=== RUN   TestDownloadOnly/v1.14.0/preload-exists

aaa_download_only_test.go:105: failed to verify preloaded tarball file exists: stat /Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v14-v1.14.0-docker-overlay2-amd64.tar.lz4: no such file or directory

--- FAIL: TestDownloadOnly/v1.14.0/preload-exists (0.18s)

=== RUN   TestCertOptions

=== PAUSE TestCertOptions

=== CONT  TestCertOptions

cert_options_test.go:50: (dbg) Run:  out/minikube-darwin-amd64 start -p cert-options-20211117171058-31976 --memory=2048 --apiserver-ips=127.0.0.1 --apiserver-ips=192.168.15.15 --apiserver-names=localhost --apiserver-names=www.google.com --apiserver-port=8555 --driver=docker  --apiserver-name=localhost

cert_options_test.go:50: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p cert-options-20211117171058-31976 --memory=2048 --apiserver-ips=127.0.0.1 --apiserver-ips=192.168.15.15 --apiserver-names=localhost --apiserver-names=www.google.com --apiserver-port=8555 --driver=docker  --apiserver-name=localhost: exit status 69 (407.00252ms)

-- stdout --

	* [cert-options-20211117171058-31976] minikube v1.24.0 on Darwin 11.2.3

	  - MINIKUBE_LOCATION=12739

	  - KUBECONFIG=/Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/kubeconfig

	  - MINIKUBE_BIN=out/minikube-darwin-amd64

	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube

	* Using the docker driver based on user configuration

-- /stdout --

** stderr ** 

	X Exiting due to PROVIDER_DOCKER_VERSION_EXIT_1: "docker version --format -" exit status 1: Error response from daemon: Bad response from Docker engine

	* Documentation: https://minikube.sigs.k8s.io/docs/drivers/docker/

** /stderr **

cert_options_test.go:52: failed to start minikube with args: "out/minikube-darwin-amd64 start -p cert-options-20211117171058-31976 --memory=2048 --apiserver-ips=127.0.0.1 --apiserver-ips=192.168.15.15 --apiserver-names=localhost --apiserver-names=www.google.com --apiserver-port=8555 --driver=docker  --apiserver-name=localhost" : exit status 69

cert_options_test.go:61: (dbg) Run:  out/minikube-darwin-amd64 -p cert-options-20211117171058-31976 ssh "openssl x509 -text -noout -in /var/lib/minikube/certs/apiserver.crt"

cert_options_test.go:61: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p cert-options-20211117171058-31976 ssh "openssl x509 -text -noout -in /var/lib/minikube/certs/apiserver.crt": exit status 85 (94.144614ms)

-- stdout --

	* Profile "cert-options-20211117171058-31976" not found. Run "minikube profile list" to view all profiles.

	  To start a cluster, run: "minikube start -p cert-options-20211117171058-31976"

-- /stdout --

cert_options_test.go:63: failed to read apiserver cert inside minikube. args "out/minikube-darwin-amd64 -p cert-options-20211117171058-31976 ssh \"openssl x509 -text -noout -in /var/lib/minikube/certs/apiserver.crt\"": exit status 85

cert_options_test.go:70: apiserver cert does not include 127.0.0.1 in SAN.

cert_options_test.go:70: apiserver cert does not include 192.168.15.15 in SAN.

cert_options_test.go:70: apiserver cert does not include localhost in SAN.

cert_options_test.go:70: apiserver cert does not include www.google.com in SAN.

cert_options_test.go:83: failed to inspect container for the port get port 8555 for "cert-options-20211117171058-31976": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "8555/tcp") 0).HostPort}}'" cert-options-20211117171058-31976: exit status 1

stdout:

stderr:

Error response from daemon: Bad response from Docker engine

cert_options_test.go:86: expected to get a non-zero forwarded port but got 0

cert_options_test.go:101: (dbg) Run:  out/minikube-darwin-amd64 ssh -p cert-options-20211117171058-31976 -- "sudo cat /etc/kubernetes/admin.conf"

cert_options_test.go:101: (dbg) Non-zero exit: out/minikube-darwin-amd64 ssh -p cert-options-20211117171058-31976 -- "sudo cat /etc/kubernetes/admin.conf": exit status 85 (94.71636ms)

-- stdout --

	* Profile "cert-options-20211117171058-31976" not found. Run "minikube profile list" to view all profiles.

	  To start a cluster, run: "minikube start -p cert-options-20211117171058-31976"

-- /stdout --

cert_options_test.go:103: failed to SSH to minikube with args: "out/minikube-darwin-amd64 ssh -p cert-options-20211117171058-31976 -- \"sudo cat /etc/kubernetes/admin.conf\"" : exit status 85

cert_options_test.go:107: Internal minikube kubeconfig (admin.conf) does not containe the right api port. 

-- stdout --

	* Profile "cert-options-20211117171058-31976" not found. Run "minikube profile list" to view all profiles.

	  To start a cluster, run: "minikube start -p cert-options-20211117171058-31976"

-- /stdout --

cert_options_test.go:110: *** TestCertOptions FAILED at 2021-11-17 17:10:59.016564 -0800 PST m=+3630.811482287

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:230: ======>  post-mortem[TestCertOptions]: docker inspect <======

helpers_test.go:231: (dbg) Run:  docker inspect cert-options-20211117171058-31976

helpers_test.go:231: (dbg) Non-zero exit: docker inspect cert-options-20211117171058-31976: exit status 1 (114.176021ms)

-- stdout --

	[]

-- /stdout --

** stderr ** 

	Error response from daemon: Bad response from Docker engine

** /stderr **

helpers_test.go:233: failed to get docker inspect: exit status 1

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p cert-options-20211117171058-31976 -n cert-options-20211117171058-31976

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p cert-options-20211117171058-31976 -n cert-options-20211117171058-31976: exit status 85 (93.65986ms)

-- stdout --

	* Profile "cert-options-20211117171058-31976" not found. Run "minikube profile list" to view all profiles.

	  To start a cluster, run: "minikube start -p cert-options-20211117171058-31976"

-- /stdout --

helpers_test.go:239: status error: exit status 85 (may be ok)

helpers_test.go:241: "cert-options-20211117171058-31976" host is not running, skipping log retrieval (state="* Profile \"cert-options-20211117171058-31976\" not found. Run \"minikube profile list\" to view all profiles.\n  To start a cluster, run: \"minikube start -p cert-options-20211117171058-31976\"")

helpers_test.go:175: Cleaning up "cert-options-20211117171058-31976" profile ...

helpers_test.go:178: (dbg) Run:  out/minikube-darwin-amd64 delete -p cert-options-20211117171058-31976

--- FAIL: TestCertOptions (1.59s)

=== RUN   TestCertExpiration

=== PAUSE TestCertExpiration

=== CONT  TestCertExpiration

cert_options_test.go:124: (dbg) Run:  out/minikube-darwin-amd64 start -p cert-expiration-20211117171050-31976 --memory=2048 --cert-expiration=3m --driver=docker 

* Downloading driver docker-machine-driver-hyperkit:

cert_options_test.go:124: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p cert-expiration-20211117171050-31976 --memory=2048 --cert-expiration=3m --driver=docker : exit status 69 (454.467578ms)

-- stdout --

	* [cert-expiration-20211117171050-31976] minikube v1.24.0 on Darwin 11.2.3

	  - MINIKUBE_LOCATION=12739

	  - KUBECONFIG=/Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/kubeconfig

	  - MINIKUBE_BIN=out/minikube-darwin-amd64

	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube

	* Using the docker driver based on user configuration

-- /stdout --

** stderr ** 

	X Exiting due to PROVIDER_DOCKER_VERSION_EXIT_1: "docker version --format -" exit status 1: Error response from daemon: Bad response from Docker engine

	* Documentation: https://minikube.sigs.k8s.io/docs/drivers/docker/

** /stderr **

cert_options_test.go:126: failed to start minikube with args: "out/minikube-darwin-amd64 start -p cert-expiration-20211117171050-31976 --memory=2048 --cert-expiration=3m --driver=docker " : exit status 69

* The 'hyperkit' driver requires elevated permissions. The following commands will be executed:

$ sudo chown root:wheel /var/folders/xd/3vdzn10d2gb_wxr7lj_p8h5c0000gp/T/upgrade-v1.2.0-to-current1498606143/.minikube/bin/docker-machine-driver-hyperkit 

$ sudo chmod u+s /var/folders/xd/3vdzn10d2gb_wxr7lj_p8h5c0000gp/T/upgrade-v1.2.0-to-current1498606143/.minikube/bin/docker-machine-driver-hyperkit 

! Unable to update hyperkit driver: [sudo chown root:wheel /var/folders/xd/3vdzn10d2gb_wxr7lj_p8h5c0000gp/T/upgrade-v1.2.0-to-current1498606143/.minikube/bin/docker-machine-driver-hyperkit] requires a password, and --interactive=false

* Downloading VM boot image ...

* Starting control plane node minikube in cluster minikube

* Download complete!

=== CONT  TestCertExpiration

cert_options_test.go:132: (dbg) Run:  out/minikube-darwin-amd64 start -p cert-expiration-20211117171050-31976 --memory=2048 --cert-expiration=8760h --driver=docker 

cert_options_test.go:132: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p cert-expiration-20211117171050-31976 --memory=2048 --cert-expiration=8760h --driver=docker : exit status 69 (431.564505ms)

-- stdout --

	* [cert-expiration-20211117171050-31976] minikube v1.24.0 on Darwin 11.2.3

	  - MINIKUBE_LOCATION=12739

	  - KUBECONFIG=/Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/kubeconfig

	  - MINIKUBE_BIN=out/minikube-darwin-amd64

	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube

	* Using the docker driver based on user configuration

-- /stdout --

** stderr ** 

	X Exiting due to PROVIDER_DOCKER_VERSION_EXIT_1: "docker version --format -" exit status 1: Error response from daemon: Bad response from Docker engine

	* Documentation: https://minikube.sigs.k8s.io/docs/drivers/docker/

** /stderr **

cert_options_test.go:134: failed to start minikube after cert expiration: "out/minikube-darwin-amd64 start -p cert-expiration-20211117171050-31976 --memory=2048 --cert-expiration=8760h --driver=docker " : exit status 69

cert_options_test.go:137: minikube start output did not warn about expired certs: 

-- stdout --

	* [cert-expiration-20211117171050-31976] minikube v1.24.0 on Darwin 11.2.3

	  - MINIKUBE_LOCATION=12739

	  - KUBECONFIG=/Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/kubeconfig

	  - MINIKUBE_BIN=out/minikube-darwin-amd64

	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube

	* Using the docker driver based on user configuration

-- /stdout --

** stderr ** 

	X Exiting due to PROVIDER_DOCKER_VERSION_EXIT_1: "docker version --format -" exit status 1: Error response from daemon: Bad response from Docker engine

	* Documentation: https://minikube.sigs.k8s.io/docs/drivers/docker/

** /stderr **

cert_options_test.go:139: *** TestCertExpiration FAILED at 2021-11-17 17:13:51.808904 -0800 PST m=+3803.599616588

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:230: ======>  post-mortem[TestCertExpiration]: docker inspect <======

helpers_test.go:231: (dbg) Run:  docker inspect cert-expiration-20211117171050-31976

helpers_test.go:231: (dbg) Non-zero exit: docker inspect cert-expiration-20211117171050-31976: exit status 1 (119.422176ms)

-- stdout --

	[]

-- /stdout --

** stderr ** 

	Error response from daemon: Bad response from Docker engine

** /stderr **

helpers_test.go:233: failed to get docker inspect: exit status 1

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p cert-expiration-20211117171050-31976 -n cert-expiration-20211117171050-31976

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p cert-expiration-20211117171050-31976 -n cert-expiration-20211117171050-31976: exit status 85 (95.477949ms)

-- stdout --

	* Profile "cert-expiration-20211117171050-31976" not found. Run "minikube profile list" to view all profiles.

	  To start a cluster, run: "minikube start -p cert-expiration-20211117171050-31976"

-- /stdout --

helpers_test.go:239: status error: exit status 85 (may be ok)

helpers_test.go:241: "cert-expiration-20211117171050-31976" host is not running, skipping log retrieval (state="* Profile \"cert-expiration-20211117171050-31976\" not found. Run \"minikube profile list\" to view all profiles.\n  To start a cluster, run: \"minikube start -p cert-expiration-20211117171050-31976\"")

helpers_test.go:175: Cleaning up "cert-expiration-20211117171050-31976" profile ...

helpers_test.go:178: (dbg) Run:  out/minikube-darwin-amd64 delete -p cert-expiration-20211117171050-31976

--- FAIL: TestCertExpiration (181.77s)

=== RUN   TestDockerFlags

=== PAUSE TestDockerFlags

=== CONT  TestDockerFlags

docker_test.go:46: (dbg) Run:  out/minikube-darwin-amd64 start -p docker-flags-20211117171056-31976 --cache-images=false --memory=2048 --install-addons=false --wait=false --docker-env=FOO=BAR --docker-env=BAZ=BAT --docker-opt=debug --docker-opt=icc=true --alsologtostderr -v=5 --driver=docker 

docker_test.go:46: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p docker-flags-20211117171056-31976 --cache-images=false --memory=2048 --install-addons=false --wait=false --docker-env=FOO=BAR --docker-env=BAZ=BAT --docker-opt=debug --docker-opt=icc=true --alsologtostderr -v=5 --driver=docker : exit status 69 (433.006961ms)

-- stdout --

	* [docker-flags-20211117171056-31976] minikube v1.24.0 on Darwin 11.2.3

	  - MINIKUBE_LOCATION=12739

	  - KUBECONFIG=/Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/kubeconfig

	  - MINIKUBE_BIN=out/minikube-darwin-amd64

	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube

	* Using the docker driver based on user configuration

-- /stdout --

** stderr ** 

	I1117 17:10:56.782673   43987 out.go:297] Setting OutFile to fd 1 ...

	I1117 17:10:56.782801   43987 out.go:344] TERM=,COLORTERM=, which probably does not support color

	I1117 17:10:56.782806   43987 out.go:310] Setting ErrFile to fd 2...

	I1117 17:10:56.782809   43987 out.go:344] TERM=,COLORTERM=, which probably does not support color

	I1117 17:10:56.782883   43987 root.go:315] Updating PATH: /Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/bin

	I1117 17:10:56.783191   43987 out.go:304] Setting JSON to false

	I1117 17:10:56.808353   43987 start.go:112] hostinfo: {"hostname":"37310.local","uptime":11431,"bootTime":1637186425,"procs":360,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"11.2.3","kernelVersion":"20.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"bd1c05a8-24a6-5973-aa69-f3c7c66a87ce"}

	W1117 17:10:56.808448   43987 start.go:120] gopshost.Virtualization returned error: not implemented yet

	I1117 17:10:56.835635   43987 out.go:176] * [docker-flags-20211117171056-31976] minikube v1.24.0 on Darwin 11.2.3

	I1117 17:10:56.835894   43987 notify.go:174] Checking for updates...

	I1117 17:10:56.884388   43987 out.go:176]   - MINIKUBE_LOCATION=12739

	I1117 17:10:56.910377   43987 out.go:176]   - KUBECONFIG=/Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/kubeconfig

	I1117 17:10:56.936140   43987 out.go:176]   - MINIKUBE_BIN=out/minikube-darwin-amd64

	I1117 17:10:56.962110   43987 out.go:176]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube

	I1117 17:10:56.962362   43987 driver.go:343] Setting default libvirt URI to qemu:///system

	W1117 17:10:57.052387   43987 docker.go:108] docker version returned error: exit status 1

	I1117 17:10:57.079303   43987 out.go:176] * Using the docker driver based on user configuration

	I1117 17:10:57.079361   43987 start.go:280] selected driver: docker

	I1117 17:10:57.079378   43987 start.go:775] validating driver "docker" against <nil>

	I1117 17:10:57.079404   43987 start.go:786] status for docker: {Installed:true Healthy:false Running:true NeedsImprovement:false Error:"docker version --format {{.Server.Os}}-{{.Server.Version}}" exit status 1: Error response from daemon: Bad response from Docker engine Reason:PROVIDER_DOCKER_VERSION_EXIT_1 Fix: Doc:https://minikube.sigs.k8s.io/docs/drivers/docker/}

	I1117 17:10:57.128044   43987 out.go:176] 

	W1117 17:10:57.128243   43987 out.go:241] X Exiting due to PROVIDER_DOCKER_VERSION_EXIT_1: "docker version --format -" exit status 1: Error response from daemon: Bad response from Docker engine

	X Exiting due to PROVIDER_DOCKER_VERSION_EXIT_1: "docker version --format -" exit status 1: Error response from daemon: Bad response from Docker engine

	W1117 17:10:57.128309   43987 out.go:241] * Documentation: https://minikube.sigs.k8s.io/docs/drivers/docker/

	* Documentation: https://minikube.sigs.k8s.io/docs/drivers/docker/

	I1117 17:10:57.154080   43987 out.go:176] 

** /stderr **

docker_test.go:48: failed to start minikube with args: "out/minikube-darwin-amd64 start -p docker-flags-20211117171056-31976 --cache-images=false --memory=2048 --install-addons=false --wait=false --docker-env=FOO=BAR --docker-env=BAZ=BAT --docker-opt=debug --docker-opt=icc=true --alsologtostderr -v=5 --driver=docker " : exit status 69

docker_test.go:51: (dbg) Run:  out/minikube-darwin-amd64 -p docker-flags-20211117171056-31976 ssh "sudo systemctl show docker --property=Environment --no-pager"

docker_test.go:51: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p docker-flags-20211117171056-31976 ssh "sudo systemctl show docker --property=Environment --no-pager": exit status 85 (95.205902ms)

-- stdout --

	* Profile "docker-flags-20211117171056-31976" not found. Run "minikube profile list" to view all profiles.

	  To start a cluster, run: "minikube start -p docker-flags-20211117171056-31976"

-- /stdout --

docker_test.go:53: failed to 'systemctl show docker' inside minikube. args "out/minikube-darwin-amd64 -p docker-flags-20211117171056-31976 ssh \"sudo systemctl show docker --property=Environment --no-pager\"": exit status 85

docker_test.go:58: expected env key/value "FOO=BAR" to be passed to minikube's docker and be included in: *"* Profile \"docker-flags-20211117171056-31976\" not found. Run \"minikube profile list\" to view all profiles.\n  To start a cluster, run: \"minikube start -p docker-flags-20211117171056-31976\"\n"*.

docker_test.go:58: expected env key/value "BAZ=BAT" to be passed to minikube's docker and be included in: *"* Profile \"docker-flags-20211117171056-31976\" not found. Run \"minikube profile list\" to view all profiles.\n  To start a cluster, run: \"minikube start -p docker-flags-20211117171056-31976\"\n"*.

docker_test.go:62: (dbg) Run:  out/minikube-darwin-amd64 -p docker-flags-20211117171056-31976 ssh "sudo systemctl show docker --property=ExecStart --no-pager"

docker_test.go:62: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p docker-flags-20211117171056-31976 ssh "sudo systemctl show docker --property=ExecStart --no-pager": exit status 85 (93.72835ms)

-- stdout --

	* Profile "docker-flags-20211117171056-31976" not found. Run "minikube profile list" to view all profiles.

	  To start a cluster, run: "minikube start -p docker-flags-20211117171056-31976"

-- /stdout --

docker_test.go:64: failed on the second 'systemctl show docker' inside minikube. args "out/minikube-darwin-amd64 -p docker-flags-20211117171056-31976 ssh \"sudo systemctl show docker --property=ExecStart --no-pager\"": exit status 85

docker_test.go:68: expected "out/minikube-darwin-amd64 -p docker-flags-20211117171056-31976 ssh \"sudo systemctl show docker --property=ExecStart --no-pager\"" output to have include *--debug* . output: "* Profile \"docker-flags-20211117171056-31976\" not found. Run \"minikube profile list\" to view all profiles.\n  To start a cluster, run: \"minikube start -p docker-flags-20211117171056-31976\"\n"

panic.go:642: *** TestDockerFlags FAILED at 2021-11-17 17:10:57.366257 -0800 PST m=+3629.161215269

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:230: ======>  post-mortem[TestDockerFlags]: docker inspect <======

helpers_test.go:231: (dbg) Run:  docker inspect docker-flags-20211117171056-31976

helpers_test.go:231: (dbg) Non-zero exit: docker inspect docker-flags-20211117171056-31976: exit status 1 (115.539666ms)

-- stdout --

	[]

-- /stdout --

** stderr ** 

	Error response from daemon: Bad response from Docker engine

** /stderr **

helpers_test.go:233: failed to get docker inspect: exit status 1

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p docker-flags-20211117171056-31976 -n docker-flags-20211117171056-31976

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p docker-flags-20211117171056-31976 -n docker-flags-20211117171056-31976: exit status 85 (94.567169ms)

-- stdout --

	* Profile "docker-flags-20211117171056-31976" not found. Run "minikube profile list" to view all profiles.

	  To start a cluster, run: "minikube start -p docker-flags-20211117171056-31976"

-- /stdout --

helpers_test.go:239: status error: exit status 85 (may be ok)

helpers_test.go:241: "docker-flags-20211117171056-31976" host is not running, skipping log retrieval (state="* Profile \"docker-flags-20211117171056-31976\" not found. Run \"minikube profile list\" to view all profiles.\n  To start a cluster, run: \"minikube start -p docker-flags-20211117171056-31976\"")

helpers_test.go:175: Cleaning up "docker-flags-20211117171056-31976" profile ...

helpers_test.go:178: (dbg) Run:  out/minikube-darwin-amd64 delete -p docker-flags-20211117171056-31976

--- FAIL: TestDockerFlags (1.56s)

=== RUN   TestForceSystemdFlag

=== PAUSE TestForceSystemdFlag

=== CONT  TestForceSystemdFlag

docker_test.go:86: (dbg) Run:  out/minikube-darwin-amd64 start -p force-systemd-flag-20211117171036-31976 --memory=2048 --force-systemd --alsologtostderr -v=5 --driver=docker 

docker_test.go:86: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p force-systemd-flag-20211117171036-31976 --memory=2048 --force-systemd --alsologtostderr -v=5 --driver=docker : exit status 69 (408.594741ms)

-- stdout --

	* [force-systemd-flag-20211117171036-31976] minikube v1.24.0 on Darwin 11.2.3

	  - MINIKUBE_LOCATION=12739

	  - KUBECONFIG=/Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/kubeconfig

	  - MINIKUBE_BIN=out/minikube-darwin-amd64

	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube

	* Using the docker driver based on user configuration

-- /stdout --

** stderr ** 

	I1117 17:10:36.603581   43838 out.go:297] Setting OutFile to fd 1 ...

	I1117 17:10:36.603723   43838 out.go:344] TERM=,COLORTERM=, which probably does not support color

	I1117 17:10:36.603728   43838 out.go:310] Setting ErrFile to fd 2...

	I1117 17:10:36.603731   43838 out.go:344] TERM=,COLORTERM=, which probably does not support color

	I1117 17:10:36.603807   43838 root.go:315] Updating PATH: /Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/bin

	I1117 17:10:36.604110   43838 out.go:304] Setting JSON to false

	I1117 17:10:36.629160   43838 start.go:112] hostinfo: {"hostname":"37310.local","uptime":11411,"bootTime":1637186425,"procs":361,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"11.2.3","kernelVersion":"20.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"bd1c05a8-24a6-5973-aa69-f3c7c66a87ce"}

	W1117 17:10:36.629247   43838 start.go:120] gopshost.Virtualization returned error: not implemented yet

	I1117 17:10:36.656664   43838 out.go:176] * [force-systemd-flag-20211117171036-31976] minikube v1.24.0 on Darwin 11.2.3

	I1117 17:10:36.656854   43838 notify.go:174] Checking for updates...

	I1117 17:10:36.682940   43838 out.go:176]   - MINIKUBE_LOCATION=12739

	I1117 17:10:36.709455   43838 out.go:176]   - KUBECONFIG=/Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/kubeconfig

	I1117 17:10:36.735835   43838 out.go:176]   - MINIKUBE_BIN=out/minikube-darwin-amd64

	I1117 17:10:36.762150   43838 out.go:176]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube

	I1117 17:10:36.762585   43838 config.go:176] Loaded profile config "running-upgrade-20211117170725-31976": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.18.0

	I1117 17:10:36.762616   43838 driver.go:343] Setting default libvirt URI to qemu:///system

	W1117 17:10:36.847683   43838 docker.go:108] docker version returned error: exit status 1

	I1117 17:10:36.874749   43838 out.go:176] * Using the docker driver based on user configuration

	I1117 17:10:36.874834   43838 start.go:280] selected driver: docker

	I1117 17:10:36.874850   43838 start.go:775] validating driver "docker" against <nil>

	I1117 17:10:36.874874   43838 start.go:786] status for docker: {Installed:true Healthy:false Running:true NeedsImprovement:false Error:"docker version --format {{.Server.Os}}-{{.Server.Version}}" exit status 1: Error response from daemon: Bad response from Docker engine Reason:PROVIDER_DOCKER_VERSION_EXIT_1 Fix: Doc:https://minikube.sigs.k8s.io/docs/drivers/docker/}

	I1117 17:10:36.923267   43838 out.go:176] 

	W1117 17:10:36.923457   43838 out.go:241] X Exiting due to PROVIDER_DOCKER_VERSION_EXIT_1: "docker version --format -" exit status 1: Error response from daemon: Bad response from Docker engine

	X Exiting due to PROVIDER_DOCKER_VERSION_EXIT_1: "docker version --format -" exit status 1: Error response from daemon: Bad response from Docker engine

	W1117 17:10:36.923541   43838 out.go:241] * Documentation: https://minikube.sigs.k8s.io/docs/drivers/docker/

	* Documentation: https://minikube.sigs.k8s.io/docs/drivers/docker/

	I1117 17:10:36.949439   43838 out.go:176] 

** /stderr **

docker_test.go:88: failed to start minikube with args: "out/minikube-darwin-amd64 start -p force-systemd-flag-20211117171036-31976 --memory=2048 --force-systemd --alsologtostderr -v=5 --driver=docker " : exit status 69

docker_test.go:105: (dbg) Run:  out/minikube-darwin-amd64 -p force-systemd-flag-20211117171036-31976 ssh "docker info --format {{.CgroupDriver}}"

docker_test.go:105: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p force-systemd-flag-20211117171036-31976 ssh "docker info --format {{.CgroupDriver}}": exit status 85 (94.446069ms)

-- stdout --

	* Profile "force-systemd-flag-20211117171036-31976" not found. Run "minikube profile list" to view all profiles.

	  To start a cluster, run: "minikube start -p force-systemd-flag-20211117171036-31976"

-- /stdout --

docker_test.go:107: failed to get docker cgroup driver. args "out/minikube-darwin-amd64 -p force-systemd-flag-20211117171036-31976 ssh \"docker info --format {{.CgroupDriver}}\"": exit status 85

docker_test.go:101: *** TestForceSystemdFlag FAILED at 2021-11-17 17:10:37.066465 -0800 PST m=+3608.861917386

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:230: ======>  post-mortem[TestForceSystemdFlag]: docker inspect <======

helpers_test.go:231: (dbg) Run:  docker inspect force-systemd-flag-20211117171036-31976

helpers_test.go:231: (dbg) Non-zero exit: docker inspect force-systemd-flag-20211117171036-31976: exit status 1 (115.719145ms)

-- stdout --

	[]

-- /stdout --

** stderr ** 

	Error response from daemon: Bad response from Docker engine

** /stderr **

helpers_test.go:233: failed to get docker inspect: exit status 1

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p force-systemd-flag-20211117171036-31976 -n force-systemd-flag-20211117171036-31976

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p force-systemd-flag-20211117171036-31976 -n force-systemd-flag-20211117171036-31976: exit status 85 (94.122078ms)

-- stdout --

	* Profile "force-systemd-flag-20211117171036-31976" not found. Run "minikube profile list" to view all profiles.

	  To start a cluster, run: "minikube start -p force-systemd-flag-20211117171036-31976"

-- /stdout --

helpers_test.go:239: status error: exit status 85 (may be ok)

helpers_test.go:241: "force-systemd-flag-20211117171036-31976" host is not running, skipping log retrieval (state="* Profile \"force-systemd-flag-20211117171036-31976\" not found. Run \"minikube profile list\" to view all profiles.\n  To start a cluster, run: \"minikube start -p force-systemd-flag-20211117171036-31976\"")

helpers_test.go:175: Cleaning up "force-systemd-flag-20211117171036-31976" profile ...

helpers_test.go:178: (dbg) Run:  out/minikube-darwin-amd64 delete -p force-systemd-flag-20211117171036-31976

--- FAIL: TestForceSystemdFlag (1.51s)

=== RUN   TestForceSystemdEnv

=== PAUSE TestForceSystemdEnv

=== CONT  TestForceSystemdEnv

docker_test.go:151: (dbg) Run:  out/minikube-darwin-amd64 start -p force-systemd-env-20211117171048-31976 --memory=2048 --alsologtostderr -v=5 --driver=docker 

docker_test.go:151: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p force-systemd-env-20211117171048-31976 --memory=2048 --alsologtostderr -v=5 --driver=docker : exit status 69 (738.149967ms)

-- stdout --

	* [force-systemd-env-20211117171048-31976] minikube v1.24.0 on Darwin 11.2.3

	  - MINIKUBE_LOCATION=12739

	  - KUBECONFIG=/Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/kubeconfig

	  - MINIKUBE_BIN=out/minikube-darwin-amd64

	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube

	  - MINIKUBE_FORCE_SYSTEMD=true

	* Using the docker driver based on user configuration

-- /stdout --

** stderr ** 

	I1117 17:10:48.788112   43939 out.go:297] Setting OutFile to fd 1 ...

	I1117 17:10:48.788350   43939 out.go:344] TERM=,COLORTERM=, which probably does not support color

	I1117 17:10:48.788354   43939 out.go:310] Setting ErrFile to fd 2...

	I1117 17:10:48.788358   43939 out.go:344] TERM=,COLORTERM=, which probably does not support color

	I1117 17:10:48.788443   43939 root.go:315] Updating PATH: /Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/bin

	I1117 17:10:48.788777   43939 out.go:304] Setting JSON to false

	I1117 17:10:48.858069   43939 start.go:112] hostinfo: {"hostname":"37310.local","uptime":11423,"bootTime":1637186425,"procs":360,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"11.2.3","kernelVersion":"20.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"bd1c05a8-24a6-5973-aa69-f3c7c66a87ce"}

	W1117 17:10:48.858177   43939 start.go:120] gopshost.Virtualization returned error: not implemented yet

	I1117 17:10:48.898935   43939 out.go:176] * [force-systemd-env-20211117171048-31976] minikube v1.24.0 on Darwin 11.2.3

	I1117 17:10:48.899128   43939 notify.go:174] Checking for updates...

	I1117 17:10:48.945939   43939 out.go:176]   - MINIKUBE_LOCATION=12739

	I1117 17:10:49.013207   43939 out.go:176]   - KUBECONFIG=/Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/kubeconfig

	I1117 17:10:49.073223   43939 out.go:176]   - MINIKUBE_BIN=out/minikube-darwin-amd64

	I1117 17:10:49.148059   43939 out.go:176]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube

	I1117 17:10:49.188712   43939 out.go:176]   - MINIKUBE_FORCE_SYSTEMD=true

	I1117 17:10:49.189113   43939 driver.go:343] Setting default libvirt URI to qemu:///system

	W1117 17:10:49.304399   43939 docker.go:108] docker version returned error: exit status 1

	I1117 17:10:49.394221   43939 out.go:176] * Using the docker driver based on user configuration

	I1117 17:10:49.394268   43939 start.go:280] selected driver: docker

	I1117 17:10:49.394287   43939 start.go:775] validating driver "docker" against <nil>

	I1117 17:10:49.394327   43939 start.go:786] status for docker: {Installed:true Healthy:false Running:true NeedsImprovement:false Error:"docker version --format {{.Server.Os}}-{{.Server.Version}}" exit status 1: Error response from daemon: Bad response from Docker engine Reason:PROVIDER_DOCKER_VERSION_EXIT_1 Fix: Doc:https://minikube.sigs.k8s.io/docs/drivers/docker/}

	I1117 17:10:49.433197   43939 out.go:176] 

	W1117 17:10:49.433393   43939 out.go:241] X Exiting due to PROVIDER_DOCKER_VERSION_EXIT_1: "docker version --format -" exit status 1: Error response from daemon: Bad response from Docker engine

	X Exiting due to PROVIDER_DOCKER_VERSION_EXIT_1: "docker version --format -" exit status 1: Error response from daemon: Bad response from Docker engine

	W1117 17:10:49.433474   43939 out.go:241] * Documentation: https://minikube.sigs.k8s.io/docs/drivers/docker/

	* Documentation: https://minikube.sigs.k8s.io/docs/drivers/docker/

	I1117 17:10:49.460167   43939 out.go:176] 

** /stderr **

docker_test.go:153: failed to start minikube with args: "out/minikube-darwin-amd64 start -p force-systemd-env-20211117171048-31976 --memory=2048 --alsologtostderr -v=5 --driver=docker " : exit status 69

docker_test.go:105: (dbg) Run:  out/minikube-darwin-amd64 -p force-systemd-env-20211117171048-31976 ssh "docker info --format {{.CgroupDriver}}"

docker_test.go:105: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p force-systemd-env-20211117171048-31976 ssh "docker info --format {{.CgroupDriver}}": exit status 85 (182.359099ms)

-- stdout --

	* Profile "force-systemd-env-20211117171048-31976" not found. Run "minikube profile list" to view all profiles.

	  To start a cluster, run: "minikube start -p force-systemd-env-20211117171048-31976"

-- /stdout --

docker_test.go:107: failed to get docker cgroup driver. args "out/minikube-darwin-amd64 -p force-systemd-env-20211117171048-31976 ssh \"docker info --format {{.CgroupDriver}}\"": exit status 85

docker_test.go:162: *** TestForceSystemdEnv FAILED at 2021-11-17 17:10:49.665279 -0800 PST m=+3621.460425252

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:230: ======>  post-mortem[TestForceSystemdEnv]: docker inspect <======

helpers_test.go:231: (dbg) Run:  docker inspect force-systemd-env-20211117171048-31976

helpers_test.go:231: (dbg) Non-zero exit: docker inspect force-systemd-env-20211117171048-31976: exit status 1 (170.829372ms)

-- stdout --

	[]

-- /stdout --

** stderr ** 

	Error response from daemon: Bad response from Docker engine

** /stderr **

helpers_test.go:233: failed to get docker inspect: exit status 1

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p force-systemd-env-20211117171048-31976 -n force-systemd-env-20211117171048-31976

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p force-systemd-env-20211117171048-31976 -n force-systemd-env-20211117171048-31976: exit status 85 (146.879084ms)

-- stdout --

	* Profile "force-systemd-env-20211117171048-31976" not found. Run "minikube profile list" to view all profiles.

	  To start a cluster, run: "minikube start -p force-systemd-env-20211117171048-31976"

-- /stdout --

helpers_test.go:239: status error: exit status 85 (may be ok)

helpers_test.go:241: "force-systemd-env-20211117171048-31976" host is not running, skipping log retrieval (state="* Profile \"force-systemd-env-20211117171048-31976\" not found. Run \"minikube profile list\" to view all profiles.\n  To start a cluster, run: \"minikube start -p force-systemd-env-20211117171048-31976\"")

helpers_test.go:175: Cleaning up "force-systemd-env-20211117171048-31976" profile ...

helpers_test.go:178: (dbg) Run:  out/minikube-darwin-amd64 delete -p force-systemd-env-20211117171048-31976

* minikube v1.24.0 on darwin

- MINIKUBE_LOCATION=12739

- KUBECONFIG=/Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/kubeconfig

- MINIKUBE_BIN=out/minikube-darwin-amd64

- MINIKUBE_HOME=/var/folders/xd/3vdzn10d2gb_wxr7lj_p8h5c0000gp/T/upgrade-v1.2.0-to-current1498606143

* Using the hyperkit driver based on user configuration

--- FAIL: TestForceSystemdEnv (2.17s)

=== RUN   TestFunctional/serial/CacheCmd/cache/add_remote

functional_test.go:983: (dbg) Run:  out/minikube-darwin-amd64 -p functional-20211117161858-31976 cache add k8s.gcr.io/pause:3.1

functional_test.go:983: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-20211117161858-31976 cache add k8s.gcr.io/pause:3.1: exit status 10 (102.039783ms)

-- stdout --

-- /stdout --

** stderr ** 

	! "minikube cache" will be deprecated in upcoming versions, please switch to "minikube image load"

	X Exiting due to MK_CACHE_LOAD: save to dir: caching images: caching image "/Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/cache/images/k8s.gcr.io/pause_3.1": write: unable to calculate manifest: Error: No such image: k8s.gcr.io/pause:3.1

	* 

	╭──────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                                                          │

	│    * If the above advice does not help, please let us know:                                                              │

	│      https://github.com/kubernetes/minikube/issues/new/choose                                                            │

	│                                                                                                                          │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                 │

	│    * Please also attach the following file to the GitHub issue:                                                          │

	│    * - /var/folders/xd/3vdzn10d2gb_wxr7lj_p8h5c0000gp/T/minikube_cache_1ee7f0edc085faba6c5c2cd5567d37f230636116_0.log    │

	│                                                                                                                          │

	╰──────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯

** /stderr **

functional_test.go:985: failed to 'cache add' remote image "k8s.gcr.io/pause:3.1". args "out/minikube-darwin-amd64 -p functional-20211117161858-31976 cache add k8s.gcr.io/pause:3.1" err exit status 10

functional_test.go:983: (dbg) Run:  out/minikube-darwin-amd64 -p functional-20211117161858-31976 cache add k8s.gcr.io/pause:3.3

functional_test.go:983: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-20211117161858-31976 cache add k8s.gcr.io/pause:3.3: exit status 10 (100.698756ms)

-- stdout --

-- /stdout --

** stderr ** 

	! "minikube cache" will be deprecated in upcoming versions, please switch to "minikube image load"

	X Exiting due to MK_CACHE_LOAD: save to dir: caching images: caching image "/Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/cache/images/k8s.gcr.io/pause_3.3": write: unable to calculate manifest: Error: No such image: k8s.gcr.io/pause:3.3

	* 

	╭──────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                                                          │

	│    * If the above advice does not help, please let us know:                                                              │

	│      https://github.com/kubernetes/minikube/issues/new/choose                                                            │

	│                                                                                                                          │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                 │

	│    * Please also attach the following file to the GitHub issue:                                                          │

	│    * - /var/folders/xd/3vdzn10d2gb_wxr7lj_p8h5c0000gp/T/minikube_cache_de8128d312e6d2ac89c1c5074cd22b7974c28c2b_0.log    │

	│                                                                                                                          │

	╰──────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯

** /stderr **

functional_test.go:985: failed to 'cache add' remote image "k8s.gcr.io/pause:3.3". args "out/minikube-darwin-amd64 -p functional-20211117161858-31976 cache add k8s.gcr.io/pause:3.3" err exit status 10

functional_test.go:983: (dbg) Run:  out/minikube-darwin-amd64 -p functional-20211117161858-31976 cache add k8s.gcr.io/pause:latest

functional_test.go:983: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-20211117161858-31976 cache add k8s.gcr.io/pause:latest: exit status 10 (101.505248ms)

-- stdout --

-- /stdout --

** stderr ** 

	! "minikube cache" will be deprecated in upcoming versions, please switch to "minikube image load"

	X Exiting due to MK_CACHE_LOAD: save to dir: caching images: caching image "/Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/cache/images/k8s.gcr.io/pause_latest": write: unable to calculate manifest: Error: No such image: k8s.gcr.io/pause:latest

	* 

	╭──────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                                                          │

	│    * If the above advice does not help, please let us know:                                                              │

	│      https://github.com/kubernetes/minikube/issues/new/choose                                                            │

	│                                                                                                                          │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                 │

	│    * Please also attach the following file to the GitHub issue:                                                          │

	│    * - /var/folders/xd/3vdzn10d2gb_wxr7lj_p8h5c0000gp/T/minikube_cache_5aa7605f63066fc2b7f8379478b9def700202ac8_0.log    │

	│                                                                                                                          │

	╰──────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯

** /stderr **

functional_test.go:985: failed to 'cache add' remote image "k8s.gcr.io/pause:latest". args "out/minikube-darwin-amd64 -p functional-20211117161858-31976 cache add k8s.gcr.io/pause:latest" err exit status 10

--- FAIL: TestFunctional/serial/CacheCmd/cache/add_remote (0.30s)

=== RUN   TestFunctional/serial/CacheCmd/cache/delete_k8s.gcr.io/pause:3.3

functional_test.go:1039: (dbg) Run:  out/minikube-darwin-amd64 cache delete k8s.gcr.io/pause:3.3

functional_test.go:1039: (dbg) Non-zero exit: out/minikube-darwin-amd64 cache delete k8s.gcr.io/pause:3.3: exit status 30 (101.476796ms)

-- stdout --

-- /stdout --

** stderr ** 

	X Exiting due to HOST_DEL_CACHE: remove /Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/cache/images/k8s.gcr.io/pause_3.3: no such file or directory

	* 

	╭──────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                                                          │

	│    * If the above advice does not help, please let us know:                                                              │

	│      https://github.com/kubernetes/minikube/issues/new/choose                                                            │

	│                                                                                                                          │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                 │

	│    * Please also attach the following file to the GitHub issue:                                                          │

	│    * - /var/folders/xd/3vdzn10d2gb_wxr7lj_p8h5c0000gp/T/minikube_cache_e17e40910561608ab15e9700ab84b4e1db856f38_0.log    │

	│                                                                                                                          │

	╰──────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯

** /stderr **

functional_test.go:1041: failed to delete image k8s.gcr.io/pause:3.3 from cache. args "out/minikube-darwin-amd64 cache delete k8s.gcr.io/pause:3.3": exit status 30

--- FAIL: TestFunctional/serial/CacheCmd/cache/delete_k8s.gcr.io/pause:3.3 (0.10s)

=== RUN   TestFunctional/serial/CacheCmd/cache/list

functional_test.go:1047: (dbg) Run:  out/minikube-darwin-amd64 cache list

functional_test.go:1052: expected 'cache list' output to include 'k8s.gcr.io/pause' but got: ******

--- FAIL: TestFunctional/serial/CacheCmd/cache/list (0.07s)

=== RUN   TestFunctional/serial/CacheCmd/cache/verify_cache_inside_node

functional_test.go:1061: (dbg) Run:  out/minikube-darwin-amd64 -p functional-20211117161858-31976 ssh sudo crictl images

functional_test.go:1067: expected sha for pause:3.3 "0184c1613d929" to be in the output but got *

-- stdout --

	IMAGE                                     TAG                               IMAGE ID            SIZE

	gcr.io/k8s-minikube/storage-provisioner   v5                                6e38f40d628db       31.5MB

	k8s.gcr.io/coredns/coredns                v1.8.4                            8d147537fb7d1       47.6MB

	k8s.gcr.io/etcd                           3.5.0-0                           0048118155842       295MB

	k8s.gcr.io/kube-apiserver                 v1.22.3                           53224b502ea4d       128MB

	k8s.gcr.io/kube-controller-manager        v1.22.3                           05c905cef780c       122MB

	k8s.gcr.io/kube-proxy                     v1.22.3                           6120bd723dced       104MB

	k8s.gcr.io/kube-scheduler                 v1.22.3                           0aa9c7e31d307       52.7MB

	k8s.gcr.io/pause                          3.5                               ed210e3e4a5ba       683kB

	kubernetesui/dashboard                    v2.3.1                            e1482a24335a6       220MB

	kubernetesui/metrics-scraper              v1.0.7                            7801cfc6d5c07       34.4MB

	minikube-local-cache-test                 functional-20211117161858-31976   5005f91eebf03       30B

-- /stdout --*

--- FAIL: TestFunctional/serial/CacheCmd/cache/verify_cache_inside_node (0.72s)

=== RUN   TestFunctional/serial/CacheCmd/cache/cache_reload

functional_test.go:1084: (dbg) Run:  out/minikube-darwin-amd64 -p functional-20211117161858-31976 ssh sudo docker rmi k8s.gcr.io/pause:latest

functional_test.go:1084: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-20211117161858-31976 ssh sudo docker rmi k8s.gcr.io/pause:latest: exit status 1 (627.349217ms)

-- stdout --

	Error: No such image: k8s.gcr.io/pause:latest

-- /stdout --

** stderr ** 

	ssh: Process exited with status 1

** /stderr **

functional_test.go:1087: failed to manually delete image "out/minikube-darwin-amd64 -p functional-20211117161858-31976 ssh sudo docker rmi k8s.gcr.io/pause:latest" : exit status 1

functional_test.go:1090: (dbg) Run:  out/minikube-darwin-amd64 -p functional-20211117161858-31976 ssh sudo crictl inspecti k8s.gcr.io/pause:latest

functional_test.go:1090: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-20211117161858-31976 ssh sudo crictl inspecti k8s.gcr.io/pause:latest: exit status 1 (619.815773ms)

-- stdout --

	FATA[0000] no such image "k8s.gcr.io/pause:latest" present 

-- /stdout --

** stderr ** 

	ssh: Process exited with status 1

** /stderr **

functional_test.go:1095: (dbg) Run:  out/minikube-darwin-amd64 -p functional-20211117161858-31976 cache reload

functional_test.go:1100: (dbg) Run:  out/minikube-darwin-amd64 -p functional-20211117161858-31976 ssh sudo crictl inspecti k8s.gcr.io/pause:latest

functional_test.go:1100: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-20211117161858-31976 ssh sudo crictl inspecti k8s.gcr.io/pause:latest: exit status 1 (611.637806ms)

-- stdout --

	FATA[0000] no such image "k8s.gcr.io/pause:latest" present 

-- /stdout --

** stderr ** 

	ssh: Process exited with status 1

** /stderr **

functional_test.go:1102: expected "out/minikube-darwin-amd64 -p functional-20211117161858-31976 ssh sudo crictl inspecti k8s.gcr.io/pause:latest" to run successfully but got error: exit status 1

--- FAIL: TestFunctional/serial/CacheCmd/cache/cache_reload (1.93s)

=== RUN   TestFunctional/serial/CacheCmd/cache/delete

functional_test.go:1109: (dbg) Run:  out/minikube-darwin-amd64 cache delete k8s.gcr.io/pause:3.1

functional_test.go:1109: (dbg) Non-zero exit: out/minikube-darwin-amd64 cache delete k8s.gcr.io/pause:3.1: exit status 30 (98.743728ms)

-- stdout --

-- /stdout --

** stderr ** 

	X Exiting due to HOST_DEL_CACHE: remove /Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/cache/images/k8s.gcr.io/pause_3.1: no such file or directory

	* 

	╭──────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                                                          │

	│    * If the above advice does not help, please let us know:                                                              │

	│      https://github.com/kubernetes/minikube/issues/new/choose                                                            │

	│                                                                                                                          │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                 │

	│    * Please also attach the following file to the GitHub issue:                                                          │

	│    * - /var/folders/xd/3vdzn10d2gb_wxr7lj_p8h5c0000gp/T/minikube_cache_d1b33253e7334db9f364f7cea75d63fe683cad74_0.log    │

	│                                                                                                                          │

	╰──────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯

** /stderr **

functional_test.go:1111: failed to delete k8s.gcr.io/pause:3.1 from cache. args "out/minikube-darwin-amd64 cache delete k8s.gcr.io/pause:3.1": exit status 30

functional_test.go:1109: (dbg) Run:  out/minikube-darwin-amd64 cache delete k8s.gcr.io/pause:latest

functional_test.go:1109: (dbg) Non-zero exit: out/minikube-darwin-amd64 cache delete k8s.gcr.io/pause:latest: exit status 30 (99.007379ms)

-- stdout --

-- /stdout --

** stderr ** 

	X Exiting due to HOST_DEL_CACHE: remove /Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/cache/images/k8s.gcr.io/pause_latest: no such file or directory

	* 

	╭──────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                                                          │

	│    * If the above advice does not help, please let us know:                                                              │

	│      https://github.com/kubernetes/minikube/issues/new/choose                                                            │

	│                                                                                                                          │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                 │

	│    * Please also attach the following file to the GitHub issue:                                                          │

	│    * - /var/folders/xd/3vdzn10d2gb_wxr7lj_p8h5c0000gp/T/minikube_cache_d17bcf228b7a032ee268baa189bce7c5c7938c34_0.log    │

	│                                                                                                                          │

	╰──────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯

** /stderr **

functional_test.go:1111: failed to delete k8s.gcr.io/pause:latest from cache. args "out/minikube-darwin-amd64 cache delete k8s.gcr.io/pause:latest": exit status 30

--- FAIL: TestFunctional/serial/CacheCmd/cache/delete (0.20s)

=== RUN   TestFunctional/serial/ExtraConfig

functional_test.go:698: (dbg) Run:  out/minikube-darwin-amd64 start -p functional-20211117161858-31976 --extra-config=apiserver.enable-admission-plugins=NamespaceAutoProvision --wait=all

E1117 16:21:36.918341   31976 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/profiles/addons-20211117161126-31976/client.crt: no such file or directory

functional_test.go:698: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p functional-20211117161858-31976 --extra-config=apiserver.enable-admission-plugins=NamespaceAutoProvision --wait=all: exit status 80 (26.823423081s)

-- stdout --

	* [functional-20211117161858-31976] minikube v1.24.0 on Darwin 11.2.3

	  - MINIKUBE_LOCATION=12739

	  - KUBECONFIG=/Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/kubeconfig

	  - MINIKUBE_BIN=out/minikube-darwin-amd64

	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube

	* Using the docker driver based on existing profile

	* Starting control plane node functional-20211117161858-31976 in cluster functional-20211117161858-31976

	* Pulling base image ...

	* Updating the running docker "functional-20211117161858-31976" container ...

	* Preparing Kubernetes v1.22.3 on Docker 20.10.8 ...

	  - apiserver.enable-admission-plugins=NamespaceAutoProvision

	* Verifying Kubernetes components...

	  - Using image gcr.io/k8s-minikube/storage-provisioner:v5

	* Enabled addons: storage-provisioner, default-storageclass

-- /stdout --

** stderr ** 

	E1117 16:21:34.733709   33790 pod_ready.go:66] WaitExtra: waitPodCondition: node "functional-20211117161858-31976" hosting pod "etcd-functional-20211117161858-31976" in "kube-system" namespace is currently not "Ready" (skipping!): node "functional-20211117161858-31976" has status "Ready":"False"

	E1117 16:21:34.738325   33790 pod_ready.go:66] WaitExtra: waitPodCondition: node "functional-20211117161858-31976" hosting pod "kube-apiserver-functional-20211117161858-31976" in "kube-system" namespace is currently not "Ready" (skipping!): node "functional-20211117161858-31976" has status "Ready":"False"

	E1117 16:21:34.742733   33790 pod_ready.go:66] WaitExtra: waitPodCondition: node "functional-20211117161858-31976" hosting pod "kube-controller-manager-functional-20211117161858-31976" in "kube-system" namespace is currently not "Ready" (skipping!): node "functional-20211117161858-31976" has status "Ready":"False"

	E1117 16:21:35.029346   33790 pod_ready.go:66] WaitExtra: waitPodCondition: node "functional-20211117161858-31976" hosting pod "kube-proxy-wbv29" in "kube-system" namespace is currently not "Ready" (skipping!): node "functional-20211117161858-31976" has status "Ready":"False"

	E1117 16:21:35.432302   33790 pod_ready.go:66] WaitExtra: waitPodCondition: node "functional-20211117161858-31976" hosting pod "kube-scheduler-functional-20211117161858-31976" in "kube-system" namespace is currently not "Ready" (skipping!): node "functional-20211117161858-31976" has status "Ready":"False"

	X Exiting due to GUEST_START: wait 6m0s for node: waiting for node to be ready: waitNodeCondition: error getting node "functional-20211117161858-31976": an error on the server ("") has prevented the request from succeeding (get nodes functional-20211117161858-31976)

	* 

	╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

** /stderr **

functional_test.go:700: failed to restart minikube. args "out/minikube-darwin-amd64 start -p functional-20211117161858-31976 --extra-config=apiserver.enable-admission-plugins=NamespaceAutoProvision --wait=all": exit status 80

functional_test.go:702: restart took 26.823986352s for "functional-20211117161858-31976" cluster.

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:230: ======>  post-mortem[TestFunctional/serial/ExtraConfig]: docker inspect <======

helpers_test.go:231: (dbg) Run:  docker inspect functional-20211117161858-31976

helpers_test.go:235: (dbg) docker inspect functional-20211117161858-31976:

-- stdout --

	[

	    {

	        "Id": "d46e9a51de65467f8f95d5caf1ea606f6207ea96f31ad410cb49b500d1a234d3",

	        "Created": "2021-11-18T00:19:05.626133858Z",

	        "Path": "/usr/local/bin/entrypoint",

	        "Args": [

	            "/sbin/init"

	        ],

	        "State": {

	            "Status": "running",

	            "Running": true,

	            "Paused": false,

	            "Restarting": false,

	            "OOMKilled": false,

	            "Dead": false,

	            "Pid": 38790,

	            "ExitCode": 0,

	            "Error": "",

	            "StartedAt": "2021-11-18T00:19:17.027751041Z",

	            "FinishedAt": "0001-01-01T00:00:00Z"

	        },

	        "Image": "sha256:e2a6c047beddf8261495222adf87089305bbc18e350587b01ebe3725535b5871",

	        "ResolvConfPath": "/var/lib/docker/containers/d46e9a51de65467f8f95d5caf1ea606f6207ea96f31ad410cb49b500d1a234d3/resolv.conf",

	        "HostnamePath": "/var/lib/docker/containers/d46e9a51de65467f8f95d5caf1ea606f6207ea96f31ad410cb49b500d1a234d3/hostname",

	        "HostsPath": "/var/lib/docker/containers/d46e9a51de65467f8f95d5caf1ea606f6207ea96f31ad410cb49b500d1a234d3/hosts",

	        "LogPath": "/var/lib/docker/containers/d46e9a51de65467f8f95d5caf1ea606f6207ea96f31ad410cb49b500d1a234d3/d46e9a51de65467f8f95d5caf1ea606f6207ea96f31ad410cb49b500d1a234d3-json.log",

	        "Name": "/functional-20211117161858-31976",

	        "RestartCount": 0,

	        "Driver": "overlay2",

	        "Platform": "linux",

	        "MountLabel": "",

	        "ProcessLabel": "",

	        "AppArmorProfile": "",

	        "ExecIDs": null,

	        "HostConfig": {

	            "Binds": [

	                "/lib/modules:/lib/modules:ro",

	                "functional-20211117161858-31976:/var"

	            ],

	            "ContainerIDFile": "",

	            "LogConfig": {

	                "Type": "json-file",

	                "Config": {}

	            },

	            "NetworkMode": "functional-20211117161858-31976",

	            "PortBindings": {

	                "22/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "0"

	                    }

	                ],

	                "2376/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "0"

	                    }

	                ],

	                "32443/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "0"

	                    }

	                ],

	                "5000/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "0"

	                    }

	                ],

	                "8441/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "0"

	                    }

	                ]

	            },

	            "RestartPolicy": {

	                "Name": "no",

	                "MaximumRetryCount": 0

	            },

	            "AutoRemove": false,

	            "VolumeDriver": "",

	            "VolumesFrom": null,

	            "CapAdd": null,

	            "CapDrop": null,

	            "CgroupnsMode": "host",

	            "Dns": [],

	            "DnsOptions": [],

	            "DnsSearch": [],

	            "ExtraHosts": null,

	            "GroupAdd": null,

	            "IpcMode": "private",

	            "Cgroup": "",

	            "Links": null,

	            "OomScoreAdj": 0,

	            "PidMode": "",

	            "Privileged": true,

	            "PublishAllPorts": false,

	            "ReadonlyRootfs": false,

	            "SecurityOpt": [

	                "seccomp=unconfined",

	                "apparmor=unconfined",

	                "label=disable"

	            ],

	            "Tmpfs": {

	                "/run": "",

	                "/tmp": ""

	            },

	            "UTSMode": "",

	            "UsernsMode": "",

	            "ShmSize": 67108864,

	            "Runtime": "runc",

	            "ConsoleSize": [

	                0,

	                0

	            ],

	            "Isolation": "",

	            "CpuShares": 0,

	            "Memory": 4194304000,

	            "NanoCpus": 2000000000,

	            "CgroupParent": "",

	            "BlkioWeight": 0,

	            "BlkioWeightDevice": [],

	            "BlkioDeviceReadBps": null,

	            "BlkioDeviceWriteBps": null,

	            "BlkioDeviceReadIOps": null,

	            "BlkioDeviceWriteIOps": null,

	            "CpuPeriod": 0,

	            "CpuQuota": 0,

	            "CpuRealtimePeriod": 0,

	            "CpuRealtimeRuntime": 0,

	            "CpusetCpus": "",

	            "CpusetMems": "",

	            "Devices": [

	                {

	                    "PathOnHost": "/dev/fuse",

	                    "PathInContainer": "/dev/fuse",

	                    "CgroupPermissions": "rwm"

	                }

	            ],

	            "DeviceCgroupRules": null,

	            "DeviceRequests": null,

	            "KernelMemory": 0,

	            "KernelMemoryTCP": 0,

	            "MemoryReservation": 0,

	            "MemorySwap": 4194304000,

	            "MemorySwappiness": null,

	            "OomKillDisable": false,

	            "PidsLimit": null,

	            "Ulimits": null,

	            "CpuCount": 0,

	            "CpuPercent": 0,

	            "IOMaximumIOps": 0,

	            "IOMaximumBandwidth": 0,

	            "MaskedPaths": null,

	            "ReadonlyPaths": null

	        },

	        "GraphDriver": {

	            "Data": {

	                "LowerDir": "/var/lib/docker/overlay2/49e0ec7a7f73c1ddbbb9f56f242aeba44c6beb8e8ba4345e2d31970a02d02099-init/diff:/var/lib/docker/overlay2/a93dcfb6f3d6cc41c972ba77a74f26c33bb647aae37c056960e88eff1f45318e/diff:/var/lib/docker/overlay2/5bf663a55dc098d601b6dea4d4c10aaec9f068dcf0de0b940d77262bf5e9bdc6/diff:/var/lib/docker/overlay2/042de3e4be800f5293bfc3bc6fc92553d872b01461acd16fa5a146a312df0e28/diff:/var/lib/docker/overlay2/0790f68de366f4e5284d9606e1a26055a65a8ee9c04fd59b5bac02d4016cf450/diff:/var/lib/docker/overlay2/0b2d68653092e419e945cb562f07ca719191e8b17667a18a8f7b4c24ad10ab0e/diff:/var/lib/docker/overlay2/74497acbc2dda9790b519bf52aa865acb9f38e5cef76e7d8a3a4b529a3d9e702/diff:/var/lib/docker/overlay2/ff120bb48ef6e6e06a88f4c5187e25d554152cc97e0ea1fb3555f17a66908154/diff:/var/lib/docker/overlay2/f5db8db950342323f76b38613fda86996d2b4a2aa755297267caa5b7b8981da0/diff:/var/lib/docker/overlay2/6017be4153ffd7b1ab22d79efd97895ca9791c09d7e77b930827f1f338219cbb/diff:/var/lib/docker/overlay2/fd8bd2

db0148ff3cbae056e3d40a5e785a6daa9839d28dce541d1db16c76a910/diff:/var/lib/docker/overlay2/6e6b657f7202e480d424be1b6934196a3f4b88d643e66c8f27823833e0833ba4/diff:/var/lib/docker/overlay2/4129ea43aaaf15e7de040c40f26e1a9a163317620d7ef92d98e4b2467d593034/diff:/var/lib/docker/overlay2/fd07546476691a27dba8ff73e418292264e996c20c06e955a30dbad83de1733c/diff:/var/lib/docker/overlay2/5ad0909670349956719e0f0ea9ddd5ee7e8959f505f470f10ac2520aa8014e97/diff:/var/lib/docker/overlay2/8825a434b266c3c834891f42fa35dc89e993f3c9e395f2f3c4d6e815f0e329af/diff:/var/lib/docker/overlay2/b4eeccd1b8c68a280e0e4d881a805d320f55b0c471529a3313b31b47252b0c47/diff:/var/lib/docker/overlay2/35fd48039713604d0debc8ac2009daf167d289893615387c0ad9287bffa10082/diff:/var/lib/docker/overlay2/494facb3e11d8950ad7593c6354187416d14009c69168858a6dffc25ebfbf84c/diff:/var/lib/docker/overlay2/4f1ce1df10039c93e604a552d53e3e6645d372f9cddab1b12c00f0067ad80ba2/diff:/var/lib/docker/overlay2/659379d7d9913fcb5492ef098d76112aded93cb7ce203354f9fbcee82d5b062c/diff:/var/lib/d

ocker/overlay2/a1c5d5e92d294301fbac809907fba5a0acc107e187b93e52d5afb6bb0bc2eb9d/diff:/var/lib/docker/overlay2/5065eba0fcf1a8cf75076e4a123f1e9f038fbbf1fae3f82e3ea33d1523b60c91/diff:/var/lib/docker/overlay2/594d5b999ebec6822417fd4ba02da0a7cde6c024fdfb474db4ff3a0784d7f735/diff:/var/lib/docker/overlay2/067ddba03cf6c6688f887150cb3d7174e90d66e9a6f356e86cc3a906c4941894/diff:/var/lib/docker/overlay2/6cee93a03c4d65017c1ef9d392ae34d531e8f7abdd809dc26a0a48ede1ff8367/diff:/var/lib/docker/overlay2/d1e8cfbc84975893028d0b859ebb9ca07a8efc1c8ad9abc10fb1e9c7235f53d4/diff:/var/lib/docker/overlay2/4f2c513e3b5d4707a2aed9244d7ef9f6fc2631524cf8225ba0dfa2f8c3e3931c/diff:/var/lib/docker/overlay2/9be7da800f4028bec22556081948d1d22da9bb3be2d63dde017c61c44c0274ea/diff:/var/lib/docker/overlay2/58b13aae5c184fe2071d64f90c7955b5dbbe76d225c3bd9847f03d1ce1ec8664/diff:/var/lib/docker/overlay2/997e96d68467fd54763e75e2d501272ee5d0497b00ab2c5522522f8ba0754f07/diff:/var/lib/docker/overlay2/49be1e8263d191ec5fdfd8cd4138af81d23aaa12d6548a465b255afe5e8

819c3/diff:/var/lib/docker/overlay2/8658b7127dfd599a3897343d297be67b4576b31720472927b3f5f1856059c56d/diff:/var/lib/docker/overlay2/26b53a2f30fe8fc01bfec363d6b00e2f5ab4f48325d1b5f62b5d8f2854dda781/diff:/var/lib/docker/overlay2/9abe9a8e38d4d40dcfa6152a2ae1bf2ed14dfa1579245d8534bea68a1124307b/diff:/var/lib/docker/overlay2/a1d4fbf621974c40a62164636c14f0dbe1ffa8a7bc7b13c1995ed93b1113dbe7/diff:/var/lib/docker/overlay2/aecec25c90cb357ced7bbaa69f3135cb6f7c8765605b7a360cd515642e00de14/diff:/var/lib/docker/overlay2/5c55f200070f6d0617d7f3031ce23a27df90a72720139ef51fac61fe40032625/diff:/var/lib/docker/overlay2/7a473817be0962d3e2ae1f57f32e95115af914c56a786f2d4d15a9dca232cefa/diff:/var/lib/docker/overlay2/3ca997de4525080aca8f86ad0f68f4f26acc4262a80846cfc96b3d4af8dd2526/diff:/var/lib/docker/overlay2/ad3ce384b651be2a1810da477a29e598be710b6e40f940a3bb3a4a9ed7ee048d/diff",

	                "MergedDir": "/var/lib/docker/overlay2/49e0ec7a7f73c1ddbbb9f56f242aeba44c6beb8e8ba4345e2d31970a02d02099/merged",

	                "UpperDir": "/var/lib/docker/overlay2/49e0ec7a7f73c1ddbbb9f56f242aeba44c6beb8e8ba4345e2d31970a02d02099/diff",

	                "WorkDir": "/var/lib/docker/overlay2/49e0ec7a7f73c1ddbbb9f56f242aeba44c6beb8e8ba4345e2d31970a02d02099/work"

	            },

	            "Name": "overlay2"

	        },

	        "Mounts": [

	            {

	                "Type": "volume",

	                "Name": "functional-20211117161858-31976",

	                "Source": "/var/lib/docker/volumes/functional-20211117161858-31976/_data",

	                "Destination": "/var",

	                "Driver": "local",

	                "Mode": "z",

	                "RW": true,

	                "Propagation": ""

	            },

	            {

	                "Type": "bind",

	                "Source": "/lib/modules",

	                "Destination": "/lib/modules",

	                "Mode": "ro",

	                "RW": false,

	                "Propagation": "rprivate"

	            }

	        ],

	        "Config": {

	            "Hostname": "functional-20211117161858-31976",

	            "Domainname": "",

	            "User": "root",

	            "AttachStdin": false,

	            "AttachStdout": false,

	            "AttachStderr": false,

	            "ExposedPorts": {

	                "22/tcp": {},

	                "2376/tcp": {},

	                "32443/tcp": {},

	                "5000/tcp": {},

	                "8441/tcp": {}

	            },

	            "Tty": true,

	            "OpenStdin": false,

	            "StdinOnce": false,

	            "Env": [

	                "container=docker",

	                "PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"

	            ],

	            "Cmd": null,

	            "Image": "gcr.io/k8s-minikube/kicbase:v0.0.28@sha256:4780f1897569d2bf77aafb3d133a08d42b4fe61127f06fcfc90c2c5d902d893c",

	            "Volumes": null,

	            "WorkingDir": "",

	            "Entrypoint": [

	                "/usr/local/bin/entrypoint",

	                "/sbin/init"

	            ],

	            "OnBuild": null,

	            "Labels": {

	                "created_by.minikube.sigs.k8s.io": "true",

	                "mode.minikube.sigs.k8s.io": "functional-20211117161858-31976",

	                "name.minikube.sigs.k8s.io": "functional-20211117161858-31976",

	                "role.minikube.sigs.k8s.io": ""

	            },

	            "StopSignal": "SIGRTMIN+3"

	        },

	        "NetworkSettings": {

	            "Bridge": "",

	            "SandboxID": "076ac0afe3795f81804d3da602b3a69ab38e221a0122b3f448d185a1ba341295",

	            "HairpinMode": false,

	            "LinkLocalIPv6Address": "",

	            "LinkLocalIPv6PrefixLen": 0,

	            "Ports": {

	                "22/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "52137"

	                    }

	                ],

	                "2376/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "52138"

	                    }

	                ],

	                "32443/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "52139"

	                    }

	                ],

	                "5000/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "52140"

	                    }

	                ],

	                "8441/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "52141"

	                    }

	                ]

	            },

	            "SandboxKey": "/var/run/docker/netns/076ac0afe379",

	            "SecondaryIPAddresses": null,

	            "SecondaryIPv6Addresses": null,

	            "EndpointID": "",

	            "Gateway": "",

	            "GlobalIPv6Address": "",

	            "GlobalIPv6PrefixLen": 0,

	            "IPAddress": "",

	            "IPPrefixLen": 0,

	            "IPv6Gateway": "",

	            "MacAddress": "",

	            "Networks": {

	                "functional-20211117161858-31976": {

	                    "IPAMConfig": {

	                        "IPv4Address": "192.168.49.2"

	                    },

	                    "Links": null,

	                    "Aliases": [

	                        "d46e9a51de65",

	                        "functional-20211117161858-31976"

	                    ],

	                    "NetworkID": "716130e30ae38c1d22de4c84857f1a2addaf8dd4e40f1651d386549d11497de6",

	                    "EndpointID": "dc6711626c432c360f8407c17df6ecba81d669b643cd6e499253a6205087f92f",

	                    "Gateway": "192.168.49.1",

	                    "IPAddress": "192.168.49.2",

	                    "IPPrefixLen": 24,

	                    "IPv6Gateway": "",

	                    "GlobalIPv6Address": "",

	                    "GlobalIPv6PrefixLen": 0,

	                    "MacAddress": "02:42:c0:a8:31:02",

	                    "DriverOpts": null

	                }

	            }

	        }

	    }

	]

-- /stdout --

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p functional-20211117161858-31976 -n functional-20211117161858-31976

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p functional-20211117161858-31976 -n functional-20211117161858-31976: exit status 2 (641.631979ms)

-- stdout --

	Running

-- /stdout --

helpers_test.go:239: status error: exit status 2 (may be ok)

helpers_test.go:244: <<< TestFunctional/serial/ExtraConfig FAILED: start of post-mortem logs <<<

helpers_test.go:245: ======>  post-mortem[TestFunctional/serial/ExtraConfig]: minikube logs <======

helpers_test.go:247: (dbg) Run:  out/minikube-darwin-amd64 -p functional-20211117161858-31976 logs -n 25

helpers_test.go:247: (dbg) Done: out/minikube-darwin-amd64 -p functional-20211117161858-31976 logs -n 25: (2.917904273s)

helpers_test.go:252: TestFunctional/serial/ExtraConfig logs: 

-- stdout --

	* 

	* ==> Audit <==

	* |---------|----------------------------------------------------------------------------------------|---------------------------------|---------|---------|-------------------------------|-------------------------------|

	| Command |                                          Args                                          |             Profile             |  User   | Version |          Start Time           |           End Time            |

	|---------|----------------------------------------------------------------------------------------|---------------------------------|---------|---------|-------------------------------|-------------------------------|

	| stop    | -p addons-20211117161126-31976                                                         | addons-20211117161126-31976     | jenkins | v1.24.0 | Wed, 17 Nov 2021 16:16:48 PST | Wed, 17 Nov 2021 16:17:06 PST |

	| addons  | enable dashboard -p                                                                    | addons-20211117161126-31976     | jenkins | v1.24.0 | Wed, 17 Nov 2021 16:17:06 PST | Wed, 17 Nov 2021 16:17:06 PST |

	|         | addons-20211117161126-31976                                                            |                                 |         |         |                               |                               |

	| addons  | disable dashboard -p                                                                   | addons-20211117161126-31976     | jenkins | v1.24.0 | Wed, 17 Nov 2021 16:17:06 PST | Wed, 17 Nov 2021 16:17:06 PST |

	|         | addons-20211117161126-31976                                                            |                                 |         |         |                               |                               |

	| delete  | -p addons-20211117161126-31976                                                         | addons-20211117161126-31976     | jenkins | v1.24.0 | Wed, 17 Nov 2021 16:17:06 PST | Wed, 17 Nov 2021 16:17:14 PST |

	| start   | -p nospam-20211117161714-31976 -n=1 --memory=2250 --wait=false                         | nospam-20211117161714-31976     | jenkins | v1.24.0 | Wed, 17 Nov 2021 16:17:14 PST | Wed, 17 Nov 2021 16:18:24 PST |

	|         | --log_dir=/var/folders/xd/3vdzn10d2gb_wxr7lj_p8h5c0000gp/T/nospam-20211117161714-31976 |                                 |         |         |                               |                               |

	|         | --driver=docker                                                                        |                                 |         |         |                               |                               |

	| -p      | nospam-20211117161714-31976 --log_dir                                                  | nospam-20211117161714-31976     | jenkins | v1.24.0 | Wed, 17 Nov 2021 16:18:29 PST | Wed, 17 Nov 2021 16:18:29 PST |

	|         | /var/folders/xd/3vdzn10d2gb_wxr7lj_p8h5c0000gp/T/nospam-20211117161714-31976           |                                 |         |         |                               |                               |

	|         | pause                                                                                  |                                 |         |         |                               |                               |

	| -p      | nospam-20211117161714-31976 --log_dir                                                  | nospam-20211117161714-31976     | jenkins | v1.24.0 | Wed, 17 Nov 2021 16:18:30 PST | Wed, 17 Nov 2021 16:18:30 PST |

	|         | /var/folders/xd/3vdzn10d2gb_wxr7lj_p8h5c0000gp/T/nospam-20211117161714-31976           |                                 |         |         |                               |                               |

	|         | pause                                                                                  |                                 |         |         |                               |                               |

	| -p      | nospam-20211117161714-31976 --log_dir                                                  | nospam-20211117161714-31976     | jenkins | v1.24.0 | Wed, 17 Nov 2021 16:18:30 PST | Wed, 17 Nov 2021 16:18:31 PST |

	|         | /var/folders/xd/3vdzn10d2gb_wxr7lj_p8h5c0000gp/T/nospam-20211117161714-31976           |                                 |         |         |                               |                               |

	|         | pause                                                                                  |                                 |         |         |                               |                               |

	| -p      | nospam-20211117161714-31976 --log_dir                                                  | nospam-20211117161714-31976     | jenkins | v1.24.0 | Wed, 17 Nov 2021 16:18:31 PST | Wed, 17 Nov 2021 16:18:32 PST |

	|         | /var/folders/xd/3vdzn10d2gb_wxr7lj_p8h5c0000gp/T/nospam-20211117161714-31976           |                                 |         |         |                               |                               |

	|         | unpause                                                                                |                                 |         |         |                               |                               |

	| -p      | nospam-20211117161714-31976 --log_dir                                                  | nospam-20211117161714-31976     | jenkins | v1.24.0 | Wed, 17 Nov 2021 16:18:32 PST | Wed, 17 Nov 2021 16:18:32 PST |

	|         | /var/folders/xd/3vdzn10d2gb_wxr7lj_p8h5c0000gp/T/nospam-20211117161714-31976           |                                 |         |         |                               |                               |

	|         | unpause                                                                                |                                 |         |         |                               |                               |

	| -p      | nospam-20211117161714-31976 --log_dir                                                  | nospam-20211117161714-31976     | jenkins | v1.24.0 | Wed, 17 Nov 2021 16:18:32 PST | Wed, 17 Nov 2021 16:18:33 PST |

	|         | /var/folders/xd/3vdzn10d2gb_wxr7lj_p8h5c0000gp/T/nospam-20211117161714-31976           |                                 |         |         |                               |                               |

	|         | unpause                                                                                |                                 |         |         |                               |                               |

	| -p      | nospam-20211117161714-31976 --log_dir                                                  | nospam-20211117161714-31976     | jenkins | v1.24.0 | Wed, 17 Nov 2021 16:18:33 PST | Wed, 17 Nov 2021 16:18:50 PST |

	|         | /var/folders/xd/3vdzn10d2gb_wxr7lj_p8h5c0000gp/T/nospam-20211117161714-31976           |                                 |         |         |                               |                               |

	|         | stop                                                                                   |                                 |         |         |                               |                               |

	| -p      | nospam-20211117161714-31976 --log_dir                                                  | nospam-20211117161714-31976     | jenkins | v1.24.0 | Wed, 17 Nov 2021 16:18:51 PST | Wed, 17 Nov 2021 16:18:51 PST |

	|         | /var/folders/xd/3vdzn10d2gb_wxr7lj_p8h5c0000gp/T/nospam-20211117161714-31976           |                                 |         |         |                               |                               |

	|         | stop                                                                                   |                                 |         |         |                               |                               |

	| -p      | nospam-20211117161714-31976 --log_dir                                                  | nospam-20211117161714-31976     | jenkins | v1.24.0 | Wed, 17 Nov 2021 16:18:51 PST | Wed, 17 Nov 2021 16:18:51 PST |

	|         | /var/folders/xd/3vdzn10d2gb_wxr7lj_p8h5c0000gp/T/nospam-20211117161714-31976           |                                 |         |         |                               |                               |

	|         | stop                                                                                   |                                 |         |         |                               |                               |

	| delete  | -p nospam-20211117161714-31976                                                         | nospam-20211117161714-31976     | jenkins | v1.24.0 | Wed, 17 Nov 2021 16:18:51 PST | Wed, 17 Nov 2021 16:18:58 PST |

	| start   | -p                                                                                     | functional-20211117161858-31976 | jenkins | v1.24.0 | Wed, 17 Nov 2021 16:18:58 PST | Wed, 17 Nov 2021 16:21:01 PST |

	|         | functional-20211117161858-31976                                                        |                                 |         |         |                               |                               |

	|         | --memory=4000                                                                          |                                 |         |         |                               |                               |

	|         | --apiserver-port=8441                                                                  |                                 |         |         |                               |                               |

	|         | --wait=all --driver=docker                                                             |                                 |         |         |                               |                               |

	| start   | -p                                                                                     | functional-20211117161858-31976 | jenkins | v1.24.0 | Wed, 17 Nov 2021 16:21:01 PST | Wed, 17 Nov 2021 16:21:09 PST |

	|         | functional-20211117161858-31976                                                        |                                 |         |         |                               |                               |

	|         | --alsologtostderr -v=8                                                                 |                                 |         |         |                               |                               |

	| -p      | functional-20211117161858-31976 cache add                                              | functional-20211117161858-31976 | jenkins | v1.24.0 | Wed, 17 Nov 2021 16:21:11 PST | Wed, 17 Nov 2021 16:21:13 PST |

	|         | minikube-local-cache-test:functional-20211117161858-31976                              |                                 |         |         |                               |                               |

	| -p      | functional-20211117161858-31976 cache delete                                           | functional-20211117161858-31976 | jenkins | v1.24.0 | Wed, 17 Nov 2021 16:21:13 PST | Wed, 17 Nov 2021 16:21:13 PST |

	|         | minikube-local-cache-test:functional-20211117161858-31976                              |                                 |         |         |                               |                               |

	| cache   | list                                                                                   | minikube                        | jenkins | v1.24.0 | Wed, 17 Nov 2021 16:21:13 PST | Wed, 17 Nov 2021 16:21:13 PST |

	| -p      | functional-20211117161858-31976                                                        | functional-20211117161858-31976 | jenkins | v1.24.0 | Wed, 17 Nov 2021 16:21:13 PST | Wed, 17 Nov 2021 16:21:14 PST |

	|         | ssh sudo crictl images                                                                 |                                 |         |         |                               |                               |

	| -p      | functional-20211117161858-31976                                                        | functional-20211117161858-31976 | jenkins | v1.24.0 | Wed, 17 Nov 2021 16:21:15 PST | Wed, 17 Nov 2021 16:21:15 PST |

	|         | cache reload                                                                           |                                 |         |         |                               |                               |

	| -p      | functional-20211117161858-31976                                                        | functional-20211117161858-31976 | jenkins | v1.24.0 | Wed, 17 Nov 2021 16:21:17 PST | Wed, 17 Nov 2021 16:21:19 PST |

	|         | logs -n 25                                                                             |                                 |         |         |                               |                               |

	| -p      | functional-20211117161858-31976                                                        | functional-20211117161858-31976 | jenkins | v1.24.0 | Wed, 17 Nov 2021 16:21:20 PST | Wed, 17 Nov 2021 16:21:21 PST |

	|         | kubectl -- --context                                                                   |                                 |         |         |                               |                               |

	|         | functional-20211117161858-31976                                                        |                                 |         |         |                               |                               |

	|         | get pods                                                                               |                                 |         |         |                               |                               |

	| kubectl | --profile=functional-20211117161858-31976                                              | functional-20211117161858-31976 | jenkins | v1.24.0 | Wed, 17 Nov 2021 16:21:21 PST | Wed, 17 Nov 2021 16:21:21 PST |

	|         | -- --context                                                                           |                                 |         |         |                               |                               |

	|         | functional-20211117161858-31976 get pods                                               |                                 |         |         |                               |                               |

	|---------|----------------------------------------------------------------------------------------|---------------------------------|---------|---------|-------------------------------|-------------------------------|

	* 

	* ==> Last Start <==

	* Log file created at: 2021/11/17 16:21:21

	Running on machine: 37310

	Binary: Built with gc go1.17.3 for darwin/amd64

	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg

	I1117 16:21:21.622885   33790 out.go:297] Setting OutFile to fd 1 ...

	I1117 16:21:21.623009   33790 out.go:344] TERM=,COLORTERM=, which probably does not support color

	I1117 16:21:21.623011   33790 out.go:310] Setting ErrFile to fd 2...

	I1117 16:21:21.623013   33790 out.go:344] TERM=,COLORTERM=, which probably does not support color

	I1117 16:21:21.623084   33790 root.go:315] Updating PATH: /Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/bin

	I1117 16:21:21.623330   33790 out.go:304] Setting JSON to false

	I1117 16:21:21.649303   33790 start.go:112] hostinfo: {"hostname":"37310.local","uptime":8456,"bootTime":1637186425,"procs":357,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"11.2.3","kernelVersion":"20.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"bd1c05a8-24a6-5973-aa69-f3c7c66a87ce"}

	W1117 16:21:21.649404   33790 start.go:120] gopshost.Virtualization returned error: not implemented yet

	I1117 16:21:21.676374   33790 out.go:176] * [functional-20211117161858-31976] minikube v1.24.0 on Darwin 11.2.3

	I1117 16:21:21.676542   33790 notify.go:174] Checking for updates...

	I1117 16:21:21.702052   33790 out.go:176]   - MINIKUBE_LOCATION=12739

	I1117 16:21:21.728239   33790 out.go:176]   - KUBECONFIG=/Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/kubeconfig

	I1117 16:21:21.753862   33790 out.go:176]   - MINIKUBE_BIN=out/minikube-darwin-amd64

	I1117 16:21:21.779964   33790 out.go:176]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube

	I1117 16:21:21.780393   33790 config.go:176] Loaded profile config "functional-20211117161858-31976": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.22.3

	I1117 16:21:21.780436   33790 driver.go:343] Setting default libvirt URI to qemu:///system

	I1117 16:21:21.881721   33790 docker.go:132] docker version: linux-20.10.6

	I1117 16:21:21.881850   33790 cli_runner.go:115] Run: docker system info --format "{{json .}}"

	I1117 16:21:22.071842   33790 info.go:263] docker info: {ID:2AYQ:M3LP:F6GE:IPKK:4XGD:7ZUA:OVWC:XKGI:AARV:HKMV:IHBV:IRRJ Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:26 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:51 OomKillDisable:true NGoroutines:54 SystemTime:2021-11-18 00:21:22.004732313 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:4 KernelVersion:5.10.25-linuxkit OperatingSystem:Docker Desktop OSType:linux Architecture:x86_64 IndexServer

Address:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:6 MemTotal:6234726400 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy:http.docker.internal:3128 HTTPSProxy:http.docker.internal:3128 NoProxy: Name:docker-desktop Labels:[] ExperimentalBuild:false ServerVersion:20.10.6 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:05f951a3781f4f2c1911b05e61c160e9c30eaa8e Expected:05f951a3781f4f2c1911b05e61c160e9c30eaa8e} RuncCommit:{ID:12644e614e25b05da6fd08a38ffa0cfe1903fdec Expected:12644e614e25b05da6fd08a38ffa0cfe1903fdec} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=sec

comp,profile=default] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Experimental:true Name:app Path:/usr/local/lib/docker/cli-plugins/docker-app SchemaVersion:0.1.0 ShortDescription:Docker App Vendor:Docker Inc. Version:v0.9.1-beta3] map[Name:buildx Path:/usr/local/lib/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Build with BuildKit Vendor:Docker Inc. Version:v0.5.1-docker] map[Name:compose Path:/usr/local/lib/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:2.0.0-beta.1] map[Name:scan Path:/usr/local/lib/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.8.0]] Warnings:<nil>}}

	I1117 16:21:22.120163   33790 out.go:176] * Using the docker driver based on existing profile

	I1117 16:21:22.120221   33790 start.go:280] selected driver: docker

	I1117 16:21:22.120231   33790 start.go:775] validating driver "docker" against &{Name:functional-20211117161858-31976 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.28@sha256:4780f1897569d2bf77aafb3d133a08d42b4fe61127f06fcfc90c2c5d902d893c Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.22.3 ClusterName:functional-20211117161858-31976 Namespace:default APIServerName:minikubeCA APIServ

erNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8441 NodeName:} Nodes:[{Name: IP:192.168.49.2 Port:8441 KubernetesVersion:v1.22.3 ControlPlane:true Worker:true}] Addons:map[ambassador:false auto-pause:false csi-hostpath-driver:false dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false helm-tiller:false ingress:false ingress-dns:false istio:false istio-provisioner:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false volumesnapshots:false] CustomAddonImages:map[] CustomAdd

onRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host}

	I1117 16:21:22.120357   33790 start.go:786] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc:}

	I1117 16:21:22.120726   33790 cli_runner.go:115] Run: docker system info --format "{{json .}}"

	I1117 16:21:22.310085   33790 info.go:263] docker info: {ID:2AYQ:M3LP:F6GE:IPKK:4XGD:7ZUA:OVWC:XKGI:AARV:HKMV:IHBV:IRRJ Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:26 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:51 OomKillDisable:true NGoroutines:54 SystemTime:2021-11-18 00:21:22.241494137 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:4 KernelVersion:5.10.25-linuxkit OperatingSystem:Docker Desktop OSType:linux Architecture:x86_64 IndexServer

Address:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:6 MemTotal:6234726400 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy:http.docker.internal:3128 HTTPSProxy:http.docker.internal:3128 NoProxy: Name:docker-desktop Labels:[] ExperimentalBuild:false ServerVersion:20.10.6 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:05f951a3781f4f2c1911b05e61c160e9c30eaa8e Expected:05f951a3781f4f2c1911b05e61c160e9c30eaa8e} RuncCommit:{ID:12644e614e25b05da6fd08a38ffa0cfe1903fdec Expected:12644e614e25b05da6fd08a38ffa0cfe1903fdec} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=sec

comp,profile=default] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Experimental:true Name:app Path:/usr/local/lib/docker/cli-plugins/docker-app SchemaVersion:0.1.0 ShortDescription:Docker App Vendor:Docker Inc. Version:v0.9.1-beta3] map[Name:buildx Path:/usr/local/lib/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Build with BuildKit Vendor:Docker Inc. Version:v0.5.1-docker] map[Name:compose Path:/usr/local/lib/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:2.0.0-beta.1] map[Name:scan Path:/usr/local/lib/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.8.0]] Warnings:<nil>}}

	I1117 16:21:22.312056   33790 start_flags.go:758] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]

	I1117 16:21:22.312086   33790 cni.go:93] Creating CNI manager for ""

	I1117 16:21:22.312094   33790 cni.go:167] CNI unnecessary in this configuration, recommending no CNI

	I1117 16:21:22.312101   33790 start_flags.go:282] config:

	{Name:functional-20211117161858-31976 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.28@sha256:4780f1897569d2bf77aafb3d133a08d42b4fe61127f06fcfc90c2c5d902d893c Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.22.3 ClusterName:functional-20211117161858-31976 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISo

cket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[{Component:apiserver Key:enable-admission-plugins Value:NamespaceAutoProvision}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8441 NodeName:} Nodes:[{Name: IP:192.168.49.2 Port:8441 KubernetesVersion:v1.22.3 ControlPlane:true Worker:true}] Addons:map[ambassador:false auto-pause:false csi-hostpath-driver:false dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false helm-tiller:false ingress:false ingress-dns:false istio:false istio-provisioner:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false volumesnapshots:false] CustomAddonImages:map[] CustomAddo

nRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host}

	I1117 16:21:22.360734   33790 out.go:176] * Starting control plane node functional-20211117161858-31976 in cluster functional-20211117161858-31976

	I1117 16:21:22.360819   33790 cache.go:118] Beginning downloading kic base image for docker with docker

	I1117 16:21:22.386749   33790 out.go:176] * Pulling base image ...

	I1117 16:21:22.386821   33790 preload.go:132] Checking if preload exists for k8s version v1.22.3 and runtime docker

	I1117 16:21:22.386901   33790 preload.go:148] Found local preload: /Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v14-v1.22.3-docker-overlay2-amd64.tar.lz4

	I1117 16:21:22.386931   33790 cache.go:57] Caching tarball of preloaded images

	I1117 16:21:22.386925   33790 image.go:75] Checking for gcr.io/k8s-minikube/kicbase:v0.0.28@sha256:4780f1897569d2bf77aafb3d133a08d42b4fe61127f06fcfc90c2c5d902d893c in local docker daemon

	I1117 16:21:22.387177   33790 preload.go:174] Found /Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v14-v1.22.3-docker-overlay2-amd64.tar.lz4 in cache, skipping download

	I1117 16:21:22.387208   33790 cache.go:60] Finished verifying existence of preloaded tar for  v1.22.3 on docker

	I1117 16:21:22.387966   33790 profile.go:147] Saving config to /Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/profiles/functional-20211117161858-31976/config.json ...

	I1117 16:21:22.514468   33790 image.go:79] Found gcr.io/k8s-minikube/kicbase:v0.0.28@sha256:4780f1897569d2bf77aafb3d133a08d42b4fe61127f06fcfc90c2c5d902d893c in local docker daemon, skipping pull

	I1117 16:21:22.514485   33790 cache.go:140] gcr.io/k8s-minikube/kicbase:v0.0.28@sha256:4780f1897569d2bf77aafb3d133a08d42b4fe61127f06fcfc90c2c5d902d893c exists in daemon, skipping load

	I1117 16:21:22.514497   33790 cache.go:206] Successfully downloaded all kic artifacts

	I1117 16:21:22.514541   33790 start.go:313] acquiring machines lock for functional-20211117161858-31976: {Name:mkf7e5ee0db2d67009702787d2639dd998f1b20a Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I1117 16:21:22.514618   33790 start.go:317] acquired machines lock for "functional-20211117161858-31976" in 62.221µs

	I1117 16:21:22.514641   33790 start.go:93] Skipping create...Using existing machine configuration

	I1117 16:21:22.514648   33790 fix.go:55] fixHost starting: 

	I1117 16:21:22.514907   33790 cli_runner.go:115] Run: docker container inspect functional-20211117161858-31976 --format={{.State.Status}}

	I1117 16:21:22.635958   33790 fix.go:108] recreateIfNeeded on functional-20211117161858-31976: state=Running err=<nil>

	W1117 16:21:22.635981   33790 fix.go:134] unexpected machine state, will restart: <nil>

	I1117 16:21:22.662731   33790 out.go:176] * Updating the running docker "functional-20211117161858-31976" container ...

	I1117 16:21:22.662759   33790 machine.go:88] provisioning docker machine ...

	I1117 16:21:22.662778   33790 ubuntu.go:169] provisioning hostname "functional-20211117161858-31976"

	I1117 16:21:22.662854   33790 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-20211117161858-31976

	I1117 16:21:22.782815   33790 main.go:130] libmachine: Using SSH client type: native

	I1117 16:21:22.782997   33790 main.go:130] libmachine: &{{{<nil> 0 [] [] []} docker [0x1396d40] 0x1399e20 <nil>  [] 0s} 127.0.0.1 52137 <nil> <nil>}

	I1117 16:21:22.783006   33790 main.go:130] libmachine: About to run SSH command:

	sudo hostname functional-20211117161858-31976 && echo "functional-20211117161858-31976" | sudo tee /etc/hostname

	I1117 16:21:22.902454   33790 main.go:130] libmachine: SSH cmd err, output: <nil>: functional-20211117161858-31976

	I1117 16:21:22.902543   33790 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-20211117161858-31976

	I1117 16:21:23.024332   33790 main.go:130] libmachine: Using SSH client type: native

	I1117 16:21:23.024486   33790 main.go:130] libmachine: &{{{<nil> 0 [] [] []} docker [0x1396d40] 0x1399e20 <nil>  [] 0s} 127.0.0.1 52137 <nil> <nil>}

	I1117 16:21:23.024499   33790 main.go:130] libmachine: About to run SSH command:

			if ! grep -xq '.*\sfunctional-20211117161858-31976' /etc/hosts; then

				if grep -xq '127.0.1.1\s.*' /etc/hosts; then

					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 functional-20211117161858-31976/g' /etc/hosts;

				else 

					echo '127.0.1.1 functional-20211117161858-31976' | sudo tee -a /etc/hosts; 

				fi

			fi

	I1117 16:21:23.134580   33790 main.go:130] libmachine: SSH cmd err, output: <nil>: 

	I1117 16:21:23.134623   33790 ubuntu.go:175] set auth options {CertDir:/Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube CaCertPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/certs/ca.pem CaPrivateKeyPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/machines/server.pem ServerKeyPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/machines/server-key.pem ClientKeyPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/certs/key.pem ServerCertRemotePath:/etc/doc

ker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube}

	I1117 16:21:23.134651   33790 ubuntu.go:177] setting up certificates

	I1117 16:21:23.134667   33790 provision.go:83] configureAuth start

	I1117 16:21:23.134760   33790 cli_runner.go:115] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" functional-20211117161858-31976

	I1117 16:21:23.262120   33790 provision.go:138] copyHostCerts

	I1117 16:21:23.262204   33790 exec_runner.go:144] found /Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/cert.pem, removing ...

	I1117 16:21:23.262209   33790 exec_runner.go:207] rm: /Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/cert.pem

	I1117 16:21:23.262305   33790 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/certs/cert.pem --> /Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/cert.pem (1123 bytes)

	I1117 16:21:23.262507   33790 exec_runner.go:144] found /Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/key.pem, removing ...

	I1117 16:21:23.262516   33790 exec_runner.go:207] rm: /Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/key.pem

	I1117 16:21:23.262571   33790 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/certs/key.pem --> /Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/key.pem (1679 bytes)

	I1117 16:21:23.262708   33790 exec_runner.go:144] found /Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/ca.pem, removing ...

	I1117 16:21:23.262711   33790 exec_runner.go:207] rm: /Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/ca.pem

	I1117 16:21:23.262777   33790 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/certs/ca.pem --> /Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/ca.pem (1078 bytes)

	I1117 16:21:23.262901   33790 provision.go:112] generating server cert: /Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/machines/server.pem ca-key=/Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/certs/ca.pem private-key=/Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/certs/ca-key.pem org=jenkins.functional-20211117161858-31976 san=[192.168.49.2 127.0.0.1 localhost 127.0.0.1 minikube functional-20211117161858-31976]

	I1117 16:21:23.387784   33790 provision.go:172] copyRemoteCerts

	I1117 16:21:23.387849   33790 ssh_runner.go:152] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker

	I1117 16:21:23.387901   33790 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-20211117161858-31976

	I1117 16:21:23.508062   33790 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:52137 SSHKeyPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/machines/functional-20211117161858-31976/id_rsa Username:docker}

	I1117 16:21:23.598162   33790 ssh_runner.go:319] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/machines/server.pem --> /etc/docker/server.pem (1265 bytes)

	I1117 16:21:23.614485   33790 ssh_runner.go:319] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)

	I1117 16:21:23.631096   33790 ssh_runner.go:319] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)

	I1117 16:21:23.647617   33790 provision.go:86] duration metric: configureAuth took 512.923631ms

	I1117 16:21:23.647626   33790 ubuntu.go:193] setting minikube options for container-runtime

	I1117 16:21:23.647791   33790 config.go:176] Loaded profile config "functional-20211117161858-31976": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.22.3

	I1117 16:21:23.647858   33790 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-20211117161858-31976

	I1117 16:21:23.767974   33790 main.go:130] libmachine: Using SSH client type: native

	I1117 16:21:23.768127   33790 main.go:130] libmachine: &{{{<nil> 0 [] [] []} docker [0x1396d40] 0x1399e20 <nil>  [] 0s} 127.0.0.1 52137 <nil> <nil>}

	I1117 16:21:23.768134   33790 main.go:130] libmachine: About to run SSH command:

	df --output=fstype / | tail -n 1

	I1117 16:21:23.881322   33790 main.go:130] libmachine: SSH cmd err, output: <nil>: overlay

	I1117 16:21:23.881336   33790 ubuntu.go:71] root file system type: overlay

	I1117 16:21:23.881520   33790 provision.go:309] Updating docker unit: /lib/systemd/system/docker.service ...

	I1117 16:21:23.881615   33790 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-20211117161858-31976

	I1117 16:21:24.000288   33790 main.go:130] libmachine: Using SSH client type: native

	I1117 16:21:24.000448   33790 main.go:130] libmachine: &{{{<nil> 0 [] [] []} docker [0x1396d40] 0x1399e20 <nil>  [] 0s} 127.0.0.1 52137 <nil> <nil>}

	I1117 16:21:24.000493   33790 main.go:130] libmachine: About to run SSH command:

	sudo mkdir -p /lib/systemd/system && printf %!s(MISSING) "[Unit]

	Description=Docker Application Container Engine

	Documentation=https://docs.docker.com

	BindsTo=containerd.service

	After=network-online.target firewalld.service containerd.service

	Wants=network-online.target

	Requires=docker.socket

	StartLimitBurst=3

	StartLimitIntervalSec=60

	[Service]

	Type=notify

	Restart=on-failure

	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	# The base configuration already specifies an 'ExecStart=...' command. The first directive

	# here is to clear out that command inherited from the base configuration. Without this,

	# the command from the base configuration and the command specified here are treated as

	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	# will catch this invalid input and refuse to start the service with an error like:

	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	ExecStart=

	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12 

	ExecReload=/bin/kill -s HUP \$MAINPID

	# Having non-zero Limit*s causes performance problems due to accounting overhead

	# in the kernel. We recommend using cgroups to do container-local accounting.

	LimitNOFILE=infinity

	LimitNPROC=infinity

	LimitCORE=infinity

	# Uncomment TasksMax if your systemd version supports it.

	# Only systemd 226 and above support this version.

	TasksMax=infinity

	TimeoutStartSec=0

	# set delegate yes so that systemd does not reset the cgroups of docker containers

	Delegate=yes

	# kill only the docker process, not all processes in the cgroup

	KillMode=process

	[Install]

	WantedBy=multi-user.target

	" | sudo tee /lib/systemd/system/docker.service.new

	I1117 16:21:24.119293   33790 main.go:130] libmachine: SSH cmd err, output: <nil>: [Unit]

	Description=Docker Application Container Engine

	Documentation=https://docs.docker.com

	BindsTo=containerd.service

	After=network-online.target firewalld.service containerd.service

	Wants=network-online.target

	Requires=docker.socket

	StartLimitBurst=3

	StartLimitIntervalSec=60

	[Service]

	Type=notify

	Restart=on-failure

	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	# The base configuration already specifies an 'ExecStart=...' command. The first directive

	# here is to clear out that command inherited from the base configuration. Without this,

	# the command from the base configuration and the command specified here are treated as

	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	# will catch this invalid input and refuse to start the service with an error like:

	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	ExecStart=

	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12 

	ExecReload=/bin/kill -s HUP $MAINPID

	# Having non-zero Limit*s causes performance problems due to accounting overhead

	# in the kernel. We recommend using cgroups to do container-local accounting.

	LimitNOFILE=infinity

	LimitNPROC=infinity

	LimitCORE=infinity

	# Uncomment TasksMax if your systemd version supports it.

	# Only systemd 226 and above support this version.

	TasksMax=infinity

	TimeoutStartSec=0

	# set delegate yes so that systemd does not reset the cgroups of docker containers

	Delegate=yes

	# kill only the docker process, not all processes in the cgroup

	KillMode=process

	[Install]

	WantedBy=multi-user.target

	I1117 16:21:24.119389   33790 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-20211117161858-31976

	I1117 16:21:24.237960   33790 main.go:130] libmachine: Using SSH client type: native

	I1117 16:21:24.238130   33790 main.go:130] libmachine: &{{{<nil> 0 [] [] []} docker [0x1396d40] 0x1399e20 <nil>  [] 0s} 127.0.0.1 52137 <nil> <nil>}

	I1117 16:21:24.238140   33790 main.go:130] libmachine: About to run SSH command:

	sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }

	I1117 16:21:24.352811   33790 main.go:130] libmachine: SSH cmd err, output: <nil>: 

	I1117 16:21:24.352825   33790 machine.go:91] provisioned docker machine in 1.690013418s

	I1117 16:21:24.352833   33790 start.go:267] post-start starting for "functional-20211117161858-31976" (driver="docker")

	I1117 16:21:24.352836   33790 start.go:277] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]

	I1117 16:21:24.352919   33790 ssh_runner.go:152] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs

	I1117 16:21:24.352978   33790 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-20211117161858-31976

	I1117 16:21:24.472328   33790 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:52137 SSHKeyPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/machines/functional-20211117161858-31976/id_rsa Username:docker}

	I1117 16:21:24.555003   33790 ssh_runner.go:152] Run: cat /etc/os-release

	I1117 16:21:24.558639   33790 main.go:130] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found

	I1117 16:21:24.558652   33790 main.go:130] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found

	I1117 16:21:24.558660   33790 main.go:130] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found

	I1117 16:21:24.558665   33790 info.go:137] Remote host: Ubuntu 20.04.2 LTS

	I1117 16:21:24.558672   33790 filesync.go:126] Scanning /Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/addons for local assets ...

	I1117 16:21:24.558765   33790 filesync.go:126] Scanning /Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/files for local assets ...

	I1117 16:21:24.558951   33790 filesync.go:149] local asset: /Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/files/etc/ssl/certs/319762.pem -> 319762.pem in /etc/ssl/certs

	I1117 16:21:24.559095   33790 filesync.go:149] local asset: /Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/files/etc/test/nested/copy/31976/hosts -> hosts in /etc/test/nested/copy/31976

	I1117 16:21:24.559142   33790 ssh_runner.go:152] Run: sudo mkdir -p /etc/ssl/certs /etc/test/nested/copy/31976

	I1117 16:21:24.566252   33790 ssh_runner.go:319] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/files/etc/ssl/certs/319762.pem --> /etc/ssl/certs/319762.pem (1708 bytes)

	I1117 16:21:24.582991   33790 ssh_runner.go:319] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/files/etc/test/nested/copy/31976/hosts --> /etc/test/nested/copy/31976/hosts (40 bytes)

	I1117 16:21:24.599708   33790 start.go:270] post-start completed in 246.860649ms

	I1117 16:21:24.599784   33790 ssh_runner.go:152] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I1117 16:21:24.599840   33790 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-20211117161858-31976

	I1117 16:21:24.718037   33790 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:52137 SSHKeyPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/machines/functional-20211117161858-31976/id_rsa Username:docker}

	I1117 16:21:24.797768   33790 fix.go:57] fixHost completed within 2.283044439s

	I1117 16:21:24.797784   33790 start.go:80] releasing machines lock for "functional-20211117161858-31976", held for 2.283095634s

	I1117 16:21:24.797900   33790 cli_runner.go:115] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" functional-20211117161858-31976

	I1117 16:21:24.917591   33790 ssh_runner.go:152] Run: systemctl --version

	I1117 16:21:24.917601   33790 ssh_runner.go:152] Run: curl -sS -m 2 https://k8s.gcr.io/

	I1117 16:21:24.917658   33790 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-20211117161858-31976

	I1117 16:21:24.917672   33790 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-20211117161858-31976

	I1117 16:21:25.046625   33790 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:52137 SSHKeyPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/machines/functional-20211117161858-31976/id_rsa Username:docker}

	I1117 16:21:25.046759   33790 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:52137 SSHKeyPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/machines/functional-20211117161858-31976/id_rsa Username:docker}

	I1117 16:21:25.593369   33790 ssh_runner.go:152] Run: sudo systemctl is-active --quiet service containerd

	I1117 16:21:25.602997   33790 ssh_runner.go:152] Run: sudo systemctl cat docker.service

	I1117 16:21:25.612754   33790 cruntime.go:255] skipping containerd shutdown because we are bound to it

	I1117 16:21:25.612817   33790 ssh_runner.go:152] Run: sudo systemctl is-active --quiet service crio

	I1117 16:21:25.621861   33790 ssh_runner.go:152] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/dockershim.sock

	image-endpoint: unix:///var/run/dockershim.sock

	" | sudo tee /etc/crictl.yaml"

	I1117 16:21:25.634265   33790 ssh_runner.go:152] Run: sudo systemctl unmask docker.service

	I1117 16:21:25.711219   33790 ssh_runner.go:152] Run: sudo systemctl enable docker.socket

	I1117 16:21:25.789866   33790 ssh_runner.go:152] Run: sudo systemctl cat docker.service

	I1117 16:21:25.800286   33790 ssh_runner.go:152] Run: sudo systemctl daemon-reload

	I1117 16:21:25.877362   33790 ssh_runner.go:152] Run: sudo systemctl start docker

	I1117 16:21:25.887091   33790 ssh_runner.go:152] Run: docker version --format {{.Server.Version}}

	I1117 16:21:25.925452   33790 ssh_runner.go:152] Run: docker version --format {{.Server.Version}}

	I1117 16:21:25.992258   33790 out.go:203] * Preparing Kubernetes v1.22.3 on Docker 20.10.8 ...

	I1117 16:21:25.992393   33790 cli_runner.go:115] Run: docker exec -t functional-20211117161858-31976 dig +short host.docker.internal

	I1117 16:21:26.182933   33790 network.go:96] got host ip for mount in container by digging dns: 192.168.65.2

	I1117 16:21:26.183029   33790 ssh_runner.go:152] Run: grep 192.168.65.2	host.minikube.internal$ /etc/hosts

	I1117 16:21:26.187212   33790 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "8441/tcp") 0).HostPort}}'" functional-20211117161858-31976

	I1117 16:21:26.350225   33790 out.go:176]   - apiserver.enable-admission-plugins=NamespaceAutoProvision

	I1117 16:21:26.350377   33790 preload.go:132] Checking if preload exists for k8s version v1.22.3 and runtime docker

	I1117 16:21:26.350545   33790 ssh_runner.go:152] Run: docker images --format {{.Repository}}:{{.Tag}}

	I1117 16:21:26.382564   33790 docker.go:558] Got preloaded images: -- stdout --

	k8s.gcr.io/kube-apiserver:v1.22.3

	k8s.gcr.io/kube-scheduler:v1.22.3

	k8s.gcr.io/kube-controller-manager:v1.22.3

	k8s.gcr.io/kube-proxy:v1.22.3

	minikube-local-cache-test:functional-20211117161858-31976

	kubernetesui/dashboard:v2.3.1

	k8s.gcr.io/etcd:3.5.0-0

	kubernetesui/metrics-scraper:v1.0.7

	k8s.gcr.io/coredns/coredns:v1.8.4

	gcr.io/k8s-minikube/storage-provisioner:v5

	k8s.gcr.io/pause:3.5

	-- /stdout --

	I1117 16:21:26.382573   33790 docker.go:489] Images already preloaded, skipping extraction

	I1117 16:21:26.382653   33790 ssh_runner.go:152] Run: docker images --format {{.Repository}}:{{.Tag}}

	I1117 16:21:26.412928   33790 docker.go:558] Got preloaded images: -- stdout --

	k8s.gcr.io/kube-apiserver:v1.22.3

	k8s.gcr.io/kube-scheduler:v1.22.3

	k8s.gcr.io/kube-controller-manager:v1.22.3

	k8s.gcr.io/kube-proxy:v1.22.3

	minikube-local-cache-test:functional-20211117161858-31976

	kubernetesui/dashboard:v2.3.1

	k8s.gcr.io/etcd:3.5.0-0

	kubernetesui/metrics-scraper:v1.0.7

	k8s.gcr.io/coredns/coredns:v1.8.4

	gcr.io/k8s-minikube/storage-provisioner:v5

	k8s.gcr.io/pause:3.5

	-- /stdout --

	I1117 16:21:26.412940   33790 cache_images.go:79] Images are preloaded, skipping loading

	I1117 16:21:26.413025   33790 ssh_runner.go:152] Run: docker info --format {{.CgroupDriver}}

	I1117 16:21:26.493364   33790 extraconfig.go:124] Overwriting default enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota with user provided enable-admission-plugins=NamespaceAutoProvision for component apiserver

	I1117 16:21:26.493384   33790 cni.go:93] Creating CNI manager for ""

	I1117 16:21:26.493390   33790 cni.go:167] CNI unnecessary in this configuration, recommending no CNI

	I1117 16:21:26.493393   33790 kubeadm.go:87] Using pod CIDR: 10.244.0.0/16

	I1117 16:21:26.493408   33790 kubeadm.go:153] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.49.2 APIServerPort:8441 KubernetesVersion:v1.22.3 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:functional-20211117161858-31976 NodeName:functional-20211117161858-31976 DNSDomain:cluster.local CRISocket:/var/run/dockershim.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceAutoProvision] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.49.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NoTaintMaster:true NodeIP:192.168.49.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[]}

	I1117 16:21:26.493510   33790 kubeadm.go:157] kubeadm config:

	apiVersion: kubeadm.k8s.io/v1beta2

	kind: InitConfiguration

	localAPIEndpoint:

	  advertiseAddress: 192.168.49.2

	  bindPort: 8441

	bootstrapTokens:

	  - groups:

	      - system:bootstrappers:kubeadm:default-node-token

	    ttl: 24h0m0s

	    usages:

	      - signing

	      - authentication

	nodeRegistration:

	  criSocket: /var/run/dockershim.sock

	  name: "functional-20211117161858-31976"

	  kubeletExtraArgs:

	    node-ip: 192.168.49.2

	  taints: []

	---

	apiVersion: kubeadm.k8s.io/v1beta2

	kind: ClusterConfiguration

	apiServer:

	  certSANs: ["127.0.0.1", "localhost", "192.168.49.2"]

	  extraArgs:

	    enable-admission-plugins: "NamespaceAutoProvision"

	controllerManager:

	  extraArgs:

	    allocate-node-cidrs: "true"

	    leader-elect: "false"

	scheduler:

	  extraArgs:

	    leader-elect: "false"

	certificatesDir: /var/lib/minikube/certs

	clusterName: mk

	controlPlaneEndpoint: control-plane.minikube.internal:8441

	dns:

	  type: CoreDNS

	etcd:

	  local:

	    dataDir: /var/lib/minikube/etcd

	    extraArgs:

	      proxy-refresh-interval: "70000"

	kubernetesVersion: v1.22.3

	networking:

	  dnsDomain: cluster.local

	  podSubnet: "10.244.0.0/16"

	  serviceSubnet: 10.96.0.0/12

	---

	apiVersion: kubelet.config.k8s.io/v1beta1

	kind: KubeletConfiguration

	authentication:

	  x509:

	    clientCAFile: /var/lib/minikube/certs/ca.crt

	cgroupDriver: cgroupfs

	clusterDomain: "cluster.local"

	# disable disk resource management by default

	imageGCHighThresholdPercent: 100

	evictionHard:

	  nodefs.available: "0%!"(MISSING)

	  nodefs.inodesFree: "0%!"(MISSING)

	  imagefs.available: "0%!"(MISSING)

	failSwapOn: false

	staticPodPath: /etc/kubernetes/manifests

	---

	apiVersion: kubeproxy.config.k8s.io/v1alpha1

	kind: KubeProxyConfiguration

	clusterCIDR: "10.244.0.0/16"

	metricsBindAddress: 0.0.0.0:10249

	conntrack:

	  maxPerCore: 0

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"

	  tcpEstablishedTimeout: 0s

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"

	  tcpCloseWaitTimeout: 0s

	I1117 16:21:26.493599   33790 kubeadm.go:909] kubelet [Unit]

	Wants=docker.socket

	[Service]

	ExecStart=

	ExecStart=/var/lib/minikube/binaries/v1.22.3/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=docker --hostname-override=functional-20211117161858-31976 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.49.2

	[Install]

	 config:

	{KubernetesVersion:v1.22.3 ClusterName:functional-20211117161858-31976 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[{Component:apiserver Key:enable-admission-plugins Value:NamespaceAutoProvision}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8441 NodeName:}

	I1117 16:21:26.493666   33790 ssh_runner.go:152] Run: sudo ls /var/lib/minikube/binaries/v1.22.3

	I1117 16:21:26.501690   33790 binaries.go:44] Found k8s binaries, skipping transfer

	I1117 16:21:26.501744   33790 ssh_runner.go:152] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube

	I1117 16:21:26.508804   33790 ssh_runner.go:319] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (357 bytes)

	I1117 16:21:26.521182   33790 ssh_runner.go:319] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)

	I1117 16:21:26.533276   33790 ssh_runner.go:319] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (1924 bytes)

	I1117 16:21:26.554949   33790 ssh_runner.go:152] Run: grep 192.168.49.2	control-plane.minikube.internal$ /etc/hosts

	I1117 16:21:26.559258   33790 certs.go:54] Setting up /Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/profiles/functional-20211117161858-31976 for IP: 192.168.49.2

	I1117 16:21:26.559460   33790 certs.go:182] skipping minikubeCA CA generation: /Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/ca.key

	I1117 16:21:26.559521   33790 certs.go:182] skipping proxyClientCA CA generation: /Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/proxy-client-ca.key

	I1117 16:21:26.559652   33790 certs.go:298] skipping minikube-user signed cert generation: /Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/profiles/functional-20211117161858-31976/client.key

	I1117 16:21:26.559720   33790 certs.go:298] skipping minikube signed cert generation: /Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/profiles/functional-20211117161858-31976/apiserver.key.dd3b5fb2

	I1117 16:21:26.559771   33790 certs.go:298] skipping aggregator signed cert generation: /Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/profiles/functional-20211117161858-31976/proxy-client.key

	I1117 16:21:26.559974   33790 certs.go:388] found cert: /Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/certs/Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/certs/31976.pem (1338 bytes)

	W1117 16:21:26.560019   33790 certs.go:384] ignoring /Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/certs/Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/certs/31976_empty.pem, impossibly tiny 0 bytes

	I1117 16:21:26.560033   33790 certs.go:388] found cert: /Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/certs/Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/certs/ca-key.pem (1679 bytes)

	I1117 16:21:26.560072   33790 certs.go:388] found cert: /Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/certs/Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/certs/ca.pem (1078 bytes)

	I1117 16:21:26.560110   33790 certs.go:388] found cert: /Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/certs/Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/certs/cert.pem (1123 bytes)

	I1117 16:21:26.560155   33790 certs.go:388] found cert: /Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/certs/Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/certs/key.pem (1679 bytes)

	I1117 16:21:26.560217   33790 certs.go:388] found cert: /Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/files/etc/ssl/certs/Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/files/etc/ssl/certs/319762.pem (1708 bytes)

	I1117 16:21:26.561014   33790 ssh_runner.go:319] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/profiles/functional-20211117161858-31976/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1399 bytes)

	I1117 16:21:26.582083   33790 ssh_runner.go:319] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/profiles/functional-20211117161858-31976/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)

	I1117 16:21:26.599821   33790 ssh_runner.go:319] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/profiles/functional-20211117161858-31976/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)

	I1117 16:21:26.636540   33790 ssh_runner.go:319] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/profiles/functional-20211117161858-31976/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)

	I1117 16:21:26.653473   33790 ssh_runner.go:319] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)

	I1117 16:21:26.670129   33790 ssh_runner.go:319] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)

	I1117 16:21:26.686208   33790 ssh_runner.go:319] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)

	I1117 16:21:26.702853   33790 ssh_runner.go:319] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)

	I1117 16:21:26.719475   33790 ssh_runner.go:319] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)

	I1117 16:21:26.736305   33790 ssh_runner.go:319] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/certs/31976.pem --> /usr/share/ca-certificates/31976.pem (1338 bytes)

	I1117 16:21:26.753116   33790 ssh_runner.go:319] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/files/etc/ssl/certs/319762.pem --> /usr/share/ca-certificates/319762.pem (1708 bytes)

	I1117 16:21:26.770927   33790 ssh_runner.go:319] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)

	I1117 16:21:26.783126   33790 ssh_runner.go:152] Run: openssl version

	I1117 16:21:26.788339   33790 ssh_runner.go:152] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/31976.pem && ln -fs /usr/share/ca-certificates/31976.pem /etc/ssl/certs/31976.pem"

	I1117 16:21:26.795960   33790 ssh_runner.go:152] Run: ls -la /usr/share/ca-certificates/31976.pem

	I1117 16:21:26.799692   33790 certs.go:431] hashing: -rw-r--r-- 1 root root 1338 Nov 18 00:18 /usr/share/ca-certificates/31976.pem

	I1117 16:21:26.799736   33790 ssh_runner.go:152] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/31976.pem

	I1117 16:21:26.804943   33790 ssh_runner.go:152] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/31976.pem /etc/ssl/certs/51391683.0"

	I1117 16:21:26.812809   33790 ssh_runner.go:152] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/319762.pem && ln -fs /usr/share/ca-certificates/319762.pem /etc/ssl/certs/319762.pem"

	I1117 16:21:26.820966   33790 ssh_runner.go:152] Run: ls -la /usr/share/ca-certificates/319762.pem

	I1117 16:21:26.825189   33790 certs.go:431] hashing: -rw-r--r-- 1 root root 1708 Nov 18 00:18 /usr/share/ca-certificates/319762.pem

	I1117 16:21:26.825239   33790 ssh_runner.go:152] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/319762.pem

	I1117 16:21:26.830525   33790 ssh_runner.go:152] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/319762.pem /etc/ssl/certs/3ec20f2e.0"

	I1117 16:21:26.838070   33790 ssh_runner.go:152] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"

	I1117 16:21:26.846059   33790 ssh_runner.go:152] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem

	I1117 16:21:26.850266   33790 certs.go:431] hashing: -rw-r--r-- 1 root root 1111 Nov 18 00:12 /usr/share/ca-certificates/minikubeCA.pem

	I1117 16:21:26.850311   33790 ssh_runner.go:152] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem

	I1117 16:21:26.855877   33790 ssh_runner.go:152] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"

	I1117 16:21:26.863048   33790 kubeadm.go:390] StartCluster: {Name:functional-20211117161858-31976 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.28@sha256:4780f1897569d2bf77aafb3d133a08d42b4fe61127f06fcfc90c2c5d902d893c Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.22.3 ClusterName:functional-20211117161858-31976 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServer

IPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[{Component:apiserver Key:enable-admission-plugins Value:NamespaceAutoProvision}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8441 NodeName:} Nodes:[{Name: IP:192.168.49.2 Port:8441 KubernetesVersion:v1.22.3 ControlPlane:true Worker:true}] Addons:map[ambassador:false auto-pause:false csi-hostpath-driver:false dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false helm-tiller:false ingress:false ingress-dns:false istio:false istio-provisioner:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:fal

se volumesnapshots:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host}

	I1117 16:21:26.863171   33790 ssh_runner.go:152] Run: docker ps --filter status=paused --filter=name=k8s_.*_(kube-system)_ --format={{.ID}}

	I1117 16:21:26.891230   33790 ssh_runner.go:152] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd

	I1117 16:21:26.899485   33790 kubeadm.go:401] found existing configuration files, will attempt cluster restart

	I1117 16:21:26.899495   33790 kubeadm.go:600] restartCluster start

	I1117 16:21:26.899552   33790 ssh_runner.go:152] Run: sudo test -d /data/minikube

	I1117 16:21:26.906674   33790 kubeadm.go:126] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1

	stdout:

	stderr:

	I1117 16:21:26.906751   33790 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "8441/tcp") 0).HostPort}}'" functional-20211117161858-31976

	I1117 16:21:27.028837   33790 kubeconfig.go:92] found "functional-20211117161858-31976" server: "https://127.0.0.1:52141"

	I1117 16:21:27.032037   33790 ssh_runner.go:152] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new

	I1117 16:21:27.040014   33790 kubeadm.go:568] needs reconfigure: configs differ:

	-- stdout --

	--- /var/tmp/minikube/kubeadm.yaml	2021-11-18 00:19:49.283585838 +0000

	+++ /var/tmp/minikube/kubeadm.yaml.new	2021-11-18 00:21:26.562255672 +0000

	@@ -22,7 +22,7 @@

	 apiServer:

	   certSANs: ["127.0.0.1", "localhost", "192.168.49.2"]

	   extraArgs:

	-    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"

	+    enable-admission-plugins: "NamespaceAutoProvision"

	 controllerManager:

	   extraArgs:

	     allocate-node-cidrs: "true"

	-- /stdout --

	I1117 16:21:27.040021   33790 kubeadm.go:1032] stopping kube-system containers ...

	I1117 16:21:27.040101   33790 ssh_runner.go:152] Run: docker ps -a --filter=name=k8s_.*_(kube-system)_ --format={{.ID}}

	I1117 16:21:27.071071   33790 docker.go:390] Stopping containers: [ea850ca3cc61 d0d3e0dca5e9 41b6ab69a384 0e35560df59b e4efee81ca46 26ff204bef53 7d514020b6b7 9b2f0c8b2294 57f34cc17d7a acade1ad68d7 5c6c4dc475e0 9bad689182de 72ff4c2179fb e30cdc66639d c595f5f22c80]

	I1117 16:21:27.071168   33790 ssh_runner.go:152] Run: docker stop ea850ca3cc61 d0d3e0dca5e9 41b6ab69a384 0e35560df59b e4efee81ca46 26ff204bef53 7d514020b6b7 9b2f0c8b2294 57f34cc17d7a acade1ad68d7 5c6c4dc475e0 9bad689182de 72ff4c2179fb e30cdc66639d c595f5f22c80

	I1117 16:21:32.228295   33790 ssh_runner.go:192] Completed: docker stop ea850ca3cc61 d0d3e0dca5e9 41b6ab69a384 0e35560df59b e4efee81ca46 26ff204bef53 7d514020b6b7 9b2f0c8b2294 57f34cc17d7a acade1ad68d7 5c6c4dc475e0 9bad689182de 72ff4c2179fb e30cdc66639d c595f5f22c80: (5.156941798s)

	I1117 16:21:32.228388   33790 ssh_runner.go:152] Run: sudo systemctl stop kubelet

	I1117 16:21:32.273365   33790 ssh_runner.go:152] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf

	I1117 16:21:32.281095   33790 kubeadm.go:154] found existing configuration files:

	-rw------- 1 root root 5639 Nov 18 00:19 /etc/kubernetes/admin.conf

	-rw------- 1 root root 5652 Nov 18 00:19 /etc/kubernetes/controller-manager.conf

	-rw------- 1 root root 2063 Nov 18 00:20 /etc/kubernetes/kubelet.conf

	-rw------- 1 root root 5604 Nov 18 00:19 /etc/kubernetes/scheduler.conf

	I1117 16:21:32.281148   33790 ssh_runner.go:152] Run: sudo grep https://control-plane.minikube.internal:8441 /etc/kubernetes/admin.conf

	I1117 16:21:32.288879   33790 ssh_runner.go:152] Run: sudo grep https://control-plane.minikube.internal:8441 /etc/kubernetes/kubelet.conf

	I1117 16:21:32.296147   33790 ssh_runner.go:152] Run: sudo grep https://control-plane.minikube.internal:8441 /etc/kubernetes/controller-manager.conf

	I1117 16:21:32.303562   33790 kubeadm.go:165] "https://control-plane.minikube.internal:8441" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8441 /etc/kubernetes/controller-manager.conf: Process exited with status 1

	stdout:

	stderr:

	I1117 16:21:32.303622   33790 ssh_runner.go:152] Run: sudo rm -f /etc/kubernetes/controller-manager.conf

	I1117 16:21:32.312025   33790 ssh_runner.go:152] Run: sudo grep https://control-plane.minikube.internal:8441 /etc/kubernetes/scheduler.conf

	I1117 16:21:32.319391   33790 kubeadm.go:165] "https://control-plane.minikube.internal:8441" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8441 /etc/kubernetes/scheduler.conf: Process exited with status 1

	stdout:

	stderr:

	I1117 16:21:32.319450   33790 ssh_runner.go:152] Run: sudo rm -f /etc/kubernetes/scheduler.conf

	I1117 16:21:32.326292   33790 ssh_runner.go:152] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml

	I1117 16:21:32.333970   33790 kubeadm.go:676] reconfiguring cluster from /var/tmp/minikube/kubeadm.yaml

	I1117 16:21:32.333977   33790 ssh_runner.go:152] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.22.3:$PATH" kubeadm init phase certs all --config /var/tmp/minikube/kubeadm.yaml"

	I1117 16:21:32.380483   33790 ssh_runner.go:152] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.22.3:$PATH" kubeadm init phase kubeconfig all --config /var/tmp/minikube/kubeadm.yaml"

	I1117 16:21:33.540088   33790 ssh_runner.go:192] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.22.3:$PATH" kubeadm init phase kubeconfig all --config /var/tmp/minikube/kubeadm.yaml": (1.159560405s)

	I1117 16:21:33.540097   33790 ssh_runner.go:152] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.22.3:$PATH" kubeadm init phase kubelet-start --config /var/tmp/minikube/kubeadm.yaml"

	I1117 16:21:33.673891   33790 ssh_runner.go:152] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.22.3:$PATH" kubeadm init phase control-plane all --config /var/tmp/minikube/kubeadm.yaml"

	I1117 16:21:33.726579   33790 ssh_runner.go:152] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.22.3:$PATH" kubeadm init phase etcd local --config /var/tmp/minikube/kubeadm.yaml"

	I1117 16:21:33.795988   33790 api_server.go:51] waiting for apiserver process to appear ...

	I1117 16:21:33.796057   33790 ssh_runner.go:152] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I1117 16:21:33.812813   33790 api_server.go:71] duration metric: took 16.830404ms to wait for apiserver process to appear ...

	I1117 16:21:33.812822   33790 api_server.go:87] waiting for apiserver healthz status ...

	I1117 16:21:33.812833   33790 api_server.go:240] Checking apiserver healthz at https://127.0.0.1:52141/healthz ...

	I1117 16:21:33.819102   33790 api_server.go:266] https://127.0.0.1:52141/healthz returned 200:

	ok

	I1117 16:21:33.826158   33790 api_server.go:140] control plane version: v1.22.3

	I1117 16:21:33.826169   33790 api_server.go:130] duration metric: took 13.343873ms to wait for apiserver health ...

	I1117 16:21:33.826174   33790 cni.go:93] Creating CNI manager for ""

	I1117 16:21:33.826178   33790 cni.go:167] CNI unnecessary in this configuration, recommending no CNI

	I1117 16:21:33.826185   33790 system_pods.go:43] waiting for kube-system pods to appear ...

	I1117 16:21:33.836317   33790 system_pods.go:59] 7 kube-system pods found

	I1117 16:21:33.836331   33790 system_pods.go:61] "coredns-78fcd69978-dnq6x" [67a186a3-f954-4960-bb9e-57d18527dbc7] Running

	I1117 16:21:33.836337   33790 system_pods.go:61] "etcd-functional-20211117161858-31976" [0591e3ee-239f-402b-a882-d725460bb901] Running / Ready:ContainersNotReady (containers with unready status: [etcd]) / ContainersReady:ContainersNotReady (containers with unready status: [etcd])

	I1117 16:21:33.836340   33790 system_pods.go:61] "kube-apiserver-functional-20211117161858-31976" [e7056857-2ed9-4d76-8caa-79910d7b601e] Running / Ready:ContainersNotReady (containers with unready status: [kube-apiserver]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-apiserver])

	I1117 16:21:33.836348   33790 system_pods.go:61] "kube-controller-manager-functional-20211117161858-31976" [7fd136e2-3546-4ed5-a212-51641f6cb3d3] Running / Ready:ContainersNotReady (containers with unready status: [kube-controller-manager]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-controller-manager])

	I1117 16:21:33.836351   33790 system_pods.go:61] "kube-proxy-wbv29" [453e3252-c5a8-48b4-893b-0496a8ed4dec] Running

	I1117 16:21:33.836353   33790 system_pods.go:61] "kube-scheduler-functional-20211117161858-31976" [709bdcfd-0135-490f-9d56-c5ad014aab58] Running

	I1117 16:21:33.836358   33790 system_pods.go:61] "storage-provisioner" [9b9ccef0-fccc-43f7-8dec-952d07564964] Running / Ready:ContainersNotReady (containers with unready status: [storage-provisioner]) / ContainersReady:ContainersNotReady (containers with unready status: [storage-provisioner])

	I1117 16:21:33.836361   33790 system_pods.go:74] duration metric: took 10.173348ms to wait for pod list to return data ...

	I1117 16:21:33.836365   33790 node_conditions.go:102] verifying NodePressure condition ...

	I1117 16:21:33.840538   33790 node_conditions.go:122] node storage ephemeral capacity is 123591232Ki

	I1117 16:21:33.840552   33790 node_conditions.go:123] node cpu capacity is 6

	I1117 16:21:33.840563   33790 node_conditions.go:105] duration metric: took 4.193776ms to run NodePressure ...

	I1117 16:21:33.840571   33790 ssh_runner.go:152] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.22.3:$PATH" kubeadm init phase addon all --config /var/tmp/minikube/kubeadm.yaml"

	I1117 16:21:34.196195   33790 kubeadm.go:731] waiting for restarted kubelet to initialise ...

	I1117 16:21:34.200872   33790 kubeadm.go:746] kubelet initialised

	I1117 16:21:34.200878   33790 kubeadm.go:747] duration metric: took 4.672789ms waiting for restarted kubelet to initialise ...

	I1117 16:21:34.200885   33790 pod_ready.go:35] extra waiting up to 4m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I1117 16:21:34.206372   33790 pod_ready.go:78] waiting up to 4m0s for pod "coredns-78fcd69978-dnq6x" in "kube-system" namespace to be "Ready" ...

	I1117 16:21:34.216319   33790 pod_ready.go:92] pod "coredns-78fcd69978-dnq6x" in "kube-system" namespace has status "Ready":"True"

	I1117 16:21:34.216325   33790 pod_ready.go:81] duration metric: took 9.941793ms waiting for pod "coredns-78fcd69978-dnq6x" in "kube-system" namespace to be "Ready" ...

	I1117 16:21:34.216336   33790 pod_ready.go:78] waiting up to 4m0s for pod "etcd-functional-20211117161858-31976" in "kube-system" namespace to be "Ready" ...

	I1117 16:21:34.733695   33790 pod_ready.go:97] node "functional-20211117161858-31976" hosting pod "etcd-functional-20211117161858-31976" in "kube-system" namespace is currently not "Ready" (skipping!): node "functional-20211117161858-31976" has status "Ready":"False"

	I1117 16:21:34.733705   33790 pod_ready.go:81] duration metric: took 517.348753ms waiting for pod "etcd-functional-20211117161858-31976" in "kube-system" namespace to be "Ready" ...

	E1117 16:21:34.733709   33790 pod_ready.go:66] WaitExtra: waitPodCondition: node "functional-20211117161858-31976" hosting pod "etcd-functional-20211117161858-31976" in "kube-system" namespace is currently not "Ready" (skipping!): node "functional-20211117161858-31976" has status "Ready":"False"

	I1117 16:21:34.733723   33790 pod_ready.go:78] waiting up to 4m0s for pod "kube-apiserver-functional-20211117161858-31976" in "kube-system" namespace to be "Ready" ...

	I1117 16:21:34.738314   33790 pod_ready.go:97] node "functional-20211117161858-31976" hosting pod "kube-apiserver-functional-20211117161858-31976" in "kube-system" namespace is currently not "Ready" (skipping!): node "functional-20211117161858-31976" has status "Ready":"False"

	I1117 16:21:34.738320   33790 pod_ready.go:81] duration metric: took 4.593288ms waiting for pod "kube-apiserver-functional-20211117161858-31976" in "kube-system" namespace to be "Ready" ...

	E1117 16:21:34.738325   33790 pod_ready.go:66] WaitExtra: waitPodCondition: node "functional-20211117161858-31976" hosting pod "kube-apiserver-functional-20211117161858-31976" in "kube-system" namespace is currently not "Ready" (skipping!): node "functional-20211117161858-31976" has status "Ready":"False"

	I1117 16:21:34.738332   33790 pod_ready.go:78] waiting up to 4m0s for pod "kube-controller-manager-functional-20211117161858-31976" in "kube-system" namespace to be "Ready" ...

	I1117 16:21:34.742721   33790 pod_ready.go:97] node "functional-20211117161858-31976" hosting pod "kube-controller-manager-functional-20211117161858-31976" in "kube-system" namespace is currently not "Ready" (skipping!): node "functional-20211117161858-31976" has status "Ready":"False"

	I1117 16:21:34.742728   33790 pod_ready.go:81] duration metric: took 4.392273ms waiting for pod "kube-controller-manager-functional-20211117161858-31976" in "kube-system" namespace to be "Ready" ...

	E1117 16:21:34.742733   33790 pod_ready.go:66] WaitExtra: waitPodCondition: node "functional-20211117161858-31976" hosting pod "kube-controller-manager-functional-20211117161858-31976" in "kube-system" namespace is currently not "Ready" (skipping!): node "functional-20211117161858-31976" has status "Ready":"False"

	I1117 16:21:34.742742   33790 pod_ready.go:78] waiting up to 4m0s for pod "kube-proxy-wbv29" in "kube-system" namespace to be "Ready" ...

	I1117 16:21:35.029336   33790 pod_ready.go:97] node "functional-20211117161858-31976" hosting pod "kube-proxy-wbv29" in "kube-system" namespace is currently not "Ready" (skipping!): node "functional-20211117161858-31976" has status "Ready":"False"

	I1117 16:21:35.029342   33790 pod_ready.go:81] duration metric: took 286.584397ms waiting for pod "kube-proxy-wbv29" in "kube-system" namespace to be "Ready" ...

	E1117 16:21:35.029346   33790 pod_ready.go:66] WaitExtra: waitPodCondition: node "functional-20211117161858-31976" hosting pod "kube-proxy-wbv29" in "kube-system" namespace is currently not "Ready" (skipping!): node "functional-20211117161858-31976" has status "Ready":"False"

	I1117 16:21:35.029360   33790 pod_ready.go:78] waiting up to 4m0s for pod "kube-scheduler-functional-20211117161858-31976" in "kube-system" namespace to be "Ready" ...

	I1117 16:21:35.432286   33790 pod_ready.go:97] node "functional-20211117161858-31976" hosting pod "kube-scheduler-functional-20211117161858-31976" in "kube-system" namespace is currently not "Ready" (skipping!): node "functional-20211117161858-31976" has status "Ready":"False"

	I1117 16:21:35.432297   33790 pod_ready.go:81] duration metric: took 402.92083ms waiting for pod "kube-scheduler-functional-20211117161858-31976" in "kube-system" namespace to be "Ready" ...

	E1117 16:21:35.432302   33790 pod_ready.go:66] WaitExtra: waitPodCondition: node "functional-20211117161858-31976" hosting pod "kube-scheduler-functional-20211117161858-31976" in "kube-system" namespace is currently not "Ready" (skipping!): node "functional-20211117161858-31976" has status "Ready":"False"

	I1117 16:21:35.432314   33790 pod_ready.go:38] duration metric: took 1.231387704s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I1117 16:21:35.432326   33790 ssh_runner.go:152] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"

	I1117 16:21:35.448332   33790 ops.go:34] apiserver oom_adj: -16

	I1117 16:21:35.448338   33790 kubeadm.go:604] restartCluster took 8.54859145s

	I1117 16:21:35.448342   33790 kubeadm.go:392] StartCluster complete in 8.585052624s

	I1117 16:21:35.448355   33790 settings.go:142] acquiring lock: {Name:mk2452f58907cab9912f4bf05149d18acb236e76 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1117 16:21:35.448438   33790 settings.go:150] Updating kubeconfig:  /Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/kubeconfig

	I1117 16:21:35.448901   33790 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/kubeconfig: {Name:mk7b88dea9e1cf642f59443febe00ec01446b401 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1117 16:21:35.454603   33790 kapi.go:244] deployment "coredns" in namespace "kube-system" and context "functional-20211117161858-31976" rescaled to 1

	I1117 16:21:35.454631   33790 start.go:229] Will wait 6m0s for node &{Name: IP:192.168.49.2 Port:8441 KubernetesVersion:v1.22.3 ControlPlane:true Worker:true}

	I1117 16:21:35.454642   33790 ssh_runner.go:152] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.22.3/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"

	I1117 16:21:35.454677   33790 addons.go:415] enableAddons start: toEnable=map[ambassador:false auto-pause:false csi-hostpath-driver:false dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false helm-tiller:false ingress:false ingress-dns:false istio:false istio-provisioner:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false volumesnapshots:false], additional=[]

	I1117 16:21:35.482280   33790 out.go:176] * Verifying Kubernetes components...

	I1117 16:21:35.454823   33790 config.go:176] Loaded profile config "functional-20211117161858-31976": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.22.3

	I1117 16:21:35.482339   33790 addons.go:65] Setting default-storageclass=true in profile "functional-20211117161858-31976"

	I1117 16:21:35.482342   33790 addons.go:65] Setting storage-provisioner=true in profile "functional-20211117161858-31976"

	I1117 16:21:35.482355   33790 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "functional-20211117161858-31976"

	I1117 16:21:35.482360   33790 addons.go:153] Setting addon storage-provisioner=true in "functional-20211117161858-31976"

	I1117 16:21:35.482365   33790 ssh_runner.go:152] Run: sudo systemctl is-active --quiet service kubelet

	W1117 16:21:35.482365   33790 addons.go:165] addon storage-provisioner should already be in state true

	I1117 16:21:35.482397   33790 host.go:66] Checking if "functional-20211117161858-31976" exists ...

	I1117 16:21:35.482835   33790 cli_runner.go:115] Run: docker container inspect functional-20211117161858-31976 --format={{.State.Status}}

	I1117 16:21:35.503648   33790 cli_runner.go:115] Run: docker container inspect functional-20211117161858-31976 --format={{.State.Status}}

	I1117 16:21:35.517807   33790 start.go:719] CoreDNS already contains "host.minikube.internal" host record, skipping...

	I1117 16:21:35.517901   33790 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "8441/tcp") 0).HostPort}}'" functional-20211117161858-31976

	I1117 16:21:35.651758   33790 addons.go:153] Setting addon default-storageclass=true in "functional-20211117161858-31976"

	W1117 16:21:35.651773   33790 addons.go:165] addon default-storageclass should already be in state true

	I1117 16:21:35.651786   33790 host.go:66] Checking if "functional-20211117161858-31976" exists ...

	I1117 16:21:35.652195   33790 cli_runner.go:115] Run: docker container inspect functional-20211117161858-31976 --format={{.State.Status}}

	I1117 16:21:35.688652   33790 out.go:176]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5

	I1117 16:21:35.688763   33790 addons.go:348] installing /etc/kubernetes/addons/storage-provisioner.yaml

	I1117 16:21:35.688779   33790 ssh_runner.go:319] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)

	I1117 16:21:35.688858   33790 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-20211117161858-31976

	I1117 16:21:35.694743   33790 node_ready.go:35] waiting up to 6m0s for node "functional-20211117161858-31976" to be "Ready" ...

	I1117 16:21:35.793431   33790 addons.go:348] installing /etc/kubernetes/addons/storageclass.yaml

	I1117 16:21:35.793440   33790 ssh_runner.go:319] scp memory --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)

	I1117 16:21:35.793530   33790 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-20211117161858-31976

	I1117 16:21:35.827874   33790 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:52137 SSHKeyPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/machines/functional-20211117161858-31976/id_rsa Username:docker}

	I1117 16:21:35.921703   33790 ssh_runner.go:152] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.22.3/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml

	I1117 16:21:35.934689   33790 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:52137 SSHKeyPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/machines/functional-20211117161858-31976/id_rsa Username:docker}

	I1117 16:21:36.037457   33790 ssh_runner.go:152] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.22.3/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml

	I1117 16:21:36.223180   33790 out.go:176] * Enabled addons: storage-provisioner, default-storageclass

	I1117 16:21:36.223193   33790 addons.go:417] enableAddons completed in 768.519889ms

	I1117 16:21:37.704232   33790 node_ready.go:58] node "functional-20211117161858-31976" has status "Ready":"False"

	I1117 16:21:48.248672   33790 node_ready.go:53] error getting node "functional-20211117161858-31976": an error on the server ("") has prevented the request from succeeding (get nodes functional-20211117161858-31976)

	I1117 16:21:48.248680   33790 node_ready.go:38] duration metric: took 12.55354997s waiting for node "functional-20211117161858-31976" to be "Ready" ...

	I1117 16:21:48.274481   33790 out.go:176] 

	W1117 16:21:48.274560   33790 out.go:241] X Exiting due to GUEST_START: wait 6m0s for node: waiting for node to be ready: waitNodeCondition: error getting node "functional-20211117161858-31976": an error on the server ("") has prevented the request from succeeding (get nodes functional-20211117161858-31976)

	W1117 16:21:48.274567   33790 out.go:241] * 

	W1117 16:21:48.275136   33790 out.go:241] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	* 

	* ==> Docker <==

	* -- Logs begin at Thu 2021-11-18 00:19:19 UTC, end at Thu 2021-11-18 00:21:50 UTC. --

	Nov 18 00:19:46 functional-20211117161858-31976 dockerd[468]: time="2021-11-18T00:19:46.215832592Z" level=info msg="Daemon has completed initialization"

	Nov 18 00:19:46 functional-20211117161858-31976 systemd[1]: Started Docker Application Container Engine.

	Nov 18 00:19:46 functional-20211117161858-31976 dockerd[468]: time="2021-11-18T00:19:46.238854763Z" level=info msg="API listen on [::]:2376"

	Nov 18 00:19:46 functional-20211117161858-31976 dockerd[468]: time="2021-11-18T00:19:46.241903110Z" level=info msg="API listen on /var/run/docker.sock"

	Nov 18 00:20:31 functional-20211117161858-31976 dockerd[468]: time="2021-11-18T00:20:31.951567126Z" level=info msg="ignoring event" container=297f7a37e8bd7e92a66de64cccc099099267fca4f04ebdb80560c3fcd6134577 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Nov 18 00:20:31 functional-20211117161858-31976 dockerd[468]: time="2021-11-18T00:20:31.995327419Z" level=info msg="ignoring event" container=1a443d1f744d39173e81d045ed1ce442d19760861b9b4307dc4c605d2085949d module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Nov 18 00:20:52 functional-20211117161858-31976 dockerd[468]: time="2021-11-18T00:20:52.253052227Z" level=info msg="ignoring event" container=d0d3e0dca5e9300eb2fb46ca47b9bcb6ec63a0aad06b59cb5d507a3a4e10680c module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Nov 18 00:21:27 functional-20211117161858-31976 dockerd[468]: time="2021-11-18T00:21:27.295680499Z" level=info msg="ignoring event" container=41b6ab69a384cb2e2ddb1f58cec2f1e85d3f1eb993943f1b6072c82a98fd06b0 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Nov 18 00:21:27 functional-20211117161858-31976 dockerd[468]: time="2021-11-18T00:21:27.304131363Z" level=info msg="ignoring event" container=e4efee81ca4695061c2b6dbf156d12f268077143c8eb277bd7100d8ef2b2c746 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Nov 18 00:21:27 functional-20211117161858-31976 dockerd[468]: time="2021-11-18T00:21:27.317333478Z" level=info msg="ignoring event" container=acade1ad68d757b68fa1e074e64d4bcad38eb847718506af25d18d956f2802ee module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Nov 18 00:21:27 functional-20211117161858-31976 dockerd[468]: time="2021-11-18T00:21:27.317377663Z" level=info msg="ignoring event" container=7d514020b6b739c237d0dfbeed599f8d20fe29b82c0c692c1fd395c603db5d4e module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Nov 18 00:21:27 functional-20211117161858-31976 dockerd[468]: time="2021-11-18T00:21:27.318184856Z" level=info msg="ignoring event" container=9bad689182deb3a3a60cf2e56ad1100208a956315916a74e9011474dce7d993e module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Nov 18 00:21:27 functional-20211117161858-31976 dockerd[468]: time="2021-11-18T00:21:27.328384627Z" level=info msg="ignoring event" container=72ff4c2179fba02d43ccc433933719e2c2c383ce806bfdeb133a5c8c986a42f6 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Nov 18 00:21:27 functional-20211117161858-31976 dockerd[468]: time="2021-11-18T00:21:27.400303630Z" level=info msg="ignoring event" container=ea850ca3cc61f91a1d9499307e0c2772fec37eaae99f198afab1abd75c47845b module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Nov 18 00:21:27 functional-20211117161858-31976 dockerd[468]: time="2021-11-18T00:21:27.401539547Z" level=info msg="ignoring event" container=c595f5f22c8069dac10251914290d0bd3bffa5e83e842b2b2e5d28f8490bb26f module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Nov 18 00:21:27 functional-20211117161858-31976 dockerd[468]: time="2021-11-18T00:21:27.404561545Z" level=info msg="ignoring event" container=26ff204bef53fc0dd18974e371dadc54ca7dcdf9d710d3665b61c303bddcee0e module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Nov 18 00:21:27 functional-20211117161858-31976 dockerd[468]: time="2021-11-18T00:21:27.421254142Z" level=info msg="ignoring event" container=e30cdc66639da264af9585cfacae2cd0521fceedefac10b6fcfb5737ba3a87c3 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Nov 18 00:21:27 functional-20211117161858-31976 dockerd[468]: time="2021-11-18T00:21:27.430842555Z" level=info msg="ignoring event" container=57f34cc17d7a6aae9f8632a13b459232478f514fe0f9238e9f12307474be2aeb module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Nov 18 00:21:28 functional-20211117161858-31976 dockerd[468]: time="2021-11-18T00:21:28.107342437Z" level=info msg="ignoring event" container=5c6c4dc475e0660b8b2222acba60032c7e49bb624a8c38a53e34b1ebba19402e module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Nov 18 00:21:28 functional-20211117161858-31976 dockerd[468]: time="2021-11-18T00:21:28.118865919Z" level=info msg="ignoring event" container=9b2f0c8b2294b600fc96d434db4d07350341a1416663656abaf0eabe13f7007c module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Nov 18 00:21:32 functional-20211117161858-31976 dockerd[468]: time="2021-11-18T00:21:32.227573401Z" level=info msg="ignoring event" container=0e35560df59bfc3e72f16462d40b50c0480ce4e80d80028a8c867f8f9cf914ed module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Nov 18 00:21:36 functional-20211117161858-31976 dockerd[468]: time="2021-11-18T00:21:36.535503755Z" level=info msg="ignoring event" container=2ff1bb3b6c9371822d485e55a78074e668fc4461c35828f4d9ea383e3af000a6 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Nov 18 00:21:37 functional-20211117161858-31976 dockerd[468]: time="2021-11-18T00:21:37.813734943Z" level=info msg="ignoring event" container=e180853e419038951cae72f6dcf958ed9e63196aeb434f87f93d71eb7f7bd335 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Nov 18 00:21:37 functional-20211117161858-31976 dockerd[468]: time="2021-11-18T00:21:37.885685250Z" level=info msg="ignoring event" container=2e79e79749173295007690797003e6e7aadbc13edb87be79e18ab291e2222c62 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Nov 18 00:21:37 functional-20211117161858-31976 dockerd[468]: time="2021-11-18T00:21:37.910686858Z" level=info msg="ignoring event" container=622e4ca9307f2db3d4eff6dbe6895f584fdeac51698c6b276894bf22bcc4af05 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	* 

	* ==> container status <==

	* CONTAINER           IMAGE               CREATED              STATE               NAME                      ATTEMPT             POD ID

	e180853e41903       53224b502ea4d       13 seconds ago       Exited              kube-apiserver            1                   f8f1e147723bf

	fbf9821ffb084       8d147537fb7d1       13 seconds ago       Running             coredns                   1                   47dbcdbbcbb52

	422236a5e675b       6e38f40d628db       14 seconds ago       Running             storage-provisioner       2                   250d98e52e33e

	250907264d348       0aa9c7e31d307       22 seconds ago       Running             kube-scheduler            1                   6e098b42d6ec1

	e34b718143e14       05c905cef780c       22 seconds ago       Running             kube-controller-manager   1                   8d617fb091a41

	4a9c75d87f40b       0048118155842       22 seconds ago       Running             etcd                      1                   dbf91b2d10759

	dec4850aecf1d       6120bd723dced       22 seconds ago       Running             kube-proxy                1                   1357ef914aa3f

	ea850ca3cc61f       6e38f40d628db       58 seconds ago       Exited              storage-provisioner       1                   41b6ab69a384c

	0e35560df59bf       8d147537fb7d1       About a minute ago   Exited              coredns                   0                   7d514020b6b73

	e4efee81ca469       6120bd723dced       About a minute ago   Exited              kube-proxy                0                   26ff204bef53f

	9b2f0c8b2294b       0aa9c7e31d307       About a minute ago   Exited              kube-scheduler            0                   9bad689182deb

	57f34cc17d7a6       05c905cef780c       About a minute ago   Exited              kube-controller-manager   0                   72ff4c2179fba

	acade1ad68d75       0048118155842       About a minute ago   Exited              etcd                      0                   c595f5f22c806

	* 

	* ==> coredns [0e35560df59b] <==

	* [INFO] plugin/ready: Still waiting on: "kubernetes"

	[INFO] plugin/ready: Still waiting on: "kubernetes"

	[WARNING] plugin/kubernetes: starting server with unsynced Kubernetes API

	.:53

	[INFO] plugin/reload: Running configuration MD5 = db32ca3650231d74073ff4cf814959a7

	CoreDNS-1.8.4

	linux/amd64, go1.16.4, 053c4d5

	[INFO] plugin/ready: Still waiting on: "kubernetes"

	[INFO] plugin/ready: Still waiting on: "kubernetes"

	[INFO] plugin/ready: Still waiting on: "kubernetes"

	[INFO] Reloading

	[INFO] plugin/health: Going into lameduck mode for 5s

	[INFO] plugin/reload: Running configuration MD5 = c23ed519c17e71ee396ed052e6209e94

	[INFO] Reloading complete

	[INFO] SIGTERM: Shutting down servers then terminating

	[INFO] plugin/health: Going into lameduck mode for 5s

	* 

	* ==> coredns [fbf9821ffb08] <==

	* .:53

	[INFO] plugin/reload: Running configuration MD5 = c23ed519c17e71ee396ed052e6209e94

	CoreDNS-1.8.4

	linux/amd64, go1.16.4, 053c4d5

	W1118 00:21:37.886846       1 reflector.go:436] pkg/mod/k8s.io/client-go@v0.21.1/tools/cache/reflector.go:167: watch of *v1.EndpointSlice ended with: very short watch: pkg/mod/k8s.io/client-go@v0.21.1/tools/cache/reflector.go:167: Unexpected watch close - watch lasted less than a second and no items received

	W1118 00:21:37.886923       1 reflector.go:436] pkg/mod/k8s.io/client-go@v0.21.1/tools/cache/reflector.go:167: watch of *v1.Service ended with: very short watch: pkg/mod/k8s.io/client-go@v0.21.1/tools/cache/reflector.go:167: Unexpected watch close - watch lasted less than a second and no items received

	W1118 00:21:37.886940       1 reflector.go:436] pkg/mod/k8s.io/client-go@v0.21.1/tools/cache/reflector.go:167: watch of *v1.Namespace ended with: very short watch: pkg/mod/k8s.io/client-go@v0.21.1/tools/cache/reflector.go:167: Unexpected watch close - watch lasted less than a second and no items received

	E1118 00:21:38.740403       1 reflector.go:138] pkg/mod/k8s.io/client-go@v0.21.1/tools/cache/reflector.go:167: Failed to watch *v1.Namespace: failed to list *v1.Namespace: Get "https://10.96.0.1:443/api/v1/namespaces?resourceVersion=525": dial tcp 10.96.0.1:443: connect: connection refused

	E1118 00:21:39.028112       1 reflector.go:138] pkg/mod/k8s.io/client-go@v0.21.1/tools/cache/reflector.go:167: Failed to watch *v1.EndpointSlice: failed to list *v1.EndpointSlice: Get "https://10.96.0.1:443/apis/discovery.k8s.io/v1/endpointslices?resourceVersion=525": dial tcp 10.96.0.1:443: connect: connection refused

	E1118 00:21:39.237619       1 reflector.go:138] pkg/mod/k8s.io/client-go@v0.21.1/tools/cache/reflector.go:167: Failed to watch *v1.Service: failed to list *v1.Service: Get "https://10.96.0.1:443/api/v1/services?resourceVersion=525": dial tcp 10.96.0.1:443: connect: connection refused

	E1118 00:21:40.592244       1 reflector.go:138] pkg/mod/k8s.io/client-go@v0.21.1/tools/cache/reflector.go:167: Failed to watch *v1.Namespace: failed to list *v1.Namespace: Get "https://10.96.0.1:443/api/v1/namespaces?resourceVersion=525": dial tcp 10.96.0.1:443: connect: connection refused

	E1118 00:21:40.783828       1 reflector.go:138] pkg/mod/k8s.io/client-go@v0.21.1/tools/cache/reflector.go:167: Failed to watch *v1.EndpointSlice: failed to list *v1.EndpointSlice: Get "https://10.96.0.1:443/apis/discovery.k8s.io/v1/endpointslices?resourceVersion=525": dial tcp 10.96.0.1:443: connect: connection refused

	E1118 00:21:41.320049       1 reflector.go:138] pkg/mod/k8s.io/client-go@v0.21.1/tools/cache/reflector.go:167: Failed to watch *v1.Service: failed to list *v1.Service: Get "https://10.96.0.1:443/api/v1/services?resourceVersion=525": dial tcp 10.96.0.1:443: connect: connection refused

	E1118 00:21:45.185752       1 reflector.go:138] pkg/mod/k8s.io/client-go@v0.21.1/tools/cache/reflector.go:167: Failed to watch *v1.Service: failed to list *v1.Service: Get "https://10.96.0.1:443/api/v1/services?resourceVersion=525": dial tcp 10.96.0.1:443: connect: connection refused

	E1118 00:21:45.421249       1 reflector.go:138] pkg/mod/k8s.io/client-go@v0.21.1/tools/cache/reflector.go:167: Failed to watch *v1.Namespace: failed to list *v1.Namespace: Get "https://10.96.0.1:443/api/v1/namespaces?resourceVersion=525": dial tcp 10.96.0.1:443: connect: connection refused

	E1118 00:21:46.568514       1 reflector.go:138] pkg/mod/k8s.io/client-go@v0.21.1/tools/cache/reflector.go:167: Failed to watch *v1.EndpointSlice: failed to list *v1.EndpointSlice: Get "https://10.96.0.1:443/apis/discovery.k8s.io/v1/endpointslices?resourceVersion=525": dial tcp 10.96.0.1:443: connect: connection refused

	* 

	* ==> describe nodes <==

	* 

	* ==> dmesg <==

	* [  +0.035670] bpfilter: read fail 0

	[  +0.029225] bpfilter: read fail 0

	[  +0.036872] bpfilter: read fail 0

	[  +0.029931] bpfilter: read fail 0

	[  +0.028934] bpfilter: read fail 0

	[  +0.025120] bpfilter: read fail 0

	[  +0.028036] bpfilter: read fail 0

	[  +0.030521] bpfilter: read fail 0

	[  +0.025914] bpfilter: read fail 0

	[  +0.037066] bpfilter: read fail 0

	[  +0.044538] bpfilter: read fail 0

	[  +0.023912] bpfilter: read fail 0

	[  +0.034062] bpfilter: read fail 0

	[  +0.033394] bpfilter: read fail 0

	[  +0.034824] bpfilter: write fail -32

	[  +0.028619] bpfilter: write fail -32

	[  +0.026012] bpfilter: read fail 0

	[  +0.034679] bpfilter: write fail -32

	[  +0.033542] bpfilter: read fail 0

	[  +0.030549] bpfilter: write fail -32

	[  +0.030916] bpfilter: read fail 0

	[  +0.024932] bpfilter: read fail 0

	[  +0.030508] bpfilter: read fail 0

	[  +0.042210] bpfilter: read fail 0

	[  +0.025433] bpfilter: read fail 0

	* 

	* ==> etcd [4a9c75d87f40] <==

	* {"level":"info","ts":"2021-11-18T00:21:28.819Z","caller":"etcdserver/quota.go:94","msg":"enabled backend quota with default value","quota-name":"v3-applier","quota-size-bytes":2147483648,"quota-size":"2.1 GB"}

	{"level":"info","ts":"2021-11-18T00:21:28.819Z","caller":"etcdserver/server.go:834","msg":"starting etcd server","local-member-id":"aec36adc501070cc","local-server-version":"3.5.0","cluster-id":"fa54960ea34d58be","cluster-version":"3.5"}

	{"level":"info","ts":"2021-11-18T00:21:28.820Z","caller":"etcdserver/server.go:728","msg":"started as single-node; fast-forwarding election ticks","local-member-id":"aec36adc501070cc","forward-ticks":9,"forward-duration":"900ms","election-ticks":10,"election-timeout":"1s"}

	{"level":"info","ts":"2021-11-18T00:21:28.820Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc switched to configuration voters=(12593026477526642892)"}

	{"level":"info","ts":"2021-11-18T00:21:28.820Z","caller":"membership/cluster.go:393","msg":"added member","cluster-id":"fa54960ea34d58be","local-member-id":"aec36adc501070cc","added-peer-id":"aec36adc501070cc","added-peer-peer-urls":["https://192.168.49.2:2380"]}

	{"level":"info","ts":"2021-11-18T00:21:28.820Z","caller":"membership/cluster.go:523","msg":"updated cluster version","cluster-id":"fa54960ea34d58be","local-member-id":"aec36adc501070cc","from":"3.5","to":"3.5"}

	{"level":"info","ts":"2021-11-18T00:21:28.821Z","caller":"embed/etcd.go:687","msg":"starting with client TLS","tls-info":"cert = /var/lib/minikube/certs/etcd/server.crt, key = /var/lib/minikube/certs/etcd/server.key, client-cert=, client-key=, trusted-ca = /var/lib/minikube/certs/etcd/ca.crt, client-cert-auth = true, crl-file = ","cipher-suites":[]}

	{"level":"info","ts":"2021-11-18T00:21:28.822Z","caller":"embed/etcd.go:580","msg":"serving peer traffic","address":"192.168.49.2:2380"}

	{"level":"info","ts":"2021-11-18T00:21:28.822Z","caller":"embed/etcd.go:552","msg":"cmux::serve","address":"192.168.49.2:2380"}

	{"level":"info","ts":"2021-11-18T00:21:28.822Z","caller":"embed/etcd.go:276","msg":"now serving peer/client/metrics","local-member-id":"aec36adc501070cc","initial-advertise-peer-urls":["https://192.168.49.2:2380"],"listen-peer-urls":["https://192.168.49.2:2380"],"advertise-client-urls":["https://192.168.49.2:2379"],"listen-client-urls":["https://127.0.0.1:2379","https://192.168.49.2:2379"],"listen-metrics-urls":["http://127.0.0.1:2381"]}

	{"level":"info","ts":"2021-11-18T00:21:28.822Z","caller":"embed/etcd.go:762","msg":"serving metrics","address":"http://127.0.0.1:2381"}

	{"level":"info","ts":"2021-11-18T00:21:29.212Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc is starting a new election at term 2"}

	{"level":"info","ts":"2021-11-18T00:21:29.212Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc became pre-candidate at term 2"}

	{"level":"info","ts":"2021-11-18T00:21:29.212Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc received MsgPreVoteResp from aec36adc501070cc at term 2"}

	{"level":"info","ts":"2021-11-18T00:21:29.212Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc became candidate at term 3"}

	{"level":"info","ts":"2021-11-18T00:21:29.212Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc received MsgVoteResp from aec36adc501070cc at term 3"}

	{"level":"info","ts":"2021-11-18T00:21:29.212Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc became leader at term 3"}

	{"level":"info","ts":"2021-11-18T00:21:29.212Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"raft.node: aec36adc501070cc elected leader aec36adc501070cc at term 3"}

	{"level":"info","ts":"2021-11-18T00:21:29.213Z","caller":"etcdserver/server.go:2027","msg":"published local member to cluster through raft","local-member-id":"aec36adc501070cc","local-member-attributes":"{Name:functional-20211117161858-31976 ClientURLs:[https://192.168.49.2:2379]}","request-path":"/0/members/aec36adc501070cc/attributes","cluster-id":"fa54960ea34d58be","publish-timeout":"7s"}

	{"level":"info","ts":"2021-11-18T00:21:29.213Z","caller":"embed/serve.go:98","msg":"ready to serve client requests"}

	{"level":"info","ts":"2021-11-18T00:21:29.214Z","caller":"embed/serve.go:98","msg":"ready to serve client requests"}

	{"level":"info","ts":"2021-11-18T00:21:29.215Z","caller":"embed/serve.go:188","msg":"serving client traffic securely","address":"192.168.49.2:2379"}

	{"level":"info","ts":"2021-11-18T00:21:29.215Z","caller":"etcdmain/main.go:47","msg":"notifying init daemon"}

	{"level":"info","ts":"2021-11-18T00:21:29.215Z","caller":"etcdmain/main.go:53","msg":"successfully notified init daemon"}

	{"level":"info","ts":"2021-11-18T00:21:29.226Z","caller":"embed/serve.go:188","msg":"serving client traffic securely","address":"127.0.0.1:2379"}

	* 

	* ==> etcd [acade1ad68d7] <==

	* {"level":"info","ts":"2021-11-18T00:20:01.466Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc became pre-candidate at term 1"}

	{"level":"info","ts":"2021-11-18T00:20:01.466Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc received MsgPreVoteResp from aec36adc501070cc at term 1"}

	{"level":"info","ts":"2021-11-18T00:20:01.466Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc became candidate at term 2"}

	{"level":"info","ts":"2021-11-18T00:20:01.467Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc received MsgVoteResp from aec36adc501070cc at term 2"}

	{"level":"info","ts":"2021-11-18T00:20:01.467Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc became leader at term 2"}

	{"level":"info","ts":"2021-11-18T00:20:01.467Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"raft.node: aec36adc501070cc elected leader aec36adc501070cc at term 2"}

	{"level":"info","ts":"2021-11-18T00:20:01.467Z","caller":"etcdserver/server.go:2476","msg":"setting up initial cluster version using v2 API","cluster-version":"3.5"}

	{"level":"info","ts":"2021-11-18T00:20:01.467Z","caller":"embed/serve.go:98","msg":"ready to serve client requests"}

	{"level":"info","ts":"2021-11-18T00:20:01.467Z","caller":"etcdserver/server.go:2027","msg":"published local member to cluster through raft","local-member-id":"aec36adc501070cc","local-member-attributes":"{Name:functional-20211117161858-31976 ClientURLs:[https://192.168.49.2:2379]}","request-path":"/0/members/aec36adc501070cc/attributes","cluster-id":"fa54960ea34d58be","publish-timeout":"7s"}

	{"level":"info","ts":"2021-11-18T00:20:01.467Z","caller":"embed/serve.go:98","msg":"ready to serve client requests"}

	{"level":"info","ts":"2021-11-18T00:20:01.468Z","caller":"etcdmain/main.go:47","msg":"notifying init daemon"}

	{"level":"info","ts":"2021-11-18T00:20:01.468Z","caller":"etcdmain/main.go:53","msg":"successfully notified init daemon"}

	{"level":"info","ts":"2021-11-18T00:20:01.468Z","caller":"embed/serve.go:188","msg":"serving client traffic securely","address":"192.168.49.2:2379"}

	{"level":"info","ts":"2021-11-18T00:20:01.469Z","caller":"embed/serve.go:188","msg":"serving client traffic securely","address":"127.0.0.1:2379"}

	{"level":"info","ts":"2021-11-18T00:20:01.475Z","caller":"membership/cluster.go:531","msg":"set initial cluster version","cluster-id":"fa54960ea34d58be","local-member-id":"aec36adc501070cc","cluster-version":"3.5"}

	{"level":"info","ts":"2021-11-18T00:20:01.475Z","caller":"api/capability.go:75","msg":"enabled capabilities for version","cluster-version":"3.5"}

	{"level":"info","ts":"2021-11-18T00:20:01.475Z","caller":"etcdserver/server.go:2500","msg":"cluster version is updated","cluster-version":"3.5"}

	{"level":"info","ts":"2021-11-18T00:21:27.125Z","caller":"osutil/interrupt_unix.go:64","msg":"received signal; shutting down","signal":"terminated"}

	{"level":"info","ts":"2021-11-18T00:21:27.125Z","caller":"embed/etcd.go:367","msg":"closing etcd server","name":"functional-20211117161858-31976","data-dir":"/var/lib/minikube/etcd","advertise-peer-urls":["https://192.168.49.2:2380"],"advertise-client-urls":["https://192.168.49.2:2379"]}

	WARNING: 2021/11/18 00:21:27 [core] grpc: addrConn.createTransport failed to connect to {127.0.0.1:2379 127.0.0.1:2379 <nil> 0 <nil>}. Err: connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...

	WARNING: 2021/11/18 00:21:27 [core] grpc: addrConn.createTransport failed to connect to {192.168.49.2:2379 192.168.49.2:2379 <nil> 0 <nil>}. Err: connection error: desc = "transport: Error while dialing dial tcp 192.168.49.2:2379: connect: connection refused". Reconnecting...

	{"level":"info","ts":"2021-11-18T00:21:27.135Z","caller":"etcdserver/server.go:1438","msg":"skipped leadership transfer for single voting member cluster","local-member-id":"aec36adc501070cc","current-leader-member-id":"aec36adc501070cc"}

	{"level":"info","ts":"2021-11-18T00:21:27.137Z","caller":"embed/etcd.go:562","msg":"stopping serving peer traffic","address":"192.168.49.2:2380"}

	{"level":"info","ts":"2021-11-18T00:21:27.138Z","caller":"embed/etcd.go:567","msg":"stopped serving peer traffic","address":"192.168.49.2:2380"}

	{"level":"info","ts":"2021-11-18T00:21:27.138Z","caller":"embed/etcd.go:369","msg":"closed etcd server","name":"functional-20211117161858-31976","data-dir":"/var/lib/minikube/etcd","advertise-peer-urls":["https://192.168.49.2:2380"],"advertise-client-urls":["https://192.168.49.2:2379"]}

	* 

	* ==> kernel <==

	*  00:21:50 up 11 min,  0 users,  load average: 2.60, 2.24, 1.34

	Linux functional-20211117161858-31976 5.10.25-linuxkit #1 SMP Tue Mar 23 09:27:39 UTC 2021 x86_64 x86_64 x86_64 GNU/Linux

	PRETTY_NAME="Ubuntu 20.04.2 LTS"

	* 

	* ==> kube-apiserver [e180853e4190] <==

	* I1118 00:21:37.794054       1 server.go:553] external host was not specified, using 192.168.49.2

	I1118 00:21:37.794682       1 server.go:161] Version: v1.22.3

	Error: failed to create listener: failed to listen on 0.0.0.0:8441: listen tcp 0.0.0.0:8441: bind: address already in use

	* 

	* ==> kube-controller-manager [57f34cc17d7a] <==

	* I1118 00:20:19.861174       1 event.go:291] "Event occurred" object="kube-system/coredns" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled up replica set coredns-78fcd69978 to 2"

	I1118 00:20:19.864808       1 shared_informer.go:247] Caches are synced for node 

	I1118 00:20:19.864840       1 range_allocator.go:172] Starting range CIDR allocator

	I1118 00:20:19.864843       1 shared_informer.go:240] Waiting for caches to sync for cidrallocator

	I1118 00:20:19.864848       1 shared_informer.go:247] Caches are synced for cidrallocator 

	I1118 00:20:19.868661       1 event.go:291] "Event occurred" object="kube-system/kube-proxy" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: kube-proxy-wbv29"

	I1118 00:20:19.873974       1 range_allocator.go:373] Set node functional-20211117161858-31976 PodCIDR to [10.244.0.0/24]

	I1118 00:20:19.885673       1 event.go:291] "Event occurred" object="kube-system/coredns-78fcd69978" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: coredns-78fcd69978-dnq6x"

	I1118 00:20:19.936687       1 shared_informer.go:247] Caches are synced for ReplicationController 

	I1118 00:20:19.938663       1 event.go:291] "Event occurred" object="kube-system/coredns-78fcd69978" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: coredns-78fcd69978-hk5kk"

	I1118 00:20:20.000246       1 shared_informer.go:247] Caches are synced for disruption 

	I1118 00:20:20.038779       1 disruption.go:371] Sending events to api server.

	I1118 00:20:20.051192       1 shared_informer.go:247] Caches are synced for expand 

	I1118 00:20:20.051310       1 shared_informer.go:247] Caches are synced for PVC protection 

	I1118 00:20:20.051344       1 shared_informer.go:247] Caches are synced for persistent volume 

	I1118 00:20:20.056678       1 shared_informer.go:247] Caches are synced for attach detach 

	I1118 00:20:20.071851       1 shared_informer.go:247] Caches are synced for resource quota 

	I1118 00:20:20.071858       1 shared_informer.go:247] Caches are synced for ephemeral 

	I1118 00:20:20.076620       1 event.go:291] "Event occurred" object="kube-system/coredns" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled down replica set coredns-78fcd69978 to 1"

	I1118 00:20:20.078475       1 shared_informer.go:247] Caches are synced for resource quota 

	I1118 00:20:20.080869       1 event.go:291] "Event occurred" object="kube-system/coredns-78fcd69978" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulDelete" message="Deleted pod: coredns-78fcd69978-hk5kk"

	I1118 00:20:20.102042       1 shared_informer.go:247] Caches are synced for stateful set 

	I1118 00:20:20.488636       1 shared_informer.go:247] Caches are synced for garbage collector 

	I1118 00:20:20.493195       1 shared_informer.go:247] Caches are synced for garbage collector 

	I1118 00:20:20.493249       1 garbagecollector.go:151] Garbage collector: all resource monitors have synced. Proceeding to collect garbage

	* 

	* ==> kube-controller-manager [e34b718143e1] <==

	* I1118 00:21:34.143549       1 shared_informer.go:240] Waiting for caches to sync for TTL after finished

	I1118 00:21:34.200748       1 controllermanager.go:577] Started "daemonset"

	I1118 00:21:34.200959       1 daemon_controller.go:284] Starting daemon sets controller

	I1118 00:21:34.200969       1 shared_informer.go:240] Waiting for caches to sync for daemon sets

	I1118 00:21:34.203220       1 controllermanager.go:577] Started "tokencleaner"

	I1118 00:21:34.203256       1 tokencleaner.go:118] Starting token cleaner controller

	I1118 00:21:34.203265       1 shared_informer.go:240] Waiting for caches to sync for token_cleaner

	I1118 00:21:34.203322       1 shared_informer.go:247] Caches are synced for token_cleaner 

	I1118 00:21:34.205951       1 controllermanager.go:577] Started "attachdetach"

	I1118 00:21:34.206303       1 attach_detach_controller.go:328] Starting attach detach controller

	I1118 00:21:34.206337       1 shared_informer.go:240] Waiting for caches to sync for attach detach

	I1118 00:21:34.215108       1 controllermanager.go:577] Started "horizontalpodautoscaling"

	I1118 00:21:34.215316       1 horizontal.go:169] Starting HPA controller

	I1118 00:21:34.215328       1 shared_informer.go:240] Waiting for caches to sync for HPA

	I1118 00:21:34.217872       1 controllermanager.go:577] Started "ttl"

	I1118 00:21:34.217989       1 ttl_controller.go:121] Starting TTL controller

	I1118 00:21:34.218018       1 shared_informer.go:240] Waiting for caches to sync for TTL

	I1118 00:21:34.220481       1 controllermanager.go:577] Started "bootstrapsigner"

	I1118 00:21:34.220737       1 shared_informer.go:240] Waiting for caches to sync for bootstrap_signer

	I1118 00:21:34.223299       1 node_ipam_controller.go:91] Sending events to api server.

	W1118 00:21:44.203700       1 client_builder_dynamic.go:197] get or create service account failed: Get "https://192.168.49.2:8441/api/v1/namespaces/kube-system/serviceaccounts/node-controller": dial tcp 192.168.49.2:8441: connect: connection refused

	W1118 00:21:44.704666       1 client_builder_dynamic.go:197] get or create service account failed: Get "https://192.168.49.2:8441/api/v1/namespaces/kube-system/serviceaccounts/node-controller": dial tcp 192.168.49.2:8441: connect: connection refused

	W1118 00:21:45.705860       1 client_builder_dynamic.go:197] get or create service account failed: Get "https://192.168.49.2:8441/api/v1/namespaces/kube-system/serviceaccounts/node-controller": dial tcp 192.168.49.2:8441: connect: connection refused

	W1118 00:21:47.706509       1 client_builder_dynamic.go:197] get or create service account failed: Get "https://192.168.49.2:8441/api/v1/namespaces/kube-system/serviceaccounts/node-controller": dial tcp 192.168.49.2:8441: connect: connection refused

	E1118 00:21:47.706662       1 cidr_allocator.go:137] Failed to list all nodes: Get "https://192.168.49.2:8441/api/v1/nodes": failed to get token for kube-system/node-controller: timed out waiting for the condition

	* 

	* ==> kube-proxy [dec4850aecf1] <==

	* E1118 00:21:28.731178       1 node.go:161] Failed to retrieve node info: Get "https://control-plane.minikube.internal:8441/api/v1/nodes/functional-20211117161858-31976": dial tcp 192.168.49.2:8441: connect: connection refused

	I1118 00:21:32.008634       1 node.go:172] Successfully retrieved node IP: 192.168.49.2

	I1118 00:21:32.008670       1 server_others.go:140] Detected node IP 192.168.49.2

	W1118 00:21:32.008696       1 server_others.go:565] Unknown proxy mode "", assuming iptables proxy

	I1118 00:21:34.319819       1 server_others.go:206] kube-proxy running in dual-stack mode, IPv4-primary

	I1118 00:21:34.319893       1 server_others.go:212] Using iptables Proxier.

	I1118 00:21:34.319919       1 server_others.go:219] creating dualStackProxier for iptables.

	W1118 00:21:34.319928       1 server_others.go:495] detect-local-mode set to ClusterCIDR, but no IPv6 cluster CIDR defined, , defaulting to no-op detect-local for IPv6

	I1118 00:21:34.321812       1 server.go:649] Version: v1.22.3

	I1118 00:21:34.323441       1 config.go:315] Starting service config controller

	I1118 00:21:34.323468       1 shared_informer.go:240] Waiting for caches to sync for service config

	I1118 00:21:34.323734       1 config.go:224] Starting endpoint slice config controller

	I1118 00:21:34.323740       1 shared_informer.go:240] Waiting for caches to sync for endpoint slice config

	I1118 00:21:34.424028       1 shared_informer.go:247] Caches are synced for service config 

	I1118 00:21:34.424062       1 shared_informer.go:247] Caches are synced for endpoint slice config 

	I1118 00:21:41.600538       1 trace.go:205] Trace[1902479152]: "iptables restore" (18-Nov-2021 00:21:39.544) (total time: 2056ms):

	Trace[1902479152]: [2.056179659s] [2.056179659s] END

	I1118 00:21:50.818216       1 trace.go:205] Trace[1871746744]: "iptables restore" (18-Nov-2021 00:21:48.331) (total time: 2486ms):

	Trace[1871746744]: [2.486481381s] [2.486481381s] END

	* 

	* ==> kube-proxy [e4efee81ca46] <==

	* I1118 00:20:21.651696       1 node.go:172] Successfully retrieved node IP: 192.168.49.2

	I1118 00:20:21.651759       1 server_others.go:140] Detected node IP 192.168.49.2

	W1118 00:20:21.651773       1 server_others.go:565] Unknown proxy mode "", assuming iptables proxy

	I1118 00:20:23.854981       1 server_others.go:206] kube-proxy running in dual-stack mode, IPv4-primary

	I1118 00:20:23.855018       1 server_others.go:212] Using iptables Proxier.

	I1118 00:20:23.855027       1 server_others.go:219] creating dualStackProxier for iptables.

	W1118 00:20:23.855038       1 server_others.go:495] detect-local-mode set to ClusterCIDR, but no IPv6 cluster CIDR defined, , defaulting to no-op detect-local for IPv6

	I1118 00:20:23.855321       1 server.go:649] Version: v1.22.3

	I1118 00:20:23.855763       1 config.go:224] Starting endpoint slice config controller

	I1118 00:20:23.855791       1 shared_informer.go:240] Waiting for caches to sync for endpoint slice config

	I1118 00:20:23.855808       1 config.go:315] Starting service config controller

	I1118 00:20:23.855814       1 shared_informer.go:240] Waiting for caches to sync for service config

	I1118 00:20:23.956738       1 shared_informer.go:247] Caches are synced for endpoint slice config 

	I1118 00:20:23.956854       1 shared_informer.go:247] Caches are synced for service config 

	I1118 00:20:47.183178       1 trace.go:205] Trace[886166706]: "iptables restore" (18-Nov-2021 00:20:45.117) (total time: 2065ms):

	Trace[886166706]: [2.065366873s] [2.065366873s] END

	I1118 00:21:09.711497       1 trace.go:205] Trace[1669630311]: "iptables restore" (18-Nov-2021 00:21:07.502) (total time: 2208ms):

	Trace[1669630311]: [2.208983227s] [2.208983227s] END

	* 

	* ==> kube-scheduler [250907264d34] <==

	* I1118 00:21:29.418722       1 serving.go:347] Generated self-signed cert in-memory

	W1118 00:21:31.997832       1 requestheader_controller.go:193] Unable to get configmap/extension-apiserver-authentication in kube-system.  Usually fixed by 'kubectl create rolebinding -n kube-system ROLEBINDING_NAME --role=extension-apiserver-authentication-reader --serviceaccount=YOUR_NS:YOUR_SA'

	W1118 00:21:31.997895       1 authentication.go:345] Error looking up in-cluster authentication configuration: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot get resource "configmaps" in API group "" in the namespace "kube-system"

	W1118 00:21:31.997924       1 authentication.go:346] Continuing without authentication configuration. This may treat all requests as anonymous.

	W1118 00:21:31.997933       1 authentication.go:347] To require authentication configuration lookup to succeed, set --authentication-tolerate-lookup-failure=false

	I1118 00:21:32.011623       1 secure_serving.go:200] Serving securely on 127.0.0.1:10259

	I1118 00:21:32.011790       1 configmap_cafile_content.go:201] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file"

	I1118 00:21:32.012127       1 shared_informer.go:240] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file

	I1118 00:21:32.011814       1 tlsconfig.go:240] "Starting DynamicServingCertificateController"

	E1118 00:21:32.021075       1 plugin.go:138] "getting namespace, assuming empty set of namespace labels" err="namespace \"kube-system\" not found" namespace="kube-system"

	E1118 00:21:32.021368       1 plugin.go:138] "getting namespace, assuming empty set of namespace labels" err="namespace \"kube-system\" not found" namespace="kube-system"

	E1118 00:21:32.021634       1 plugin.go:138] "getting namespace, assuming empty set of namespace labels" err="namespace \"kube-system\" not found" namespace="kube-system"

	E1118 00:21:32.021713       1 plugin.go:138] "getting namespace, assuming empty set of namespace labels" err="namespace \"kube-system\" not found" namespace="kube-system"

	E1118 00:21:32.021793       1 plugin.go:138] "getting namespace, assuming empty set of namespace labels" err="namespace \"kube-system\" not found" namespace="kube-system"

	E1118 00:21:32.021855       1 plugin.go:138] "getting namespace, assuming empty set of namespace labels" err="namespace \"kube-system\" not found" namespace="kube-system"

	E1118 00:21:32.021896       1 plugin.go:138] "getting namespace, assuming empty set of namespace labels" err="namespace \"kube-system\" not found" namespace="kube-system"

	I1118 00:21:32.112609       1 shared_informer.go:247] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file 

	* 

	* ==> kube-scheduler [9b2f0c8b2294] <==

	* E1118 00:20:03.778476       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope

	E1118 00:20:03.778649       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope

	E1118 00:20:03.778756       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope

	E1118 00:20:03.778356       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope

	E1118 00:20:03.778477       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope

	E1118 00:20:03.778664       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope

	E1118 00:20:03.778867       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PodDisruptionBudget: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope

	E1118 00:20:03.779132       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope

	E1118 00:20:03.779200       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope

	E1118 00:20:03.779292       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope

	E1118 00:20:03.779420       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope

	E1118 00:20:03.779535       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1beta1.CSIStorageCapacity: failed to list *v1beta1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope

	E1118 00:20:04.601872       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope

	E1118 00:20:04.679677       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope

	E1118 00:20:04.718435       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope

	E1118 00:20:04.775960       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope

	E1118 00:20:04.790187       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope

	E1118 00:20:04.862294       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1beta1.CSIStorageCapacity: failed to list *v1beta1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope

	E1118 00:20:04.865410       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope

	E1118 00:20:04.897363       1 reflector.go:138] k8s.io/apiserver/pkg/server/dynamiccertificates/configmap_cafile_content.go:205: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"

	E1118 00:20:04.930491       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PodDisruptionBudget: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope

	I1118 00:20:06.875424       1 shared_informer.go:247] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file 

	I1118 00:21:27.208721       1 configmap_cafile_content.go:222] "Shutting down controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file"

	I1118 00:21:27.209099       1 secure_serving.go:311] Stopped listening on 127.0.0.1:10259

	I1118 00:21:27.209128       1 tlsconfig.go:255] "Shutting down DynamicServingCertificateController"

	* 

	* ==> kubelet <==

	* -- Logs begin at Thu 2021-11-18 00:19:19 UTC, end at Thu 2021-11-18 00:21:51 UTC. --

	Nov 18 00:21:44 functional-20211117161858-31976 kubelet[6078]: E1118 00:21:44.325785    6078 kubelet_node_status.go:470] "Error updating node status, will retry" err="error getting node \"functional-20211117161858-31976\": Get \"https://control-plane.minikube.internal:8441/api/v1/nodes/functional-20211117161858-31976?timeout=10s\": dial tcp 192.168.49.2:8441: connect: connection refused"

	Nov 18 00:21:44 functional-20211117161858-31976 kubelet[6078]: E1118 00:21:44.326015    6078 kubelet_node_status.go:470] "Error updating node status, will retry" err="error getting node \"functional-20211117161858-31976\": Get \"https://control-plane.minikube.internal:8441/api/v1/nodes/functional-20211117161858-31976?timeout=10s\": dial tcp 192.168.49.2:8441: connect: connection refused"

	Nov 18 00:21:44 functional-20211117161858-31976 kubelet[6078]: E1118 00:21:44.326044    6078 kubelet_node_status.go:457] "Unable to update node status" err="update node status exceeds retry count"

	Nov 18 00:21:44 functional-20211117161858-31976 kubelet[6078]: I1118 00:21:44.429262    6078 status_manager.go:601] "Failed to get status for pod" podUID=0ad7422ab14ae2d4b971f1822a1ff8ef pod="kube-system/kube-scheduler-functional-20211117161858-31976" err="Get \"https://control-plane.minikube.internal:8441/api/v1/namespaces/kube-system/pods/kube-scheduler-functional-20211117161858-31976\": dial tcp 192.168.49.2:8441: connect: connection refused"

	Nov 18 00:21:44 functional-20211117161858-31976 kubelet[6078]: E1118 00:21:44.462255    6078 controller.go:144] failed to ensure lease exists, will retry in 400ms, error: Get "https://control-plane.minikube.internal:8441/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/functional-20211117161858-31976?timeout=10s": dial tcp 192.168.49.2:8441: connect: connection refused

	Nov 18 00:21:44 functional-20211117161858-31976 kubelet[6078]: E1118 00:21:44.862893    6078 controller.go:144] failed to ensure lease exists, will retry in 800ms, error: Get "https://control-plane.minikube.internal:8441/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/functional-20211117161858-31976?timeout=10s": dial tcp 192.168.49.2:8441: connect: connection refused

	Nov 18 00:21:44 functional-20211117161858-31976 kubelet[6078]: I1118 00:21:44.967156    6078 status_manager.go:601] "Failed to get status for pod" podUID=0ad7422ab14ae2d4b971f1822a1ff8ef pod="kube-system/kube-scheduler-functional-20211117161858-31976" err="Get \"https://control-plane.minikube.internal:8441/api/v1/namespaces/kube-system/pods/kube-scheduler-functional-20211117161858-31976\": dial tcp 192.168.49.2:8441: connect: connection refused"

	Nov 18 00:21:44 functional-20211117161858-31976 kubelet[6078]: I1118 00:21:44.967348    6078 status_manager.go:601] "Failed to get status for pod" podUID=06052898487a9eef2760f89d323d2979 pod="kube-system/etcd-functional-20211117161858-31976" err="Get \"https://control-plane.minikube.internal:8441/api/v1/namespaces/kube-system/pods/etcd-functional-20211117161858-31976\": dial tcp 192.168.49.2:8441: connect: connection refused"

	Nov 18 00:21:45 functional-20211117161858-31976 kubelet[6078]: I1118 00:21:45.358730    6078 scope.go:110] "RemoveContainer" containerID="e180853e419038951cae72f6dcf958ed9e63196aeb434f87f93d71eb7f7bd335"

	Nov 18 00:21:45 functional-20211117161858-31976 kubelet[6078]: E1118 00:21:45.359249    6078 pod_workers.go:836] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-apiserver\" with CrashLoopBackOff: \"back-off 10s restarting failed container=kube-apiserver pod=kube-apiserver-functional-20211117161858-31976_kube-system(3c40bf658f457f3d925e48d646a29704)\"" pod="kube-system/kube-apiserver-functional-20211117161858-31976" podUID=3c40bf658f457f3d925e48d646a29704

	Nov 18 00:21:45 functional-20211117161858-31976 kubelet[6078]: E1118 00:21:45.663342    6078 controller.go:144] failed to ensure lease exists, will retry in 1.6s, error: Get "https://control-plane.minikube.internal:8441/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/functional-20211117161858-31976?timeout=10s": dial tcp 192.168.49.2:8441: connect: connection refused

	Nov 18 00:21:45 functional-20211117161858-31976 kubelet[6078]: I1118 00:21:45.819972    6078 status_manager.go:601] "Failed to get status for pod" podUID=9b9ccef0-fccc-43f7-8dec-952d07564964 pod="kube-system/storage-provisioner" err="Get \"https://control-plane.minikube.internal:8441/api/v1/namespaces/kube-system/pods/storage-provisioner\": dial tcp 192.168.49.2:8441: connect: connection refused"

	Nov 18 00:21:45 functional-20211117161858-31976 kubelet[6078]: I1118 00:21:45.820291    6078 status_manager.go:601] "Failed to get status for pod" podUID=453e3252-c5a8-48b4-893b-0496a8ed4dec pod="kube-system/kube-proxy-wbv29" err="Get \"https://control-plane.minikube.internal:8441/api/v1/namespaces/kube-system/pods/kube-proxy-wbv29\": dial tcp 192.168.49.2:8441: connect: connection refused"

	Nov 18 00:21:45 functional-20211117161858-31976 kubelet[6078]: I1118 00:21:45.820757    6078 status_manager.go:601] "Failed to get status for pod" podUID=07d38b3c32289fcb168a5eedbb42a060 pod="kube-system/kube-controller-manager-functional-20211117161858-31976" err="Get \"https://control-plane.minikube.internal:8441/api/v1/namespaces/kube-system/pods/kube-controller-manager-functional-20211117161858-31976\": dial tcp 192.168.49.2:8441: connect: connection refused"

	Nov 18 00:21:45 functional-20211117161858-31976 kubelet[6078]: I1118 00:21:45.821054    6078 status_manager.go:601] "Failed to get status for pod" podUID=67a186a3-f954-4960-bb9e-57d18527dbc7 pod="kube-system/coredns-78fcd69978-dnq6x" err="Get \"https://control-plane.minikube.internal:8441/api/v1/namespaces/kube-system/pods/coredns-78fcd69978-dnq6x\": dial tcp 192.168.49.2:8441: connect: connection refused"

	Nov 18 00:21:45 functional-20211117161858-31976 kubelet[6078]: I1118 00:21:45.821326    6078 status_manager.go:601] "Failed to get status for pod" podUID=0ad7422ab14ae2d4b971f1822a1ff8ef pod="kube-system/kube-scheduler-functional-20211117161858-31976" err="Get \"https://control-plane.minikube.internal:8441/api/v1/namespaces/kube-system/pods/kube-scheduler-functional-20211117161858-31976\": dial tcp 192.168.49.2:8441: connect: connection refused"

	Nov 18 00:21:45 functional-20211117161858-31976 kubelet[6078]: I1118 00:21:45.821657    6078 status_manager.go:601] "Failed to get status for pod" podUID=3c40bf658f457f3d925e48d646a29704 pod="kube-system/kube-apiserver-functional-20211117161858-31976" err="Get \"https://control-plane.minikube.internal:8441/api/v1/namespaces/kube-system/pods/kube-apiserver-functional-20211117161858-31976\": dial tcp 192.168.49.2:8441: connect: connection refused"

	Nov 18 00:21:45 functional-20211117161858-31976 kubelet[6078]: I1118 00:21:45.821881    6078 status_manager.go:601] "Failed to get status for pod" podUID=06052898487a9eef2760f89d323d2979 pod="kube-system/etcd-functional-20211117161858-31976" err="Get \"https://control-plane.minikube.internal:8441/api/v1/namespaces/kube-system/pods/etcd-functional-20211117161858-31976\": dial tcp 192.168.49.2:8441: connect: connection refused"

	Nov 18 00:21:45 functional-20211117161858-31976 kubelet[6078]: I1118 00:21:45.973843    6078 scope.go:110] "RemoveContainer" containerID="e180853e419038951cae72f6dcf958ed9e63196aeb434f87f93d71eb7f7bd335"

	Nov 18 00:21:45 functional-20211117161858-31976 kubelet[6078]: E1118 00:21:45.974382    6078 pod_workers.go:836] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-apiserver\" with CrashLoopBackOff: \"back-off 10s restarting failed container=kube-apiserver pod=kube-apiserver-functional-20211117161858-31976_kube-system(3c40bf658f457f3d925e48d646a29704)\"" pod="kube-system/kube-apiserver-functional-20211117161858-31976" podUID=3c40bf658f457f3d925e48d646a29704

	Nov 18 00:21:46 functional-20211117161858-31976 kubelet[6078]: I1118 00:21:46.980435    6078 scope.go:110] "RemoveContainer" containerID="e180853e419038951cae72f6dcf958ed9e63196aeb434f87f93d71eb7f7bd335"

	Nov 18 00:21:46 functional-20211117161858-31976 kubelet[6078]: E1118 00:21:46.981056    6078 pod_workers.go:836] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-apiserver\" with CrashLoopBackOff: \"back-off 10s restarting failed container=kube-apiserver pod=kube-apiserver-functional-20211117161858-31976_kube-system(3c40bf658f457f3d925e48d646a29704)\"" pod="kube-system/kube-apiserver-functional-20211117161858-31976" podUID=3c40bf658f457f3d925e48d646a29704

	Nov 18 00:21:47 functional-20211117161858-31976 kubelet[6078]: E1118 00:21:47.264527    6078 controller.go:144] failed to ensure lease exists, will retry in 3.2s, error: Get "https://control-plane.minikube.internal:8441/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/functional-20211117161858-31976?timeout=10s": dial tcp 192.168.49.2:8441: connect: connection refused

	Nov 18 00:21:47 functional-20211117161858-31976 kubelet[6078]: E1118 00:21:47.989152    6078 event.go:273] Unable to write event: '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"kube-apiserver-functional-20211117161858-31976.16b87c15dfe682a4", GenerateName:"", Namespace:"kube-system", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, InvolvedObject:v1.ObjectReference{Kind:"Pod", Namespace:"kube-system", Name:"kube-apiserver-functional-20211117161858-31976", UID:"3c40bf658f457f3d925e48d646a29704", APIVersion:"v1", ResourceVersion:"", FieldPath:"spec.containers{kube-apiserver}"}, Reason:"BackOff", Message

:"Back-off restarting failed container", Source:v1.EventSource{Component:"kubelet", Host:"functional-20211117161858-31976"}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xc05d8504782218a4, ext:4253908481, loc:(*time.Location)(0x77a8680)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xc05d8504782218a4, ext:4253908481, loc:(*time.Location)(0x77a8680)}}, Count:1, Type:"Warning", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'Post "https://control-plane.minikube.internal:8441/api/v1/namespaces/kube-system/events": dial tcp 192.168.49.2:8441: connect: connection refused'(may retry after sleeping)

	Nov 18 00:21:50 functional-20211117161858-31976 kubelet[6078]: E1118 00:21:50.465719    6078 controller.go:144] failed to ensure lease exists, will retry in 6.4s, error: Get "https://control-plane.minikube.internal:8441/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/functional-20211117161858-31976?timeout=10s": dial tcp 192.168.49.2:8441: connect: connection refused

	* 

	* ==> storage-provisioner [422236a5e675] <==

	* I1118 00:21:36.639683       1 storage_provisioner.go:116] Initializing the minikube storage provisioner...

	I1118 00:21:36.650400       1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!

	I1118 00:21:36.650449       1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...

	E1118 00:21:40.111980       1 leaderelection.go:325] error retrieving resource lock kube-system/k8s.io-minikube-hostpath: Get "https://10.96.0.1:443/api/v1/namespaces/kube-system/endpoints/k8s.io-minikube-hostpath": dial tcp 10.96.0.1:443: connect: connection refused

	E1118 00:21:44.350512       1 leaderelection.go:325] error retrieving resource lock kube-system/k8s.io-minikube-hostpath: Get "https://10.96.0.1:443/api/v1/namespaces/kube-system/endpoints/k8s.io-minikube-hostpath": dial tcp 10.96.0.1:443: connect: connection refused

	E1118 00:21:47.946818       1 leaderelection.go:325] error retrieving resource lock kube-system/k8s.io-minikube-hostpath: Get "https://10.96.0.1:443/api/v1/namespaces/kube-system/endpoints/k8s.io-minikube-hostpath": dial tcp 10.96.0.1:443: connect: connection refused

	E1118 00:21:50.997974       1 leaderelection.go:325] error retrieving resource lock kube-system/k8s.io-minikube-hostpath: Get "https://10.96.0.1:443/api/v1/namespaces/kube-system/endpoints/k8s.io-minikube-hostpath": dial tcp 10.96.0.1:443: connect: connection refused

	* 

	* ==> storage-provisioner [ea850ca3cc61] <==

	* I1118 00:20:52.931610       1 storage_provisioner.go:116] Initializing the minikube storage provisioner...

	I1118 00:20:52.938911       1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!

	I1118 00:20:52.939029       1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...

	I1118 00:20:52.953253       1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath

	I1118 00:20:52.953292       1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"32b2b3be-e39d-44de-bb2d-5d1067722fdc", APIVersion:"v1", ResourceVersion:"494", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' functional-20211117161858-31976_1183ee1f-9cef-48cf-8de5-e4dbd61f5221 became leader

	I1118 00:20:52.953495       1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_functional-20211117161858-31976_1183ee1f-9cef-48cf-8de5-e4dbd61f5221!

	I1118 00:20:53.054549       1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_functional-20211117161858-31976_1183ee1f-9cef-48cf-8de5-e4dbd61f5221!

-- /stdout --

** stderr ** 

	E1117 16:21:50.586491   33927 logs.go:190] command /bin/bash -c "sudo /var/lib/minikube/binaries/v1.22.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" failed with error: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.22.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8441 was refused - did you specify the right host or port?

	 output: "\n** stderr ** \nThe connection to the server localhost:8441 was refused - did you specify the right host or port?\n\n** /stderr **"

	! unable to fetch logs for: describe nodes

** /stderr **

helpers_test.go:254: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.APIServer}} -p functional-20211117161858-31976 -n functional-20211117161858-31976

helpers_test.go:254: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.APIServer}} -p functional-20211117161858-31976 -n functional-20211117161858-31976: exit status 2 (634.073041ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:254: status error: exit status 2 (may be ok)

helpers_test.go:256: "functional-20211117161858-31976" apiserver is not running, skipping kubectl commands (state="Stopped")

--- FAIL: TestFunctional/serial/ExtraConfig (31.17s)

=== RUN   TestFunctional/serial/ComponentHealth

functional_test.go:752: (dbg) Run:  kubectl --context functional-20211117161858-31976 get po -l tier=control-plane -n kube-system -o=json

functional_test.go:752: (dbg) Done: kubectl --context functional-20211117161858-31976 get po -l tier=control-plane -n kube-system -o=json: (7.868000346s)

functional_test.go:767: etcd phase: Running

functional_test.go:775: etcd is not Ready: {Phase:Running Conditions:[{Type:Initialized Status:True} {Type:Ready Status:False} {Type:ContainersReady Status:False} {Type:PodScheduled Status:True}] Message: Reason: HostIP:192.168.49.2 PodIP:192.168.49.2 StartTime:2021-11-17 16:20:11 -0800 PST ContainerStatuses:[{Name:etcd State:{Waiting:<nil> Running:0xc000e937d0 Terminated:<nil>} LastTerminationState:{Waiting:<nil> Running:<nil> Terminated:0xc0001aa000} Ready:false RestartCount:1 Image:k8s.gcr.io/etcd:3.5.0-0 ImageID:docker-pullable://k8s.gcr.io/etcd@sha256:9ce33ba33d8e738a5b85ed50b5080ac746deceed4a7496c550927a7a19ca3b6d ContainerID:docker://4a9c75d87f40be89aa64aeeaf48eee2edbfed6225334ae432dfbdba1093f28b5}]}

functional_test.go:767: kube-apiserver phase: Pending

functional_test.go:769: kube-apiserver is not Running: {Phase:Pending Conditions:[] Message: Reason: HostIP: PodIP: StartTime:<nil> ContainerStatuses:[]}

functional_test.go:767: kube-controller-manager phase: Running

functional_test.go:775: kube-controller-manager is not Ready: {Phase:Running Conditions:[{Type:Initialized Status:True} {Type:Ready Status:False} {Type:ContainersReady Status:False} {Type:PodScheduled Status:True}] Message: Reason: HostIP:192.168.49.2 PodIP:192.168.49.2 StartTime:2021-11-17 16:20:11 -0800 PST ContainerStatuses:[{Name:kube-controller-manager State:{Waiting:<nil> Running:0xc000e93cf8 Terminated:<nil>} LastTerminationState:{Waiting:<nil> Running:<nil> Terminated:0xc0001aa070} Ready:false RestartCount:1 Image:k8s.gcr.io/kube-controller-manager:v1.22.3 ImageID:docker-pullable://k8s.gcr.io/kube-controller-manager@sha256:e67dbfd3796b7ce04fee80acb52876928c290224a91862c5849c3ab0fa31ca78 ContainerID:docker://e34b718143e148506fc44d89d96a1a8ec9f06973714a55f8f3b59ff51ade5a13}]}

functional_test.go:767: kube-scheduler phase: Running

functional_test.go:775: kube-scheduler is not Ready: {Phase:Running Conditions:[{Type:Initialized Status:True} {Type:Ready Status:False} {Type:ContainersReady Status:False} {Type:PodScheduled Status:True}] Message: Reason: HostIP:192.168.49.2 PodIP:192.168.49.2 StartTime:2021-11-17 16:20:11 -0800 PST ContainerStatuses:[{Name:kube-scheduler State:{Waiting:<nil> Running:0xc000e93ef0 Terminated:<nil>} LastTerminationState:{Waiting:<nil> Running:<nil> Terminated:0xc0001aa0e0} Ready:false RestartCount:1 Image:k8s.gcr.io/kube-scheduler:v1.22.3 ImageID:docker-pullable://k8s.gcr.io/kube-scheduler@sha256:cac7ea67201a84c00f3e8d9be51877c25fb539055ac404c4a9d2dd4c79d3fdab ContainerID:docker://250907264d348e83f2dbf05695470c030947e582eba007c6188deaa21b57fcd1}]}

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:230: ======>  post-mortem[TestFunctional/serial/ComponentHealth]: docker inspect <======

helpers_test.go:231: (dbg) Run:  docker inspect functional-20211117161858-31976

helpers_test.go:235: (dbg) docker inspect functional-20211117161858-31976:

-- stdout --

	[

	    {

	        "Id": "d46e9a51de65467f8f95d5caf1ea606f6207ea96f31ad410cb49b500d1a234d3",

	        "Created": "2021-11-18T00:19:05.626133858Z",

	        "Path": "/usr/local/bin/entrypoint",

	        "Args": [

	            "/sbin/init"

	        ],

	        "State": {

	            "Status": "running",

	            "Running": true,

	            "Paused": false,

	            "Restarting": false,

	            "OOMKilled": false,

	            "Dead": false,

	            "Pid": 38790,

	            "ExitCode": 0,

	            "Error": "",

	            "StartedAt": "2021-11-18T00:19:17.027751041Z",

	            "FinishedAt": "0001-01-01T00:00:00Z"

	        },

	        "Image": "sha256:e2a6c047beddf8261495222adf87089305bbc18e350587b01ebe3725535b5871",

	        "ResolvConfPath": "/var/lib/docker/containers/d46e9a51de65467f8f95d5caf1ea606f6207ea96f31ad410cb49b500d1a234d3/resolv.conf",

	        "HostnamePath": "/var/lib/docker/containers/d46e9a51de65467f8f95d5caf1ea606f6207ea96f31ad410cb49b500d1a234d3/hostname",

	        "HostsPath": "/var/lib/docker/containers/d46e9a51de65467f8f95d5caf1ea606f6207ea96f31ad410cb49b500d1a234d3/hosts",

	        "LogPath": "/var/lib/docker/containers/d46e9a51de65467f8f95d5caf1ea606f6207ea96f31ad410cb49b500d1a234d3/d46e9a51de65467f8f95d5caf1ea606f6207ea96f31ad410cb49b500d1a234d3-json.log",

	        "Name": "/functional-20211117161858-31976",

	        "RestartCount": 0,

	        "Driver": "overlay2",

	        "Platform": "linux",

	        "MountLabel": "",

	        "ProcessLabel": "",

	        "AppArmorProfile": "",

	        "ExecIDs": null,

	        "HostConfig": {

	            "Binds": [

	                "/lib/modules:/lib/modules:ro",

	                "functional-20211117161858-31976:/var"

	            ],

	            "ContainerIDFile": "",

	            "LogConfig": {

	                "Type": "json-file",

	                "Config": {}

	            },

	            "NetworkMode": "functional-20211117161858-31976",

	            "PortBindings": {

	                "22/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "0"

	                    }

	                ],

	                "2376/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "0"

	                    }

	                ],

	                "32443/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "0"

	                    }

	                ],

	                "5000/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "0"

	                    }

	                ],

	                "8441/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "0"

	                    }

	                ]

	            },

	            "RestartPolicy": {

	                "Name": "no",

	                "MaximumRetryCount": 0

	            },

	            "AutoRemove": false,

	            "VolumeDriver": "",

	            "VolumesFrom": null,

	            "CapAdd": null,

	            "CapDrop": null,

	            "CgroupnsMode": "host",

	            "Dns": [],

	            "DnsOptions": [],

	            "DnsSearch": [],

	            "ExtraHosts": null,

	            "GroupAdd": null,

	            "IpcMode": "private",

	            "Cgroup": "",

	            "Links": null,

	            "OomScoreAdj": 0,

	            "PidMode": "",

	            "Privileged": true,

	            "PublishAllPorts": false,

	            "ReadonlyRootfs": false,

	            "SecurityOpt": [

	                "seccomp=unconfined",

	                "apparmor=unconfined",

	                "label=disable"

	            ],

	            "Tmpfs": {

	                "/run": "",

	                "/tmp": ""

	            },

	            "UTSMode": "",

	            "UsernsMode": "",

	            "ShmSize": 67108864,

	            "Runtime": "runc",

	            "ConsoleSize": [

	                0,

	                0

	            ],

	            "Isolation": "",

	            "CpuShares": 0,

	            "Memory": 4194304000,

	            "NanoCpus": 2000000000,

	            "CgroupParent": "",

	            "BlkioWeight": 0,

	            "BlkioWeightDevice": [],

	            "BlkioDeviceReadBps": null,

	            "BlkioDeviceWriteBps": null,

	            "BlkioDeviceReadIOps": null,

	            "BlkioDeviceWriteIOps": null,

	            "CpuPeriod": 0,

	            "CpuQuota": 0,

	            "CpuRealtimePeriod": 0,

	            "CpuRealtimeRuntime": 0,

	            "CpusetCpus": "",

	            "CpusetMems": "",

	            "Devices": [

	                {

	                    "PathOnHost": "/dev/fuse",

	                    "PathInContainer": "/dev/fuse",

	                    "CgroupPermissions": "rwm"

	                }

	            ],

	            "DeviceCgroupRules": null,

	            "DeviceRequests": null,

	            "KernelMemory": 0,

	            "KernelMemoryTCP": 0,

	            "MemoryReservation": 0,

	            "MemorySwap": 4194304000,

	            "MemorySwappiness": null,

	            "OomKillDisable": false,

	            "PidsLimit": null,

	            "Ulimits": null,

	            "CpuCount": 0,

	            "CpuPercent": 0,

	            "IOMaximumIOps": 0,

	            "IOMaximumBandwidth": 0,

	            "MaskedPaths": null,

	            "ReadonlyPaths": null

	        },

	        "GraphDriver": {

	            "Data": {

	                "LowerDir": "/var/lib/docker/overlay2/49e0ec7a7f73c1ddbbb9f56f242aeba44c6beb8e8ba4345e2d31970a02d02099-init/diff:/var/lib/docker/overlay2/a93dcfb6f3d6cc41c972ba77a74f26c33bb647aae37c056960e88eff1f45318e/diff:/var/lib/docker/overlay2/5bf663a55dc098d601b6dea4d4c10aaec9f068dcf0de0b940d77262bf5e9bdc6/diff:/var/lib/docker/overlay2/042de3e4be800f5293bfc3bc6fc92553d872b01461acd16fa5a146a312df0e28/diff:/var/lib/docker/overlay2/0790f68de366f4e5284d9606e1a26055a65a8ee9c04fd59b5bac02d4016cf450/diff:/var/lib/docker/overlay2/0b2d68653092e419e945cb562f07ca719191e8b17667a18a8f7b4c24ad10ab0e/diff:/var/lib/docker/overlay2/74497acbc2dda9790b519bf52aa865acb9f38e5cef76e7d8a3a4b529a3d9e702/diff:/var/lib/docker/overlay2/ff120bb48ef6e6e06a88f4c5187e25d554152cc97e0ea1fb3555f17a66908154/diff:/var/lib/docker/overlay2/f5db8db950342323f76b38613fda86996d2b4a2aa755297267caa5b7b8981da0/diff:/var/lib/docker/overlay2/6017be4153ffd7b1ab22d79efd97895ca9791c09d7e77b930827f1f338219cbb/diff:/var/lib/docker/overlay2/fd8bd2

db0148ff3cbae056e3d40a5e785a6daa9839d28dce541d1db16c76a910/diff:/var/lib/docker/overlay2/6e6b657f7202e480d424be1b6934196a3f4b88d643e66c8f27823833e0833ba4/diff:/var/lib/docker/overlay2/4129ea43aaaf15e7de040c40f26e1a9a163317620d7ef92d98e4b2467d593034/diff:/var/lib/docker/overlay2/fd07546476691a27dba8ff73e418292264e996c20c06e955a30dbad83de1733c/diff:/var/lib/docker/overlay2/5ad0909670349956719e0f0ea9ddd5ee7e8959f505f470f10ac2520aa8014e97/diff:/var/lib/docker/overlay2/8825a434b266c3c834891f42fa35dc89e993f3c9e395f2f3c4d6e815f0e329af/diff:/var/lib/docker/overlay2/b4eeccd1b8c68a280e0e4d881a805d320f55b0c471529a3313b31b47252b0c47/diff:/var/lib/docker/overlay2/35fd48039713604d0debc8ac2009daf167d289893615387c0ad9287bffa10082/diff:/var/lib/docker/overlay2/494facb3e11d8950ad7593c6354187416d14009c69168858a6dffc25ebfbf84c/diff:/var/lib/docker/overlay2/4f1ce1df10039c93e604a552d53e3e6645d372f9cddab1b12c00f0067ad80ba2/diff:/var/lib/docker/overlay2/659379d7d9913fcb5492ef098d76112aded93cb7ce203354f9fbcee82d5b062c/diff:/var/lib/d

ocker/overlay2/a1c5d5e92d294301fbac809907fba5a0acc107e187b93e52d5afb6bb0bc2eb9d/diff:/var/lib/docker/overlay2/5065eba0fcf1a8cf75076e4a123f1e9f038fbbf1fae3f82e3ea33d1523b60c91/diff:/var/lib/docker/overlay2/594d5b999ebec6822417fd4ba02da0a7cde6c024fdfb474db4ff3a0784d7f735/diff:/var/lib/docker/overlay2/067ddba03cf6c6688f887150cb3d7174e90d66e9a6f356e86cc3a906c4941894/diff:/var/lib/docker/overlay2/6cee93a03c4d65017c1ef9d392ae34d531e8f7abdd809dc26a0a48ede1ff8367/diff:/var/lib/docker/overlay2/d1e8cfbc84975893028d0b859ebb9ca07a8efc1c8ad9abc10fb1e9c7235f53d4/diff:/var/lib/docker/overlay2/4f2c513e3b5d4707a2aed9244d7ef9f6fc2631524cf8225ba0dfa2f8c3e3931c/diff:/var/lib/docker/overlay2/9be7da800f4028bec22556081948d1d22da9bb3be2d63dde017c61c44c0274ea/diff:/var/lib/docker/overlay2/58b13aae5c184fe2071d64f90c7955b5dbbe76d225c3bd9847f03d1ce1ec8664/diff:/var/lib/docker/overlay2/997e96d68467fd54763e75e2d501272ee5d0497b00ab2c5522522f8ba0754f07/diff:/var/lib/docker/overlay2/49be1e8263d191ec5fdfd8cd4138af81d23aaa12d6548a465b255afe5e8

819c3/diff:/var/lib/docker/overlay2/8658b7127dfd599a3897343d297be67b4576b31720472927b3f5f1856059c56d/diff:/var/lib/docker/overlay2/26b53a2f30fe8fc01bfec363d6b00e2f5ab4f48325d1b5f62b5d8f2854dda781/diff:/var/lib/docker/overlay2/9abe9a8e38d4d40dcfa6152a2ae1bf2ed14dfa1579245d8534bea68a1124307b/diff:/var/lib/docker/overlay2/a1d4fbf621974c40a62164636c14f0dbe1ffa8a7bc7b13c1995ed93b1113dbe7/diff:/var/lib/docker/overlay2/aecec25c90cb357ced7bbaa69f3135cb6f7c8765605b7a360cd515642e00de14/diff:/var/lib/docker/overlay2/5c55f200070f6d0617d7f3031ce23a27df90a72720139ef51fac61fe40032625/diff:/var/lib/docker/overlay2/7a473817be0962d3e2ae1f57f32e95115af914c56a786f2d4d15a9dca232cefa/diff:/var/lib/docker/overlay2/3ca997de4525080aca8f86ad0f68f4f26acc4262a80846cfc96b3d4af8dd2526/diff:/var/lib/docker/overlay2/ad3ce384b651be2a1810da477a29e598be710b6e40f940a3bb3a4a9ed7ee048d/diff",

	                "MergedDir": "/var/lib/docker/overlay2/49e0ec7a7f73c1ddbbb9f56f242aeba44c6beb8e8ba4345e2d31970a02d02099/merged",

	                "UpperDir": "/var/lib/docker/overlay2/49e0ec7a7f73c1ddbbb9f56f242aeba44c6beb8e8ba4345e2d31970a02d02099/diff",

	                "WorkDir": "/var/lib/docker/overlay2/49e0ec7a7f73c1ddbbb9f56f242aeba44c6beb8e8ba4345e2d31970a02d02099/work"

	            },

	            "Name": "overlay2"

	        },

	        "Mounts": [

	            {

	                "Type": "bind",

	                "Source": "/lib/modules",

	                "Destination": "/lib/modules",

	                "Mode": "ro",

	                "RW": false,

	                "Propagation": "rprivate"

	            },

	            {

	                "Type": "volume",

	                "Name": "functional-20211117161858-31976",

	                "Source": "/var/lib/docker/volumes/functional-20211117161858-31976/_data",

	                "Destination": "/var",

	                "Driver": "local",

	                "Mode": "z",

	                "RW": true,

	                "Propagation": ""

	            }

	        ],

	        "Config": {

	            "Hostname": "functional-20211117161858-31976",

	            "Domainname": "",

	            "User": "root",

	            "AttachStdin": false,

	            "AttachStdout": false,

	            "AttachStderr": false,

	            "ExposedPorts": {

	                "22/tcp": {},

	                "2376/tcp": {},

	                "32443/tcp": {},

	                "5000/tcp": {},

	                "8441/tcp": {}

	            },

	            "Tty": true,

	            "OpenStdin": false,

	            "StdinOnce": false,

	            "Env": [

	                "container=docker",

	                "PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"

	            ],

	            "Cmd": null,

	            "Image": "gcr.io/k8s-minikube/kicbase:v0.0.28@sha256:4780f1897569d2bf77aafb3d133a08d42b4fe61127f06fcfc90c2c5d902d893c",

	            "Volumes": null,

	            "WorkingDir": "",

	            "Entrypoint": [

	                "/usr/local/bin/entrypoint",

	                "/sbin/init"

	            ],

	            "OnBuild": null,

	            "Labels": {

	                "created_by.minikube.sigs.k8s.io": "true",

	                "mode.minikube.sigs.k8s.io": "functional-20211117161858-31976",

	                "name.minikube.sigs.k8s.io": "functional-20211117161858-31976",

	                "role.minikube.sigs.k8s.io": ""

	            },

	            "StopSignal": "SIGRTMIN+3"

	        },

	        "NetworkSettings": {

	            "Bridge": "",

	            "SandboxID": "076ac0afe3795f81804d3da602b3a69ab38e221a0122b3f448d185a1ba341295",

	            "HairpinMode": false,

	            "LinkLocalIPv6Address": "",

	            "LinkLocalIPv6PrefixLen": 0,

	            "Ports": {

	                "22/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "52137"

	                    }

	                ],

	                "2376/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "52138"

	                    }

	                ],

	                "32443/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "52139"

	                    }

	                ],

	                "5000/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "52140"

	                    }

	                ],

	                "8441/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "52141"

	                    }

	                ]

	            },

	            "SandboxKey": "/var/run/docker/netns/076ac0afe379",

	            "SecondaryIPAddresses": null,

	            "SecondaryIPv6Addresses": null,

	            "EndpointID": "",

	            "Gateway": "",

	            "GlobalIPv6Address": "",

	            "GlobalIPv6PrefixLen": 0,

	            "IPAddress": "",

	            "IPPrefixLen": 0,

	            "IPv6Gateway": "",

	            "MacAddress": "",

	            "Networks": {

	                "functional-20211117161858-31976": {

	                    "IPAMConfig": {

	                        "IPv4Address": "192.168.49.2"

	                    },

	                    "Links": null,

	                    "Aliases": [

	                        "d46e9a51de65",

	                        "functional-20211117161858-31976"

	                    ],

	                    "NetworkID": "716130e30ae38c1d22de4c84857f1a2addaf8dd4e40f1651d386549d11497de6",

	                    "EndpointID": "dc6711626c432c360f8407c17df6ecba81d669b643cd6e499253a6205087f92f",

	                    "Gateway": "192.168.49.1",

	                    "IPAddress": "192.168.49.2",

	                    "IPPrefixLen": 24,

	                    "IPv6Gateway": "",

	                    "GlobalIPv6Address": "",

	                    "GlobalIPv6PrefixLen": 0,

	                    "MacAddress": "02:42:c0:a8:31:02",

	                    "DriverOpts": null

	                }

	            }

	        }

	    }

	]

-- /stdout --

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p functional-20211117161858-31976 -n functional-20211117161858-31976

helpers_test.go:239: (dbg) Done: out/minikube-darwin-amd64 status --format={{.Host}} -p functional-20211117161858-31976 -n functional-20211117161858-31976: (1.320154525s)

helpers_test.go:244: <<< TestFunctional/serial/ComponentHealth FAILED: start of post-mortem logs <<<

helpers_test.go:245: ======>  post-mortem[TestFunctional/serial/ComponentHealth]: minikube logs <======

helpers_test.go:247: (dbg) Run:  out/minikube-darwin-amd64 -p functional-20211117161858-31976 logs -n 25

helpers_test.go:247: (dbg) Done: out/minikube-darwin-amd64 -p functional-20211117161858-31976 logs -n 25: (3.150699577s)

helpers_test.go:252: TestFunctional/serial/ComponentHealth logs: 

-- stdout --

	* 

	* ==> Audit <==

	* |---------|----------------------------------------------------------------------------------------|---------------------------------|---------|---------|-------------------------------|-------------------------------|

	| Command |                                          Args                                          |             Profile             |  User   | Version |          Start Time           |           End Time            |

	|---------|----------------------------------------------------------------------------------------|---------------------------------|---------|---------|-------------------------------|-------------------------------|

	| addons  | enable dashboard -p                                                                    | addons-20211117161126-31976     | jenkins | v1.24.0 | Wed, 17 Nov 2021 16:17:06 PST | Wed, 17 Nov 2021 16:17:06 PST |

	|         | addons-20211117161126-31976                                                            |                                 |         |         |                               |                               |

	| addons  | disable dashboard -p                                                                   | addons-20211117161126-31976     | jenkins | v1.24.0 | Wed, 17 Nov 2021 16:17:06 PST | Wed, 17 Nov 2021 16:17:06 PST |

	|         | addons-20211117161126-31976                                                            |                                 |         |         |                               |                               |

	| delete  | -p addons-20211117161126-31976                                                         | addons-20211117161126-31976     | jenkins | v1.24.0 | Wed, 17 Nov 2021 16:17:06 PST | Wed, 17 Nov 2021 16:17:14 PST |

	| start   | -p nospam-20211117161714-31976 -n=1 --memory=2250 --wait=false                         | nospam-20211117161714-31976     | jenkins | v1.24.0 | Wed, 17 Nov 2021 16:17:14 PST | Wed, 17 Nov 2021 16:18:24 PST |

	|         | --log_dir=/var/folders/xd/3vdzn10d2gb_wxr7lj_p8h5c0000gp/T/nospam-20211117161714-31976 |                                 |         |         |                               |                               |

	|         | --driver=docker                                                                        |                                 |         |         |                               |                               |

	| -p      | nospam-20211117161714-31976 --log_dir                                                  | nospam-20211117161714-31976     | jenkins | v1.24.0 | Wed, 17 Nov 2021 16:18:29 PST | Wed, 17 Nov 2021 16:18:29 PST |

	|         | /var/folders/xd/3vdzn10d2gb_wxr7lj_p8h5c0000gp/T/nospam-20211117161714-31976           |                                 |         |         |                               |                               |

	|         | pause                                                                                  |                                 |         |         |                               |                               |

	| -p      | nospam-20211117161714-31976 --log_dir                                                  | nospam-20211117161714-31976     | jenkins | v1.24.0 | Wed, 17 Nov 2021 16:18:30 PST | Wed, 17 Nov 2021 16:18:30 PST |

	|         | /var/folders/xd/3vdzn10d2gb_wxr7lj_p8h5c0000gp/T/nospam-20211117161714-31976           |                                 |         |         |                               |                               |

	|         | pause                                                                                  |                                 |         |         |                               |                               |

	| -p      | nospam-20211117161714-31976 --log_dir                                                  | nospam-20211117161714-31976     | jenkins | v1.24.0 | Wed, 17 Nov 2021 16:18:30 PST | Wed, 17 Nov 2021 16:18:31 PST |

	|         | /var/folders/xd/3vdzn10d2gb_wxr7lj_p8h5c0000gp/T/nospam-20211117161714-31976           |                                 |         |         |                               |                               |

	|         | pause                                                                                  |                                 |         |         |                               |                               |

	| -p      | nospam-20211117161714-31976 --log_dir                                                  | nospam-20211117161714-31976     | jenkins | v1.24.0 | Wed, 17 Nov 2021 16:18:31 PST | Wed, 17 Nov 2021 16:18:32 PST |

	|         | /var/folders/xd/3vdzn10d2gb_wxr7lj_p8h5c0000gp/T/nospam-20211117161714-31976           |                                 |         |         |                               |                               |

	|         | unpause                                                                                |                                 |         |         |                               |                               |

	| -p      | nospam-20211117161714-31976 --log_dir                                                  | nospam-20211117161714-31976     | jenkins | v1.24.0 | Wed, 17 Nov 2021 16:18:32 PST | Wed, 17 Nov 2021 16:18:32 PST |

	|         | /var/folders/xd/3vdzn10d2gb_wxr7lj_p8h5c0000gp/T/nospam-20211117161714-31976           |                                 |         |         |                               |                               |

	|         | unpause                                                                                |                                 |         |         |                               |                               |

	| -p      | nospam-20211117161714-31976 --log_dir                                                  | nospam-20211117161714-31976     | jenkins | v1.24.0 | Wed, 17 Nov 2021 16:18:32 PST | Wed, 17 Nov 2021 16:18:33 PST |

	|         | /var/folders/xd/3vdzn10d2gb_wxr7lj_p8h5c0000gp/T/nospam-20211117161714-31976           |                                 |         |         |                               |                               |

	|         | unpause                                                                                |                                 |         |         |                               |                               |

	| -p      | nospam-20211117161714-31976 --log_dir                                                  | nospam-20211117161714-31976     | jenkins | v1.24.0 | Wed, 17 Nov 2021 16:18:33 PST | Wed, 17 Nov 2021 16:18:50 PST |

	|         | /var/folders/xd/3vdzn10d2gb_wxr7lj_p8h5c0000gp/T/nospam-20211117161714-31976           |                                 |         |         |                               |                               |

	|         | stop                                                                                   |                                 |         |         |                               |                               |

	| -p      | nospam-20211117161714-31976 --log_dir                                                  | nospam-20211117161714-31976     | jenkins | v1.24.0 | Wed, 17 Nov 2021 16:18:51 PST | Wed, 17 Nov 2021 16:18:51 PST |

	|         | /var/folders/xd/3vdzn10d2gb_wxr7lj_p8h5c0000gp/T/nospam-20211117161714-31976           |                                 |         |         |                               |                               |

	|         | stop                                                                                   |                                 |         |         |                               |                               |

	| -p      | nospam-20211117161714-31976 --log_dir                                                  | nospam-20211117161714-31976     | jenkins | v1.24.0 | Wed, 17 Nov 2021 16:18:51 PST | Wed, 17 Nov 2021 16:18:51 PST |

	|         | /var/folders/xd/3vdzn10d2gb_wxr7lj_p8h5c0000gp/T/nospam-20211117161714-31976           |                                 |         |         |                               |                               |

	|         | stop                                                                                   |                                 |         |         |                               |                               |

	| delete  | -p nospam-20211117161714-31976                                                         | nospam-20211117161714-31976     | jenkins | v1.24.0 | Wed, 17 Nov 2021 16:18:51 PST | Wed, 17 Nov 2021 16:18:58 PST |

	| start   | -p                                                                                     | functional-20211117161858-31976 | jenkins | v1.24.0 | Wed, 17 Nov 2021 16:18:58 PST | Wed, 17 Nov 2021 16:21:01 PST |

	|         | functional-20211117161858-31976                                                        |                                 |         |         |                               |                               |

	|         | --memory=4000                                                                          |                                 |         |         |                               |                               |

	|         | --apiserver-port=8441                                                                  |                                 |         |         |                               |                               |

	|         | --wait=all --driver=docker                                                             |                                 |         |         |                               |                               |

	| start   | -p                                                                                     | functional-20211117161858-31976 | jenkins | v1.24.0 | Wed, 17 Nov 2021 16:21:01 PST | Wed, 17 Nov 2021 16:21:09 PST |

	|         | functional-20211117161858-31976                                                        |                                 |         |         |                               |                               |

	|         | --alsologtostderr -v=8                                                                 |                                 |         |         |                               |                               |

	| -p      | functional-20211117161858-31976 cache add                                              | functional-20211117161858-31976 | jenkins | v1.24.0 | Wed, 17 Nov 2021 16:21:11 PST | Wed, 17 Nov 2021 16:21:13 PST |

	|         | minikube-local-cache-test:functional-20211117161858-31976                              |                                 |         |         |                               |                               |

	| -p      | functional-20211117161858-31976 cache delete                                           | functional-20211117161858-31976 | jenkins | v1.24.0 | Wed, 17 Nov 2021 16:21:13 PST | Wed, 17 Nov 2021 16:21:13 PST |

	|         | minikube-local-cache-test:functional-20211117161858-31976                              |                                 |         |         |                               |                               |

	| cache   | list                                                                                   | minikube                        | jenkins | v1.24.0 | Wed, 17 Nov 2021 16:21:13 PST | Wed, 17 Nov 2021 16:21:13 PST |

	| -p      | functional-20211117161858-31976                                                        | functional-20211117161858-31976 | jenkins | v1.24.0 | Wed, 17 Nov 2021 16:21:13 PST | Wed, 17 Nov 2021 16:21:14 PST |

	|         | ssh sudo crictl images                                                                 |                                 |         |         |                               |                               |

	| -p      | functional-20211117161858-31976                                                        | functional-20211117161858-31976 | jenkins | v1.24.0 | Wed, 17 Nov 2021 16:21:15 PST | Wed, 17 Nov 2021 16:21:15 PST |

	|         | cache reload                                                                           |                                 |         |         |                               |                               |

	| -p      | functional-20211117161858-31976                                                        | functional-20211117161858-31976 | jenkins | v1.24.0 | Wed, 17 Nov 2021 16:21:17 PST | Wed, 17 Nov 2021 16:21:19 PST |

	|         | logs -n 25                                                                             |                                 |         |         |                               |                               |

	| -p      | functional-20211117161858-31976                                                        | functional-20211117161858-31976 | jenkins | v1.24.0 | Wed, 17 Nov 2021 16:21:20 PST | Wed, 17 Nov 2021 16:21:21 PST |

	|         | kubectl -- --context                                                                   |                                 |         |         |                               |                               |

	|         | functional-20211117161858-31976                                                        |                                 |         |         |                               |                               |

	|         | get pods                                                                               |                                 |         |         |                               |                               |

	| kubectl | --profile=functional-20211117161858-31976                                              | functional-20211117161858-31976 | jenkins | v1.24.0 | Wed, 17 Nov 2021 16:21:21 PST | Wed, 17 Nov 2021 16:21:21 PST |

	|         | -- --context                                                                           |                                 |         |         |                               |                               |

	|         | functional-20211117161858-31976 get pods                                               |                                 |         |         |                               |                               |

	| -p      | functional-20211117161858-31976                                                        | functional-20211117161858-31976 | jenkins | v1.24.0 | Wed, 17 Nov 2021 16:21:49 PST | Wed, 17 Nov 2021 16:21:52 PST |

	|         | logs -n 25                                                                             |                                 |         |         |                               |                               |

	|---------|----------------------------------------------------------------------------------------|---------------------------------|---------|---------|-------------------------------|-------------------------------|

	* 

	* ==> Last Start <==

	* Log file created at: 2021/11/17 16:21:21

	Running on machine: 37310

	Binary: Built with gc go1.17.3 for darwin/amd64

	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg

	I1117 16:21:21.622885   33790 out.go:297] Setting OutFile to fd 1 ...

	I1117 16:21:21.623009   33790 out.go:344] TERM=,COLORTERM=, which probably does not support color

	I1117 16:21:21.623011   33790 out.go:310] Setting ErrFile to fd 2...

	I1117 16:21:21.623013   33790 out.go:344] TERM=,COLORTERM=, which probably does not support color

	I1117 16:21:21.623084   33790 root.go:315] Updating PATH: /Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/bin

	I1117 16:21:21.623330   33790 out.go:304] Setting JSON to false

	I1117 16:21:21.649303   33790 start.go:112] hostinfo: {"hostname":"37310.local","uptime":8456,"bootTime":1637186425,"procs":357,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"11.2.3","kernelVersion":"20.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"bd1c05a8-24a6-5973-aa69-f3c7c66a87ce"}

	W1117 16:21:21.649404   33790 start.go:120] gopshost.Virtualization returned error: not implemented yet

	I1117 16:21:21.676374   33790 out.go:176] * [functional-20211117161858-31976] minikube v1.24.0 on Darwin 11.2.3

	I1117 16:21:21.676542   33790 notify.go:174] Checking for updates...

	I1117 16:21:21.702052   33790 out.go:176]   - MINIKUBE_LOCATION=12739

	I1117 16:21:21.728239   33790 out.go:176]   - KUBECONFIG=/Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/kubeconfig

	I1117 16:21:21.753862   33790 out.go:176]   - MINIKUBE_BIN=out/minikube-darwin-amd64

	I1117 16:21:21.779964   33790 out.go:176]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube

	I1117 16:21:21.780393   33790 config.go:176] Loaded profile config "functional-20211117161858-31976": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.22.3

	I1117 16:21:21.780436   33790 driver.go:343] Setting default libvirt URI to qemu:///system

	I1117 16:21:21.881721   33790 docker.go:132] docker version: linux-20.10.6

	I1117 16:21:21.881850   33790 cli_runner.go:115] Run: docker system info --format "{{json .}}"

	I1117 16:21:22.071842   33790 info.go:263] docker info: {ID:2AYQ:M3LP:F6GE:IPKK:4XGD:7ZUA:OVWC:XKGI:AARV:HKMV:IHBV:IRRJ Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:26 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:51 OomKillDisable:true NGoroutines:54 SystemTime:2021-11-18 00:21:22.004732313 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:4 KernelVersion:5.10.25-linuxkit OperatingSystem:Docker Desktop OSType:linux Architecture:x86_64 IndexServer

Address:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:6 MemTotal:6234726400 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy:http.docker.internal:3128 HTTPSProxy:http.docker.internal:3128 NoProxy: Name:docker-desktop Labels:[] ExperimentalBuild:false ServerVersion:20.10.6 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:05f951a3781f4f2c1911b05e61c160e9c30eaa8e Expected:05f951a3781f4f2c1911b05e61c160e9c30eaa8e} RuncCommit:{ID:12644e614e25b05da6fd08a38ffa0cfe1903fdec Expected:12644e614e25b05da6fd08a38ffa0cfe1903fdec} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=sec

comp,profile=default] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Experimental:true Name:app Path:/usr/local/lib/docker/cli-plugins/docker-app SchemaVersion:0.1.0 ShortDescription:Docker App Vendor:Docker Inc. Version:v0.9.1-beta3] map[Name:buildx Path:/usr/local/lib/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Build with BuildKit Vendor:Docker Inc. Version:v0.5.1-docker] map[Name:compose Path:/usr/local/lib/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:2.0.0-beta.1] map[Name:scan Path:/usr/local/lib/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.8.0]] Warnings:<nil>}}

	I1117 16:21:22.120163   33790 out.go:176] * Using the docker driver based on existing profile

	I1117 16:21:22.120221   33790 start.go:280] selected driver: docker

	I1117 16:21:22.120231   33790 start.go:775] validating driver "docker" against &{Name:functional-20211117161858-31976 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.28@sha256:4780f1897569d2bf77aafb3d133a08d42b4fe61127f06fcfc90c2c5d902d893c Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.22.3 ClusterName:functional-20211117161858-31976 Namespace:default APIServerName:minikubeCA APIServ

erNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8441 NodeName:} Nodes:[{Name: IP:192.168.49.2 Port:8441 KubernetesVersion:v1.22.3 ControlPlane:true Worker:true}] Addons:map[ambassador:false auto-pause:false csi-hostpath-driver:false dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false helm-tiller:false ingress:false ingress-dns:false istio:false istio-provisioner:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false volumesnapshots:false] CustomAddonImages:map[] CustomAdd

onRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host}

	I1117 16:21:22.120357   33790 start.go:786] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc:}

	I1117 16:21:22.120726   33790 cli_runner.go:115] Run: docker system info --format "{{json .}}"

	I1117 16:21:22.310085   33790 info.go:263] docker info: {ID:2AYQ:M3LP:F6GE:IPKK:4XGD:7ZUA:OVWC:XKGI:AARV:HKMV:IHBV:IRRJ Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:26 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:51 OomKillDisable:true NGoroutines:54 SystemTime:2021-11-18 00:21:22.241494137 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:4 KernelVersion:5.10.25-linuxkit OperatingSystem:Docker Desktop OSType:linux Architecture:x86_64 IndexServer

Address:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:6 MemTotal:6234726400 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy:http.docker.internal:3128 HTTPSProxy:http.docker.internal:3128 NoProxy: Name:docker-desktop Labels:[] ExperimentalBuild:false ServerVersion:20.10.6 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:05f951a3781f4f2c1911b05e61c160e9c30eaa8e Expected:05f951a3781f4f2c1911b05e61c160e9c30eaa8e} RuncCommit:{ID:12644e614e25b05da6fd08a38ffa0cfe1903fdec Expected:12644e614e25b05da6fd08a38ffa0cfe1903fdec} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=sec

comp,profile=default] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Experimental:true Name:app Path:/usr/local/lib/docker/cli-plugins/docker-app SchemaVersion:0.1.0 ShortDescription:Docker App Vendor:Docker Inc. Version:v0.9.1-beta3] map[Name:buildx Path:/usr/local/lib/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Build with BuildKit Vendor:Docker Inc. Version:v0.5.1-docker] map[Name:compose Path:/usr/local/lib/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:2.0.0-beta.1] map[Name:scan Path:/usr/local/lib/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.8.0]] Warnings:<nil>}}

	I1117 16:21:22.312056   33790 start_flags.go:758] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]

	I1117 16:21:22.312086   33790 cni.go:93] Creating CNI manager for ""

	I1117 16:21:22.312094   33790 cni.go:167] CNI unnecessary in this configuration, recommending no CNI

	I1117 16:21:22.312101   33790 start_flags.go:282] config:

	{Name:functional-20211117161858-31976 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.28@sha256:4780f1897569d2bf77aafb3d133a08d42b4fe61127f06fcfc90c2c5d902d893c Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.22.3 ClusterName:functional-20211117161858-31976 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISo

cket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[{Component:apiserver Key:enable-admission-plugins Value:NamespaceAutoProvision}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8441 NodeName:} Nodes:[{Name: IP:192.168.49.2 Port:8441 KubernetesVersion:v1.22.3 ControlPlane:true Worker:true}] Addons:map[ambassador:false auto-pause:false csi-hostpath-driver:false dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false helm-tiller:false ingress:false ingress-dns:false istio:false istio-provisioner:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false volumesnapshots:false] CustomAddonImages:map[] CustomAddo

nRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host}

	I1117 16:21:22.360734   33790 out.go:176] * Starting control plane node functional-20211117161858-31976 in cluster functional-20211117161858-31976

	I1117 16:21:22.360819   33790 cache.go:118] Beginning downloading kic base image for docker with docker

	I1117 16:21:22.386749   33790 out.go:176] * Pulling base image ...

	I1117 16:21:22.386821   33790 preload.go:132] Checking if preload exists for k8s version v1.22.3 and runtime docker

	I1117 16:21:22.386901   33790 preload.go:148] Found local preload: /Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v14-v1.22.3-docker-overlay2-amd64.tar.lz4

	I1117 16:21:22.386931   33790 cache.go:57] Caching tarball of preloaded images

	I1117 16:21:22.386925   33790 image.go:75] Checking for gcr.io/k8s-minikube/kicbase:v0.0.28@sha256:4780f1897569d2bf77aafb3d133a08d42b4fe61127f06fcfc90c2c5d902d893c in local docker daemon

	I1117 16:21:22.387177   33790 preload.go:174] Found /Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v14-v1.22.3-docker-overlay2-amd64.tar.lz4 in cache, skipping download

	I1117 16:21:22.387208   33790 cache.go:60] Finished verifying existence of preloaded tar for  v1.22.3 on docker

	I1117 16:21:22.387966   33790 profile.go:147] Saving config to /Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/profiles/functional-20211117161858-31976/config.json ...

	I1117 16:21:22.514468   33790 image.go:79] Found gcr.io/k8s-minikube/kicbase:v0.0.28@sha256:4780f1897569d2bf77aafb3d133a08d42b4fe61127f06fcfc90c2c5d902d893c in local docker daemon, skipping pull

	I1117 16:21:22.514485   33790 cache.go:140] gcr.io/k8s-minikube/kicbase:v0.0.28@sha256:4780f1897569d2bf77aafb3d133a08d42b4fe61127f06fcfc90c2c5d902d893c exists in daemon, skipping load

	I1117 16:21:22.514497   33790 cache.go:206] Successfully downloaded all kic artifacts

	I1117 16:21:22.514541   33790 start.go:313] acquiring machines lock for functional-20211117161858-31976: {Name:mkf7e5ee0db2d67009702787d2639dd998f1b20a Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I1117 16:21:22.514618   33790 start.go:317] acquired machines lock for "functional-20211117161858-31976" in 62.221µs

	I1117 16:21:22.514641   33790 start.go:93] Skipping create...Using existing machine configuration

	I1117 16:21:22.514648   33790 fix.go:55] fixHost starting: 

	I1117 16:21:22.514907   33790 cli_runner.go:115] Run: docker container inspect functional-20211117161858-31976 --format={{.State.Status}}

	I1117 16:21:22.635958   33790 fix.go:108] recreateIfNeeded on functional-20211117161858-31976: state=Running err=<nil>

	W1117 16:21:22.635981   33790 fix.go:134] unexpected machine state, will restart: <nil>

	I1117 16:21:22.662731   33790 out.go:176] * Updating the running docker "functional-20211117161858-31976" container ...

	I1117 16:21:22.662759   33790 machine.go:88] provisioning docker machine ...

	I1117 16:21:22.662778   33790 ubuntu.go:169] provisioning hostname "functional-20211117161858-31976"

	I1117 16:21:22.662854   33790 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-20211117161858-31976

	I1117 16:21:22.782815   33790 main.go:130] libmachine: Using SSH client type: native

	I1117 16:21:22.782997   33790 main.go:130] libmachine: &{{{<nil> 0 [] [] []} docker [0x1396d40] 0x1399e20 <nil>  [] 0s} 127.0.0.1 52137 <nil> <nil>}

	I1117 16:21:22.783006   33790 main.go:130] libmachine: About to run SSH command:

	sudo hostname functional-20211117161858-31976 && echo "functional-20211117161858-31976" | sudo tee /etc/hostname

	I1117 16:21:22.902454   33790 main.go:130] libmachine: SSH cmd err, output: <nil>: functional-20211117161858-31976

	I1117 16:21:22.902543   33790 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-20211117161858-31976

	I1117 16:21:23.024332   33790 main.go:130] libmachine: Using SSH client type: native

	I1117 16:21:23.024486   33790 main.go:130] libmachine: &{{{<nil> 0 [] [] []} docker [0x1396d40] 0x1399e20 <nil>  [] 0s} 127.0.0.1 52137 <nil> <nil>}

	I1117 16:21:23.024499   33790 main.go:130] libmachine: About to run SSH command:

			if ! grep -xq '.*\sfunctional-20211117161858-31976' /etc/hosts; then

				if grep -xq '127.0.1.1\s.*' /etc/hosts; then

					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 functional-20211117161858-31976/g' /etc/hosts;

				else 

					echo '127.0.1.1 functional-20211117161858-31976' | sudo tee -a /etc/hosts; 

				fi

			fi

	I1117 16:21:23.134580   33790 main.go:130] libmachine: SSH cmd err, output: <nil>: 

	I1117 16:21:23.134623   33790 ubuntu.go:175] set auth options {CertDir:/Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube CaCertPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/certs/ca.pem CaPrivateKeyPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/machines/server.pem ServerKeyPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/machines/server-key.pem ClientKeyPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/certs/key.pem ServerCertRemotePath:/etc/doc

ker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube}

	I1117 16:21:23.134651   33790 ubuntu.go:177] setting up certificates

	I1117 16:21:23.134667   33790 provision.go:83] configureAuth start

	I1117 16:21:23.134760   33790 cli_runner.go:115] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" functional-20211117161858-31976

	I1117 16:21:23.262120   33790 provision.go:138] copyHostCerts

	I1117 16:21:23.262204   33790 exec_runner.go:144] found /Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/cert.pem, removing ...

	I1117 16:21:23.262209   33790 exec_runner.go:207] rm: /Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/cert.pem

	I1117 16:21:23.262305   33790 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/certs/cert.pem --> /Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/cert.pem (1123 bytes)

	I1117 16:21:23.262507   33790 exec_runner.go:144] found /Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/key.pem, removing ...

	I1117 16:21:23.262516   33790 exec_runner.go:207] rm: /Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/key.pem

	I1117 16:21:23.262571   33790 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/certs/key.pem --> /Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/key.pem (1679 bytes)

	I1117 16:21:23.262708   33790 exec_runner.go:144] found /Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/ca.pem, removing ...

	I1117 16:21:23.262711   33790 exec_runner.go:207] rm: /Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/ca.pem

	I1117 16:21:23.262777   33790 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/certs/ca.pem --> /Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/ca.pem (1078 bytes)

	I1117 16:21:23.262901   33790 provision.go:112] generating server cert: /Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/machines/server.pem ca-key=/Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/certs/ca.pem private-key=/Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/certs/ca-key.pem org=jenkins.functional-20211117161858-31976 san=[192.168.49.2 127.0.0.1 localhost 127.0.0.1 minikube functional-20211117161858-31976]

	I1117 16:21:23.387784   33790 provision.go:172] copyRemoteCerts

	I1117 16:21:23.387849   33790 ssh_runner.go:152] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker

	I1117 16:21:23.387901   33790 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-20211117161858-31976

	I1117 16:21:23.508062   33790 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:52137 SSHKeyPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/machines/functional-20211117161858-31976/id_rsa Username:docker}

	I1117 16:21:23.598162   33790 ssh_runner.go:319] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/machines/server.pem --> /etc/docker/server.pem (1265 bytes)

	I1117 16:21:23.614485   33790 ssh_runner.go:319] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)

	I1117 16:21:23.631096   33790 ssh_runner.go:319] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)

	I1117 16:21:23.647617   33790 provision.go:86] duration metric: configureAuth took 512.923631ms

	I1117 16:21:23.647626   33790 ubuntu.go:193] setting minikube options for container-runtime

	I1117 16:21:23.647791   33790 config.go:176] Loaded profile config "functional-20211117161858-31976": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.22.3

	I1117 16:21:23.647858   33790 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-20211117161858-31976

	I1117 16:21:23.767974   33790 main.go:130] libmachine: Using SSH client type: native

	I1117 16:21:23.768127   33790 main.go:130] libmachine: &{{{<nil> 0 [] [] []} docker [0x1396d40] 0x1399e20 <nil>  [] 0s} 127.0.0.1 52137 <nil> <nil>}

	I1117 16:21:23.768134   33790 main.go:130] libmachine: About to run SSH command:

	df --output=fstype / | tail -n 1

	I1117 16:21:23.881322   33790 main.go:130] libmachine: SSH cmd err, output: <nil>: overlay

	I1117 16:21:23.881336   33790 ubuntu.go:71] root file system type: overlay

	I1117 16:21:23.881520   33790 provision.go:309] Updating docker unit: /lib/systemd/system/docker.service ...

	I1117 16:21:23.881615   33790 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-20211117161858-31976

	I1117 16:21:24.000288   33790 main.go:130] libmachine: Using SSH client type: native

	I1117 16:21:24.000448   33790 main.go:130] libmachine: &{{{<nil> 0 [] [] []} docker [0x1396d40] 0x1399e20 <nil>  [] 0s} 127.0.0.1 52137 <nil> <nil>}

	I1117 16:21:24.000493   33790 main.go:130] libmachine: About to run SSH command:

	sudo mkdir -p /lib/systemd/system && printf %!s(MISSING) "[Unit]

	Description=Docker Application Container Engine

	Documentation=https://docs.docker.com

	BindsTo=containerd.service

	After=network-online.target firewalld.service containerd.service

	Wants=network-online.target

	Requires=docker.socket

	StartLimitBurst=3

	StartLimitIntervalSec=60

	[Service]

	Type=notify

	Restart=on-failure

	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	# The base configuration already specifies an 'ExecStart=...' command. The first directive

	# here is to clear out that command inherited from the base configuration. Without this,

	# the command from the base configuration and the command specified here are treated as

	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	# will catch this invalid input and refuse to start the service with an error like:

	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	ExecStart=

	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12 

	ExecReload=/bin/kill -s HUP \$MAINPID

	# Having non-zero Limit*s causes performance problems due to accounting overhead

	# in the kernel. We recommend using cgroups to do container-local accounting.

	LimitNOFILE=infinity

	LimitNPROC=infinity

	LimitCORE=infinity

	# Uncomment TasksMax if your systemd version supports it.

	# Only systemd 226 and above support this version.

	TasksMax=infinity

	TimeoutStartSec=0

	# set delegate yes so that systemd does not reset the cgroups of docker containers

	Delegate=yes

	# kill only the docker process, not all processes in the cgroup

	KillMode=process

	[Install]

	WantedBy=multi-user.target

	" | sudo tee /lib/systemd/system/docker.service.new

	I1117 16:21:24.119293   33790 main.go:130] libmachine: SSH cmd err, output: <nil>: [Unit]

	Description=Docker Application Container Engine

	Documentation=https://docs.docker.com

	BindsTo=containerd.service

	After=network-online.target firewalld.service containerd.service

	Wants=network-online.target

	Requires=docker.socket

	StartLimitBurst=3

	StartLimitIntervalSec=60

	[Service]

	Type=notify

	Restart=on-failure

	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	# The base configuration already specifies an 'ExecStart=...' command. The first directive

	# here is to clear out that command inherited from the base configuration. Without this,

	# the command from the base configuration and the command specified here are treated as

	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	# will catch this invalid input and refuse to start the service with an error like:

	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	ExecStart=

	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12 

	ExecReload=/bin/kill -s HUP $MAINPID

	# Having non-zero Limit*s causes performance problems due to accounting overhead

	# in the kernel. We recommend using cgroups to do container-local accounting.

	LimitNOFILE=infinity

	LimitNPROC=infinity

	LimitCORE=infinity

	# Uncomment TasksMax if your systemd version supports it.

	# Only systemd 226 and above support this version.

	TasksMax=infinity

	TimeoutStartSec=0

	# set delegate yes so that systemd does not reset the cgroups of docker containers

	Delegate=yes

	# kill only the docker process, not all processes in the cgroup

	KillMode=process

	[Install]

	WantedBy=multi-user.target

	I1117 16:21:24.119389   33790 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-20211117161858-31976

	I1117 16:21:24.237960   33790 main.go:130] libmachine: Using SSH client type: native

	I1117 16:21:24.238130   33790 main.go:130] libmachine: &{{{<nil> 0 [] [] []} docker [0x1396d40] 0x1399e20 <nil>  [] 0s} 127.0.0.1 52137 <nil> <nil>}

	I1117 16:21:24.238140   33790 main.go:130] libmachine: About to run SSH command:

	sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }

	I1117 16:21:24.352811   33790 main.go:130] libmachine: SSH cmd err, output: <nil>: 

	I1117 16:21:24.352825   33790 machine.go:91] provisioned docker machine in 1.690013418s

	I1117 16:21:24.352833   33790 start.go:267] post-start starting for "functional-20211117161858-31976" (driver="docker")

	I1117 16:21:24.352836   33790 start.go:277] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]

	I1117 16:21:24.352919   33790 ssh_runner.go:152] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs

	I1117 16:21:24.352978   33790 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-20211117161858-31976

	I1117 16:21:24.472328   33790 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:52137 SSHKeyPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/machines/functional-20211117161858-31976/id_rsa Username:docker}

	I1117 16:21:24.555003   33790 ssh_runner.go:152] Run: cat /etc/os-release

	I1117 16:21:24.558639   33790 main.go:130] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found

	I1117 16:21:24.558652   33790 main.go:130] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found

	I1117 16:21:24.558660   33790 main.go:130] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found

	I1117 16:21:24.558665   33790 info.go:137] Remote host: Ubuntu 20.04.2 LTS

	I1117 16:21:24.558672   33790 filesync.go:126] Scanning /Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/addons for local assets ...

	I1117 16:21:24.558765   33790 filesync.go:126] Scanning /Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/files for local assets ...

	I1117 16:21:24.558951   33790 filesync.go:149] local asset: /Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/files/etc/ssl/certs/319762.pem -> 319762.pem in /etc/ssl/certs

	I1117 16:21:24.559095   33790 filesync.go:149] local asset: /Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/files/etc/test/nested/copy/31976/hosts -> hosts in /etc/test/nested/copy/31976

	I1117 16:21:24.559142   33790 ssh_runner.go:152] Run: sudo mkdir -p /etc/ssl/certs /etc/test/nested/copy/31976

	I1117 16:21:24.566252   33790 ssh_runner.go:319] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/files/etc/ssl/certs/319762.pem --> /etc/ssl/certs/319762.pem (1708 bytes)

	I1117 16:21:24.582991   33790 ssh_runner.go:319] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/files/etc/test/nested/copy/31976/hosts --> /etc/test/nested/copy/31976/hosts (40 bytes)

	I1117 16:21:24.599708   33790 start.go:270] post-start completed in 246.860649ms

	I1117 16:21:24.599784   33790 ssh_runner.go:152] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I1117 16:21:24.599840   33790 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-20211117161858-31976

	I1117 16:21:24.718037   33790 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:52137 SSHKeyPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/machines/functional-20211117161858-31976/id_rsa Username:docker}

	I1117 16:21:24.797768   33790 fix.go:57] fixHost completed within 2.283044439s

	I1117 16:21:24.797784   33790 start.go:80] releasing machines lock for "functional-20211117161858-31976", held for 2.283095634s

	I1117 16:21:24.797900   33790 cli_runner.go:115] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" functional-20211117161858-31976

	I1117 16:21:24.917591   33790 ssh_runner.go:152] Run: systemctl --version

	I1117 16:21:24.917601   33790 ssh_runner.go:152] Run: curl -sS -m 2 https://k8s.gcr.io/

	I1117 16:21:24.917658   33790 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-20211117161858-31976

	I1117 16:21:24.917672   33790 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-20211117161858-31976

	I1117 16:21:25.046625   33790 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:52137 SSHKeyPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/machines/functional-20211117161858-31976/id_rsa Username:docker}

	I1117 16:21:25.046759   33790 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:52137 SSHKeyPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/machines/functional-20211117161858-31976/id_rsa Username:docker}

	I1117 16:21:25.593369   33790 ssh_runner.go:152] Run: sudo systemctl is-active --quiet service containerd

	I1117 16:21:25.602997   33790 ssh_runner.go:152] Run: sudo systemctl cat docker.service

	I1117 16:21:25.612754   33790 cruntime.go:255] skipping containerd shutdown because we are bound to it

	I1117 16:21:25.612817   33790 ssh_runner.go:152] Run: sudo systemctl is-active --quiet service crio

	I1117 16:21:25.621861   33790 ssh_runner.go:152] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/dockershim.sock

	image-endpoint: unix:///var/run/dockershim.sock

	" | sudo tee /etc/crictl.yaml"

	I1117 16:21:25.634265   33790 ssh_runner.go:152] Run: sudo systemctl unmask docker.service

	I1117 16:21:25.711219   33790 ssh_runner.go:152] Run: sudo systemctl enable docker.socket

	I1117 16:21:25.789866   33790 ssh_runner.go:152] Run: sudo systemctl cat docker.service

	I1117 16:21:25.800286   33790 ssh_runner.go:152] Run: sudo systemctl daemon-reload

	I1117 16:21:25.877362   33790 ssh_runner.go:152] Run: sudo systemctl start docker

	I1117 16:21:25.887091   33790 ssh_runner.go:152] Run: docker version --format {{.Server.Version}}

	I1117 16:21:25.925452   33790 ssh_runner.go:152] Run: docker version --format {{.Server.Version}}

	I1117 16:21:25.992258   33790 out.go:203] * Preparing Kubernetes v1.22.3 on Docker 20.10.8 ...

	I1117 16:21:25.992393   33790 cli_runner.go:115] Run: docker exec -t functional-20211117161858-31976 dig +short host.docker.internal

	I1117 16:21:26.182933   33790 network.go:96] got host ip for mount in container by digging dns: 192.168.65.2

	I1117 16:21:26.183029   33790 ssh_runner.go:152] Run: grep 192.168.65.2	host.minikube.internal$ /etc/hosts

	I1117 16:21:26.187212   33790 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "8441/tcp") 0).HostPort}}'" functional-20211117161858-31976

	I1117 16:21:26.350225   33790 out.go:176]   - apiserver.enable-admission-plugins=NamespaceAutoProvision

	I1117 16:21:26.350377   33790 preload.go:132] Checking if preload exists for k8s version v1.22.3 and runtime docker

	I1117 16:21:26.350545   33790 ssh_runner.go:152] Run: docker images --format {{.Repository}}:{{.Tag}}

	I1117 16:21:26.382564   33790 docker.go:558] Got preloaded images: -- stdout --

	k8s.gcr.io/kube-apiserver:v1.22.3

	k8s.gcr.io/kube-scheduler:v1.22.3

	k8s.gcr.io/kube-controller-manager:v1.22.3

	k8s.gcr.io/kube-proxy:v1.22.3

	minikube-local-cache-test:functional-20211117161858-31976

	kubernetesui/dashboard:v2.3.1

	k8s.gcr.io/etcd:3.5.0-0

	kubernetesui/metrics-scraper:v1.0.7

	k8s.gcr.io/coredns/coredns:v1.8.4

	gcr.io/k8s-minikube/storage-provisioner:v5

	k8s.gcr.io/pause:3.5

	-- /stdout --

	I1117 16:21:26.382573   33790 docker.go:489] Images already preloaded, skipping extraction

	I1117 16:21:26.382653   33790 ssh_runner.go:152] Run: docker images --format {{.Repository}}:{{.Tag}}

	I1117 16:21:26.412928   33790 docker.go:558] Got preloaded images: -- stdout --

	k8s.gcr.io/kube-apiserver:v1.22.3

	k8s.gcr.io/kube-scheduler:v1.22.3

	k8s.gcr.io/kube-controller-manager:v1.22.3

	k8s.gcr.io/kube-proxy:v1.22.3

	minikube-local-cache-test:functional-20211117161858-31976

	kubernetesui/dashboard:v2.3.1

	k8s.gcr.io/etcd:3.5.0-0

	kubernetesui/metrics-scraper:v1.0.7

	k8s.gcr.io/coredns/coredns:v1.8.4

	gcr.io/k8s-minikube/storage-provisioner:v5

	k8s.gcr.io/pause:3.5

	-- /stdout --

	I1117 16:21:26.412940   33790 cache_images.go:79] Images are preloaded, skipping loading

	I1117 16:21:26.413025   33790 ssh_runner.go:152] Run: docker info --format {{.CgroupDriver}}

	I1117 16:21:26.493364   33790 extraconfig.go:124] Overwriting default enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota with user provided enable-admission-plugins=NamespaceAutoProvision for component apiserver

	I1117 16:21:26.493384   33790 cni.go:93] Creating CNI manager for ""

	I1117 16:21:26.493390   33790 cni.go:167] CNI unnecessary in this configuration, recommending no CNI

	I1117 16:21:26.493393   33790 kubeadm.go:87] Using pod CIDR: 10.244.0.0/16

	I1117 16:21:26.493408   33790 kubeadm.go:153] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.49.2 APIServerPort:8441 KubernetesVersion:v1.22.3 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:functional-20211117161858-31976 NodeName:functional-20211117161858-31976 DNSDomain:cluster.local CRISocket:/var/run/dockershim.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceAutoProvision] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.49.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NoTaintMaster:true NodeIP:192.168.49.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[]}

	I1117 16:21:26.493510   33790 kubeadm.go:157] kubeadm config:

	apiVersion: kubeadm.k8s.io/v1beta2

	kind: InitConfiguration

	localAPIEndpoint:

	  advertiseAddress: 192.168.49.2

	  bindPort: 8441

	bootstrapTokens:

	  - groups:

	      - system:bootstrappers:kubeadm:default-node-token

	    ttl: 24h0m0s

	    usages:

	      - signing

	      - authentication

	nodeRegistration:

	  criSocket: /var/run/dockershim.sock

	  name: "functional-20211117161858-31976"

	  kubeletExtraArgs:

	    node-ip: 192.168.49.2

	  taints: []

	---

	apiVersion: kubeadm.k8s.io/v1beta2

	kind: ClusterConfiguration

	apiServer:

	  certSANs: ["127.0.0.1", "localhost", "192.168.49.2"]

	  extraArgs:

	    enable-admission-plugins: "NamespaceAutoProvision"

	controllerManager:

	  extraArgs:

	    allocate-node-cidrs: "true"

	    leader-elect: "false"

	scheduler:

	  extraArgs:

	    leader-elect: "false"

	certificatesDir: /var/lib/minikube/certs

	clusterName: mk

	controlPlaneEndpoint: control-plane.minikube.internal:8441

	dns:

	  type: CoreDNS

	etcd:

	  local:

	    dataDir: /var/lib/minikube/etcd

	    extraArgs:

	      proxy-refresh-interval: "70000"

	kubernetesVersion: v1.22.3

	networking:

	  dnsDomain: cluster.local

	  podSubnet: "10.244.0.0/16"

	  serviceSubnet: 10.96.0.0/12

	---

	apiVersion: kubelet.config.k8s.io/v1beta1

	kind: KubeletConfiguration

	authentication:

	  x509:

	    clientCAFile: /var/lib/minikube/certs/ca.crt

	cgroupDriver: cgroupfs

	clusterDomain: "cluster.local"

	# disable disk resource management by default

	imageGCHighThresholdPercent: 100

	evictionHard:

	  nodefs.available: "0%!"(MISSING)

	  nodefs.inodesFree: "0%!"(MISSING)

	  imagefs.available: "0%!"(MISSING)

	failSwapOn: false

	staticPodPath: /etc/kubernetes/manifests

	---

	apiVersion: kubeproxy.config.k8s.io/v1alpha1

	kind: KubeProxyConfiguration

	clusterCIDR: "10.244.0.0/16"

	metricsBindAddress: 0.0.0.0:10249

	conntrack:

	  maxPerCore: 0

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"

	  tcpEstablishedTimeout: 0s

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"

	  tcpCloseWaitTimeout: 0s

	I1117 16:21:26.493599   33790 kubeadm.go:909] kubelet [Unit]

	Wants=docker.socket

	[Service]

	ExecStart=

	ExecStart=/var/lib/minikube/binaries/v1.22.3/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=docker --hostname-override=functional-20211117161858-31976 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.49.2

	[Install]

	 config:

	{KubernetesVersion:v1.22.3 ClusterName:functional-20211117161858-31976 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[{Component:apiserver Key:enable-admission-plugins Value:NamespaceAutoProvision}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8441 NodeName:}

	I1117 16:21:26.493666   33790 ssh_runner.go:152] Run: sudo ls /var/lib/minikube/binaries/v1.22.3

	I1117 16:21:26.501690   33790 binaries.go:44] Found k8s binaries, skipping transfer

	I1117 16:21:26.501744   33790 ssh_runner.go:152] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube

	I1117 16:21:26.508804   33790 ssh_runner.go:319] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (357 bytes)

	I1117 16:21:26.521182   33790 ssh_runner.go:319] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)

	I1117 16:21:26.533276   33790 ssh_runner.go:319] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (1924 bytes)

	I1117 16:21:26.554949   33790 ssh_runner.go:152] Run: grep 192.168.49.2	control-plane.minikube.internal$ /etc/hosts

	I1117 16:21:26.559258   33790 certs.go:54] Setting up /Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/profiles/functional-20211117161858-31976 for IP: 192.168.49.2

	I1117 16:21:26.559460   33790 certs.go:182] skipping minikubeCA CA generation: /Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/ca.key

	I1117 16:21:26.559521   33790 certs.go:182] skipping proxyClientCA CA generation: /Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/proxy-client-ca.key

	I1117 16:21:26.559652   33790 certs.go:298] skipping minikube-user signed cert generation: /Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/profiles/functional-20211117161858-31976/client.key

	I1117 16:21:26.559720   33790 certs.go:298] skipping minikube signed cert generation: /Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/profiles/functional-20211117161858-31976/apiserver.key.dd3b5fb2

	I1117 16:21:26.559771   33790 certs.go:298] skipping aggregator signed cert generation: /Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/profiles/functional-20211117161858-31976/proxy-client.key

	I1117 16:21:26.559974   33790 certs.go:388] found cert: /Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/certs/Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/certs/31976.pem (1338 bytes)

	W1117 16:21:26.560019   33790 certs.go:384] ignoring /Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/certs/Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/certs/31976_empty.pem, impossibly tiny 0 bytes

	I1117 16:21:26.560033   33790 certs.go:388] found cert: /Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/certs/Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/certs/ca-key.pem (1679 bytes)

	I1117 16:21:26.560072   33790 certs.go:388] found cert: /Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/certs/Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/certs/ca.pem (1078 bytes)

	I1117 16:21:26.560110   33790 certs.go:388] found cert: /Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/certs/Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/certs/cert.pem (1123 bytes)

	I1117 16:21:26.560155   33790 certs.go:388] found cert: /Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/certs/Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/certs/key.pem (1679 bytes)

	I1117 16:21:26.560217   33790 certs.go:388] found cert: /Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/files/etc/ssl/certs/Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/files/etc/ssl/certs/319762.pem (1708 bytes)

	I1117 16:21:26.561014   33790 ssh_runner.go:319] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/profiles/functional-20211117161858-31976/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1399 bytes)

	I1117 16:21:26.582083   33790 ssh_runner.go:319] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/profiles/functional-20211117161858-31976/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)

	I1117 16:21:26.599821   33790 ssh_runner.go:319] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/profiles/functional-20211117161858-31976/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)

	I1117 16:21:26.636540   33790 ssh_runner.go:319] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/profiles/functional-20211117161858-31976/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)

	I1117 16:21:26.653473   33790 ssh_runner.go:319] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)

	I1117 16:21:26.670129   33790 ssh_runner.go:319] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)

	I1117 16:21:26.686208   33790 ssh_runner.go:319] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)

	I1117 16:21:26.702853   33790 ssh_runner.go:319] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)

	I1117 16:21:26.719475   33790 ssh_runner.go:319] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)

	I1117 16:21:26.736305   33790 ssh_runner.go:319] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/certs/31976.pem --> /usr/share/ca-certificates/31976.pem (1338 bytes)

	I1117 16:21:26.753116   33790 ssh_runner.go:319] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/files/etc/ssl/certs/319762.pem --> /usr/share/ca-certificates/319762.pem (1708 bytes)

	I1117 16:21:26.770927   33790 ssh_runner.go:319] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)

	I1117 16:21:26.783126   33790 ssh_runner.go:152] Run: openssl version

	I1117 16:21:26.788339   33790 ssh_runner.go:152] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/31976.pem && ln -fs /usr/share/ca-certificates/31976.pem /etc/ssl/certs/31976.pem"

	I1117 16:21:26.795960   33790 ssh_runner.go:152] Run: ls -la /usr/share/ca-certificates/31976.pem

	I1117 16:21:26.799692   33790 certs.go:431] hashing: -rw-r--r-- 1 root root 1338 Nov 18 00:18 /usr/share/ca-certificates/31976.pem

	I1117 16:21:26.799736   33790 ssh_runner.go:152] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/31976.pem

	I1117 16:21:26.804943   33790 ssh_runner.go:152] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/31976.pem /etc/ssl/certs/51391683.0"

	I1117 16:21:26.812809   33790 ssh_runner.go:152] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/319762.pem && ln -fs /usr/share/ca-certificates/319762.pem /etc/ssl/certs/319762.pem"

	I1117 16:21:26.820966   33790 ssh_runner.go:152] Run: ls -la /usr/share/ca-certificates/319762.pem

	I1117 16:21:26.825189   33790 certs.go:431] hashing: -rw-r--r-- 1 root root 1708 Nov 18 00:18 /usr/share/ca-certificates/319762.pem

	I1117 16:21:26.825239   33790 ssh_runner.go:152] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/319762.pem

	I1117 16:21:26.830525   33790 ssh_runner.go:152] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/319762.pem /etc/ssl/certs/3ec20f2e.0"

	I1117 16:21:26.838070   33790 ssh_runner.go:152] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"

	I1117 16:21:26.846059   33790 ssh_runner.go:152] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem

	I1117 16:21:26.850266   33790 certs.go:431] hashing: -rw-r--r-- 1 root root 1111 Nov 18 00:12 /usr/share/ca-certificates/minikubeCA.pem

	I1117 16:21:26.850311   33790 ssh_runner.go:152] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem

	I1117 16:21:26.855877   33790 ssh_runner.go:152] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"

	I1117 16:21:26.863048   33790 kubeadm.go:390] StartCluster: {Name:functional-20211117161858-31976 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.28@sha256:4780f1897569d2bf77aafb3d133a08d42b4fe61127f06fcfc90c2c5d902d893c Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.22.3 ClusterName:functional-20211117161858-31976 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServer

IPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[{Component:apiserver Key:enable-admission-plugins Value:NamespaceAutoProvision}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8441 NodeName:} Nodes:[{Name: IP:192.168.49.2 Port:8441 KubernetesVersion:v1.22.3 ControlPlane:true Worker:true}] Addons:map[ambassador:false auto-pause:false csi-hostpath-driver:false dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false helm-tiller:false ingress:false ingress-dns:false istio:false istio-provisioner:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:fal

se volumesnapshots:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host}

	I1117 16:21:26.863171   33790 ssh_runner.go:152] Run: docker ps --filter status=paused --filter=name=k8s_.*_(kube-system)_ --format={{.ID}}

	I1117 16:21:26.891230   33790 ssh_runner.go:152] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd

	I1117 16:21:26.899485   33790 kubeadm.go:401] found existing configuration files, will attempt cluster restart

	I1117 16:21:26.899495   33790 kubeadm.go:600] restartCluster start

	I1117 16:21:26.899552   33790 ssh_runner.go:152] Run: sudo test -d /data/minikube

	I1117 16:21:26.906674   33790 kubeadm.go:126] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1

	stdout:

	stderr:

	I1117 16:21:26.906751   33790 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "8441/tcp") 0).HostPort}}'" functional-20211117161858-31976

	I1117 16:21:27.028837   33790 kubeconfig.go:92] found "functional-20211117161858-31976" server: "https://127.0.0.1:52141"

	I1117 16:21:27.032037   33790 ssh_runner.go:152] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new

	I1117 16:21:27.040014   33790 kubeadm.go:568] needs reconfigure: configs differ:

	-- stdout --

	--- /var/tmp/minikube/kubeadm.yaml	2021-11-18 00:19:49.283585838 +0000

	+++ /var/tmp/minikube/kubeadm.yaml.new	2021-11-18 00:21:26.562255672 +0000

	@@ -22,7 +22,7 @@

	 apiServer:

	   certSANs: ["127.0.0.1", "localhost", "192.168.49.2"]

	   extraArgs:

	-    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"

	+    enable-admission-plugins: "NamespaceAutoProvision"

	 controllerManager:

	   extraArgs:

	     allocate-node-cidrs: "true"

	-- /stdout --

	I1117 16:21:27.040021   33790 kubeadm.go:1032] stopping kube-system containers ...

	I1117 16:21:27.040101   33790 ssh_runner.go:152] Run: docker ps -a --filter=name=k8s_.*_(kube-system)_ --format={{.ID}}

	I1117 16:21:27.071071   33790 docker.go:390] Stopping containers: [ea850ca3cc61 d0d3e0dca5e9 41b6ab69a384 0e35560df59b e4efee81ca46 26ff204bef53 7d514020b6b7 9b2f0c8b2294 57f34cc17d7a acade1ad68d7 5c6c4dc475e0 9bad689182de 72ff4c2179fb e30cdc66639d c595f5f22c80]

	I1117 16:21:27.071168   33790 ssh_runner.go:152] Run: docker stop ea850ca3cc61 d0d3e0dca5e9 41b6ab69a384 0e35560df59b e4efee81ca46 26ff204bef53 7d514020b6b7 9b2f0c8b2294 57f34cc17d7a acade1ad68d7 5c6c4dc475e0 9bad689182de 72ff4c2179fb e30cdc66639d c595f5f22c80

	I1117 16:21:32.228295   33790 ssh_runner.go:192] Completed: docker stop ea850ca3cc61 d0d3e0dca5e9 41b6ab69a384 0e35560df59b e4efee81ca46 26ff204bef53 7d514020b6b7 9b2f0c8b2294 57f34cc17d7a acade1ad68d7 5c6c4dc475e0 9bad689182de 72ff4c2179fb e30cdc66639d c595f5f22c80: (5.156941798s)

	I1117 16:21:32.228388   33790 ssh_runner.go:152] Run: sudo systemctl stop kubelet

	I1117 16:21:32.273365   33790 ssh_runner.go:152] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf

	I1117 16:21:32.281095   33790 kubeadm.go:154] found existing configuration files:

	-rw------- 1 root root 5639 Nov 18 00:19 /etc/kubernetes/admin.conf

	-rw------- 1 root root 5652 Nov 18 00:19 /etc/kubernetes/controller-manager.conf

	-rw------- 1 root root 2063 Nov 18 00:20 /etc/kubernetes/kubelet.conf

	-rw------- 1 root root 5604 Nov 18 00:19 /etc/kubernetes/scheduler.conf

	I1117 16:21:32.281148   33790 ssh_runner.go:152] Run: sudo grep https://control-plane.minikube.internal:8441 /etc/kubernetes/admin.conf

	I1117 16:21:32.288879   33790 ssh_runner.go:152] Run: sudo grep https://control-plane.minikube.internal:8441 /etc/kubernetes/kubelet.conf

	I1117 16:21:32.296147   33790 ssh_runner.go:152] Run: sudo grep https://control-plane.minikube.internal:8441 /etc/kubernetes/controller-manager.conf

	I1117 16:21:32.303562   33790 kubeadm.go:165] "https://control-plane.minikube.internal:8441" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8441 /etc/kubernetes/controller-manager.conf: Process exited with status 1

	stdout:

	stderr:

	I1117 16:21:32.303622   33790 ssh_runner.go:152] Run: sudo rm -f /etc/kubernetes/controller-manager.conf

	I1117 16:21:32.312025   33790 ssh_runner.go:152] Run: sudo grep https://control-plane.minikube.internal:8441 /etc/kubernetes/scheduler.conf

	I1117 16:21:32.319391   33790 kubeadm.go:165] "https://control-plane.minikube.internal:8441" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8441 /etc/kubernetes/scheduler.conf: Process exited with status 1

	stdout:

	stderr:

	I1117 16:21:32.319450   33790 ssh_runner.go:152] Run: sudo rm -f /etc/kubernetes/scheduler.conf

	I1117 16:21:32.326292   33790 ssh_runner.go:152] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml

	I1117 16:21:32.333970   33790 kubeadm.go:676] reconfiguring cluster from /var/tmp/minikube/kubeadm.yaml

	I1117 16:21:32.333977   33790 ssh_runner.go:152] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.22.3:$PATH" kubeadm init phase certs all --config /var/tmp/minikube/kubeadm.yaml"

	I1117 16:21:32.380483   33790 ssh_runner.go:152] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.22.3:$PATH" kubeadm init phase kubeconfig all --config /var/tmp/minikube/kubeadm.yaml"

	I1117 16:21:33.540088   33790 ssh_runner.go:192] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.22.3:$PATH" kubeadm init phase kubeconfig all --config /var/tmp/minikube/kubeadm.yaml": (1.159560405s)

	I1117 16:21:33.540097   33790 ssh_runner.go:152] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.22.3:$PATH" kubeadm init phase kubelet-start --config /var/tmp/minikube/kubeadm.yaml"

	I1117 16:21:33.673891   33790 ssh_runner.go:152] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.22.3:$PATH" kubeadm init phase control-plane all --config /var/tmp/minikube/kubeadm.yaml"

	I1117 16:21:33.726579   33790 ssh_runner.go:152] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.22.3:$PATH" kubeadm init phase etcd local --config /var/tmp/minikube/kubeadm.yaml"

	I1117 16:21:33.795988   33790 api_server.go:51] waiting for apiserver process to appear ...

	I1117 16:21:33.796057   33790 ssh_runner.go:152] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I1117 16:21:33.812813   33790 api_server.go:71] duration metric: took 16.830404ms to wait for apiserver process to appear ...

	I1117 16:21:33.812822   33790 api_server.go:87] waiting for apiserver healthz status ...

	I1117 16:21:33.812833   33790 api_server.go:240] Checking apiserver healthz at https://127.0.0.1:52141/healthz ...

	I1117 16:21:33.819102   33790 api_server.go:266] https://127.0.0.1:52141/healthz returned 200:

	ok

	I1117 16:21:33.826158   33790 api_server.go:140] control plane version: v1.22.3

	I1117 16:21:33.826169   33790 api_server.go:130] duration metric: took 13.343873ms to wait for apiserver health ...

	I1117 16:21:33.826174   33790 cni.go:93] Creating CNI manager for ""

	I1117 16:21:33.826178   33790 cni.go:167] CNI unnecessary in this configuration, recommending no CNI

	I1117 16:21:33.826185   33790 system_pods.go:43] waiting for kube-system pods to appear ...

	I1117 16:21:33.836317   33790 system_pods.go:59] 7 kube-system pods found

	I1117 16:21:33.836331   33790 system_pods.go:61] "coredns-78fcd69978-dnq6x" [67a186a3-f954-4960-bb9e-57d18527dbc7] Running

	I1117 16:21:33.836337   33790 system_pods.go:61] "etcd-functional-20211117161858-31976" [0591e3ee-239f-402b-a882-d725460bb901] Running / Ready:ContainersNotReady (containers with unready status: [etcd]) / ContainersReady:ContainersNotReady (containers with unready status: [etcd])

	I1117 16:21:33.836340   33790 system_pods.go:61] "kube-apiserver-functional-20211117161858-31976" [e7056857-2ed9-4d76-8caa-79910d7b601e] Running / Ready:ContainersNotReady (containers with unready status: [kube-apiserver]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-apiserver])

	I1117 16:21:33.836348   33790 system_pods.go:61] "kube-controller-manager-functional-20211117161858-31976" [7fd136e2-3546-4ed5-a212-51641f6cb3d3] Running / Ready:ContainersNotReady (containers with unready status: [kube-controller-manager]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-controller-manager])

	I1117 16:21:33.836351   33790 system_pods.go:61] "kube-proxy-wbv29" [453e3252-c5a8-48b4-893b-0496a8ed4dec] Running

	I1117 16:21:33.836353   33790 system_pods.go:61] "kube-scheduler-functional-20211117161858-31976" [709bdcfd-0135-490f-9d56-c5ad014aab58] Running

	I1117 16:21:33.836358   33790 system_pods.go:61] "storage-provisioner" [9b9ccef0-fccc-43f7-8dec-952d07564964] Running / Ready:ContainersNotReady (containers with unready status: [storage-provisioner]) / ContainersReady:ContainersNotReady (containers with unready status: [storage-provisioner])

	I1117 16:21:33.836361   33790 system_pods.go:74] duration metric: took 10.173348ms to wait for pod list to return data ...

	I1117 16:21:33.836365   33790 node_conditions.go:102] verifying NodePressure condition ...

	I1117 16:21:33.840538   33790 node_conditions.go:122] node storage ephemeral capacity is 123591232Ki

	I1117 16:21:33.840552   33790 node_conditions.go:123] node cpu capacity is 6

	I1117 16:21:33.840563   33790 node_conditions.go:105] duration metric: took 4.193776ms to run NodePressure ...

	I1117 16:21:33.840571   33790 ssh_runner.go:152] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.22.3:$PATH" kubeadm init phase addon all --config /var/tmp/minikube/kubeadm.yaml"

	I1117 16:21:34.196195   33790 kubeadm.go:731] waiting for restarted kubelet to initialise ...

	I1117 16:21:34.200872   33790 kubeadm.go:746] kubelet initialised

	I1117 16:21:34.200878   33790 kubeadm.go:747] duration metric: took 4.672789ms waiting for restarted kubelet to initialise ...

	I1117 16:21:34.200885   33790 pod_ready.go:35] extra waiting up to 4m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I1117 16:21:34.206372   33790 pod_ready.go:78] waiting up to 4m0s for pod "coredns-78fcd69978-dnq6x" in "kube-system" namespace to be "Ready" ...

	I1117 16:21:34.216319   33790 pod_ready.go:92] pod "coredns-78fcd69978-dnq6x" in "kube-system" namespace has status "Ready":"True"

	I1117 16:21:34.216325   33790 pod_ready.go:81] duration metric: took 9.941793ms waiting for pod "coredns-78fcd69978-dnq6x" in "kube-system" namespace to be "Ready" ...

	I1117 16:21:34.216336   33790 pod_ready.go:78] waiting up to 4m0s for pod "etcd-functional-20211117161858-31976" in "kube-system" namespace to be "Ready" ...

	I1117 16:21:34.733695   33790 pod_ready.go:97] node "functional-20211117161858-31976" hosting pod "etcd-functional-20211117161858-31976" in "kube-system" namespace is currently not "Ready" (skipping!): node "functional-20211117161858-31976" has status "Ready":"False"

	I1117 16:21:34.733705   33790 pod_ready.go:81] duration metric: took 517.348753ms waiting for pod "etcd-functional-20211117161858-31976" in "kube-system" namespace to be "Ready" ...

	E1117 16:21:34.733709   33790 pod_ready.go:66] WaitExtra: waitPodCondition: node "functional-20211117161858-31976" hosting pod "etcd-functional-20211117161858-31976" in "kube-system" namespace is currently not "Ready" (skipping!): node "functional-20211117161858-31976" has status "Ready":"False"

	I1117 16:21:34.733723   33790 pod_ready.go:78] waiting up to 4m0s for pod "kube-apiserver-functional-20211117161858-31976" in "kube-system" namespace to be "Ready" ...

	I1117 16:21:34.738314   33790 pod_ready.go:97] node "functional-20211117161858-31976" hosting pod "kube-apiserver-functional-20211117161858-31976" in "kube-system" namespace is currently not "Ready" (skipping!): node "functional-20211117161858-31976" has status "Ready":"False"

	I1117 16:21:34.738320   33790 pod_ready.go:81] duration metric: took 4.593288ms waiting for pod "kube-apiserver-functional-20211117161858-31976" in "kube-system" namespace to be "Ready" ...

	E1117 16:21:34.738325   33790 pod_ready.go:66] WaitExtra: waitPodCondition: node "functional-20211117161858-31976" hosting pod "kube-apiserver-functional-20211117161858-31976" in "kube-system" namespace is currently not "Ready" (skipping!): node "functional-20211117161858-31976" has status "Ready":"False"

	I1117 16:21:34.738332   33790 pod_ready.go:78] waiting up to 4m0s for pod "kube-controller-manager-functional-20211117161858-31976" in "kube-system" namespace to be "Ready" ...

	I1117 16:21:34.742721   33790 pod_ready.go:97] node "functional-20211117161858-31976" hosting pod "kube-controller-manager-functional-20211117161858-31976" in "kube-system" namespace is currently not "Ready" (skipping!): node "functional-20211117161858-31976" has status "Ready":"False"

	I1117 16:21:34.742728   33790 pod_ready.go:81] duration metric: took 4.392273ms waiting for pod "kube-controller-manager-functional-20211117161858-31976" in "kube-system" namespace to be "Ready" ...

	E1117 16:21:34.742733   33790 pod_ready.go:66] WaitExtra: waitPodCondition: node "functional-20211117161858-31976" hosting pod "kube-controller-manager-functional-20211117161858-31976" in "kube-system" namespace is currently not "Ready" (skipping!): node "functional-20211117161858-31976" has status "Ready":"False"

	I1117 16:21:34.742742   33790 pod_ready.go:78] waiting up to 4m0s for pod "kube-proxy-wbv29" in "kube-system" namespace to be "Ready" ...

	I1117 16:21:35.029336   33790 pod_ready.go:97] node "functional-20211117161858-31976" hosting pod "kube-proxy-wbv29" in "kube-system" namespace is currently not "Ready" (skipping!): node "functional-20211117161858-31976" has status "Ready":"False"

	I1117 16:21:35.029342   33790 pod_ready.go:81] duration metric: took 286.584397ms waiting for pod "kube-proxy-wbv29" in "kube-system" namespace to be "Ready" ...

	E1117 16:21:35.029346   33790 pod_ready.go:66] WaitExtra: waitPodCondition: node "functional-20211117161858-31976" hosting pod "kube-proxy-wbv29" in "kube-system" namespace is currently not "Ready" (skipping!): node "functional-20211117161858-31976" has status "Ready":"False"

	I1117 16:21:35.029360   33790 pod_ready.go:78] waiting up to 4m0s for pod "kube-scheduler-functional-20211117161858-31976" in "kube-system" namespace to be "Ready" ...

	I1117 16:21:35.432286   33790 pod_ready.go:97] node "functional-20211117161858-31976" hosting pod "kube-scheduler-functional-20211117161858-31976" in "kube-system" namespace is currently not "Ready" (skipping!): node "functional-20211117161858-31976" has status "Ready":"False"

	I1117 16:21:35.432297   33790 pod_ready.go:81] duration metric: took 402.92083ms waiting for pod "kube-scheduler-functional-20211117161858-31976" in "kube-system" namespace to be "Ready" ...

	E1117 16:21:35.432302   33790 pod_ready.go:66] WaitExtra: waitPodCondition: node "functional-20211117161858-31976" hosting pod "kube-scheduler-functional-20211117161858-31976" in "kube-system" namespace is currently not "Ready" (skipping!): node "functional-20211117161858-31976" has status "Ready":"False"

	I1117 16:21:35.432314   33790 pod_ready.go:38] duration metric: took 1.231387704s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I1117 16:21:35.432326   33790 ssh_runner.go:152] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"

	I1117 16:21:35.448332   33790 ops.go:34] apiserver oom_adj: -16

	I1117 16:21:35.448338   33790 kubeadm.go:604] restartCluster took 8.54859145s

	I1117 16:21:35.448342   33790 kubeadm.go:392] StartCluster complete in 8.585052624s

	I1117 16:21:35.448355   33790 settings.go:142] acquiring lock: {Name:mk2452f58907cab9912f4bf05149d18acb236e76 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1117 16:21:35.448438   33790 settings.go:150] Updating kubeconfig:  /Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/kubeconfig

	I1117 16:21:35.448901   33790 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/kubeconfig: {Name:mk7b88dea9e1cf642f59443febe00ec01446b401 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1117 16:21:35.454603   33790 kapi.go:244] deployment "coredns" in namespace "kube-system" and context "functional-20211117161858-31976" rescaled to 1

	I1117 16:21:35.454631   33790 start.go:229] Will wait 6m0s for node &{Name: IP:192.168.49.2 Port:8441 KubernetesVersion:v1.22.3 ControlPlane:true Worker:true}

	I1117 16:21:35.454642   33790 ssh_runner.go:152] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.22.3/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"

	I1117 16:21:35.454677   33790 addons.go:415] enableAddons start: toEnable=map[ambassador:false auto-pause:false csi-hostpath-driver:false dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false helm-tiller:false ingress:false ingress-dns:false istio:false istio-provisioner:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false volumesnapshots:false], additional=[]

	I1117 16:21:35.482280   33790 out.go:176] * Verifying Kubernetes components...

	I1117 16:21:35.454823   33790 config.go:176] Loaded profile config "functional-20211117161858-31976": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.22.3

	I1117 16:21:35.482339   33790 addons.go:65] Setting default-storageclass=true in profile "functional-20211117161858-31976"

	I1117 16:21:35.482342   33790 addons.go:65] Setting storage-provisioner=true in profile "functional-20211117161858-31976"

	I1117 16:21:35.482355   33790 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "functional-20211117161858-31976"

	I1117 16:21:35.482360   33790 addons.go:153] Setting addon storage-provisioner=true in "functional-20211117161858-31976"

	I1117 16:21:35.482365   33790 ssh_runner.go:152] Run: sudo systemctl is-active --quiet service kubelet

	W1117 16:21:35.482365   33790 addons.go:165] addon storage-provisioner should already be in state true

	I1117 16:21:35.482397   33790 host.go:66] Checking if "functional-20211117161858-31976" exists ...

	I1117 16:21:35.482835   33790 cli_runner.go:115] Run: docker container inspect functional-20211117161858-31976 --format={{.State.Status}}

	I1117 16:21:35.503648   33790 cli_runner.go:115] Run: docker container inspect functional-20211117161858-31976 --format={{.State.Status}}

	I1117 16:21:35.517807   33790 start.go:719] CoreDNS already contains "host.minikube.internal" host record, skipping...

	I1117 16:21:35.517901   33790 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "8441/tcp") 0).HostPort}}'" functional-20211117161858-31976

	I1117 16:21:35.651758   33790 addons.go:153] Setting addon default-storageclass=true in "functional-20211117161858-31976"

	W1117 16:21:35.651773   33790 addons.go:165] addon default-storageclass should already be in state true

	I1117 16:21:35.651786   33790 host.go:66] Checking if "functional-20211117161858-31976" exists ...

	I1117 16:21:35.652195   33790 cli_runner.go:115] Run: docker container inspect functional-20211117161858-31976 --format={{.State.Status}}

	I1117 16:21:35.688652   33790 out.go:176]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5

	I1117 16:21:35.688763   33790 addons.go:348] installing /etc/kubernetes/addons/storage-provisioner.yaml

	I1117 16:21:35.688779   33790 ssh_runner.go:319] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)

	I1117 16:21:35.688858   33790 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-20211117161858-31976

	I1117 16:21:35.694743   33790 node_ready.go:35] waiting up to 6m0s for node "functional-20211117161858-31976" to be "Ready" ...

	I1117 16:21:35.793431   33790 addons.go:348] installing /etc/kubernetes/addons/storageclass.yaml

	I1117 16:21:35.793440   33790 ssh_runner.go:319] scp memory --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)

	I1117 16:21:35.793530   33790 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-20211117161858-31976

	I1117 16:21:35.827874   33790 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:52137 SSHKeyPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/machines/functional-20211117161858-31976/id_rsa Username:docker}

	I1117 16:21:35.921703   33790 ssh_runner.go:152] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.22.3/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml

	I1117 16:21:35.934689   33790 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:52137 SSHKeyPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/machines/functional-20211117161858-31976/id_rsa Username:docker}

	I1117 16:21:36.037457   33790 ssh_runner.go:152] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.22.3/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml

	I1117 16:21:36.223180   33790 out.go:176] * Enabled addons: storage-provisioner, default-storageclass

	I1117 16:21:36.223193   33790 addons.go:417] enableAddons completed in 768.519889ms

	I1117 16:21:37.704232   33790 node_ready.go:58] node "functional-20211117161858-31976" has status "Ready":"False"

	I1117 16:21:48.248672   33790 node_ready.go:53] error getting node "functional-20211117161858-31976": an error on the server ("") has prevented the request from succeeding (get nodes functional-20211117161858-31976)

	I1117 16:21:48.248680   33790 node_ready.go:38] duration metric: took 12.55354997s waiting for node "functional-20211117161858-31976" to be "Ready" ...

	I1117 16:21:48.274481   33790 out.go:176] 

	W1117 16:21:48.274560   33790 out.go:241] X Exiting due to GUEST_START: wait 6m0s for node: waiting for node to be ready: waitNodeCondition: error getting node "functional-20211117161858-31976": an error on the server ("") has prevented the request from succeeding (get nodes functional-20211117161858-31976)

	W1117 16:21:48.274567   33790 out.go:241] * 

	W1117 16:21:48.275136   33790 out.go:241] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	* 

	* ==> Docker <==

	* -- Logs begin at Thu 2021-11-18 00:19:19 UTC, end at Thu 2021-11-18 00:22:03 UTC. --

	Nov 18 00:19:46 functional-20211117161858-31976 dockerd[468]: time="2021-11-18T00:19:46.215832592Z" level=info msg="Daemon has completed initialization"

	Nov 18 00:19:46 functional-20211117161858-31976 systemd[1]: Started Docker Application Container Engine.

	Nov 18 00:19:46 functional-20211117161858-31976 dockerd[468]: time="2021-11-18T00:19:46.238854763Z" level=info msg="API listen on [::]:2376"

	Nov 18 00:19:46 functional-20211117161858-31976 dockerd[468]: time="2021-11-18T00:19:46.241903110Z" level=info msg="API listen on /var/run/docker.sock"

	Nov 18 00:20:31 functional-20211117161858-31976 dockerd[468]: time="2021-11-18T00:20:31.951567126Z" level=info msg="ignoring event" container=297f7a37e8bd7e92a66de64cccc099099267fca4f04ebdb80560c3fcd6134577 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Nov 18 00:20:31 functional-20211117161858-31976 dockerd[468]: time="2021-11-18T00:20:31.995327419Z" level=info msg="ignoring event" container=1a443d1f744d39173e81d045ed1ce442d19760861b9b4307dc4c605d2085949d module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Nov 18 00:20:52 functional-20211117161858-31976 dockerd[468]: time="2021-11-18T00:20:52.253052227Z" level=info msg="ignoring event" container=d0d3e0dca5e9300eb2fb46ca47b9bcb6ec63a0aad06b59cb5d507a3a4e10680c module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Nov 18 00:21:27 functional-20211117161858-31976 dockerd[468]: time="2021-11-18T00:21:27.295680499Z" level=info msg="ignoring event" container=41b6ab69a384cb2e2ddb1f58cec2f1e85d3f1eb993943f1b6072c82a98fd06b0 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Nov 18 00:21:27 functional-20211117161858-31976 dockerd[468]: time="2021-11-18T00:21:27.304131363Z" level=info msg="ignoring event" container=e4efee81ca4695061c2b6dbf156d12f268077143c8eb277bd7100d8ef2b2c746 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Nov 18 00:21:27 functional-20211117161858-31976 dockerd[468]: time="2021-11-18T00:21:27.317333478Z" level=info msg="ignoring event" container=acade1ad68d757b68fa1e074e64d4bcad38eb847718506af25d18d956f2802ee module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Nov 18 00:21:27 functional-20211117161858-31976 dockerd[468]: time="2021-11-18T00:21:27.317377663Z" level=info msg="ignoring event" container=7d514020b6b739c237d0dfbeed599f8d20fe29b82c0c692c1fd395c603db5d4e module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Nov 18 00:21:27 functional-20211117161858-31976 dockerd[468]: time="2021-11-18T00:21:27.318184856Z" level=info msg="ignoring event" container=9bad689182deb3a3a60cf2e56ad1100208a956315916a74e9011474dce7d993e module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Nov 18 00:21:27 functional-20211117161858-31976 dockerd[468]: time="2021-11-18T00:21:27.328384627Z" level=info msg="ignoring event" container=72ff4c2179fba02d43ccc433933719e2c2c383ce806bfdeb133a5c8c986a42f6 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Nov 18 00:21:27 functional-20211117161858-31976 dockerd[468]: time="2021-11-18T00:21:27.400303630Z" level=info msg="ignoring event" container=ea850ca3cc61f91a1d9499307e0c2772fec37eaae99f198afab1abd75c47845b module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Nov 18 00:21:27 functional-20211117161858-31976 dockerd[468]: time="2021-11-18T00:21:27.401539547Z" level=info msg="ignoring event" container=c595f5f22c8069dac10251914290d0bd3bffa5e83e842b2b2e5d28f8490bb26f module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Nov 18 00:21:27 functional-20211117161858-31976 dockerd[468]: time="2021-11-18T00:21:27.404561545Z" level=info msg="ignoring event" container=26ff204bef53fc0dd18974e371dadc54ca7dcdf9d710d3665b61c303bddcee0e module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Nov 18 00:21:27 functional-20211117161858-31976 dockerd[468]: time="2021-11-18T00:21:27.421254142Z" level=info msg="ignoring event" container=e30cdc66639da264af9585cfacae2cd0521fceedefac10b6fcfb5737ba3a87c3 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Nov 18 00:21:27 functional-20211117161858-31976 dockerd[468]: time="2021-11-18T00:21:27.430842555Z" level=info msg="ignoring event" container=57f34cc17d7a6aae9f8632a13b459232478f514fe0f9238e9f12307474be2aeb module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Nov 18 00:21:28 functional-20211117161858-31976 dockerd[468]: time="2021-11-18T00:21:28.107342437Z" level=info msg="ignoring event" container=5c6c4dc475e0660b8b2222acba60032c7e49bb624a8c38a53e34b1ebba19402e module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Nov 18 00:21:28 functional-20211117161858-31976 dockerd[468]: time="2021-11-18T00:21:28.118865919Z" level=info msg="ignoring event" container=9b2f0c8b2294b600fc96d434db4d07350341a1416663656abaf0eabe13f7007c module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Nov 18 00:21:32 functional-20211117161858-31976 dockerd[468]: time="2021-11-18T00:21:32.227573401Z" level=info msg="ignoring event" container=0e35560df59bfc3e72f16462d40b50c0480ce4e80d80028a8c867f8f9cf914ed module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Nov 18 00:21:36 functional-20211117161858-31976 dockerd[468]: time="2021-11-18T00:21:36.535503755Z" level=info msg="ignoring event" container=2ff1bb3b6c9371822d485e55a78074e668fc4461c35828f4d9ea383e3af000a6 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Nov 18 00:21:37 functional-20211117161858-31976 dockerd[468]: time="2021-11-18T00:21:37.813734943Z" level=info msg="ignoring event" container=e180853e419038951cae72f6dcf958ed9e63196aeb434f87f93d71eb7f7bd335 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Nov 18 00:21:37 functional-20211117161858-31976 dockerd[468]: time="2021-11-18T00:21:37.885685250Z" level=info msg="ignoring event" container=2e79e79749173295007690797003e6e7aadbc13edb87be79e18ab291e2222c62 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Nov 18 00:21:37 functional-20211117161858-31976 dockerd[468]: time="2021-11-18T00:21:37.910686858Z" level=info msg="ignoring event" container=622e4ca9307f2db3d4eff6dbe6895f584fdeac51698c6b276894bf22bcc4af05 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	* 

	* ==> container status <==

	* CONTAINER           IMAGE               CREATED              STATE               NAME                      ATTEMPT             POD ID

	28d32fce294d7       53224b502ea4d       6 seconds ago        Running             kube-apiserver            2                   f8f1e147723bf

	e180853e41903       53224b502ea4d       26 seconds ago       Exited              kube-apiserver            1                   f8f1e147723bf

	fbf9821ffb084       8d147537fb7d1       26 seconds ago       Running             coredns                   1                   47dbcdbbcbb52

	422236a5e675b       6e38f40d628db       27 seconds ago       Running             storage-provisioner       2                   250d98e52e33e

	250907264d348       0aa9c7e31d307       35 seconds ago       Running             kube-scheduler            1                   6e098b42d6ec1

	e34b718143e14       05c905cef780c       35 seconds ago       Running             kube-controller-manager   1                   8d617fb091a41

	4a9c75d87f40b       0048118155842       35 seconds ago       Running             etcd                      1                   dbf91b2d10759

	dec4850aecf1d       6120bd723dced       35 seconds ago       Running             kube-proxy                1                   1357ef914aa3f

	ea850ca3cc61f       6e38f40d628db       About a minute ago   Exited              storage-provisioner       1                   41b6ab69a384c

	0e35560df59bf       8d147537fb7d1       About a minute ago   Exited              coredns                   0                   7d514020b6b73

	e4efee81ca469       6120bd723dced       About a minute ago   Exited              kube-proxy                0                   26ff204bef53f

	9b2f0c8b2294b       0aa9c7e31d307       2 minutes ago        Exited              kube-scheduler            0                   9bad689182deb

	57f34cc17d7a6       05c905cef780c       2 minutes ago        Exited              kube-controller-manager   0                   72ff4c2179fba

	acade1ad68d75       0048118155842       2 minutes ago        Exited              etcd                      0                   c595f5f22c806

	* 

	* ==> coredns [0e35560df59b] <==

	* [INFO] plugin/ready: Still waiting on: "kubernetes"

	[INFO] plugin/ready: Still waiting on: "kubernetes"

	[WARNING] plugin/kubernetes: starting server with unsynced Kubernetes API

	.:53

	[INFO] plugin/reload: Running configuration MD5 = db32ca3650231d74073ff4cf814959a7

	CoreDNS-1.8.4

	linux/amd64, go1.16.4, 053c4d5

	[INFO] plugin/ready: Still waiting on: "kubernetes"

	[INFO] plugin/ready: Still waiting on: "kubernetes"

	[INFO] plugin/ready: Still waiting on: "kubernetes"

	[INFO] Reloading

	[INFO] plugin/health: Going into lameduck mode for 5s

	[INFO] plugin/reload: Running configuration MD5 = c23ed519c17e71ee396ed052e6209e94

	[INFO] Reloading complete

	[INFO] SIGTERM: Shutting down servers then terminating

	[INFO] plugin/health: Going into lameduck mode for 5s

	* 

	* ==> coredns [fbf9821ffb08] <==

	* .:53

	[INFO] plugin/reload: Running configuration MD5 = c23ed519c17e71ee396ed052e6209e94

	CoreDNS-1.8.4

	linux/amd64, go1.16.4, 053c4d5

	W1118 00:21:37.886846       1 reflector.go:436] pkg/mod/k8s.io/client-go@v0.21.1/tools/cache/reflector.go:167: watch of *v1.EndpointSlice ended with: very short watch: pkg/mod/k8s.io/client-go@v0.21.1/tools/cache/reflector.go:167: Unexpected watch close - watch lasted less than a second and no items received

	W1118 00:21:37.886923       1 reflector.go:436] pkg/mod/k8s.io/client-go@v0.21.1/tools/cache/reflector.go:167: watch of *v1.Service ended with: very short watch: pkg/mod/k8s.io/client-go@v0.21.1/tools/cache/reflector.go:167: Unexpected watch close - watch lasted less than a second and no items received

	W1118 00:21:37.886940       1 reflector.go:436] pkg/mod/k8s.io/client-go@v0.21.1/tools/cache/reflector.go:167: watch of *v1.Namespace ended with: very short watch: pkg/mod/k8s.io/client-go@v0.21.1/tools/cache/reflector.go:167: Unexpected watch close - watch lasted less than a second and no items received

	E1118 00:21:38.740403       1 reflector.go:138] pkg/mod/k8s.io/client-go@v0.21.1/tools/cache/reflector.go:167: Failed to watch *v1.Namespace: failed to list *v1.Namespace: Get "https://10.96.0.1:443/api/v1/namespaces?resourceVersion=525": dial tcp 10.96.0.1:443: connect: connection refused

	E1118 00:21:39.028112       1 reflector.go:138] pkg/mod/k8s.io/client-go@v0.21.1/tools/cache/reflector.go:167: Failed to watch *v1.EndpointSlice: failed to list *v1.EndpointSlice: Get "https://10.96.0.1:443/apis/discovery.k8s.io/v1/endpointslices?resourceVersion=525": dial tcp 10.96.0.1:443: connect: connection refused

	E1118 00:21:39.237619       1 reflector.go:138] pkg/mod/k8s.io/client-go@v0.21.1/tools/cache/reflector.go:167: Failed to watch *v1.Service: failed to list *v1.Service: Get "https://10.96.0.1:443/api/v1/services?resourceVersion=525": dial tcp 10.96.0.1:443: connect: connection refused

	E1118 00:21:40.592244       1 reflector.go:138] pkg/mod/k8s.io/client-go@v0.21.1/tools/cache/reflector.go:167: Failed to watch *v1.Namespace: failed to list *v1.Namespace: Get "https://10.96.0.1:443/api/v1/namespaces?resourceVersion=525": dial tcp 10.96.0.1:443: connect: connection refused

	E1118 00:21:40.783828       1 reflector.go:138] pkg/mod/k8s.io/client-go@v0.21.1/tools/cache/reflector.go:167: Failed to watch *v1.EndpointSlice: failed to list *v1.EndpointSlice: Get "https://10.96.0.1:443/apis/discovery.k8s.io/v1/endpointslices?resourceVersion=525": dial tcp 10.96.0.1:443: connect: connection refused

	E1118 00:21:41.320049       1 reflector.go:138] pkg/mod/k8s.io/client-go@v0.21.1/tools/cache/reflector.go:167: Failed to watch *v1.Service: failed to list *v1.Service: Get "https://10.96.0.1:443/api/v1/services?resourceVersion=525": dial tcp 10.96.0.1:443: connect: connection refused

	E1118 00:21:45.185752       1 reflector.go:138] pkg/mod/k8s.io/client-go@v0.21.1/tools/cache/reflector.go:167: Failed to watch *v1.Service: failed to list *v1.Service: Get "https://10.96.0.1:443/api/v1/services?resourceVersion=525": dial tcp 10.96.0.1:443: connect: connection refused

	E1118 00:21:45.421249       1 reflector.go:138] pkg/mod/k8s.io/client-go@v0.21.1/tools/cache/reflector.go:167: Failed to watch *v1.Namespace: failed to list *v1.Namespace: Get "https://10.96.0.1:443/api/v1/namespaces?resourceVersion=525": dial tcp 10.96.0.1:443: connect: connection refused

	E1118 00:21:46.568514       1 reflector.go:138] pkg/mod/k8s.io/client-go@v0.21.1/tools/cache/reflector.go:167: Failed to watch *v1.EndpointSlice: failed to list *v1.EndpointSlice: Get "https://10.96.0.1:443/apis/discovery.k8s.io/v1/endpointslices?resourceVersion=525": dial tcp 10.96.0.1:443: connect: connection refused

	E1118 00:21:53.858305       1 reflector.go:138] pkg/mod/k8s.io/client-go@v0.21.1/tools/cache/reflector.go:167: Failed to watch *v1.Namespace: failed to list *v1.Namespace: Get "https://10.96.0.1:443/api/v1/namespaces?resourceVersion=525": dial tcp 10.96.0.1:443: connect: connection refused

	E1118 00:21:54.022869       1 reflector.go:138] pkg/mod/k8s.io/client-go@v0.21.1/tools/cache/reflector.go:167: Failed to watch *v1.Service: failed to list *v1.Service: Get "https://10.96.0.1:443/api/v1/services?resourceVersion=525": dial tcp 10.96.0.1:443: connect: connection refused

	E1118 00:21:55.979621       1 reflector.go:138] pkg/mod/k8s.io/client-go@v0.21.1/tools/cache/reflector.go:167: Failed to watch *v1.EndpointSlice: failed to list *v1.EndpointSlice: Get "https://10.96.0.1:443/apis/discovery.k8s.io/v1/endpointslices?resourceVersion=525": dial tcp 10.96.0.1:443: connect: connection refused

	* 

	* ==> describe nodes <==

	* Name:               functional-20211117161858-31976

	Roles:              control-plane,master

	Labels:             beta.kubernetes.io/arch=amd64

	                    beta.kubernetes.io/os=linux

	                    kubernetes.io/arch=amd64

	                    kubernetes.io/hostname=functional-20211117161858-31976

	                    kubernetes.io/os=linux

	                    minikube.k8s.io/commit=b7b0a42f687dae576880a10f0aa2f899d9174438

	                    minikube.k8s.io/name=functional-20211117161858-31976

	                    minikube.k8s.io/updated_at=2021_11_17T16_20_07_0700

	                    minikube.k8s.io/version=v1.24.0

	                    node-role.kubernetes.io/control-plane=

	                    node-role.kubernetes.io/master=

	                    node.kubernetes.io/exclude-from-external-load-balancers=

	Annotations:        kubeadm.alpha.kubernetes.io/cri-socket: /var/run/dockershim.sock

	                    node.alpha.kubernetes.io/ttl: 0

	                    volumes.kubernetes.io/controller-managed-attach-detach: true

	CreationTimestamp:  Thu, 18 Nov 2021 00:20:06 +0000

	Taints:             <none>

	Unschedulable:      false

	Lease:

	  HolderIdentity:  functional-20211117161858-31976

	  AcquireTime:     <unset>

	  RenewTime:       Thu, 18 Nov 2021 00:21:34 +0000

	Conditions:

	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message

	  ----             ------  -----------------                 ------------------                ------                       -------

	  MemoryPressure   False   Thu, 18 Nov 2021 00:21:34 +0000   Thu, 18 Nov 2021 00:20:05 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available

	  DiskPressure     False   Thu, 18 Nov 2021 00:21:34 +0000   Thu, 18 Nov 2021 00:20:05 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure

	  PIDPressure      False   Thu, 18 Nov 2021 00:21:34 +0000   Thu, 18 Nov 2021 00:20:05 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available

	  Ready            False   Thu, 18 Nov 2021 00:21:34 +0000   Thu, 18 Nov 2021 00:21:34 +0000   KubeletNotReady              PLEG is not healthy: pleg has yet to be successful

	Addresses:

	  InternalIP:  192.168.49.2

	  Hostname:    functional-20211117161858-31976

	Capacity:

	  cpu:                6

	  ephemeral-storage:  123591232Ki

	  hugepages-1Gi:      0

	  hugepages-2Mi:      0

	  memory:             6088600Ki

	  pods:               110

	Allocatable:

	  cpu:                6

	  ephemeral-storage:  123591232Ki

	  hugepages-1Gi:      0

	  hugepages-2Mi:      0

	  memory:             6088600Ki

	  pods:               110

	System Info:

	  Machine ID:                 bba0be70c47c400ea3cf7733f1c0b4c1

	  System UUID:                e68caa8e-8163-46fe-ae02-a5e7cce38646

	  Boot ID:                    2574929b-a85a-4f3c-934f-b3f13d66b47f

	  Kernel Version:             5.10.25-linuxkit

	  OS Image:                   Ubuntu 20.04.2 LTS

	  Operating System:           linux

	  Architecture:               amd64

	  Container Runtime Version:  docker://20.10.8

	  Kubelet Version:            v1.22.3

	  Kube-Proxy Version:         v1.22.3

	PodCIDR:                      10.244.0.0/24

	PodCIDRs:                     10.244.0.0/24

	Non-terminated Pods:          (7 in total)

	  Namespace                   Name                                                       CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age

	  ---------                   ----                                                       ------------  ----------  ---------------  -------------  ---

	  kube-system                 coredns-78fcd69978-dnq6x                                   100m (1%!)(MISSING)     0 (0%!)(MISSING)      70Mi (1%!)(MISSING)        170Mi (2%!)(MISSING)     104s

	  kube-system                 etcd-functional-20211117161858-31976                       100m (1%!)(MISSING)     0 (0%!)(MISSING)      100Mi (1%!)(MISSING)       0 (0%!)(MISSING)         112s

	  kube-system                 kube-apiserver-functional-20211117161858-31976             250m (4%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         26s

	  kube-system                 kube-controller-manager-functional-20211117161858-31976    200m (3%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         112s

	  kube-system                 kube-proxy-wbv29                                           0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         104s

	  kube-system                 kube-scheduler-functional-20211117161858-31976             100m (1%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         112s

	  kube-system                 storage-provisioner                                        0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         102s

	Allocated resources:

	  (Total limits may be over 100 percent, i.e., overcommitted.)

	  Resource           Requests    Limits

	  --------           --------    ------

	  cpu                750m (12%!)(MISSING)  0 (0%!)(MISSING)

	  memory             170Mi (2%!)(MISSING)  170Mi (2%!)(MISSING)

	  ephemeral-storage  0 (0%!)(MISSING)      0 (0%!)(MISSING)

	  hugepages-1Gi      0 (0%!)(MISSING)      0 (0%!)(MISSING)

	  hugepages-2Mi      0 (0%!)(MISSING)      0 (0%!)(MISSING)

	Events:

	  Type    Reason                   Age                   From        Message

	  ----    ------                   ----                  ----        -------

	  Normal  Starting                 29s                   kube-proxy  

	  Normal  Starting                 99s                   kube-proxy  

	  Normal  NodeHasNoDiskPressure    2m9s (x5 over 2m10s)  kubelet     Node functional-20211117161858-31976 status is now: NodeHasNoDiskPressure

	  Normal  NodeHasSufficientPID     2m9s (x5 over 2m10s)  kubelet     Node functional-20211117161858-31976 status is now: NodeHasSufficientPID

	  Normal  NodeHasSufficientMemory  2m7s (x6 over 2m10s)  kubelet     Node functional-20211117161858-31976 status is now: NodeHasSufficientMemory

	  Normal  NodeHasSufficientMemory  116s                  kubelet     Node functional-20211117161858-31976 status is now: NodeHasSufficientMemory

	  Normal  NodeHasNoDiskPressure    116s                  kubelet     Node functional-20211117161858-31976 status is now: NodeHasNoDiskPressure

	  Normal  NodeHasSufficientPID     116s                  kubelet     Node functional-20211117161858-31976 status is now: NodeHasSufficientPID

	  Normal  NodeAllocatableEnforced  116s                  kubelet     Updated Node Allocatable limit across pods

	  Normal  Starting                 116s                  kubelet     Starting kubelet.

	  Normal  NodeReady                106s                  kubelet     Node functional-20211117161858-31976 status is now: NodeReady

	  Normal  NodeHasSufficientMemory  29s                   kubelet     Node functional-20211117161858-31976 status is now: NodeHasSufficientMemory

	  Normal  NodeHasNoDiskPressure    29s                   kubelet     Node functional-20211117161858-31976 status is now: NodeHasNoDiskPressure

	  Normal  NodeHasSufficientPID     29s                   kubelet     Node functional-20211117161858-31976 status is now: NodeHasSufficientPID

	  Normal  Starting                 29s                   kubelet     Starting kubelet.

	  Normal  NodeNotReady             29s                   kubelet     Node functional-20211117161858-31976 status is now: NodeNotReady

	  Normal  NodeAllocatableEnforced  29s                   kubelet     Updated Node Allocatable limit across pods

	* 

	* ==> dmesg <==

	* [  +0.028934] bpfilter: read fail 0

	[  +0.025120] bpfilter: read fail 0

	[  +0.028036] bpfilter: read fail 0

	[  +0.030521] bpfilter: read fail 0

	[  +0.025914] bpfilter: read fail 0

	[  +0.037066] bpfilter: read fail 0

	[  +0.044538] bpfilter: read fail 0

	[  +0.023912] bpfilter: read fail 0

	[  +0.034062] bpfilter: read fail 0

	[  +0.033394] bpfilter: read fail 0

	[  +0.034824] bpfilter: write fail -32

	[  +0.028619] bpfilter: write fail -32

	[  +0.026012] bpfilter: read fail 0

	[  +0.034679] bpfilter: write fail -32

	[  +0.033542] bpfilter: read fail 0

	[  +0.030549] bpfilter: write fail -32

	[  +0.030916] bpfilter: read fail 0

	[  +0.024932] bpfilter: read fail 0

	[  +0.030508] bpfilter: read fail 0

	[  +0.042210] bpfilter: read fail 0

	[  +0.025433] bpfilter: read fail 0

	[  +0.037375] bpfilter: write fail -32

	[  +0.033166] bpfilter: write fail -32

	[  +0.041518] bpfilter: read fail 0

	[  +0.031775] bpfilter: write fail -32

	* 

	* ==> etcd [4a9c75d87f40] <==

	* {"level":"info","ts":"2021-11-18T00:21:28.819Z","caller":"etcdserver/quota.go:94","msg":"enabled backend quota with default value","quota-name":"v3-applier","quota-size-bytes":2147483648,"quota-size":"2.1 GB"}

	{"level":"info","ts":"2021-11-18T00:21:28.819Z","caller":"etcdserver/server.go:834","msg":"starting etcd server","local-member-id":"aec36adc501070cc","local-server-version":"3.5.0","cluster-id":"fa54960ea34d58be","cluster-version":"3.5"}

	{"level":"info","ts":"2021-11-18T00:21:28.820Z","caller":"etcdserver/server.go:728","msg":"started as single-node; fast-forwarding election ticks","local-member-id":"aec36adc501070cc","forward-ticks":9,"forward-duration":"900ms","election-ticks":10,"election-timeout":"1s"}

	{"level":"info","ts":"2021-11-18T00:21:28.820Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc switched to configuration voters=(12593026477526642892)"}

	{"level":"info","ts":"2021-11-18T00:21:28.820Z","caller":"membership/cluster.go:393","msg":"added member","cluster-id":"fa54960ea34d58be","local-member-id":"aec36adc501070cc","added-peer-id":"aec36adc501070cc","added-peer-peer-urls":["https://192.168.49.2:2380"]}

	{"level":"info","ts":"2021-11-18T00:21:28.820Z","caller":"membership/cluster.go:523","msg":"updated cluster version","cluster-id":"fa54960ea34d58be","local-member-id":"aec36adc501070cc","from":"3.5","to":"3.5"}

	{"level":"info","ts":"2021-11-18T00:21:28.821Z","caller":"embed/etcd.go:687","msg":"starting with client TLS","tls-info":"cert = /var/lib/minikube/certs/etcd/server.crt, key = /var/lib/minikube/certs/etcd/server.key, client-cert=, client-key=, trusted-ca = /var/lib/minikube/certs/etcd/ca.crt, client-cert-auth = true, crl-file = ","cipher-suites":[]}

	{"level":"info","ts":"2021-11-18T00:21:28.822Z","caller":"embed/etcd.go:580","msg":"serving peer traffic","address":"192.168.49.2:2380"}

	{"level":"info","ts":"2021-11-18T00:21:28.822Z","caller":"embed/etcd.go:552","msg":"cmux::serve","address":"192.168.49.2:2380"}

	{"level":"info","ts":"2021-11-18T00:21:28.822Z","caller":"embed/etcd.go:276","msg":"now serving peer/client/metrics","local-member-id":"aec36adc501070cc","initial-advertise-peer-urls":["https://192.168.49.2:2380"],"listen-peer-urls":["https://192.168.49.2:2380"],"advertise-client-urls":["https://192.168.49.2:2379"],"listen-client-urls":["https://127.0.0.1:2379","https://192.168.49.2:2379"],"listen-metrics-urls":["http://127.0.0.1:2381"]}

	{"level":"info","ts":"2021-11-18T00:21:28.822Z","caller":"embed/etcd.go:762","msg":"serving metrics","address":"http://127.0.0.1:2381"}

	{"level":"info","ts":"2021-11-18T00:21:29.212Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc is starting a new election at term 2"}

	{"level":"info","ts":"2021-11-18T00:21:29.212Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc became pre-candidate at term 2"}

	{"level":"info","ts":"2021-11-18T00:21:29.212Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc received MsgPreVoteResp from aec36adc501070cc at term 2"}

	{"level":"info","ts":"2021-11-18T00:21:29.212Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc became candidate at term 3"}

	{"level":"info","ts":"2021-11-18T00:21:29.212Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc received MsgVoteResp from aec36adc501070cc at term 3"}

	{"level":"info","ts":"2021-11-18T00:21:29.212Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc became leader at term 3"}

	{"level":"info","ts":"2021-11-18T00:21:29.212Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"raft.node: aec36adc501070cc elected leader aec36adc501070cc at term 3"}

	{"level":"info","ts":"2021-11-18T00:21:29.213Z","caller":"etcdserver/server.go:2027","msg":"published local member to cluster through raft","local-member-id":"aec36adc501070cc","local-member-attributes":"{Name:functional-20211117161858-31976 ClientURLs:[https://192.168.49.2:2379]}","request-path":"/0/members/aec36adc501070cc/attributes","cluster-id":"fa54960ea34d58be","publish-timeout":"7s"}

	{"level":"info","ts":"2021-11-18T00:21:29.213Z","caller":"embed/serve.go:98","msg":"ready to serve client requests"}

	{"level":"info","ts":"2021-11-18T00:21:29.214Z","caller":"embed/serve.go:98","msg":"ready to serve client requests"}

	{"level":"info","ts":"2021-11-18T00:21:29.215Z","caller":"embed/serve.go:188","msg":"serving client traffic securely","address":"192.168.49.2:2379"}

	{"level":"info","ts":"2021-11-18T00:21:29.215Z","caller":"etcdmain/main.go:47","msg":"notifying init daemon"}

	{"level":"info","ts":"2021-11-18T00:21:29.215Z","caller":"etcdmain/main.go:53","msg":"successfully notified init daemon"}

	{"level":"info","ts":"2021-11-18T00:21:29.226Z","caller":"embed/serve.go:188","msg":"serving client traffic securely","address":"127.0.0.1:2379"}

	* 

	* ==> etcd [acade1ad68d7] <==

	* {"level":"info","ts":"2021-11-18T00:20:01.466Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc became pre-candidate at term 1"}

	{"level":"info","ts":"2021-11-18T00:20:01.466Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc received MsgPreVoteResp from aec36adc501070cc at term 1"}

	{"level":"info","ts":"2021-11-18T00:20:01.466Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc became candidate at term 2"}

	{"level":"info","ts":"2021-11-18T00:20:01.467Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc received MsgVoteResp from aec36adc501070cc at term 2"}

	{"level":"info","ts":"2021-11-18T00:20:01.467Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc became leader at term 2"}

	{"level":"info","ts":"2021-11-18T00:20:01.467Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"raft.node: aec36adc501070cc elected leader aec36adc501070cc at term 2"}

	{"level":"info","ts":"2021-11-18T00:20:01.467Z","caller":"etcdserver/server.go:2476","msg":"setting up initial cluster version using v2 API","cluster-version":"3.5"}

	{"level":"info","ts":"2021-11-18T00:20:01.467Z","caller":"embed/serve.go:98","msg":"ready to serve client requests"}

	{"level":"info","ts":"2021-11-18T00:20:01.467Z","caller":"etcdserver/server.go:2027","msg":"published local member to cluster through raft","local-member-id":"aec36adc501070cc","local-member-attributes":"{Name:functional-20211117161858-31976 ClientURLs:[https://192.168.49.2:2379]}","request-path":"/0/members/aec36adc501070cc/attributes","cluster-id":"fa54960ea34d58be","publish-timeout":"7s"}

	{"level":"info","ts":"2021-11-18T00:20:01.467Z","caller":"embed/serve.go:98","msg":"ready to serve client requests"}

	{"level":"info","ts":"2021-11-18T00:20:01.468Z","caller":"etcdmain/main.go:47","msg":"notifying init daemon"}

	{"level":"info","ts":"2021-11-18T00:20:01.468Z","caller":"etcdmain/main.go:53","msg":"successfully notified init daemon"}

	{"level":"info","ts":"2021-11-18T00:20:01.468Z","caller":"embed/serve.go:188","msg":"serving client traffic securely","address":"192.168.49.2:2379"}

	{"level":"info","ts":"2021-11-18T00:20:01.469Z","caller":"embed/serve.go:188","msg":"serving client traffic securely","address":"127.0.0.1:2379"}

	{"level":"info","ts":"2021-11-18T00:20:01.475Z","caller":"membership/cluster.go:531","msg":"set initial cluster version","cluster-id":"fa54960ea34d58be","local-member-id":"aec36adc501070cc","cluster-version":"3.5"}

	{"level":"info","ts":"2021-11-18T00:20:01.475Z","caller":"api/capability.go:75","msg":"enabled capabilities for version","cluster-version":"3.5"}

	{"level":"info","ts":"2021-11-18T00:20:01.475Z","caller":"etcdserver/server.go:2500","msg":"cluster version is updated","cluster-version":"3.5"}

	{"level":"info","ts":"2021-11-18T00:21:27.125Z","caller":"osutil/interrupt_unix.go:64","msg":"received signal; shutting down","signal":"terminated"}

	{"level":"info","ts":"2021-11-18T00:21:27.125Z","caller":"embed/etcd.go:367","msg":"closing etcd server","name":"functional-20211117161858-31976","data-dir":"/var/lib/minikube/etcd","advertise-peer-urls":["https://192.168.49.2:2380"],"advertise-client-urls":["https://192.168.49.2:2379"]}

	WARNING: 2021/11/18 00:21:27 [core] grpc: addrConn.createTransport failed to connect to {127.0.0.1:2379 127.0.0.1:2379 <nil> 0 <nil>}. Err: connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...

	WARNING: 2021/11/18 00:21:27 [core] grpc: addrConn.createTransport failed to connect to {192.168.49.2:2379 192.168.49.2:2379 <nil> 0 <nil>}. Err: connection error: desc = "transport: Error while dialing dial tcp 192.168.49.2:2379: connect: connection refused". Reconnecting...

	{"level":"info","ts":"2021-11-18T00:21:27.135Z","caller":"etcdserver/server.go:1438","msg":"skipped leadership transfer for single voting member cluster","local-member-id":"aec36adc501070cc","current-leader-member-id":"aec36adc501070cc"}

	{"level":"info","ts":"2021-11-18T00:21:27.137Z","caller":"embed/etcd.go:562","msg":"stopping serving peer traffic","address":"192.168.49.2:2380"}

	{"level":"info","ts":"2021-11-18T00:21:27.138Z","caller":"embed/etcd.go:567","msg":"stopped serving peer traffic","address":"192.168.49.2:2380"}

	{"level":"info","ts":"2021-11-18T00:21:27.138Z","caller":"embed/etcd.go:369","msg":"closed etcd server","name":"functional-20211117161858-31976","data-dir":"/var/lib/minikube/etcd","advertise-peer-urls":["https://192.168.49.2:2380"],"advertise-client-urls":["https://192.168.49.2:2379"]}

	* 

	* ==> kernel <==

	*  00:22:03 up 11 min,  0 users,  load average: 2.19, 2.16, 1.33

	Linux functional-20211117161858-31976 5.10.25-linuxkit #1 SMP Tue Mar 23 09:27:39 UTC 2021 x86_64 x86_64 x86_64 GNU/Linux

	PRETTY_NAME="Ubuntu 20.04.2 LTS"

	* 

	* ==> kube-apiserver [28d32fce294d] <==

	* I1118 00:22:00.602142       1 shared_informer.go:240] Waiting for caches to sync for crd-autoregister

	I1118 00:22:00.602154       1 controller.go:85] Starting OpenAPI controller

	I1118 00:22:00.602163       1 naming_controller.go:291] Starting NamingConditionController

	I1118 00:22:00.602183       1 establishing_controller.go:76] Starting EstablishingController

	I1118 00:22:00.602191       1 nonstructuralschema_controller.go:192] Starting NonStructuralSchemaConditionController

	I1118 00:22:00.602203       1 apiapproval_controller.go:186] Starting KubernetesAPIApprovalPolicyConformantConditionController

	I1118 00:22:00.602234       1 crd_finalizer.go:266] Starting CRDFinalizer

	E1118 00:22:00.603790       1 controller.go:152] Unable to remove old endpoints from kubernetes service: StorageError: key not found, Code: 1, Key: /registry/masterleases/192.168.49.2, ResourceVersion: 0, AdditionalErrorMsg: 

	I1118 00:22:00.604582       1 available_controller.go:491] Starting AvailableConditionController

	I1118 00:22:00.604608       1 cache.go:32] Waiting for caches to sync for AvailableConditionController controller

	I1118 00:22:00.612908       1 dynamic_serving_content.go:129] "Starting controller" name="aggregator-proxy-cert::/var/lib/minikube/certs/front-proxy-client.crt::/var/lib/minikube/certs/front-proxy-client.key"

	I1118 00:22:00.612990       1 controller.go:83] Starting OpenAPI AggregationController

	I1118 00:22:00.613300       1 apf_controller.go:312] Starting API Priority and Fairness config controller

	I1118 00:22:00.700167       1 cache.go:39] Caches are synced for autoregister controller

	I1118 00:22:00.700536       1 shared_informer.go:247] Caches are synced for cluster_authentication_trust_controller 

	I1118 00:22:00.701355       1 cache.go:39] Caches are synced for APIServiceRegistrationController controller

	I1118 00:22:00.702165       1 shared_informer.go:247] Caches are synced for crd-autoregister 

	I1118 00:22:00.705052       1 cache.go:39] Caches are synced for AvailableConditionController controller

	I1118 00:22:00.713446       1 apf_controller.go:317] Running API Priority and Fairness config worker

	I1118 00:22:00.735901       1 shared_informer.go:247] Caches are synced for node_authorizer 

	I1118 00:22:01.600071       1 controller.go:132] OpenAPI AggregationController: action for item : Nothing (removed from the queue).

	I1118 00:22:01.600140       1 controller.go:132] OpenAPI AggregationController: action for item k8s_internal_local_delegation_chain_0000000000: Nothing (removed from the queue).

	I1118 00:22:01.604087       1 storage_scheduling.go:148] all system priority classes are created successfully or already exist.

	I1118 00:22:03.066739       1 controller.go:611] quota admission added evaluator for: endpoints

	I1118 00:22:03.882455       1 controller.go:611] quota admission added evaluator for: leases.coordination.k8s.io

	* 

	* ==> kube-apiserver [e180853e4190] <==

	* I1118 00:21:37.794054       1 server.go:553] external host was not specified, using 192.168.49.2

	I1118 00:21:37.794682       1 server.go:161] Version: v1.22.3

	Error: failed to create listener: failed to listen on 0.0.0.0:8441: listen tcp 0.0.0.0:8441: bind: address already in use

	* 

	* ==> kube-controller-manager [57f34cc17d7a] <==

	* I1118 00:20:19.861174       1 event.go:291] "Event occurred" object="kube-system/coredns" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled up replica set coredns-78fcd69978 to 2"

	I1118 00:20:19.864808       1 shared_informer.go:247] Caches are synced for node 

	I1118 00:20:19.864840       1 range_allocator.go:172] Starting range CIDR allocator

	I1118 00:20:19.864843       1 shared_informer.go:240] Waiting for caches to sync for cidrallocator

	I1118 00:20:19.864848       1 shared_informer.go:247] Caches are synced for cidrallocator 

	I1118 00:20:19.868661       1 event.go:291] "Event occurred" object="kube-system/kube-proxy" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: kube-proxy-wbv29"

	I1118 00:20:19.873974       1 range_allocator.go:373] Set node functional-20211117161858-31976 PodCIDR to [10.244.0.0/24]

	I1118 00:20:19.885673       1 event.go:291] "Event occurred" object="kube-system/coredns-78fcd69978" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: coredns-78fcd69978-dnq6x"

	I1118 00:20:19.936687       1 shared_informer.go:247] Caches are synced for ReplicationController 

	I1118 00:20:19.938663       1 event.go:291] "Event occurred" object="kube-system/coredns-78fcd69978" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: coredns-78fcd69978-hk5kk"

	I1118 00:20:20.000246       1 shared_informer.go:247] Caches are synced for disruption 

	I1118 00:20:20.038779       1 disruption.go:371] Sending events to api server.

	I1118 00:20:20.051192       1 shared_informer.go:247] Caches are synced for expand 

	I1118 00:20:20.051310       1 shared_informer.go:247] Caches are synced for PVC protection 

	I1118 00:20:20.051344       1 shared_informer.go:247] Caches are synced for persistent volume 

	I1118 00:20:20.056678       1 shared_informer.go:247] Caches are synced for attach detach 

	I1118 00:20:20.071851       1 shared_informer.go:247] Caches are synced for resource quota 

	I1118 00:20:20.071858       1 shared_informer.go:247] Caches are synced for ephemeral 

	I1118 00:20:20.076620       1 event.go:291] "Event occurred" object="kube-system/coredns" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled down replica set coredns-78fcd69978 to 1"

	I1118 00:20:20.078475       1 shared_informer.go:247] Caches are synced for resource quota 

	I1118 00:20:20.080869       1 event.go:291] "Event occurred" object="kube-system/coredns-78fcd69978" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulDelete" message="Deleted pod: coredns-78fcd69978-hk5kk"

	I1118 00:20:20.102042       1 shared_informer.go:247] Caches are synced for stateful set 

	I1118 00:20:20.488636       1 shared_informer.go:247] Caches are synced for garbage collector 

	I1118 00:20:20.493195       1 shared_informer.go:247] Caches are synced for garbage collector 

	I1118 00:20:20.493249       1 garbagecollector.go:151] Garbage collector: all resource monitors have synced. Proceeding to collect garbage

	* 

	* ==> kube-controller-manager [e34b718143e1] <==

	* I1118 00:22:04.244405       1 certificate_controller.go:118] Starting certificate controller "csrsigning-legacy-unknown"

	I1118 00:22:04.244410       1 shared_informer.go:240] Waiting for caches to sync for certificate-csrsigning-legacy-unknown

	I1118 00:22:04.244422       1 dynamic_serving_content.go:129] "Starting controller" name="csr-controller::/var/lib/minikube/certs/ca.crt::/var/lib/minikube/certs/ca.key"

	I1118 00:22:04.244728       1 shared_informer.go:240] Waiting for caches to sync for resource quota

	W1118 00:22:04.255994       1 actual_state_of_world.go:534] Failed to update statusUpdateNeeded field in actual state of world: Failed to set statusUpdateNeeded to needed true, because nodeName="functional-20211117161858-31976" does not exist

	I1118 00:22:04.276276       1 shared_informer.go:240] Waiting for caches to sync for garbage collector

	I1118 00:22:04.282445       1 shared_informer.go:247] Caches are synced for certificate-csrapproving 

	I1118 00:22:04.284819       1 shared_informer.go:247] Caches are synced for PV protection 

	I1118 00:22:04.290591       1 shared_informer.go:247] Caches are synced for expand 

	I1118 00:22:04.298317       1 shared_informer.go:247] Caches are synced for TTL 

	I1118 00:22:04.300567       1 shared_informer.go:247] Caches are synced for bootstrap_signer 

	I1118 00:22:04.313914       1 shared_informer.go:247] Caches are synced for cronjob 

	I1118 00:22:04.318888       1 shared_informer.go:247] Caches are synced for node 

	I1118 00:22:04.318933       1 range_allocator.go:172] Starting range CIDR allocator

	I1118 00:22:04.318939       1 shared_informer.go:240] Waiting for caches to sync for cidrallocator

	I1118 00:22:04.318945       1 shared_informer.go:247] Caches are synced for cidrallocator 

	I1118 00:22:04.322913       1 shared_informer.go:247] Caches are synced for endpoint_slice_mirroring 

	I1118 00:22:04.323050       1 shared_informer.go:247] Caches are synced for TTL after finished 

	I1118 00:22:04.332691       1 shared_informer.go:247] Caches are synced for namespace 

	I1118 00:22:04.333939       1 shared_informer.go:247] Caches are synced for crt configmap 

	I1118 00:22:04.338528       1 shared_informer.go:247] Caches are synced for service account 

	I1118 00:22:04.344468       1 shared_informer.go:247] Caches are synced for certificate-csrsigning-kubelet-serving 

	I1118 00:22:04.344502       1 shared_informer.go:247] Caches are synced for certificate-csrsigning-legacy-unknown 

	I1118 00:22:04.344518       1 shared_informer.go:247] Caches are synced for certificate-csrsigning-kubelet-client 

	I1118 00:22:04.344526       1 shared_informer.go:247] Caches are synced for certificate-csrsigning-kube-apiserver-client 

	* 

	* ==> kube-proxy [dec4850aecf1] <==

	* E1118 00:21:28.731178       1 node.go:161] Failed to retrieve node info: Get "https://control-plane.minikube.internal:8441/api/v1/nodes/functional-20211117161858-31976": dial tcp 192.168.49.2:8441: connect: connection refused

	I1118 00:21:32.008634       1 node.go:172] Successfully retrieved node IP: 192.168.49.2

	I1118 00:21:32.008670       1 server_others.go:140] Detected node IP 192.168.49.2

	W1118 00:21:32.008696       1 server_others.go:565] Unknown proxy mode "", assuming iptables proxy

	I1118 00:21:34.319819       1 server_others.go:206] kube-proxy running in dual-stack mode, IPv4-primary

	I1118 00:21:34.319893       1 server_others.go:212] Using iptables Proxier.

	I1118 00:21:34.319919       1 server_others.go:219] creating dualStackProxier for iptables.

	W1118 00:21:34.319928       1 server_others.go:495] detect-local-mode set to ClusterCIDR, but no IPv6 cluster CIDR defined, , defaulting to no-op detect-local for IPv6

	I1118 00:21:34.321812       1 server.go:649] Version: v1.22.3

	I1118 00:21:34.323441       1 config.go:315] Starting service config controller

	I1118 00:21:34.323468       1 shared_informer.go:240] Waiting for caches to sync for service config

	I1118 00:21:34.323734       1 config.go:224] Starting endpoint slice config controller

	I1118 00:21:34.323740       1 shared_informer.go:240] Waiting for caches to sync for endpoint slice config

	I1118 00:21:34.424028       1 shared_informer.go:247] Caches are synced for service config 

	I1118 00:21:34.424062       1 shared_informer.go:247] Caches are synced for endpoint slice config 

	I1118 00:21:41.600538       1 trace.go:205] Trace[1902479152]: "iptables restore" (18-Nov-2021 00:21:39.544) (total time: 2056ms):

	Trace[1902479152]: [2.056179659s] [2.056179659s] END

	I1118 00:21:50.818216       1 trace.go:205] Trace[1871746744]: "iptables restore" (18-Nov-2021 00:21:48.331) (total time: 2486ms):

	Trace[1871746744]: [2.486481381s] [2.486481381s] END

	* 

	* ==> kube-proxy [e4efee81ca46] <==

	* I1118 00:20:21.651696       1 node.go:172] Successfully retrieved node IP: 192.168.49.2

	I1118 00:20:21.651759       1 server_others.go:140] Detected node IP 192.168.49.2

	W1118 00:20:21.651773       1 server_others.go:565] Unknown proxy mode "", assuming iptables proxy

	I1118 00:20:23.854981       1 server_others.go:206] kube-proxy running in dual-stack mode, IPv4-primary

	I1118 00:20:23.855018       1 server_others.go:212] Using iptables Proxier.

	I1118 00:20:23.855027       1 server_others.go:219] creating dualStackProxier for iptables.

	W1118 00:20:23.855038       1 server_others.go:495] detect-local-mode set to ClusterCIDR, but no IPv6 cluster CIDR defined, , defaulting to no-op detect-local for IPv6

	I1118 00:20:23.855321       1 server.go:649] Version: v1.22.3

	I1118 00:20:23.855763       1 config.go:224] Starting endpoint slice config controller

	I1118 00:20:23.855791       1 shared_informer.go:240] Waiting for caches to sync for endpoint slice config

	I1118 00:20:23.855808       1 config.go:315] Starting service config controller

	I1118 00:20:23.855814       1 shared_informer.go:240] Waiting for caches to sync for service config

	I1118 00:20:23.956738       1 shared_informer.go:247] Caches are synced for endpoint slice config 

	I1118 00:20:23.956854       1 shared_informer.go:247] Caches are synced for service config 

	I1118 00:20:47.183178       1 trace.go:205] Trace[886166706]: "iptables restore" (18-Nov-2021 00:20:45.117) (total time: 2065ms):

	Trace[886166706]: [2.065366873s] [2.065366873s] END

	I1118 00:21:09.711497       1 trace.go:205] Trace[1669630311]: "iptables restore" (18-Nov-2021 00:21:07.502) (total time: 2208ms):

	Trace[1669630311]: [2.208983227s] [2.208983227s] END

	* 

	* ==> kube-scheduler [250907264d34] <==

	* I1118 00:21:29.418722       1 serving.go:347] Generated self-signed cert in-memory

	W1118 00:21:31.997832       1 requestheader_controller.go:193] Unable to get configmap/extension-apiserver-authentication in kube-system.  Usually fixed by 'kubectl create rolebinding -n kube-system ROLEBINDING_NAME --role=extension-apiserver-authentication-reader --serviceaccount=YOUR_NS:YOUR_SA'

	W1118 00:21:31.997895       1 authentication.go:345] Error looking up in-cluster authentication configuration: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot get resource "configmaps" in API group "" in the namespace "kube-system"

	W1118 00:21:31.997924       1 authentication.go:346] Continuing without authentication configuration. This may treat all requests as anonymous.

	W1118 00:21:31.997933       1 authentication.go:347] To require authentication configuration lookup to succeed, set --authentication-tolerate-lookup-failure=false

	I1118 00:21:32.011623       1 secure_serving.go:200] Serving securely on 127.0.0.1:10259

	I1118 00:21:32.011790       1 configmap_cafile_content.go:201] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file"

	I1118 00:21:32.012127       1 shared_informer.go:240] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file

	I1118 00:21:32.011814       1 tlsconfig.go:240] "Starting DynamicServingCertificateController"

	E1118 00:21:32.021075       1 plugin.go:138] "getting namespace, assuming empty set of namespace labels" err="namespace \"kube-system\" not found" namespace="kube-system"

	E1118 00:21:32.021368       1 plugin.go:138] "getting namespace, assuming empty set of namespace labels" err="namespace \"kube-system\" not found" namespace="kube-system"

	E1118 00:21:32.021634       1 plugin.go:138] "getting namespace, assuming empty set of namespace labels" err="namespace \"kube-system\" not found" namespace="kube-system"

	E1118 00:21:32.021713       1 plugin.go:138] "getting namespace, assuming empty set of namespace labels" err="namespace \"kube-system\" not found" namespace="kube-system"

	E1118 00:21:32.021793       1 plugin.go:138] "getting namespace, assuming empty set of namespace labels" err="namespace \"kube-system\" not found" namespace="kube-system"

	E1118 00:21:32.021855       1 plugin.go:138] "getting namespace, assuming empty set of namespace labels" err="namespace \"kube-system\" not found" namespace="kube-system"

	E1118 00:21:32.021896       1 plugin.go:138] "getting namespace, assuming empty set of namespace labels" err="namespace \"kube-system\" not found" namespace="kube-system"

	I1118 00:21:32.112609       1 shared_informer.go:247] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file 

	E1118 00:22:00.629682       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StorageClass: unknown (get storageclasses.storage.k8s.io)

	* 

	* ==> kube-scheduler [9b2f0c8b2294] <==

	* E1118 00:20:03.778476       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope

	E1118 00:20:03.778649       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope

	E1118 00:20:03.778756       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope

	E1118 00:20:03.778356       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope

	E1118 00:20:03.778477       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope

	E1118 00:20:03.778664       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope

	E1118 00:20:03.778867       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PodDisruptionBudget: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope

	E1118 00:20:03.779132       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope

	E1118 00:20:03.779200       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope

	E1118 00:20:03.779292       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope

	E1118 00:20:03.779420       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope

	E1118 00:20:03.779535       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1beta1.CSIStorageCapacity: failed to list *v1beta1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope

	E1118 00:20:04.601872       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope

	E1118 00:20:04.679677       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope

	E1118 00:20:04.718435       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope

	E1118 00:20:04.775960       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope

	E1118 00:20:04.790187       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope

	E1118 00:20:04.862294       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1beta1.CSIStorageCapacity: failed to list *v1beta1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope

	E1118 00:20:04.865410       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope

	E1118 00:20:04.897363       1 reflector.go:138] k8s.io/apiserver/pkg/server/dynamiccertificates/configmap_cafile_content.go:205: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"

	E1118 00:20:04.930491       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PodDisruptionBudget: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope

	I1118 00:20:06.875424       1 shared_informer.go:247] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file 

	I1118 00:21:27.208721       1 configmap_cafile_content.go:222] "Shutting down controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file"

	I1118 00:21:27.209099       1 secure_serving.go:311] Stopped listening on 127.0.0.1:10259

	I1118 00:21:27.209128       1 tlsconfig.go:255] "Shutting down DynamicServingCertificateController"

	* 

	* ==> kubelet <==

	* -- Logs begin at Thu 2021-11-18 00:19:19 UTC, end at Thu 2021-11-18 00:22:04 UTC. --

	Nov 18 00:21:45 functional-20211117161858-31976 kubelet[6078]: I1118 00:21:45.821657    6078 status_manager.go:601] "Failed to get status for pod" podUID=3c40bf658f457f3d925e48d646a29704 pod="kube-system/kube-apiserver-functional-20211117161858-31976" err="Get \"https://control-plane.minikube.internal:8441/api/v1/namespaces/kube-system/pods/kube-apiserver-functional-20211117161858-31976\": dial tcp 192.168.49.2:8441: connect: connection refused"

	Nov 18 00:21:45 functional-20211117161858-31976 kubelet[6078]: I1118 00:21:45.821881    6078 status_manager.go:601] "Failed to get status for pod" podUID=06052898487a9eef2760f89d323d2979 pod="kube-system/etcd-functional-20211117161858-31976" err="Get \"https://control-plane.minikube.internal:8441/api/v1/namespaces/kube-system/pods/etcd-functional-20211117161858-31976\": dial tcp 192.168.49.2:8441: connect: connection refused"

	Nov 18 00:21:45 functional-20211117161858-31976 kubelet[6078]: I1118 00:21:45.973843    6078 scope.go:110] "RemoveContainer" containerID="e180853e419038951cae72f6dcf958ed9e63196aeb434f87f93d71eb7f7bd335"

	Nov 18 00:21:45 functional-20211117161858-31976 kubelet[6078]: E1118 00:21:45.974382    6078 pod_workers.go:836] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-apiserver\" with CrashLoopBackOff: \"back-off 10s restarting failed container=kube-apiserver pod=kube-apiserver-functional-20211117161858-31976_kube-system(3c40bf658f457f3d925e48d646a29704)\"" pod="kube-system/kube-apiserver-functional-20211117161858-31976" podUID=3c40bf658f457f3d925e48d646a29704

	Nov 18 00:21:46 functional-20211117161858-31976 kubelet[6078]: I1118 00:21:46.980435    6078 scope.go:110] "RemoveContainer" containerID="e180853e419038951cae72f6dcf958ed9e63196aeb434f87f93d71eb7f7bd335"

	Nov 18 00:21:46 functional-20211117161858-31976 kubelet[6078]: E1118 00:21:46.981056    6078 pod_workers.go:836] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-apiserver\" with CrashLoopBackOff: \"back-off 10s restarting failed container=kube-apiserver pod=kube-apiserver-functional-20211117161858-31976_kube-system(3c40bf658f457f3d925e48d646a29704)\"" pod="kube-system/kube-apiserver-functional-20211117161858-31976" podUID=3c40bf658f457f3d925e48d646a29704

	Nov 18 00:21:47 functional-20211117161858-31976 kubelet[6078]: E1118 00:21:47.264527    6078 controller.go:144] failed to ensure lease exists, will retry in 3.2s, error: Get "https://control-plane.minikube.internal:8441/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/functional-20211117161858-31976?timeout=10s": dial tcp 192.168.49.2:8441: connect: connection refused

	Nov 18 00:21:47 functional-20211117161858-31976 kubelet[6078]: E1118 00:21:47.989152    6078 event.go:273] Unable to write event: '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"kube-apiserver-functional-20211117161858-31976.16b87c15dfe682a4", GenerateName:"", Namespace:"kube-system", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, InvolvedObject:v1.ObjectReference{Kind:"Pod", Namespace:"kube-system", Name:"kube-apiserver-functional-20211117161858-31976", UID:"3c40bf658f457f3d925e48d646a29704", APIVersion:"v1", ResourceVersion:"", FieldPath:"spec.containers{kube-apiserver}"}, Reason:"BackOff", Message

:"Back-off restarting failed container", Source:v1.EventSource{Component:"kubelet", Host:"functional-20211117161858-31976"}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xc05d8504782218a4, ext:4253908481, loc:(*time.Location)(0x77a8680)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xc05d8504782218a4, ext:4253908481, loc:(*time.Location)(0x77a8680)}}, Count:1, Type:"Warning", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'Post "https://control-plane.minikube.internal:8441/api/v1/namespaces/kube-system/events": dial tcp 192.168.49.2:8441: connect: connection refused'(may retry after sleeping)

	Nov 18 00:21:50 functional-20211117161858-31976 kubelet[6078]: E1118 00:21:50.465719    6078 controller.go:144] failed to ensure lease exists, will retry in 6.4s, error: Get "https://control-plane.minikube.internal:8441/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/functional-20211117161858-31976?timeout=10s": dial tcp 192.168.49.2:8441: connect: connection refused

	Nov 18 00:21:54 functional-20211117161858-31976 kubelet[6078]: E1118 00:21:54.327426    6078 kubelet_node_status.go:470] "Error updating node status, will retry" err="error getting node \"functional-20211117161858-31976\": Get \"https://control-plane.minikube.internal:8441/api/v1/nodes/functional-20211117161858-31976?resourceVersion=0&timeout=10s\": dial tcp 192.168.49.2:8441: connect: connection refused"

	Nov 18 00:21:54 functional-20211117161858-31976 kubelet[6078]: E1118 00:21:54.327891    6078 kubelet_node_status.go:470] "Error updating node status, will retry" err="error getting node \"functional-20211117161858-31976\": Get \"https://control-plane.minikube.internal:8441/api/v1/nodes/functional-20211117161858-31976?timeout=10s\": dial tcp 192.168.49.2:8441: connect: connection refused"

	Nov 18 00:21:54 functional-20211117161858-31976 kubelet[6078]: E1118 00:21:54.328323    6078 kubelet_node_status.go:470] "Error updating node status, will retry" err="error getting node \"functional-20211117161858-31976\": Get \"https://control-plane.minikube.internal:8441/api/v1/nodes/functional-20211117161858-31976?timeout=10s\": dial tcp 192.168.49.2:8441: connect: connection refused"

	Nov 18 00:21:54 functional-20211117161858-31976 kubelet[6078]: E1118 00:21:54.328687    6078 kubelet_node_status.go:470] "Error updating node status, will retry" err="error getting node \"functional-20211117161858-31976\": Get \"https://control-plane.minikube.internal:8441/api/v1/nodes/functional-20211117161858-31976?timeout=10s\": dial tcp 192.168.49.2:8441: connect: connection refused"

	Nov 18 00:21:54 functional-20211117161858-31976 kubelet[6078]: E1118 00:21:54.328969    6078 kubelet_node_status.go:470] "Error updating node status, will retry" err="error getting node \"functional-20211117161858-31976\": Get \"https://control-plane.minikube.internal:8441/api/v1/nodes/functional-20211117161858-31976?timeout=10s\": dial tcp 192.168.49.2:8441: connect: connection refused"

	Nov 18 00:21:54 functional-20211117161858-31976 kubelet[6078]: E1118 00:21:54.329010    6078 kubelet_node_status.go:457] "Unable to update node status" err="update node status exceeds retry count"

	Nov 18 00:21:55 functional-20211117161858-31976 kubelet[6078]: I1118 00:21:55.820351    6078 status_manager.go:601] "Failed to get status for pod" podUID=0ad7422ab14ae2d4b971f1822a1ff8ef pod="kube-system/kube-scheduler-functional-20211117161858-31976" err="Get \"https://control-plane.minikube.internal:8441/api/v1/namespaces/kube-system/pods/kube-scheduler-functional-20211117161858-31976\": dial tcp 192.168.49.2:8441: connect: connection refused"

	Nov 18 00:21:55 functional-20211117161858-31976 kubelet[6078]: I1118 00:21:55.820720    6078 status_manager.go:601] "Failed to get status for pod" podUID=3c40bf658f457f3d925e48d646a29704 pod="kube-system/kube-apiserver-functional-20211117161858-31976" err="Get \"https://control-plane.minikube.internal:8441/api/v1/namespaces/kube-system/pods/kube-apiserver-functional-20211117161858-31976\": dial tcp 192.168.49.2:8441: connect: connection refused"

	Nov 18 00:21:55 functional-20211117161858-31976 kubelet[6078]: I1118 00:21:55.820901    6078 status_manager.go:601] "Failed to get status for pod" podUID=06052898487a9eef2760f89d323d2979 pod="kube-system/etcd-functional-20211117161858-31976" err="Get \"https://control-plane.minikube.internal:8441/api/v1/namespaces/kube-system/pods/etcd-functional-20211117161858-31976\": dial tcp 192.168.49.2:8441: connect: connection refused"

	Nov 18 00:21:55 functional-20211117161858-31976 kubelet[6078]: I1118 00:21:55.821052    6078 status_manager.go:601] "Failed to get status for pod" podUID=9b9ccef0-fccc-43f7-8dec-952d07564964 pod="kube-system/storage-provisioner" err="Get \"https://control-plane.minikube.internal:8441/api/v1/namespaces/kube-system/pods/storage-provisioner\": dial tcp 192.168.49.2:8441: connect: connection refused"

	Nov 18 00:21:55 functional-20211117161858-31976 kubelet[6078]: I1118 00:21:55.821220    6078 status_manager.go:601] "Failed to get status for pod" podUID=453e3252-c5a8-48b4-893b-0496a8ed4dec pod="kube-system/kube-proxy-wbv29" err="Get \"https://control-plane.minikube.internal:8441/api/v1/namespaces/kube-system/pods/kube-proxy-wbv29\": dial tcp 192.168.49.2:8441: connect: connection refused"

	Nov 18 00:21:55 functional-20211117161858-31976 kubelet[6078]: I1118 00:21:55.821434    6078 status_manager.go:601] "Failed to get status for pod" podUID=07d38b3c32289fcb168a5eedbb42a060 pod="kube-system/kube-controller-manager-functional-20211117161858-31976" err="Get \"https://control-plane.minikube.internal:8441/api/v1/namespaces/kube-system/pods/kube-controller-manager-functional-20211117161858-31976\": dial tcp 192.168.49.2:8441: connect: connection refused"

	Nov 18 00:21:55 functional-20211117161858-31976 kubelet[6078]: I1118 00:21:55.821648    6078 status_manager.go:601] "Failed to get status for pod" podUID=67a186a3-f954-4960-bb9e-57d18527dbc7 pod="kube-system/coredns-78fcd69978-dnq6x" err="Get \"https://control-plane.minikube.internal:8441/api/v1/namespaces/kube-system/pods/coredns-78fcd69978-dnq6x\": dial tcp 192.168.49.2:8441: connect: connection refused"

	Nov 18 00:21:56 functional-20211117161858-31976 kubelet[6078]: E1118 00:21:56.870506    6078 controller.go:144] failed to ensure lease exists, will retry in 7s, error: Get "https://control-plane.minikube.internal:8441/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/functional-20211117161858-31976?timeout=10s": dial tcp 192.168.49.2:8441: connect: connection refused

	Nov 18 00:21:57 functional-20211117161858-31976 kubelet[6078]: I1118 00:21:57.819518    6078 scope.go:110] "RemoveContainer" containerID="e180853e419038951cae72f6dcf958ed9e63196aeb434f87f93d71eb7f7bd335"

	Nov 18 00:22:00 functional-20211117161858-31976 kubelet[6078]: E1118 00:22:00.623024    6078 reflector.go:138] object-"kube-system"/"kube-root-ca.crt": Failed to watch *v1.ConfigMap: unknown (get configmaps)

	* 

	* ==> storage-provisioner [422236a5e675] <==

	* I1118 00:21:36.639683       1 storage_provisioner.go:116] Initializing the minikube storage provisioner...

	I1118 00:21:36.650400       1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!

	I1118 00:21:36.650449       1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...

	E1118 00:21:40.111980       1 leaderelection.go:325] error retrieving resource lock kube-system/k8s.io-minikube-hostpath: Get "https://10.96.0.1:443/api/v1/namespaces/kube-system/endpoints/k8s.io-minikube-hostpath": dial tcp 10.96.0.1:443: connect: connection refused

	E1118 00:21:44.350512       1 leaderelection.go:325] error retrieving resource lock kube-system/k8s.io-minikube-hostpath: Get "https://10.96.0.1:443/api/v1/namespaces/kube-system/endpoints/k8s.io-minikube-hostpath": dial tcp 10.96.0.1:443: connect: connection refused

	E1118 00:21:47.946818       1 leaderelection.go:325] error retrieving resource lock kube-system/k8s.io-minikube-hostpath: Get "https://10.96.0.1:443/api/v1/namespaces/kube-system/endpoints/k8s.io-minikube-hostpath": dial tcp 10.96.0.1:443: connect: connection refused

	E1118 00:21:50.997974       1 leaderelection.go:325] error retrieving resource lock kube-system/k8s.io-minikube-hostpath: Get "https://10.96.0.1:443/api/v1/namespaces/kube-system/endpoints/k8s.io-minikube-hostpath": dial tcp 10.96.0.1:443: connect: connection refused

	E1118 00:21:54.018609       1 leaderelection.go:325] error retrieving resource lock kube-system/k8s.io-minikube-hostpath: Get "https://10.96.0.1:443/api/v1/namespaces/kube-system/endpoints/k8s.io-minikube-hostpath": dial tcp 10.96.0.1:443: connect: connection refused

	E1118 00:21:57.669218       1 leaderelection.go:325] error retrieving resource lock kube-system/k8s.io-minikube-hostpath: Get "https://10.96.0.1:443/api/v1/namespaces/kube-system/endpoints/k8s.io-minikube-hostpath": dial tcp 10.96.0.1:443: connect: connection refused

	E1118 00:22:00.682650       1 leaderelection.go:325] error retrieving resource lock kube-system/k8s.io-minikube-hostpath: endpoints "k8s.io-minikube-hostpath" is forbidden: User "system:serviceaccount:kube-system:storage-provisioner" cannot get resource "endpoints" in API group "" in the namespace "kube-system"

	I1118 00:22:03.068026       1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath

	I1118 00:22:03.068173       1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_functional-20211117161858-31976_4fef0d5b-bc84-456c-a1c3-fda05fbd6e27!

	I1118 00:22:03.068434       1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"32b2b3be-e39d-44de-bb2d-5d1067722fdc", APIVersion:"v1", ResourceVersion:"579", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' functional-20211117161858-31976_4fef0d5b-bc84-456c-a1c3-fda05fbd6e27 became leader

	I1118 00:22:03.169335       1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_functional-20211117161858-31976_4fef0d5b-bc84-456c-a1c3-fda05fbd6e27!

	* 

	* ==> storage-provisioner [ea850ca3cc61] <==

	* I1118 00:20:52.931610       1 storage_provisioner.go:116] Initializing the minikube storage provisioner...

	I1118 00:20:52.938911       1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!

	I1118 00:20:52.939029       1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...

	I1118 00:20:52.953253       1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath

	I1118 00:20:52.953292       1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"32b2b3be-e39d-44de-bb2d-5d1067722fdc", APIVersion:"v1", ResourceVersion:"494", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' functional-20211117161858-31976_1183ee1f-9cef-48cf-8de5-e4dbd61f5221 became leader

	I1118 00:20:52.953495       1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_functional-20211117161858-31976_1183ee1f-9cef-48cf-8de5-e4dbd61f5221!

	I1118 00:20:53.054549       1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_functional-20211117161858-31976_1183ee1f-9cef-48cf-8de5-e4dbd61f5221!

-- /stdout --

helpers_test.go:254: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.APIServer}} -p functional-20211117161858-31976 -n functional-20211117161858-31976

helpers_test.go:261: (dbg) Run:  kubectl --context functional-20211117161858-31976 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running

helpers_test.go:270: non-running pods: 

helpers_test.go:272: ======> post-mortem[TestFunctional/serial/ComponentHealth]: describe non-running pods <======

helpers_test.go:275: (dbg) Run:  kubectl --context functional-20211117161858-31976 describe pod 

helpers_test.go:275: (dbg) Non-zero exit: kubectl --context functional-20211117161858-31976 describe pod : exit status 1 (44.464431ms)

** stderr ** 

	error: resource name may not be empty

** /stderr **

helpers_test.go:277: kubectl --context functional-20211117161858-31976 describe pod : exit status 1

--- FAIL: TestFunctional/serial/ComponentHealth (13.26s)

=== RUN   TestRunningBinaryUpgrade

=== PAUSE TestRunningBinaryUpgrade

=== CONT  TestRunningBinaryUpgrade

version_upgrade_test.go:127: (dbg) Run:  /var/folders/xd/3vdzn10d2gb_wxr7lj_p8h5c0000gp/T/minikube-v1.9.0.1901742650.exe start -p running-upgrade-20211117170725-31976 --memory=2200 --vm-driver=docker 

E1117 17:07:29.139426   31976 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/profiles/skaffold-20211117170024-31976/client.crt: no such file or directory

E1117 17:07:49.625558   31976 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/profiles/skaffold-20211117170024-31976/client.crt: no such file or directory

E1117 17:08:30.588097   31976 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/profiles/skaffold-20211117170024-31976/client.crt: no such file or directory

=== CONT  TestRunningBinaryUpgrade

version_upgrade_test.go:127: (dbg) Non-zero exit: /var/folders/xd/3vdzn10d2gb_wxr7lj_p8h5c0000gp/T/minikube-v1.9.0.1901742650.exe start -p running-upgrade-20211117170725-31976 --memory=2200 --vm-driver=docker : exit status 70 (1m44.339552271s)

-- stdout --

	* [running-upgrade-20211117170725-31976] minikube v1.9.0 on Darwin 11.2.3

	  - MINIKUBE_LOCATION=12739

	  - MINIKUBE_BIN=out/minikube-darwin-amd64

	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube

	  - KUBECONFIG=/var/folders/xd/3vdzn10d2gb_wxr7lj_p8h5c0000gp/T/legacy_kubeconfig2148005027

	* Using the docker driver based on user configuration

	* Pulling base image ...

	* Downloading Kubernetes v1.18.0 preload ...

	* Creating Kubernetes in docker container with (CPUs=2) (0 available), Memory=2200MB (0MB available) ...

	! StartHost failed, but will try again: creating host: create: creating: create kic node: creating volume for running-upgrade-20211117170725-31976 container: output Error response from daemon: Bad response from Docker engine

	: exit status 1

	* docker "running-upgrade-20211117170725-31976" container is missing, will recreate.

	* Creating Kubernetes in docker container with (CPUs=2) (0 available), Memory=2200MB (0MB available) ...

	* StartHost failed again: recreate: creating host: create: creating: create kic node: creating volume for running-upgrade-20211117170725-31976 container: output Error response from daemon: Bad response from Docker engine

	: exit status 1

	  - Run: "minikube delete -p running-upgrade-20211117170725-31976", then "minikube start -p running-upgrade-20211117170725-31976 --alsologtostderr -v=1" to try again with more logging

-- /stdout --

** stderr ** 

	! 'docker' driver reported an issue: exit status 1

	* Suggestion: Docker is not running or is responding too slow. Try: restarting docker desktop.

	    > preloaded-images-k8s-v2-v1.18.0-docker-overlay2-amd64.tar.lz4: 9.88 MiB /    > preloaded-images-k8s-v2-v1.18.0-docker-overlay2-amd64.tar.lz4: 30.94 MiB     > preloaded-images-k8s-v2-v1.18.0-docker-overlay2-amd64.tar.lz4: 48.25 MiB     > preloaded-images-k8s-v2-v1.18.0-docker-overlay2-amd64.tar.lz4: 69.44 MiB     > preloaded-images-k8s-v2-v1.18.0-docker-overlay2-amd64.tar.lz4: 90.31 MiB     > preloaded-images-k8s-v2-v1.18.0-docker-overlay2-amd64.tar.lz4: 111.77 MiB    > preloaded-images-k8s-v2-v1.18.0-docker-overlay2-amd64.tar.lz4: 133.75 MiB    > preloaded-images-k8s-v2-v1.18.0-docker-overlay2-amd64.tar.lz4: 155.83 MiB    > preloaded-images-k8s-v2-v1.18.0-docker-overlay2-amd64.tar.lz4: 171.44 MiB    > preloaded-images-k8s-v2-v1.18.0-docker-overlay2-amd64.tar.lz4: 188.28 MiB    > preloaded-images-k8s-v2-v1.18.0-docker-overlay2-amd64.tar.lz4: 208.00 MiB    > preloaded-images-k8s-v2-v1.18.0-docker-overlay2-amd64.tar.lz4: 219.02 MiB    > preloaded-images-k8s-v2-v1.18.0-docker-overlay2-amd64.tar.lz4

: 240.50 MiB    > preloaded-images-k8s-v2-v1.18.0-docker-overlay2-amd64.tar.lz4: 261.50 MiB    > preloaded-images-k8s-v2-v1.18.0-docker-overlay2-amd64.tar.lz4: 284.31 MiB    > preloaded-images-k8s-v2-v1.18.0-docker-overlay2-amd64.tar.lz4: 305.25 MiB    > preloaded-images-k8s-v2-v1.18.0-docker-overlay2-amd64.tar.lz4: 327.70 MiB    > preloaded-images-k8s-v2-v1.18.0-docker-overlay2-amd64.tar.lz4: 349.84 MiB    > preloaded-images-k8s-v2-v1.18.0-docker-overlay2-amd64.tar.lz4: 372.28 MiB    > preloaded-images-k8s-v2-v1.18.0-docker-overlay2-amd64.tar.lz4: 394.20 MiB    > preloaded-images-k8s-v2-v1.18.0-docker-overlay2-amd64.tar.lz4: 415.31 MiB    > preloaded-images-k8s-v2-v1.18.0-docker-overlay2-amd64.tar.lz4: 438.08 MiB    > preloaded-images-k8s-v2-v1.18.0-docker-overlay2-amd64.tar.lz4: 460.11 MiB    > preloaded-images-k8s-v2-v1.18.0-docker-overlay2-amd64.tar.lz4: 481.94 MiB    > preloaded-images-k8s-v2-v1.18.0-docker-overlay2-amd64.tar.lz4: 496.00 MiB    > preloaded-images-k8s-v2-v1.18.0-docker-overlay2-amd64.tar.

lz4: 504.06 MiB    > preloaded-images-k8s-v2-v1.18.0-docker-overlay2-amd64.tar.lz4: 512.00 MiB    > preloaded-images-k8s-v2-v1.18.0-docker-overlay2-amd64.tar.lz4: 513.86 MiB    > preloaded-images-k8s-v2-v1.18.0-docker-overlay2-amd64.tar.lz4: 536.56 MiB    > preloaded-images-k8s-v2-v1.18.0-docker-overlay2-amd64.tar.lz4: 542.91 MiBE1117 17:07:34.571510   42508 cache.go:114] Error downloading kic artifacts:  error loading image: Error response from daemon: Bad response from Docker engine

	* 

	X Unable to start VM after repeated tries. Please try {{'minikube delete' if possible: recreate: creating host: create: creating: create kic node: creating volume for running-upgrade-20211117170725-31976 container: output Error response from daemon: Bad response from Docker engine

	: exit status 1

	* 

	* minikube is exiting due to an error. If the above message is not useful, open an issue:

	  - https://github.com/kubernetes/minikube/issues/new/choose

** /stderr **

version_upgrade_test.go:127: (dbg) Run:  /var/folders/xd/3vdzn10d2gb_wxr7lj_p8h5c0000gp/T/minikube-v1.9.0.1901742650.exe start -p running-upgrade-20211117170725-31976 --memory=2200 --vm-driver=docker 

=== CONT  TestRunningBinaryUpgrade

version_upgrade_test.go:127: (dbg) Non-zero exit: /var/folders/xd/3vdzn10d2gb_wxr7lj_p8h5c0000gp/T/minikube-v1.9.0.1901742650.exe start -p running-upgrade-20211117170725-31976 --memory=2200 --vm-driver=docker : exit status 70 (42.078030285s)

-- stdout --

	* [running-upgrade-20211117170725-31976] minikube v1.9.0 on Darwin 11.2.3

	  - MINIKUBE_LOCATION=12739

	  - MINIKUBE_BIN=out/minikube-darwin-amd64

	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube

	  - KUBECONFIG=/var/folders/xd/3vdzn10d2gb_wxr7lj_p8h5c0000gp/T/legacy_kubeconfig798656051

	* Using the docker driver based on existing profile

	* Pulling base image ...

	* docker "running-upgrade-20211117170725-31976" container is missing, will recreate.

	* Creating Kubernetes in docker container with (CPUs=2) (0 available), Memory=2200MB (0MB available) ...

	! StartHost failed, but will try again: recreate: creating host: create: creating: create kic node: creating volume for running-upgrade-20211117170725-31976 container: output Error response from daemon: Bad response from Docker engine

	: exit status 1

	* docker "running-upgrade-20211117170725-31976" container is missing, will recreate.

	* Creating Kubernetes in docker container with (CPUs=2) (0 available), Memory=2200MB (0MB available) ...

	* StartHost failed again: recreate: creating host: create: creating: create kic node: creating volume for running-upgrade-20211117170725-31976 container: output Error response from daemon: Bad response from Docker engine

	: exit status 1

	  - Run: "minikube delete -p running-upgrade-20211117170725-31976", then "minikube start -p running-upgrade-20211117170725-31976 --alsologtostderr -v=1" to try again with more logging

-- /stdout --

** stderr ** 

	! 'docker' driver reported an issue: exit status 1

	* Suggestion: Docker is not running or is responding too slow. Try: restarting docker desktop.

	E1117 17:09:14.633284   42896 cache.go:114] Error downloading kic artifacts:  error loading image: Error response from daemon: Bad response from Docker engine

	* 

	X Unable to start VM after repeated tries. Please try {{'minikube delete' if possible: recreate: creating host: create: creating: create kic node: creating volume for running-upgrade-20211117170725-31976 container: output Error response from daemon: Bad response from Docker engine

	: exit status 1

	* 

	* minikube is exiting due to an error. If the above message is not useful, open an issue:

	  - https://github.com/kubernetes/minikube/issues/new/choose

** /stderr **

version_upgrade_test.go:127: (dbg) Run:  /var/folders/xd/3vdzn10d2gb_wxr7lj_p8h5c0000gp/T/minikube-v1.9.0.1901742650.exe start -p running-upgrade-20211117170725-31976 --memory=2200 --vm-driver=docker 

E1117 17:09:58.086319   31976 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/profiles/addons-20211117161126-31976/client.crt: no such file or directory

E1117 17:10:14.958281   31976 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/profiles/addons-20211117161126-31976/client.crt: no such file or directory

=== CONT  TestRunningBinaryUpgrade

version_upgrade_test.go:127: (dbg) Non-zero exit: /var/folders/xd/3vdzn10d2gb_wxr7lj_p8h5c0000gp/T/minikube-v1.9.0.1901742650.exe start -p running-upgrade-20211117170725-31976 --memory=2200 --vm-driver=docker : exit status 70 (42.014791586s)

-- stdout --

	* [running-upgrade-20211117170725-31976] minikube v1.9.0 on Darwin 11.2.3

	  - MINIKUBE_LOCATION=12739

	  - MINIKUBE_BIN=out/minikube-darwin-amd64

	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube

	  - KUBECONFIG=/var/folders/xd/3vdzn10d2gb_wxr7lj_p8h5c0000gp/T/legacy_kubeconfig1527647170

	* Using the docker driver based on existing profile

	* Pulling base image ...

	* docker "running-upgrade-20211117170725-31976" container is missing, will recreate.

	* Creating Kubernetes in docker container with (CPUs=2) (0 available), Memory=2200MB (0MB available) ...

	! StartHost failed, but will try again: recreate: creating host: create: creating: create kic node: creating volume for running-upgrade-20211117170725-31976 container: output Error response from daemon: Bad response from Docker engine

	: exit status 1

	* docker "running-upgrade-20211117170725-31976" container is missing, will recreate.

	* Creating Kubernetes in docker container with (CPUs=2) (0 available), Memory=2200MB (0MB available) ...

	* StartHost failed again: recreate: creating host: create: creating: create kic node: creating volume for running-upgrade-20211117170725-31976 container: output Error response from daemon: Bad response from Docker engine

	: exit status 1

	  - Run: "minikube delete -p running-upgrade-20211117170725-31976", then "minikube start -p running-upgrade-20211117170725-31976 --alsologtostderr -v=1" to try again with more logging

-- /stdout --

** stderr ** 

	! 'docker' driver reported an issue: exit status 1

	* Suggestion: Docker is not running or is responding too slow. Try: restarting docker desktop.

	E1117 17:09:58.520140   43275 cache.go:114] Error downloading kic artifacts:  error loading image: Error response from daemon: Bad response from Docker engine

	* 

	X Unable to start VM after repeated tries. Please try {{'minikube delete' if possible: recreate: creating host: create: creating: create kic node: creating volume for running-upgrade-20211117170725-31976 container: output Error response from daemon: Bad response from Docker engine

	: exit status 1

	* 

	* minikube is exiting due to an error. If the above message is not useful, open an issue:

	  - https://github.com/kubernetes/minikube/issues/new/choose

** /stderr **

version_upgrade_test.go:133: legacy v1.9.0 start failed: exit status 70

=== CONT  TestRunningBinaryUpgrade

panic.go:642: *** TestRunningBinaryUpgrade FAILED at 2021-11-17 17:10:38.074568 -0800 PST m=+3609.869995950

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:230: ======>  post-mortem[TestRunningBinaryUpgrade]: docker inspect <======

helpers_test.go:231: (dbg) Run:  docker inspect running-upgrade-20211117170725-31976

helpers_test.go:231: (dbg) Non-zero exit: docker inspect running-upgrade-20211117170725-31976: exit status 1 (219.513825ms)

-- stdout --

	[]

-- /stdout --

** stderr ** 

	Error response from daemon: Bad response from Docker engine

** /stderr **

helpers_test.go:233: failed to get docker inspect: exit status 1

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p running-upgrade-20211117170725-31976 -n running-upgrade-20211117170725-31976

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p running-upgrade-20211117170725-31976 -n running-upgrade-20211117170725-31976: exit status 7 (230.057389ms)

-- stdout --

	Nonexistent

-- /stdout --

** stderr ** 

	E1117 17:10:38.523220   43878 status.go:247] status error: host: state: unknown state "running-upgrade-20211117170725-31976": docker container inspect running-upgrade-20211117170725-31976 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: Bad response from Docker engine

** /stderr **

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "running-upgrade-20211117170725-31976" host is not running, skipping log retrieval (state="Nonexistent")

helpers_test.go:175: Cleaning up "running-upgrade-20211117170725-31976" profile ...

helpers_test.go:178: (dbg) Run:  out/minikube-darwin-amd64 delete -p running-upgrade-20211117170725-31976

helpers_test.go:178: (dbg) Done: out/minikube-darwin-amd64 delete -p running-upgrade-20211117170725-31976: (1.258615786s)

--- FAIL: TestRunningBinaryUpgrade (194.29s)

=== RUN   TestKubernetesUpgrade

=== PAUSE TestKubernetesUpgrade

=== CONT  TestKubernetesUpgrade

version_upgrade_test.go:229: (dbg) Run:  out/minikube-darwin-amd64 start -p kubernetes-upgrade-20211117170535-31976 --memory=2200 --kubernetes-version=v1.14.0 --alsologtostderr -v=1 --driver=docker 

E1117 17:06:14.139708   31976 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/profiles/ingress-addon-legacy-20211117162339-31976/client.crt: no such file or directory

=== CONT  TestKubernetesUpgrade

version_upgrade_test.go:229: (dbg) Done: out/minikube-darwin-amd64 start -p kubernetes-upgrade-20211117170535-31976 --memory=2200 --kubernetes-version=v1.14.0 --alsologtostderr -v=1 --driver=docker : (1m8.432133651s)

version_upgrade_test.go:234: (dbg) Run:  out/minikube-darwin-amd64 stop -p kubernetes-upgrade-20211117170535-31976

version_upgrade_test.go:234: (dbg) Done: out/minikube-darwin-amd64 stop -p kubernetes-upgrade-20211117170535-31976: (6.621235546s)

version_upgrade_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 -p kubernetes-upgrade-20211117170535-31976 status --format={{.Host}}

version_upgrade_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p kubernetes-upgrade-20211117170535-31976 status --format={{.Host}}: exit status 7 (212.325864ms)

-- stdout --

	Stopped

-- /stdout --

version_upgrade_test.go:241: status error: exit status 7 (may be ok)

version_upgrade_test.go:250: (dbg) Run:  out/minikube-darwin-amd64 start -p kubernetes-upgrade-20211117170535-31976 --memory=2200 --kubernetes-version=v1.22.4-rc.0 --alsologtostderr -v=1 --driver=docker 

E1117 17:07:08.605490   31976 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/profiles/skaffold-20211117170024-31976/client.crt: no such file or directory

E1117 17:07:08.610992   31976 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/profiles/skaffold-20211117170024-31976/client.crt: no such file or directory

E1117 17:07:08.621941   31976 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/profiles/skaffold-20211117170024-31976/client.crt: no such file or directory

E1117 17:07:08.645028   31976 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/profiles/skaffold-20211117170024-31976/client.crt: no such file or directory

E1117 17:07:08.690986   31976 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/profiles/skaffold-20211117170024-31976/client.crt: no such file or directory

E1117 17:07:08.773436   31976 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/profiles/skaffold-20211117170024-31976/client.crt: no such file or directory

E1117 17:07:08.940965   31976 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/profiles/skaffold-20211117170024-31976/client.crt: no such file or directory

E1117 17:07:09.269306   31976 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/profiles/skaffold-20211117170024-31976/client.crt: no such file or directory

E1117 17:07:09.919272   31976 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/profiles/skaffold-20211117170024-31976/client.crt: no such file or directory

E1117 17:07:11.207777   31976 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/profiles/skaffold-20211117170024-31976/client.crt: no such file or directory

E1117 17:07:13.777379   31976 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/profiles/skaffold-20211117170024-31976/client.crt: no such file or directory

E1117 17:07:18.898601   31976 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/profiles/skaffold-20211117170024-31976/client.crt: no such file or directory

E1117 17:07:20.406598   31976 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/profiles/functional-20211117161858-31976/client.crt: no such file or directory

version_upgrade_test.go:250: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p kubernetes-upgrade-20211117170535-31976 --memory=2200 --kubernetes-version=v1.22.4-rc.0 --alsologtostderr -v=1 --driver=docker : exit status 80 (33.613468295s)

-- stdout --

	* [kubernetes-upgrade-20211117170535-31976] minikube v1.24.0 on Darwin 11.2.3

	  - MINIKUBE_LOCATION=12739

	  - KUBECONFIG=/Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/kubeconfig

	  - MINIKUBE_BIN=out/minikube-darwin-amd64

	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube

	* Using the docker driver based on existing profile

	* Starting control plane node kubernetes-upgrade-20211117170535-31976 in cluster kubernetes-upgrade-20211117170535-31976

	* Pulling base image ...

	* Restarting existing docker container for "kubernetes-upgrade-20211117170535-31976" ...

	* docker "kubernetes-upgrade-20211117170535-31976" container is missing, will recreate.

	* Creating docker container (CPUs=2, Memory=2200MB) ...

-- /stdout --

** stderr ** 

	I1117 17:06:50.775270   42213 out.go:297] Setting OutFile to fd 1 ...

	I1117 17:06:50.775448   42213 out.go:344] TERM=,COLORTERM=, which probably does not support color

	I1117 17:06:50.775454   42213 out.go:310] Setting ErrFile to fd 2...

	I1117 17:06:50.775458   42213 out.go:344] TERM=,COLORTERM=, which probably does not support color

	I1117 17:06:50.775549   42213 root.go:315] Updating PATH: /Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/bin

	I1117 17:06:50.775843   42213 out.go:304] Setting JSON to false

	I1117 17:06:50.812010   42213 start.go:112] hostinfo: {"hostname":"37310.local","uptime":11185,"bootTime":1637186425,"procs":373,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"11.2.3","kernelVersion":"20.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"bd1c05a8-24a6-5973-aa69-f3c7c66a87ce"}

	W1117 17:06:50.812131   42213 start.go:120] gopshost.Virtualization returned error: not implemented yet

	I1117 17:06:50.843714   42213 out.go:176] * [kubernetes-upgrade-20211117170535-31976] minikube v1.24.0 on Darwin 11.2.3

	I1117 17:06:50.843810   42213 notify.go:174] Checking for updates...

	I1117 17:06:50.844089   42213 preload.go:305] deleting older generation preload /Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v2-v1.18.0-docker-overlay2-amd64.tar.lz4

	I1117 17:06:50.898832   42213 out.go:176]   - MINIKUBE_LOCATION=12739

	I1117 17:06:50.898973   42213 preload.go:305] deleting older generation preload /Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v2-v1.18.0-docker-overlay2-amd64.tar.lz4.checksum

	I1117 17:06:50.924089   42213 out.go:176]   - KUBECONFIG=/Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/kubeconfig

	I1117 17:06:50.950286   42213 out.go:176]   - MINIKUBE_BIN=out/minikube-darwin-amd64

	I1117 17:06:50.976317   42213 out.go:176]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube

	I1117 17:06:50.976754   42213 config.go:176] Loaded profile config "kubernetes-upgrade-20211117170535-31976": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.14.0

	I1117 17:06:50.977101   42213 driver.go:343] Setting default libvirt URI to qemu:///system

	I1117 17:06:51.101331   42213 docker.go:132] docker version: linux-20.10.6

	I1117 17:06:51.101450   42213 cli_runner.go:115] Run: docker system info --format "{{json .}}"

	I1117 17:06:51.327924   42213 info.go:263] docker info: {ID:2AYQ:M3LP:F6GE:IPKK:4XGD:7ZUA:OVWC:XKGI:AARV:HKMV:IHBV:IRRJ Containers:3 ContainersRunning:2 ContainersPaused:0 ContainersStopped:1 Images:26 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:59 OomKillDisable:true NGoroutines:63 SystemTime:2021-11-18 01:06:51.239695789 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:4 KernelVersion:5.10.25-linuxkit OperatingSystem:Docker Desktop OSType:linux Architecture:x86_64 IndexServer

Address:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:6 MemTotal:6234726400 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy:http.docker.internal:3128 HTTPSProxy:http.docker.internal:3128 NoProxy: Name:docker-desktop Labels:[] ExperimentalBuild:false ServerVersion:20.10.6 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:05f951a3781f4f2c1911b05e61c160e9c30eaa8e Expected:05f951a3781f4f2c1911b05e61c160e9c30eaa8e} RuncCommit:{ID:12644e614e25b05da6fd08a38ffa0cfe1903fdec Expected:12644e614e25b05da6fd08a38ffa0cfe1903fdec} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=sec

comp,profile=default] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Experimental:true Name:app Path:/usr/local/lib/docker/cli-plugins/docker-app SchemaVersion:0.1.0 ShortDescription:Docker App Vendor:Docker Inc. Version:v0.9.1-beta3] map[Name:buildx Path:/usr/local/lib/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Build with BuildKit Vendor:Docker Inc. Version:v0.5.1-docker] map[Name:compose Path:/usr/local/lib/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:2.0.0-beta.1] map[Name:scan Path:/usr/local/lib/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.8.0]] Warnings:<nil>}}

	I1117 17:06:51.375238   42213 out.go:176] * Using the docker driver based on existing profile

	I1117 17:06:51.375302   42213 start.go:280] selected driver: docker

	I1117 17:06:51.375312   42213 start.go:775] validating driver "docker" against &{Name:kubernetes-upgrade-20211117170535-31976 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.28@sha256:4780f1897569d2bf77aafb3d133a08d42b4fe61127f06fcfc90c2c5d902d893c Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.14.0 ClusterName:kubernetes-upgrade-20211117170535-31976 Namespace:default APIServerName:mi

nikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.14.0 ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host}

	I1117 17:06:51.375441   42213 start.go:786] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc:}

	I1117 17:06:51.377948   42213 cli_runner.go:115] Run: docker system info --format "{{json .}}"

	I1117 17:06:51.612929   42213 info.go:263] docker info: {ID:2AYQ:M3LP:F6GE:IPKK:4XGD:7ZUA:OVWC:XKGI:AARV:HKMV:IHBV:IRRJ Containers:3 ContainersRunning:2 ContainersPaused:0 ContainersStopped:1 Images:26 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:59 OomKillDisable:true NGoroutines:63 SystemTime:2021-11-18 01:06:51.521850889 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:4 KernelVersion:5.10.25-linuxkit OperatingSystem:Docker Desktop OSType:linux Architecture:x86_64 IndexServer

Address:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:6 MemTotal:6234726400 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy:http.docker.internal:3128 HTTPSProxy:http.docker.internal:3128 NoProxy: Name:docker-desktop Labels:[] ExperimentalBuild:false ServerVersion:20.10.6 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:05f951a3781f4f2c1911b05e61c160e9c30eaa8e Expected:05f951a3781f4f2c1911b05e61c160e9c30eaa8e} RuncCommit:{ID:12644e614e25b05da6fd08a38ffa0cfe1903fdec Expected:12644e614e25b05da6fd08a38ffa0cfe1903fdec} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=sec

comp,profile=default] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Experimental:true Name:app Path:/usr/local/lib/docker/cli-plugins/docker-app SchemaVersion:0.1.0 ShortDescription:Docker App Vendor:Docker Inc. Version:v0.9.1-beta3] map[Name:buildx Path:/usr/local/lib/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Build with BuildKit Vendor:Docker Inc. Version:v0.5.1-docker] map[Name:compose Path:/usr/local/lib/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:2.0.0-beta.1] map[Name:scan Path:/usr/local/lib/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.8.0]] Warnings:<nil>}}

	I1117 17:06:51.613064   42213 cni.go:93] Creating CNI manager for ""

	I1117 17:06:51.613077   42213 cni.go:167] CNI unnecessary in this configuration, recommending no CNI

	I1117 17:06:51.613086   42213 start_flags.go:282] config:

	{Name:kubernetes-upgrade-20211117170535-31976 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.28@sha256:4780f1897569d2bf77aafb3d133a08d42b4fe61127f06fcfc90c2c5d902d893c Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.22.4-rc.0 ClusterName:kubernetes-upgrade-20211117170535-31976 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local Containe

rRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.14.0 ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host}

	I1117 17:06:51.660640   42213 out.go:176] * Starting control plane node kubernetes-upgrade-20211117170535-31976 in cluster kubernetes-upgrade-20211117170535-31976

	I1117 17:06:51.660681   42213 cache.go:118] Beginning downloading kic base image for docker with docker

	I1117 17:06:51.707437   42213 out.go:176] * Pulling base image ...

	I1117 17:06:51.707483   42213 preload.go:132] Checking if preload exists for k8s version v1.22.4-rc.0 and runtime docker

	I1117 17:06:51.707507   42213 image.go:75] Checking for gcr.io/k8s-minikube/kicbase:v0.0.28@sha256:4780f1897569d2bf77aafb3d133a08d42b4fe61127f06fcfc90c2c5d902d893c in local docker daemon

	I1117 17:06:51.707535   42213 preload.go:148] Found local preload: /Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v14-v1.22.4-rc.0-docker-overlay2-amd64.tar.lz4

	I1117 17:06:51.707557   42213 cache.go:57] Caching tarball of preloaded images

	I1117 17:06:51.707722   42213 preload.go:174] Found /Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v14-v1.22.4-rc.0-docker-overlay2-amd64.tar.lz4 in cache, skipping download

	I1117 17:06:51.707736   42213 cache.go:60] Finished verifying existence of preloaded tar for  v1.22.4-rc.0 on docker

	I1117 17:06:51.708438   42213 profile.go:147] Saving config to /Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/profiles/kubernetes-upgrade-20211117170535-31976/config.json ...

	I1117 17:06:51.865954   42213 image.go:79] Found gcr.io/k8s-minikube/kicbase:v0.0.28@sha256:4780f1897569d2bf77aafb3d133a08d42b4fe61127f06fcfc90c2c5d902d893c in local docker daemon, skipping pull

	I1117 17:06:51.865969   42213 cache.go:140] gcr.io/k8s-minikube/kicbase:v0.0.28@sha256:4780f1897569d2bf77aafb3d133a08d42b4fe61127f06fcfc90c2c5d902d893c exists in daemon, skipping load

	I1117 17:06:51.865982   42213 cache.go:206] Successfully downloaded all kic artifacts

	I1117 17:06:51.866041   42213 start.go:313] acquiring machines lock for kubernetes-upgrade-20211117170535-31976: {Name:mk9072703b78acf3b7213aadf906ddf9902cea7c Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I1117 17:06:51.866133   42213 start.go:317] acquired machines lock for "kubernetes-upgrade-20211117170535-31976" in 69.949µs

	I1117 17:06:51.866163   42213 start.go:93] Skipping create...Using existing machine configuration

	I1117 17:06:51.866172   42213 fix.go:55] fixHost starting: 

	I1117 17:06:51.866445   42213 cli_runner.go:115] Run: docker container inspect kubernetes-upgrade-20211117170535-31976 --format={{.State.Status}}

	I1117 17:06:52.002809   42213 fix.go:108] recreateIfNeeded on kubernetes-upgrade-20211117170535-31976: state=Stopped err=<nil>

	W1117 17:06:52.002849   42213 fix.go:134] unexpected machine state, will restart: <nil>

	I1117 17:06:52.029701   42213 out.go:176] * Restarting existing docker container for "kubernetes-upgrade-20211117170535-31976" ...

	I1117 17:06:52.029823   42213 cli_runner.go:115] Run: docker start kubernetes-upgrade-20211117170535-31976

	W1117 17:06:52.757923   42213 cli_runner.go:162] docker start kubernetes-upgrade-20211117170535-31976 returned with exit code 1

	I1117 17:06:52.758068   42213 cli_runner.go:115] Run: docker inspect kubernetes-upgrade-20211117170535-31976

	W1117 17:06:52.888984   42213 cli_runner.go:162] docker inspect kubernetes-upgrade-20211117170535-31976 returned with exit code 1

	W1117 17:06:52.889028   42213 errors.go:82] Failed to get postmortem inspect. docker inspect kubernetes-upgrade-20211117170535-31976 :docker inspect kubernetes-upgrade-20211117170535-31976: exit status 1

	stdout:

	[]

	stderr:

	Error response from daemon: Bad response from Docker engine

	I1117 17:06:52.889163   42213 cli_runner.go:115] Run: docker logs --timestamps --details kubernetes-upgrade-20211117170535-31976

	W1117 17:06:53.008402   42213 cli_runner.go:162] docker logs --timestamps --details kubernetes-upgrade-20211117170535-31976 returned with exit code 1

	W1117 17:06:53.008428   42213 errors.go:89] Failed to get postmortem logs. docker logs --timestamps --details kubernetes-upgrade-20211117170535-31976 :docker logs --timestamps --details kubernetes-upgrade-20211117170535-31976: exit status 1

	stdout:

	stderr:

	Error response from daemon: Bad response from Docker engine

	I1117 17:06:53.008510   42213 cli_runner.go:115] Run: docker system info --format "{{json .}}"

	I1117 17:06:53.182243   42213 info.go:263] docker info: {ID: Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:0 Driver: DriverStatus:[] SystemStatus:<nil> Plugins:{Volume:[] Network:[] Authorization:<nil> Log:[]} MemoryLimit:false SwapLimit:false KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:false CPUCfsQuota:false CPUShares:false CPUSet:false PidsLimit:false IPv4Forwarding:false BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:0 OomKillDisable:false NGoroutines:0 SystemTime:0001-01-01 00:00:00 +0000 UTC LoggingDriver: CgroupDriver: NEventsListener:0 KernelVersion: OperatingSystem: OSType: Architecture: IndexServerAddress: RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[] IndexConfigs:{DockerIo:{Name: Mirrors:[] Secure:false Official:false}} Mirrors:[]} NCPU:0 MemTotal:0 GenericResources:<nil> DockerRootDir: HTTPProxy: HTTPSProxy: NoProxy: Name: Labels:[] ExperimentalBuild:fals

e ServerVersion: ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:}} DefaultRuntime: Swarm:{NodeID: NodeAddr: LocalNodeState: ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary: ContainerdCommit:{ID: Expected:} RuncCommit:{ID: Expected:} InitCommit:{ID: Expected:} SecurityOptions:[] ProductLicense: Warnings:<nil> ServerErrors:[Error response from daemon: Bad response from Docker engine] ClientInfo:{Debug:false Plugins:[map[Experimental:true Name:app Path:/usr/local/lib/docker/cli-plugins/docker-app SchemaVersion:0.1.0 ShortDescription:Docker App Vendor:Docker Inc. Version:v0.9.1-beta3] map[Name:buildx Path:/usr/local/lib/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Build with BuildKit Vendor:Docker Inc. Version:v0.5.1-docker] map[Name:compose Path:/usr/local/lib/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:2.0.0-beta.1] map[Name:scan Path:/usr/local/lib/docker/cli-pl

ugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.8.0]] Warnings:<nil>}}

	I1117 17:06:53.182342   42213 errors.go:98] postmortem docker info: {ID: Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:0 Driver: DriverStatus:[] SystemStatus:<nil> Plugins:{Volume:[] Network:[] Authorization:<nil> Log:[]} MemoryLimit:false SwapLimit:false KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:false CPUCfsQuota:false CPUShares:false CPUSet:false PidsLimit:false IPv4Forwarding:false BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:0 OomKillDisable:false NGoroutines:0 SystemTime:0001-01-01 00:00:00 +0000 UTC LoggingDriver: CgroupDriver: NEventsListener:0 KernelVersion: OperatingSystem: OSType: Architecture: IndexServerAddress: RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[] IndexConfigs:{DockerIo:{Name: Mirrors:[] Secure:false Official:false}} Mirrors:[]} NCPU:0 MemTotal:0 GenericResources:<nil> DockerRootDir: HTTPProxy: HTTPSProxy: NoProxy: Name: Labels:[] Experiment

alBuild:false ServerVersion: ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:}} DefaultRuntime: Swarm:{NodeID: NodeAddr: LocalNodeState: ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary: ContainerdCommit:{ID: Expected:} RuncCommit:{ID: Expected:} InitCommit:{ID: Expected:} SecurityOptions:[] ProductLicense: Warnings:<nil> ServerErrors:[Error response from daemon: Bad response from Docker engine] ClientInfo:{Debug:false Plugins:[map[Experimental:true Name:app Path:/usr/local/lib/docker/cli-plugins/docker-app SchemaVersion:0.1.0 ShortDescription:Docker App Vendor:Docker Inc. Version:v0.9.1-beta3] map[Name:buildx Path:/usr/local/lib/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Build with BuildKit Vendor:Docker Inc. Version:v0.5.1-docker] map[Name:compose Path:/usr/local/lib/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:2.0.0-beta.1] map[Name:scan Path:/usr/local/lib/d

ocker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.8.0]] Warnings:<nil>}}

	I1117 17:06:53.182475   42213 network_create.go:254] running [docker network inspect kubernetes-upgrade-20211117170535-31976] to gather additional debugging logs...

	I1117 17:06:53.182492   42213 cli_runner.go:115] Run: docker network inspect kubernetes-upgrade-20211117170535-31976

	W1117 17:06:53.318601   42213 cli_runner.go:162] docker network inspect kubernetes-upgrade-20211117170535-31976 returned with exit code 1

	I1117 17:06:53.318626   42213 network_create.go:257] error running [docker network inspect kubernetes-upgrade-20211117170535-31976]: docker network inspect kubernetes-upgrade-20211117170535-31976: exit status 1

	stdout:

	[]

	stderr:

	Error response from daemon: Bad response from Docker engine

	I1117 17:06:53.318637   42213 network_create.go:259] output of [docker network inspect kubernetes-upgrade-20211117170535-31976]: -- stdout --

	[]

	-- /stdout --

	** stderr ** 

	Error response from daemon: Bad response from Docker engine

	** /stderr **

	I1117 17:06:53.318731   42213 cli_runner.go:115] Run: docker system info --format "{{json .}}"

	I1117 17:06:53.488546   42213 info.go:263] docker info: {ID: Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:0 Driver: DriverStatus:[] SystemStatus:<nil> Plugins:{Volume:[] Network:[] Authorization:<nil> Log:[]} MemoryLimit:false SwapLimit:false KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:false CPUCfsQuota:false CPUShares:false CPUSet:false PidsLimit:false IPv4Forwarding:false BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:0 OomKillDisable:false NGoroutines:0 SystemTime:0001-01-01 00:00:00 +0000 UTC LoggingDriver: CgroupDriver: NEventsListener:0 KernelVersion: OperatingSystem: OSType: Architecture: IndexServerAddress: RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[] IndexConfigs:{DockerIo:{Name: Mirrors:[] Secure:false Official:false}} Mirrors:[]} NCPU:0 MemTotal:0 GenericResources:<nil> DockerRootDir: HTTPProxy: HTTPSProxy: NoProxy: Name: Labels:[] ExperimentalBuild:fals

e ServerVersion: ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:}} DefaultRuntime: Swarm:{NodeID: NodeAddr: LocalNodeState: ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary: ContainerdCommit:{ID: Expected:} RuncCommit:{ID: Expected:} InitCommit:{ID: Expected:} SecurityOptions:[] ProductLicense: Warnings:<nil> ServerErrors:[Error response from daemon: Bad response from Docker engine] ClientInfo:{Debug:false Plugins:[map[Experimental:true Name:app Path:/usr/local/lib/docker/cli-plugins/docker-app SchemaVersion:0.1.0 ShortDescription:Docker App Vendor:Docker Inc. Version:v0.9.1-beta3] map[Name:buildx Path:/usr/local/lib/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Build with BuildKit Vendor:Docker Inc. Version:v0.5.1-docker] map[Name:compose Path:/usr/local/lib/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:2.0.0-beta.1] map[Name:scan Path:/usr/local/lib/docker/cli-pl

ugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.8.0]] Warnings:<nil>}}

	I1117 17:06:53.489139   42213 cli_runner.go:115] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" kubernetes-upgrade-20211117170535-31976

	W1117 17:06:53.602437   42213 cli_runner.go:162] docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" kubernetes-upgrade-20211117170535-31976 returned with exit code 1

	I1117 17:06:53.602544   42213 ssh_runner.go:152] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I1117 17:06:53.602617   42213 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20211117170535-31976

	W1117 17:06:53.725618   42213 cli_runner.go:162] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20211117170535-31976 returned with exit code 1

	I1117 17:06:53.725714   42213 retry.go:31] will retry after 276.165072ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "kubernetes-upgrade-20211117170535-31976": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20211117170535-31976: exit status 1

	stdout:

	stderr:

	Error response from daemon: Bad response from Docker engine

	I1117 17:06:54.003912   42213 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20211117170535-31976

	W1117 17:06:54.124594   42213 cli_runner.go:162] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20211117170535-31976 returned with exit code 1

	I1117 17:06:54.124670   42213 retry.go:31] will retry after 540.190908ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "kubernetes-upgrade-20211117170535-31976": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20211117170535-31976: exit status 1

	stdout:

	stderr:

	Error response from daemon: Bad response from Docker engine

	I1117 17:06:54.674331   42213 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20211117170535-31976

	W1117 17:06:54.797671   42213 cli_runner.go:162] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20211117170535-31976 returned with exit code 1

	I1117 17:06:54.797760   42213 retry.go:31] will retry after 655.06503ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "kubernetes-upgrade-20211117170535-31976": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20211117170535-31976: exit status 1

	stdout:

	stderr:

	Error response from daemon: Bad response from Docker engine

	I1117 17:06:55.454169   42213 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20211117170535-31976

	W1117 17:06:55.574394   42213 cli_runner.go:162] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20211117170535-31976 returned with exit code 1

	W1117 17:06:55.574474   42213 start.go:257] error running df -h /var: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "kubernetes-upgrade-20211117170535-31976": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20211117170535-31976: exit status 1

	stdout:

	stderr:

	Error response from daemon: Bad response from Docker engine

	W1117 17:06:55.574495   42213 start.go:239] error getting percentage of /var that is free: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "kubernetes-upgrade-20211117170535-31976": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20211117170535-31976: exit status 1

	stdout:

	stderr:

	Error response from daemon: Bad response from Docker engine

	I1117 17:06:55.574506   42213 fix.go:57] fixHost completed within 3.708253072s

	I1117 17:06:55.574515   42213 start.go:80] releasing machines lock for "kubernetes-upgrade-20211117170535-31976", held for 3.708290894s

	W1117 17:06:55.574528   42213 start.go:532] error starting host: inspecting NetworkSettings.Networks: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" kubernetes-upgrade-20211117170535-31976: exit status 1

	stdout:

	stderr:

	Error response from daemon: Bad response from Docker engine

	W1117 17:06:55.574629   42213 out.go:241] ! StartHost failed, but will try again: inspecting NetworkSettings.Networks: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" kubernetes-upgrade-20211117170535-31976: exit status 1

	stdout:

	stderr:

	Error response from daemon: Bad response from Docker engine

	! StartHost failed, but will try again: inspecting NetworkSettings.Networks: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" kubernetes-upgrade-20211117170535-31976: exit status 1

	stdout:

	stderr:

	Error response from daemon: Bad response from Docker engine

	I1117 17:06:55.574637   42213 start.go:547] Will try again in 5 seconds ...

	I1117 17:07:00.574920   42213 start.go:313] acquiring machines lock for kubernetes-upgrade-20211117170535-31976: {Name:mk9072703b78acf3b7213aadf906ddf9902cea7c Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I1117 17:07:00.575053   42213 start.go:317] acquired machines lock for "kubernetes-upgrade-20211117170535-31976" in 98.876µs

	I1117 17:07:00.575074   42213 start.go:93] Skipping create...Using existing machine configuration

	I1117 17:07:00.575078   42213 fix.go:55] fixHost starting: 

	I1117 17:07:00.575377   42213 cli_runner.go:115] Run: docker container inspect kubernetes-upgrade-20211117170535-31976 --format={{.State.Status}}

	W1117 17:07:00.698108   42213 cli_runner.go:162] docker container inspect kubernetes-upgrade-20211117170535-31976 --format={{.State.Status}} returned with exit code 1

	I1117 17:07:00.698157   42213 fix.go:108] recreateIfNeeded on kubernetes-upgrade-20211117170535-31976: state= err=unknown state "kubernetes-upgrade-20211117170535-31976": docker container inspect kubernetes-upgrade-20211117170535-31976 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: Bad response from Docker engine

	I1117 17:07:00.698170   42213 fix.go:113] machineExists: false. err=machine does not exist

	I1117 17:07:00.725135   42213 out.go:176] * docker "kubernetes-upgrade-20211117170535-31976" container is missing, will recreate.

	I1117 17:07:00.725189   42213 delete.go:124] DEMOLISHING kubernetes-upgrade-20211117170535-31976 ...

	I1117 17:07:00.725392   42213 cli_runner.go:115] Run: docker container inspect kubernetes-upgrade-20211117170535-31976 --format={{.State.Status}}

	W1117 17:07:00.861868   42213 cli_runner.go:162] docker container inspect kubernetes-upgrade-20211117170535-31976 --format={{.State.Status}} returned with exit code 1

	W1117 17:07:00.861911   42213 stop.go:75] unable to get state: unknown state "kubernetes-upgrade-20211117170535-31976": docker container inspect kubernetes-upgrade-20211117170535-31976 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: Bad response from Docker engine

	I1117 17:07:00.861936   42213 delete.go:129] stophost failed (probably ok): ssh power off: unknown state "kubernetes-upgrade-20211117170535-31976": docker container inspect kubernetes-upgrade-20211117170535-31976 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: Bad response from Docker engine

	I1117 17:07:00.862364   42213 cli_runner.go:115] Run: docker container inspect kubernetes-upgrade-20211117170535-31976 --format={{.State.Status}}

	W1117 17:07:00.978129   42213 cli_runner.go:162] docker container inspect kubernetes-upgrade-20211117170535-31976 --format={{.State.Status}} returned with exit code 1

	I1117 17:07:00.978172   42213 delete.go:82] Unable to get host status for kubernetes-upgrade-20211117170535-31976, assuming it has already been deleted: state: unknown state "kubernetes-upgrade-20211117170535-31976": docker container inspect kubernetes-upgrade-20211117170535-31976 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: Bad response from Docker engine

	I1117 17:07:00.978260   42213 cli_runner.go:115] Run: docker container inspect -f {{.Id}} kubernetes-upgrade-20211117170535-31976

	W1117 17:07:01.092880   42213 cli_runner.go:162] docker container inspect -f {{.Id}} kubernetes-upgrade-20211117170535-31976 returned with exit code 1

	I1117 17:07:01.092911   42213 kic.go:360] could not find the container kubernetes-upgrade-20211117170535-31976 to remove it. will try anyways

	I1117 17:07:01.092996   42213 cli_runner.go:115] Run: docker container inspect kubernetes-upgrade-20211117170535-31976 --format={{.State.Status}}

	W1117 17:07:01.209201   42213 cli_runner.go:162] docker container inspect kubernetes-upgrade-20211117170535-31976 --format={{.State.Status}} returned with exit code 1

	W1117 17:07:01.209238   42213 oci.go:83] error getting container status, will try to delete anyways: unknown state "kubernetes-upgrade-20211117170535-31976": docker container inspect kubernetes-upgrade-20211117170535-31976 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: Bad response from Docker engine

	I1117 17:07:01.209322   42213 cli_runner.go:115] Run: docker exec --privileged -t kubernetes-upgrade-20211117170535-31976 /bin/bash -c "sudo init 0"

	W1117 17:07:01.322461   42213 cli_runner.go:162] docker exec --privileged -t kubernetes-upgrade-20211117170535-31976 /bin/bash -c "sudo init 0" returned with exit code 1

	I1117 17:07:01.322486   42213 oci.go:651] error shutdown kubernetes-upgrade-20211117170535-31976: docker exec --privileged -t kubernetes-upgrade-20211117170535-31976 /bin/bash -c "sudo init 0": exit status 1

	stdout:

	stderr:

	Error response from daemon: Bad response from Docker engine

	I1117 17:07:02.326114   42213 cli_runner.go:115] Run: docker container inspect kubernetes-upgrade-20211117170535-31976 --format={{.State.Status}}

	W1117 17:07:02.442126   42213 cli_runner.go:162] docker container inspect kubernetes-upgrade-20211117170535-31976 --format={{.State.Status}} returned with exit code 1

	I1117 17:07:02.442165   42213 oci.go:663] temporary error verifying shutdown: unknown state "kubernetes-upgrade-20211117170535-31976": docker container inspect kubernetes-upgrade-20211117170535-31976 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: Bad response from Docker engine

	I1117 17:07:02.442173   42213 oci.go:665] temporary error: container kubernetes-upgrade-20211117170535-31976 status is  but expect it to be exited

	I1117 17:07:02.442195   42213 retry.go:31] will retry after 462.318748ms: couldn't verify container is exited. %v: unknown state "kubernetes-upgrade-20211117170535-31976": docker container inspect kubernetes-upgrade-20211117170535-31976 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: Bad response from Docker engine

	I1117 17:07:02.912951   42213 cli_runner.go:115] Run: docker container inspect kubernetes-upgrade-20211117170535-31976 --format={{.State.Status}}

	W1117 17:07:03.031243   42213 cli_runner.go:162] docker container inspect kubernetes-upgrade-20211117170535-31976 --format={{.State.Status}} returned with exit code 1

	I1117 17:07:03.031288   42213 oci.go:663] temporary error verifying shutdown: unknown state "kubernetes-upgrade-20211117170535-31976": docker container inspect kubernetes-upgrade-20211117170535-31976 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: Bad response from Docker engine

	I1117 17:07:03.031301   42213 oci.go:665] temporary error: container kubernetes-upgrade-20211117170535-31976 status is  but expect it to be exited

	I1117 17:07:03.031332   42213 retry.go:31] will retry after 890.117305ms: couldn't verify container is exited. %v: unknown state "kubernetes-upgrade-20211117170535-31976": docker container inspect kubernetes-upgrade-20211117170535-31976 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: Bad response from Docker engine

	I1117 17:07:03.924515   42213 cli_runner.go:115] Run: docker container inspect kubernetes-upgrade-20211117170535-31976 --format={{.State.Status}}

	W1117 17:07:04.042733   42213 cli_runner.go:162] docker container inspect kubernetes-upgrade-20211117170535-31976 --format={{.State.Status}} returned with exit code 1

	I1117 17:07:04.042773   42213 oci.go:663] temporary error verifying shutdown: unknown state "kubernetes-upgrade-20211117170535-31976": docker container inspect kubernetes-upgrade-20211117170535-31976 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: Bad response from Docker engine

	I1117 17:07:04.042781   42213 oci.go:665] temporary error: container kubernetes-upgrade-20211117170535-31976 status is  but expect it to be exited

	I1117 17:07:04.042805   42213 retry.go:31] will retry after 636.341646ms: couldn't verify container is exited. %v: unknown state "kubernetes-upgrade-20211117170535-31976": docker container inspect kubernetes-upgrade-20211117170535-31976 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: Bad response from Docker engine

	I1117 17:07:04.679507   42213 cli_runner.go:115] Run: docker container inspect kubernetes-upgrade-20211117170535-31976 --format={{.State.Status}}

	W1117 17:07:04.801314   42213 cli_runner.go:162] docker container inspect kubernetes-upgrade-20211117170535-31976 --format={{.State.Status}} returned with exit code 1

	I1117 17:07:04.801351   42213 oci.go:663] temporary error verifying shutdown: unknown state "kubernetes-upgrade-20211117170535-31976": docker container inspect kubernetes-upgrade-20211117170535-31976 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: Bad response from Docker engine

	I1117 17:07:04.801358   42213 oci.go:665] temporary error: container kubernetes-upgrade-20211117170535-31976 status is  but expect it to be exited

	I1117 17:07:04.801382   42213 retry.go:31] will retry after 1.107876242s: couldn't verify container is exited. %v: unknown state "kubernetes-upgrade-20211117170535-31976": docker container inspect kubernetes-upgrade-20211117170535-31976 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: Bad response from Docker engine

	I1117 17:07:05.916094   42213 cli_runner.go:115] Run: docker container inspect kubernetes-upgrade-20211117170535-31976 --format={{.State.Status}}

	W1117 17:07:06.030465   42213 cli_runner.go:162] docker container inspect kubernetes-upgrade-20211117170535-31976 --format={{.State.Status}} returned with exit code 1

	I1117 17:07:06.030502   42213 oci.go:663] temporary error verifying shutdown: unknown state "kubernetes-upgrade-20211117170535-31976": docker container inspect kubernetes-upgrade-20211117170535-31976 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: Bad response from Docker engine

	I1117 17:07:06.030512   42213 oci.go:665] temporary error: container kubernetes-upgrade-20211117170535-31976 status is  but expect it to be exited

	I1117 17:07:06.030543   42213 retry.go:31] will retry after 1.511079094s: couldn't verify container is exited. %v: unknown state "kubernetes-upgrade-20211117170535-31976": docker container inspect kubernetes-upgrade-20211117170535-31976 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: Bad response from Docker engine

	I1117 17:07:07.552029   42213 cli_runner.go:115] Run: docker container inspect kubernetes-upgrade-20211117170535-31976 --format={{.State.Status}}

	W1117 17:07:07.669793   42213 cli_runner.go:162] docker container inspect kubernetes-upgrade-20211117170535-31976 --format={{.State.Status}} returned with exit code 1

	I1117 17:07:07.669838   42213 oci.go:663] temporary error verifying shutdown: unknown state "kubernetes-upgrade-20211117170535-31976": docker container inspect kubernetes-upgrade-20211117170535-31976 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: Bad response from Docker engine

	I1117 17:07:07.669855   42213 oci.go:665] temporary error: container kubernetes-upgrade-20211117170535-31976 status is  but expect it to be exited

	I1117 17:07:07.669885   42213 retry.go:31] will retry after 3.04096222s: couldn't verify container is exited. %v: unknown state "kubernetes-upgrade-20211117170535-31976": docker container inspect kubernetes-upgrade-20211117170535-31976 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: Bad response from Docker engine

	I1117 17:07:10.714642   42213 cli_runner.go:115] Run: docker container inspect kubernetes-upgrade-20211117170535-31976 --format={{.State.Status}}

	W1117 17:07:10.845215   42213 cli_runner.go:162] docker container inspect kubernetes-upgrade-20211117170535-31976 --format={{.State.Status}} returned with exit code 1

	I1117 17:07:10.845252   42213 oci.go:663] temporary error verifying shutdown: unknown state "kubernetes-upgrade-20211117170535-31976": docker container inspect kubernetes-upgrade-20211117170535-31976 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: Bad response from Docker engine

	I1117 17:07:10.845259   42213 oci.go:665] temporary error: container kubernetes-upgrade-20211117170535-31976 status is  but expect it to be exited

	I1117 17:07:10.845282   42213 retry.go:31] will retry after 5.781953173s: couldn't verify container is exited. %v: unknown state "kubernetes-upgrade-20211117170535-31976": docker container inspect kubernetes-upgrade-20211117170535-31976 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: Bad response from Docker engine

	I1117 17:07:16.627792   42213 cli_runner.go:115] Run: docker container inspect kubernetes-upgrade-20211117170535-31976 --format={{.State.Status}}

	W1117 17:07:16.746605   42213 cli_runner.go:162] docker container inspect kubernetes-upgrade-20211117170535-31976 --format={{.State.Status}} returned with exit code 1

	I1117 17:07:16.746646   42213 oci.go:663] temporary error verifying shutdown: unknown state "kubernetes-upgrade-20211117170535-31976": docker container inspect kubernetes-upgrade-20211117170535-31976 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: Bad response from Docker engine

	I1117 17:07:16.746653   42213 oci.go:665] temporary error: container kubernetes-upgrade-20211117170535-31976 status is  but expect it to be exited

	I1117 17:07:16.746688   42213 oci.go:87] couldn't shut down kubernetes-upgrade-20211117170535-31976 (might be okay): verify shutdown: couldn't verify container is exited. %v: unknown state "kubernetes-upgrade-20211117170535-31976": docker container inspect kubernetes-upgrade-20211117170535-31976 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: Bad response from Docker engine

	I1117 17:07:16.746769   42213 cli_runner.go:115] Run: docker rm -f -v kubernetes-upgrade-20211117170535-31976

	W1117 17:07:16.862743   42213 cli_runner.go:162] docker rm -f -v kubernetes-upgrade-20211117170535-31976 returned with exit code 1

	I1117 17:07:16.862866   42213 cli_runner.go:115] Run: docker container inspect -f {{.Id}} kubernetes-upgrade-20211117170535-31976

	W1117 17:07:16.978253   42213 cli_runner.go:162] docker container inspect -f {{.Id}} kubernetes-upgrade-20211117170535-31976 returned with exit code 1

	I1117 17:07:16.978363   42213 cli_runner.go:115] Run: docker network inspect kubernetes-upgrade-20211117170535-31976 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"

	W1117 17:07:17.089943   42213 cli_runner.go:162] docker network inspect kubernetes-upgrade-20211117170535-31976 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1

	I1117 17:07:17.090053   42213 network_create.go:254] running [docker network inspect kubernetes-upgrade-20211117170535-31976] to gather additional debugging logs...

	I1117 17:07:17.090068   42213 cli_runner.go:115] Run: docker network inspect kubernetes-upgrade-20211117170535-31976

	W1117 17:07:17.204149   42213 cli_runner.go:162] docker network inspect kubernetes-upgrade-20211117170535-31976 returned with exit code 1

	I1117 17:07:17.204173   42213 network_create.go:257] error running [docker network inspect kubernetes-upgrade-20211117170535-31976]: docker network inspect kubernetes-upgrade-20211117170535-31976: exit status 1

	stdout:

	[]

	stderr:

	Error response from daemon: Bad response from Docker engine

	I1117 17:07:17.204187   42213 network_create.go:259] output of [docker network inspect kubernetes-upgrade-20211117170535-31976]: -- stdout --

	[]

	-- /stdout --

	** stderr ** 

	Error response from daemon: Bad response from Docker engine

	** /stderr **

	W1117 17:07:17.204202   42213 network_create.go:284] Error inspecting docker network kubernetes-upgrade-20211117170535-31976: docker network inspect kubernetes-upgrade-20211117170535-31976 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}": exit status 1

	stdout:

	stderr:

	Error response from daemon: Bad response from Docker engine

	W1117 17:07:17.204558   42213 delete.go:139] delete failed (probably ok) <nil>

	I1117 17:07:17.204565   42213 fix.go:120] Sleeping 1 second for extra luck!

	I1117 17:07:18.207305   42213 start.go:126] createHost starting for "" (driver="docker")

	I1117 17:07:18.282955   42213 out.go:203] * Creating docker container (CPUs=2, Memory=2200MB) ...

	I1117 17:07:18.283137   42213 start.go:160] libmachine.API.Create for "kubernetes-upgrade-20211117170535-31976" (driver="docker")

	I1117 17:07:18.283183   42213 client.go:168] LocalClient.Create starting

	I1117 17:07:18.283353   42213 main.go:130] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/certs/ca.pem

	I1117 17:07:18.283604   42213 main.go:130] libmachine: Decoding PEM data...

	I1117 17:07:18.283647   42213 main.go:130] libmachine: Parsing certificate...

	I1117 17:07:18.283801   42213 main.go:130] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/certs/cert.pem

	I1117 17:07:18.304803   42213 main.go:130] libmachine: Decoding PEM data...

	I1117 17:07:18.304837   42213 main.go:130] libmachine: Parsing certificate...

	I1117 17:07:18.305751   42213 cli_runner.go:115] Run: docker network inspect kubernetes-upgrade-20211117170535-31976 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"

	W1117 17:07:18.423985   42213 cli_runner.go:162] docker network inspect kubernetes-upgrade-20211117170535-31976 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1

	I1117 17:07:18.424097   42213 network_create.go:254] running [docker network inspect kubernetes-upgrade-20211117170535-31976] to gather additional debugging logs...

	I1117 17:07:18.424116   42213 cli_runner.go:115] Run: docker network inspect kubernetes-upgrade-20211117170535-31976

	W1117 17:07:18.536585   42213 cli_runner.go:162] docker network inspect kubernetes-upgrade-20211117170535-31976 returned with exit code 1

	I1117 17:07:18.536611   42213 network_create.go:257] error running [docker network inspect kubernetes-upgrade-20211117170535-31976]: docker network inspect kubernetes-upgrade-20211117170535-31976: exit status 1

	stdout:

	[]

	stderr:

	Error response from daemon: Bad response from Docker engine

	I1117 17:07:18.536632   42213 network_create.go:259] output of [docker network inspect kubernetes-upgrade-20211117170535-31976]: -- stdout --

	[]

	-- /stdout --

	** stderr ** 

	Error response from daemon: Bad response from Docker engine

	** /stderr **

	I1117 17:07:18.536716   42213 cli_runner.go:115] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"

	W1117 17:07:18.649614   42213 cli_runner.go:162] docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1

	I1117 17:07:18.649750   42213 network_create.go:254] running [docker network inspect bridge] to gather additional debugging logs...

	I1117 17:07:18.649784   42213 cli_runner.go:115] Run: docker network inspect bridge

	W1117 17:07:18.764966   42213 cli_runner.go:162] docker network inspect bridge returned with exit code 1

	I1117 17:07:18.764992   42213 network_create.go:257] error running [docker network inspect bridge]: docker network inspect bridge: exit status 1

	stdout:

	[]

	stderr:

	Error response from daemon: Bad response from Docker engine

	I1117 17:07:18.765003   42213 network_create.go:259] output of [docker network inspect bridge]: -- stdout --

	[]

	-- /stdout --

	** stderr ** 

	Error response from daemon: Bad response from Docker engine

	** /stderr **

	W1117 17:07:18.765010   42213 network_create.go:75] failed to get mtu information from the docker's default network "bridge": docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}": exit status 1

	stdout:

	stderr:

	Error response from daemon: Bad response from Docker engine

	I1117 17:07:18.765230   42213 network.go:288] reserving subnet 192.168.49.0 for 1m0s: &{mu:{state:0 sema:0} read:{v:{m:map[] amended:true}} dirty:map[192.168.49.0:0xc0005a6110] misses:0}

	I1117 17:07:18.765255   42213 network.go:235] using free private subnet 192.168.49.0/24: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:}}

	I1117 17:07:18.765271   42213 network_create.go:106] attempt to create docker network kubernetes-upgrade-20211117170535-31976 192.168.49.0/24 with gateway 192.168.49.1 and MTU of 0 ...

	I1117 17:07:18.765349   42213 cli_runner.go:115] Run: docker network create --driver=bridge --subnet=192.168.49.0/24 --gateway=192.168.49.1 -o --ip-masq -o --icc --label=created_by.minikube.sigs.k8s.io=true kubernetes-upgrade-20211117170535-31976

	W1117 17:07:18.877964   42213 cli_runner.go:162] docker network create --driver=bridge --subnet=192.168.49.0/24 --gateway=192.168.49.1 -o --ip-masq -o --icc --label=created_by.minikube.sigs.k8s.io=true kubernetes-upgrade-20211117170535-31976 returned with exit code 1

	E1117 17:07:18.878015   42213 network_create.go:95] error while trying to create docker network kubernetes-upgrade-20211117170535-31976 192.168.49.0/24: create docker network kubernetes-upgrade-20211117170535-31976 192.168.49.0/24 with gateway 192.168.49.1 and MTU of 0: docker network create --driver=bridge --subnet=192.168.49.0/24 --gateway=192.168.49.1 -o --ip-masq -o --icc --label=created_by.minikube.sigs.k8s.io=true kubernetes-upgrade-20211117170535-31976: exit status 1

	stdout:

	stderr:

	Error response from daemon: Bad response from Docker engine

	W1117 17:07:18.878162   42213 out.go:241] ! Unable to create dedicated network, this might result in cluster IP change after restart: un-retryable: create docker network kubernetes-upgrade-20211117170535-31976 192.168.49.0/24 with gateway 192.168.49.1 and MTU of 0: docker network create --driver=bridge --subnet=192.168.49.0/24 --gateway=192.168.49.1 -o --ip-masq -o --icc --label=created_by.minikube.sigs.k8s.io=true kubernetes-upgrade-20211117170535-31976: exit status 1

	stdout:

	stderr:

	Error response from daemon: Bad response from Docker engine

	! Unable to create dedicated network, this might result in cluster IP change after restart: un-retryable: create docker network kubernetes-upgrade-20211117170535-31976 192.168.49.0/24 with gateway 192.168.49.1 and MTU of 0: docker network create --driver=bridge --subnet=192.168.49.0/24 --gateway=192.168.49.1 -o --ip-masq -o --icc --label=created_by.minikube.sigs.k8s.io=true kubernetes-upgrade-20211117170535-31976: exit status 1

	stdout:

	stderr:

	Error response from daemon: Bad response from Docker engine

	I1117 17:07:18.878277   42213 cli_runner.go:115] Run: docker ps -a --format {{.Names}}

	W1117 17:07:18.994646   42213 cli_runner.go:162] docker ps -a --format {{.Names}} returned with exit code 1

	W1117 17:07:18.994676   42213 kic.go:149] failed to check if container already exists: docker ps -a --format {{.Names}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: Bad response from Docker engine

	I1117 17:07:18.994769   42213 cli_runner.go:115] Run: docker volume create kubernetes-upgrade-20211117170535-31976 --label name.minikube.sigs.k8s.io=kubernetes-upgrade-20211117170535-31976 --label created_by.minikube.sigs.k8s.io=true

	W1117 17:07:19.109297   42213 cli_runner.go:162] docker volume create kubernetes-upgrade-20211117170535-31976 --label name.minikube.sigs.k8s.io=kubernetes-upgrade-20211117170535-31976 --label created_by.minikube.sigs.k8s.io=true returned with exit code 1

	I1117 17:07:19.109339   42213 client.go:171] LocalClient.Create took 826.13022ms

	I1117 17:07:21.115680   42213 ssh_runner.go:152] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I1117 17:07:21.115838   42213 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20211117170535-31976

	W1117 17:07:21.230804   42213 cli_runner.go:162] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20211117170535-31976 returned with exit code 1

	I1117 17:07:21.230882   42213 retry.go:31] will retry after 178.565968ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "kubernetes-upgrade-20211117170535-31976": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20211117170535-31976: exit status 1

	stdout:

	stderr:

	Error response from daemon: Bad response from Docker engine

	I1117 17:07:21.410252   42213 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20211117170535-31976

	W1117 17:07:21.526439   42213 cli_runner.go:162] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20211117170535-31976 returned with exit code 1

	I1117 17:07:21.526527   42213 retry.go:31] will retry after 330.246446ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "kubernetes-upgrade-20211117170535-31976": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20211117170535-31976: exit status 1

	stdout:

	stderr:

	Error response from daemon: Bad response from Docker engine

	I1117 17:07:21.859203   42213 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20211117170535-31976

	W1117 17:07:21.979700   42213 cli_runner.go:162] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20211117170535-31976 returned with exit code 1

	I1117 17:07:21.979785   42213 retry.go:31] will retry after 460.157723ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "kubernetes-upgrade-20211117170535-31976": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20211117170535-31976: exit status 1

	stdout:

	stderr:

	Error response from daemon: Bad response from Docker engine

	I1117 17:07:22.440613   42213 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20211117170535-31976

	W1117 17:07:22.555457   42213 cli_runner.go:162] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20211117170535-31976 returned with exit code 1

	W1117 17:07:22.555546   42213 start.go:257] error running df -h /var: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "kubernetes-upgrade-20211117170535-31976": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20211117170535-31976: exit status 1

	stdout:

	stderr:

	Error response from daemon: Bad response from Docker engine

	W1117 17:07:22.555575   42213 start.go:239] error getting percentage of /var that is free: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "kubernetes-upgrade-20211117170535-31976": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20211117170535-31976: exit status 1

	stdout:

	stderr:

	Error response from daemon: Bad response from Docker engine

	I1117 17:07:22.555599   42213 start.go:129] duration metric: createHost completed in 4.34814707s

	I1117 17:07:22.555658   42213 ssh_runner.go:152] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I1117 17:07:22.555709   42213 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20211117170535-31976

	W1117 17:07:22.667949   42213 cli_runner.go:162] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20211117170535-31976 returned with exit code 1

	I1117 17:07:22.668030   42213 retry.go:31] will retry after 195.758538ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "kubernetes-upgrade-20211117170535-31976": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20211117170535-31976: exit status 1

	stdout:

	stderr:

	Error response from daemon: Bad response from Docker engine

	I1117 17:07:22.865551   42213 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20211117170535-31976

	W1117 17:07:22.979098   42213 cli_runner.go:162] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20211117170535-31976 returned with exit code 1

	I1117 17:07:22.979187   42213 retry.go:31] will retry after 297.413196ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "kubernetes-upgrade-20211117170535-31976": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20211117170535-31976: exit status 1

	stdout:

	stderr:

	Error response from daemon: Bad response from Docker engine

	I1117 17:07:23.282713   42213 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20211117170535-31976

	W1117 17:07:23.402324   42213 cli_runner.go:162] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20211117170535-31976 returned with exit code 1

	I1117 17:07:23.402401   42213 retry.go:31] will retry after 663.23513ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "kubernetes-upgrade-20211117170535-31976": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20211117170535-31976: exit status 1

	stdout:

	stderr:

	Error response from daemon: Bad response from Docker engine

	I1117 17:07:24.065859   42213 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20211117170535-31976

	W1117 17:07:24.180619   42213 cli_runner.go:162] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20211117170535-31976 returned with exit code 1

	W1117 17:07:24.180700   42213 start.go:257] error running df -h /var: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "kubernetes-upgrade-20211117170535-31976": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20211117170535-31976: exit status 1

	stdout:

	stderr:

	Error response from daemon: Bad response from Docker engine

	W1117 17:07:24.180723   42213 start.go:239] error getting percentage of /var that is free: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "kubernetes-upgrade-20211117170535-31976": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20211117170535-31976: exit status 1

	stdout:

	stderr:

	Error response from daemon: Bad response from Docker engine

	I1117 17:07:24.180734   42213 fix.go:57] fixHost completed within 23.60512594s

	I1117 17:07:24.180744   42213 start.go:80] releasing machines lock for "kubernetes-upgrade-20211117170535-31976", held for 23.605153823s

	W1117 17:07:24.180884   42213 out.go:241] * Failed to start docker container. Running "minikube delete -p kubernetes-upgrade-20211117170535-31976" may fix it: recreate: creating host: create: creating: setting up container node: creating volume for kubernetes-upgrade-20211117170535-31976 container: docker volume create kubernetes-upgrade-20211117170535-31976 --label name.minikube.sigs.k8s.io=kubernetes-upgrade-20211117170535-31976 --label created_by.minikube.sigs.k8s.io=true: exit status 1

	stdout:

	stderr:

	Error response from daemon: Bad response from Docker engine

	* Failed to start docker container. Running "minikube delete -p kubernetes-upgrade-20211117170535-31976" may fix it: recreate: creating host: create: creating: setting up container node: creating volume for kubernetes-upgrade-20211117170535-31976 container: docker volume create kubernetes-upgrade-20211117170535-31976 --label name.minikube.sigs.k8s.io=kubernetes-upgrade-20211117170535-31976 --label created_by.minikube.sigs.k8s.io=true: exit status 1

	stdout:

	stderr:

	Error response from daemon: Bad response from Docker engine

	I1117 17:07:24.207631   42213 out.go:176] 

	W1117 17:07:24.207883   42213 out.go:241] X Exiting due to GUEST_PROVISION: Failed to start host: recreate: creating host: create: creating: setting up container node: creating volume for kubernetes-upgrade-20211117170535-31976 container: docker volume create kubernetes-upgrade-20211117170535-31976 --label name.minikube.sigs.k8s.io=kubernetes-upgrade-20211117170535-31976 --label created_by.minikube.sigs.k8s.io=true: exit status 1

	stdout:

	stderr:

	Error response from daemon: Bad response from Docker engine

	X Exiting due to GUEST_PROVISION: Failed to start host: recreate: creating host: create: creating: setting up container node: creating volume for kubernetes-upgrade-20211117170535-31976 container: docker volume create kubernetes-upgrade-20211117170535-31976 --label name.minikube.sigs.k8s.io=kubernetes-upgrade-20211117170535-31976 --label created_by.minikube.sigs.k8s.io=true: exit status 1

	stdout:

	stderr:

	Error response from daemon: Bad response from Docker engine

	W1117 17:07:24.207899   42213 out.go:241] * 

	* 

	W1117 17:07:24.208954   42213 out.go:241] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	I1117 17:07:24.307525   42213 out.go:176] 

** /stderr **

version_upgrade_test.go:252: failed to upgrade with newest k8s version. args: out/minikube-darwin-amd64 start -p kubernetes-upgrade-20211117170535-31976 --memory=2200 --kubernetes-version=v1.22.4-rc.0 --alsologtostderr -v=1 --driver=docker  : exit status 80

version_upgrade_test.go:255: (dbg) Run:  kubectl --context kubernetes-upgrade-20211117170535-31976 version --output=json

version_upgrade_test.go:255: (dbg) Non-zero exit: kubectl --context kubernetes-upgrade-20211117170535-31976 version --output=json: exit status 1 (40.274404ms)

** stderr ** 

	error: context "kubernetes-upgrade-20211117170535-31976" does not exist

** /stderr **

version_upgrade_test.go:257: error running kubectl: exit status 1

panic.go:642: *** TestKubernetesUpgrade FAILED at 2021-11-17 17:07:24.379121 -0800 PST m=+3416.177109272

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:230: ======>  post-mortem[TestKubernetesUpgrade]: docker inspect <======

helpers_test.go:231: (dbg) Run:  docker inspect kubernetes-upgrade-20211117170535-31976

helpers_test.go:231: (dbg) Non-zero exit: docker inspect kubernetes-upgrade-20211117170535-31976: exit status 1 (117.735288ms)

-- stdout --

	[]

-- /stdout --

** stderr ** 

	Error response from daemon: Bad response from Docker engine

** /stderr **

helpers_test.go:233: failed to get docker inspect: exit status 1

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p kubernetes-upgrade-20211117170535-31976 -n kubernetes-upgrade-20211117170535-31976

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p kubernetes-upgrade-20211117170535-31976 -n kubernetes-upgrade-20211117170535-31976: exit status 7 (156.285854ms)

-- stdout --

	Nonexistent

-- /stdout --

** stderr ** 

	E1117 17:07:24.652058   42478 status.go:247] status error: host: state: unknown state "kubernetes-upgrade-20211117170535-31976": docker container inspect kubernetes-upgrade-20211117170535-31976 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: Bad response from Docker engine

** /stderr **

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "kubernetes-upgrade-20211117170535-31976" host is not running, skipping log retrieval (state="Nonexistent")

helpers_test.go:175: Cleaning up "kubernetes-upgrade-20211117170535-31976" profile ...

helpers_test.go:178: (dbg) Run:  out/minikube-darwin-amd64 delete -p kubernetes-upgrade-20211117170535-31976

--- FAIL: TestKubernetesUpgrade (110.04s)

=== RUN   TestStoppedBinaryUpgrade/Upgrade

version_upgrade_test.go:190: (dbg) Run:  /var/folders/xd/3vdzn10d2gb_wxr7lj_p8h5c0000gp/T/minikube-v1.9.0.1704274414.exe start -p stopped-upgrade-20211117170633-31976 --memory=2200 --vm-driver=docker 

=== CONT  TestStoppedBinaryUpgrade/Upgrade

version_upgrade_test.go:190: (dbg) Non-zero exit: /var/folders/xd/3vdzn10d2gb_wxr7lj_p8h5c0000gp/T/minikube-v1.9.0.1704274414.exe start -p stopped-upgrade-20211117170633-31976 --memory=2200 --vm-driver=docker : exit status 70 (2m24.993119099s)

-- stdout --

	* [stopped-upgrade-20211117170633-31976] minikube v1.9.0 on Darwin 11.2.3

	  - MINIKUBE_LOCATION=12739

	  - MINIKUBE_BIN=out/minikube-darwin-amd64

	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube

	  - KUBECONFIG=/var/folders/xd/3vdzn10d2gb_wxr7lj_p8h5c0000gp/T/legacy_kubeconfig1694200434

	* Using the docker driver based on user configuration

	* Pulling base image ...

	* Downloading Kubernetes v1.18.0 preload ...

	* Creating Kubernetes in docker container with (CPUs=2) (6 available), Memory=2200MB (5945MB available) ...

	! StartHost failed, but will try again: creating host: create host timed out in 120.000000 seconds

	* docker "stopped-upgrade-20211117170633-31976" container is missing, will recreate.

	* Creating Kubernetes in docker container with (CPUs=2) (0 available), Memory=2200MB (0MB available) ...

	* StartHost failed again: recreate: creating host: create: creating: create kic node: creating volume for stopped-upgrade-20211117170633-31976 container: output Error response from daemon: Bad response from Docker engine

	: exit status 1

	  - Run: "minikube delete -p stopped-upgrade-20211117170633-31976", then "minikube start -p stopped-upgrade-20211117170633-31976 --alsologtostderr -v=1" to try again with more logging

-- /stdout --

** stderr ** 

	    > preloaded-images-k8s-v2-v1.18.0-docker-overlay2-amd64.tar.lz4: 8.00 MiB /    > preloaded-images-k8s-v2-v1.18.0-docker-overlay2-amd64.tar.lz4: 8.00 MiB /    > preloaded-images-k8s-v2-v1.18.0-docker-overlay2-amd64.tar.lz4: 19.42 MiB     > preloaded-images-k8s-v2-v1.18.0-docker-overlay2-amd64.tar.lz4: 41.20 MiB     > preloaded-images-k8s-v2-v1.18.0-docker-overlay2-amd64.tar.lz4: 62.67 MiB     > preloaded-images-k8s-v2-v1.18.0-docker-overlay2-amd64.tar.lz4: 85.69 MiB     > preloaded-images-k8s-v2-v1.18.0-docker-overlay2-amd64.tar.lz4: 107.03 MiB    > preloaded-images-k8s-v2-v1.18.0-docker-overlay2-amd64.tar.lz4: 129.23 MiB    > preloaded-images-k8s-v2-v1.18.0-docker-overlay2-amd64.tar.lz4: 149.95 MiB    > preloaded-images-k8s-v2-v1.18.0-docker-overlay2-amd64.tar.lz4: 170.14 MiB    > preloaded-images-k8s-v2-v1.18.0-docker-overlay2-amd64.tar.lz4: 190.31 MiB    > preloaded-images-k8s-v2-v1.18.0-docker-overlay2-amd64.tar.lz4: 212.12 MiB    > preloaded-images-k8s-v2-v1.18.0-docker-overlay2-amd64.tar.lz4

: 226.17 MiB    > preloaded-images-k8s-v2-v1.18.0-docker-overlay2-amd64.tar.lz4: 246.92 MiB    > preloaded-images-k8s-v2-v1.18.0-docker-overlay2-amd64.tar.lz4: 270.12 MiB    > preloaded-images-k8s-v2-v1.18.0-docker-overlay2-amd64.tar.lz4: 290.89 MiB    > preloaded-images-k8s-v2-v1.18.0-docker-overlay2-amd64.tar.lz4: 313.98 MiB    > preloaded-images-k8s-v2-v1.18.0-docker-overlay2-amd64.tar.lz4: 334.88 MiB    > preloaded-images-k8s-v2-v1.18.0-docker-overlay2-amd64.tar.lz4: 357.17 MiB    > preloaded-images-k8s-v2-v1.18.0-docker-overlay2-amd64.tar.lz4: 379.09 MiB    > preloaded-images-k8s-v2-v1.18.0-docker-overlay2-amd64.tar.lz4: 401.45 MiB    > preloaded-images-k8s-v2-v1.18.0-docker-overlay2-amd64.tar.lz4: 423.39 MiB    > preloaded-images-k8s-v2-v1.18.0-docker-overlay2-amd64.tar.lz4: 446.05 MiB    > preloaded-images-k8s-v2-v1.18.0-docker-overlay2-amd64.tar.lz4: 466.75 MiB    > preloaded-images-k8s-v2-v1.18.0-docker-overlay2-amd64.tar.lz4: 487.69 MiB    > preloaded-images-k8s-v2-v1.18.0-docker-overlay2-amd64.tar.

lz4: 496.22 MiB    > preloaded-images-k8s-v2-v1.18.0-docker-overlay2-amd64.tar.lz4: 513.44 MiB    > preloaded-images-k8s-v2-v1.18.0-docker-overlay2-amd64.tar.lz4: 527.91 MiB    > preloaded-images-k8s-v2-v1.18.0-docker-overlay2-amd64.tar.lz4: 539.48 MiB    > preloaded-images-k8s-v2-v1.18.0-docker-overlay2-amd64.tar.lz4: 542.91 MiB* 

	X Unable to start VM after repeated tries. Please try {{'minikube delete' if possible: recreate: creating host: create: creating: create kic node: creating volume for stopped-upgrade-20211117170633-31976 container: output Error response from daemon: Bad response from Docker engine

	: exit status 1

	* 

	* minikube is exiting due to an error. If the above message is not useful, open an issue:

	  - https://github.com/kubernetes/minikube/issues/new/choose

** /stderr **

version_upgrade_test.go:190: (dbg) Run:  /var/folders/xd/3vdzn10d2gb_wxr7lj_p8h5c0000gp/T/minikube-v1.9.0.1704274414.exe start -p stopped-upgrade-20211117170633-31976 --memory=2200 --vm-driver=docker 

=== CONT  TestStoppedBinaryUpgrade/Upgrade

version_upgrade_test.go:190: (dbg) Non-zero exit: /var/folders/xd/3vdzn10d2gb_wxr7lj_p8h5c0000gp/T/minikube-v1.9.0.1704274414.exe start -p stopped-upgrade-20211117170633-31976 --memory=2200 --vm-driver=docker : exit status 70 (42.511018983s)

-- stdout --

	* [stopped-upgrade-20211117170633-31976] minikube v1.9.0 on Darwin 11.2.3

	  - MINIKUBE_LOCATION=12739

	  - MINIKUBE_BIN=out/minikube-darwin-amd64

	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube

	  - KUBECONFIG=/var/folders/xd/3vdzn10d2gb_wxr7lj_p8h5c0000gp/T/legacy_kubeconfig1931650060

	* Using the docker driver based on existing profile

	* Pulling base image ...

	* docker "stopped-upgrade-20211117170633-31976" container is missing, will recreate.

	* Creating Kubernetes in docker container with (CPUs=2) (0 available), Memory=2200MB (0MB available) ...

	! StartHost failed, but will try again: recreate: creating host: create: creating: create kic node: creating volume for stopped-upgrade-20211117170633-31976 container: output Error response from daemon: Bad response from Docker engine

	: exit status 1

	* docker "stopped-upgrade-20211117170633-31976" container is missing, will recreate.

	* Creating Kubernetes in docker container with (CPUs=2) (0 available), Memory=2200MB (0MB available) ...

	* StartHost failed again: recreate: creating host: create: creating: create kic node: creating volume for stopped-upgrade-20211117170633-31976 container: output Error response from daemon: Bad response from Docker engine

	: exit status 1

	  - Run: "minikube delete -p stopped-upgrade-20211117170633-31976", then "minikube start -p stopped-upgrade-20211117170633-31976 --alsologtostderr -v=1" to try again with more logging

-- /stdout --

** stderr ** 

	! 'docker' driver reported an issue: exit status 1

	* Suggestion: Docker is not running or is responding too slow. Try: restarting docker desktop.

	E1117 17:09:03.005406   42785 cache.go:114] Error downloading kic artifacts:  error loading image: Error response from daemon: Bad response from Docker engine

	* 

	X Unable to start VM after repeated tries. Please try {{'minikube delete' if possible: recreate: creating host: create: creating: create kic node: creating volume for stopped-upgrade-20211117170633-31976 container: output Error response from daemon: Bad response from Docker engine

	: exit status 1

	* 

	* minikube is exiting due to an error. If the above message is not useful, open an issue:

	  - https://github.com/kubernetes/minikube/issues/new/choose

** /stderr **

version_upgrade_test.go:190: (dbg) Run:  /var/folders/xd/3vdzn10d2gb_wxr7lj_p8h5c0000gp/T/minikube-v1.9.0.1704274414.exe start -p stopped-upgrade-20211117170633-31976 --memory=2200 --vm-driver=docker 

E1117 17:09:52.520381   31976 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/profiles/skaffold-20211117170024-31976/client.crt: no such file or directory

=== CONT  TestStoppedBinaryUpgrade/Upgrade

version_upgrade_test.go:190: (dbg) Non-zero exit: /var/folders/xd/3vdzn10d2gb_wxr7lj_p8h5c0000gp/T/minikube-v1.9.0.1704274414.exe start -p stopped-upgrade-20211117170633-31976 --memory=2200 --vm-driver=docker : exit status 70 (42.338819502s)

-- stdout --

	* [stopped-upgrade-20211117170633-31976] minikube v1.9.0 on Darwin 11.2.3

	  - MINIKUBE_LOCATION=12739

	  - MINIKUBE_BIN=out/minikube-darwin-amd64

	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube

	  - KUBECONFIG=/var/folders/xd/3vdzn10d2gb_wxr7lj_p8h5c0000gp/T/legacy_kubeconfig2650525672

	* Using the docker driver based on existing profile

	* Pulling base image ...

	* docker "stopped-upgrade-20211117170633-31976" container is missing, will recreate.

	* Creating Kubernetes in docker container with (CPUs=2) (0 available), Memory=2200MB (0MB available) ...

	! StartHost failed, but will try again: recreate: creating host: create: creating: create kic node: creating volume for stopped-upgrade-20211117170633-31976 container: output Error response from daemon: Bad response from Docker engine

	: exit status 1

	* docker "stopped-upgrade-20211117170633-31976" container is missing, will recreate.

	* Creating Kubernetes in docker container with (CPUs=2) (0 available), Memory=2200MB (0MB available) ...

	* StartHost failed again: recreate: creating host: create: creating: create kic node: creating volume for stopped-upgrade-20211117170633-31976 container: output Error response from daemon: Bad response from Docker engine

	: exit status 1

	  - Run: "minikube delete -p stopped-upgrade-20211117170633-31976", then "minikube start -p stopped-upgrade-20211117170633-31976 --alsologtostderr -v=1" to try again with more logging

-- /stdout --

** stderr ** 

	! 'docker' driver reported an issue: exit status 1

	* Suggestion: Docker is not running or is responding too slow. Try: restarting docker desktop.

	E1117 17:09:46.761296   43167 cache.go:114] Error downloading kic artifacts:  error loading image: Error response from daemon: Bad response from Docker engine

	* 

	X Unable to start VM after repeated tries. Please try {{'minikube delete' if possible: recreate: creating host: create: creating: create kic node: creating volume for stopped-upgrade-20211117170633-31976 container: output Error response from daemon: Bad response from Docker engine

	: exit status 1

	* 

	* minikube is exiting due to an error. If the above message is not useful, open an issue:

	  - https://github.com/kubernetes/minikube/issues/new/choose

** /stderr **

version_upgrade_test.go:196: legacy v1.9.0 start failed: exit status 70

--- FAIL: TestStoppedBinaryUpgrade/Upgrade (232.10s)

=== RUN   TestStoppedBinaryUpgrade/MinikubeLogs

version_upgrade_test.go:213: (dbg) Run:  out/minikube-darwin-amd64 logs -p stopped-upgrade-20211117170633-31976

version_upgrade_test.go:213: (dbg) Non-zero exit: out/minikube-darwin-amd64 logs -p stopped-upgrade-20211117170633-31976: exit status 80 (477.475526ms)

-- stdout --

	* 

	* ==> Audit <==

	* |------------|-------------------------------------------------------------|-------------------------------------------|----------|---------|-------------------------------|-------------------------------|

	|  Command   |                            Args                             |                  Profile                  |   User   | Version |          Start Time           |           End Time            |

	|------------|-------------------------------------------------------------|-------------------------------------------|----------|---------|-------------------------------|-------------------------------|

	| stop       | -p                                                          | mount-start-2-20211117163347-31976        | jenkins  | v1.24.0 | Wed, 17 Nov 2021 16:36:13 PST | Wed, 17 Nov 2021 16:36:31 PST |

	|            | mount-start-2-20211117163347-31976                          |                                           |          |         |                               |                               |

	| start      | -p                                                          | mount-start-2-20211117163347-31976        | jenkins  | v1.24.0 | Wed, 17 Nov 2021 16:36:31 PST | Wed, 17 Nov 2021 16:37:19 PST |

	|            | mount-start-2-20211117163347-31976                          |                                           |          |         |                               |                               |

	| -p         | mount-start-2-20211117163347-31976                          | mount-start-2-20211117163347-31976        | jenkins  | v1.24.0 | Wed, 17 Nov 2021 16:37:19 PST | Wed, 17 Nov 2021 16:37:20 PST |

	|            | ssh ls /minikube-host                                       |                                           |          |         |                               |                               |

	| delete     | -p                                                          | mount-start-2-20211117163347-31976        | jenkins  | v1.24.0 | Wed, 17 Nov 2021 16:37:20 PST | Wed, 17 Nov 2021 16:37:33 PST |

	|            | mount-start-2-20211117163347-31976                          |                                           |          |         |                               |                               |

	| delete     | -p                                                          | mount-start-1-20211117163347-31976        | jenkins  | v1.24.0 | Wed, 17 Nov 2021 16:37:33 PST | Wed, 17 Nov 2021 16:37:34 PST |

	|            | mount-start-1-20211117163347-31976                          |                                           |          |         |                               |                               |

	| start      | -p                                                          | multinode-20211117163734-31976            | jenkins  | v1.24.0 | Wed, 17 Nov 2021 16:37:34 PST | Wed, 17 Nov 2021 16:41:11 PST |

	|            | multinode-20211117163734-31976                              |                                           |          |         |                               |                               |

	|            | --wait=true --memory=2200                                   |                                           |          |         |                               |                               |

	|            | --nodes=2 -v=8                                              |                                           |          |         |                               |                               |

	|            | --alsologtostderr                                           |                                           |          |         |                               |                               |

	|            | --driver=docker                                             |                                           |          |         |                               |                               |

	| kubectl    | -p multinode-20211117163734-31976 -- apply -f               | multinode-20211117163734-31976            | jenkins  | v1.24.0 | Wed, 17 Nov 2021 16:41:12 PST | Wed, 17 Nov 2021 16:41:14 PST |

	|            | ./testdata/multinodes/multinode-pod-dns-test.yaml           |                                           |          |         |                               |                               |

	| kubectl    | -p                                                          | multinode-20211117163734-31976            | jenkins  | v1.24.0 | Wed, 17 Nov 2021 16:41:14 PST | Wed, 17 Nov 2021 16:41:17 PST |

	|            | multinode-20211117163734-31976                              |                                           |          |         |                               |                               |

	|            | -- rollout status                                           |                                           |          |         |                               |                               |

	|            | deployment/busybox                                          |                                           |          |         |                               |                               |

	| kubectl    | -p multinode-20211117163734-31976                           | multinode-20211117163734-31976            | jenkins  | v1.24.0 | Wed, 17 Nov 2021 16:41:17 PST | Wed, 17 Nov 2021 16:41:17 PST |

	|            | -- get pods -o                                              |                                           |          |         |                               |                               |

	|            | jsonpath='{.items[*].status.podIP}'                         |                                           |          |         |                               |                               |

	| kubectl    | -p multinode-20211117163734-31976                           | multinode-20211117163734-31976            | jenkins  | v1.24.0 | Wed, 17 Nov 2021 16:41:17 PST | Wed, 17 Nov 2021 16:41:17 PST |

	|            | -- get pods -o                                              |                                           |          |         |                               |                               |

	|            | jsonpath='{.items[*].metadata.name}'                        |                                           |          |         |                               |                               |

	| kubectl    | -p                                                          | multinode-20211117163734-31976            | jenkins  | v1.24.0 | Wed, 17 Nov 2021 16:41:17 PST | Wed, 17 Nov 2021 16:41:17 PST |

	|            | multinode-20211117163734-31976                              |                                           |          |         |                               |                               |

	|            | -- exec                                                     |                                           |          |         |                               |                               |

	|            | busybox-84b6686758-55jx9 --                                 |                                           |          |         |                               |                               |

	|            | nslookup kubernetes.io                                      |                                           |          |         |                               |                               |

	| kubectl    | -p                                                          | multinode-20211117163734-31976            | jenkins  | v1.24.0 | Wed, 17 Nov 2021 16:41:17 PST | Wed, 17 Nov 2021 16:41:18 PST |

	|            | multinode-20211117163734-31976                              |                                           |          |         |                               |                               |

	|            | -- exec                                                     |                                           |          |         |                               |                               |

	|            | busybox-84b6686758-g894g --                                 |                                           |          |         |                               |                               |

	|            | nslookup kubernetes.io                                      |                                           |          |         |                               |                               |

	| kubectl    | -p                                                          | multinode-20211117163734-31976            | jenkins  | v1.24.0 | Wed, 17 Nov 2021 16:41:18 PST | Wed, 17 Nov 2021 16:41:18 PST |

	|            | multinode-20211117163734-31976                              |                                           |          |         |                               |                               |

	|            | -- exec                                                     |                                           |          |         |                               |                               |

	|            | busybox-84b6686758-55jx9 --                                 |                                           |          |         |                               |                               |

	|            | nslookup kubernetes.default                                 |                                           |          |         |                               |                               |

	| kubectl    | -p                                                          | multinode-20211117163734-31976            | jenkins  | v1.24.0 | Wed, 17 Nov 2021 16:41:18 PST | Wed, 17 Nov 2021 16:41:18 PST |

	|            | multinode-20211117163734-31976                              |                                           |          |         |                               |                               |

	|            | -- exec                                                     |                                           |          |         |                               |                               |

	|            | busybox-84b6686758-g894g --                                 |                                           |          |         |                               |                               |

	|            | nslookup kubernetes.default                                 |                                           |          |         |                               |                               |

	| kubectl    | -p multinode-20211117163734-31976                           | multinode-20211117163734-31976            | jenkins  | v1.24.0 | Wed, 17 Nov 2021 16:41:18 PST | Wed, 17 Nov 2021 16:41:18 PST |

	|            | -- exec busybox-84b6686758-55jx9                            |                                           |          |         |                               |                               |

	|            | -- nslookup                                                 |                                           |          |         |                               |                               |

	|            | kubernetes.default.svc.cluster.local                        |                                           |          |         |                               |                               |

	| kubectl    | -p multinode-20211117163734-31976                           | multinode-20211117163734-31976            | jenkins  | v1.24.0 | Wed, 17 Nov 2021 16:41:18 PST | Wed, 17 Nov 2021 16:41:18 PST |

	|            | -- exec busybox-84b6686758-g894g                            |                                           |          |         |                               |                               |

	|            | -- nslookup                                                 |                                           |          |         |                               |                               |

	|            | kubernetes.default.svc.cluster.local                        |                                           |          |         |                               |                               |

	| kubectl    | -p multinode-20211117163734-31976                           | multinode-20211117163734-31976            | jenkins  | v1.24.0 | Wed, 17 Nov 2021 16:41:18 PST | Wed, 17 Nov 2021 16:41:18 PST |

	|            | -- get pods -o                                              |                                           |          |         |                               |                               |

	|            | jsonpath='{.items[*].metadata.name}'                        |                                           |          |         |                               |                               |

	| kubectl    | -p                                                          | multinode-20211117163734-31976            | jenkins  | v1.24.0 | Wed, 17 Nov 2021 16:41:19 PST | Wed, 17 Nov 2021 16:41:19 PST |

	|            | multinode-20211117163734-31976                              |                                           |          |         |                               |                               |

	|            | -- exec                                                     |                                           |          |         |                               |                               |

	|            | busybox-84b6686758-55jx9                                    |                                           |          |         |                               |                               |

	|            | -- sh -c nslookup                                           |                                           |          |         |                               |                               |

	|            | host.minikube.internal | awk                                |                                           |          |         |                               |                               |

	|            | 'NR==5' | cut -d' ' -f3                                     |                                           |          |         |                               |                               |

	| kubectl    | -p                                                          | multinode-20211117163734-31976            | jenkins  | v1.24.0 | Wed, 17 Nov 2021 16:41:19 PST | Wed, 17 Nov 2021 16:41:19 PST |

	|            | multinode-20211117163734-31976                              |                                           |          |         |                               |                               |

	|            | -- exec                                                     |                                           |          |         |                               |                               |

	|            | busybox-84b6686758-55jx9 -- sh                              |                                           |          |         |                               |                               |

	|            | -c ping -c 1 192.168.65.2                                   |                                           |          |         |                               |                               |

	| kubectl    | -p                                                          | multinode-20211117163734-31976            | jenkins  | v1.24.0 | Wed, 17 Nov 2021 16:41:19 PST | Wed, 17 Nov 2021 16:41:19 PST |

	|            | multinode-20211117163734-31976                              |                                           |          |         |                               |                               |

	|            | -- exec                                                     |                                           |          |         |                               |                               |

	|            | busybox-84b6686758-g894g                                    |                                           |          |         |                               |                               |

	|            | -- sh -c nslookup                                           |                                           |          |         |                               |                               |

	|            | host.minikube.internal | awk                                |                                           |          |         |                               |                               |

	|            | 'NR==5' | cut -d' ' -f3                                     |                                           |          |         |                               |                               |

	| kubectl    | -p                                                          | multinode-20211117163734-31976            | jenkins  | v1.24.0 | Wed, 17 Nov 2021 16:41:19 PST | Wed, 17 Nov 2021 16:41:19 PST |

	|            | multinode-20211117163734-31976                              |                                           |          |         |                               |                               |

	|            | -- exec                                                     |                                           |          |         |                               |                               |

	|            | busybox-84b6686758-g894g -- sh                              |                                           |          |         |                               |                               |

	|            | -c ping -c 1 192.168.65.2                                   |                                           |          |         |                               |                               |

	| node       | add -p                                                      | multinode-20211117163734-31976            | jenkins  | v1.24.0 | Wed, 17 Nov 2021 16:41:19 PST | Wed, 17 Nov 2021 16:43:05 PST |

	|            | multinode-20211117163734-31976                              |                                           |          |         |                               |                               |

	|            | -v 3 --alsologtostderr                                      |                                           |          |         |                               |                               |

	| profile    | list --output json                                          | minikube                                  | jenkins  | v1.24.0 | Wed, 17 Nov 2021 16:43:07 PST | Wed, 17 Nov 2021 16:43:07 PST |

	| -p         | multinode-20211117163734-31976                              | multinode-20211117163734-31976            | jenkins  | v1.24.0 | Wed, 17 Nov 2021 16:43:09 PST | Wed, 17 Nov 2021 16:43:10 PST |

	|            | cp testdata/cp-test.txt                                     |                                           |          |         |                               |                               |

	|            | /home/docker/cp-test.txt                                    |                                           |          |         |                               |                               |

	| -p         | multinode-20211117163734-31976                              | multinode-20211117163734-31976            | jenkins  | v1.24.0 | Wed, 17 Nov 2021 16:43:10 PST | Wed, 17 Nov 2021 16:43:10 PST |

	|            | ssh sudo cat                                                |                                           |          |         |                               |                               |

	|            | /home/docker/cp-test.txt                                    |                                           |          |         |                               |                               |

	| -p         | multinode-20211117163734-31976 cp testdata/cp-test.txt      | multinode-20211117163734-31976            | jenkins  | v1.24.0 | Wed, 17 Nov 2021 16:43:10 PST | Wed, 17 Nov 2021 16:43:11 PST |

	|            | multinode-20211117163734-31976-m02:/home/docker/cp-test.txt |                                           |          |         |                               |                               |

	| -p         | multinode-20211117163734-31976                              | multinode-20211117163734-31976            | jenkins  | v1.24.0 | Wed, 17 Nov 2021 16:43:11 PST | Wed, 17 Nov 2021 16:43:11 PST |

	|            | ssh -n                                                      |                                           |          |         |                               |                               |

	|            | multinode-20211117163734-31976-m02                          |                                           |          |         |                               |                               |

	|            | sudo cat /home/docker/cp-test.txt                           |                                           |          |         |                               |                               |

	| -p         | multinode-20211117163734-31976 cp testdata/cp-test.txt      | multinode-20211117163734-31976            | jenkins  | v1.24.0 | Wed, 17 Nov 2021 16:43:11 PST | Wed, 17 Nov 2021 16:43:12 PST |

	|            | multinode-20211117163734-31976-m03:/home/docker/cp-test.txt |                                           |          |         |                               |                               |

	| -p         | multinode-20211117163734-31976                              | multinode-20211117163734-31976            | jenkins  | v1.24.0 | Wed, 17 Nov 2021 16:43:12 PST | Wed, 17 Nov 2021 16:43:13 PST |

	|            | ssh -n                                                      |                                           |          |         |                               |                               |

	|            | multinode-20211117163734-31976-m03                          |                                           |          |         |                               |                               |

	|            | sudo cat /home/docker/cp-test.txt                           |                                           |          |         |                               |                               |

	| -p         | multinode-20211117163734-31976                              | multinode-20211117163734-31976            | jenkins  | v1.24.0 | Wed, 17 Nov 2021 16:43:13 PST | Wed, 17 Nov 2021 16:43:22 PST |

	|            | node stop m03                                               |                                           |          |         |                               |                               |

	| -p         | multinode-20211117163734-31976                              | multinode-20211117163734-31976            | jenkins  | v1.24.0 | Wed, 17 Nov 2021 16:43:25 PST | Wed, 17 Nov 2021 16:44:17 PST |

	|            | node start m03                                              |                                           |          |         |                               |                               |

	|            | --alsologtostderr                                           |                                           |          |         |                               |                               |

	| stop       | -p                                                          | multinode-20211117163734-31976            | jenkins  | v1.24.0 | Wed, 17 Nov 2021 16:44:18 PST | Wed, 17 Nov 2021 16:44:58 PST |

	|            | multinode-20211117163734-31976                              |                                           |          |         |                               |                               |

	| start      | -p                                                          | multinode-20211117163734-31976            | jenkins  | v1.24.0 | Wed, 17 Nov 2021 16:44:58 PST | Wed, 17 Nov 2021 16:48:28 PST |

	|            | multinode-20211117163734-31976                              |                                           |          |         |                               |                               |

	|            | --wait=true -v=8                                            |                                           |          |         |                               |                               |

	|            | --alsologtostderr                                           |                                           |          |         |                               |                               |

	| -p         | multinode-20211117163734-31976                              | multinode-20211117163734-31976            | jenkins  | v1.24.0 | Wed, 17 Nov 2021 16:48:28 PST | Wed, 17 Nov 2021 16:48:43 PST |

	|            | node delete m03                                             |                                           |          |         |                               |                               |

	| -p         | multinode-20211117163734-31976                              | multinode-20211117163734-31976            | jenkins  | v1.24.0 | Wed, 17 Nov 2021 16:48:46 PST | Wed, 17 Nov 2021 16:49:21 PST |

	|            | stop                                                        |                                           |          |         |                               |                               |

	| start      | -p                                                          | multinode-20211117163734-31976            | jenkins  | v1.24.0 | Wed, 17 Nov 2021 16:49:21 PST | Wed, 17 Nov 2021 16:51:49 PST |

	|            | multinode-20211117163734-31976                              |                                           |          |         |                               |                               |

	|            | --wait=true -v=8                                            |                                           |          |         |                               |                               |

	|            | --alsologtostderr                                           |                                           |          |         |                               |                               |

	|            | --driver=docker                                             |                                           |          |         |                               |                               |

	| start      | -p                                                          | multinode-20211117163734-31976-m03        | jenkins  | v1.24.0 | Wed, 17 Nov 2021 16:51:52 PST | Wed, 17 Nov 2021 16:53:11 PST |

	|            | multinode-20211117163734-31976-m03                          |                                           |          |         |                               |                               |

	|            | --driver=docker                                             |                                           |          |         |                               |                               |

	| delete     | -p                                                          | multinode-20211117163734-31976-m03        | jenkins  | v1.24.0 | Wed, 17 Nov 2021 16:53:11 PST | Wed, 17 Nov 2021 16:53:27 PST |

	|            | multinode-20211117163734-31976-m03                          |                                           |          |         |                               |                               |

	| delete     | -p                                                          | multinode-20211117163734-31976            | jenkins  | v1.24.0 | Wed, 17 Nov 2021 16:53:27 PST | Wed, 17 Nov 2021 16:53:51 PST |

	|            | multinode-20211117163734-31976                              |                                           |          |         |                               |                               |

	| start      | -p                                                          | test-preload-20211117165351-31976         | jenkins  | v1.24.0 | Wed, 17 Nov 2021 16:53:51 PST | Wed, 17 Nov 2021 16:56:39 PST |

	|            | test-preload-20211117165351-31976                           |                                           |          |         |                               |                               |

	|            | --memory=2200 --alsologtostderr                             |                                           |          |         |                               |                               |

	|            | --wait=true --preload=false                                 |                                           |          |         |                               |                               |

	|            | --driver=docker                                             |                                           |          |         |                               |                               |

	|            | --kubernetes-version=v1.17.0                                |                                           |          |         |                               |                               |

	| ssh        | -p                                                          | test-preload-20211117165351-31976         | jenkins  | v1.24.0 | Wed, 17 Nov 2021 16:56:39 PST | Wed, 17 Nov 2021 16:56:42 PST |

	|            | test-preload-20211117165351-31976                           |                                           |          |         |                               |                               |

	|            | -- docker pull busybox                                      |                                           |          |         |                               |                               |

	| start      | -p                                                          | test-preload-20211117165351-31976         | jenkins  | v1.24.0 | Wed, 17 Nov 2021 16:56:43 PST | Wed, 17 Nov 2021 16:57:36 PST |

	|            | test-preload-20211117165351-31976                           |                                           |          |         |                               |                               |

	|            | --memory=2200 --alsologtostderr                             |                                           |          |         |                               |                               |

	|            | -v=1 --wait=true --driver=docker                            |                                           |          |         |                               |                               |

	|            | --kubernetes-version=v1.17.3                                |                                           |          |         |                               |                               |

	| ssh        | -p                                                          | test-preload-20211117165351-31976         | jenkins  | v1.24.0 | Wed, 17 Nov 2021 16:57:36 PST | Wed, 17 Nov 2021 16:57:37 PST |

	|            | test-preload-20211117165351-31976                           |                                           |          |         |                               |                               |

	|            | -- docker images                                            |                                           |          |         |                               |                               |

	| delete     | -p                                                          | test-preload-20211117165351-31976         | jenkins  | v1.24.0 | Wed, 17 Nov 2021 16:57:37 PST | Wed, 17 Nov 2021 16:57:50 PST |

	|            | test-preload-20211117165351-31976                           |                                           |          |         |                               |                               |

	| start      | -p                                                          | scheduled-stop-20211117165750-31976       | jenkins  | v1.24.0 | Wed, 17 Nov 2021 16:57:50 PST | Wed, 17 Nov 2021 16:59:05 PST |

	|            | scheduled-stop-20211117165750-31976                         |                                           |          |         |                               |                               |

	|            | --memory=2048 --driver=docker                               |                                           |          |         |                               |                               |

	| stop       | -p                                                          | scheduled-stop-20211117165750-31976       | jenkins  | v1.24.0 | Wed, 17 Nov 2021 16:59:06 PST | Wed, 17 Nov 2021 16:59:06 PST |

	|            | scheduled-stop-20211117165750-31976                         |                                           |          |         |                               |                               |

	|            | --cancel-scheduled                                          |                                           |          |         |                               |                               |

	| stop       | -p                                                          | scheduled-stop-20211117165750-31976       | jenkins  | v1.24.0 | Wed, 17 Nov 2021 16:59:33 PST | Wed, 17 Nov 2021 17:00:05 PST |

	|            | scheduled-stop-20211117165750-31976                         |                                           |          |         |                               |                               |

	|            | --schedule 15s                                              |                                           |          |         |                               |                               |

	| delete     | -p                                                          | scheduled-stop-20211117165750-31976       | jenkins  | v1.24.0 | Wed, 17 Nov 2021 17:00:18 PST | Wed, 17 Nov 2021 17:00:24 PST |

	|            | scheduled-stop-20211117165750-31976                         |                                           |          |         |                               |                               |

	| start      | -p                                                          | skaffold-20211117170024-31976             | jenkins  | v1.24.0 | Wed, 17 Nov 2021 17:00:26 PST | Wed, 17 Nov 2021 17:01:39 PST |

	|            | skaffold-20211117170024-31976                               |                                           |          |         |                               |                               |

	|            | --memory=2600 --driver=docker                               |                                           |          |         |                               |                               |

	| docker-env | --shell none -p                                             | skaffold-20211117170024-31976             | skaffold | v1.24.0 | Wed, 17 Nov 2021 17:01:40 PST | Wed, 17 Nov 2021 17:01:41 PST |

	|            | skaffold-20211117170024-31976                               |                                           |          |         |                               |                               |

	|            | --user=skaffold                                             |                                           |          |         |                               |                               |

	| delete     | -p                                                          | skaffold-20211117170024-31976             | jenkins  | v1.24.0 | Wed, 17 Nov 2021 17:02:18 PST | Wed, 17 Nov 2021 17:02:32 PST |

	|            | skaffold-20211117170024-31976                               |                                           |          |         |                               |                               |

	| delete     | -p                                                          | insufficient-storage-20211117170232-31976 | jenkins  | v1.24.0 | Wed, 17 Nov 2021 17:03:22 PST | Wed, 17 Nov 2021 17:03:34 PST |

	|            | insufficient-storage-20211117170232-31976                   |                                           |          |         |                               |                               |

	| delete     | -p                                                          | flannel-20211117170334-31976              | jenkins  | v1.24.0 | Wed, 17 Nov 2021 17:03:34 PST | Wed, 17 Nov 2021 17:03:35 PST |

	|            | flannel-20211117170334-31976                                |                                           |          |         |                               |                               |

	| start      | -p                                                          | offline-docker-20211117170334-31976       | jenkins  | v1.24.0 | Wed, 17 Nov 2021 17:03:34 PST | Wed, 17 Nov 2021 17:05:19 PST |

	|            | offline-docker-20211117170334-31976                         |                                           |          |         |                               |                               |

	|            | --alsologtostderr -v=1                                      |                                           |          |         |                               |                               |

	|            | --memory=2048 --wait=true                                   |                                           |          |         |                               |                               |

	|            | --driver=docker                                             |                                           |          |         |                               |                               |

	| delete     | -p                                                          | offline-docker-20211117170334-31976       | jenkins  | v1.24.0 | Wed, 17 Nov 2021 17:05:19 PST | Wed, 17 Nov 2021 17:05:35 PST |

	|            | offline-docker-20211117170334-31976                         |                                           |          |         |                               |                               |

	| start      | -p                                                          | missing-upgrade-20211117170335-31976      | jenkins  | v1.24.0 | Wed, 17 Nov 2021 17:05:01 PST | Wed, 17 Nov 2021 17:06:17 PST |

	|            | missing-upgrade-20211117170335-31976                        |                                           |          |         |                               |                               |

	|            | --memory=2200 --alsologtostderr -v=1                        |                                           |          |         |                               |                               |

	|            | --driver=docker                                             |                                           |          |         |                               |                               |

	| delete     | -p                                                          | missing-upgrade-20211117170335-31976      | jenkins  | v1.24.0 | Wed, 17 Nov 2021 17:06:17 PST | Wed, 17 Nov 2021 17:06:33 PST |

	|            | missing-upgrade-20211117170335-31976                        |                                           |          |         |                               |                               |

	| start      | -p                                                          | kubernetes-upgrade-20211117170535-31976   | jenkins  | v1.24.0 | Wed, 17 Nov 2021 17:05:35 PST | Wed, 17 Nov 2021 17:06:43 PST |

	|            | kubernetes-upgrade-20211117170535-31976                     |                                           |          |         |                               |                               |

	|            | --memory=2200                                               |                                           |          |         |                               |                               |

	|            | --kubernetes-version=v1.14.0                                |                                           |          |         |                               |                               |

	|            | --alsologtostderr -v=1 --driver=docker                      |                                           |          |         |                               |                               |

	| stop       | -p                                                          | kubernetes-upgrade-20211117170535-31976   | jenkins  | v1.24.0 | Wed, 17 Nov 2021 17:06:43 PST | Wed, 17 Nov 2021 17:06:50 PST |

	|            | kubernetes-upgrade-20211117170535-31976                     |                                           |          |         |                               |                               |

	| delete     | -p                                                          | kubernetes-upgrade-20211117170535-31976   | jenkins  | v1.24.0 | Wed, 17 Nov 2021 17:07:24 PST | Wed, 17 Nov 2021 17:07:25 PST |

	|            | kubernetes-upgrade-20211117170535-31976                     |                                           |          |         |                               |                               |

	|------------|-------------------------------------------------------------|-------------------------------------------|----------|---------|-------------------------------|-------------------------------|

	* 

	* ==> Last Start <==

	* Log file created at: 2021/11/17 17:06:50

	Running on machine: 37310

	Binary: Built with gc go1.17.3 for darwin/amd64

	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg

	I1117 17:06:50.775270   42213 out.go:297] Setting OutFile to fd 1 ...

	I1117 17:06:50.775448   42213 out.go:344] TERM=,COLORTERM=, which probably does not support color

	I1117 17:06:50.775454   42213 out.go:310] Setting ErrFile to fd 2...

	I1117 17:06:50.775458   42213 out.go:344] TERM=,COLORTERM=, which probably does not support color

	I1117 17:06:50.775549   42213 root.go:315] Updating PATH: /Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/bin

	I1117 17:06:50.775843   42213 out.go:304] Setting JSON to false

	I1117 17:06:50.812010   42213 start.go:112] hostinfo: {"hostname":"37310.local","uptime":11185,"bootTime":1637186425,"procs":373,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"11.2.3","kernelVersion":"20.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"bd1c05a8-24a6-5973-aa69-f3c7c66a87ce"}

	W1117 17:06:50.812131   42213 start.go:120] gopshost.Virtualization returned error: not implemented yet

	I1117 17:06:50.843714   42213 out.go:176] * [kubernetes-upgrade-20211117170535-31976] minikube v1.24.0 on Darwin 11.2.3

	I1117 17:06:50.843810   42213 notify.go:174] Checking for updates...

	I1117 17:06:50.844089   42213 preload.go:305] deleting older generation preload /Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v2-v1.18.0-docker-overlay2-amd64.tar.lz4

	I1117 17:06:50.898832   42213 out.go:176]   - MINIKUBE_LOCATION=12739

	I1117 17:06:50.898973   42213 preload.go:305] deleting older generation preload /Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v2-v1.18.0-docker-overlay2-amd64.tar.lz4.checksum

	I1117 17:06:50.924089   42213 out.go:176]   - KUBECONFIG=/Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/kubeconfig

	I1117 17:06:50.950286   42213 out.go:176]   - MINIKUBE_BIN=out/minikube-darwin-amd64

	I1117 17:06:50.976317   42213 out.go:176]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube

	I1117 17:06:50.976754   42213 config.go:176] Loaded profile config "kubernetes-upgrade-20211117170535-31976": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.14.0

	I1117 17:06:50.977101   42213 driver.go:343] Setting default libvirt URI to qemu:///system

	I1117 17:06:51.101331   42213 docker.go:132] docker version: linux-20.10.6

	I1117 17:06:51.101450   42213 cli_runner.go:115] Run: docker system info --format "{{json .}}"

	I1117 17:06:51.327924   42213 info.go:263] docker info: {ID:2AYQ:M3LP:F6GE:IPKK:4XGD:7ZUA:OVWC:XKGI:AARV:HKMV:IHBV:IRRJ Containers:3 ContainersRunning:2 ContainersPaused:0 ContainersStopped:1 Images:26 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:59 OomKillDisable:true NGoroutines:63 SystemTime:2021-11-18 01:06:51.239695789 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:4 KernelVersion:5.10.25-linuxkit OperatingSystem:Docker Desktop OSType:linux Architecture:x86_64 IndexServer

Address:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:6 MemTotal:6234726400 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy:http.docker.internal:3128 HTTPSProxy:http.docker.internal:3128 NoProxy: Name:docker-desktop Labels:[] ExperimentalBuild:false ServerVersion:20.10.6 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:05f951a3781f4f2c1911b05e61c160e9c30eaa8e Expected:05f951a3781f4f2c1911b05e61c160e9c30eaa8e} RuncCommit:{ID:12644e614e25b05da6fd08a38ffa0cfe1903fdec Expected:12644e614e25b05da6fd08a38ffa0cfe1903fdec} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=sec

comp,profile=default] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Experimental:true Name:app Path:/usr/local/lib/docker/cli-plugins/docker-app SchemaVersion:0.1.0 ShortDescription:Docker App Vendor:Docker Inc. Version:v0.9.1-beta3] map[Name:buildx Path:/usr/local/lib/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Build with BuildKit Vendor:Docker Inc. Version:v0.5.1-docker] map[Name:compose Path:/usr/local/lib/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:2.0.0-beta.1] map[Name:scan Path:/usr/local/lib/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.8.0]] Warnings:<nil>}}

	I1117 17:06:51.375238   42213 out.go:176] * Using the docker driver based on existing profile

	I1117 17:06:51.375302   42213 start.go:280] selected driver: docker

	I1117 17:06:51.375312   42213 start.go:775] validating driver "docker" against &{Name:kubernetes-upgrade-20211117170535-31976 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.28@sha256:4780f1897569d2bf77aafb3d133a08d42b4fe61127f06fcfc90c2c5d902d893c Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.14.0 ClusterName:kubernetes-upgrade-20211117170535-31976 Namespace:default APIServerName:mi

nikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.14.0 ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host}

	I1117 17:06:51.375441   42213 start.go:786] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc:}

	I1117 17:06:51.377948   42213 cli_runner.go:115] Run: docker system info --format "{{json .}}"

	I1117 17:06:51.612929   42213 info.go:263] docker info: {ID:2AYQ:M3LP:F6GE:IPKK:4XGD:7ZUA:OVWC:XKGI:AARV:HKMV:IHBV:IRRJ Containers:3 ContainersRunning:2 ContainersPaused:0 ContainersStopped:1 Images:26 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:59 OomKillDisable:true NGoroutines:63 SystemTime:2021-11-18 01:06:51.521850889 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:4 KernelVersion:5.10.25-linuxkit OperatingSystem:Docker Desktop OSType:linux Architecture:x86_64 IndexServer

Address:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:6 MemTotal:6234726400 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy:http.docker.internal:3128 HTTPSProxy:http.docker.internal:3128 NoProxy: Name:docker-desktop Labels:[] ExperimentalBuild:false ServerVersion:20.10.6 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:05f951a3781f4f2c1911b05e61c160e9c30eaa8e Expected:05f951a3781f4f2c1911b05e61c160e9c30eaa8e} RuncCommit:{ID:12644e614e25b05da6fd08a38ffa0cfe1903fdec Expected:12644e614e25b05da6fd08a38ffa0cfe1903fdec} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=sec

comp,profile=default] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Experimental:true Name:app Path:/usr/local/lib/docker/cli-plugins/docker-app SchemaVersion:0.1.0 ShortDescription:Docker App Vendor:Docker Inc. Version:v0.9.1-beta3] map[Name:buildx Path:/usr/local/lib/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Build with BuildKit Vendor:Docker Inc. Version:v0.5.1-docker] map[Name:compose Path:/usr/local/lib/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:2.0.0-beta.1] map[Name:scan Path:/usr/local/lib/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.8.0]] Warnings:<nil>}}

	I1117 17:06:51.613064   42213 cni.go:93] Creating CNI manager for ""

	I1117 17:06:51.613077   42213 cni.go:167] CNI unnecessary in this configuration, recommending no CNI

	I1117 17:06:51.613086   42213 start_flags.go:282] config:

	{Name:kubernetes-upgrade-20211117170535-31976 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.28@sha256:4780f1897569d2bf77aafb3d133a08d42b4fe61127f06fcfc90c2c5d902d893c Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.22.4-rc.0 ClusterName:kubernetes-upgrade-20211117170535-31976 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local Containe

rRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.14.0 ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host}

	I1117 17:06:51.660640   42213 out.go:176] * Starting control plane node kubernetes-upgrade-20211117170535-31976 in cluster kubernetes-upgrade-20211117170535-31976

	I1117 17:06:51.660681   42213 cache.go:118] Beginning downloading kic base image for docker with docker

	I1117 17:06:51.707437   42213 out.go:176] * Pulling base image ...

	I1117 17:06:51.707483   42213 preload.go:132] Checking if preload exists for k8s version v1.22.4-rc.0 and runtime docker

	I1117 17:06:51.707507   42213 image.go:75] Checking for gcr.io/k8s-minikube/kicbase:v0.0.28@sha256:4780f1897569d2bf77aafb3d133a08d42b4fe61127f06fcfc90c2c5d902d893c in local docker daemon

	I1117 17:06:51.707535   42213 preload.go:148] Found local preload: /Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v14-v1.22.4-rc.0-docker-overlay2-amd64.tar.lz4

	I1117 17:06:51.707557   42213 cache.go:57] Caching tarball of preloaded images

	I1117 17:06:51.707722   42213 preload.go:174] Found /Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v14-v1.22.4-rc.0-docker-overlay2-amd64.tar.lz4 in cache, skipping download

	I1117 17:06:51.707736   42213 cache.go:60] Finished verifying existence of preloaded tar for  v1.22.4-rc.0 on docker

	I1117 17:06:51.708438   42213 profile.go:147] Saving config to /Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/profiles/kubernetes-upgrade-20211117170535-31976/config.json ...

	I1117 17:06:51.865954   42213 image.go:79] Found gcr.io/k8s-minikube/kicbase:v0.0.28@sha256:4780f1897569d2bf77aafb3d133a08d42b4fe61127f06fcfc90c2c5d902d893c in local docker daemon, skipping pull

	I1117 17:06:51.865969   42213 cache.go:140] gcr.io/k8s-minikube/kicbase:v0.0.28@sha256:4780f1897569d2bf77aafb3d133a08d42b4fe61127f06fcfc90c2c5d902d893c exists in daemon, skipping load

	I1117 17:06:51.865982   42213 cache.go:206] Successfully downloaded all kic artifacts

	I1117 17:06:51.866041   42213 start.go:313] acquiring machines lock for kubernetes-upgrade-20211117170535-31976: {Name:mk9072703b78acf3b7213aadf906ddf9902cea7c Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I1117 17:06:51.866133   42213 start.go:317] acquired machines lock for "kubernetes-upgrade-20211117170535-31976" in 69.949µs

	I1117 17:06:51.866163   42213 start.go:93] Skipping create...Using existing machine configuration

	I1117 17:06:51.866172   42213 fix.go:55] fixHost starting: 

	I1117 17:06:51.866445   42213 cli_runner.go:115] Run: docker container inspect kubernetes-upgrade-20211117170535-31976 --format={{.State.Status}}

	I1117 17:06:52.002809   42213 fix.go:108] recreateIfNeeded on kubernetes-upgrade-20211117170535-31976: state=Stopped err=<nil>

	W1117 17:06:52.002849   42213 fix.go:134] unexpected machine state, will restart: <nil>

	I1117 17:06:52.029701   42213 out.go:176] * Restarting existing docker container for "kubernetes-upgrade-20211117170535-31976" ...

	I1117 17:06:52.029823   42213 cli_runner.go:115] Run: docker start kubernetes-upgrade-20211117170535-31976

	W1117 17:06:52.757923   42213 cli_runner.go:162] docker start kubernetes-upgrade-20211117170535-31976 returned with exit code 1

	I1117 17:06:52.758068   42213 cli_runner.go:115] Run: docker inspect kubernetes-upgrade-20211117170535-31976

	W1117 17:06:52.888984   42213 cli_runner.go:162] docker inspect kubernetes-upgrade-20211117170535-31976 returned with exit code 1

	W1117 17:06:52.889028   42213 errors.go:82] Failed to get postmortem inspect. docker inspect kubernetes-upgrade-20211117170535-31976 :docker inspect kubernetes-upgrade-20211117170535-31976: exit status 1

	stdout:

	[]

	stderr:

	Error response from daemon: Bad response from Docker engine

	I1117 17:06:52.889163   42213 cli_runner.go:115] Run: docker logs --timestamps --details kubernetes-upgrade-20211117170535-31976

	W1117 17:06:53.008402   42213 cli_runner.go:162] docker logs --timestamps --details kubernetes-upgrade-20211117170535-31976 returned with exit code 1

	W1117 17:06:53.008428   42213 errors.go:89] Failed to get postmortem logs. docker logs --timestamps --details kubernetes-upgrade-20211117170535-31976 :docker logs --timestamps --details kubernetes-upgrade-20211117170535-31976: exit status 1

	stdout:

	stderr:

	Error response from daemon: Bad response from Docker engine

	I1117 17:06:53.008510   42213 cli_runner.go:115] Run: docker system info --format "{{json .}}"

	I1117 17:06:53.182243   42213 info.go:263] docker info: {ID: Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:0 Driver: DriverStatus:[] SystemStatus:<nil> Plugins:{Volume:[] Network:[] Authorization:<nil> Log:[]} MemoryLimit:false SwapLimit:false KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:false CPUCfsQuota:false CPUShares:false CPUSet:false PidsLimit:false IPv4Forwarding:false BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:0 OomKillDisable:false NGoroutines:0 SystemTime:0001-01-01 00:00:00 +0000 UTC LoggingDriver: CgroupDriver: NEventsListener:0 KernelVersion: OperatingSystem: OSType: Architecture: IndexServerAddress: RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[] IndexConfigs:{DockerIo:{Name: Mirrors:[] Secure:false Official:false}} Mirrors:[]} NCPU:0 MemTotal:0 GenericResources:<nil> DockerRootDir: HTTPProxy: HTTPSProxy: NoProxy: Name: Labels:[] ExperimentalBuild:fals

e ServerVersion: ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:}} DefaultRuntime: Swarm:{NodeID: NodeAddr: LocalNodeState: ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary: ContainerdCommit:{ID: Expected:} RuncCommit:{ID: Expected:} InitCommit:{ID: Expected:} SecurityOptions:[] ProductLicense: Warnings:<nil> ServerErrors:[Error response from daemon: Bad response from Docker engine] ClientInfo:{Debug:false Plugins:[map[Experimental:true Name:app Path:/usr/local/lib/docker/cli-plugins/docker-app SchemaVersion:0.1.0 ShortDescription:Docker App Vendor:Docker Inc. Version:v0.9.1-beta3] map[Name:buildx Path:/usr/local/lib/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Build with BuildKit Vendor:Docker Inc. Version:v0.5.1-docker] map[Name:compose Path:/usr/local/lib/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:2.0.0-beta.1] map[Name:scan Path:/usr/local/lib/docker/cli-pl

ugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.8.0]] Warnings:<nil>}}

	I1117 17:06:53.182342   42213 errors.go:98] postmortem docker info: {ID: Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:0 Driver: DriverStatus:[] SystemStatus:<nil> Plugins:{Volume:[] Network:[] Authorization:<nil> Log:[]} MemoryLimit:false SwapLimit:false KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:false CPUCfsQuota:false CPUShares:false CPUSet:false PidsLimit:false IPv4Forwarding:false BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:0 OomKillDisable:false NGoroutines:0 SystemTime:0001-01-01 00:00:00 +0000 UTC LoggingDriver: CgroupDriver: NEventsListener:0 KernelVersion: OperatingSystem: OSType: Architecture: IndexServerAddress: RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[] IndexConfigs:{DockerIo:{Name: Mirrors:[] Secure:false Official:false}} Mirrors:[]} NCPU:0 MemTotal:0 GenericResources:<nil> DockerRootDir: HTTPProxy: HTTPSProxy: NoProxy: Name: Labels:[] Experiment

alBuild:false ServerVersion: ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:}} DefaultRuntime: Swarm:{NodeID: NodeAddr: LocalNodeState: ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary: ContainerdCommit:{ID: Expected:} RuncCommit:{ID: Expected:} InitCommit:{ID: Expected:} SecurityOptions:[] ProductLicense: Warnings:<nil> ServerErrors:[Error response from daemon: Bad response from Docker engine] ClientInfo:{Debug:false Plugins:[map[Experimental:true Name:app Path:/usr/local/lib/docker/cli-plugins/docker-app SchemaVersion:0.1.0 ShortDescription:Docker App Vendor:Docker Inc. Version:v0.9.1-beta3] map[Name:buildx Path:/usr/local/lib/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Build with BuildKit Vendor:Docker Inc. Version:v0.5.1-docker] map[Name:compose Path:/usr/local/lib/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:2.0.0-beta.1] map[Name:scan Path:/usr/local/lib/d

ocker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.8.0]] Warnings:<nil>}}

	I1117 17:06:53.182475   42213 network_create.go:254] running [docker network inspect kubernetes-upgrade-20211117170535-31976] to gather additional debugging logs...

	I1117 17:06:53.182492   42213 cli_runner.go:115] Run: docker network inspect kubernetes-upgrade-20211117170535-31976

	W1117 17:06:53.318601   42213 cli_runner.go:162] docker network inspect kubernetes-upgrade-20211117170535-31976 returned with exit code 1

	I1117 17:06:53.318626   42213 network_create.go:257] error running [docker network inspect kubernetes-upgrade-20211117170535-31976]: docker network inspect kubernetes-upgrade-20211117170535-31976: exit status 1

	stdout:

	[]

	stderr:

	Error response from daemon: Bad response from Docker engine

	I1117 17:06:53.318637   42213 network_create.go:259] output of [docker network inspect kubernetes-upgrade-20211117170535-31976]: -- stdout --

	[]

	-- /stdout --

	** stderr ** 

	Error response from daemon: Bad response from Docker engine

	** /stderr **

	I1117 17:06:53.318731   42213 cli_runner.go:115] Run: docker system info --format "{{json .}}"

	I1117 17:06:53.488546   42213 info.go:263] docker info: {ID: Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:0 Driver: DriverStatus:[] SystemStatus:<nil> Plugins:{Volume:[] Network:[] Authorization:<nil> Log:[]} MemoryLimit:false SwapLimit:false KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:false CPUCfsQuota:false CPUShares:false CPUSet:false PidsLimit:false IPv4Forwarding:false BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:0 OomKillDisable:false NGoroutines:0 SystemTime:0001-01-01 00:00:00 +0000 UTC LoggingDriver: CgroupDriver: NEventsListener:0 KernelVersion: OperatingSystem: OSType: Architecture: IndexServerAddress: RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[] IndexConfigs:{DockerIo:{Name: Mirrors:[] Secure:false Official:false}} Mirrors:[]} NCPU:0 MemTotal:0 GenericResources:<nil> DockerRootDir: HTTPProxy: HTTPSProxy: NoProxy: Name: Labels:[] ExperimentalBuild:fals

e ServerVersion: ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:}} DefaultRuntime: Swarm:{NodeID: NodeAddr: LocalNodeState: ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary: ContainerdCommit:{ID: Expected:} RuncCommit:{ID: Expected:} InitCommit:{ID: Expected:} SecurityOptions:[] ProductLicense: Warnings:<nil> ServerErrors:[Error response from daemon: Bad response from Docker engine] ClientInfo:{Debug:false Plugins:[map[Experimental:true Name:app Path:/usr/local/lib/docker/cli-plugins/docker-app SchemaVersion:0.1.0 ShortDescription:Docker App Vendor:Docker Inc. Version:v0.9.1-beta3] map[Name:buildx Path:/usr/local/lib/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Build with BuildKit Vendor:Docker Inc. Version:v0.5.1-docker] map[Name:compose Path:/usr/local/lib/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:2.0.0-beta.1] map[Name:scan Path:/usr/local/lib/docker/cli-pl

ugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.8.0]] Warnings:<nil>}}

	I1117 17:06:53.489139   42213 cli_runner.go:115] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" kubernetes-upgrade-20211117170535-31976

	W1117 17:06:53.602437   42213 cli_runner.go:162] docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" kubernetes-upgrade-20211117170535-31976 returned with exit code 1

	I1117 17:06:53.602544   42213 ssh_runner.go:152] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I1117 17:06:53.602617   42213 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20211117170535-31976

	W1117 17:06:53.725618   42213 cli_runner.go:162] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20211117170535-31976 returned with exit code 1

	I1117 17:06:53.725714   42213 retry.go:31] will retry after 276.165072ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "kubernetes-upgrade-20211117170535-31976": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20211117170535-31976: exit status 1

	stdout:

	stderr:

	Error response from daemon: Bad response from Docker engine

	I1117 17:06:54.003912   42213 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20211117170535-31976

	W1117 17:06:54.124594   42213 cli_runner.go:162] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20211117170535-31976 returned with exit code 1

	I1117 17:06:54.124670   42213 retry.go:31] will retry after 540.190908ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "kubernetes-upgrade-20211117170535-31976": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20211117170535-31976: exit status 1

	stdout:

	stderr:

	Error response from daemon: Bad response from Docker engine

	I1117 17:06:54.674331   42213 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20211117170535-31976

	W1117 17:06:54.797671   42213 cli_runner.go:162] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20211117170535-31976 returned with exit code 1

	I1117 17:06:54.797760   42213 retry.go:31] will retry after 655.06503ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "kubernetes-upgrade-20211117170535-31976": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20211117170535-31976: exit status 1

	stdout:

	stderr:

	Error response from daemon: Bad response from Docker engine

	I1117 17:06:55.454169   42213 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20211117170535-31976

	W1117 17:06:55.574394   42213 cli_runner.go:162] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20211117170535-31976 returned with exit code 1

	W1117 17:06:55.574474   42213 start.go:257] error running df -h /var: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "kubernetes-upgrade-20211117170535-31976": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20211117170535-31976: exit status 1

	stdout:

	stderr:

	Error response from daemon: Bad response from Docker engine

	W1117 17:06:55.574495   42213 start.go:239] error getting percentage of /var that is free: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "kubernetes-upgrade-20211117170535-31976": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20211117170535-31976: exit status 1

	stdout:

	stderr:

	Error response from daemon: Bad response from Docker engine

	I1117 17:06:55.574506   42213 fix.go:57] fixHost completed within 3.708253072s

	I1117 17:06:55.574515   42213 start.go:80] releasing machines lock for "kubernetes-upgrade-20211117170535-31976", held for 3.708290894s

	W1117 17:06:55.574528   42213 start.go:532] error starting host: inspecting NetworkSettings.Networks: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" kubernetes-upgrade-20211117170535-31976: exit status 1

	stdout:

	stderr:

	Error response from daemon: Bad response from Docker engine

	W1117 17:06:55.574629   42213 out.go:241] ! StartHost failed, but will try again: inspecting NetworkSettings.Networks: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" kubernetes-upgrade-20211117170535-31976: exit status 1

	stdout:

	stderr:

	Error response from daemon: Bad response from Docker engine

	I1117 17:06:55.574637   42213 start.go:547] Will try again in 5 seconds ...

	I1117 17:07:00.574920   42213 start.go:313] acquiring machines lock for kubernetes-upgrade-20211117170535-31976: {Name:mk9072703b78acf3b7213aadf906ddf9902cea7c Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I1117 17:07:00.575053   42213 start.go:317] acquired machines lock for "kubernetes-upgrade-20211117170535-31976" in 98.876µs

	I1117 17:07:00.575074   42213 start.go:93] Skipping create...Using existing machine configuration

	I1117 17:07:00.575078   42213 fix.go:55] fixHost starting: 

	I1117 17:07:00.575377   42213 cli_runner.go:115] Run: docker container inspect kubernetes-upgrade-20211117170535-31976 --format={{.State.Status}}

	W1117 17:07:00.698108   42213 cli_runner.go:162] docker container inspect kubernetes-upgrade-20211117170535-31976 --format={{.State.Status}} returned with exit code 1

	I1117 17:07:00.698157   42213 fix.go:108] recreateIfNeeded on kubernetes-upgrade-20211117170535-31976: state= err=unknown state "kubernetes-upgrade-20211117170535-31976": docker container inspect kubernetes-upgrade-20211117170535-31976 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: Bad response from Docker engine

	I1117 17:07:00.698170   42213 fix.go:113] machineExists: false. err=machine does not exist

	I1117 17:07:00.725135   42213 out.go:176] * docker "kubernetes-upgrade-20211117170535-31976" container is missing, will recreate.

	I1117 17:07:00.725189   42213 delete.go:124] DEMOLISHING kubernetes-upgrade-20211117170535-31976 ...

	I1117 17:07:00.725392   42213 cli_runner.go:115] Run: docker container inspect kubernetes-upgrade-20211117170535-31976 --format={{.State.Status}}

	W1117 17:07:00.861868   42213 cli_runner.go:162] docker container inspect kubernetes-upgrade-20211117170535-31976 --format={{.State.Status}} returned with exit code 1

	W1117 17:07:00.861911   42213 stop.go:75] unable to get state: unknown state "kubernetes-upgrade-20211117170535-31976": docker container inspect kubernetes-upgrade-20211117170535-31976 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: Bad response from Docker engine

	I1117 17:07:00.861936   42213 delete.go:129] stophost failed (probably ok): ssh power off: unknown state "kubernetes-upgrade-20211117170535-31976": docker container inspect kubernetes-upgrade-20211117170535-31976 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: Bad response from Docker engine

	I1117 17:07:00.862364   42213 cli_runner.go:115] Run: docker container inspect kubernetes-upgrade-20211117170535-31976 --format={{.State.Status}}

	W1117 17:07:00.978129   42213 cli_runner.go:162] docker container inspect kubernetes-upgrade-20211117170535-31976 --format={{.State.Status}} returned with exit code 1

	I1117 17:07:00.978172   42213 delete.go:82] Unable to get host status for kubernetes-upgrade-20211117170535-31976, assuming it has already been deleted: state: unknown state "kubernetes-upgrade-20211117170535-31976": docker container inspect kubernetes-upgrade-20211117170535-31976 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: Bad response from Docker engine

	I1117 17:07:00.978260   42213 cli_runner.go:115] Run: docker container inspect -f {{.Id}} kubernetes-upgrade-20211117170535-31976

	W1117 17:07:01.092880   42213 cli_runner.go:162] docker container inspect -f {{.Id}} kubernetes-upgrade-20211117170535-31976 returned with exit code 1

	I1117 17:07:01.092911   42213 kic.go:360] could not find the container kubernetes-upgrade-20211117170535-31976 to remove it. will try anyways

	I1117 17:07:01.092996   42213 cli_runner.go:115] Run: docker container inspect kubernetes-upgrade-20211117170535-31976 --format={{.State.Status}}

	W1117 17:07:01.209201   42213 cli_runner.go:162] docker container inspect kubernetes-upgrade-20211117170535-31976 --format={{.State.Status}} returned with exit code 1

	W1117 17:07:01.209238   42213 oci.go:83] error getting container status, will try to delete anyways: unknown state "kubernetes-upgrade-20211117170535-31976": docker container inspect kubernetes-upgrade-20211117170535-31976 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: Bad response from Docker engine

	I1117 17:07:01.209322   42213 cli_runner.go:115] Run: docker exec --privileged -t kubernetes-upgrade-20211117170535-31976 /bin/bash -c "sudo init 0"

	W1117 17:07:01.322461   42213 cli_runner.go:162] docker exec --privileged -t kubernetes-upgrade-20211117170535-31976 /bin/bash -c "sudo init 0" returned with exit code 1

	I1117 17:07:01.322486   42213 oci.go:651] error shutdown kubernetes-upgrade-20211117170535-31976: docker exec --privileged -t kubernetes-upgrade-20211117170535-31976 /bin/bash -c "sudo init 0": exit status 1

	stdout:

	stderr:

	Error response from daemon: Bad response from Docker engine

	I1117 17:07:02.326114   42213 cli_runner.go:115] Run: docker container inspect kubernetes-upgrade-20211117170535-31976 --format={{.State.Status}}

	W1117 17:07:02.442126   42213 cli_runner.go:162] docker container inspect kubernetes-upgrade-20211117170535-31976 --format={{.State.Status}} returned with exit code 1

	I1117 17:07:02.442165   42213 oci.go:663] temporary error verifying shutdown: unknown state "kubernetes-upgrade-20211117170535-31976": docker container inspect kubernetes-upgrade-20211117170535-31976 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: Bad response from Docker engine

	I1117 17:07:02.442173   42213 oci.go:665] temporary error: container kubernetes-upgrade-20211117170535-31976 status is  but expect it to be exited

	I1117 17:07:02.442195   42213 retry.go:31] will retry after 462.318748ms: couldn't verify container is exited. %!v(MISSING): unknown state "kubernetes-upgrade-20211117170535-31976": docker container inspect kubernetes-upgrade-20211117170535-31976 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: Bad response from Docker engine

	I1117 17:07:02.912951   42213 cli_runner.go:115] Run: docker container inspect kubernetes-upgrade-20211117170535-31976 --format={{.State.Status}}

	W1117 17:07:03.031243   42213 cli_runner.go:162] docker container inspect kubernetes-upgrade-20211117170535-31976 --format={{.State.Status}} returned with exit code 1

	I1117 17:07:03.031288   42213 oci.go:663] temporary error verifying shutdown: unknown state "kubernetes-upgrade-20211117170535-31976": docker container inspect kubernetes-upgrade-20211117170535-31976 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: Bad response from Docker engine

	I1117 17:07:03.031301   42213 oci.go:665] temporary error: container kubernetes-upgrade-20211117170535-31976 status is  but expect it to be exited

	I1117 17:07:03.031332   42213 retry.go:31] will retry after 890.117305ms: couldn't verify container is exited. %!v(MISSING): unknown state "kubernetes-upgrade-20211117170535-31976": docker container inspect kubernetes-upgrade-20211117170535-31976 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: Bad response from Docker engine

	I1117 17:07:03.924515   42213 cli_runner.go:115] Run: docker container inspect kubernetes-upgrade-20211117170535-31976 --format={{.State.Status}}

	W1117 17:07:04.042733   42213 cli_runner.go:162] docker container inspect kubernetes-upgrade-20211117170535-31976 --format={{.State.Status}} returned with exit code 1

	I1117 17:07:04.042773   42213 oci.go:663] temporary error verifying shutdown: unknown state "kubernetes-upgrade-20211117170535-31976": docker container inspect kubernetes-upgrade-20211117170535-31976 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: Bad response from Docker engine

	I1117 17:07:04.042781   42213 oci.go:665] temporary error: container kubernetes-upgrade-20211117170535-31976 status is  but expect it to be exited

	I1117 17:07:04.042805   42213 retry.go:31] will retry after 636.341646ms: couldn't verify container is exited. %!v(MISSING): unknown state "kubernetes-upgrade-20211117170535-31976": docker container inspect kubernetes-upgrade-20211117170535-31976 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: Bad response from Docker engine

	I1117 17:07:04.679507   42213 cli_runner.go:115] Run: docker container inspect kubernetes-upgrade-20211117170535-31976 --format={{.State.Status}}

	W1117 17:07:04.801314   42213 cli_runner.go:162] docker container inspect kubernetes-upgrade-20211117170535-31976 --format={{.State.Status}} returned with exit code 1

	I1117 17:07:04.801351   42213 oci.go:663] temporary error verifying shutdown: unknown state "kubernetes-upgrade-20211117170535-31976": docker container inspect kubernetes-upgrade-20211117170535-31976 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: Bad response from Docker engine

	I1117 17:07:04.801358   42213 oci.go:665] temporary error: container kubernetes-upgrade-20211117170535-31976 status is  but expect it to be exited

	I1117 17:07:04.801382   42213 retry.go:31] will retry after 1.107876242s: couldn't verify container is exited. %!v(MISSING): unknown state "kubernetes-upgrade-20211117170535-31976": docker container inspect kubernetes-upgrade-20211117170535-31976 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: Bad response from Docker engine

	I1117 17:07:05.916094   42213 cli_runner.go:115] Run: docker container inspect kubernetes-upgrade-20211117170535-31976 --format={{.State.Status}}

	W1117 17:07:06.030465   42213 cli_runner.go:162] docker container inspect kubernetes-upgrade-20211117170535-31976 --format={{.State.Status}} returned with exit code 1

	I1117 17:07:06.030502   42213 oci.go:663] temporary error verifying shutdown: unknown state "kubernetes-upgrade-20211117170535-31976": docker container inspect kubernetes-upgrade-20211117170535-31976 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: Bad response from Docker engine

	I1117 17:07:06.030512   42213 oci.go:665] temporary error: container kubernetes-upgrade-20211117170535-31976 status is  but expect it to be exited

	I1117 17:07:06.030543   42213 retry.go:31] will retry after 1.511079094s: couldn't verify container is exited. %!v(MISSING): unknown state "kubernetes-upgrade-20211117170535-31976": docker container inspect kubernetes-upgrade-20211117170535-31976 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: Bad response from Docker engine

	I1117 17:07:07.552029   42213 cli_runner.go:115] Run: docker container inspect kubernetes-upgrade-20211117170535-31976 --format={{.State.Status}}

	W1117 17:07:07.669793   42213 cli_runner.go:162] docker container inspect kubernetes-upgrade-20211117170535-31976 --format={{.State.Status}} returned with exit code 1

	I1117 17:07:07.669838   42213 oci.go:663] temporary error verifying shutdown: unknown state "kubernetes-upgrade-20211117170535-31976": docker container inspect kubernetes-upgrade-20211117170535-31976 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: Bad response from Docker engine

	I1117 17:07:07.669855   42213 oci.go:665] temporary error: container kubernetes-upgrade-20211117170535-31976 status is  but expect it to be exited

	I1117 17:07:07.669885   42213 retry.go:31] will retry after 3.04096222s: couldn't verify container is exited. %!v(MISSING): unknown state "kubernetes-upgrade-20211117170535-31976": docker container inspect kubernetes-upgrade-20211117170535-31976 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: Bad response from Docker engine

	I1117 17:07:10.714642   42213 cli_runner.go:115] Run: docker container inspect kubernetes-upgrade-20211117170535-31976 --format={{.State.Status}}

	W1117 17:07:10.845215   42213 cli_runner.go:162] docker container inspect kubernetes-upgrade-20211117170535-31976 --format={{.State.Status}} returned with exit code 1

	I1117 17:07:10.845252   42213 oci.go:663] temporary error verifying shutdown: unknown state "kubernetes-upgrade-20211117170535-31976": docker container inspect kubernetes-upgrade-20211117170535-31976 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: Bad response from Docker engine

	I1117 17:07:10.845259   42213 oci.go:665] temporary error: container kubernetes-upgrade-20211117170535-31976 status is  but expect it to be exited

	I1117 17:07:10.845282   42213 retry.go:31] will retry after 5.781953173s: couldn't verify container is exited. %!v(MISSING): unknown state "kubernetes-upgrade-20211117170535-31976": docker container inspect kubernetes-upgrade-20211117170535-31976 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: Bad response from Docker engine

	I1117 17:07:16.627792   42213 cli_runner.go:115] Run: docker container inspect kubernetes-upgrade-20211117170535-31976 --format={{.State.Status}}

	W1117 17:07:16.746605   42213 cli_runner.go:162] docker container inspect kubernetes-upgrade-20211117170535-31976 --format={{.State.Status}} returned with exit code 1

	I1117 17:07:16.746646   42213 oci.go:663] temporary error verifying shutdown: unknown state "kubernetes-upgrade-20211117170535-31976": docker container inspect kubernetes-upgrade-20211117170535-31976 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: Bad response from Docker engine

	I1117 17:07:16.746653   42213 oci.go:665] temporary error: container kubernetes-upgrade-20211117170535-31976 status is  but expect it to be exited

	I1117 17:07:16.746688   42213 oci.go:87] couldn't shut down kubernetes-upgrade-20211117170535-31976 (might be okay): verify shutdown: couldn't verify container is exited. %!v(MISSING): unknown state "kubernetes-upgrade-20211117170535-31976": docker container inspect kubernetes-upgrade-20211117170535-31976 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: Bad response from Docker engine

	I1117 17:07:16.746769   42213 cli_runner.go:115] Run: docker rm -f -v kubernetes-upgrade-20211117170535-31976

	W1117 17:07:16.862743   42213 cli_runner.go:162] docker rm -f -v kubernetes-upgrade-20211117170535-31976 returned with exit code 1

	I1117 17:07:16.862866   42213 cli_runner.go:115] Run: docker container inspect -f {{.Id}} kubernetes-upgrade-20211117170535-31976

	W1117 17:07:16.978253   42213 cli_runner.go:162] docker container inspect -f {{.Id}} kubernetes-upgrade-20211117170535-31976 returned with exit code 1

	I1117 17:07:16.978363   42213 cli_runner.go:115] Run: docker network inspect kubernetes-upgrade-20211117170535-31976 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"

	W1117 17:07:17.089943   42213 cli_runner.go:162] docker network inspect kubernetes-upgrade-20211117170535-31976 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1

	I1117 17:07:17.090053   42213 network_create.go:254] running [docker network inspect kubernetes-upgrade-20211117170535-31976] to gather additional debugging logs...

	I1117 17:07:17.090068   42213 cli_runner.go:115] Run: docker network inspect kubernetes-upgrade-20211117170535-31976

	W1117 17:07:17.204149   42213 cli_runner.go:162] docker network inspect kubernetes-upgrade-20211117170535-31976 returned with exit code 1

	I1117 17:07:17.204173   42213 network_create.go:257] error running [docker network inspect kubernetes-upgrade-20211117170535-31976]: docker network inspect kubernetes-upgrade-20211117170535-31976: exit status 1

	stdout:

	[]

	stderr:

	Error response from daemon: Bad response from Docker engine

	I1117 17:07:17.204187   42213 network_create.go:259] output of [docker network inspect kubernetes-upgrade-20211117170535-31976]: -- stdout --

	[]

	-- /stdout --

	** stderr ** 

	Error response from daemon: Bad response from Docker engine

	** /stderr **

	W1117 17:07:17.204202   42213 network_create.go:284] Error inspecting docker network kubernetes-upgrade-20211117170535-31976: docker network inspect kubernetes-upgrade-20211117170535-31976 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}": exit status 1

	stdout:

	stderr:

	Error response from daemon: Bad response from Docker engine

	W1117 17:07:17.204558   42213 delete.go:139] delete failed (probably ok) <nil>

	I1117 17:07:17.204565   42213 fix.go:120] Sleeping 1 second for extra luck!

	I1117 17:07:18.207305   42213 start.go:126] createHost starting for "" (driver="docker")

	I1117 17:07:18.282955   42213 out.go:203] * Creating docker container (CPUs=2, Memory=2200MB) ...

	I1117 17:07:18.283137   42213 start.go:160] libmachine.API.Create for "kubernetes-upgrade-20211117170535-31976" (driver="docker")

	I1117 17:07:18.283183   42213 client.go:168] LocalClient.Create starting

	I1117 17:07:18.283353   42213 main.go:130] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/certs/ca.pem

	I1117 17:07:18.283604   42213 main.go:130] libmachine: Decoding PEM data...

	I1117 17:07:18.283647   42213 main.go:130] libmachine: Parsing certificate...

	I1117 17:07:18.283801   42213 main.go:130] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/certs/cert.pem

	I1117 17:07:18.304803   42213 main.go:130] libmachine: Decoding PEM data...

	I1117 17:07:18.304837   42213 main.go:130] libmachine: Parsing certificate...

	I1117 17:07:18.305751   42213 cli_runner.go:115] Run: docker network inspect kubernetes-upgrade-20211117170535-31976 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"

	W1117 17:07:18.423985   42213 cli_runner.go:162] docker network inspect kubernetes-upgrade-20211117170535-31976 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1

	I1117 17:07:18.424097   42213 network_create.go:254] running [docker network inspect kubernetes-upgrade-20211117170535-31976] to gather additional debugging logs...

	I1117 17:07:18.424116   42213 cli_runner.go:115] Run: docker network inspect kubernetes-upgrade-20211117170535-31976

	W1117 17:07:18.536585   42213 cli_runner.go:162] docker network inspect kubernetes-upgrade-20211117170535-31976 returned with exit code 1

	I1117 17:07:18.536611   42213 network_create.go:257] error running [docker network inspect kubernetes-upgrade-20211117170535-31976]: docker network inspect kubernetes-upgrade-20211117170535-31976: exit status 1

	stdout:

	[]

	stderr:

	Error response from daemon: Bad response from Docker engine

	I1117 17:07:18.536632   42213 network_create.go:259] output of [docker network inspect kubernetes-upgrade-20211117170535-31976]: -- stdout --

	[]

	-- /stdout --

	** stderr ** 

	Error response from daemon: Bad response from Docker engine

	** /stderr **

	I1117 17:07:18.536716   42213 cli_runner.go:115] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"

	W1117 17:07:18.649614   42213 cli_runner.go:162] docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1

	I1117 17:07:18.649750   42213 network_create.go:254] running [docker network inspect bridge] to gather additional debugging logs...

	I1117 17:07:18.649784   42213 cli_runner.go:115] Run: docker network inspect bridge

	W1117 17:07:18.764966   42213 cli_runner.go:162] docker network inspect bridge returned with exit code 1

	I1117 17:07:18.764992   42213 network_create.go:257] error running [docker network inspect bridge]: docker network inspect bridge: exit status 1

	stdout:

	[]

	stderr:

	Error response from daemon: Bad response from Docker engine

	I1117 17:07:18.765003   42213 network_create.go:259] output of [docker network inspect bridge]: -- stdout --

	[]

	-- /stdout --

	** stderr ** 

	Error response from daemon: Bad response from Docker engine

	** /stderr **

	W1117 17:07:18.765010   42213 network_create.go:75] failed to get mtu information from the docker's default network "bridge": docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}": exit status 1

	stdout:

	stderr:

	Error response from daemon: Bad response from Docker engine

	I1117 17:07:18.765230   42213 network.go:288] reserving subnet 192.168.49.0 for 1m0s: &{mu:{state:0 sema:0} read:{v:{m:map[] amended:true}} dirty:map[192.168.49.0:0xc0005a6110] misses:0}

	I1117 17:07:18.765255   42213 network.go:235] using free private subnet 192.168.49.0/24: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:}}

	I1117 17:07:18.765271   42213 network_create.go:106] attempt to create docker network kubernetes-upgrade-20211117170535-31976 192.168.49.0/24 with gateway 192.168.49.1 and MTU of 0 ...

	I1117 17:07:18.765349   42213 cli_runner.go:115] Run: docker network create --driver=bridge --subnet=192.168.49.0/24 --gateway=192.168.49.1 -o --ip-masq -o --icc --label=created_by.minikube.sigs.k8s.io=true kubernetes-upgrade-20211117170535-31976

	W1117 17:07:18.877964   42213 cli_runner.go:162] docker network create --driver=bridge --subnet=192.168.49.0/24 --gateway=192.168.49.1 -o --ip-masq -o --icc --label=created_by.minikube.sigs.k8s.io=true kubernetes-upgrade-20211117170535-31976 returned with exit code 1

	E1117 17:07:18.878015   42213 network_create.go:95] error while trying to create docker network kubernetes-upgrade-20211117170535-31976 192.168.49.0/24: create docker network kubernetes-upgrade-20211117170535-31976 192.168.49.0/24 with gateway 192.168.49.1 and MTU of 0: docker network create --driver=bridge --subnet=192.168.49.0/24 --gateway=192.168.49.1 -o --ip-masq -o --icc --label=created_by.minikube.sigs.k8s.io=true kubernetes-upgrade-20211117170535-31976: exit status 1

	stdout:

	stderr:

	Error response from daemon: Bad response from Docker engine

	W1117 17:07:18.878162   42213 out.go:241] ! Unable to create dedicated network, this might result in cluster IP change after restart: un-retryable: create docker network kubernetes-upgrade-20211117170535-31976 192.168.49.0/24 with gateway 192.168.49.1 and MTU of 0: docker network create --driver=bridge --subnet=192.168.49.0/24 --gateway=192.168.49.1 -o --ip-masq -o --icc --label=created_by.minikube.sigs.k8s.io=true kubernetes-upgrade-20211117170535-31976: exit status 1

	stdout:

	stderr:

	Error response from daemon: Bad response from Docker engine

	I1117 17:07:18.878277   42213 cli_runner.go:115] Run: docker ps -a --format {{.Names}}

	W1117 17:07:18.994646   42213 cli_runner.go:162] docker ps -a --format {{.Names}} returned with exit code 1

	W1117 17:07:18.994676   42213 kic.go:149] failed to check if container already exists: docker ps -a --format {{.Names}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: Bad response from Docker engine

	I1117 17:07:18.994769   42213 cli_runner.go:115] Run: docker volume create kubernetes-upgrade-20211117170535-31976 --label name.minikube.sigs.k8s.io=kubernetes-upgrade-20211117170535-31976 --label created_by.minikube.sigs.k8s.io=true

	W1117 17:07:19.109297   42213 cli_runner.go:162] docker volume create kubernetes-upgrade-20211117170535-31976 --label name.minikube.sigs.k8s.io=kubernetes-upgrade-20211117170535-31976 --label created_by.minikube.sigs.k8s.io=true returned with exit code 1

	I1117 17:07:19.109339   42213 client.go:171] LocalClient.Create took 826.13022ms

	I1117 17:07:21.115680   42213 ssh_runner.go:152] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I1117 17:07:21.115838   42213 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20211117170535-31976

	W1117 17:07:21.230804   42213 cli_runner.go:162] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20211117170535-31976 returned with exit code 1

	I1117 17:07:21.230882   42213 retry.go:31] will retry after 178.565968ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "kubernetes-upgrade-20211117170535-31976": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20211117170535-31976: exit status 1

	stdout:

	stderr:

	Error response from daemon: Bad response from Docker engine

	I1117 17:07:21.410252   42213 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20211117170535-31976

	W1117 17:07:21.526439   42213 cli_runner.go:162] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20211117170535-31976 returned with exit code 1

	I1117 17:07:21.526527   42213 retry.go:31] will retry after 330.246446ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "kubernetes-upgrade-20211117170535-31976": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20211117170535-31976: exit status 1

	stdout:

	stderr:

	Error response from daemon: Bad response from Docker engine

	I1117 17:07:21.859203   42213 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20211117170535-31976

	W1117 17:07:21.979700   42213 cli_runner.go:162] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20211117170535-31976 returned with exit code 1

	I1117 17:07:21.979785   42213 retry.go:31] will retry after 460.157723ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "kubernetes-upgrade-20211117170535-31976": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20211117170535-31976: exit status 1

	stdout:

	stderr:

	Error response from daemon: Bad response from Docker engine

	I1117 17:07:22.440613   42213 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20211117170535-31976

	W1117 17:07:22.555457   42213 cli_runner.go:162] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20211117170535-31976 returned with exit code 1

	W1117 17:07:22.555546   42213 start.go:257] error running df -h /var: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "kubernetes-upgrade-20211117170535-31976": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20211117170535-31976: exit status 1

	stdout:

	stderr:

	Error response from daemon: Bad response from Docker engine

	W1117 17:07:22.555575   42213 start.go:239] error getting percentage of /var that is free: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "kubernetes-upgrade-20211117170535-31976": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20211117170535-31976: exit status 1

	stdout:

	stderr:

	Error response from daemon: Bad response from Docker engine

	I1117 17:07:22.555599   42213 start.go:129] duration metric: createHost completed in 4.34814707s

	I1117 17:07:22.555658   42213 ssh_runner.go:152] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I1117 17:07:22.555709   42213 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20211117170535-31976

	W1117 17:07:22.667949   42213 cli_runner.go:162] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20211117170535-31976 returned with exit code 1

	I1117 17:07:22.668030   42213 retry.go:31] will retry after 195.758538ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "kubernetes-upgrade-20211117170535-31976": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20211117170535-31976: exit status 1

	stdout:

	stderr:

	Error response from daemon: Bad response from Docker engine

	I1117 17:07:22.865551   42213 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20211117170535-31976

	W1117 17:07:22.979098   42213 cli_runner.go:162] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20211117170535-31976 returned with exit code 1

	I1117 17:07:22.979187   42213 retry.go:31] will retry after 297.413196ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "kubernetes-upgrade-20211117170535-31976": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20211117170535-31976: exit status 1

	stdout:

	stderr:

	Error response from daemon: Bad response from Docker engine

	I1117 17:07:23.282713   42213 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20211117170535-31976

	W1117 17:07:23.402324   42213 cli_runner.go:162] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20211117170535-31976 returned with exit code 1

	I1117 17:07:23.402401   42213 retry.go:31] will retry after 663.23513ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "kubernetes-upgrade-20211117170535-31976": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20211117170535-31976: exit status 1

	stdout:

	stderr:

	Error response from daemon: Bad response from Docker engine

	I1117 17:07:24.065859   42213 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20211117170535-31976

	W1117 17:07:24.180619   42213 cli_runner.go:162] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20211117170535-31976 returned with exit code 1

	W1117 17:07:24.180700   42213 start.go:257] error running df -h /var: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "kubernetes-upgrade-20211117170535-31976": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20211117170535-31976: exit status 1

	stdout:

	stderr:

	Error response from daemon: Bad response from Docker engine

	W1117 17:07:24.180723   42213 start.go:239] error getting percentage of /var that is free: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "kubernetes-upgrade-20211117170535-31976": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20211117170535-31976: exit status 1

	stdout:

	stderr:

	Error response from daemon: Bad response from Docker engine

	I1117 17:07:24.180734   42213 fix.go:57] fixHost completed within 23.60512594s

	I1117 17:07:24.180744   42213 start.go:80] releasing machines lock for "kubernetes-upgrade-20211117170535-31976", held for 23.605153823s

	W1117 17:07:24.180884   42213 out.go:241] * Failed to start docker container. Running "minikube delete -p kubernetes-upgrade-20211117170535-31976" may fix it: recreate: creating host: create: creating: setting up container node: creating volume for kubernetes-upgrade-20211117170535-31976 container: docker volume create kubernetes-upgrade-20211117170535-31976 --label name.minikube.sigs.k8s.io=kubernetes-upgrade-20211117170535-31976 --label created_by.minikube.sigs.k8s.io=true: exit status 1

	stdout:

	stderr:

	Error response from daemon: Bad response from Docker engine

	I1117 17:07:24.207631   42213 out.go:176] 

	W1117 17:07:24.207883   42213 out.go:241] X Exiting due to GUEST_PROVISION: Failed to start host: recreate: creating host: create: creating: setting up container node: creating volume for kubernetes-upgrade-20211117170535-31976 container: docker volume create kubernetes-upgrade-20211117170535-31976 --label name.minikube.sigs.k8s.io=kubernetes-upgrade-20211117170535-31976 --label created_by.minikube.sigs.k8s.io=true: exit status 1

	stdout:

	stderr:

	Error response from daemon: Bad response from Docker engine

	W1117 17:07:24.207899   42213 out.go:241] * 

	W1117 17:07:24.208954   42213 out.go:241] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	* 

-- /stdout --

** stderr ** 

	X Exiting due to GUEST_STATUS: state: unknown state "stopped-upgrade-20211117170633-31976": docker container inspect stopped-upgrade-20211117170633-31976 --format=: exit status 1

	stdout:

	stderr:

	Error response from daemon: Bad response from Docker engine

	* 

	╭─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                                                         │

	│    * If the above advice does not help, please let us know:                                                             │

	│      https://github.com/kubernetes/minikube/issues/new/choose                                                           │

	│                                                                                                                         │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                │

	│    * Please also attach the following file to the GitHub issue:                                                         │

	│    * - /var/folders/xd/3vdzn10d2gb_wxr7lj_p8h5c0000gp/T/minikube_logs_00302df19cf26dc43b03ea32978d5cabc189a5ea_2.log    │

	│                                                                                                                         │

	╰─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯

** /stderr **

version_upgrade_test.go:215: `minikube logs` after upgrade to HEAD from v1.9.0 failed: exit status 80

--- FAIL: TestStoppedBinaryUpgrade/MinikubeLogs (0.50s)

=== RUN   TestPause/serial/Start

pause_test.go:78: (dbg) Run:  out/minikube-darwin-amd64 start -p pause-20211117171027-31976 --memory=2048 --install-addons=false --wait=all --driver=docker 

pause_test.go:78: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p pause-20211117171027-31976 --memory=2048 --install-addons=false --wait=all --driver=docker : exit status 69 (446.850602ms)

-- stdout --

	* [pause-20211117171027-31976] minikube v1.24.0 on Darwin 11.2.3

	  - MINIKUBE_LOCATION=12739

	  - KUBECONFIG=/Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/kubeconfig

	  - MINIKUBE_BIN=out/minikube-darwin-amd64

	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube

	* Using the docker driver based on user configuration

-- /stdout --

** stderr ** 

	X Exiting due to PROVIDER_DOCKER_VERSION_EXIT_1: "docker version --format -" exit status 1: Error response from daemon: Bad response from Docker engine

	* Documentation: https://minikube.sigs.k8s.io/docs/drivers/docker/

** /stderr **

pause_test.go:80: failed to start minikube with args: "out/minikube-darwin-amd64 start -p pause-20211117171027-31976 --memory=2048 --install-addons=false --wait=all --driver=docker " : exit status 69

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:230: ======>  post-mortem[TestPause/serial/Start]: docker inspect <======

helpers_test.go:231: (dbg) Run:  docker inspect pause-20211117171027-31976

helpers_test.go:231: (dbg) Non-zero exit: docker inspect pause-20211117171027-31976: exit status 1 (117.06464ms)

-- stdout --

	[]

-- /stdout --

** stderr ** 

	Error response from daemon: Bad response from Docker engine

** /stderr **

helpers_test.go:233: failed to get docker inspect: exit status 1

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p pause-20211117171027-31976 -n pause-20211117171027-31976

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p pause-20211117171027-31976 -n pause-20211117171027-31976: exit status 85 (95.313835ms)

-- stdout --

	* Profile "pause-20211117171027-31976" not found. Run "minikube profile list" to view all profiles.

	  To start a cluster, run: "minikube start -p pause-20211117171027-31976"

-- /stdout --

helpers_test.go:239: status error: exit status 85 (may be ok)

helpers_test.go:241: "pause-20211117171027-31976" host is not running, skipping log retrieval (state="* Profile \"pause-20211117171027-31976\" not found. Run \"minikube profile list\" to view all profiles.\n  To start a cluster, run: \"minikube start -p pause-20211117171027-31976\"")

--- FAIL: TestPause/serial/Start (0.66s)

=== RUN   TestPause/serial/SecondStartNoReconfiguration

pause_test.go:90: (dbg) Run:  out/minikube-darwin-amd64 start -p pause-20211117171027-31976 --alsologtostderr -v=1 --driver=docker 

pause_test.go:90: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p pause-20211117171027-31976 --alsologtostderr -v=1 --driver=docker : exit status 69 (458.858599ms)

-- stdout --

	* [pause-20211117171027-31976] minikube v1.24.0 on Darwin 11.2.3

	  - MINIKUBE_LOCATION=12739

	  - KUBECONFIG=/Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/kubeconfig

	  - MINIKUBE_BIN=out/minikube-darwin-amd64

	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube

	* Using the docker driver based on user configuration

-- /stdout --

** stderr ** 

	I1117 17:10:28.641197   43586 out.go:297] Setting OutFile to fd 1 ...

	I1117 17:10:28.641396   43586 out.go:344] TERM=,COLORTERM=, which probably does not support color

	I1117 17:10:28.641400   43586 out.go:310] Setting ErrFile to fd 2...

	I1117 17:10:28.641403   43586 out.go:344] TERM=,COLORTERM=, which probably does not support color

	I1117 17:10:28.641466   43586 root.go:315] Updating PATH: /Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/bin

	I1117 17:10:28.641706   43586 out.go:304] Setting JSON to false

	I1117 17:10:28.667661   43586 start.go:112] hostinfo: {"hostname":"37310.local","uptime":11403,"bootTime":1637186425,"procs":361,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"11.2.3","kernelVersion":"20.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"bd1c05a8-24a6-5973-aa69-f3c7c66a87ce"}

	W1117 17:10:28.667759   43586 start.go:120] gopshost.Virtualization returned error: not implemented yet

	I1117 17:10:28.694546   43586 out.go:176] * [pause-20211117171027-31976] minikube v1.24.0 on Darwin 11.2.3

	I1117 17:10:28.694717   43586 notify.go:174] Checking for updates...

	I1117 17:10:28.741466   43586 out.go:176]   - MINIKUBE_LOCATION=12739

	I1117 17:10:28.767210   43586 out.go:176]   - KUBECONFIG=/Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/kubeconfig

	I1117 17:10:28.793461   43586 out.go:176]   - MINIKUBE_BIN=out/minikube-darwin-amd64

	I1117 17:10:28.819631   43586 out.go:176]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube

	I1117 17:10:28.820605   43586 config.go:176] Loaded profile config "running-upgrade-20211117170725-31976": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.18.0

	I1117 17:10:28.820687   43586 driver.go:343] Setting default libvirt URI to qemu:///system

	W1117 17:10:28.916364   43586 docker.go:108] docker version returned error: exit status 1

	I1117 17:10:28.943025   43586 out.go:176] * Using the docker driver based on user configuration

	I1117 17:10:28.943049   43586 start.go:280] selected driver: docker

	I1117 17:10:28.943057   43586 start.go:775] validating driver "docker" against <nil>

	I1117 17:10:28.943070   43586 start.go:786] status for docker: {Installed:true Healthy:false Running:true NeedsImprovement:false Error:"docker version --format {{.Server.Os}}-{{.Server.Version}}" exit status 1: Error response from daemon: Bad response from Docker engine Reason:PROVIDER_DOCKER_VERSION_EXIT_1 Fix: Doc:https://minikube.sigs.k8s.io/docs/drivers/docker/}

	I1117 17:10:28.990208   43586 out.go:176] 

	W1117 17:10:28.990421   43586 out.go:241] X Exiting due to PROVIDER_DOCKER_VERSION_EXIT_1: "docker version --format -" exit status 1: Error response from daemon: Bad response from Docker engine

	X Exiting due to PROVIDER_DOCKER_VERSION_EXIT_1: "docker version --format -" exit status 1: Error response from daemon: Bad response from Docker engine

	W1117 17:10:28.990506   43586 out.go:241] * Documentation: https://minikube.sigs.k8s.io/docs/drivers/docker/

	* Documentation: https://minikube.sigs.k8s.io/docs/drivers/docker/

	I1117 17:10:29.038114   43586 out.go:176] 

** /stderr **

pause_test.go:92: failed to second start a running minikube with args: "out/minikube-darwin-amd64 start -p pause-20211117171027-31976 --alsologtostderr -v=1 --driver=docker " : exit status 69

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:230: ======>  post-mortem[TestPause/serial/SecondStartNoReconfiguration]: docker inspect <======

helpers_test.go:231: (dbg) Run:  docker inspect pause-20211117171027-31976

helpers_test.go:231: (dbg) Non-zero exit: docker inspect pause-20211117171027-31976: exit status 1 (119.106526ms)

-- stdout --

	[]

-- /stdout --

** stderr ** 

	Error response from daemon: Bad response from Docker engine

** /stderr **

helpers_test.go:233: failed to get docker inspect: exit status 1

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p pause-20211117171027-31976 -n pause-20211117171027-31976

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p pause-20211117171027-31976 -n pause-20211117171027-31976: exit status 85 (93.731499ms)

-- stdout --

	* Profile "pause-20211117171027-31976" not found. Run "minikube profile list" to view all profiles.

	  To start a cluster, run: "minikube start -p pause-20211117171027-31976"

-- /stdout --

helpers_test.go:239: status error: exit status 85 (may be ok)

helpers_test.go:241: "pause-20211117171027-31976" host is not running, skipping log retrieval (state="* Profile \"pause-20211117171027-31976\" not found. Run \"minikube profile list\" to view all profiles.\n  To start a cluster, run: \"minikube start -p pause-20211117171027-31976\"")

--- FAIL: TestPause/serial/SecondStartNoReconfiguration (0.67s)

=== RUN   TestPause/serial/Pause

pause_test.go:108: (dbg) Run:  out/minikube-darwin-amd64 pause -p pause-20211117171027-31976 --alsologtostderr -v=5

pause_test.go:108: (dbg) Non-zero exit: out/minikube-darwin-amd64 pause -p pause-20211117171027-31976 --alsologtostderr -v=5: exit status 85 (93.441161ms)

-- stdout --

	* Profile "pause-20211117171027-31976" not found. Run "minikube profile list" to view all profiles.

	  To start a cluster, run: "minikube start -p pause-20211117171027-31976"

-- /stdout --

** stderr ** 

	I1117 17:10:29.313362   43606 out.go:297] Setting OutFile to fd 1 ...

	I1117 17:10:29.314077   43606 out.go:344] TERM=,COLORTERM=, which probably does not support color

	I1117 17:10:29.314083   43606 out.go:310] Setting ErrFile to fd 2...

	I1117 17:10:29.314086   43606 out.go:344] TERM=,COLORTERM=, which probably does not support color

	I1117 17:10:29.314166   43606 root.go:315] Updating PATH: /Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/bin

	I1117 17:10:29.314340   43606 out.go:304] Setting JSON to false

	I1117 17:10:29.314355   43606 mustload.go:65] Loading cluster: pause-20211117171027-31976

	I1117 17:10:29.340024   43606 out.go:176] * Profile "pause-20211117171027-31976" not found. Run "minikube profile list" to view all profiles.

	I1117 17:10:29.365752   43606 out.go:176]   To start a cluster, run: "minikube start -p pause-20211117171027-31976"

** /stderr **

pause_test.go:110: failed to pause minikube with args: "out/minikube-darwin-amd64 pause -p pause-20211117171027-31976 --alsologtostderr -v=5" : exit status 85

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:230: ======>  post-mortem[TestPause/serial/Pause]: docker inspect <======

helpers_test.go:231: (dbg) Run:  docker inspect pause-20211117171027-31976

helpers_test.go:231: (dbg) Non-zero exit: docker inspect pause-20211117171027-31976: exit status 1 (116.18729ms)

-- stdout --

	[]

-- /stdout --

** stderr ** 

	Error response from daemon: Bad response from Docker engine

** /stderr **

helpers_test.go:233: failed to get docker inspect: exit status 1

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p pause-20211117171027-31976 -n pause-20211117171027-31976

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p pause-20211117171027-31976 -n pause-20211117171027-31976: exit status 85 (92.944424ms)

-- stdout --

	* Profile "pause-20211117171027-31976" not found. Run "minikube profile list" to view all profiles.

	  To start a cluster, run: "minikube start -p pause-20211117171027-31976"

-- /stdout --

helpers_test.go:239: status error: exit status 85 (may be ok)

helpers_test.go:241: "pause-20211117171027-31976" host is not running, skipping log retrieval (state="* Profile \"pause-20211117171027-31976\" not found. Run \"minikube profile list\" to view all profiles.\n  To start a cluster, run: \"minikube start -p pause-20211117171027-31976\"")

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:230: ======>  post-mortem[TestPause/serial/Pause]: docker inspect <======

helpers_test.go:231: (dbg) Run:  docker inspect pause-20211117171027-31976

helpers_test.go:231: (dbg) Non-zero exit: docker inspect pause-20211117171027-31976: exit status 1 (114.887953ms)

-- stdout --

	[]

-- /stdout --

** stderr ** 

	Error response from daemon: Bad response from Docker engine

** /stderr **

helpers_test.go:233: failed to get docker inspect: exit status 1

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p pause-20211117171027-31976 -n pause-20211117171027-31976

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p pause-20211117171027-31976 -n pause-20211117171027-31976: exit status 85 (94.929647ms)

-- stdout --

	* Profile "pause-20211117171027-31976" not found. Run "minikube profile list" to view all profiles.

	  To start a cluster, run: "minikube start -p pause-20211117171027-31976"

-- /stdout --

helpers_test.go:239: status error: exit status 85 (may be ok)

helpers_test.go:241: "pause-20211117171027-31976" host is not running, skipping log retrieval (state="* Profile \"pause-20211117171027-31976\" not found. Run \"minikube profile list\" to view all profiles.\n  To start a cluster, run: \"minikube start -p pause-20211117171027-31976\"")

--- FAIL: TestPause/serial/Pause (0.51s)

=== RUN   TestPause/serial/VerifyStatus

status_test.go:77: (dbg) Run:  out/minikube-darwin-amd64 status -p pause-20211117171027-31976 --output=json --layout=cluster

status_test.go:77: (dbg) Non-zero exit: out/minikube-darwin-amd64 status -p pause-20211117171027-31976 --output=json --layout=cluster: exit status 85 (41.144016ms)

-- stdout --

	{"specversion":"1.0","id":"c43b0eb6-dc80-47dc-b00c-cb70f5f43e8e","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"Profile \"pause-20211117171027-31976\" not found. Run \"minikube profile list\" to view all profiles."}}

	{"specversion":"1.0","id":"2c592b0c-8f09-42eb-9ae0-e51436f1f94e","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"To start a cluster, run: \"minikube start -p pause-20211117171027-31976\""}}

-- /stdout --

pause_test.go:194: unmarshalling: invalid character '{' after top-level value

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:230: ======>  post-mortem[TestPause/serial/VerifyStatus]: docker inspect <======

helpers_test.go:231: (dbg) Run:  docker inspect pause-20211117171027-31976

helpers_test.go:231: (dbg) Non-zero exit: docker inspect pause-20211117171027-31976: exit status 1 (114.172677ms)

-- stdout --

	[]

-- /stdout --

** stderr ** 

	Error response from daemon: Bad response from Docker engine

** /stderr **

helpers_test.go:233: failed to get docker inspect: exit status 1

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p pause-20211117171027-31976 -n pause-20211117171027-31976

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p pause-20211117171027-31976 -n pause-20211117171027-31976: exit status 85 (95.516913ms)

-- stdout --

	* Profile "pause-20211117171027-31976" not found. Run "minikube profile list" to view all profiles.

	  To start a cluster, run: "minikube start -p pause-20211117171027-31976"

-- /stdout --

helpers_test.go:239: status error: exit status 85 (may be ok)

helpers_test.go:241: "pause-20211117171027-31976" host is not running, skipping log retrieval (state="* Profile \"pause-20211117171027-31976\" not found. Run \"minikube profile list\" to view all profiles.\n  To start a cluster, run: \"minikube start -p pause-20211117171027-31976\"")

--- FAIL: TestPause/serial/VerifyStatus (0.25s)

=== RUN   TestPause/serial/Unpause

pause_test.go:119: (dbg) Run:  out/minikube-darwin-amd64 unpause -p pause-20211117171027-31976 --alsologtostderr -v=5

pause_test.go:119: (dbg) Non-zero exit: out/minikube-darwin-amd64 unpause -p pause-20211117171027-31976 --alsologtostderr -v=5: exit status 85 (95.288704ms)

-- stdout --

	* Profile "pause-20211117171027-31976" not found. Run "minikube profile list" to view all profiles.

	  To start a cluster, run: "minikube start -p pause-20211117171027-31976"

-- /stdout --

** stderr ** 

	I1117 17:10:30.078711   43623 out.go:297] Setting OutFile to fd 1 ...

	I1117 17:10:30.079283   43623 out.go:344] TERM=,COLORTERM=, which probably does not support color

	I1117 17:10:30.079289   43623 out.go:310] Setting ErrFile to fd 2...

	I1117 17:10:30.079292   43623 out.go:344] TERM=,COLORTERM=, which probably does not support color

	I1117 17:10:30.079359   43623 root.go:315] Updating PATH: /Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/bin

	I1117 17:10:30.079615   43623 mustload.go:65] Loading cluster: pause-20211117171027-31976

	I1117 17:10:30.106325   43623 out.go:176] * Profile "pause-20211117171027-31976" not found. Run "minikube profile list" to view all profiles.

	I1117 17:10:30.132188   43623 out.go:176]   To start a cluster, run: "minikube start -p pause-20211117171027-31976"

** /stderr **

pause_test.go:121: failed to unpause minikube with args: "out/minikube-darwin-amd64 unpause -p pause-20211117171027-31976 --alsologtostderr -v=5" : exit status 85

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:230: ======>  post-mortem[TestPause/serial/Unpause]: docker inspect <======

helpers_test.go:231: (dbg) Run:  docker inspect pause-20211117171027-31976

helpers_test.go:231: (dbg) Non-zero exit: docker inspect pause-20211117171027-31976: exit status 1 (118.334441ms)

-- stdout --

	[]

-- /stdout --

** stderr ** 

	Error response from daemon: Bad response from Docker engine

** /stderr **

helpers_test.go:233: failed to get docker inspect: exit status 1

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p pause-20211117171027-31976 -n pause-20211117171027-31976

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p pause-20211117171027-31976 -n pause-20211117171027-31976: exit status 85 (95.076369ms)

-- stdout --

	* Profile "pause-20211117171027-31976" not found. Run "minikube profile list" to view all profiles.

	  To start a cluster, run: "minikube start -p pause-20211117171027-31976"

-- /stdout --

helpers_test.go:239: status error: exit status 85 (may be ok)

helpers_test.go:241: "pause-20211117171027-31976" host is not running, skipping log retrieval (state="* Profile \"pause-20211117171027-31976\" not found. Run \"minikube profile list\" to view all profiles.\n  To start a cluster, run: \"minikube start -p pause-20211117171027-31976\"")

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:230: ======>  post-mortem[TestPause/serial/Unpause]: docker inspect <======

helpers_test.go:231: (dbg) Run:  docker inspect pause-20211117171027-31976

helpers_test.go:231: (dbg) Non-zero exit: docker inspect pause-20211117171027-31976: exit status 1 (118.250509ms)

-- stdout --

	[]

-- /stdout --

** stderr ** 

	Error response from daemon: Bad response from Docker engine

** /stderr **

helpers_test.go:233: failed to get docker inspect: exit status 1

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p pause-20211117171027-31976 -n pause-20211117171027-31976

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p pause-20211117171027-31976 -n pause-20211117171027-31976: exit status 85 (94.502301ms)

-- stdout --

	* Profile "pause-20211117171027-31976" not found. Run "minikube profile list" to view all profiles.

	  To start a cluster, run: "minikube start -p pause-20211117171027-31976"

-- /stdout --

helpers_test.go:239: status error: exit status 85 (may be ok)

helpers_test.go:241: "pause-20211117171027-31976" host is not running, skipping log retrieval (state="* Profile \"pause-20211117171027-31976\" not found. Run \"minikube profile list\" to view all profiles.\n  To start a cluster, run: \"minikube start -p pause-20211117171027-31976\"")

--- FAIL: TestPause/serial/Unpause (0.52s)

=== RUN   TestPause/serial/PauseAgain

pause_test.go:108: (dbg) Run:  out/minikube-darwin-amd64 pause -p pause-20211117171027-31976 --alsologtostderr -v=5

pause_test.go:108: (dbg) Non-zero exit: out/minikube-darwin-amd64 pause -p pause-20211117171027-31976 --alsologtostderr -v=5: exit status 85 (94.879613ms)

-- stdout --

	* Profile "pause-20211117171027-31976" not found. Run "minikube profile list" to view all profiles.

	  To start a cluster, run: "minikube start -p pause-20211117171027-31976"

-- /stdout --

** stderr ** 

	I1117 17:10:30.600850   43638 out.go:297] Setting OutFile to fd 1 ...

	I1117 17:10:30.601045   43638 out.go:344] TERM=,COLORTERM=, which probably does not support color

	I1117 17:10:30.601050   43638 out.go:310] Setting ErrFile to fd 2...

	I1117 17:10:30.601053   43638 out.go:344] TERM=,COLORTERM=, which probably does not support color

	I1117 17:10:30.601126   43638 root.go:315] Updating PATH: /Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/bin

	I1117 17:10:30.601285   43638 out.go:304] Setting JSON to false

	I1117 17:10:30.601300   43638 mustload.go:65] Loading cluster: pause-20211117171027-31976

	I1117 17:10:30.627452   43638 out.go:176] * Profile "pause-20211117171027-31976" not found. Run "minikube profile list" to view all profiles.

	I1117 17:10:30.654349   43638 out.go:176]   To start a cluster, run: "minikube start -p pause-20211117171027-31976"

** /stderr **

pause_test.go:110: failed to pause minikube with args: "out/minikube-darwin-amd64 pause -p pause-20211117171027-31976 --alsologtostderr -v=5" : exit status 85

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:230: ======>  post-mortem[TestPause/serial/PauseAgain]: docker inspect <======

helpers_test.go:231: (dbg) Run:  docker inspect pause-20211117171027-31976

helpers_test.go:231: (dbg) Non-zero exit: docker inspect pause-20211117171027-31976: exit status 1 (114.867689ms)

-- stdout --

	[]

-- /stdout --

** stderr ** 

	Error response from daemon: Bad response from Docker engine

** /stderr **

helpers_test.go:233: failed to get docker inspect: exit status 1

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p pause-20211117171027-31976 -n pause-20211117171027-31976

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p pause-20211117171027-31976 -n pause-20211117171027-31976: exit status 85 (94.042813ms)

-- stdout --

	* Profile "pause-20211117171027-31976" not found. Run "minikube profile list" to view all profiles.

	  To start a cluster, run: "minikube start -p pause-20211117171027-31976"

-- /stdout --

helpers_test.go:239: status error: exit status 85 (may be ok)

helpers_test.go:241: "pause-20211117171027-31976" host is not running, skipping log retrieval (state="* Profile \"pause-20211117171027-31976\" not found. Run \"minikube profile list\" to view all profiles.\n  To start a cluster, run: \"minikube start -p pause-20211117171027-31976\"")

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:230: ======>  post-mortem[TestPause/serial/PauseAgain]: docker inspect <======

helpers_test.go:231: (dbg) Run:  docker inspect pause-20211117171027-31976

helpers_test.go:231: (dbg) Non-zero exit: docker inspect pause-20211117171027-31976: exit status 1 (116.771234ms)

-- stdout --

	[]

-- /stdout --

** stderr ** 

	Error response from daemon: Bad response from Docker engine

** /stderr **

helpers_test.go:233: failed to get docker inspect: exit status 1

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p pause-20211117171027-31976 -n pause-20211117171027-31976

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p pause-20211117171027-31976 -n pause-20211117171027-31976: exit status 85 (93.521892ms)

-- stdout --

	* Profile "pause-20211117171027-31976" not found. Run "minikube profile list" to view all profiles.

	  To start a cluster, run: "minikube start -p pause-20211117171027-31976"

-- /stdout --

helpers_test.go:239: status error: exit status 85 (may be ok)

helpers_test.go:241: "pause-20211117171027-31976" host is not running, skipping log retrieval (state="* Profile \"pause-20211117171027-31976\" not found. Run \"minikube profile list\" to view all profiles.\n  To start a cluster, run: \"minikube start -p pause-20211117171027-31976\"")

--- FAIL: TestPause/serial/PauseAgain (0.52s)

=== RUN   TestPause/serial/VerifyDeletedResources

pause_test.go:140: (dbg) Run:  out/minikube-darwin-amd64 profile list --output json

pause_test.go:166: (dbg) Run:  docker ps -a

pause_test.go:166: (dbg) Non-zero exit: docker ps -a: exit status 1 (115.321064ms)

** stderr ** 

	Error response from daemon: Bad response from Docker engine

** /stderr **

pause_test.go:171: (dbg) Run:  docker volume inspect pause-20211117171027-31976

pause_test.go:171: (dbg) Non-zero exit: docker volume inspect pause-20211117171027-31976: exit status 1 (118.301439ms)

-- stdout --

	[]

-- /stdout --

** stderr ** 

	Error response from daemon: Bad response from Docker engine

** /stderr **

pause_test.go:176: (dbg) Run:  sudo docker network ls

pause_test.go:176: (dbg) Non-zero exit: sudo docker network ls: exit status 1 (137.253632ms)

** stderr ** 

	Error response from daemon: Bad response from Docker engine

** /stderr **

pause_test.go:178: failed to get list of networks: exit status 1

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:230: ======>  post-mortem[TestPause/serial/VerifyDeletedResources]: docker inspect <======

helpers_test.go:231: (dbg) Run:  docker inspect pause-20211117171027-31976

helpers_test.go:231: (dbg) Non-zero exit: docker inspect pause-20211117171027-31976: exit status 1 (120.81741ms)

-- stdout --

	[]

-- /stdout --

** stderr ** 

	Error response from daemon: Bad response from Docker engine

** /stderr **

helpers_test.go:233: failed to get docker inspect: exit status 1

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p pause-20211117171027-31976 -n pause-20211117171027-31976

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p pause-20211117171027-31976 -n pause-20211117171027-31976: exit status 85 (99.043891ms)

-- stdout --

	* Profile "pause-20211117171027-31976" not found. Run "minikube profile list" to view all profiles.

	  To start a cluster, run: "minikube start -p pause-20211117171027-31976"

-- /stdout --

helpers_test.go:239: status error: exit status 85 (may be ok)

helpers_test.go:241: "pause-20211117171027-31976" host is not running, skipping log retrieval (state="* Profile \"pause-20211117171027-31976\" not found. Run \"minikube profile list\" to view all profiles.\n  To start a cluster, run: \"minikube start -p pause-20211117171027-31976\"")

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:230: ======>  post-mortem[TestPause/serial/VerifyDeletedResources]: docker inspect <======

helpers_test.go:231: (dbg) Run:  docker inspect pause-20211117171027-31976

helpers_test.go:231: (dbg) Non-zero exit: docker inspect pause-20211117171027-31976: exit status 1 (124.825145ms)

-- stdout --

	[]

-- /stdout --

** stderr ** 

	Error response from daemon: Bad response from Docker engine

** /stderr **

helpers_test.go:233: failed to get docker inspect: exit status 1

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p pause-20211117171027-31976 -n pause-20211117171027-31976

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p pause-20211117171027-31976 -n pause-20211117171027-31976: exit status 85 (99.148667ms)

-- stdout --

	* Profile "pause-20211117171027-31976" not found. Run "minikube profile list" to view all profiles.

	  To start a cluster, run: "minikube start -p pause-20211117171027-31976"

-- /stdout --

helpers_test.go:239: status error: exit status 85 (may be ok)

helpers_test.go:241: "pause-20211117171027-31976" host is not running, skipping log retrieval (state="* Profile \"pause-20211117171027-31976\" not found. Run \"minikube profile list\" to view all profiles.\n  To start a cluster, run: \"minikube start -p pause-20211117171027-31976\"")

--- FAIL: TestPause/serial/VerifyDeletedResources (1.14s)

=== RUN   TestNoKubernetes/serial/Start

no_kubernetes_test.go:78: (dbg) Run:  out/minikube-darwin-amd64 start -p NoKubernetes-20211117171033-31976 --no-kubernetes --driver=docker 

no_kubernetes_test.go:78: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p NoKubernetes-20211117171033-31976 --no-kubernetes --driver=docker : exit status 69 (406.708336ms)

-- stdout --

	* [NoKubernetes-20211117171033-31976] minikube v1.24.0 on Darwin 11.2.3

	  - MINIKUBE_LOCATION=12739

	  - KUBECONFIG=/Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/kubeconfig

	  - MINIKUBE_BIN=out/minikube-darwin-amd64

	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube

	* Using the docker driver based on user configuration

-- /stdout --

** stderr ** 

	X Exiting due to PROVIDER_DOCKER_VERSION_EXIT_1: "docker version --format -" exit status 1: Error response from daemon: Bad response from Docker engine

	* Documentation: https://minikube.sigs.k8s.io/docs/drivers/docker/

** /stderr **

no_kubernetes_test.go:80: failed to start minikube with args: "out/minikube-darwin-amd64 start -p NoKubernetes-20211117171033-31976 --no-kubernetes --driver=docker " : exit status 69

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:230: ======>  post-mortem[TestNoKubernetes/serial/Start]: docker inspect <======

helpers_test.go:231: (dbg) Run:  docker inspect NoKubernetes-20211117171033-31976

helpers_test.go:231: (dbg) Non-zero exit: docker inspect NoKubernetes-20211117171033-31976: exit status 1 (120.76095ms)

-- stdout --

	[]

-- /stdout --

** stderr ** 

	Error response from daemon: Bad response from Docker engine

** /stderr **

helpers_test.go:233: failed to get docker inspect: exit status 1

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p NoKubernetes-20211117171033-31976 -n NoKubernetes-20211117171033-31976

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p NoKubernetes-20211117171033-31976 -n NoKubernetes-20211117171033-31976: exit status 85 (99.481399ms)

-- stdout --

	* Profile "NoKubernetes-20211117171033-31976" not found. Run "minikube profile list" to view all profiles.

	  To start a cluster, run: "minikube start -p NoKubernetes-20211117171033-31976"

-- /stdout --

helpers_test.go:239: status error: exit status 85 (may be ok)

helpers_test.go:241: "NoKubernetes-20211117171033-31976" host is not running, skipping log retrieval (state="* Profile \"NoKubernetes-20211117171033-31976\" not found. Run \"minikube profile list\" to view all profiles.\n  To start a cluster, run: \"minikube start -p NoKubernetes-20211117171033-31976\"")

--- FAIL: TestNoKubernetes/serial/Start (0.63s)

=== RUN   TestNoKubernetes/serial/ProfileList

no_kubernetes_test.go:111: (dbg) Run:  out/minikube-darwin-amd64 profile list

no_kubernetes_test.go:117: expected N/A in the profile list for kubernetes version but got : "out/minikube-darwin-amd64 profile list" : 

-- stdout --

	|--------------------------------------|-----------|---------|----|------|---------|---------|-------|

	|               Profile                | VM Driver | Runtime | IP | Port | Version | Status  | Nodes |

	|--------------------------------------|-----------|---------|----|------|---------|---------|-------|

	| running-upgrade-20211117170725-31976 | docker    | docker  |    | 8443 | v1.18.0 | Unknown |     1 |

	|--------------------------------------|-----------|---------|----|------|---------|---------|-------|

-- /stdout --

** stderr ** 

	! Found 2 invalid profile(s) ! 

	* 	 NoKubernetes-20211117171033-31976

	* 	 multinode-20211117163734-31976-m02

	* You can delete them using the following command(s): 

		 $ minikube delete -p NoKubernetes-20211117171033-31976 

		 $ minikube delete -p multinode-20211117163734-31976-m02 

** /stderr **

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:230: ======>  post-mortem[TestNoKubernetes/serial/ProfileList]: docker inspect <======

helpers_test.go:231: (dbg) Run:  docker inspect NoKubernetes-20211117171033-31976

helpers_test.go:231: (dbg) Non-zero exit: docker inspect NoKubernetes-20211117171033-31976: exit status 1 (115.155447ms)

-- stdout --

	[]

-- /stdout --

** stderr ** 

	Error response from daemon: Bad response from Docker engine

** /stderr **

helpers_test.go:233: failed to get docker inspect: exit status 1

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p NoKubernetes-20211117171033-31976 -n NoKubernetes-20211117171033-31976

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p NoKubernetes-20211117171033-31976 -n NoKubernetes-20211117171033-31976: exit status 85 (93.435193ms)

-- stdout --

	* Profile "NoKubernetes-20211117171033-31976" not found. Run "minikube profile list" to view all profiles.

	  To start a cluster, run: "minikube start -p NoKubernetes-20211117171033-31976"

-- /stdout --

helpers_test.go:239: status error: exit status 85 (may be ok)

helpers_test.go:241: "NoKubernetes-20211117171033-31976" host is not running, skipping log retrieval (state="* Profile \"NoKubernetes-20211117171033-31976\" not found. Run \"minikube profile list\" to view all profiles.\n  To start a cluster, run: \"minikube start -p NoKubernetes-20211117171033-31976\"")

--- FAIL: TestNoKubernetes/serial/ProfileList (0.51s)

=== RUN   TestNoKubernetes/serial/Stop

no_kubernetes_test.go:100: (dbg) Run:  out/minikube-darwin-amd64 stop -p NoKubernetes-20211117171033-31976

no_kubernetes_test.go:100: (dbg) Non-zero exit: out/minikube-darwin-amd64 stop -p NoKubernetes-20211117171033-31976: exit status 85 (93.543522ms)

-- stdout --

	* Profile "NoKubernetes-20211117171033-31976" not found. Run "minikube profile list" to view all profiles.

	  To start a cluster, run: "minikube start -p NoKubernetes-20211117171033-31976"

-- /stdout --

no_kubernetes_test.go:102: Failed to stop minikube "out/minikube-darwin-amd64 stop -p NoKubernetes-20211117171033-31976" : exit status 85

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:230: ======>  post-mortem[TestNoKubernetes/serial/Stop]: docker inspect <======

helpers_test.go:231: (dbg) Run:  docker inspect NoKubernetes-20211117171033-31976

helpers_test.go:231: (dbg) Non-zero exit: docker inspect NoKubernetes-20211117171033-31976: exit status 1 (114.697769ms)

-- stdout --

	[]

-- /stdout --

** stderr ** 

	Error response from daemon: Bad response from Docker engine

** /stderr **

helpers_test.go:233: failed to get docker inspect: exit status 1

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p NoKubernetes-20211117171033-31976 -n NoKubernetes-20211117171033-31976

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p NoKubernetes-20211117171033-31976 -n NoKubernetes-20211117171033-31976: exit status 85 (93.989844ms)

-- stdout --

	* Profile "NoKubernetes-20211117171033-31976" not found. Run "minikube profile list" to view all profiles.

	  To start a cluster, run: "minikube start -p NoKubernetes-20211117171033-31976"

-- /stdout --

helpers_test.go:239: status error: exit status 85 (may be ok)

helpers_test.go:241: "NoKubernetes-20211117171033-31976" host is not running, skipping log retrieval (state="* Profile \"NoKubernetes-20211117171033-31976\" not found. Run \"minikube profile list\" to view all profiles.\n  To start a cluster, run: \"minikube start -p NoKubernetes-20211117171033-31976\"")

--- FAIL: TestNoKubernetes/serial/Stop (0.30s)

=== RUN   TestNoKubernetes/serial/StartNoArgs

no_kubernetes_test.go:133: (dbg) Run:  out/minikube-darwin-amd64 start -p NoKubernetes-20211117171033-31976 --driver=docker 

no_kubernetes_test.go:133: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p NoKubernetes-20211117171033-31976 --driver=docker : exit status 69 (437.710967ms)

-- stdout --

	* [NoKubernetes-20211117171033-31976] minikube v1.24.0 on Darwin 11.2.3

	  - MINIKUBE_LOCATION=12739

	  - KUBECONFIG=/Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/kubeconfig

	  - MINIKUBE_BIN=out/minikube-darwin-amd64

	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube

	* Using the docker driver based on user configuration

-- /stdout --

** stderr ** 

	X Exiting due to PROVIDER_DOCKER_VERSION_EXIT_1: "docker version --format -" exit status 1: Error response from daemon: Bad response from Docker engine

	* Documentation: https://minikube.sigs.k8s.io/docs/drivers/docker/

** /stderr **

no_kubernetes_test.go:135: failed to start minikube with args: "out/minikube-darwin-amd64 start -p NoKubernetes-20211117171033-31976 --driver=docker " : exit status 69

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:230: ======>  post-mortem[TestNoKubernetes/serial/StartNoArgs]: docker inspect <======

helpers_test.go:231: (dbg) Run:  docker inspect NoKubernetes-20211117171033-31976

helpers_test.go:231: (dbg) Non-zero exit: docker inspect NoKubernetes-20211117171033-31976: exit status 1 (149.600032ms)

-- stdout --

	[]

-- /stdout --

** stderr ** 

	Error response from daemon: Bad response from Docker engine

** /stderr **

helpers_test.go:233: failed to get docker inspect: exit status 1

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p NoKubernetes-20211117171033-31976 -n NoKubernetes-20211117171033-31976

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p NoKubernetes-20211117171033-31976 -n NoKubernetes-20211117171033-31976: exit status 85 (98.073779ms)

-- stdout --

	* Profile "NoKubernetes-20211117171033-31976" not found. Run "minikube profile list" to view all profiles.

	  To start a cluster, run: "minikube start -p NoKubernetes-20211117171033-31976"

-- /stdout --

helpers_test.go:239: status error: exit status 85 (may be ok)

helpers_test.go:241: "NoKubernetes-20211117171033-31976" host is not running, skipping log retrieval (state="* Profile \"NoKubernetes-20211117171033-31976\" not found. Run \"minikube profile list\" to view all profiles.\n  To start a cluster, run: \"minikube start -p NoKubernetes-20211117171033-31976\"")

--- FAIL: TestNoKubernetes/serial/StartNoArgs (0.69s)

=== RUN   TestNetworkPlugins/group/auto/Start

net_test.go:99: (dbg) Run:  out/minikube-darwin-amd64 start -p auto-20211117170334-31976 --memory=2048 --alsologtostderr --wait=true --wait-timeout=5m --driver=docker 

net_test.go:99: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p auto-20211117170334-31976 --memory=2048 --alsologtostderr --wait=true --wait-timeout=5m --driver=docker : exit status 69 (428.583971ms)

-- stdout --

	* [auto-20211117170334-31976] minikube v1.24.0 on Darwin 11.2.3

	  - MINIKUBE_LOCATION=12739

	  - KUBECONFIG=/Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/kubeconfig

	  - MINIKUBE_BIN=out/minikube-darwin-amd64

	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube

	* Using the docker driver based on user configuration

-- /stdout --

** stderr ** 

	I1117 17:10:59.934533   44061 out.go:297] Setting OutFile to fd 1 ...

	I1117 17:10:59.934673   44061 out.go:344] TERM=,COLORTERM=, which probably does not support color

	I1117 17:10:59.934678   44061 out.go:310] Setting ErrFile to fd 2...

	I1117 17:10:59.934681   44061 out.go:344] TERM=,COLORTERM=, which probably does not support color

	I1117 17:10:59.934772   44061 root.go:315] Updating PATH: /Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/bin

	I1117 17:10:59.935085   44061 out.go:304] Setting JSON to false

	I1117 17:10:59.960020   44061 start.go:112] hostinfo: {"hostname":"37310.local","uptime":11434,"bootTime":1637186425,"procs":360,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"11.2.3","kernelVersion":"20.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"bd1c05a8-24a6-5973-aa69-f3c7c66a87ce"}

	W1117 17:10:59.960108   44061 start.go:120] gopshost.Virtualization returned error: not implemented yet

	I1117 17:10:59.987245   44061 out.go:176] * [auto-20211117170334-31976] minikube v1.24.0 on Darwin 11.2.3

	I1117 17:10:59.987436   44061 notify.go:174] Checking for updates...

	I1117 17:11:00.034912   44061 out.go:176]   - MINIKUBE_LOCATION=12739

	I1117 17:11:00.060624   44061 out.go:176]   - KUBECONFIG=/Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/kubeconfig

	I1117 17:11:00.086752   44061 out.go:176]   - MINIKUBE_BIN=out/minikube-darwin-amd64

	I1117 17:11:00.112672   44061 out.go:176]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube

	I1117 17:11:00.112930   44061 driver.go:343] Setting default libvirt URI to qemu:///system

	W1117 17:11:00.200802   44061 docker.go:108] docker version returned error: exit status 1

	I1117 17:11:00.227520   44061 out.go:176] * Using the docker driver based on user configuration

	I1117 17:11:00.227533   44061 start.go:280] selected driver: docker

	I1117 17:11:00.227538   44061 start.go:775] validating driver "docker" against <nil>

	I1117 17:11:00.227553   44061 start.go:786] status for docker: {Installed:true Healthy:false Running:true NeedsImprovement:false Error:"docker version --format {{.Server.Os}}-{{.Server.Version}}" exit status 1: Error response from daemon: Bad response from Docker engine Reason:PROVIDER_DOCKER_VERSION_EXIT_1 Fix: Doc:https://minikube.sigs.k8s.io/docs/drivers/docker/}

	I1117 17:11:00.276941   44061 out.go:176] 

	W1117 17:11:00.277125   44061 out.go:241] X Exiting due to PROVIDER_DOCKER_VERSION_EXIT_1: "docker version --format -" exit status 1: Error response from daemon: Bad response from Docker engine

	X Exiting due to PROVIDER_DOCKER_VERSION_EXIT_1: "docker version --format -" exit status 1: Error response from daemon: Bad response from Docker engine

	W1117 17:11:00.277209   44061 out.go:241] * Documentation: https://minikube.sigs.k8s.io/docs/drivers/docker/

	* Documentation: https://minikube.sigs.k8s.io/docs/drivers/docker/

	I1117 17:11:00.302571   44061 out.go:176] 

** /stderr **

net_test.go:101: failed start: exit status 69

--- FAIL: TestNetworkPlugins/group/auto/Start (0.43s)

=== RUN   TestNetworkPlugins/group/false/Start

net_test.go:99: (dbg) Run:  out/minikube-darwin-amd64 start -p false-20211117170335-31976 --memory=2048 --alsologtostderr --wait=true --wait-timeout=5m --cni=false --driver=docker 

net_test.go:99: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p false-20211117170335-31976 --memory=2048 --alsologtostderr --wait=true --wait-timeout=5m --cni=false --driver=docker : exit status 69 (449.254402ms)

-- stdout --

	* [false-20211117170335-31976] minikube v1.24.0 on Darwin 11.2.3

	  - MINIKUBE_LOCATION=12739

	  - KUBECONFIG=/Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/kubeconfig

	  - MINIKUBE_BIN=out/minikube-darwin-amd64

	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube

	* Using the docker driver based on user configuration

-- /stdout --

** stderr ** 

	I1117 17:11:01.242511   44094 out.go:297] Setting OutFile to fd 1 ...

	I1117 17:11:01.242698   44094 out.go:344] TERM=,COLORTERM=, which probably does not support color

	I1117 17:11:01.242703   44094 out.go:310] Setting ErrFile to fd 2...

	I1117 17:11:01.242706   44094 out.go:344] TERM=,COLORTERM=, which probably does not support color

	I1117 17:11:01.242785   44094 root.go:315] Updating PATH: /Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/bin

	I1117 17:11:01.243091   44094 out.go:304] Setting JSON to false

	I1117 17:11:01.267811   44094 start.go:112] hostinfo: {"hostname":"37310.local","uptime":11436,"bootTime":1637186425,"procs":360,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"11.2.3","kernelVersion":"20.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"bd1c05a8-24a6-5973-aa69-f3c7c66a87ce"}

	W1117 17:11:01.267905   44094 start.go:120] gopshost.Virtualization returned error: not implemented yet

	I1117 17:11:01.295133   44094 out.go:176] * [false-20211117170335-31976] minikube v1.24.0 on Darwin 11.2.3

	I1117 17:11:01.295340   44094 notify.go:174] Checking for updates...

	I1117 17:11:01.342752   44094 out.go:176]   - MINIKUBE_LOCATION=12739

	I1117 17:11:01.368330   44094 out.go:176]   - KUBECONFIG=/Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/kubeconfig

	I1117 17:11:01.410528   44094 out.go:176]   - MINIKUBE_BIN=out/minikube-darwin-amd64

	I1117 17:11:01.437412   44094 out.go:176]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube

	I1117 17:11:01.437734   44094 driver.go:343] Setting default libvirt URI to qemu:///system

	W1117 17:11:01.526383   44094 docker.go:108] docker version returned error: exit status 1

	I1117 17:11:01.553566   44094 out.go:176] * Using the docker driver based on user configuration

	I1117 17:11:01.553637   44094 start.go:280] selected driver: docker

	I1117 17:11:01.553653   44094 start.go:775] validating driver "docker" against <nil>

	I1117 17:11:01.553688   44094 start.go:786] status for docker: {Installed:true Healthy:false Running:true NeedsImprovement:false Error:"docker version --format {{.Server.Os}}-{{.Server.Version}}" exit status 1: Error response from daemon: Bad response from Docker engine Reason:PROVIDER_DOCKER_VERSION_EXIT_1 Fix: Doc:https://minikube.sigs.k8s.io/docs/drivers/docker/}

	I1117 17:11:01.601872   44094 out.go:176] 

	W1117 17:11:01.602087   44094 out.go:241] X Exiting due to PROVIDER_DOCKER_VERSION_EXIT_1: "docker version --format -" exit status 1: Error response from daemon: Bad response from Docker engine

	X Exiting due to PROVIDER_DOCKER_VERSION_EXIT_1: "docker version --format -" exit status 1: Error response from daemon: Bad response from Docker engine

	W1117 17:11:01.602174   44094 out.go:241] * Documentation: https://minikube.sigs.k8s.io/docs/drivers/docker/

	* Documentation: https://minikube.sigs.k8s.io/docs/drivers/docker/

	I1117 17:11:01.630111   44094 out.go:176] 

** /stderr **

net_test.go:101: failed start: exit status 69

--- FAIL: TestNetworkPlugins/group/false/Start (0.45s)

=== RUN   TestNetworkPlugins/group/cilium/Start

net_test.go:99: (dbg) Run:  out/minikube-darwin-amd64 start -p cilium-20211117170335-31976 --memory=2048 --alsologtostderr --wait=true --wait-timeout=5m --cni=cilium --driver=docker 

net_test.go:99: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p cilium-20211117170335-31976 --memory=2048 --alsologtostderr --wait=true --wait-timeout=5m --cni=cilium --driver=docker : exit status 69 (450.046719ms)

-- stdout --

	* [cilium-20211117170335-31976] minikube v1.24.0 on Darwin 11.2.3

	  - MINIKUBE_LOCATION=12739

	  - KUBECONFIG=/Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/kubeconfig

	  - MINIKUBE_BIN=out/minikube-darwin-amd64

	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube

	* Using the docker driver based on user configuration

-- /stdout --

** stderr ** 

	I1117 17:11:02.573932   44127 out.go:297] Setting OutFile to fd 1 ...

	I1117 17:11:02.574062   44127 out.go:344] TERM=,COLORTERM=, which probably does not support color

	I1117 17:11:02.574066   44127 out.go:310] Setting ErrFile to fd 2...

	I1117 17:11:02.574070   44127 out.go:344] TERM=,COLORTERM=, which probably does not support color

	I1117 17:11:02.574139   44127 root.go:315] Updating PATH: /Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/bin

	I1117 17:11:02.574449   44127 out.go:304] Setting JSON to false

	I1117 17:11:02.599252   44127 start.go:112] hostinfo: {"hostname":"37310.local","uptime":11437,"bootTime":1637186425,"procs":360,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"11.2.3","kernelVersion":"20.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"bd1c05a8-24a6-5973-aa69-f3c7c66a87ce"}

	W1117 17:11:02.599348   44127 start.go:120] gopshost.Virtualization returned error: not implemented yet

	I1117 17:11:02.626613   44127 out.go:176] * [cilium-20211117170335-31976] minikube v1.24.0 on Darwin 11.2.3

	I1117 17:11:02.626837   44127 notify.go:174] Checking for updates...

	I1117 17:11:02.675051   44127 out.go:176]   - MINIKUBE_LOCATION=12739

	I1117 17:11:02.701008   44127 out.go:176]   - KUBECONFIG=/Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/kubeconfig

	I1117 17:11:02.727148   44127 out.go:176]   - MINIKUBE_BIN=out/minikube-darwin-amd64

	I1117 17:11:02.752781   44127 out.go:176]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube

	I1117 17:11:02.752979   44127 driver.go:343] Setting default libvirt URI to qemu:///system

	W1117 17:11:02.839183   44127 docker.go:108] docker version returned error: exit status 1

	I1117 17:11:02.865052   44127 out.go:176] * Using the docker driver based on user configuration

	I1117 17:11:02.865112   44127 start.go:280] selected driver: docker

	I1117 17:11:02.865123   44127 start.go:775] validating driver "docker" against <nil>

	I1117 17:11:02.865152   44127 start.go:786] status for docker: {Installed:true Healthy:false Running:true NeedsImprovement:false Error:"docker version --format {{.Server.Os}}-{{.Server.Version}}" exit status 1: Error response from daemon: Bad response from Docker engine Reason:PROVIDER_DOCKER_VERSION_EXIT_1 Fix: Doc:https://minikube.sigs.k8s.io/docs/drivers/docker/}

	I1117 17:11:02.911965   44127 out.go:176] 

	W1117 17:11:02.912184   44127 out.go:241] X Exiting due to PROVIDER_DOCKER_VERSION_EXIT_1: "docker version --format -" exit status 1: Error response from daemon: Bad response from Docker engine

	X Exiting due to PROVIDER_DOCKER_VERSION_EXIT_1: "docker version --format -" exit status 1: Error response from daemon: Bad response from Docker engine

	W1117 17:11:02.912264   44127 out.go:241] * Documentation: https://minikube.sigs.k8s.io/docs/drivers/docker/

	* Documentation: https://minikube.sigs.k8s.io/docs/drivers/docker/

	I1117 17:11:02.964198   44127 out.go:176] 

** /stderr **

net_test.go:101: failed start: exit status 69

--- FAIL: TestNetworkPlugins/group/cilium/Start (0.45s)

=== RUN   TestNetworkPlugins/group/calico/Start

net_test.go:99: (dbg) Run:  out/minikube-darwin-amd64 start -p calico-20211117170335-31976 --memory=2048 --alsologtostderr --wait=true --wait-timeout=5m --cni=calico --driver=docker 

net_test.go:99: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p calico-20211117170335-31976 --memory=2048 --alsologtostderr --wait=true --wait-timeout=5m --cni=calico --driver=docker : exit status 69 (427.920832ms)

-- stdout --

	* [calico-20211117170335-31976] minikube v1.24.0 on Darwin 11.2.3

	  - MINIKUBE_LOCATION=12739

	  - KUBECONFIG=/Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/kubeconfig

	  - MINIKUBE_BIN=out/minikube-darwin-amd64

	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube

	* Using the docker driver based on user configuration

-- /stdout --

** stderr ** 

	I1117 17:11:03.950926   44160 out.go:297] Setting OutFile to fd 1 ...

	I1117 17:11:03.951054   44160 out.go:344] TERM=,COLORTERM=, which probably does not support color

	I1117 17:11:03.951059   44160 out.go:310] Setting ErrFile to fd 2...

	I1117 17:11:03.951065   44160 out.go:344] TERM=,COLORTERM=, which probably does not support color

	I1117 17:11:03.951143   44160 root.go:315] Updating PATH: /Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/bin

	I1117 17:11:03.951446   44160 out.go:304] Setting JSON to false

	I1117 17:11:03.976699   44160 start.go:112] hostinfo: {"hostname":"37310.local","uptime":11438,"bootTime":1637186425,"procs":360,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"11.2.3","kernelVersion":"20.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"bd1c05a8-24a6-5973-aa69-f3c7c66a87ce"}

	W1117 17:11:03.976803   44160 start.go:120] gopshost.Virtualization returned error: not implemented yet

	I1117 17:11:04.003953   44160 out.go:176] * [calico-20211117170335-31976] minikube v1.24.0 on Darwin 11.2.3

	I1117 17:11:04.004148   44160 notify.go:174] Checking for updates...

	I1117 17:11:04.052659   44160 out.go:176]   - MINIKUBE_LOCATION=12739

	I1117 17:11:04.078708   44160 out.go:176]   - KUBECONFIG=/Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/kubeconfig

	I1117 17:11:04.104223   44160 out.go:176]   - MINIKUBE_BIN=out/minikube-darwin-amd64

	I1117 17:11:04.130404   44160 out.go:176]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube

	I1117 17:11:04.130613   44160 driver.go:343] Setting default libvirt URI to qemu:///system

	W1117 17:11:04.218336   44160 docker.go:108] docker version returned error: exit status 1

	I1117 17:11:04.244736   44160 out.go:176] * Using the docker driver based on user configuration

	I1117 17:11:04.244774   44160 start.go:280] selected driver: docker

	I1117 17:11:04.244791   44160 start.go:775] validating driver "docker" against <nil>

	I1117 17:11:04.244833   44160 start.go:786] status for docker: {Installed:true Healthy:false Running:true NeedsImprovement:false Error:"docker version --format {{.Server.Os}}-{{.Server.Version}}" exit status 1: Error response from daemon: Bad response from Docker engine Reason:PROVIDER_DOCKER_VERSION_EXIT_1 Fix: Doc:https://minikube.sigs.k8s.io/docs/drivers/docker/}

	I1117 17:11:04.291677   44160 out.go:176] 

	W1117 17:11:04.291898   44160 out.go:241] X Exiting due to PROVIDER_DOCKER_VERSION_EXIT_1: "docker version --format -" exit status 1: Error response from daemon: Bad response from Docker engine

	X Exiting due to PROVIDER_DOCKER_VERSION_EXIT_1: "docker version --format -" exit status 1: Error response from daemon: Bad response from Docker engine

	W1117 17:11:04.292013   44160 out.go:241] * Documentation: https://minikube.sigs.k8s.io/docs/drivers/docker/

	* Documentation: https://minikube.sigs.k8s.io/docs/drivers/docker/

	I1117 17:11:04.318485   44160 out.go:176] 

** /stderr **

net_test.go:101: failed start: exit status 69

--- FAIL: TestNetworkPlugins/group/calico/Start (0.43s)

=== RUN   TestNetworkPlugins/group/custom-weave/Start

net_test.go:99: (dbg) Run:  out/minikube-darwin-amd64 start -p custom-weave-20211117170335-31976 --memory=2048 --alsologtostderr --wait=true --wait-timeout=5m --cni=testdata/weavenet.yaml --driver=docker 

net_test.go:99: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p custom-weave-20211117170335-31976 --memory=2048 --alsologtostderr --wait=true --wait-timeout=5m --cni=testdata/weavenet.yaml --driver=docker : exit status 69 (427.466337ms)

-- stdout --

	* [custom-weave-20211117170335-31976] minikube v1.24.0 on Darwin 11.2.3

	  - MINIKUBE_LOCATION=12739

	  - KUBECONFIG=/Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/kubeconfig

	  - MINIKUBE_BIN=out/minikube-darwin-amd64

	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube

	* Using the docker driver based on user configuration

-- /stdout --

** stderr ** 

	I1117 17:11:05.257392   44195 out.go:297] Setting OutFile to fd 1 ...

	I1117 17:11:05.257524   44195 out.go:344] TERM=,COLORTERM=, which probably does not support color

	I1117 17:11:05.257528   44195 out.go:310] Setting ErrFile to fd 2...

	I1117 17:11:05.257532   44195 out.go:344] TERM=,COLORTERM=, which probably does not support color

	I1117 17:11:05.257607   44195 root.go:315] Updating PATH: /Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/bin

	I1117 17:11:05.257913   44195 out.go:304] Setting JSON to false

	I1117 17:11:05.282753   44195 start.go:112] hostinfo: {"hostname":"37310.local","uptime":11440,"bootTime":1637186425,"procs":362,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"11.2.3","kernelVersion":"20.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"bd1c05a8-24a6-5973-aa69-f3c7c66a87ce"}

	W1117 17:11:05.282842   44195 start.go:120] gopshost.Virtualization returned error: not implemented yet

	I1117 17:11:05.310098   44195 out.go:176] * [custom-weave-20211117170335-31976] minikube v1.24.0 on Darwin 11.2.3

	I1117 17:11:05.357809   44195 out.go:176]   - MINIKUBE_LOCATION=12739

	I1117 17:11:05.310293   44195 notify.go:174] Checking for updates...

	I1117 17:11:05.384807   44195 out.go:176]   - KUBECONFIG=/Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/kubeconfig

	I1117 17:11:05.410511   44195 out.go:176]   - MINIKUBE_BIN=out/minikube-darwin-amd64

	I1117 17:11:05.436645   44195 out.go:176]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube

	I1117 17:11:05.437143   44195 driver.go:343] Setting default libvirt URI to qemu:///system

	W1117 17:11:05.525020   44195 docker.go:108] docker version returned error: exit status 1

	I1117 17:11:05.550582   44195 out.go:176] * Using the docker driver based on user configuration

	I1117 17:11:05.550596   44195 start.go:280] selected driver: docker

	I1117 17:11:05.550600   44195 start.go:775] validating driver "docker" against <nil>

	I1117 17:11:05.550610   44195 start.go:786] status for docker: {Installed:true Healthy:false Running:true NeedsImprovement:false Error:"docker version --format {{.Server.Os}}-{{.Server.Version}}" exit status 1: Error response from daemon: Bad response from Docker engine Reason:PROVIDER_DOCKER_VERSION_EXIT_1 Fix: Doc:https://minikube.sigs.k8s.io/docs/drivers/docker/}

	I1117 17:11:05.597718   44195 out.go:176] 

	W1117 17:11:05.597970   44195 out.go:241] X Exiting due to PROVIDER_DOCKER_VERSION_EXIT_1: "docker version --format -" exit status 1: Error response from daemon: Bad response from Docker engine

	X Exiting due to PROVIDER_DOCKER_VERSION_EXIT_1: "docker version --format -" exit status 1: Error response from daemon: Bad response from Docker engine

	W1117 17:11:05.598055   44195 out.go:241] * Documentation: https://minikube.sigs.k8s.io/docs/drivers/docker/

	* Documentation: https://minikube.sigs.k8s.io/docs/drivers/docker/

	I1117 17:11:05.623720   44195 out.go:176] 

** /stderr **

net_test.go:101: failed start: exit status 69

--- FAIL: TestNetworkPlugins/group/custom-weave/Start (0.43s)

=== RUN   TestNetworkPlugins/group/enable-default-cni/Start

net_test.go:99: (dbg) Run:  out/minikube-darwin-amd64 start -p enable-default-cni-20211117170334-31976 --memory=2048 --alsologtostderr --wait=true --wait-timeout=5m --enable-default-cni=true --driver=docker 

net_test.go:99: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p enable-default-cni-20211117170334-31976 --memory=2048 --alsologtostderr --wait=true --wait-timeout=5m --enable-default-cni=true --driver=docker : exit status 69 (406.726641ms)

-- stdout --

	* [enable-default-cni-20211117170334-31976] minikube v1.24.0 on Darwin 11.2.3

	  - MINIKUBE_LOCATION=12739

	  - KUBECONFIG=/Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/kubeconfig

	  - MINIKUBE_BIN=out/minikube-darwin-amd64

	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube

	* Using the docker driver based on user configuration

-- /stdout --

** stderr ** 

	I1117 17:11:06.627053   44228 out.go:297] Setting OutFile to fd 1 ...

	I1117 17:11:06.627202   44228 out.go:344] TERM=,COLORTERM=, which probably does not support color

	I1117 17:11:06.627206   44228 out.go:310] Setting ErrFile to fd 2...

	I1117 17:11:06.627209   44228 out.go:344] TERM=,COLORTERM=, which probably does not support color

	I1117 17:11:06.627277   44228 root.go:315] Updating PATH: /Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube/bin

	I1117 17:11:06.627583   44228 out.go:304] Setting JSON to false

	I1117 17:11:06.652698   44228 start.go:112] hostinfo: {"hostname":"37310.local","uptime":11441,"bootTime":1637186425,"procs":362,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"11.2.3","kernelVersion":"20.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"bd1c05a8-24a6-5973-aa69-f3c7c66a87ce"}

	W1117 17:11:06.652788   44228 start.go:120] gopshost.Virtualization returned error: not implemented yet

	I1117 17:11:06.679853   44228 out.go:176] * [enable-default-cni-20211117170334-31976] minikube v1.24.0 on Darwin 11.2.3

	I1117 17:11:06.679978   44228 notify.go:174] Checking for updates...

	I1117 17:11:06.727665   44228 out.go:176]   - MINIKUBE_LOCATION=12739

	I1117 17:11:06.753718   44228 out.go:176]   - KUBECONFIG=/Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/kubeconfig

	I1117 17:11:06.779243   44228 out.go:176]   - MINIKUBE_BIN=out/minikube-darwin-amd64

	I1117 17:11:06.805404   44228 out.go:176]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/darwin-amd64-docker--12739-30388-24e369002aeb518840e093d9fb528e6077bdad6e/.minikube

	I1117 17:11:06.805640   44228 driver.go:343] Setting default libvirt URI to qemu:///system

	W1117 17:11:06.893934   44228 docker.go:108] docker version returned error: exit status 1

	I1117 17:11:06.920760   44228 out.go:176] * Using the docker driver based on user configuration

	I1117 17:11:06.920818   44228 start.go:280] selected driver: docker

	I1117 17:11:06.920850   44228 start.go:775] validating driver "docker" against <nil>

	I1117 17:11:06.920872   44228 start.go:786] status for docker: {Installed:true Healthy:false Running:true NeedsImprovement:false Error:"docker version --format {{.Server.Os}}-{{.Server.Version}}" exit status 1: Error response from daemon: Bad response from Docker engine Reason:PROVIDER_DOCKER_VERSION_EXIT_1 Fix: Doc:https://minikube.sigs.k8s.io/docs/drivers/docker/}

	I1117 17:11:06.947262   44228 out.go:176] 

	W1117 17:11:06.947456   44228 out.go:241] X Exiting due to PROVIDER_DOCKER_VERSION_EXIT_1: "docker version --format -" exit status 1: Error response from daemon: Bad response from Docker engine

	X Exiting due to PROVIDER_DOCKER_VERSION_EXIT_1: "docker version --format -" exit status 1: Error response from daemon: Bad response from Docker engine

	W1117 17:11:06.947549   44228 out.go:241] * Documentation: https://minikube.sigs.k8s.io/docs/drivers/docker/

	* Documentation: https://minikube.sigs.k8s.io/docs/drivers/docker/

	I1117 17:11:06.973456   44228 out.go:176] 

** /stderr **

net_test.go:101: failed start: exit status 69

--- FAIL: TestNetworkPlugins/group/enable-default-cni/Start (0.41s)