=== RUN   TestCertExpiration

=== PAUSE TestCertExpiration

=== CONT  TestCertExpiration

cert_options_test.go:123: (dbg) Run:  out/minikube-darwin-amd64 start -p cert-expiration-729000 --memory=2048 --cert-expiration=3m --driver=hyperkit 

=== CONT  TestCertExpiration

cert_options_test.go:123: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p cert-expiration-729000 --memory=2048 --cert-expiration=3m --driver=hyperkit : exit status 90 (20.327867131s)

-- stdout --

	* [cert-expiration-729000] minikube v1.28.0 on Darwin 13.2

	  - MINIKUBE_LOCATION=15565

	  - KUBECONFIG=/Users/jenkins/minikube-integration/15565-3235/kubeconfig

	  - MINIKUBE_BIN=out/minikube-darwin-amd64

	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/15565-3235/.minikube

	  - MINIKUBE_FORCE_SYSTEMD=

	* Using the hyperkit driver based on user configuration

	* Starting control plane node cert-expiration-729000 in cluster cert-expiration-729000

	* Creating hyperkit VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

-- /stdout --

** stderr ** 

	! Image was not built for the current minikube version. To resolve this you can delete and recreate your minikube cluster using the latest images. Expected minikube version: v1.29.0-1674856271-15565 -> Actual minikube version: v1.28.0

	X Exiting due to RUNTIME_ENABLE: sudo systemctl restart cri-docker.socket: Process exited with status 1

	stdout:

	stderr:

	Job failed. See "journalctl -xe" for details.

	* 

	╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

** /stderr **

cert_options_test.go:125: failed to start minikube with args: "out/minikube-darwin-amd64 start -p cert-expiration-729000 --memory=2048 --cert-expiration=3m --driver=hyperkit " : exit status 90

E0127 20:02:47.091071    4442 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/15565-3235/.minikube/profiles/addons-113000/client.crt: no such file or directory

=== CONT  TestCertExpiration

cert_options_test.go:131: (dbg) Run:  out/minikube-darwin-amd64 start -p cert-expiration-729000 --memory=2048 --cert-expiration=8760h --driver=hyperkit 

E0127 20:05:31.896145    4442 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/15565-3235/.minikube/profiles/skaffold-497000/client.crt: no such file or directory

E0127 20:05:52.377437    4442 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/15565-3235/.minikube/profiles/skaffold-497000/client.crt: no such file or directory

=== CONT  TestCertExpiration

cert_options_test.go:131: (dbg) Done: out/minikube-darwin-amd64 start -p cert-expiration-729000 --memory=2048 --cert-expiration=8760h --driver=hyperkit : (23.949517656s)

cert_options_test.go:136: minikube start output did not warn about expired certs: 

-- stdout --

	* [cert-expiration-729000] minikube v1.28.0 on Darwin 13.2

	  - MINIKUBE_LOCATION=15565

	  - KUBECONFIG=/Users/jenkins/minikube-integration/15565-3235/kubeconfig

	  - MINIKUBE_BIN=out/minikube-darwin-amd64

	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/15565-3235/.minikube

	  - MINIKUBE_FORCE_SYSTEMD=

	* Using the hyperkit driver based on existing profile

	* Starting control plane node cert-expiration-729000 in cluster cert-expiration-729000

	* Updating the running hyperkit "cert-expiration-729000" VM ...

	* Preparing Kubernetes v1.26.1 on Docker 20.10.23 ...

	  - Generating certificates and keys ...

	  - Booting up control plane ...

	  - Configuring RBAC rules ...

	* Configuring bridge CNI (Container Networking Interface) ...

	  - Using image gcr.io/k8s-minikube/storage-provisioner:v5

	* Verifying Kubernetes components...

	* Enabled addons: storage-provisioner, default-storageclass

	* Done! kubectl is now configured to use "cert-expiration-729000" cluster and "default" namespace by default

-- /stdout --

** stderr ** 

	! Image was not built for the current minikube version. To resolve this you can delete and recreate your minikube cluster using the latest images. Expected minikube version: v1.29.0-1674856271-15565 -> Actual minikube version: v1.28.0

** /stderr **

cert_options_test.go:138: *** TestCertExpiration FAILED at 2023-01-27 20:05:55.322302 -0800 PST m=+2143.754742106

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p cert-expiration-729000 -n cert-expiration-729000

helpers_test.go:244: <<< TestCertExpiration FAILED: start of post-mortem logs <<<

helpers_test.go:245: ======>  post-mortem[TestCertExpiration]: minikube logs <======

helpers_test.go:247: (dbg) Run:  out/minikube-darwin-amd64 -p cert-expiration-729000 logs -n 25

helpers_test.go:247: (dbg) Done: out/minikube-darwin-amd64 -p cert-expiration-729000 logs -n 25: (2.037446667s)

helpers_test.go:252: TestCertExpiration logs: 

-- stdout --

	* 

	* ==> Audit <==

	* |---------|---------------------------------------|---------------------------|---------|---------|---------------------|---------------------|

	| Command |                 Args                  |          Profile          |  User   | Version |     Start Time      |      End Time       |

	|---------|---------------------------------------|---------------------------|---------|---------|---------------------|---------------------|

	| ssh     | -p cilium-035000 sudo                 | cilium-035000             | jenkins | v1.28.0 | 27 Jan 23 20:00 PST |                     |

	|         | containerd config dump                |                           |         |         |                     |                     |

	| ssh     | -p cilium-035000 sudo                 | cilium-035000             | jenkins | v1.28.0 | 27 Jan 23 20:00 PST |                     |

	|         | systemctl status crio --all           |                           |         |         |                     |                     |

	|         | --full --no-pager                     |                           |         |         |                     |                     |

	| ssh     | -p cilium-035000 sudo                 | cilium-035000             | jenkins | v1.28.0 | 27 Jan 23 20:00 PST |                     |

	|         | systemctl cat crio --no-pager         |                           |         |         |                     |                     |

	| ssh     | -p cilium-035000 sudo find            | cilium-035000             | jenkins | v1.28.0 | 27 Jan 23 20:00 PST |                     |

	|         | /etc/crio -type f -exec sh -c         |                           |         |         |                     |                     |

	|         | 'echo {}; cat {}' \;                  |                           |         |         |                     |                     |

	| ssh     | -p cilium-035000 sudo crio            | cilium-035000             | jenkins | v1.28.0 | 27 Jan 23 20:00 PST |                     |

	|         | config                                |                           |         |         |                     |                     |

	| delete  | -p cilium-035000                      | cilium-035000             | jenkins | v1.28.0 | 27 Jan 23 20:00 PST | 27 Jan 23 20:00 PST |

	| start   | -p force-systemd-env-631000           | force-systemd-env-631000  | jenkins | v1.28.0 | 27 Jan 23 20:00 PST | 27 Jan 23 20:01 PST |

	|         | --memory=2048                         |                           |         |         |                     |                     |

	|         | --alsologtostderr -v=5                |                           |         |         |                     |                     |

	|         | --driver=hyperkit                     |                           |         |         |                     |                     |

	| delete  | -p offline-docker-310000              | offline-docker-310000     | jenkins | v1.28.0 | 27 Jan 23 20:01 PST | 27 Jan 23 20:01 PST |

	| start   | -p force-systemd-flag-814000          | force-systemd-flag-814000 | jenkins | v1.28.0 | 27 Jan 23 20:01 PST | 27 Jan 23 20:02 PST |

	|         | --memory=2048 --force-systemd         |                           |         |         |                     |                     |

	|         | --alsologtostderr -v=5                |                           |         |         |                     |                     |

	|         | --driver=hyperkit                     |                           |         |         |                     |                     |

	| ssh     | force-systemd-env-631000              | force-systemd-env-631000  | jenkins | v1.28.0 | 27 Jan 23 20:01 PST | 27 Jan 23 20:01 PST |

	|         | ssh docker info --format              |                           |         |         |                     |                     |

	|         | {{.CgroupDriver}}                     |                           |         |         |                     |                     |

	| delete  | -p force-systemd-env-631000           | force-systemd-env-631000  | jenkins | v1.28.0 | 27 Jan 23 20:01 PST | 27 Jan 23 20:01 PST |

	| start   | -p docker-flags-643000                | docker-flags-643000       | jenkins | v1.28.0 | 27 Jan 23 20:01 PST | 27 Jan 23 20:02 PST |

	|         | --cache-images=false                  |                           |         |         |                     |                     |

	|         | --memory=2048                         |                           |         |         |                     |                     |

	|         | --install-addons=false                |                           |         |         |                     |                     |

	|         | --wait=false                          |                           |         |         |                     |                     |

	|         | --docker-env=FOO=BAR                  |                           |         |         |                     |                     |

	|         | --docker-env=BAZ=BAT                  |                           |         |         |                     |                     |

	|         | --docker-opt=debug                    |                           |         |         |                     |                     |

	|         | --docker-opt=icc=true                 |                           |         |         |                     |                     |

	|         | --alsologtostderr -v=5                |                           |         |         |                     |                     |

	|         | --driver=hyperkit                     |                           |         |         |                     |                     |

	| ssh     | force-systemd-flag-814000             | force-systemd-flag-814000 | jenkins | v1.28.0 | 27 Jan 23 20:02 PST | 27 Jan 23 20:02 PST |

	|         | ssh docker info --format              |                           |         |         |                     |                     |

	|         | {{.CgroupDriver}}                     |                           |         |         |                     |                     |

	| delete  | -p force-systemd-flag-814000          | force-systemd-flag-814000 | jenkins | v1.28.0 | 27 Jan 23 20:02 PST | 27 Jan 23 20:02 PST |

	| start   | -p cert-expiration-729000             | cert-expiration-729000    | jenkins | v1.28.0 | 27 Jan 23 20:02 PST |                     |

	|         | --memory=2048                         |                           |         |         |                     |                     |

	|         | --cert-expiration=3m                  |                           |         |         |                     |                     |

	|         | --driver=hyperkit                     |                           |         |         |                     |                     |

	| ssh     | docker-flags-643000 ssh               | docker-flags-643000       | jenkins | v1.28.0 | 27 Jan 23 20:02 PST | 27 Jan 23 20:02 PST |

	|         | sudo systemctl show docker            |                           |         |         |                     |                     |

	|         | --property=Environment                |                           |         |         |                     |                     |

	|         | --no-pager                            |                           |         |         |                     |                     |

	| ssh     | docker-flags-643000 ssh               | docker-flags-643000       | jenkins | v1.28.0 | 27 Jan 23 20:02 PST | 27 Jan 23 20:02 PST |

	|         | sudo systemctl show docker            |                           |         |         |                     |                     |

	|         | --property=ExecStart                  |                           |         |         |                     |                     |

	|         | --no-pager                            |                           |         |         |                     |                     |

	| delete  | -p docker-flags-643000                | docker-flags-643000       | jenkins | v1.28.0 | 27 Jan 23 20:02 PST | 27 Jan 23 20:02 PST |

	| start   | -p cert-options-460000                | cert-options-460000       | jenkins | v1.28.0 | 27 Jan 23 20:02 PST | 27 Jan 23 20:03 PST |

	|         | --memory=2048                         |                           |         |         |                     |                     |

	|         | --apiserver-ips=127.0.0.1             |                           |         |         |                     |                     |

	|         | --apiserver-ips=192.168.15.15         |                           |         |         |                     |                     |

	|         | --apiserver-names=localhost           |                           |         |         |                     |                     |

	|         | --apiserver-names=www.google.com      |                           |         |         |                     |                     |

	|         | --apiserver-port=8555                 |                           |         |         |                     |                     |

	|         | --driver=hyperkit                     |                           |         |         |                     |                     |

	| ssh     | cert-options-460000 ssh               | cert-options-460000       | jenkins | v1.28.0 | 27 Jan 23 20:03 PST | 27 Jan 23 20:03 PST |

	|         | openssl x509 -text -noout -in         |                           |         |         |                     |                     |

	|         | /var/lib/minikube/certs/apiserver.crt |                           |         |         |                     |                     |

	| ssh     | -p cert-options-460000 -- sudo        | cert-options-460000       | jenkins | v1.28.0 | 27 Jan 23 20:03 PST | 27 Jan 23 20:03 PST |

	|         | cat /etc/kubernetes/admin.conf        |                           |         |         |                     |                     |

	| delete  | -p cert-options-460000                | cert-options-460000       | jenkins | v1.28.0 | 27 Jan 23 20:03 PST | 27 Jan 23 20:03 PST |

	| start   | -p running-upgrade-052000             | running-upgrade-052000    | jenkins | v1.28.0 | 27 Jan 23 20:04 PST | 27 Jan 23 20:05 PST |

	|         | --memory=2200                         |                           |         |         |                     |                     |

	|         | --alsologtostderr -v=1                |                           |         |         |                     |                     |

	|         | --driver=hyperkit                     |                           |         |         |                     |                     |

	| start   | -p cert-expiration-729000             | cert-expiration-729000    | jenkins | v1.28.0 | 27 Jan 23 20:05 PST | 27 Jan 23 20:05 PST |

	|         | --memory=2048                         |                           |         |         |                     |                     |

	|         | --cert-expiration=8760h               |                           |         |         |                     |                     |

	|         | --driver=hyperkit                     |                           |         |         |                     |                     |

	| delete  | -p running-upgrade-052000             | running-upgrade-052000    | jenkins | v1.28.0 | 27 Jan 23 20:05 PST |                     |

	|---------|---------------------------------------|---------------------------|---------|---------|---------------------|---------------------|

	* 

	* ==> Last Start <==

	* Log file created at: 2023/01/27 20:05:31

	Running on machine: MacOS-Agent-4

	Binary: Built with gc go1.19.5 for darwin/amd64

	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg

	I0127 20:05:31.430413   10037 out.go:296] Setting OutFile to fd 1 ...

	I0127 20:05:31.430567   10037 out.go:343] TERM=,COLORTERM=, which probably does not support color

	I0127 20:05:31.430571   10037 out.go:309] Setting ErrFile to fd 2...

	I0127 20:05:31.430574   10037 out.go:343] TERM=,COLORTERM=, which probably does not support color

	I0127 20:05:31.430683   10037 root.go:334] Updating PATH: /Users/jenkins/minikube-integration/15565-3235/.minikube/bin

	I0127 20:05:31.431177   10037 out.go:303] Setting JSON to false

	I0127 20:05:31.449709   10037 start.go:125] hostinfo: {"hostname":"MacOS-Agent-4.local","uptime":3906,"bootTime":1674874825,"procs":404,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"13.2","kernelVersion":"22.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"f2f27e25-cfda-5ffd-9706-e98286194e62"}

	W0127 20:05:31.449793   10037 start.go:133] gopshost.Virtualization returned error: not implemented yet

	I0127 20:05:31.479973   10037 out.go:177] * [cert-expiration-729000] minikube v1.28.0 on Darwin 13.2

	I0127 20:05:31.521792   10037 notify.go:220] Checking for updates...

	I0127 20:05:31.543564   10037 out.go:177]   - MINIKUBE_LOCATION=15565

	I0127 20:05:31.564703   10037 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/15565-3235/kubeconfig

	I0127 20:05:31.585754   10037 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64

	I0127 20:05:31.606755   10037 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I0127 20:05:31.628580   10037 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/15565-3235/.minikube

	I0127 20:05:31.649793   10037 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=

	I0127 20:05:31.672338   10037 config.go:180] Loaded profile config "cert-expiration-729000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.26.1

	I0127 20:05:31.673032   10037 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit

	I0127 20:05:31.673106   10037 main.go:141] libmachine: Launching plugin server for driver hyperkit

	I0127 20:05:31.680966   10037 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:52581

	I0127 20:05:31.681375   10037 main.go:141] libmachine: () Calling .GetVersion

	I0127 20:05:31.681771   10037 main.go:141] libmachine: Using API Version  1

	I0127 20:05:31.681778   10037 main.go:141] libmachine: () Calling .SetConfigRaw

	I0127 20:05:31.681974   10037 main.go:141] libmachine: () Calling .GetMachineName

	I0127 20:05:31.682080   10037 main.go:141] libmachine: (cert-expiration-729000) Calling .DriverName

	I0127 20:05:31.682214   10037 driver.go:365] Setting default libvirt URI to qemu:///system

	I0127 20:05:31.682465   10037 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit

	I0127 20:05:31.682486   10037 main.go:141] libmachine: Launching plugin server for driver hyperkit

	I0127 20:05:31.689207   10037 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:52583

	I0127 20:05:31.689553   10037 main.go:141] libmachine: () Calling .GetVersion

	I0127 20:05:31.689882   10037 main.go:141] libmachine: Using API Version  1

	I0127 20:05:31.689890   10037 main.go:141] libmachine: () Calling .SetConfigRaw

	I0127 20:05:31.690076   10037 main.go:141] libmachine: () Calling .GetMachineName

	I0127 20:05:31.690170   10037 main.go:141] libmachine: (cert-expiration-729000) Calling .DriverName

	I0127 20:05:31.717678   10037 out.go:177] * Using the hyperkit driver based on existing profile

	I0127 20:05:31.759488   10037 start.go:296] selected driver: hyperkit

	I0127 20:05:31.759569   10037 start.go:840] validating driver "hyperkit" against &{Name:cert-expiration-729000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/15565/minikube-v1.29.0-1674856271-15565-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.36-1674164627-15541@sha256:0a2280301e955e0d3910d6e639e0b7341db1f4a25558521ac97b38c782c6189a Memory:2048 CPUs:2 DiskSize:20000 VMDriver: Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 Kub

ernetesConfig:{KubernetesVersion:v1.26.1 ClusterName:cert-expiration-729000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.64.23 Port:8443 KubernetesVersion:v1.26.1 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:3m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:dock

er BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP:}

	I0127 20:05:31.759743   10037 start.go:851] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}

	I0127 20:05:31.763859   10037 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0127 20:05:31.763993   10037 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/15565-3235/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin

	I0127 20:05:31.771086   10037 install.go:137] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit version is 1.28.0

	I0127 20:05:31.774339   10037 install.go:79] stdout: /Users/jenkins/workspace/out/docker-machine-driver-hyperkit

	I0127 20:05:31.774351   10037 install.go:81] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit looks good

	I0127 20:05:31.774424   10037 cni.go:84] Creating CNI manager for ""

	I0127 20:05:31.774436   10037 cni.go:157] "hyperkit" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge

	I0127 20:05:31.774446   10037 start_flags.go:319] config:

	{Name:cert-expiration-729000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/15565/minikube-v1.29.0-1674856271-15565-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.36-1674164627-15541@sha256:0a2280301e955e0d3910d6e639e0b7341db1f4a25558521ac97b38c782c6189a Memory:2048 CPUs:2 DiskSize:20000 VMDriver: Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.26.1 ClusterName:cert-expiration-729000 Namesp

ace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.64.23 Port:8443 KubernetesVersion:v1.26.1 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:8760h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFi

rmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP:}

	I0127 20:05:31.774576   10037 iso.go:125] acquiring lock: {Name:mkeeb6f52f7fa0577f04180383dbb7ed67f33d88 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0127 20:05:31.816479   10037 out.go:177] * Starting control plane node cert-expiration-729000 in cluster cert-expiration-729000

	I0127 20:05:31.837589   10037 preload.go:132] Checking if preload exists for k8s version v1.26.1 and runtime docker

	I0127 20:05:31.837665   10037 preload.go:148] Found local preload: /Users/jenkins/minikube-integration/15565-3235/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.26.1-docker-overlay2-amd64.tar.lz4

	I0127 20:05:31.837689   10037 cache.go:57] Caching tarball of preloaded images

	I0127 20:05:31.837881   10037 preload.go:174] Found /Users/jenkins/minikube-integration/15565-3235/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.26.1-docker-overlay2-amd64.tar.lz4 in cache, skipping download

	I0127 20:05:31.837894   10037 cache.go:60] Finished verifying existence of preloaded tar for  v1.26.1 on docker

	I0127 20:05:31.838032   10037 profile.go:148] Saving config to /Users/jenkins/minikube-integration/15565-3235/.minikube/profiles/cert-expiration-729000/config.json ...

	I0127 20:05:31.838906   10037 cache.go:193] Successfully downloaded all kic artifacts

	I0127 20:05:31.838951   10037 start.go:364] acquiring machines lock for cert-expiration-729000: {Name:mk69c04a34b14d26e3f74e414bcb566a33d5b215 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0127 20:05:31.839050   10037 start.go:368] acquired machines lock for "cert-expiration-729000" in 83.928µs

	I0127 20:05:31.839090   10037 start.go:96] Skipping create...Using existing machine configuration

	I0127 20:05:31.839104   10037 fix.go:55] fixHost starting: 

	I0127 20:05:31.839540   10037 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit

	I0127 20:05:31.839565   10037 main.go:141] libmachine: Launching plugin server for driver hyperkit

	I0127 20:05:31.847119   10037 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:52585

	I0127 20:05:31.847481   10037 main.go:141] libmachine: () Calling .GetVersion

	I0127 20:05:31.847863   10037 main.go:141] libmachine: Using API Version  1

	I0127 20:05:31.847877   10037 main.go:141] libmachine: () Calling .SetConfigRaw

	I0127 20:05:31.848074   10037 main.go:141] libmachine: () Calling .GetMachineName

	I0127 20:05:31.848187   10037 main.go:141] libmachine: (cert-expiration-729000) Calling .DriverName

	I0127 20:05:31.848279   10037 main.go:141] libmachine: (cert-expiration-729000) Calling .GetState

	I0127 20:05:31.848371   10037 main.go:141] libmachine: (cert-expiration-729000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0

	I0127 20:05:31.848446   10037 main.go:141] libmachine: (cert-expiration-729000) DBG | hyperkit pid from json: 9398

	I0127 20:05:31.849313   10037 fix.go:103] recreateIfNeeded on cert-expiration-729000: state=Running err=<nil>

	W0127 20:05:31.849324   10037 fix.go:129] unexpected machine state, will restart: <nil>

	I0127 20:05:31.891634   10037 out.go:177] * Updating the running hyperkit "cert-expiration-729000" VM ...

	I0127 20:05:27.314666    9771 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0127 20:05:27.814670    9771 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0127 20:05:28.312595    9771 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0127 20:05:28.814565    9771 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0127 20:05:29.313942    9771 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0127 20:05:29.813568    9771 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0127 20:05:30.314556    9771 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0127 20:05:30.814517    9771 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0127 20:05:31.312771    9771 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0127 20:05:31.813046    9771 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0127 20:05:31.912880   10037 machine.go:88] provisioning docker machine ...

	I0127 20:05:31.912947   10037 main.go:141] libmachine: (cert-expiration-729000) Calling .DriverName

	I0127 20:05:31.913259   10037 main.go:141] libmachine: (cert-expiration-729000) Calling .GetMachineName

	I0127 20:05:31.913480   10037 buildroot.go:166] provisioning hostname "cert-expiration-729000"

	I0127 20:05:31.913497   10037 main.go:141] libmachine: (cert-expiration-729000) Calling .GetMachineName

	I0127 20:05:31.913693   10037 main.go:141] libmachine: (cert-expiration-729000) Calling .GetSSHHostname

	I0127 20:05:31.913864   10037 main.go:141] libmachine: (cert-expiration-729000) Calling .GetSSHPort

	I0127 20:05:31.914051   10037 main.go:141] libmachine: (cert-expiration-729000) Calling .GetSSHKeyPath

	I0127 20:05:31.914255   10037 main.go:141] libmachine: (cert-expiration-729000) Calling .GetSSHKeyPath

	I0127 20:05:31.914448   10037 main.go:141] libmachine: (cert-expiration-729000) Calling .GetSSHUsername

	I0127 20:05:31.914680   10037 main.go:141] libmachine: Using SSH client type: native

	I0127 20:05:31.914990   10037 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x13ec500] 0x13ef680 <nil>  [] 0s} 192.168.64.23 22 <nil> <nil>}

	I0127 20:05:31.915001   10037 main.go:141] libmachine: About to run SSH command:

	sudo hostname cert-expiration-729000 && echo "cert-expiration-729000" | sudo tee /etc/hostname

	I0127 20:05:32.005292   10037 main.go:141] libmachine: SSH cmd err, output: <nil>: cert-expiration-729000

	I0127 20:05:32.005305   10037 main.go:141] libmachine: (cert-expiration-729000) Calling .GetSSHHostname

	I0127 20:05:32.005433   10037 main.go:141] libmachine: (cert-expiration-729000) Calling .GetSSHPort

	I0127 20:05:32.005509   10037 main.go:141] libmachine: (cert-expiration-729000) Calling .GetSSHKeyPath

	I0127 20:05:32.005592   10037 main.go:141] libmachine: (cert-expiration-729000) Calling .GetSSHKeyPath

	I0127 20:05:32.005677   10037 main.go:141] libmachine: (cert-expiration-729000) Calling .GetSSHUsername

	I0127 20:05:32.005790   10037 main.go:141] libmachine: Using SSH client type: native

	I0127 20:05:32.005915   10037 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x13ec500] 0x13ef680 <nil>  [] 0s} 192.168.64.23 22 <nil> <nil>}

	I0127 20:05:32.005928   10037 main.go:141] libmachine: About to run SSH command:

			if ! grep -xq '.*\scert-expiration-729000' /etc/hosts; then

				if grep -xq '127.0.1.1\s.*' /etc/hosts; then

					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 cert-expiration-729000/g' /etc/hosts;

				else 

					echo '127.0.1.1 cert-expiration-729000' | sudo tee -a /etc/hosts; 

				fi

			fi

	I0127 20:05:32.084026   10037 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I0127 20:05:32.084037   10037 buildroot.go:172] set auth options {CertDir:/Users/jenkins/minikube-integration/15565-3235/.minikube CaCertPath:/Users/jenkins/minikube-integration/15565-3235/.minikube/certs/ca.pem CaPrivateKeyPath:/Users/jenkins/minikube-integration/15565-3235/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/Users/jenkins/minikube-integration/15565-3235/.minikube/machines/server.pem ServerKeyPath:/Users/jenkins/minikube-integration/15565-3235/.minikube/machines/server-key.pem ClientKeyPath:/Users/jenkins/minikube-integration/15565-3235/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/Users/jenkins/minikube-integration/15565-3235/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/Users/jenkins/minikube-integration/15565-3235/.minikube}

	I0127 20:05:32.084051   10037 buildroot.go:174] setting up certificates

	I0127 20:05:32.084060   10037 provision.go:83] configureAuth start

	I0127 20:05:32.084065   10037 main.go:141] libmachine: (cert-expiration-729000) Calling .GetMachineName

	I0127 20:05:32.084203   10037 main.go:141] libmachine: (cert-expiration-729000) Calling .GetIP

	I0127 20:05:32.084289   10037 main.go:141] libmachine: (cert-expiration-729000) Calling .GetSSHHostname

	I0127 20:05:32.084367   10037 provision.go:138] copyHostCerts

	I0127 20:05:32.084446   10037 exec_runner.go:144] found /Users/jenkins/minikube-integration/15565-3235/.minikube/ca.pem, removing ...

	I0127 20:05:32.084454   10037 exec_runner.go:207] rm: /Users/jenkins/minikube-integration/15565-3235/.minikube/ca.pem

	I0127 20:05:32.097697   10037 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/15565-3235/.minikube/certs/ca.pem --> /Users/jenkins/minikube-integration/15565-3235/.minikube/ca.pem (1082 bytes)

	I0127 20:05:32.098068   10037 exec_runner.go:144] found /Users/jenkins/minikube-integration/15565-3235/.minikube/cert.pem, removing ...

	I0127 20:05:32.098079   10037 exec_runner.go:207] rm: /Users/jenkins/minikube-integration/15565-3235/.minikube/cert.pem

	I0127 20:05:32.098237   10037 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/15565-3235/.minikube/certs/cert.pem --> /Users/jenkins/minikube-integration/15565-3235/.minikube/cert.pem (1123 bytes)

	I0127 20:05:32.098509   10037 exec_runner.go:144] found /Users/jenkins/minikube-integration/15565-3235/.minikube/key.pem, removing ...

	I0127 20:05:32.098515   10037 exec_runner.go:207] rm: /Users/jenkins/minikube-integration/15565-3235/.minikube/key.pem

	I0127 20:05:32.098636   10037 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/15565-3235/.minikube/certs/key.pem --> /Users/jenkins/minikube-integration/15565-3235/.minikube/key.pem (1675 bytes)

	I0127 20:05:32.098849   10037 provision.go:112] generating server cert: /Users/jenkins/minikube-integration/15565-3235/.minikube/machines/server.pem ca-key=/Users/jenkins/minikube-integration/15565-3235/.minikube/certs/ca.pem private-key=/Users/jenkins/minikube-integration/15565-3235/.minikube/certs/ca-key.pem org=jenkins.cert-expiration-729000 san=[192.168.64.23 192.168.64.23 localhost 127.0.0.1 minikube cert-expiration-729000]

	I0127 20:05:32.154738   10037 provision.go:172] copyRemoteCerts

	I0127 20:05:32.154792   10037 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker

	I0127 20:05:32.154811   10037 main.go:141] libmachine: (cert-expiration-729000) Calling .GetSSHHostname

	I0127 20:05:32.154937   10037 main.go:141] libmachine: (cert-expiration-729000) Calling .GetSSHPort

	I0127 20:05:32.155046   10037 main.go:141] libmachine: (cert-expiration-729000) Calling .GetSSHKeyPath

	I0127 20:05:32.155128   10037 main.go:141] libmachine: (cert-expiration-729000) Calling .GetSSHUsername

	I0127 20:05:32.155227   10037 sshutil.go:53] new ssh client: &{IP:192.168.64.23 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/15565-3235/.minikube/machines/cert-expiration-729000/id_rsa Username:docker}

	I0127 20:05:32.200282   10037 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15565-3235/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)

	I0127 20:05:32.215501   10037 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15565-3235/.minikube/machines/server.pem --> /etc/docker/server.pem (1241 bytes)

	I0127 20:05:32.230837   10037 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15565-3235/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)

	I0127 20:05:32.246059   10037 provision.go:86] duration metric: configureAuth took 161.987414ms

	I0127 20:05:32.246067   10037 buildroot.go:189] setting minikube options for container-runtime

	I0127 20:05:32.246204   10037 config.go:180] Loaded profile config "cert-expiration-729000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.26.1

	I0127 20:05:32.246218   10037 main.go:141] libmachine: (cert-expiration-729000) Calling .DriverName

	I0127 20:05:32.246351   10037 main.go:141] libmachine: (cert-expiration-729000) Calling .GetSSHHostname

	I0127 20:05:32.246448   10037 main.go:141] libmachine: (cert-expiration-729000) Calling .GetSSHPort

	I0127 20:05:32.246525   10037 main.go:141] libmachine: (cert-expiration-729000) Calling .GetSSHKeyPath

	I0127 20:05:32.246614   10037 main.go:141] libmachine: (cert-expiration-729000) Calling .GetSSHKeyPath

	I0127 20:05:32.246685   10037 main.go:141] libmachine: (cert-expiration-729000) Calling .GetSSHUsername

	I0127 20:05:32.246779   10037 main.go:141] libmachine: Using SSH client type: native

	I0127 20:05:32.246878   10037 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x13ec500] 0x13ef680 <nil>  [] 0s} 192.168.64.23 22 <nil> <nil>}

	I0127 20:05:32.246883   10037 main.go:141] libmachine: About to run SSH command:

	df --output=fstype / | tail -n 1

	I0127 20:05:32.324943   10037 main.go:141] libmachine: SSH cmd err, output: <nil>: tmpfs

	I0127 20:05:32.324949   10037 buildroot.go:70] root file system type: tmpfs

	I0127 20:05:32.325081   10037 provision.go:309] Updating docker unit: /lib/systemd/system/docker.service ...

	I0127 20:05:32.325100   10037 main.go:141] libmachine: (cert-expiration-729000) Calling .GetSSHHostname

	I0127 20:05:32.325224   10037 main.go:141] libmachine: (cert-expiration-729000) Calling .GetSSHPort

	I0127 20:05:32.325296   10037 main.go:141] libmachine: (cert-expiration-729000) Calling .GetSSHKeyPath

	I0127 20:05:32.325377   10037 main.go:141] libmachine: (cert-expiration-729000) Calling .GetSSHKeyPath

	I0127 20:05:32.325454   10037 main.go:141] libmachine: (cert-expiration-729000) Calling .GetSSHUsername

	I0127 20:05:32.325593   10037 main.go:141] libmachine: Using SSH client type: native

	I0127 20:05:32.325700   10037 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x13ec500] 0x13ef680 <nil>  [] 0s} 192.168.64.23 22 <nil> <nil>}

	I0127 20:05:32.325745   10037 main.go:141] libmachine: About to run SSH command:

	sudo mkdir -p /lib/systemd/system && printf %!s(MISSING) "[Unit]

	Description=Docker Application Container Engine

	Documentation=https://docs.docker.com

	After=network.target  minikube-automount.service docker.socket

	Requires= minikube-automount.service docker.socket 

	StartLimitBurst=3

	StartLimitIntervalSec=60

	[Service]

	Type=notify

	Restart=on-failure

	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	# The base configuration already specifies an 'ExecStart=...' command. The first directive

	# here is to clear out that command inherited from the base configuration. Without this,

	# the command from the base configuration and the command specified here are treated as

	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	# will catch this invalid input and refuse to start the service with an error like:

	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	ExecStart=

	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=hyperkit --insecure-registry 10.96.0.0/12 

	ExecReload=/bin/kill -s HUP \$MAINPID

	# Having non-zero Limit*s causes performance problems due to accounting overhead

	# in the kernel. We recommend using cgroups to do container-local accounting.

	LimitNOFILE=infinity

	LimitNPROC=infinity

	LimitCORE=infinity

	# Uncomment TasksMax if your systemd version supports it.

	# Only systemd 226 and above support this version.

	TasksMax=infinity

	TimeoutStartSec=0

	# set delegate yes so that systemd does not reset the cgroups of docker containers

	Delegate=yes

	# kill only the docker process, not all processes in the cgroup

	KillMode=process

	[Install]

	WantedBy=multi-user.target

	" | sudo tee /lib/systemd/system/docker.service.new

	I0127 20:05:32.414803   10037 main.go:141] libmachine: SSH cmd err, output: <nil>: [Unit]

	Description=Docker Application Container Engine

	Documentation=https://docs.docker.com

	After=network.target  minikube-automount.service docker.socket

	Requires= minikube-automount.service docker.socket 

	StartLimitBurst=3

	StartLimitIntervalSec=60

	[Service]

	Type=notify

	Restart=on-failure

	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	# The base configuration already specifies an 'ExecStart=...' command. The first directive

	# here is to clear out that command inherited from the base configuration. Without this,

	# the command from the base configuration and the command specified here are treated as

	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	# will catch this invalid input and refuse to start the service with an error like:

	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	ExecStart=

	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=hyperkit --insecure-registry 10.96.0.0/12 

	ExecReload=/bin/kill -s HUP $MAINPID

	# Having non-zero Limit*s causes performance problems due to accounting overhead

	# in the kernel. We recommend using cgroups to do container-local accounting.

	LimitNOFILE=infinity

	LimitNPROC=infinity

	LimitCORE=infinity

	# Uncomment TasksMax if your systemd version supports it.

	# Only systemd 226 and above support this version.

	TasksMax=infinity

	TimeoutStartSec=0

	# set delegate yes so that systemd does not reset the cgroups of docker containers

	Delegate=yes

	# kill only the docker process, not all processes in the cgroup

	KillMode=process

	[Install]

	WantedBy=multi-user.target

	I0127 20:05:32.414820   10037 main.go:141] libmachine: (cert-expiration-729000) Calling .GetSSHHostname

	I0127 20:05:32.414946   10037 main.go:141] libmachine: (cert-expiration-729000) Calling .GetSSHPort

	I0127 20:05:32.415032   10037 main.go:141] libmachine: (cert-expiration-729000) Calling .GetSSHKeyPath

	I0127 20:05:32.415137   10037 main.go:141] libmachine: (cert-expiration-729000) Calling .GetSSHKeyPath

	I0127 20:05:32.415217   10037 main.go:141] libmachine: (cert-expiration-729000) Calling .GetSSHUsername

	I0127 20:05:32.415337   10037 main.go:141] libmachine: Using SSH client type: native

	I0127 20:05:32.415450   10037 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x13ec500] 0x13ef680 <nil>  [] 0s} 192.168.64.23 22 <nil> <nil>}

	I0127 20:05:32.415459   10037 main.go:141] libmachine: About to run SSH command:

	sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }

	I0127 20:05:32.497800   10037 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I0127 20:05:32.497806   10037 machine.go:91] provisioned docker machine in 584.931958ms

	I0127 20:05:32.497814   10037 start.go:300] post-start starting for "cert-expiration-729000" (driver="hyperkit")

	I0127 20:05:32.497818   10037 start.go:328] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]

	I0127 20:05:32.497828   10037 main.go:141] libmachine: (cert-expiration-729000) Calling .DriverName

	I0127 20:05:32.498007   10037 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs

	I0127 20:05:32.498016   10037 main.go:141] libmachine: (cert-expiration-729000) Calling .GetSSHHostname

	I0127 20:05:32.498104   10037 main.go:141] libmachine: (cert-expiration-729000) Calling .GetSSHPort

	I0127 20:05:32.498185   10037 main.go:141] libmachine: (cert-expiration-729000) Calling .GetSSHKeyPath

	I0127 20:05:32.498251   10037 main.go:141] libmachine: (cert-expiration-729000) Calling .GetSSHUsername

	I0127 20:05:32.498326   10037 sshutil.go:53] new ssh client: &{IP:192.168.64.23 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/15565-3235/.minikube/machines/cert-expiration-729000/id_rsa Username:docker}

	I0127 20:05:32.543474   10037 ssh_runner.go:195] Run: cat /etc/os-release

	I0127 20:05:32.546025   10037 info.go:137] Remote host: Buildroot 2021.02.12

	I0127 20:05:32.546037   10037 filesync.go:126] Scanning /Users/jenkins/minikube-integration/15565-3235/.minikube/addons for local assets ...

	I0127 20:05:32.546116   10037 filesync.go:126] Scanning /Users/jenkins/minikube-integration/15565-3235/.minikube/files for local assets ...

	I0127 20:05:32.546259   10037 filesync.go:149] local asset: /Users/jenkins/minikube-integration/15565-3235/.minikube/files/etc/ssl/certs/44422.pem -> 44422.pem in /etc/ssl/certs

	I0127 20:05:32.546409   10037 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs

	I0127 20:05:32.551985   10037 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15565-3235/.minikube/files/etc/ssl/certs/44422.pem --> /etc/ssl/certs/44422.pem (1708 bytes)

	I0127 20:05:32.568131   10037 start.go:303] post-start completed in 70.312991ms

	I0127 20:05:32.568143   10037 fix.go:57] fixHost completed within 729.063605ms

	I0127 20:05:32.568156   10037 main.go:141] libmachine: (cert-expiration-729000) Calling .GetSSHHostname

	I0127 20:05:32.568281   10037 main.go:141] libmachine: (cert-expiration-729000) Calling .GetSSHPort

	I0127 20:05:32.568381   10037 main.go:141] libmachine: (cert-expiration-729000) Calling .GetSSHKeyPath

	I0127 20:05:32.568500   10037 main.go:141] libmachine: (cert-expiration-729000) Calling .GetSSHKeyPath

	I0127 20:05:32.568584   10037 main.go:141] libmachine: (cert-expiration-729000) Calling .GetSSHUsername

	I0127 20:05:32.568688   10037 main.go:141] libmachine: Using SSH client type: native

	I0127 20:05:32.568798   10037 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x13ec500] 0x13ef680 <nil>  [] 0s} 192.168.64.23 22 <nil> <nil>}

	I0127 20:05:32.568803   10037 main.go:141] libmachine: About to run SSH command:

	date +%!s(MISSING).%!N(MISSING)

	I0127 20:05:32.645897   10037 main.go:141] libmachine: SSH cmd err, output: <nil>: 1674878732.859804806

	I0127 20:05:32.645903   10037 fix.go:207] guest clock: 1674878732.859804806

	I0127 20:05:32.645907   10037 fix.go:220] Guest: 2023-01-27 20:05:32.859804806 -0800 PST Remote: 2023-01-27 20:05:32.568146 -0800 PST m=+1.187546836 (delta=291.658806ms)

	I0127 20:05:32.645926   10037 fix.go:191] guest clock delta is within tolerance: 291.658806ms

	I0127 20:05:32.645929   10037 start.go:83] releasing machines lock for "cert-expiration-729000", held for 806.892226ms

	I0127 20:05:32.645944   10037 main.go:141] libmachine: (cert-expiration-729000) Calling .DriverName

	I0127 20:05:32.646069   10037 main.go:141] libmachine: (cert-expiration-729000) Calling .GetIP

	I0127 20:05:32.646154   10037 main.go:141] libmachine: (cert-expiration-729000) Calling .DriverName

	I0127 20:05:32.646466   10037 main.go:141] libmachine: (cert-expiration-729000) Calling .DriverName

	I0127 20:05:32.646594   10037 main.go:141] libmachine: (cert-expiration-729000) Calling .DriverName

	I0127 20:05:32.646682   10037 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/

	I0127 20:05:32.646708   10037 main.go:141] libmachine: (cert-expiration-729000) Calling .GetSSHHostname

	I0127 20:05:32.646724   10037 ssh_runner.go:195] Run: cat /version.json

	I0127 20:05:32.646732   10037 main.go:141] libmachine: (cert-expiration-729000) Calling .GetSSHHostname

	I0127 20:05:32.646804   10037 main.go:141] libmachine: (cert-expiration-729000) Calling .GetSSHPort

	I0127 20:05:32.646830   10037 main.go:141] libmachine: (cert-expiration-729000) Calling .GetSSHPort

	I0127 20:05:32.646886   10037 main.go:141] libmachine: (cert-expiration-729000) Calling .GetSSHKeyPath

	I0127 20:05:32.646922   10037 main.go:141] libmachine: (cert-expiration-729000) Calling .GetSSHKeyPath

	I0127 20:05:32.646952   10037 main.go:141] libmachine: (cert-expiration-729000) Calling .GetSSHUsername

	I0127 20:05:32.646985   10037 main.go:141] libmachine: (cert-expiration-729000) Calling .GetSSHUsername

	I0127 20:05:32.647020   10037 sshutil.go:53] new ssh client: &{IP:192.168.64.23 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/15565-3235/.minikube/machines/cert-expiration-729000/id_rsa Username:docker}

	I0127 20:05:32.647079   10037 sshutil.go:53] new ssh client: &{IP:192.168.64.23 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/15565-3235/.minikube/machines/cert-expiration-729000/id_rsa Username:docker}

	W0127 20:05:32.687525   10037 out.go:239] ! Image was not built for the current minikube version. To resolve this you can delete and recreate your minikube cluster using the latest images. Expected minikube version: v1.29.0-1674856271-15565 -> Actual minikube version: v1.28.0

	I0127 20:05:32.687589   10037 ssh_runner.go:195] Run: systemctl --version

	I0127 20:05:32.751318   10037 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"

	W0127 20:05:32.755512   10037 cni.go:208] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found

	I0127 20:05:32.755580   10037 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/cri-docker.service.d

	I0127 20:05:32.761318   10037 ssh_runner.go:362] scp memory --> /etc/systemd/system/cri-docker.service.d/10-cni.conf (135 bytes)

	I0127 20:05:32.771947   10037 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ;

	I0127 20:05:32.777308   10037 cni.go:258] no active bridge cni configs found in "/etc/cni/net.d" - nothing to disable

	I0127 20:05:32.777316   10037 preload.go:132] Checking if preload exists for k8s version v1.26.1 and runtime docker

	I0127 20:05:32.777386   10037 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}

	I0127 20:05:32.793076   10037 docker.go:630] Got preloaded images: -- stdout --

	registry.k8s.io/kube-apiserver:v1.26.1

	registry.k8s.io/kube-controller-manager:v1.26.1

	registry.k8s.io/kube-scheduler:v1.26.1

	registry.k8s.io/kube-proxy:v1.26.1

	registry.k8s.io/etcd:3.5.6-0

	registry.k8s.io/pause:3.9

	registry.k8s.io/coredns/coredns:v1.9.3

	gcr.io/k8s-minikube/storage-provisioner:v5

	-- /stdout --

	I0127 20:05:32.793090   10037 docker.go:560] Images already preloaded, skipping extraction

	I0127 20:05:32.793094   10037 start.go:472] detecting cgroup driver to use...

	I0127 20:05:32.793172   10037 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///run/containerd/containerd.sock

	image-endpoint: unix:///run/containerd/containerd.sock

	" | sudo tee /etc/crictl.yaml"

	I0127 20:05:32.805431   10037 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.9"|' /etc/containerd/config.toml"

	I0127 20:05:32.811696   10037 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"

	I0127 20:05:32.818019   10037 containerd.go:145] configuring containerd to use "cgroupfs" as cgroup driver...

	I0127 20:05:32.818072   10037 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"

	I0127 20:05:32.824633   10037 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"

	I0127 20:05:32.830923   10037 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"

	I0127 20:05:32.837823   10037 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"

	I0127 20:05:32.844685   10037 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"

	I0127 20:05:32.851797   10037 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"

	I0127 20:05:32.858655   10037 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables

	I0127 20:05:32.864826   10037 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"

	I0127 20:05:32.871028   10037 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0127 20:05:32.961920   10037 ssh_runner.go:195] Run: sudo systemctl restart containerd

	I0127 20:05:32.974188   10037 start.go:472] detecting cgroup driver to use...

	I0127 20:05:32.974252   10037 ssh_runner.go:195] Run: sudo systemctl cat docker.service

	I0127 20:05:32.983819   10037 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I0127 20:05:32.992737   10037 ssh_runner.go:195] Run: sudo systemctl stop -f containerd

	I0127 20:05:33.005065   10037 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I0127 20:05:33.013689   10037 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio

	I0127 20:05:33.022060   10037 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/cri-dockerd.sock

	image-endpoint: unix:///var/run/cri-dockerd.sock

	" | sudo tee /etc/crictl.yaml"

	I0127 20:05:33.034812   10037 ssh_runner.go:195] Run: sudo systemctl unmask docker.service

	I0127 20:05:33.121278   10037 ssh_runner.go:195] Run: sudo systemctl enable docker.socket

	I0127 20:05:33.217290   10037 docker.go:529] configuring docker to use "cgroupfs" as cgroup driver...

	I0127 20:05:33.217303   10037 ssh_runner.go:362] scp memory --> /etc/docker/daemon.json (144 bytes)

	I0127 20:05:33.228482   10037 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0127 20:05:33.323545   10037 ssh_runner.go:195] Run: sudo systemctl restart docker

	I0127 20:05:34.547424   10037 ssh_runner.go:235] Completed: sudo systemctl restart docker: (1.223893832s)

	I0127 20:05:34.547475   10037 ssh_runner.go:195] Run: sudo systemctl enable cri-docker.socket

	I0127 20:05:34.632374   10037 ssh_runner.go:195] Run: sudo systemctl unmask cri-docker.socket

	I0127 20:05:34.716786   10037 ssh_runner.go:195] Run: sudo systemctl enable cri-docker.socket

	I0127 20:05:34.799783   10037 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0127 20:05:34.887497   10037 ssh_runner.go:195] Run: sudo systemctl restart cri-docker.socket

	I0127 20:05:34.902733   10037 start.go:519] Will wait 60s for socket path /var/run/cri-dockerd.sock

	I0127 20:05:34.902807   10037 ssh_runner.go:195] Run: stat /var/run/cri-dockerd.sock

	I0127 20:05:34.912654   10037 start.go:540] Will wait 60s for crictl version

	I0127 20:05:34.912707   10037 ssh_runner.go:195] Run: which crictl

	I0127 20:05:34.915300   10037 ssh_runner.go:195] Run: sudo /usr/bin/crictl version

	I0127 20:05:34.979884   10037 start.go:556] Version:  0.1.0

	RuntimeName:  docker

	RuntimeVersion:  20.10.23

	RuntimeApiVersion:  v1alpha2

	I0127 20:05:34.979952   10037 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}

	I0127 20:05:35.002679   10037 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}

	I0127 20:05:35.071662   10037 out.go:204] * Preparing Kubernetes v1.26.1 on Docker 20.10.23 ...

	I0127 20:05:35.071815   10037 ssh_runner.go:195] Run: grep 192.168.64.1	host.minikube.internal$ /etc/hosts

	I0127 20:05:35.075875   10037 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.64.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0127 20:05:35.084734   10037 localpath.go:92] copying /Users/jenkins/minikube-integration/15565-3235/.minikube/client.crt -> /Users/jenkins/minikube-integration/15565-3235/.minikube/profiles/cert-expiration-729000/client.crt

	I0127 20:05:35.085003   10037 localpath.go:117] copying /Users/jenkins/minikube-integration/15565-3235/.minikube/client.key -> /Users/jenkins/minikube-integration/15565-3235/.minikube/profiles/cert-expiration-729000/client.key

	I0127 20:05:35.085182   10037 preload.go:132] Checking if preload exists for k8s version v1.26.1 and runtime docker

	I0127 20:05:35.085232   10037 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}

	I0127 20:05:35.102018   10037 docker.go:630] Got preloaded images: -- stdout --

	registry.k8s.io/kube-apiserver:v1.26.1

	registry.k8s.io/kube-scheduler:v1.26.1

	registry.k8s.io/kube-controller-manager:v1.26.1

	registry.k8s.io/kube-proxy:v1.26.1

	registry.k8s.io/etcd:3.5.6-0

	registry.k8s.io/pause:3.9

	registry.k8s.io/coredns/coredns:v1.9.3

	gcr.io/k8s-minikube/storage-provisioner:v5

	-- /stdout --

	I0127 20:05:35.102025   10037 docker.go:560] Images already preloaded, skipping extraction

	I0127 20:05:35.102093   10037 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}

	I0127 20:05:35.118516   10037 docker.go:630] Got preloaded images: -- stdout --

	registry.k8s.io/kube-apiserver:v1.26.1

	registry.k8s.io/kube-scheduler:v1.26.1

	registry.k8s.io/kube-controller-manager:v1.26.1

	registry.k8s.io/kube-proxy:v1.26.1

	registry.k8s.io/etcd:3.5.6-0

	registry.k8s.io/pause:3.9

	registry.k8s.io/coredns/coredns:v1.9.3

	gcr.io/k8s-minikube/storage-provisioner:v5

	-- /stdout --

	I0127 20:05:35.118531   10037 cache_images.go:84] Images are preloaded, skipping loading

	I0127 20:05:35.118599   10037 ssh_runner.go:195] Run: docker info --format {{.CgroupDriver}}

	I0127 20:05:35.145820   10037 cni.go:84] Creating CNI manager for ""

	I0127 20:05:35.145831   10037 cni.go:157] "hyperkit" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge

	I0127 20:05:35.145851   10037 kubeadm.go:87] Using pod CIDR: 10.244.0.0/16

	I0127 20:05:35.145864   10037 kubeadm.go:172] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.64.23 APIServerPort:8443 KubernetesVersion:v1.26.1 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:cert-expiration-729000 NodeName:cert-expiration-729000 DNSDomain:cluster.local CRISocket:/var/run/cri-dockerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.64.23"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.64.23 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt Sta

ticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m]}

	I0127 20:05:35.145952   10037 kubeadm.go:177] kubeadm config:

	apiVersion: kubeadm.k8s.io/v1beta3

	kind: InitConfiguration

	localAPIEndpoint:

	  advertiseAddress: 192.168.64.23

	  bindPort: 8443

	bootstrapTokens:

	  - groups:

	      - system:bootstrappers:kubeadm:default-node-token

	    ttl: 24h0m0s

	    usages:

	      - signing

	      - authentication

	nodeRegistration:

	  criSocket: /var/run/cri-dockerd.sock

	  name: "cert-expiration-729000"

	  kubeletExtraArgs:

	    node-ip: 192.168.64.23

	  taints: []

	---

	apiVersion: kubeadm.k8s.io/v1beta3

	kind: ClusterConfiguration

	apiServer:

	  certSANs: ["127.0.0.1", "localhost", "192.168.64.23"]

	  extraArgs:

	    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"

	controllerManager:

	  extraArgs:

	    allocate-node-cidrs: "true"

	    leader-elect: "false"

	scheduler:

	  extraArgs:

	    leader-elect: "false"

	certificatesDir: /var/lib/minikube/certs

	clusterName: mk

	controlPlaneEndpoint: control-plane.minikube.internal:8443

	etcd:

	  local:

	    dataDir: /var/lib/minikube/etcd

	    extraArgs:

	      proxy-refresh-interval: "70000"

	kubernetesVersion: v1.26.1

	networking:

	  dnsDomain: cluster.local

	  podSubnet: "10.244.0.0/16"

	  serviceSubnet: 10.96.0.0/12

	---

	apiVersion: kubelet.config.k8s.io/v1beta1

	kind: KubeletConfiguration

	authentication:

	  x509:

	    clientCAFile: /var/lib/minikube/certs/ca.crt

	cgroupDriver: cgroupfs

	hairpinMode: hairpin-veth

	runtimeRequestTimeout: 15m

	clusterDomain: "cluster.local"

	# disable disk resource management by default

	imageGCHighThresholdPercent: 100

	evictionHard:

	  nodefs.available: "0%!"(MISSING)

	  nodefs.inodesFree: "0%!"(MISSING)

	  imagefs.available: "0%!"(MISSING)

	failSwapOn: false

	staticPodPath: /etc/kubernetes/manifests

	---

	apiVersion: kubeproxy.config.k8s.io/v1alpha1

	kind: KubeProxyConfiguration

	clusterCIDR: "10.244.0.0/16"

	metricsBindAddress: 0.0.0.0:10249

	conntrack:

	  maxPerCore: 0

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"

	  tcpEstablishedTimeout: 0s

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"

	  tcpCloseWaitTimeout: 0s

	I0127 20:05:35.146039   10037 kubeadm.go:968] kubelet [Unit]

	Wants=docker.socket

	[Service]

	ExecStart=

	ExecStart=/var/lib/minikube/binaries/v1.26.1/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=/var/run/cri-dockerd.sock --hostname-override=cert-expiration-729000 --image-service-endpoint=/var/run/cri-dockerd.sock --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.64.23

	[Install]

	 config:

	{KubernetesVersion:v1.26.1 ClusterName:cert-expiration-729000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:}

	I0127 20:05:35.146095   10037 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.26.1

	I0127 20:05:35.152454   10037 binaries.go:44] Found k8s binaries, skipping transfer

	I0127 20:05:35.152497   10037 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube

	I0127 20:05:35.158468   10037 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (455 bytes)

	I0127 20:05:35.169722   10037 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)

	I0127 20:05:35.180566   10037 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2101 bytes)

	I0127 20:05:35.191593   10037 ssh_runner.go:195] Run: grep 192.168.64.23	control-plane.minikube.internal$ /etc/hosts

	I0127 20:05:35.193776   10037 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.64.23	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0127 20:05:35.201372   10037 certs.go:56] Setting up /Users/jenkins/minikube-integration/15565-3235/.minikube/profiles/cert-expiration-729000 for IP: 192.168.64.23

	I0127 20:05:35.201382   10037 certs.go:186] acquiring lock for shared ca certs: {Name:mk29c07f32f81afc524ae789005062e84bfc25e6 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0127 20:05:35.201522   10037 certs.go:195] skipping minikubeCA CA generation: /Users/jenkins/minikube-integration/15565-3235/.minikube/ca.key

	I0127 20:05:35.201573   10037 certs.go:195] skipping proxyClientCA CA generation: /Users/jenkins/minikube-integration/15565-3235/.minikube/proxy-client-ca.key

	I0127 20:05:35.201658   10037 certs.go:311] skipping minikube-user signed cert generation: /Users/jenkins/minikube-integration/15565-3235/.minikube/profiles/cert-expiration-729000/client.key

	I0127 20:05:35.201677   10037 certs.go:315] generating minikube signed cert: /Users/jenkins/minikube-integration/15565-3235/.minikube/profiles/cert-expiration-729000/apiserver.key.7d9037ca

	I0127 20:05:35.201694   10037 crypto.go:68] Generating cert /Users/jenkins/minikube-integration/15565-3235/.minikube/profiles/cert-expiration-729000/apiserver.crt.7d9037ca with IP's: [192.168.64.23 10.96.0.1 127.0.0.1 10.0.0.1]

	I0127 20:05:35.325279   10037 crypto.go:156] Writing cert to /Users/jenkins/minikube-integration/15565-3235/.minikube/profiles/cert-expiration-729000/apiserver.crt.7d9037ca ...

	I0127 20:05:35.325290   10037 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/15565-3235/.minikube/profiles/cert-expiration-729000/apiserver.crt.7d9037ca: {Name:mk4d91c120259812f82f819b1b530e466fc67aec Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0127 20:05:35.325577   10037 crypto.go:164] Writing key to /Users/jenkins/minikube-integration/15565-3235/.minikube/profiles/cert-expiration-729000/apiserver.key.7d9037ca ...

	I0127 20:05:35.325582   10037 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/15565-3235/.minikube/profiles/cert-expiration-729000/apiserver.key.7d9037ca: {Name:mk083b3eef99ce5d463fa9d03b82e06737dfbb52 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0127 20:05:35.325756   10037 certs.go:333] copying /Users/jenkins/minikube-integration/15565-3235/.minikube/profiles/cert-expiration-729000/apiserver.crt.7d9037ca -> /Users/jenkins/minikube-integration/15565-3235/.minikube/profiles/cert-expiration-729000/apiserver.crt

	I0127 20:05:35.326068   10037 certs.go:337] copying /Users/jenkins/minikube-integration/15565-3235/.minikube/profiles/cert-expiration-729000/apiserver.key.7d9037ca -> /Users/jenkins/minikube-integration/15565-3235/.minikube/profiles/cert-expiration-729000/apiserver.key

	I0127 20:05:35.326310   10037 certs.go:315] generating aggregator signed cert: /Users/jenkins/minikube-integration/15565-3235/.minikube/profiles/cert-expiration-729000/proxy-client.key

	I0127 20:05:35.326326   10037 crypto.go:68] Generating cert /Users/jenkins/minikube-integration/15565-3235/.minikube/profiles/cert-expiration-729000/proxy-client.crt with IP's: []

	I0127 20:05:35.402161   10037 crypto.go:156] Writing cert to /Users/jenkins/minikube-integration/15565-3235/.minikube/profiles/cert-expiration-729000/proxy-client.crt ...

	I0127 20:05:35.402168   10037 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/15565-3235/.minikube/profiles/cert-expiration-729000/proxy-client.crt: {Name:mk4ff3a897a7964e3c4ef42aadbfba8d3de95f61 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0127 20:05:35.402389   10037 crypto.go:164] Writing key to /Users/jenkins/minikube-integration/15565-3235/.minikube/profiles/cert-expiration-729000/proxy-client.key ...

	I0127 20:05:35.402393   10037 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/15565-3235/.minikube/profiles/cert-expiration-729000/proxy-client.key: {Name:mk62d9b128d7b53edaec6a6ba328bfd0e5b97f50 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0127 20:05:35.402756   10037 certs.go:401] found cert: /Users/jenkins/minikube-integration/15565-3235/.minikube/certs/Users/jenkins/minikube-integration/15565-3235/.minikube/certs/4442.pem (1338 bytes)

	W0127 20:05:35.402790   10037 certs.go:397] ignoring /Users/jenkins/minikube-integration/15565-3235/.minikube/certs/Users/jenkins/minikube-integration/15565-3235/.minikube/certs/4442_empty.pem, impossibly tiny 0 bytes

	I0127 20:05:35.402798   10037 certs.go:401] found cert: /Users/jenkins/minikube-integration/15565-3235/.minikube/certs/Users/jenkins/minikube-integration/15565-3235/.minikube/certs/ca-key.pem (1679 bytes)

	I0127 20:05:35.402828   10037 certs.go:401] found cert: /Users/jenkins/minikube-integration/15565-3235/.minikube/certs/Users/jenkins/minikube-integration/15565-3235/.minikube/certs/ca.pem (1082 bytes)

	I0127 20:05:35.402855   10037 certs.go:401] found cert: /Users/jenkins/minikube-integration/15565-3235/.minikube/certs/Users/jenkins/minikube-integration/15565-3235/.minikube/certs/cert.pem (1123 bytes)

	I0127 20:05:35.402882   10037 certs.go:401] found cert: /Users/jenkins/minikube-integration/15565-3235/.minikube/certs/Users/jenkins/minikube-integration/15565-3235/.minikube/certs/key.pem (1675 bytes)

	I0127 20:05:35.402940   10037 certs.go:401] found cert: /Users/jenkins/minikube-integration/15565-3235/.minikube/files/etc/ssl/certs/Users/jenkins/minikube-integration/15565-3235/.minikube/files/etc/ssl/certs/44422.pem (1708 bytes)

	I0127 20:05:35.403401   10037 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15565-3235/.minikube/profiles/cert-expiration-729000/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1399 bytes)

	I0127 20:05:35.419766   10037 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15565-3235/.minikube/profiles/cert-expiration-729000/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)

	I0127 20:05:35.435246   10037 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15565-3235/.minikube/profiles/cert-expiration-729000/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)

	I0127 20:05:35.450624   10037 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15565-3235/.minikube/profiles/cert-expiration-729000/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)

	I0127 20:05:35.465897   10037 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15565-3235/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)

	I0127 20:05:35.481529   10037 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15565-3235/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)

	I0127 20:05:35.496878   10037 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15565-3235/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)

	I0127 20:05:35.512119   10037 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15565-3235/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)

	I0127 20:05:35.527392   10037 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15565-3235/.minikube/certs/4442.pem --> /usr/share/ca-certificates/4442.pem (1338 bytes)

	I0127 20:05:35.542606   10037 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15565-3235/.minikube/files/etc/ssl/certs/44422.pem --> /usr/share/ca-certificates/44422.pem (1708 bytes)

	I0127 20:05:35.558088   10037 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15565-3235/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)

	I0127 20:05:35.573127   10037 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)

	I0127 20:05:35.584246   10037 ssh_runner.go:195] Run: openssl version

	I0127 20:05:35.587539   10037 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/4442.pem && ln -fs /usr/share/ca-certificates/4442.pem /etc/ssl/certs/4442.pem"

	I0127 20:05:35.594409   10037 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/4442.pem

	I0127 20:05:35.597250   10037 certs.go:444] hashing: -rw-r--r-- 1 root root 1338 Jan 28 03:34 /usr/share/ca-certificates/4442.pem

	I0127 20:05:35.597284   10037 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/4442.pem

	I0127 20:05:35.600762   10037 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/4442.pem /etc/ssl/certs/51391683.0"

	I0127 20:05:35.607660   10037 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/44422.pem && ln -fs /usr/share/ca-certificates/44422.pem /etc/ssl/certs/44422.pem"

	I0127 20:05:35.614726   10037 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/44422.pem

	I0127 20:05:35.617559   10037 certs.go:444] hashing: -rw-r--r-- 1 root root 1708 Jan 28 03:34 /usr/share/ca-certificates/44422.pem

	I0127 20:05:35.617590   10037 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/44422.pem

	I0127 20:05:35.620982   10037 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/44422.pem /etc/ssl/certs/3ec20f2e.0"

	I0127 20:05:35.627560   10037 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"

	I0127 20:05:35.634354   10037 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem

	I0127 20:05:35.637216   10037 certs.go:444] hashing: -rw-r--r-- 1 root root 1111 Jan 28 03:30 /usr/share/ca-certificates/minikubeCA.pem

	I0127 20:05:35.637245   10037 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem

	I0127 20:05:35.640648   10037 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"

	I0127 20:05:35.647393   10037 kubeadm.go:401] StartCluster: {Name:cert-expiration-729000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/15565/minikube-v1.29.0-1674856271-15565-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.36-1674164627-15541@sha256:0a2280301e955e0d3910d6e639e0b7341db1f4a25558521ac97b38c782c6189a Memory:2048 CPUs:2 DiskSize:20000 VMDriver: Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kuberne

tesVersion:v1.26.1 ClusterName:cert-expiration-729000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.64.23 Port:8443 KubernetesVersion:v1.26.1 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:8760h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror:

DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP:}

	I0127 20:05:35.647472   10037 ssh_runner.go:195] Run: docker ps --filter status=paused --filter=name=k8s_.*_(kube-system)_ --format={{.ID}}

	I0127 20:05:35.663103   10037 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd

	I0127 20:05:35.669486   10037 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml

	I0127 20:05:35.675606   10037 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf

	I0127 20:05:35.681822   10037 kubeadm.go:152] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2

	stdout:

	stderr:

	ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory

	I0127 20:05:35.681840   10037 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.26.1:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"

	I0127 20:05:35.747445   10037 kubeadm.go:322] [init] Using Kubernetes version: v1.26.1

	I0127 20:05:35.747548   10037 kubeadm.go:322] [preflight] Running pre-flight checks

	I0127 20:05:35.899233   10037 kubeadm.go:322] [preflight] Pulling images required for setting up a Kubernetes cluster

	I0127 20:05:35.899313   10037 kubeadm.go:322] [preflight] This might take a minute or two, depending on the speed of your internet connection

	I0127 20:05:35.899384   10037 kubeadm.go:322] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'

	I0127 20:05:36.006971   10037 kubeadm.go:322] [certs] Using certificateDir folder "/var/lib/minikube/certs"

	I0127 20:05:36.031134   10037 out.go:204]   - Generating certificates and keys ...

	I0127 20:05:36.031200   10037 kubeadm.go:322] [certs] Using existing ca certificate authority

	I0127 20:05:36.031249   10037 kubeadm.go:322] [certs] Using existing apiserver certificate and key on disk

	I0127 20:05:36.107640   10037 kubeadm.go:322] [certs] Generating "apiserver-kubelet-client" certificate and key

	I0127 20:05:36.358376   10037 kubeadm.go:322] [certs] Generating "front-proxy-ca" certificate and key

	I0127 20:05:32.313946    9771 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0127 20:05:32.813573    9771 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0127 20:05:33.313151    9771 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0127 20:05:33.812358    9771 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0127 20:05:34.312979    9771 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0127 20:05:34.812234    9771 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0127 20:05:35.313398    9771 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0127 20:05:35.812812    9771 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0127 20:05:36.312348    9771 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0127 20:05:36.812404    9771 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0127 20:05:36.503062   10037 kubeadm.go:322] [certs] Generating "front-proxy-client" certificate and key

	I0127 20:05:36.954367   10037 kubeadm.go:322] [certs] Generating "etcd/ca" certificate and key

	I0127 20:05:37.070016   10037 kubeadm.go:322] [certs] Generating "etcd/server" certificate and key

	I0127 20:05:37.070133   10037 kubeadm.go:322] [certs] etcd/server serving cert is signed for DNS names [cert-expiration-729000 localhost] and IPs [192.168.64.23 127.0.0.1 ::1]

	I0127 20:05:37.336269   10037 kubeadm.go:322] [certs] Generating "etcd/peer" certificate and key

	I0127 20:05:37.336543   10037 kubeadm.go:322] [certs] etcd/peer serving cert is signed for DNS names [cert-expiration-729000 localhost] and IPs [192.168.64.23 127.0.0.1 ::1]

	I0127 20:05:37.659751   10037 kubeadm.go:322] [certs] Generating "etcd/healthcheck-client" certificate and key

	I0127 20:05:37.902749   10037 kubeadm.go:322] [certs] Generating "apiserver-etcd-client" certificate and key

	I0127 20:05:38.151772   10037 kubeadm.go:322] [certs] Generating "sa" key and public key

	I0127 20:05:38.151847   10037 kubeadm.go:322] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"

	I0127 20:05:38.255575   10037 kubeadm.go:322] [kubeconfig] Writing "admin.conf" kubeconfig file

	I0127 20:05:38.634544   10037 kubeadm.go:322] [kubeconfig] Writing "kubelet.conf" kubeconfig file

	I0127 20:05:38.837442   10037 kubeadm.go:322] [kubeconfig] Writing "controller-manager.conf" kubeconfig file

	I0127 20:05:39.068915   10037 kubeadm.go:322] [kubeconfig] Writing "scheduler.conf" kubeconfig file

	I0127 20:05:39.079354   10037 kubeadm.go:322] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"

	I0127 20:05:39.080353   10037 kubeadm.go:322] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"

	I0127 20:05:39.080454   10037 kubeadm.go:322] [kubelet-start] Starting the kubelet

	I0127 20:05:39.170078   10037 kubeadm.go:322] [control-plane] Using manifest folder "/etc/kubernetes/manifests"

	I0127 20:05:39.195775   10037 out.go:204]   - Booting up control plane ...

	I0127 20:05:39.195861   10037 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-apiserver"

	I0127 20:05:39.195939   10037 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-controller-manager"

	I0127 20:05:39.196000   10037 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-scheduler"

	I0127 20:05:39.196071   10037 kubeadm.go:322] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"

	I0127 20:05:39.196188   10037 kubeadm.go:322] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s

	I0127 20:05:37.312379    9771 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0127 20:05:37.814101    9771 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0127 20:05:38.312806    9771 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0127 20:05:38.812537    9771 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0127 20:05:39.313304    9771 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0127 20:05:39.812630    9771 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0127 20:05:40.313115    9771 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0127 20:05:40.812862    9771 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0127 20:05:41.313786    9771 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0127 20:05:41.813804    9771 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0127 20:05:42.312911    9771 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0127 20:05:42.813263    9771 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0127 20:05:43.314156    9771 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0127 20:05:43.812685    9771 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0127 20:05:44.312470    9771 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0127 20:05:44.812340    9771 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0127 20:05:45.313554    9771 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0127 20:05:45.813228    9771 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0127 20:05:46.313716    9771 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0127 20:05:46.813699    9771 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0127 20:05:49.674793   10037 kubeadm.go:322] [apiclient] All control plane components are healthy after 10.501763 seconds

	I0127 20:05:49.674884   10037 kubeadm.go:322] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace

	I0127 20:05:49.683872   10037 kubeadm.go:322] [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster

	I0127 20:05:47.311991    9771 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0127 20:05:47.318121    9771 api_server.go:71] duration metric: took 22.013115013s to wait for apiserver process to appear ...

	I0127 20:05:47.318136    9771 api_server.go:87] waiting for apiserver healthz status ...

	I0127 20:05:47.318148    9771 api_server.go:252] Checking apiserver healthz at https://192.168.64.25:8443/healthz ...

	I0127 20:05:52.699590   10037 kubeadm.go:322] [upload-certs] Skipping phase. Please see --upload-certs

	I0127 20:05:52.699750   10037 kubeadm.go:322] [mark-control-plane] Marking the node cert-expiration-729000 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]

	I0127 20:05:53.207742   10037 kubeadm.go:322] [bootstrap-token] Using token: rrg0sd.e2ykdqsntf61sc8i

	I0127 20:05:53.246595   10037 out.go:204]   - Configuring RBAC rules ...

	I0127 20:05:53.246717   10037 kubeadm.go:322] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles

	I0127 20:05:53.248053   10037 kubeadm.go:322] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes

	I0127 20:05:53.254260   10037 kubeadm.go:322] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials

	I0127 20:05:53.257283   10037 kubeadm.go:322] [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token

	I0127 20:05:53.260065   10037 kubeadm.go:322] [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster

	I0127 20:05:53.263640   10037 kubeadm.go:322] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace

	I0127 20:05:53.272369   10037 kubeadm.go:322] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key

	I0127 20:05:53.443381   10037 kubeadm.go:322] [addons] Applied essential addon: CoreDNS

	I0127 20:05:53.651092   10037 kubeadm.go:322] [addons] Applied essential addon: kube-proxy

	I0127 20:05:53.651982   10037 kubeadm.go:322] 

	I0127 20:05:53.652043   10037 kubeadm.go:322] Your Kubernetes control-plane has initialized successfully!

	I0127 20:05:53.652048   10037 kubeadm.go:322] 

	I0127 20:05:53.652122   10037 kubeadm.go:322] To start using your cluster, you need to run the following as a regular user:

	I0127 20:05:53.652128   10037 kubeadm.go:322] 

	I0127 20:05:53.652144   10037 kubeadm.go:322]   mkdir -p $HOME/.kube

	I0127 20:05:53.652202   10037 kubeadm.go:322]   sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config

	I0127 20:05:53.652236   10037 kubeadm.go:322]   sudo chown $(id -u):$(id -g) $HOME/.kube/config

	I0127 20:05:53.652245   10037 kubeadm.go:322] 

	I0127 20:05:53.652286   10037 kubeadm.go:322] Alternatively, if you are the root user, you can run:

	I0127 20:05:53.652289   10037 kubeadm.go:322] 

	I0127 20:05:53.652334   10037 kubeadm.go:322]   export KUBECONFIG=/etc/kubernetes/admin.conf

	I0127 20:05:53.652338   10037 kubeadm.go:322] 

	I0127 20:05:53.652379   10037 kubeadm.go:322] You should now deploy a pod network to the cluster.

	I0127 20:05:53.652442   10037 kubeadm.go:322] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:

	I0127 20:05:53.652496   10037 kubeadm.go:322]   https://kubernetes.io/docs/concepts/cluster-administration/addons/

	I0127 20:05:53.652511   10037 kubeadm.go:322] 

	I0127 20:05:53.652571   10037 kubeadm.go:322] You can now join any number of control-plane nodes by copying certificate authorities

	I0127 20:05:53.652615   10037 kubeadm.go:322] and service account keys on each node and then running the following as root:

	I0127 20:05:53.652617   10037 kubeadm.go:322] 

	I0127 20:05:53.652675   10037 kubeadm.go:322]   kubeadm join control-plane.minikube.internal:8443 --token rrg0sd.e2ykdqsntf61sc8i \

	I0127 20:05:53.652751   10037 kubeadm.go:322] 	--discovery-token-ca-cert-hash sha256:76459747d447fbe53349461588d71983b7f5033bb09648befce7f96802f57b57 \

	I0127 20:05:53.652764   10037 kubeadm.go:322] 	--control-plane 

	I0127 20:05:53.652766   10037 kubeadm.go:322] 

	I0127 20:05:53.652829   10037 kubeadm.go:322] Then you can join any number of worker nodes by running the following on each as root:

	I0127 20:05:53.652833   10037 kubeadm.go:322] 

	I0127 20:05:53.652892   10037 kubeadm.go:322] kubeadm join control-plane.minikube.internal:8443 --token rrg0sd.e2ykdqsntf61sc8i \

	I0127 20:05:53.652989   10037 kubeadm.go:322] 	--discovery-token-ca-cert-hash sha256:76459747d447fbe53349461588d71983b7f5033bb09648befce7f96802f57b57 

	I0127 20:05:53.654056   10037 kubeadm.go:322] W0128 04:05:35.958983    1701 initconfiguration.go:119] Usage of CRI endpoints without URL scheme is deprecated and can cause kubelet errors in the future. Automatically prepending scheme "unix" to the "criSocket" with value "/var/run/cri-dockerd.sock". Please update your configuration!

	I0127 20:05:53.654134   10037 kubeadm.go:322] 	[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'

	I0127 20:05:53.654149   10037 cni.go:84] Creating CNI manager for ""

	I0127 20:05:53.654157   10037 cni.go:157] "hyperkit" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge

	I0127 20:05:53.713238   10037 out.go:177] * Configuring bridge CNI (Container Networking Interface) ...

	I0127 20:05:53.750543   10037 ssh_runner.go:195] Run: sudo mkdir -p /etc/cni/net.d

	I0127 20:05:53.762941   10037 ssh_runner.go:362] scp memory --> /etc/cni/net.d/1-k8s.conflist (457 bytes)

	I0127 20:05:53.774927   10037 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"

	I0127 20:05:53.774994   10037 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.26.1/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig

	I0127 20:05:53.774997   10037 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.26.1/kubectl label nodes minikube.k8s.io/version=v1.28.0 minikube.k8s.io/commit=1a22b9432724c1a7c0bfc1f92a18db163006c245 minikube.k8s.io/name=cert-expiration-729000 minikube.k8s.io/updated_at=2023_01_27T20_05_53_0700 minikube.k8s.io/primary=true --all --overwrite --kubeconfig=/var/lib/minikube/kubeconfig

	I0127 20:05:53.797009   10037 ops.go:34] apiserver oom_adj: -16

	I0127 20:05:53.888278   10037 kubeadm.go:1073] duration metric: took 113.33693ms to wait for elevateKubeSystemPrivileges.

	I0127 20:05:53.915378   10037 kubeadm.go:403] StartCluster complete in 18.268414695s

	I0127 20:05:53.915399   10037 settings.go:142] acquiring lock: {Name:mk80549a2c3028803e331f0580d721d5d766bd61 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0127 20:05:53.915479   10037 settings.go:150] Updating kubeconfig:  /Users/jenkins/minikube-integration/15565-3235/kubeconfig

	I0127 20:05:53.916067   10037 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/15565-3235/kubeconfig: {Name:mk69cf50f5abd22c9a63615b05ca8d5c80e5d91b Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0127 20:05:53.916308   10037 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.26.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"

	I0127 20:05:53.916328   10037 addons.go:486] enableAddons start: toEnable=map[], additional=[]

	I0127 20:05:53.916371   10037 addons.go:65] Setting storage-provisioner=true in profile "cert-expiration-729000"

	I0127 20:05:53.916371   10037 addons.go:65] Setting default-storageclass=true in profile "cert-expiration-729000"

	I0127 20:05:53.916383   10037 addons.go:227] Setting addon storage-provisioner=true in "cert-expiration-729000"

	W0127 20:05:53.916385   10037 addons.go:236] addon storage-provisioner should already be in state true

	I0127 20:05:53.916385   10037 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "cert-expiration-729000"

	I0127 20:05:53.916417   10037 host.go:66] Checking if "cert-expiration-729000" exists ...

	I0127 20:05:53.916458   10037 config.go:180] Loaded profile config "cert-expiration-729000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.26.1

	I0127 20:05:53.916654   10037 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit

	I0127 20:05:53.916672   10037 main.go:141] libmachine: Launching plugin server for driver hyperkit

	I0127 20:05:53.916708   10037 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit

	I0127 20:05:53.916719   10037 main.go:141] libmachine: Launching plugin server for driver hyperkit

	I0127 20:05:53.925102   10037 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:52610

	I0127 20:05:53.925581   10037 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:52612

	I0127 20:05:53.925625   10037 main.go:141] libmachine: () Calling .GetVersion

	I0127 20:05:53.926020   10037 main.go:141] libmachine: Using API Version  1

	I0127 20:05:53.926027   10037 main.go:141] libmachine: () Calling .SetConfigRaw

	I0127 20:05:53.926045   10037 main.go:141] libmachine: () Calling .GetVersion

	I0127 20:05:53.926259   10037 main.go:141] libmachine: () Calling .GetMachineName

	I0127 20:05:53.926370   10037 main.go:141] libmachine: Using API Version  1

	I0127 20:05:53.926377   10037 main.go:141] libmachine: () Calling .SetConfigRaw

	I0127 20:05:53.926669   10037 main.go:141] libmachine: () Calling .GetMachineName

	I0127 20:05:53.926824   10037 main.go:141] libmachine: (cert-expiration-729000) Calling .GetState

	I0127 20:05:53.926952   10037 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit

	I0127 20:05:53.926967   10037 main.go:141] libmachine: (cert-expiration-729000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0

	I0127 20:05:53.926971   10037 main.go:141] libmachine: Launching plugin server for driver hyperkit

	I0127 20:05:53.927074   10037 main.go:141] libmachine: (cert-expiration-729000) DBG | hyperkit pid from json: 9398

	I0127 20:05:53.934868   10037 addons.go:227] Setting addon default-storageclass=true in "cert-expiration-729000"

	W0127 20:05:53.934885   10037 addons.go:236] addon default-storageclass should already be in state true

	I0127 20:05:53.934915   10037 host.go:66] Checking if "cert-expiration-729000" exists ...

	I0127 20:05:53.935175   10037 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:52614

	I0127 20:05:53.935478   10037 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit

	I0127 20:05:53.935496   10037 main.go:141] libmachine: Launching plugin server for driver hyperkit

	I0127 20:05:53.936236   10037 main.go:141] libmachine: () Calling .GetVersion

	I0127 20:05:53.937460   10037 main.go:141] libmachine: Using API Version  1

	I0127 20:05:53.937480   10037 main.go:141] libmachine: () Calling .SetConfigRaw

	I0127 20:05:53.937720   10037 main.go:141] libmachine: () Calling .GetMachineName

	I0127 20:05:53.937844   10037 main.go:141] libmachine: (cert-expiration-729000) Calling .GetState

	I0127 20:05:53.937948   10037 main.go:141] libmachine: (cert-expiration-729000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0

	I0127 20:05:53.938075   10037 main.go:141] libmachine: (cert-expiration-729000) DBG | hyperkit pid from json: 9398

	I0127 20:05:53.939003   10037 main.go:141] libmachine: (cert-expiration-729000) Calling .DriverName

	I0127 20:05:53.943316   10037 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:52616

	I0127 20:05:53.980584   10037 out.go:177]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5

	I0127 20:05:52.262532    9771 api_server.go:278] https://192.168.64.25:8443/healthz returned 403:

	{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}

	W0127 20:05:52.262557    9771 api_server.go:102] status: https://192.168.64.25:8443/healthz returned error 403:

	{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}

	I0127 20:05:52.762782    9771 api_server.go:252] Checking apiserver healthz at https://192.168.64.25:8443/healthz ...

	I0127 20:05:52.769733    9771 api_server.go:278] https://192.168.64.25:8443/healthz returned 500:

	[+]ping ok

	[+]log ok

	[+]etcd ok

	[+]poststarthook/start-kube-apiserver-admission-initializer ok

	[+]poststarthook/generic-apiserver-start-informers ok

	[+]poststarthook/start-apiextensions-informers ok

	[+]poststarthook/start-apiextensions-controllers ok

	[+]poststarthook/crd-informer-synced ok

	[+]poststarthook/bootstrap-controller ok

	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld

	[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld

	[+]poststarthook/start-cluster-authentication-info-controller ok

	[+]poststarthook/start-kube-aggregator-informers ok

	[+]poststarthook/apiservice-registration-controller ok

	[+]poststarthook/apiservice-status-available-controller ok

	[+]poststarthook/kube-apiserver-autoregistration ok

	[+]autoregister-completion ok

	[+]poststarthook/apiservice-openapi-controller ok

	healthz check failed

	W0127 20:05:52.769753    9771 api_server.go:102] status: https://192.168.64.25:8443/healthz returned error 500:

	[+]ping ok

	[+]log ok

	[+]etcd ok

	[+]poststarthook/start-kube-apiserver-admission-initializer ok

	[+]poststarthook/generic-apiserver-start-informers ok

	[+]poststarthook/start-apiextensions-informers ok

	[+]poststarthook/start-apiextensions-controllers ok

	[+]poststarthook/crd-informer-synced ok

	[+]poststarthook/bootstrap-controller ok

	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld

	[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld

	[+]poststarthook/start-cluster-authentication-info-controller ok

	[+]poststarthook/start-kube-aggregator-informers ok

	[+]poststarthook/apiservice-registration-controller ok

	[+]poststarthook/apiservice-status-available-controller ok

	[+]poststarthook/kube-apiserver-autoregistration ok

	[+]autoregister-completion ok

	[+]poststarthook/apiservice-openapi-controller ok

	healthz check failed

	I0127 20:05:53.263140    9771 api_server.go:252] Checking apiserver healthz at https://192.168.64.25:8443/healthz ...

	I0127 20:05:53.267540    9771 api_server.go:278] https://192.168.64.25:8443/healthz returned 500:

	[+]ping ok

	[+]log ok

	[+]etcd ok

	[+]poststarthook/start-kube-apiserver-admission-initializer ok

	[+]poststarthook/generic-apiserver-start-informers ok

	[+]poststarthook/start-apiextensions-informers ok

	[+]poststarthook/start-apiextensions-controllers ok

	[+]poststarthook/crd-informer-synced ok

	[+]poststarthook/bootstrap-controller ok

	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld

	[+]poststarthook/scheduling/bootstrap-system-priority-classes ok

	[+]poststarthook/start-cluster-authentication-info-controller ok

	[+]poststarthook/start-kube-aggregator-informers ok

	[+]poststarthook/apiservice-registration-controller ok

	[+]poststarthook/apiservice-status-available-controller ok

	[+]poststarthook/kube-apiserver-autoregistration ok

	[+]autoregister-completion ok

	[+]poststarthook/apiservice-openapi-controller ok

	healthz check failed

	W0127 20:05:53.267554    9771 api_server.go:102] status: https://192.168.64.25:8443/healthz returned error 500:

	[+]ping ok

	[+]log ok

	[+]etcd ok

	[+]poststarthook/start-kube-apiserver-admission-initializer ok

	[+]poststarthook/generic-apiserver-start-informers ok

	[+]poststarthook/start-apiextensions-informers ok

	[+]poststarthook/start-apiextensions-controllers ok

	[+]poststarthook/crd-informer-synced ok

	[+]poststarthook/bootstrap-controller ok

	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld

	[+]poststarthook/scheduling/bootstrap-system-priority-classes ok

	[+]poststarthook/start-cluster-authentication-info-controller ok

	[+]poststarthook/start-kube-aggregator-informers ok

	[+]poststarthook/apiservice-registration-controller ok

	[+]poststarthook/apiservice-status-available-controller ok

	[+]poststarthook/kube-apiserver-autoregistration ok

	[+]autoregister-completion ok

	[+]poststarthook/apiservice-openapi-controller ok

	healthz check failed

	I0127 20:05:53.764362    9771 api_server.go:252] Checking apiserver healthz at https://192.168.64.25:8443/healthz ...

	I0127 20:05:53.768632    9771 api_server.go:278] https://192.168.64.25:8443/healthz returned 200:

	ok

	I0127 20:05:53.773903    9771 api_server.go:140] control plane version: v1.17.0

	I0127 20:05:53.773919    9771 api_server.go:130] duration metric: took 6.455929345s to wait for apiserver health ...

	I0127 20:05:53.773925    9771 cni.go:84] Creating CNI manager for ""

	I0127 20:05:53.773936    9771 cni.go:161] CNI unnecessary in this configuration, recommending no CNI

	I0127 20:05:53.773948    9771 system_pods.go:43] waiting for kube-system pods to appear ...

	I0127 20:05:53.778226    9771 system_pods.go:59] 4 kube-system pods found

	I0127 20:05:53.778243    9771 system_pods.go:61] "coredns-6955765f44-4kg27" [9b2e9e1b-c463-40b7-a832-cd1b27921930] Pending: PodScheduled:Unschedulable (0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.)

	I0127 20:05:53.778250    9771 system_pods.go:61] "coredns-6955765f44-7ffc4" [ccdf5641-e668-4b3b-9b72-ede33ad90867] Pending: PodScheduled:Unschedulable (0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.)

	I0127 20:05:53.778254    9771 system_pods.go:61] "kube-proxy-nv5hs" [4137d463-f671-42bd-b020-b1bfbcef217e] Pending

	I0127 20:05:53.778258    9771 system_pods.go:61] "storage-provisioner" [d5b749b0-341b-4e5f-adfb-46c6f48adb45] Pending: PodScheduled:Unschedulable (0/1 nodes are available: 1 node(s) had taints that the pod didn't tolerate.)

	I0127 20:05:53.778262    9771 system_pods.go:74] duration metric: took 4.309335ms to wait for pod list to return data ...

	I0127 20:05:53.778268    9771 node_conditions.go:102] verifying NodePressure condition ...

	I0127 20:05:53.780400    9771 node_conditions.go:122] node storage ephemeral capacity is 17784772Ki

	I0127 20:05:53.780415    9771 node_conditions.go:123] node cpu capacity is 2

	I0127 20:05:53.780429    9771 node_conditions.go:105] duration metric: took 2.156977ms to run NodePressure ...

	I0127 20:05:53.780442    9771 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.17.0:$PATH" kubeadm init phase addon all --config /var/tmp/minikube/kubeadm.yaml"

	I0127 20:05:54.007475    9771 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"

	I0127 20:05:54.014547    9771 ops.go:34] apiserver oom_adj: -16

	I0127 20:05:54.014556    9771 kubeadm.go:637] restartCluster took 40.034616433s

	I0127 20:05:54.014561    9771 kubeadm.go:403] StartCluster complete in 40.06472281s

	I0127 20:05:54.014574    9771 settings.go:142] acquiring lock: {Name:mk80549a2c3028803e331f0580d721d5d766bd61 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0127 20:05:54.014638    9771 settings.go:150] Updating kubeconfig:  /Users/jenkins/minikube-integration/15565-3235/kubeconfig

	I0127 20:05:54.015328    9771 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/15565-3235/kubeconfig: {Name:mk69cf50f5abd22c9a63615b05ca8d5c80e5d91b Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0127 20:05:54.015605    9771 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.17.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"

	I0127 20:05:54.015621    9771 addons.go:486] enableAddons start: toEnable=map[], additional=[]

	I0127 20:05:54.015691    9771 addons.go:65] Setting storage-provisioner=true in profile "running-upgrade-052000"

	I0127 20:05:54.015691    9771 addons.go:65] Setting default-storageclass=true in profile "running-upgrade-052000"

	I0127 20:05:54.015710    9771 addons.go:227] Setting addon storage-provisioner=true in "running-upgrade-052000"

	I0127 20:05:54.015717    9771 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "running-upgrade-052000"

	W0127 20:05:54.015719    9771 addons.go:236] addon storage-provisioner should already be in state true

	I0127 20:05:54.015774    9771 host.go:66] Checking if "running-upgrade-052000" exists ...

	I0127 20:05:54.015788    9771 config.go:180] Loaded profile config "running-upgrade-052000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.17.0

	I0127 20:05:54.016106    9771 kapi.go:59] client config for running-upgrade-052000: &rest.Config{Host:"https://192.168.64.25:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/Users/jenkins/minikube-integration/15565-3235/.minikube/profiles/running-upgrade-052000/client.crt", KeyFile:"/Users/jenkins/minikube-integration/15565-3235/.minikube/profiles/running-upgrade-052000/client.key", CAFile:"/Users/jenkins/minikube-integration/15565-3235/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:

[]uint8(nil), NextProtos:[]string(nil)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x2449ae0), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}

	I0127 20:05:54.016178    9771 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit

	I0127 20:05:54.016205    9771 main.go:141] libmachine: Launching plugin server for driver hyperkit

	I0127 20:05:54.016265    9771 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit

	I0127 20:05:54.016292    9771 main.go:141] libmachine: Launching plugin server for driver hyperkit

	I0127 20:05:54.025271    9771 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:52622

	I0127 20:05:54.025809    9771 main.go:141] libmachine: () Calling .GetVersion

	I0127 20:05:54.026088    9771 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:52624

	I0127 20:05:54.026293    9771 main.go:141] libmachine: Using API Version  1

	I0127 20:05:54.026320    9771 main.go:141] libmachine: () Calling .SetConfigRaw

	I0127 20:05:54.026550    9771 main.go:141] libmachine: () Calling .GetVersion

	I0127 20:05:54.026603    9771 main.go:141] libmachine: () Calling .GetMachineName

	I0127 20:05:54.026971    9771 main.go:141] libmachine: Using API Version  1

	I0127 20:05:54.026986    9771 main.go:141] libmachine: () Calling .SetConfigRaw

	I0127 20:05:54.027085    9771 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit

	I0127 20:05:54.027116    9771 main.go:141] libmachine: Launching plugin server for driver hyperkit

	I0127 20:05:54.027302    9771 main.go:141] libmachine: () Calling .GetMachineName

	I0127 20:05:54.028806    9771 main.go:141] libmachine: (running-upgrade-052000) Calling .GetState

	I0127 20:05:54.030254    9771 main.go:141] libmachine: (running-upgrade-052000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0

	I0127 20:05:54.030374    9771 main.go:141] libmachine: (running-upgrade-052000) DBG | hyperkit pid from json: 9576

	I0127 20:05:54.031448    9771 kapi.go:59] client config for running-upgrade-052000: &rest.Config{Host:"https://192.168.64.25:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/Users/jenkins/minikube-integration/15565-3235/.minikube/profiles/running-upgrade-052000/client.crt", KeyFile:"/Users/jenkins/minikube-integration/15565-3235/.minikube/profiles/running-upgrade-052000/client.key", CAFile:"/Users/jenkins/minikube-integration/15565-3235/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:

[]uint8(nil), NextProtos:[]string(nil)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x2449ae0), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}

	I0127 20:05:54.035700    9771 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:52626

	I0127 20:05:54.036101    9771 main.go:141] libmachine: () Calling .GetVersion

	I0127 20:05:54.036490    9771 main.go:141] libmachine: Using API Version  1

	I0127 20:05:54.036508    9771 main.go:141] libmachine: () Calling .SetConfigRaw

	I0127 20:05:54.036808    9771 main.go:141] libmachine: () Calling .GetMachineName

	I0127 20:05:54.036948    9771 main.go:141] libmachine: (running-upgrade-052000) Calling .GetState

	I0127 20:05:54.037107    9771 main.go:141] libmachine: (running-upgrade-052000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0

	I0127 20:05:54.037246    9771 main.go:141] libmachine: (running-upgrade-052000) DBG | hyperkit pid from json: 9576

	I0127 20:05:54.038373    9771 main.go:141] libmachine: (running-upgrade-052000) Calling .DriverName

	I0127 20:05:54.042905    9771 addons.go:227] Setting addon default-storageclass=true in "running-upgrade-052000"

	I0127 20:05:54.060613    9771 out.go:177]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5

	W0127 20:05:54.060622    9771 addons.go:236] addon default-storageclass should already be in state true

	I0127 20:05:54.060663    9771 host.go:66] Checking if "running-upgrade-052000" exists ...

	I0127 20:05:54.081731    9771 addons.go:419] installing /etc/kubernetes/addons/storage-provisioner.yaml

	I0127 20:05:54.081743    9771 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)

	I0127 20:05:54.081781    9771 main.go:141] libmachine: (running-upgrade-052000) Calling .GetSSHHostname

	I0127 20:05:54.081969    9771 main.go:141] libmachine: (running-upgrade-052000) Calling .GetSSHPort

	I0127 20:05:54.082032    9771 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit

	I0127 20:05:54.082062    9771 main.go:141] libmachine: Launching plugin server for driver hyperkit

	I0127 20:05:54.082099    9771 main.go:141] libmachine: (running-upgrade-052000) Calling .GetSSHKeyPath

	I0127 20:05:54.082211    9771 main.go:141] libmachine: (running-upgrade-052000) Calling .GetSSHUsername

	I0127 20:05:54.082730    9771 sshutil.go:53] new ssh client: &{IP:192.168.64.25 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/15565-3235/.minikube/machines/running-upgrade-052000/id_rsa Username:docker}

	I0127 20:05:54.090512    9771 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:52629

	I0127 20:05:54.090965    9771 main.go:141] libmachine: () Calling .GetVersion

	I0127 20:05:54.091549    9771 main.go:141] libmachine: Using API Version  1

	I0127 20:05:54.091576    9771 main.go:141] libmachine: () Calling .SetConfigRaw

	I0127 20:05:54.091818    9771 main.go:141] libmachine: () Calling .GetMachineName

	I0127 20:05:54.092235    9771 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit

	I0127 20:05:54.092264    9771 main.go:141] libmachine: Launching plugin server for driver hyperkit

	I0127 20:05:54.099956    9771 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:52631

	I0127 20:05:54.100372    9771 main.go:141] libmachine: () Calling .GetVersion

	I0127 20:05:54.100766    9771 main.go:141] libmachine: Using API Version  1

	I0127 20:05:54.100781    9771 main.go:141] libmachine: () Calling .SetConfigRaw

	I0127 20:05:54.101015    9771 main.go:141] libmachine: () Calling .GetMachineName

	I0127 20:05:54.101137    9771 main.go:141] libmachine: (running-upgrade-052000) Calling .GetState

	I0127 20:05:54.101246    9771 main.go:141] libmachine: (running-upgrade-052000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0

	I0127 20:05:54.101340    9771 main.go:141] libmachine: (running-upgrade-052000) DBG | hyperkit pid from json: 9576

	I0127 20:05:54.102298    9771 main.go:141] libmachine: (running-upgrade-052000) Calling .DriverName

	I0127 20:05:54.102491    9771 addons.go:419] installing /etc/kubernetes/addons/storageclass.yaml

	I0127 20:05:54.102502    9771 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)

	I0127 20:05:54.102512    9771 main.go:141] libmachine: (running-upgrade-052000) Calling .GetSSHHostname

	I0127 20:05:54.102615    9771 main.go:141] libmachine: (running-upgrade-052000) Calling .GetSSHPort

	I0127 20:05:54.102715    9771 main.go:141] libmachine: (running-upgrade-052000) Calling .GetSSHKeyPath

	I0127 20:05:54.102830    9771 main.go:141] libmachine: (running-upgrade-052000) Calling .GetSSHUsername

	I0127 20:05:54.102917    9771 sshutil.go:53] new ssh client: &{IP:192.168.64.25 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/15565-3235/.minikube/machines/running-upgrade-052000/id_rsa Username:docker}

	I0127 20:05:54.106491    9771 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.17.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.64.1 host.minikube.internal\n           fallthrough\n        }' -e '/^        errors *$/i \        log' | sudo /var/lib/minikube/binaries/v1.17.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"

	I0127 20:05:54.128516    9771 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.17.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml

	I0127 20:05:54.165587    9771 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.17.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml

	I0127 20:05:54.319172    9771 start.go:908] {"host.minikube.internal": 192.168.64.1} host record injected into CoreDNS's ConfigMap

	I0127 20:05:54.434474    9771 main.go:141] libmachine: Making call to close driver server

	I0127 20:05:54.434493    9771 main.go:141] libmachine: (running-upgrade-052000) Calling .Close

	I0127 20:05:54.434647    9771 main.go:141] libmachine: Successfully made call to close driver server

	I0127 20:05:54.434656    9771 main.go:141] libmachine: Making call to close connection to plugin binary

	I0127 20:05:54.434667    9771 main.go:141] libmachine: Making call to close driver server

	I0127 20:05:54.434675    9771 main.go:141] libmachine: (running-upgrade-052000) Calling .Close

	I0127 20:05:54.434818    9771 main.go:141] libmachine: Successfully made call to close driver server

	I0127 20:05:54.434827    9771 main.go:141] libmachine: Making call to close connection to plugin binary

	I0127 20:05:54.434838    9771 main.go:141] libmachine: Making call to close driver server

	I0127 20:05:54.434846    9771 main.go:141] libmachine: (running-upgrade-052000) Calling .Close

	I0127 20:05:54.434936    9771 main.go:141] libmachine: Making call to close driver server

	I0127 20:05:54.434951    9771 main.go:141] libmachine: (running-upgrade-052000) Calling .Close

	I0127 20:05:54.435010    9771 main.go:141] libmachine: (running-upgrade-052000) DBG | Closing plugin on server side

	I0127 20:05:54.435089    9771 main.go:141] libmachine: Successfully made call to close driver server

	I0127 20:05:54.435128    9771 main.go:141] libmachine: Making call to close connection to plugin binary

	I0127 20:05:54.435135    9771 main.go:141] libmachine: Successfully made call to close driver server

	I0127 20:05:54.435159    9771 main.go:141] libmachine: Making call to close connection to plugin binary

	I0127 20:05:54.435180    9771 main.go:141] libmachine: Making call to close driver server

	I0127 20:05:54.435223    9771 main.go:141] libmachine: (running-upgrade-052000) Calling .Close

	I0127 20:05:54.435237    9771 main.go:141] libmachine: (running-upgrade-052000) DBG | Closing plugin on server side

	I0127 20:05:54.435370    9771 main.go:141] libmachine: (running-upgrade-052000) DBG | Closing plugin on server side

	I0127 20:05:54.435452    9771 main.go:141] libmachine: Successfully made call to close driver server

	I0127 20:05:54.435474    9771 main.go:141] libmachine: Making call to close connection to plugin binary

	I0127 20:05:53.981052   10037 main.go:141] libmachine: () Calling .GetVersion

	I0127 20:05:54.000605   10037 addons.go:419] installing /etc/kubernetes/addons/storage-provisioner.yaml

	I0127 20:05:54.000616   10037 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)

	I0127 20:05:54.000634   10037 main.go:141] libmachine: (cert-expiration-729000) Calling .GetSSHHostname

	I0127 20:05:54.000859   10037 main.go:141] libmachine: (cert-expiration-729000) Calling .GetSSHPort

	I0127 20:05:54.001041   10037 main.go:141] libmachine: Using API Version  1

	I0127 20:05:54.001076   10037 main.go:141] libmachine: () Calling .SetConfigRaw

	I0127 20:05:54.001082   10037 main.go:141] libmachine: (cert-expiration-729000) Calling .GetSSHKeyPath

	I0127 20:05:54.001319   10037 main.go:141] libmachine: (cert-expiration-729000) Calling .GetSSHUsername

	I0127 20:05:54.001562   10037 main.go:141] libmachine: () Calling .GetMachineName

	I0127 20:05:54.001627   10037 sshutil.go:53] new ssh client: &{IP:192.168.64.23 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/15565-3235/.minikube/machines/cert-expiration-729000/id_rsa Username:docker}

	I0127 20:05:54.002238   10037 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit

	I0127 20:05:54.002266   10037 main.go:141] libmachine: Launching plugin server for driver hyperkit

	I0127 20:05:54.005684   10037 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.26.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.64.1 host.minikube.internal\n           fallthrough\n        }' -e '/^        errors *$/i \        log' | sudo /var/lib/minikube/binaries/v1.26.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"

	I0127 20:05:54.010175   10037 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:52619

	I0127 20:05:54.010507   10037 main.go:141] libmachine: () Calling .GetVersion

	I0127 20:05:54.010870   10037 main.go:141] libmachine: Using API Version  1

	I0127 20:05:54.010883   10037 main.go:141] libmachine: () Calling .SetConfigRaw

	I0127 20:05:54.011081   10037 main.go:141] libmachine: () Calling .GetMachineName

	I0127 20:05:54.011171   10037 main.go:141] libmachine: (cert-expiration-729000) Calling .GetState

	I0127 20:05:54.011268   10037 main.go:141] libmachine: (cert-expiration-729000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0

	I0127 20:05:54.011350   10037 main.go:141] libmachine: (cert-expiration-729000) DBG | hyperkit pid from json: 9398

	I0127 20:05:54.012255   10037 main.go:141] libmachine: (cert-expiration-729000) Calling .DriverName

	I0127 20:05:54.012418   10037 addons.go:419] installing /etc/kubernetes/addons/storageclass.yaml

	I0127 20:05:54.012423   10037 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)

	I0127 20:05:54.012431   10037 main.go:141] libmachine: (cert-expiration-729000) Calling .GetSSHHostname

	I0127 20:05:54.012509   10037 main.go:141] libmachine: (cert-expiration-729000) Calling .GetSSHPort

	I0127 20:05:54.012611   10037 main.go:141] libmachine: (cert-expiration-729000) Calling .GetSSHKeyPath

	I0127 20:05:54.012702   10037 main.go:141] libmachine: (cert-expiration-729000) Calling .GetSSHUsername

	I0127 20:05:54.012775   10037 sshutil.go:53] new ssh client: &{IP:192.168.64.23 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/15565-3235/.minikube/machines/cert-expiration-729000/id_rsa Username:docker}

	I0127 20:05:54.066197   10037 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.26.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml

	I0127 20:05:54.087054   10037 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.26.1/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml

	I0127 20:05:54.439646   10037 kapi.go:248] "coredns" deployment in "kube-system" namespace and "cert-expiration-729000" context rescaled to 1 replicas

	I0127 20:05:54.439665   10037 start.go:221] Will wait 6m0s for node &{Name: IP:192.168.64.23 Port:8443 KubernetesVersion:v1.26.1 ContainerRuntime:docker ControlPlane:true Worker:true}

	I0127 20:05:54.473718    9771 out.go:177] * Enabled addons: default-storageclass, storage-provisioner

	I0127 20:05:54.514486   10037 out.go:177] * Verifying Kubernetes components...

	I0127 20:05:54.514480    9771 addons.go:488] enableAddons completed in 498.883283ms

	I0127 20:05:54.589753    9771 kapi.go:248] "coredns" deployment in "kube-system" namespace and "running-upgrade-052000" context rescaled to 1 replicas

	I0127 20:05:54.589782    9771 start.go:221] Will wait 6m0s for node &{Name:minikube IP:192.168.64.25 Port:8443 KubernetesVersion:v1.17.0 ContainerRuntime:docker ControlPlane:true Worker:true}

	I0127 20:05:54.610530    9771 out.go:177] * Verifying Kubernetes components...

	I0127 20:05:54.668693    9771 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0127 20:05:54.675145    9771 kubeadm.go:515] skip waiting for components based on config.

	I0127 20:05:54.675159    9771 node_conditions.go:102] verifying NodePressure condition ...

	I0127 20:05:54.686532    9771 node_conditions.go:122] node storage ephemeral capacity is 17784772Ki

	I0127 20:05:54.686547    9771 node_conditions.go:123] node cpu capacity is 2

	I0127 20:05:54.686554    9771 node_conditions.go:105] duration metric: took 11.391146ms to run NodePressure ...

	I0127 20:05:54.686561    9771 start.go:226] waiting for startup goroutines ...

	I0127 20:05:54.686921    9771 ssh_runner.go:195] Run: rm -f paused

	I0127 20:05:54.726717    9771 start.go:538] kubectl: 1.25.4, cluster: 1.17.0 (minor skew: 8)

	I0127 20:05:54.747501    9771 out.go:177] 

	W0127 20:05:54.784939    9771 out.go:239] ! /usr/local/bin/kubectl is version 1.25.4, which may have incompatibilities with Kubernetes 1.17.0.

	I0127 20:05:54.822646    9771 out.go:177]   - Want kubectl v1.17.0? Try 'minikube kubectl -- get pods -A'

	I0127 20:05:54.880752    9771 out.go:177] * Done! kubectl is now configured to use "running-upgrade-052000" cluster and "" namespace by default

	I0127 20:05:54.588794   10037 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0127 20:05:54.695327   10037 start.go:908] {"host.minikube.internal": 192.168.64.1} host record injected into CoreDNS's ConfigMap

	I0127 20:05:55.019014   10037 main.go:141] libmachine: Making call to close driver server

	I0127 20:05:55.019024   10037 main.go:141] libmachine: (cert-expiration-729000) Calling .Close

	I0127 20:05:55.019040   10037 main.go:141] libmachine: Making call to close driver server

	I0127 20:05:55.019049   10037 main.go:141] libmachine: (cert-expiration-729000) Calling .Close

	I0127 20:05:55.019263   10037 main.go:141] libmachine: (cert-expiration-729000) DBG | Closing plugin on server side

	I0127 20:05:55.019289   10037 main.go:141] libmachine: (cert-expiration-729000) DBG | Closing plugin on server side

	I0127 20:05:55.019297   10037 main.go:141] libmachine: Successfully made call to close driver server

	I0127 20:05:55.019305   10037 main.go:141] libmachine: Making call to close connection to plugin binary

	I0127 20:05:55.019310   10037 main.go:141] libmachine: Making call to close driver server

	I0127 20:05:55.019318   10037 main.go:141] libmachine: (cert-expiration-729000) Calling .Close

	I0127 20:05:55.019306   10037 main.go:141] libmachine: Successfully made call to close driver server

	I0127 20:05:55.019376   10037 main.go:141] libmachine: Making call to close connection to plugin binary

	I0127 20:05:55.019408   10037 main.go:141] libmachine: Making call to close driver server

	I0127 20:05:55.019420   10037 main.go:141] libmachine: (cert-expiration-729000) Calling .Close

	I0127 20:05:55.019553   10037 main.go:141] libmachine: Successfully made call to close driver server

	I0127 20:05:55.019560   10037 main.go:141] libmachine: Making call to close connection to plugin binary

	I0127 20:05:55.019599   10037 main.go:141] libmachine: Successfully made call to close driver server

	I0127 20:05:55.019605   10037 main.go:141] libmachine: Making call to close connection to plugin binary

	I0127 20:05:55.019614   10037 main.go:141] libmachine: Making call to close driver server

	I0127 20:05:55.019620   10037 main.go:141] libmachine: (cert-expiration-729000) Calling .Close

	I0127 20:05:55.019633   10037 main.go:141] libmachine: (cert-expiration-729000) DBG | Closing plugin on server side

	I0127 20:05:55.019825   10037 main.go:141] libmachine: Successfully made call to close driver server

	I0127 20:05:55.019831   10037 main.go:141] libmachine: Making call to close connection to plugin binary

	I0127 20:05:55.020129   10037 api_server.go:51] waiting for apiserver process to appear ...

	I0127 20:05:55.041684   10037 out.go:177] * Enabled addons: storage-provisioner, default-storageclass

	I0127 20:05:55.041785   10037 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0127 20:05:55.115731   10037 addons.go:488] enableAddons completed in 1.199391115s

	I0127 20:05:55.127154   10037 api_server.go:71] duration metric: took 687.485477ms to wait for apiserver process to appear ...

	I0127 20:05:55.127168   10037 api_server.go:87] waiting for apiserver healthz status ...

	I0127 20:05:55.127186   10037 api_server.go:252] Checking apiserver healthz at https://192.168.64.23:8443/healthz ...

	I0127 20:05:55.131531   10037 api_server.go:278] https://192.168.64.23:8443/healthz returned 200:

	ok

	I0127 20:05:55.132234   10037 api_server.go:140] control plane version: v1.26.1

	I0127 20:05:55.132244   10037 api_server.go:130] duration metric: took 5.073117ms to wait for apiserver health ...

	I0127 20:05:55.132254   10037 system_pods.go:43] waiting for kube-system pods to appear ...

	I0127 20:05:55.137518   10037 system_pods.go:59] 5 kube-system pods found

	I0127 20:05:55.137538   10037 system_pods.go:61] "etcd-cert-expiration-729000" [0bec7128-396f-402f-8948-9bf5db76a8fd] Pending

	I0127 20:05:55.137543   10037 system_pods.go:61] "kube-apiserver-cert-expiration-729000" [6e5cac21-ac6e-4c04-9878-fd9d325fb961] Pending

	I0127 20:05:55.137547   10037 system_pods.go:61] "kube-controller-manager-cert-expiration-729000" [9f8e6296-e586-4599-a39e-3dd88b191593] Pending

	I0127 20:05:55.137551   10037 system_pods.go:61] "kube-scheduler-cert-expiration-729000" [87e82be0-8864-4da6-8593-83145af5e215] Pending

	I0127 20:05:55.137564   10037 system_pods.go:61] "storage-provisioner" [eea6ffb0-41ec-4ee7-baca-63c758359b69] Pending: PodScheduled:Unschedulable (0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling..)

	I0127 20:05:55.137568   10037 system_pods.go:74] duration metric: took 5.311376ms to wait for pod list to return data ...

	I0127 20:05:55.137575   10037 kubeadm.go:578] duration metric: took 697.910946ms to wait for : map[apiserver:true system_pods:true] ...

	I0127 20:05:55.137587   10037 node_conditions.go:102] verifying NodePressure condition ...

	I0127 20:05:55.140104   10037 node_conditions.go:122] node storage ephemeral capacity is 17784752Ki

	I0127 20:05:55.140118   10037 node_conditions.go:123] node cpu capacity is 2

	I0127 20:05:55.140126   10037 node_conditions.go:105] duration metric: took 2.536474ms to run NodePressure ...

	I0127 20:05:55.140132   10037 start.go:226] waiting for startup goroutines ...

	I0127 20:05:55.140457   10037 ssh_runner.go:195] Run: rm -f paused

	I0127 20:05:55.179678   10037 start.go:538] kubectl: 1.25.4, cluster: 1.26.1 (minor skew: 1)

	I0127 20:05:55.200419   10037 out.go:177] * Done! kubectl is now configured to use "cert-expiration-729000" cluster and "default" namespace by default

	* 

	* ==> Docker <==

	* -- Journal begins at Sat 2023-01-28 04:02:18 UTC, ends at Sat 2023-01-28 04:05:56 UTC. --

	Jan 28 04:05:45 cert-expiration-729000 dockerd[1360]: time="2023-01-28T04:05:45.306380277Z" level=info msg="starting signal loop" namespace=moby path=/run/docker/containerd/daemon/io.containerd.runtime.v2.task/moby/5fac51758de637db5711bdcade68115305c238d1b6062536e6b473f11ee970f8 pid=2034 runtime=io.containerd.runc.v2

	Jan 28 04:05:45 cert-expiration-729000 dockerd[1360]: time="2023-01-28T04:05:45.474321665Z" level=info msg="loading plugin \"io.containerd.event.v1.publisher\"..." runtime=io.containerd.runc.v2 type=io.containerd.event.v1

	Jan 28 04:05:45 cert-expiration-729000 dockerd[1360]: time="2023-01-28T04:05:45.474448207Z" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1

	Jan 28 04:05:45 cert-expiration-729000 dockerd[1360]: time="2023-01-28T04:05:45.474506449Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1

	Jan 28 04:05:45 cert-expiration-729000 dockerd[1360]: time="2023-01-28T04:05:45.474753684Z" level=info msg="starting signal loop" namespace=moby path=/run/docker/containerd/daemon/io.containerd.runtime.v2.task/moby/09f9be266e60386919d6e9174c77ec460072c4907c415e904e1cb3da22c0656b pid=2068 runtime=io.containerd.runc.v2

	Jan 28 04:05:45 cert-expiration-729000 dockerd[1360]: time="2023-01-28T04:05:45.547667876Z" level=info msg="loading plugin \"io.containerd.event.v1.publisher\"..." runtime=io.containerd.runc.v2 type=io.containerd.event.v1

	Jan 28 04:05:45 cert-expiration-729000 dockerd[1360]: time="2023-01-28T04:05:45.547708778Z" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1

	Jan 28 04:05:45 cert-expiration-729000 dockerd[1360]: time="2023-01-28T04:05:45.547716466Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1

	Jan 28 04:05:45 cert-expiration-729000 dockerd[1360]: time="2023-01-28T04:05:45.547815240Z" level=info msg="starting signal loop" namespace=moby path=/run/docker/containerd/daemon/io.containerd.runtime.v2.task/moby/e100c9dfaa645a97d0a481e5cd4a14603764b569114d3c7e5837834abbee083f pid=2103 runtime=io.containerd.runc.v2

	Jan 28 04:05:45 cert-expiration-729000 dockerd[1360]: time="2023-01-28T04:05:45.880236211Z" level=info msg="loading plugin \"io.containerd.event.v1.publisher\"..." runtime=io.containerd.runc.v2 type=io.containerd.event.v1

	Jan 28 04:05:45 cert-expiration-729000 dockerd[1360]: time="2023-01-28T04:05:45.880473337Z" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1

	Jan 28 04:05:45 cert-expiration-729000 dockerd[1360]: time="2023-01-28T04:05:45.880559102Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1

	Jan 28 04:05:45 cert-expiration-729000 dockerd[1360]: time="2023-01-28T04:05:45.880843667Z" level=info msg="starting signal loop" namespace=moby path=/run/docker/containerd/daemon/io.containerd.runtime.v2.task/moby/e90861c322335deda0553b14a4f8943dab0937810203b8ee9bc4978e9ddb011c pid=2163 runtime=io.containerd.runc.v2

	Jan 28 04:05:45 cert-expiration-729000 dockerd[1360]: time="2023-01-28T04:05:45.889441115Z" level=info msg="loading plugin \"io.containerd.event.v1.publisher\"..." runtime=io.containerd.runc.v2 type=io.containerd.event.v1

	Jan 28 04:05:45 cert-expiration-729000 dockerd[1360]: time="2023-01-28T04:05:45.889809966Z" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1

	Jan 28 04:05:45 cert-expiration-729000 dockerd[1360]: time="2023-01-28T04:05:45.889872917Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1

	Jan 28 04:05:45 cert-expiration-729000 dockerd[1360]: time="2023-01-28T04:05:45.890642983Z" level=info msg="starting signal loop" namespace=moby path=/run/docker/containerd/daemon/io.containerd.runtime.v2.task/moby/ee29e39c94dd8fd9ef9118d80751491f39701fc8750a36ee7daff2642c1ddeb8 pid=2190 runtime=io.containerd.runc.v2

	Jan 28 04:05:46 cert-expiration-729000 dockerd[1360]: time="2023-01-28T04:05:46.071856013Z" level=info msg="loading plugin \"io.containerd.event.v1.publisher\"..." runtime=io.containerd.runc.v2 type=io.containerd.event.v1

	Jan 28 04:05:46 cert-expiration-729000 dockerd[1360]: time="2023-01-28T04:05:46.071916984Z" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1

	Jan 28 04:05:46 cert-expiration-729000 dockerd[1360]: time="2023-01-28T04:05:46.071926404Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1

	Jan 28 04:05:46 cert-expiration-729000 dockerd[1360]: time="2023-01-28T04:05:46.072460166Z" level=info msg="starting signal loop" namespace=moby path=/run/docker/containerd/daemon/io.containerd.runtime.v2.task/moby/fe78b76dec737fec3cd6b49fffe5e96c82d8d185f9a058d934c83ca9c08f0802 pid=2238 runtime=io.containerd.runc.v2

	Jan 28 04:05:46 cert-expiration-729000 dockerd[1360]: time="2023-01-28T04:05:46.486889975Z" level=info msg="loading plugin \"io.containerd.event.v1.publisher\"..." runtime=io.containerd.runc.v2 type=io.containerd.event.v1

	Jan 28 04:05:46 cert-expiration-729000 dockerd[1360]: time="2023-01-28T04:05:46.486962981Z" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1

	Jan 28 04:05:46 cert-expiration-729000 dockerd[1360]: time="2023-01-28T04:05:46.486973213Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1

	Jan 28 04:05:46 cert-expiration-729000 dockerd[1360]: time="2023-01-28T04:05:46.487298302Z" level=info msg="starting signal loop" namespace=moby path=/run/docker/containerd/daemon/io.containerd.runtime.v2.task/moby/ef2d7d5804f0b250b1d706ad02493a4bd07a8ca2d098b17780b5de98262d4acb pid=2314 runtime=io.containerd.runc.v2

	* 

	* ==> container status <==

	* CONTAINER           IMAGE               CREATED             STATE               NAME                      ATTEMPT             POD ID

	ef2d7d5804f0b       655493523f607       10 seconds ago      Running             kube-scheduler            0                   fe78b76dec737

	ee29e39c94dd8       e9c08e11b07f6       11 seconds ago      Running             kube-controller-manager   0                   09f9be266e603

	e90861c322335       deb04688c4a35       11 seconds ago      Running             kube-apiserver            0                   e100c9dfaa645

	5fac51758de63       fce326961ae2d       11 seconds ago      Running             etcd                      0                   b2a84ed55df97

	* 

	* ==> describe nodes <==

	* Name:               cert-expiration-729000

	Roles:              control-plane

	Labels:             beta.kubernetes.io/arch=amd64

	                    beta.kubernetes.io/os=linux

	                    kubernetes.io/arch=amd64

	                    kubernetes.io/hostname=cert-expiration-729000

	                    kubernetes.io/os=linux

	                    minikube.k8s.io/commit=1a22b9432724c1a7c0bfc1f92a18db163006c245

	                    minikube.k8s.io/name=cert-expiration-729000

	                    minikube.k8s.io/primary=true

	                    minikube.k8s.io/updated_at=2023_01_27T20_05_53_0700

	                    minikube.k8s.io/version=v1.28.0

	                    node-role.kubernetes.io/control-plane=

	                    node.kubernetes.io/exclude-from-external-load-balancers=

	Annotations:        kubeadm.alpha.kubernetes.io/cri-socket: unix:///var/run/cri-dockerd.sock

	                    volumes.kubernetes.io/controller-managed-attach-detach: true

	CreationTimestamp:  Sat, 28 Jan 2023 04:05:52 +0000

	Taints:             node.kubernetes.io/not-ready:NoSchedule

	Unschedulable:      false

	Lease:

	  HolderIdentity:  cert-expiration-729000

	  AcquireTime:     <unset>

	  RenewTime:       Sat, 28 Jan 2023 04:05:53 +0000

	Conditions:

	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message

	  ----             ------  -----------------                 ------------------                ------                       -------

	  MemoryPressure   False   Sat, 28 Jan 2023 04:05:55 +0000   Sat, 28 Jan 2023 04:05:52 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available

	  DiskPressure     False   Sat, 28 Jan 2023 04:05:55 +0000   Sat, 28 Jan 2023 04:05:52 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure

	  PIDPressure      False   Sat, 28 Jan 2023 04:05:55 +0000   Sat, 28 Jan 2023 04:05:52 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available

	  Ready            True    Sat, 28 Jan 2023 04:05:55 +0000   Sat, 28 Jan 2023 04:05:55 +0000   KubeletReady                 kubelet is posting ready status

	Addresses:

	  InternalIP:  192.168.64.23

	  Hostname:    cert-expiration-729000

	Capacity:

	  cpu:                2

	  ephemeral-storage:  17784752Ki

	  hugepages-2Mi:      0

	  memory:             2017572Ki

	  pods:               110

	Allocatable:

	  cpu:                2

	  ephemeral-storage:  17784752Ki

	  hugepages-2Mi:      0

	  memory:             2017572Ki

	  pods:               110

	System Info:

	  Machine ID:                 139e4a18d81a4104bb2f65dd3a7d7d81

	  System UUID:                8ab711ed-0000-0000-8fe6-149d997fca88

	  Boot ID:                    103ebed0-4a1d-40ed-9dd1-e3571ca42c78

	  Kernel Version:             5.10.57

	  OS Image:                   Buildroot 2021.02.12

	  Operating System:           linux

	  Architecture:               amd64

	  Container Runtime Version:  docker://20.10.23

	  Kubelet Version:            v1.26.1

	  Kube-Proxy Version:         v1.26.1

	Non-terminated Pods:          (4 in total)

	  Namespace                   Name                                              CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age

	  ---------                   ----                                              ------------  ----------  ---------------  -------------  ---

	  kube-system                 etcd-cert-expiration-729000                       100m (5%!)(MISSING)     0 (0%!)(MISSING)      100Mi (5%!)(MISSING)       0 (0%!)(MISSING)         3s

	  kube-system                 kube-apiserver-cert-expiration-729000             250m (12%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         3s

	  kube-system                 kube-controller-manager-cert-expiration-729000    200m (10%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         3s

	  kube-system                 kube-scheduler-cert-expiration-729000             100m (5%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         3s

	Allocated resources:

	  (Total limits may be over 100 percent, i.e., overcommitted.)

	  Resource           Requests    Limits

	  --------           --------    ------

	  cpu                650m (32%!)(MISSING)  0 (0%!)(MISSING)

	  memory             100Mi (5%!)(MISSING)  0 (0%!)(MISSING)

	  ephemeral-storage  0 (0%!)(MISSING)      0 (0%!)(MISSING)

	  hugepages-2Mi      0 (0%!)(MISSING)      0 (0%!)(MISSING)

	Events:

	  Type    Reason                   Age   From     Message

	  ----    ------                   ----  ----     -------

	  Normal  Starting                 3s    kubelet  Starting kubelet.

	  Normal  NodeAllocatableEnforced  3s    kubelet  Updated Node Allocatable limit across pods

	  Normal  NodeHasSufficientMemory  3s    kubelet  Node cert-expiration-729000 status is now: NodeHasSufficientMemory

	  Normal  NodeHasNoDiskPressure    3s    kubelet  Node cert-expiration-729000 status is now: NodeHasNoDiskPressure

	  Normal  NodeHasSufficientPID     3s    kubelet  Node cert-expiration-729000 status is now: NodeHasSufficientPID

	  Normal  NodeReady                1s    kubelet  Node cert-expiration-729000 status is now: NodeReady

	* 

	* ==> dmesg <==

	* [  +0.000001] NFSD: Unable to initialize client recovery tracking! (-2)

	[  +0.972526] systemd-fstab-generator[531]: Ignoring "noauto" for root device

	[  +0.088260] systemd-fstab-generator[542]: Ignoring "noauto" for root device

	[  +5.501415] systemd-fstab-generator[730]: Ignoring "noauto" for root device

	[  +1.234658] kauditd_printk_skb: 16 callbacks suppressed

	[  +0.214029] systemd-fstab-generator[892]: Ignoring "noauto" for root device

	[  +0.202014] systemd-fstab-generator[927]: Ignoring "noauto" for root device

	[  +0.090948] systemd-fstab-generator[938]: Ignoring "noauto" for root device

	[  +0.099109] systemd-fstab-generator[951]: Ignoring "noauto" for root device

	[  +1.312105] systemd-fstab-generator[1100]: Ignoring "noauto" for root device

	[  +0.081311] systemd-fstab-generator[1111]: Ignoring "noauto" for root device

	[  +0.097154] systemd-fstab-generator[1122]: Ignoring "noauto" for root device

	[  +0.088567] systemd-fstab-generator[1133]: Ignoring "noauto" for root device

	[Jan28 04:05] systemd-fstab-generator[1289]: Ignoring "noauto" for root device

	[  +0.167442] systemd-fstab-generator[1321]: Ignoring "noauto" for root device

	[  +0.092339] systemd-fstab-generator[1332]: Ignoring "noauto" for root device

	[  +0.105251] systemd-fstab-generator[1345]: Ignoring "noauto" for root device

	[  +1.175498] kauditd_printk_skb: 68 callbacks suppressed

	[  +0.136199] systemd-fstab-generator[1492]: Ignoring "noauto" for root device

	[  +0.088589] systemd-fstab-generator[1503]: Ignoring "noauto" for root device

	[  +0.079662] systemd-fstab-generator[1514]: Ignoring "noauto" for root device

	[  +0.092603] systemd-fstab-generator[1525]: Ignoring "noauto" for root device

	[  +4.271616] systemd-fstab-generator[1776]: Ignoring "noauto" for root device

	[  +0.421234] kauditd_printk_skb: 29 callbacks suppressed

	[ +13.790743] systemd-fstab-generator[2536]: Ignoring "noauto" for root device

	* 

	* ==> etcd [5fac51758de6] <==

	* {"level":"info","ts":"2023-01-28T04:05:45.727Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"358a38a4be5dda21 switched to configuration voters=(3857958311015864865)"}

	{"level":"info","ts":"2023-01-28T04:05:45.727Z","caller":"membership/cluster.go:421","msg":"added member","cluster-id":"bf21a475ce91bca1","local-member-id":"358a38a4be5dda21","added-peer-id":"358a38a4be5dda21","added-peer-peer-urls":["https://192.168.64.23:2380"]}

	{"level":"info","ts":"2023-01-28T04:05:45.739Z","caller":"embed/etcd.go:687","msg":"starting with client TLS","tls-info":"cert = /var/lib/minikube/certs/etcd/server.crt, key = /var/lib/minikube/certs/etcd/server.key, client-cert=, client-key=, trusted-ca = /var/lib/minikube/certs/etcd/ca.crt, client-cert-auth = true, crl-file = ","cipher-suites":[]}

	{"level":"info","ts":"2023-01-28T04:05:45.739Z","caller":"embed/etcd.go:275","msg":"now serving peer/client/metrics","local-member-id":"358a38a4be5dda21","initial-advertise-peer-urls":["https://192.168.64.23:2380"],"listen-peer-urls":["https://192.168.64.23:2380"],"advertise-client-urls":["https://192.168.64.23:2379"],"listen-client-urls":["https://127.0.0.1:2379","https://192.168.64.23:2379"],"listen-metrics-urls":["http://127.0.0.1:2381"]}

	{"level":"info","ts":"2023-01-28T04:05:45.740Z","caller":"embed/etcd.go:762","msg":"serving metrics","address":"http://127.0.0.1:2381"}

	{"level":"info","ts":"2023-01-28T04:05:45.742Z","caller":"embed/etcd.go:586","msg":"serving peer traffic","address":"192.168.64.23:2380"}

	{"level":"info","ts":"2023-01-28T04:05:45.742Z","caller":"embed/etcd.go:558","msg":"cmux::serve","address":"192.168.64.23:2380"}

	{"level":"info","ts":"2023-01-28T04:05:46.110Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"358a38a4be5dda21 is starting a new election at term 1"}

	{"level":"info","ts":"2023-01-28T04:05:46.110Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"358a38a4be5dda21 became pre-candidate at term 1"}

	{"level":"info","ts":"2023-01-28T04:05:46.110Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"358a38a4be5dda21 received MsgPreVoteResp from 358a38a4be5dda21 at term 1"}

	{"level":"info","ts":"2023-01-28T04:05:46.110Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"358a38a4be5dda21 became candidate at term 2"}

	{"level":"info","ts":"2023-01-28T04:05:46.110Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"358a38a4be5dda21 received MsgVoteResp from 358a38a4be5dda21 at term 2"}

	{"level":"info","ts":"2023-01-28T04:05:46.110Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"358a38a4be5dda21 became leader at term 2"}

	{"level":"info","ts":"2023-01-28T04:05:46.110Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"raft.node: 358a38a4be5dda21 elected leader 358a38a4be5dda21 at term 2"}

	{"level":"info","ts":"2023-01-28T04:05:46.115Z","caller":"etcdserver/server.go:2054","msg":"published local member to cluster through raft","local-member-id":"358a38a4be5dda21","local-member-attributes":"{Name:cert-expiration-729000 ClientURLs:[https://192.168.64.23:2379]}","request-path":"/0/members/358a38a4be5dda21/attributes","cluster-id":"bf21a475ce91bca1","publish-timeout":"7s"}

	{"level":"info","ts":"2023-01-28T04:05:46.115Z","caller":"embed/serve.go:100","msg":"ready to serve client requests"}

	{"level":"info","ts":"2023-01-28T04:05:46.116Z","caller":"embed/serve.go:198","msg":"serving client traffic securely","address":"192.168.64.23:2379"}

	{"level":"info","ts":"2023-01-28T04:05:46.116Z","caller":"etcdserver/server.go:2563","msg":"setting up initial cluster version using v2 API","cluster-version":"3.5"}

	{"level":"info","ts":"2023-01-28T04:05:46.116Z","caller":"embed/serve.go:100","msg":"ready to serve client requests"}

	{"level":"info","ts":"2023-01-28T04:05:46.117Z","caller":"embed/serve.go:198","msg":"serving client traffic securely","address":"127.0.0.1:2379"}

	{"level":"info","ts":"2023-01-28T04:05:46.119Z","caller":"etcdmain/main.go:44","msg":"notifying init daemon"}

	{"level":"info","ts":"2023-01-28T04:05:46.123Z","caller":"etcdmain/main.go:50","msg":"successfully notified init daemon"}

	{"level":"info","ts":"2023-01-28T04:05:46.124Z","caller":"membership/cluster.go:584","msg":"set initial cluster version","cluster-id":"bf21a475ce91bca1","local-member-id":"358a38a4be5dda21","cluster-version":"3.5"}

	{"level":"info","ts":"2023-01-28T04:05:46.124Z","caller":"api/capability.go:75","msg":"enabled capabilities for version","cluster-version":"3.5"}

	{"level":"info","ts":"2023-01-28T04:05:46.124Z","caller":"etcdserver/server.go:2587","msg":"cluster version is updated","cluster-version":"3.5"}

	* 

	* ==> kernel <==

	*  04:05:57 up 3 min,  0 users,  load average: 0.42, 0.12, 0.03

	Linux cert-expiration-729000 5.10.57 #1 SMP Sat Jan 28 02:15:18 UTC 2023 x86_64 GNU/Linux

	PRETTY_NAME="Buildroot 2021.02.12"

	* 

	* ==> kube-apiserver [e90861c32233] <==

	* I0128 04:05:48.595703       1 controller.go:615] quota admission added evaluator for: namespaces

	I0128 04:05:48.614923       1 cache.go:39] Caches are synced for autoregister controller

	I0128 04:05:48.615279       1 cache.go:39] Caches are synced for AvailableConditionController controller

	I0128 04:05:48.616243       1 shared_informer.go:280] Caches are synced for configmaps

	I0128 04:05:48.616973       1 apf_controller.go:366] Running API Priority and Fairness config worker

	I0128 04:05:48.617049       1 apf_controller.go:369] Running API Priority and Fairness periodic rebalancing process

	I0128 04:05:48.617136       1 shared_informer.go:280] Caches are synced for crd-autoregister

	I0128 04:05:48.619213       1 cache.go:39] Caches are synced for APIServiceRegistrationController controller

	I0128 04:05:48.619306       1 shared_informer.go:280] Caches are synced for cluster_authentication_trust_controller

	I0128 04:05:48.644426       1 controller.go:615] quota admission added evaluator for: leases.coordination.k8s.io

	I0128 04:05:48.656786       1 shared_informer.go:280] Caches are synced for node_authorizer

	I0128 04:05:49.319314       1 controller.go:132] OpenAPI AggregationController: action for item k8s_internal_local_delegation_chain_0000000000: Nothing (removed from the queue).

	I0128 04:05:49.520112       1 storage_scheduling.go:95] created PriorityClass system-node-critical with value 2000001000

	I0128 04:05:49.527916       1 storage_scheduling.go:95] created PriorityClass system-cluster-critical with value 2000000000

	I0128 04:05:49.527949       1 storage_scheduling.go:111] all system priority classes are created successfully or already exist.

	I0128 04:05:49.839985       1 controller.go:615] quota admission added evaluator for: roles.rbac.authorization.k8s.io

	I0128 04:05:49.861833       1 controller.go:615] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io

	I0128 04:05:49.910412       1 alloc.go:327] "allocated clusterIPs" service="default/kubernetes" clusterIPs=map[IPv4:10.96.0.1]

	W0128 04:05:49.916919       1 lease.go:251] Resetting endpoints for master service "kubernetes" to [192.168.64.23]

	I0128 04:05:49.917742       1 controller.go:615] quota admission added evaluator for: endpoints

	I0128 04:05:49.920179       1 controller.go:615] quota admission added evaluator for: endpointslices.discovery.k8s.io

	I0128 04:05:50.574873       1 controller.go:615] quota admission added evaluator for: serviceaccounts

	I0128 04:05:53.660454       1 controller.go:615] quota admission added evaluator for: deployments.apps

	I0128 04:05:53.667353       1 alloc.go:327] "allocated clusterIPs" service="kube-system/kube-dns" clusterIPs=map[IPv4:10.96.0.10]

	I0128 04:05:53.675800       1 controller.go:615] quota admission added evaluator for: daemonsets.apps

	* 

	* ==> kube-controller-manager [ee29e39c94dd] <==

	* I0128 04:05:50.582791       1 cronjob_controllerv2.go:137] "Starting cronjob controller v2"

	I0128 04:05:50.583297       1 shared_informer.go:273] Waiting for caches to sync for cronjob

	I0128 04:05:50.588319       1 controllermanager.go:622] Started "csrapproving"

	I0128 04:05:50.588575       1 certificate_controller.go:112] Starting certificate controller "csrapproving"

	I0128 04:05:50.588658       1 shared_informer.go:273] Waiting for caches to sync for certificate-csrapproving

	I0128 04:05:50.590188       1 controllermanager.go:622] Started "csrcleaner"

	I0128 04:05:50.590199       1 cleaner.go:82] Starting CSR cleaner controller

	I0128 04:05:50.596558       1 node_lifecycle_controller.go:492] Controller will reconcile labels.

	I0128 04:05:50.596604       1 controllermanager.go:622] Started "nodelifecycle"

	I0128 04:05:50.596833       1 node_lifecycle_controller.go:527] Sending events to api server.

	I0128 04:05:50.596866       1 node_lifecycle_controller.go:538] Starting node controller

	I0128 04:05:50.596872       1 shared_informer.go:273] Waiting for caches to sync for taint

	I0128 04:05:50.602075       1 controllermanager.go:622] Started "podgc"

	I0128 04:05:50.602279       1 gc_controller.go:102] Starting GC controller

	I0128 04:05:50.602307       1 shared_informer.go:273] Waiting for caches to sync for GC

	I0128 04:05:50.607603       1 controllermanager.go:622] Started "serviceaccount"

	I0128 04:05:50.607801       1 serviceaccounts_controller.go:111] Starting service account controller

	I0128 04:05:50.607830       1 shared_informer.go:273] Waiting for caches to sync for service account

	I0128 04:05:50.613104       1 controllermanager.go:622] Started "replicaset"

	I0128 04:05:50.613413       1 replica_set.go:201] Starting replicaset controller

	I0128 04:05:50.613421       1 shared_informer.go:273] Waiting for caches to sync for ReplicaSet

	I0128 04:05:50.619157       1 controllermanager.go:622] Started "persistentvolume-binder"

	I0128 04:05:50.619699       1 pv_controller_base.go:318] Starting persistent volume controller

	I0128 04:05:50.619726       1 shared_informer.go:273] Waiting for caches to sync for persistent volume

	I0128 04:05:50.670200       1 shared_informer.go:280] Caches are synced for tokens

	* 

	* ==> kube-scheduler [ef2d7d5804f0] <==

	* W0128 04:05:48.604286       1 reflector.go:424] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope

	E0128 04:05:48.604294       1 reflector.go:140] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope

	W0128 04:05:48.605697       1 reflector.go:424] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope

	E0128 04:05:48.605753       1 reflector.go:140] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope

	W0128 04:05:48.605933       1 reflector.go:424] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope

	E0128 04:05:48.605984       1 reflector.go:140] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope

	W0128 04:05:48.606062       1 reflector.go:424] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope

	E0128 04:05:48.606108       1 reflector.go:140] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope

	W0128 04:05:48.606151       1 reflector.go:424] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope

	E0128 04:05:48.606196       1 reflector.go:140] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope

	W0128 04:05:48.606267       1 reflector.go:424] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope

	E0128 04:05:48.606315       1 reflector.go:140] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope

	W0128 04:05:49.508724       1 reflector.go:424] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope

	E0128 04:05:49.508800       1 reflector.go:140] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope

	W0128 04:05:49.518012       1 reflector.go:424] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope

	E0128 04:05:49.518085       1 reflector.go:140] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope

	W0128 04:05:49.580469       1 reflector.go:424] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope

	E0128 04:05:49.580567       1 reflector.go:140] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope

	W0128 04:05:49.613964       1 reflector.go:424] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope

	E0128 04:05:49.614001       1 reflector.go:140] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope

	W0128 04:05:49.651546       1 reflector.go:424] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope

	E0128 04:05:49.651616       1 reflector.go:140] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope

	W0128 04:05:49.700131       1 reflector.go:424] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope

	E0128 04:05:49.700167       1 reflector.go:140] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope

	I0128 04:05:49.995064       1 shared_informer.go:280] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file

	* 

	* ==> kubelet <==

	* -- Journal begins at Sat 2023-01-28 04:02:18 UTC, ends at Sat 2023-01-28 04:05:57 UTC. --

	Jan 28 04:05:54 cert-expiration-729000 kubelet[2556]: I0128 04:05:54.064103    2556 reconciler_common.go:253] "operationExecutor.VerifyControllerAttachedVolume started for volume \"k8s-certs\" (UniqueName: \"kubernetes.io/host-path/e1bcb52bd06bfd5e74451adc84cc53e8-k8s-certs\") pod \"kube-controller-manager-cert-expiration-729000\" (UID: \"e1bcb52bd06bfd5e74451adc84cc53e8\") " pod="kube-system/kube-controller-manager-cert-expiration-729000"

	Jan 28 04:05:54 cert-expiration-729000 kubelet[2556]: I0128 04:05:54.064191    2556 reconciler_common.go:253] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubeconfig\" (UniqueName: \"kubernetes.io/host-path/bf4ae35f72ae3f906ee969eaec31c6b5-kubeconfig\") pod \"kube-scheduler-cert-expiration-729000\" (UID: \"bf4ae35f72ae3f906ee969eaec31c6b5\") " pod="kube-system/kube-scheduler-cert-expiration-729000"

	Jan 28 04:05:54 cert-expiration-729000 kubelet[2556]: I0128 04:05:54.064213    2556 reconciler_common.go:253] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etcd-data\" (UniqueName: \"kubernetes.io/host-path/777e73f7ad1ac012089ecaaa2fcbabab-etcd-data\") pod \"etcd-cert-expiration-729000\" (UID: \"777e73f7ad1ac012089ecaaa2fcbabab\") " pod="kube-system/etcd-cert-expiration-729000"

	Jan 28 04:05:54 cert-expiration-729000 kubelet[2556]: I0128 04:05:54.064232    2556 reconciler_common.go:253] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-certs\" (UniqueName: \"kubernetes.io/host-path/3f7b59a0f3e7bb502743e8d8e38b7d9a-ca-certs\") pod \"kube-apiserver-cert-expiration-729000\" (UID: \"3f7b59a0f3e7bb502743e8d8e38b7d9a\") " pod="kube-system/kube-apiserver-cert-expiration-729000"

	Jan 28 04:05:54 cert-expiration-729000 kubelet[2556]: I0128 04:05:54.064252    2556 reconciler_common.go:253] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-certs\" (UniqueName: \"kubernetes.io/host-path/e1bcb52bd06bfd5e74451adc84cc53e8-ca-certs\") pod \"kube-controller-manager-cert-expiration-729000\" (UID: \"e1bcb52bd06bfd5e74451adc84cc53e8\") " pod="kube-system/kube-controller-manager-cert-expiration-729000"

	Jan 28 04:05:54 cert-expiration-729000 kubelet[2556]: I0128 04:05:54.064313    2556 reconciler_common.go:253] "operationExecutor.VerifyControllerAttachedVolume started for volume \"flexvolume-dir\" (UniqueName: \"kubernetes.io/host-path/e1bcb52bd06bfd5e74451adc84cc53e8-flexvolume-dir\") pod \"kube-controller-manager-cert-expiration-729000\" (UID: \"e1bcb52bd06bfd5e74451adc84cc53e8\") " pod="kube-system/kube-controller-manager-cert-expiration-729000"

	Jan 28 04:05:54 cert-expiration-729000 kubelet[2556]: I0128 04:05:54.064400    2556 reconciler_common.go:253] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubeconfig\" (UniqueName: \"kubernetes.io/host-path/e1bcb52bd06bfd5e74451adc84cc53e8-kubeconfig\") pod \"kube-controller-manager-cert-expiration-729000\" (UID: \"e1bcb52bd06bfd5e74451adc84cc53e8\") " pod="kube-system/kube-controller-manager-cert-expiration-729000"

	Jan 28 04:05:54 cert-expiration-729000 kubelet[2556]: I0128 04:05:54.064424    2556 reconciler_common.go:253] "operationExecutor.VerifyControllerAttachedVolume started for volume \"usr-share-ca-certificates\" (UniqueName: \"kubernetes.io/host-path/e1bcb52bd06bfd5e74451adc84cc53e8-usr-share-ca-certificates\") pod \"kube-controller-manager-cert-expiration-729000\" (UID: \"e1bcb52bd06bfd5e74451adc84cc53e8\") " pod="kube-system/kube-controller-manager-cert-expiration-729000"

	Jan 28 04:05:54 cert-expiration-729000 kubelet[2556]: I0128 04:05:54.064445    2556 reconciler_common.go:253] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etcd-certs\" (UniqueName: \"kubernetes.io/host-path/777e73f7ad1ac012089ecaaa2fcbabab-etcd-certs\") pod \"etcd-cert-expiration-729000\" (UID: \"777e73f7ad1ac012089ecaaa2fcbabab\") " pod="kube-system/etcd-cert-expiration-729000"

	Jan 28 04:05:54 cert-expiration-729000 kubelet[2556]: I0128 04:05:54.064463    2556 reconciler_common.go:253] "operationExecutor.VerifyControllerAttachedVolume started for volume \"k8s-certs\" (UniqueName: \"kubernetes.io/host-path/3f7b59a0f3e7bb502743e8d8e38b7d9a-k8s-certs\") pod \"kube-apiserver-cert-expiration-729000\" (UID: \"3f7b59a0f3e7bb502743e8d8e38b7d9a\") " pod="kube-system/kube-apiserver-cert-expiration-729000"

	Jan 28 04:05:54 cert-expiration-729000 kubelet[2556]: I0128 04:05:54.064528    2556 reconciler_common.go:253] "operationExecutor.VerifyControllerAttachedVolume started for volume \"usr-share-ca-certificates\" (UniqueName: \"kubernetes.io/host-path/3f7b59a0f3e7bb502743e8d8e38b7d9a-usr-share-ca-certificates\") pod \"kube-apiserver-cert-expiration-729000\" (UID: \"3f7b59a0f3e7bb502743e8d8e38b7d9a\") " pod="kube-system/kube-apiserver-cert-expiration-729000"

	Jan 28 04:05:54 cert-expiration-729000 kubelet[2556]: E0128 04:05:54.149999    2556 kubelet.go:1802] "Failed creating a mirror pod for" err="pods \"kube-scheduler-cert-expiration-729000\" already exists" pod="kube-system/kube-scheduler-cert-expiration-729000"

	Jan 28 04:05:54 cert-expiration-729000 kubelet[2556]: I0128 04:05:54.551571    2556 kubelet_node_status.go:108] "Node was previously registered" node="cert-expiration-729000"

	Jan 28 04:05:54 cert-expiration-729000 kubelet[2556]: I0128 04:05:54.551670    2556 kubelet_node_status.go:73] "Successfully registered node" node="cert-expiration-729000"

	Jan 28 04:05:54 cert-expiration-729000 kubelet[2556]: I0128 04:05:54.747578    2556 apiserver.go:52] "Watching apiserver"

	Jan 28 04:05:54 cert-expiration-729000 kubelet[2556]: I0128 04:05:54.963777    2556 desired_state_of_world_populator.go:159] "Finished populating initial desired state of world"

	Jan 28 04:05:54 cert-expiration-729000 kubelet[2556]: I0128 04:05:54.979374    2556 reconciler.go:41] "Reconciler: start to sync state"

	Jan 28 04:05:55 cert-expiration-729000 kubelet[2556]: I0128 04:05:55.283585    2556 kubelet_node_status.go:493] "Fast updating node status as it just became ready"

	Jan 28 04:05:55 cert-expiration-729000 kubelet[2556]: E0128 04:05:55.350447    2556 kubelet.go:1802] "Failed creating a mirror pod for" err="pods \"kube-apiserver-cert-expiration-729000\" already exists" pod="kube-system/kube-apiserver-cert-expiration-729000"

	Jan 28 04:05:55 cert-expiration-729000 kubelet[2556]: E0128 04:05:55.549473    2556 kubelet.go:1802] "Failed creating a mirror pod for" err="pods \"kube-scheduler-cert-expiration-729000\" already exists" pod="kube-system/kube-scheduler-cert-expiration-729000"

	Jan 28 04:05:55 cert-expiration-729000 kubelet[2556]: E0128 04:05:55.747387    2556 kubelet.go:1802] "Failed creating a mirror pod for" err="pods \"etcd-cert-expiration-729000\" already exists" pod="kube-system/etcd-cert-expiration-729000"

	Jan 28 04:05:55 cert-expiration-729000 kubelet[2556]: I0128 04:05:55.946415    2556 request.go:690] Waited for 1.08926386s due to client-side throttling, not priority and fairness, request: POST:https://control-plane.minikube.internal:8443/api/v1/namespaces/kube-system/pods

	Jan 28 04:05:56 cert-expiration-729000 kubelet[2556]: E0128 04:05:56.002997    2556 kubelet.go:1802] "Failed creating a mirror pod for" err="pods \"kube-controller-manager-cert-expiration-729000\" already exists" pod="kube-system/kube-controller-manager-cert-expiration-729000"

	Jan 28 04:05:56 cert-expiration-729000 kubelet[2556]: I0128 04:05:56.547651    2556 pod_startup_latency_tracker.go:102] "Observed pod startup duration" pod="kube-system/kube-scheduler-cert-expiration-729000" podStartSLOduration=3.5476181650000003 pod.CreationTimestamp="2023-01-28 04:05:53 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2023-01-28 04:05:56.210086978 +0000 UTC m=+2.565195159" watchObservedRunningTime="2023-01-28 04:05:56.547618165 +0000 UTC m=+2.902726329"

	Jan 28 04:05:56 cert-expiration-729000 kubelet[2556]: I0128 04:05:56.996747    2556 pod_startup_latency_tracker.go:102] "Observed pod startup duration" pod="kube-system/kube-apiserver-cert-expiration-729000" podStartSLOduration=3.996717603 pod.CreationTimestamp="2023-01-28 04:05:53 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2023-01-28 04:05:56.548333387 +0000 UTC m=+2.903441558" watchObservedRunningTime="2023-01-28 04:05:56.996717603 +0000 UTC m=+3.351825783"

-- /stdout --

helpers_test.go:254: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.APIServer}} -p cert-expiration-729000 -n cert-expiration-729000

helpers_test.go:261: (dbg) Run:  kubectl --context cert-expiration-729000 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running

helpers_test.go:272: non-running pods: kube-controller-manager-cert-expiration-729000 storage-provisioner

helpers_test.go:274: ======> post-mortem[TestCertExpiration]: describe non-running pods <======

helpers_test.go:277: (dbg) Run:  kubectl --context cert-expiration-729000 describe pod kube-controller-manager-cert-expiration-729000 storage-provisioner

helpers_test.go:277: (dbg) Non-zero exit: kubectl --context cert-expiration-729000 describe pod kube-controller-manager-cert-expiration-729000 storage-provisioner: exit status 1 (47.282937ms)

** stderr ** 

	Error from server (NotFound): pods "kube-controller-manager-cert-expiration-729000" not found

	Error from server (NotFound): pods "storage-provisioner" not found

** /stderr **

helpers_test.go:279: kubectl --context cert-expiration-729000 describe pod kube-controller-manager-cert-expiration-729000 storage-provisioner: exit status 1

helpers_test.go:175: Cleaning up "cert-expiration-729000" profile ...

helpers_test.go:178: (dbg) Run:  out/minikube-darwin-amd64 delete -p cert-expiration-729000

=== CONT  TestCertExpiration

helpers_test.go:178: (dbg) Done: out/minikube-darwin-amd64 delete -p cert-expiration-729000: (5.274928332s)

--- FAIL: TestCertExpiration (232.10s)

=== RUN   TestErrorSpam/setup

error_spam_test.go:81: (dbg) Run:  out/minikube-darwin-amd64 start -p nospam-259000 -n=1 --memory=2250 --wait=false --log_dir=/var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-259000 --driver=hyperkit 

error_spam_test.go:81: (dbg) Done: out/minikube-darwin-amd64 start -p nospam-259000 -n=1 --memory=2250 --wait=false --log_dir=/var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-259000 --driver=hyperkit : (39.384446808s)

error_spam_test.go:96: unexpected stderr: "! Image was not built for the current minikube version. To resolve this you can delete and recreate your minikube cluster using the latest images. Expected minikube version: v1.29.0-1674856271-15565 -> Actual minikube version: v1.28.0"

error_spam_test.go:110: minikube stdout:

* [nospam-259000] minikube v1.28.0 on Darwin 13.2

- MINIKUBE_LOCATION=15565

- KUBECONFIG=/Users/jenkins/minikube-integration/15565-3235/kubeconfig

- MINIKUBE_BIN=out/minikube-darwin-amd64

- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

- MINIKUBE_HOME=/Users/jenkins/minikube-integration/15565-3235/.minikube

- MINIKUBE_FORCE_SYSTEMD=

* Using the hyperkit driver based on user configuration

* Starting control plane node nospam-259000 in cluster nospam-259000

* Creating hyperkit VM (CPUs=2, Memory=2250MB, Disk=20000MB) ...

* Preparing Kubernetes v1.26.1 on Docker 20.10.23 ...

- Generating certificates and keys ...

- Booting up control plane ...

- Configuring RBAC rules ...

* Configuring bridge CNI (Container Networking Interface) ...

- Using image gcr.io/k8s-minikube/storage-provisioner:v5

* Verifying Kubernetes components...

* Enabled addons: storage-provisioner, default-storageclass

* Done! kubectl is now configured to use "nospam-259000" cluster and "default" namespace by default

error_spam_test.go:111: minikube stderr:

! Image was not built for the current minikube version. To resolve this you can delete and recreate your minikube cluster using the latest images. Expected minikube version: v1.29.0-1674856271-15565 -> Actual minikube version: v1.28.0

--- FAIL: TestErrorSpam/setup (39.38s)

=== RUN   TestImageBuild

image_test.go:40: (dbg) Run:  out/minikube-darwin-amd64 start -p image-051000 --driver=hyperkit 

E0127 19:40:30.972768    4442 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/15565-3235/.minikube/profiles/addons-113000/client.crt: no such file or directory

image_test.go:40: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p image-051000 --driver=hyperkit : exit status 90 (1m21.614348461s)

-- stdout --

	* [image-051000] minikube v1.28.0 on Darwin 13.2

	  - MINIKUBE_LOCATION=15565

	  - KUBECONFIG=/Users/jenkins/minikube-integration/15565-3235/kubeconfig

	  - MINIKUBE_BIN=out/minikube-darwin-amd64

	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/15565-3235/.minikube

	  - MINIKUBE_FORCE_SYSTEMD=

	* Using the hyperkit driver based on user configuration

	* Starting control plane node image-051000 in cluster image-051000

	* Creating hyperkit VM (CPUs=2, Memory=6000MB, Disk=20000MB) ...

-- /stdout --

** stderr ** 

	! Image was not built for the current minikube version. To resolve this you can delete and recreate your minikube cluster using the latest images. Expected minikube version: v1.29.0-1674856271-15565 -> Actual minikube version: v1.28.0

	X Exiting due to RUNTIME_ENABLE: sudo systemctl restart docker: Process exited with status 1

	stdout:

	stderr:

	Job for docker.service failed because the control process exited with error code.

	See "systemctl status docker.service" and "journalctl -xe" for details.

	* 

	╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

** /stderr **

image_test.go:43: failed to start minikube with args: "out/minikube-darwin-amd64 start -p image-051000 --driver=hyperkit " : exit status 90

helpers_test.go:175: Cleaning up "image-051000" profile ...

helpers_test.go:178: (dbg) Run:  out/minikube-darwin-amd64 delete -p image-051000

helpers_test.go:178: (dbg) Done: out/minikube-darwin-amd64 delete -p image-051000: (5.280036687s)

--- FAIL: TestImageBuild (86.89s)

=== RUN   TestNetworkPlugins/group/auto/Start

net_test.go:111: (dbg) Run:  out/minikube-darwin-amd64 start -p auto-035000 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --driver=hyperkit 

=== CONT  TestNetworkPlugins/group/auto/Start

net_test.go:111: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p auto-035000 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --driver=hyperkit : exit status 90 (20.814809076s)

-- stdout --

	* [auto-035000] minikube v1.28.0 on Darwin 13.2

	  - MINIKUBE_LOCATION=15565

	  - KUBECONFIG=/Users/jenkins/minikube-integration/15565-3235/kubeconfig

	  - MINIKUBE_BIN=out/minikube-darwin-amd64

	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/15565-3235/.minikube

	  - MINIKUBE_FORCE_SYSTEMD=

	* Using the hyperkit driver based on user configuration

	* Starting control plane node auto-035000 in cluster auto-035000

	* Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...

-- /stdout --

** stderr ** 

	I0127 20:10:26.564793   10821 out.go:296] Setting OutFile to fd 1 ...

	I0127 20:10:26.565058   10821 out.go:343] TERM=,COLORTERM=, which probably does not support color

	I0127 20:10:26.565064   10821 out.go:309] Setting ErrFile to fd 2...

	I0127 20:10:26.565068   10821 out.go:343] TERM=,COLORTERM=, which probably does not support color

	I0127 20:10:26.565184   10821 root.go:334] Updating PATH: /Users/jenkins/minikube-integration/15565-3235/.minikube/bin

	I0127 20:10:26.565721   10821 out.go:303] Setting JSON to false

	I0127 20:10:26.585736   10821 start.go:125] hostinfo: {"hostname":"MacOS-Agent-4.local","uptime":4201,"bootTime":1674874825,"procs":414,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"13.2","kernelVersion":"22.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"f2f27e25-cfda-5ffd-9706-e98286194e62"}

	W0127 20:10:26.585835   10821 start.go:133] gopshost.Virtualization returned error: not implemented yet

	I0127 20:10:26.608351   10821 out.go:177] * [auto-035000] minikube v1.28.0 on Darwin 13.2

	I0127 20:10:26.655865   10821 notify.go:220] Checking for updates...

	I0127 20:10:26.720839   10821 out.go:177]   - MINIKUBE_LOCATION=15565

	I0127 20:10:26.783943   10821 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/15565-3235/kubeconfig

	I0127 20:10:26.825936   10821 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64

	I0127 20:10:26.913070   10821 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I0127 20:10:26.975808   10821 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/15565-3235/.minikube

	I0127 20:10:27.022860   10821 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=

	I0127 20:10:27.044892   10821 config.go:180] Loaded profile config "NoKubernetes-182000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v0.0.0

	I0127 20:10:27.045014   10821 driver.go:365] Setting default libvirt URI to qemu:///system

	I0127 20:10:27.110961   10821 out.go:177] * Using the hyperkit driver based on user configuration

	I0127 20:10:27.133838   10821 start.go:296] selected driver: hyperkit

	I0127 20:10:27.133866   10821 start.go:840] validating driver "hyperkit" against <nil>

	I0127 20:10:27.133881   10821 start.go:851] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}

	I0127 20:10:27.136543   10821 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0127 20:10:27.136655   10821 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/15565-3235/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin

	I0127 20:10:27.143333   10821 install.go:137] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit version is 1.28.0

	I0127 20:10:27.146588   10821 install.go:79] stdout: /Users/jenkins/workspace/out/docker-machine-driver-hyperkit

	I0127 20:10:27.146608   10821 install.go:81] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit looks good

	I0127 20:10:27.146647   10821 start_flags.go:305] no existing cluster config was found, will generate one from the flags 

	I0127 20:10:27.146801   10821 start_flags.go:917] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]

	I0127 20:10:27.146830   10821 cni.go:84] Creating CNI manager for ""

	I0127 20:10:27.146847   10821 cni.go:157] "hyperkit" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge

	I0127 20:10:27.146852   10821 start_flags.go:314] Found "bridge CNI" CNI - setting NetworkPlugin=cni

	I0127 20:10:27.146865   10821 start_flags.go:319] config:

	{Name:auto-035000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.36-1674164627-15541@sha256:0a2280301e955e0d3910d6e639e0b7341db1f4a25558521ac97b38c782c6189a Memory:3072 CPUs:2 DiskSize:20000 VMDriver: Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.26.1 ClusterName:auto-035000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRI

Socket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP:}

	I0127 20:10:27.146961   10821 iso.go:125] acquiring lock: {Name:mkeeb6f52f7fa0577f04180383dbb7ed67f33d88 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0127 20:10:27.188681   10821 out.go:177] * Starting control plane node auto-035000 in cluster auto-035000

	I0127 20:10:27.209884   10821 preload.go:132] Checking if preload exists for k8s version v1.26.1 and runtime docker

	I0127 20:10:27.209947   10821 preload.go:148] Found local preload: /Users/jenkins/minikube-integration/15565-3235/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.26.1-docker-overlay2-amd64.tar.lz4

	I0127 20:10:27.209968   10821 cache.go:57] Caching tarball of preloaded images

	I0127 20:10:27.210105   10821 preload.go:174] Found /Users/jenkins/minikube-integration/15565-3235/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.26.1-docker-overlay2-amd64.tar.lz4 in cache, skipping download

	I0127 20:10:27.210114   10821 cache.go:60] Finished verifying existence of preloaded tar for  v1.26.1 on docker

	I0127 20:10:27.210217   10821 profile.go:148] Saving config to /Users/jenkins/minikube-integration/15565-3235/.minikube/profiles/auto-035000/config.json ...

	I0127 20:10:27.210248   10821 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/15565-3235/.minikube/profiles/auto-035000/config.json: {Name:mke545a8520bb64ac2264bd19e643dbcdbaa09cd Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0127 20:10:27.210482   10821 cache.go:193] Successfully downloaded all kic artifacts

	I0127 20:10:27.210509   10821 start.go:364] acquiring machines lock for auto-035000: {Name:mk69c04a34b14d26e3f74e414bcb566a33d5b215 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0127 20:10:27.210558   10821 start.go:368] acquired machines lock for "auto-035000" in 39.89µs

	I0127 20:10:27.210581   10821 start.go:93] Provisioning new machine with config: &{Name:auto-035000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/15565/minikube-v1.29.0-1674856271-15565-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.36-1674164627-15541@sha256:0a2280301e955e0d3910d6e639e0b7341db1f4a25558521ac97b38c782c6189a Memory:3072 CPUs:2 DiskSize:20000 VMDriver: Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConf

ig:{KubernetesVersion:v1.26.1 ClusterName:auto-035000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.26.1 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOpt

ions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP:} &{Name: IP: Port:8443 KubernetesVersion:v1.26.1 ContainerRuntime:docker ControlPlane:true Worker:true}

	I0127 20:10:27.210643   10821 start.go:125] createHost starting for "" (driver="hyperkit")

	I0127 20:10:27.235838   10821 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...

	I0127 20:10:27.236124   10821 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit

	I0127 20:10:27.236165   10821 main.go:141] libmachine: Launching plugin server for driver hyperkit

	I0127 20:10:27.243436   10821 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:53238

	I0127 20:10:27.243842   10821 main.go:141] libmachine: () Calling .GetVersion

	I0127 20:10:27.244236   10821 main.go:141] libmachine: Using API Version  1

	I0127 20:10:27.244256   10821 main.go:141] libmachine: () Calling .SetConfigRaw

	I0127 20:10:27.244464   10821 main.go:141] libmachine: () Calling .GetMachineName

	I0127 20:10:27.244578   10821 main.go:141] libmachine: (auto-035000) Calling .GetMachineName

	I0127 20:10:27.244671   10821 main.go:141] libmachine: (auto-035000) Calling .DriverName

	I0127 20:10:27.244771   10821 start.go:159] libmachine.API.Create for "auto-035000" (driver="hyperkit")

	I0127 20:10:27.244794   10821 client.go:168] LocalClient.Create starting

	I0127 20:10:27.244827   10821 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/15565-3235/.minikube/certs/ca.pem

	I0127 20:10:27.244876   10821 main.go:141] libmachine: Decoding PEM data...

	I0127 20:10:27.244889   10821 main.go:141] libmachine: Parsing certificate...

	I0127 20:10:27.244944   10821 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/15565-3235/.minikube/certs/cert.pem

	I0127 20:10:27.244977   10821 main.go:141] libmachine: Decoding PEM data...

	I0127 20:10:27.244990   10821 main.go:141] libmachine: Parsing certificate...

	I0127 20:10:27.245003   10821 main.go:141] libmachine: Running pre-create checks...

	I0127 20:10:27.245016   10821 main.go:141] libmachine: (auto-035000) Calling .PreCreateCheck

	I0127 20:10:27.245091   10821 main.go:141] libmachine: (auto-035000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0

	I0127 20:10:27.245278   10821 main.go:141] libmachine: (auto-035000) Calling .GetConfigRaw

	I0127 20:10:27.245695   10821 main.go:141] libmachine: Creating machine...

	I0127 20:10:27.245704   10821 main.go:141] libmachine: (auto-035000) Calling .Create

	I0127 20:10:27.245778   10821 main.go:141] libmachine: (auto-035000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0

	I0127 20:10:27.245909   10821 main.go:141] libmachine: (auto-035000) DBG | I0127 20:10:27.245774   10835 common.go:116] Making disk image using store path: /Users/jenkins/minikube-integration/15565-3235/.minikube

	I0127 20:10:27.245977   10821 main.go:141] libmachine: (auto-035000) Downloading /Users/jenkins/minikube-integration/15565-3235/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/15565-3235/.minikube/cache/iso/amd64/minikube-v1.29.0-1674856271-15565-amd64.iso...

	I0127 20:10:27.443861   10821 main.go:141] libmachine: (auto-035000) DBG | I0127 20:10:27.443773   10835 common.go:123] Creating ssh key: /Users/jenkins/minikube-integration/15565-3235/.minikube/machines/auto-035000/id_rsa...

	I0127 20:10:27.511367   10821 main.go:141] libmachine: (auto-035000) DBG | I0127 20:10:27.511278   10835 common.go:129] Creating raw disk image: /Users/jenkins/minikube-integration/15565-3235/.minikube/machines/auto-035000/auto-035000.rawdisk...

	I0127 20:10:27.511379   10821 main.go:141] libmachine: (auto-035000) DBG | Writing magic tar header

	I0127 20:10:27.511387   10821 main.go:141] libmachine: (auto-035000) DBG | Writing SSH key tar header

	I0127 20:10:27.512066   10821 main.go:141] libmachine: (auto-035000) DBG | I0127 20:10:27.512009   10835 common.go:143] Fixing permissions on /Users/jenkins/minikube-integration/15565-3235/.minikube/machines/auto-035000 ...

	I0127 20:10:27.657493   10821 main.go:141] libmachine: (auto-035000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0

	I0127 20:10:27.657508   10821 main.go:141] libmachine: (auto-035000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/15565-3235/.minikube/machines/auto-035000/hyperkit.pid

	I0127 20:10:27.657520   10821 main.go:141] libmachine: (auto-035000) DBG | Using UUID b21b38b4-9ec1-11ed-88e2-149d997fca88

	I0127 20:10:27.678190   10821 main.go:141] libmachine: (auto-035000) DBG | Generated MAC fa:b:55:1c:5b:fd

	I0127 20:10:27.678210   10821 main.go:141] libmachine: (auto-035000) DBG | Starting with cmdline: loglevel=3 console=ttyS0 console=tty0 noembed nomodeset norestore waitusb=10 systemd.legacy_systemd_cgroup_controller=yes random.trust_cpu=on hw_rng_model=virtio base host=auto-035000

	I0127 20:10:27.678248   10821 main.go:141] libmachine: (auto-035000) DBG | 2023/01/27 20:10:27 DEBUG: hyperkit: Start &hyperkit.HyperKit{HyperKit:"/usr/local/bin/hyperkit", Argv0:"", StateDir:"/Users/jenkins/minikube-integration/15565-3235/.minikube/machines/auto-035000", VPNKitSock:"", VPNKitUUID:"", VPNKitPreferredIPv4:"", UUID:"b21b38b4-9ec1-11ed-88e2-149d997fca88", Disks:[]hyperkit.Disk{(*hyperkit.RawDisk)(0xc00024a840)}, ISOImages:[]string{"/Users/jenkins/minikube-integration/15565-3235/.minikube/machines/auto-035000/boot2docker.iso"}, VSock:false, VSockDir:"", VSockPorts:[]int(nil), VSockGuestCID:3, VMNet:true, Sockets9P:[]hyperkit.Socket9P(nil), Kernel:"/Users/jenkins/minikube-integration/15565-3235/.minikube/machines/auto-035000/bzimage", Initrd:"/Users/jenkins/minikube-integration/15565-3235/.minikube/machines/auto-035000/initrd", Bootrom:"", CPUs:2, Memory:3072, Console:1, Serials:[]hyperkit.Serial(nil), Pid:0, Arguments:[]string(nil), CmdLine:"", process:(*os.Process)(nil)}

	I0127 20:10:27.678274   10821 main.go:141] libmachine: (auto-035000) DBG | 2023/01/27 20:10:27 DEBUG: hyperkit: check &hyperkit.HyperKit{HyperKit:"/usr/local/bin/hyperkit", Argv0:"", StateDir:"/Users/jenkins/minikube-integration/15565-3235/.minikube/machines/auto-035000", VPNKitSock:"", VPNKitUUID:"", VPNKitPreferredIPv4:"", UUID:"b21b38b4-9ec1-11ed-88e2-149d997fca88", Disks:[]hyperkit.Disk{(*hyperkit.RawDisk)(0xc00024a840)}, ISOImages:[]string{"/Users/jenkins/minikube-integration/15565-3235/.minikube/machines/auto-035000/boot2docker.iso"}, VSock:false, VSockDir:"", VSockPorts:[]int(nil), VSockGuestCID:3, VMNet:true, Sockets9P:[]hyperkit.Socket9P(nil), Kernel:"/Users/jenkins/minikube-integration/15565-3235/.minikube/machines/auto-035000/bzimage", Initrd:"/Users/jenkins/minikube-integration/15565-3235/.minikube/machines/auto-035000/initrd", Bootrom:"", CPUs:2, Memory:3072, Console:1, Serials:[]hyperkit.Serial(nil), Pid:0, Arguments:[]string(nil), CmdLine:"", process:(*os.Process)(nil)}

	I0127 20:10:27.678336   10821 main.go:141] libmachine: (auto-035000) DBG | 2023/01/27 20:10:27 DEBUG: hyperkit: Arguments: []string{"-A", "-u", "-F", "/Users/jenkins/minikube-integration/15565-3235/.minikube/machines/auto-035000/hyperkit.pid", "-c", "2", "-m", "3072M", "-s", "0:0,hostbridge", "-s", "31,lpc", "-s", "1:0,virtio-net", "-U", "b21b38b4-9ec1-11ed-88e2-149d997fca88", "-s", "2:0,virtio-blk,/Users/jenkins/minikube-integration/15565-3235/.minikube/machines/auto-035000/auto-035000.rawdisk", "-s", "3,ahci-cd,/Users/jenkins/minikube-integration/15565-3235/.minikube/machines/auto-035000/boot2docker.iso", "-s", "4,virtio-rnd", "-l", "com1,autopty=/Users/jenkins/minikube-integration/15565-3235/.minikube/machines/auto-035000/tty,log=/Users/jenkins/minikube-integration/15565-3235/.minikube/machines/auto-035000/console-ring", "-f", "kexec,/Users/jenkins/minikube-integration/15565-3235/.minikube/machines/auto-035000/bzimage,/Users/jenkins/minikube-integration/15565-3235/.minikube/machines/auto-035000/in

itrd,earlyprintk=serial loglevel=3 console=ttyS0 console=tty0 noembed nomodeset norestore waitusb=10 systemd.legacy_systemd_cgroup_controller=yes random.trust_cpu=on hw_rng_model=virtio base host=auto-035000"}

	I0127 20:10:27.678372   10821 main.go:141] libmachine: (auto-035000) DBG | 2023/01/27 20:10:27 DEBUG: hyperkit: CmdLine: "/usr/local/bin/hyperkit -A -u -F /Users/jenkins/minikube-integration/15565-3235/.minikube/machines/auto-035000/hyperkit.pid -c 2 -m 3072M -s 0:0,hostbridge -s 31,lpc -s 1:0,virtio-net -U b21b38b4-9ec1-11ed-88e2-149d997fca88 -s 2:0,virtio-blk,/Users/jenkins/minikube-integration/15565-3235/.minikube/machines/auto-035000/auto-035000.rawdisk -s 3,ahci-cd,/Users/jenkins/minikube-integration/15565-3235/.minikube/machines/auto-035000/boot2docker.iso -s 4,virtio-rnd -l com1,autopty=/Users/jenkins/minikube-integration/15565-3235/.minikube/machines/auto-035000/tty,log=/Users/jenkins/minikube-integration/15565-3235/.minikube/machines/auto-035000/console-ring -f kexec,/Users/jenkins/minikube-integration/15565-3235/.minikube/machines/auto-035000/bzimage,/Users/jenkins/minikube-integration/15565-3235/.minikube/machines/auto-035000/initrd,earlyprintk=serial loglevel=3 console=ttyS0 console=tty0

noembed nomodeset norestore waitusb=10 systemd.legacy_systemd_cgroup_controller=yes random.trust_cpu=on hw_rng_model=virtio base host=auto-035000"

	I0127 20:10:27.678385   10821 main.go:141] libmachine: (auto-035000) DBG | 2023/01/27 20:10:27 DEBUG: hyperkit: Redirecting stdout/stderr to logger

	I0127 20:10:27.679714   10821 main.go:141] libmachine: (auto-035000) DBG | 2023/01/27 20:10:27 DEBUG: hyperkit: Pid is 10841

	I0127 20:10:27.680041   10821 main.go:141] libmachine: (auto-035000) DBG | Attempt 0

	I0127 20:10:27.680052   10821 main.go:141] libmachine: (auto-035000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0

	I0127 20:10:27.680152   10821 main.go:141] libmachine: (auto-035000) DBG | hyperkit pid from json: 10841

	I0127 20:10:27.681072   10821 main.go:141] libmachine: (auto-035000) DBG | Searching for fa:b:55:1c:5b:fd in /var/db/dhcpd_leases ...

	I0127 20:10:27.681126   10821 main.go:141] libmachine: (auto-035000) DBG | Found 29 entries in /var/db/dhcpd_leases!

	I0127 20:10:27.681161   10821 main.go:141] libmachine: (auto-035000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.30 HWAddress:4e:ed:63:62:fc:74 ID:1,4e:ed:63:62:fc:74 Lease:0x63d5f1ac}

	I0127 20:10:27.681175   10821 main.go:141] libmachine: (auto-035000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.29 HWAddress:92:e8:e3:c4:f2:c8 ID:1,92:e8:e3:c4:f2:c8 Lease:0x63d4a00f}

	I0127 20:10:27.681185   10821 main.go:141] libmachine: (auto-035000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.28 HWAddress:42:0:b5:81:6b:25 ID:1,42:0:b5:81:6b:25 Lease:0x63d5f153}

	I0127 20:10:27.681193   10821 main.go:141] libmachine: (auto-035000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.27 HWAddress:e6:e7:10:11:60:d5 ID:1,e6:e7:10:11:60:d5 Lease:0x63d5f11f}

	I0127 20:10:27.681210   10821 main.go:141] libmachine: (auto-035000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.26 HWAddress:9a:fd:c9:ea:0:f4 ID:1,9a:fd:c9:ea:0:f4 Lease:0x63d5f0fa}

	I0127 20:10:27.681220   10821 main.go:141] libmachine: (auto-035000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.25 HWAddress:2:53:13:2c:ff:14 ID:1,2:53:13:2c:ff:14 Lease:0x63d5f010}

	I0127 20:10:27.681228   10821 main.go:141] libmachine: (auto-035000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.24 HWAddress:c6:3e:49:a7:8f:45 ID:1,c6:3e:49:a7:8f:45 Lease:0x63d49e7a}

	I0127 20:10:27.681237   10821 main.go:141] libmachine: (auto-035000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.23 HWAddress:6a:fe:f6:ef:e1:6e ID:1,6a:fe:f6:ef:e1:6e Lease:0x63d5efcb}

	I0127 20:10:27.681246   10821 main.go:141] libmachine: (auto-035000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.22 HWAddress:6a:2a:9:fd:ff:ea ID:1,6a:2a:9:fd:ff:ea Lease:0x63d5efaa}

	I0127 20:10:27.681253   10821 main.go:141] libmachine: (auto-035000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.21 HWAddress:8e:af:39:6e:2d:7e ID:1,8e:af:39:6e:2d:7e Lease:0x63d5ef9f}

	I0127 20:10:27.681270   10821 main.go:141] libmachine: (auto-035000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.20 HWAddress:26:9d:91:15:d7:c0 ID:1,26:9d:91:15:d7:c0 Lease:0x63d49e1e}

	I0127 20:10:27.681283   10821 main.go:141] libmachine: (auto-035000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.19 HWAddress:b2:e4:7a:80:49:eb ID:1,b2:e4:7a:80:49:eb Lease:0x63d5ef63}

	I0127 20:10:27.681292   10821 main.go:141] libmachine: (auto-035000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.18 HWAddress:82:e5:85:4a:11:dc ID:1,82:e5:85:4a:11:dc Lease:0x63d5ef18}

	I0127 20:10:27.681302   10821 main.go:141] libmachine: (auto-035000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.17 HWAddress:5e:9f:11:8c:b2:80 ID:1,5e:9f:11:8c:b2:80 Lease:0x63d5eea6}

	I0127 20:10:27.681310   10821 main.go:141] libmachine: (auto-035000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.16 HWAddress:6e:a5:9:d2:3e:da ID:1,6e:a5:9:d2:3e:da Lease:0x63d5ee59}

	I0127 20:10:27.681319   10821 main.go:141] libmachine: (auto-035000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.15 HWAddress:6a:76:72:7a:17:3c ID:1,6a:76:72:7a:17:3c Lease:0x63d49c4f}

	I0127 20:10:27.681333   10821 main.go:141] libmachine: (auto-035000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.14 HWAddress:ba:21:ea:d1:67:55 ID:1,ba:21:ea:d1:67:55 Lease:0x63d49bc2}

	I0127 20:10:27.681346   10821 main.go:141] libmachine: (auto-035000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.13 HWAddress:e2:9a:64:74:42:a7 ID:1,e2:9a:64:74:42:a7 Lease:0x63d5ed8f}

	I0127 20:10:27.681360   10821 main.go:141] libmachine: (auto-035000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.12 HWAddress:c6:ea:3a:34:4:15 ID:1,c6:ea:3a:34:4:15 Lease:0x63d5ed5c}

	I0127 20:10:27.681371   10821 main.go:141] libmachine: (auto-035000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.11 HWAddress:de:3e:8e:16:8c:c ID:1,de:3e:8e:16:8c:c Lease:0x63d49a8a}

	I0127 20:10:27.681383   10821 main.go:141] libmachine: (auto-035000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.10 HWAddress:ea:c4:22:14:f6:79 ID:1,ea:c4:22:14:f6:79 Lease:0x63d49a75}

	I0127 20:10:27.681397   10821 main.go:141] libmachine: (auto-035000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.9 HWAddress:be:1f:dd:9:d4:b2 ID:1,be:1f:dd:9:d4:b2 Lease:0x63d49a4f}

	I0127 20:10:27.681409   10821 main.go:141] libmachine: (auto-035000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.8 HWAddress:9e:12:e:46:1e:dc ID:1,9e:12:e:46:1e:dc Lease:0x63d5eb82}

	I0127 20:10:27.681419   10821 main.go:141] libmachine: (auto-035000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.7 HWAddress:a:f3:2f:66:84:69 ID:1,a:f3:2f:66:84:69 Lease:0x63d5eb41}

	I0127 20:10:27.681445   10821 main.go:141] libmachine: (auto-035000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.6 HWAddress:8a:32:b3:dc:47:42 ID:1,8a:32:b3:dc:47:42 Lease:0x63d5eaca}

	I0127 20:10:27.681460   10821 main.go:141] libmachine: (auto-035000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.5 HWAddress:ca:3a:99:12:85:7a ID:1,ca:3a:99:12:85:7a Lease:0x63d5ea6e}

	I0127 20:10:27.681473   10821 main.go:141] libmachine: (auto-035000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.4 HWAddress:a6:93:12:50:62:df ID:1,a6:93:12:50:62:df Lease:0x63d5e969}

	I0127 20:10:27.681485   10821 main.go:141] libmachine: (auto-035000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.3 HWAddress:86:ae:74:13:81:48 ID:1,86:ae:74:13:81:48 Lease:0x63d497de}

	I0127 20:10:27.681496   10821 main.go:141] libmachine: (auto-035000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.2 HWAddress:4e:8b:35:2e:2a:1c ID:1,4e:8b:35:2e:2a:1c Lease:0x63d5e860}

	I0127 20:10:27.686572   10821 main.go:141] libmachine: (auto-035000) DBG | 2023/01/27 20:10:27 INFO : hyperkit: stderr: Using fd 5 for I/O notifications

	I0127 20:10:27.696380   10821 main.go:141] libmachine: (auto-035000) DBG | 2023/01/27 20:10:27 INFO : hyperkit: stderr: /Users/jenkins/minikube-integration/15565-3235/.minikube/machines/auto-035000/boot2docker.iso: fcntl(F_PUNCHHOLE) Operation not permitted: block device will not support TRIM/DISCARD

	I0127 20:10:27.697002   10821 main.go:141] libmachine: (auto-035000) DBG | 2023/01/27 20:10:27 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 2 bit: 22 unspecified don't care: bit is 0

	I0127 20:10:27.697013   10821 main.go:141] libmachine: (auto-035000) DBG | 2023/01/27 20:10:27 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 4 bit: 12 unspecified don't care: bit is 0

	I0127 20:10:27.697026   10821 main.go:141] libmachine: (auto-035000) DBG | 2023/01/27 20:10:27 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 4 bit: 20 unspecified don't care: bit is 0

	I0127 20:10:27.697039   10821 main.go:141] libmachine: (auto-035000) DBG | 2023/01/27 20:10:27 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 3 bit: 13 unspecified don't care: bit is 0

	I0127 20:10:28.075515   10821 main.go:141] libmachine: (auto-035000) DBG | 2023/01/27 20:10:28 INFO : hyperkit: stderr: rdmsr to register 0x3a on vcpu 0

	I0127 20:10:28.075530   10821 main.go:141] libmachine: (auto-035000) DBG | 2023/01/27 20:10:28 INFO : hyperkit: stderr: rdmsr to register 0x140 on vcpu 0

	I0127 20:10:28.179526   10821 main.go:141] libmachine: (auto-035000) DBG | 2023/01/27 20:10:28 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 2 bit: 22 unspecified don't care: bit is 0

	I0127 20:10:28.179551   10821 main.go:141] libmachine: (auto-035000) DBG | 2023/01/27 20:10:28 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 4 bit: 12 unspecified don't care: bit is 0

	I0127 20:10:28.179565   10821 main.go:141] libmachine: (auto-035000) DBG | 2023/01/27 20:10:28 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 4 bit: 20 unspecified don't care: bit is 0

	I0127 20:10:28.179577   10821 main.go:141] libmachine: (auto-035000) DBG | 2023/01/27 20:10:28 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 3 bit: 13 unspecified don't care: bit is 0

	I0127 20:10:28.180419   10821 main.go:141] libmachine: (auto-035000) DBG | 2023/01/27 20:10:28 INFO : hyperkit: stderr: rdmsr to register 0x3a on vcpu 1

	I0127 20:10:28.180430   10821 main.go:141] libmachine: (auto-035000) DBG | 2023/01/27 20:10:28 INFO : hyperkit: stderr: rdmsr to register 0x140 on vcpu 1

	I0127 20:10:29.682481   10821 main.go:141] libmachine: (auto-035000) DBG | Attempt 1

	I0127 20:10:29.682493   10821 main.go:141] libmachine: (auto-035000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0

	I0127 20:10:29.682596   10821 main.go:141] libmachine: (auto-035000) DBG | hyperkit pid from json: 10841

	I0127 20:10:29.683913   10821 main.go:141] libmachine: (auto-035000) DBG | Searching for fa:b:55:1c:5b:fd in /var/db/dhcpd_leases ...

	I0127 20:10:29.683987   10821 main.go:141] libmachine: (auto-035000) DBG | Found 29 entries in /var/db/dhcpd_leases!

	I0127 20:10:29.683997   10821 main.go:141] libmachine: (auto-035000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.30 HWAddress:4e:ed:63:62:fc:74 ID:1,4e:ed:63:62:fc:74 Lease:0x63d4a034}

	I0127 20:10:29.684007   10821 main.go:141] libmachine: (auto-035000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.29 HWAddress:92:e8:e3:c4:f2:c8 ID:1,92:e8:e3:c4:f2:c8 Lease:0x63d4a00f}

	I0127 20:10:29.684016   10821 main.go:141] libmachine: (auto-035000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.28 HWAddress:42:0:b5:81:6b:25 ID:1,42:0:b5:81:6b:25 Lease:0x63d5f153}

	I0127 20:10:29.684024   10821 main.go:141] libmachine: (auto-035000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.27 HWAddress:e6:e7:10:11:60:d5 ID:1,e6:e7:10:11:60:d5 Lease:0x63d5f11f}

	I0127 20:10:29.684033   10821 main.go:141] libmachine: (auto-035000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.26 HWAddress:9a:fd:c9:ea:0:f4 ID:1,9a:fd:c9:ea:0:f4 Lease:0x63d5f0fa}

	I0127 20:10:29.684041   10821 main.go:141] libmachine: (auto-035000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.25 HWAddress:2:53:13:2c:ff:14 ID:1,2:53:13:2c:ff:14 Lease:0x63d5f010}

	I0127 20:10:29.684047   10821 main.go:141] libmachine: (auto-035000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.24 HWAddress:c6:3e:49:a7:8f:45 ID:1,c6:3e:49:a7:8f:45 Lease:0x63d49e7a}

	I0127 20:10:29.684054   10821 main.go:141] libmachine: (auto-035000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.23 HWAddress:6a:fe:f6:ef:e1:6e ID:1,6a:fe:f6:ef:e1:6e Lease:0x63d5efcb}

	I0127 20:10:29.684062   10821 main.go:141] libmachine: (auto-035000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.22 HWAddress:6a:2a:9:fd:ff:ea ID:1,6a:2a:9:fd:ff:ea Lease:0x63d5efaa}

	I0127 20:10:29.684081   10821 main.go:141] libmachine: (auto-035000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.21 HWAddress:8e:af:39:6e:2d:7e ID:1,8e:af:39:6e:2d:7e Lease:0x63d5ef9f}

	I0127 20:10:29.684095   10821 main.go:141] libmachine: (auto-035000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.20 HWAddress:26:9d:91:15:d7:c0 ID:1,26:9d:91:15:d7:c0 Lease:0x63d49e1e}

	I0127 20:10:29.684108   10821 main.go:141] libmachine: (auto-035000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.19 HWAddress:b2:e4:7a:80:49:eb ID:1,b2:e4:7a:80:49:eb Lease:0x63d5ef63}

	I0127 20:10:29.684123   10821 main.go:141] libmachine: (auto-035000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.18 HWAddress:82:e5:85:4a:11:dc ID:1,82:e5:85:4a:11:dc Lease:0x63d5ef18}

	I0127 20:10:29.684131   10821 main.go:141] libmachine: (auto-035000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.17 HWAddress:5e:9f:11:8c:b2:80 ID:1,5e:9f:11:8c:b2:80 Lease:0x63d5eea6}

	I0127 20:10:29.684141   10821 main.go:141] libmachine: (auto-035000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.16 HWAddress:6e:a5:9:d2:3e:da ID:1,6e:a5:9:d2:3e:da Lease:0x63d5ee59}

	I0127 20:10:29.684151   10821 main.go:141] libmachine: (auto-035000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.15 HWAddress:6a:76:72:7a:17:3c ID:1,6a:76:72:7a:17:3c Lease:0x63d49c4f}

	I0127 20:10:29.684159   10821 main.go:141] libmachine: (auto-035000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.14 HWAddress:ba:21:ea:d1:67:55 ID:1,ba:21:ea:d1:67:55 Lease:0x63d49bc2}

	I0127 20:10:29.684168   10821 main.go:141] libmachine: (auto-035000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.13 HWAddress:e2:9a:64:74:42:a7 ID:1,e2:9a:64:74:42:a7 Lease:0x63d5ed8f}

	I0127 20:10:29.684175   10821 main.go:141] libmachine: (auto-035000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.12 HWAddress:c6:ea:3a:34:4:15 ID:1,c6:ea:3a:34:4:15 Lease:0x63d5ed5c}

	I0127 20:10:29.684183   10821 main.go:141] libmachine: (auto-035000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.11 HWAddress:de:3e:8e:16:8c:c ID:1,de:3e:8e:16:8c:c Lease:0x63d49a8a}

	I0127 20:10:29.684190   10821 main.go:141] libmachine: (auto-035000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.10 HWAddress:ea:c4:22:14:f6:79 ID:1,ea:c4:22:14:f6:79 Lease:0x63d49a75}

	I0127 20:10:29.684198   10821 main.go:141] libmachine: (auto-035000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.9 HWAddress:be:1f:dd:9:d4:b2 ID:1,be:1f:dd:9:d4:b2 Lease:0x63d49a4f}

	I0127 20:10:29.684204   10821 main.go:141] libmachine: (auto-035000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.8 HWAddress:9e:12:e:46:1e:dc ID:1,9e:12:e:46:1e:dc Lease:0x63d5eb82}

	I0127 20:10:29.684213   10821 main.go:141] libmachine: (auto-035000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.7 HWAddress:a:f3:2f:66:84:69 ID:1,a:f3:2f:66:84:69 Lease:0x63d5eb41}

	I0127 20:10:29.684220   10821 main.go:141] libmachine: (auto-035000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.6 HWAddress:8a:32:b3:dc:47:42 ID:1,8a:32:b3:dc:47:42 Lease:0x63d5eaca}

	I0127 20:10:29.684229   10821 main.go:141] libmachine: (auto-035000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.5 HWAddress:ca:3a:99:12:85:7a ID:1,ca:3a:99:12:85:7a Lease:0x63d5ea6e}

	I0127 20:10:29.684237   10821 main.go:141] libmachine: (auto-035000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.4 HWAddress:a6:93:12:50:62:df ID:1,a6:93:12:50:62:df Lease:0x63d5e969}

	I0127 20:10:29.684245   10821 main.go:141] libmachine: (auto-035000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.3 HWAddress:86:ae:74:13:81:48 ID:1,86:ae:74:13:81:48 Lease:0x63d497de}

	I0127 20:10:29.684254   10821 main.go:141] libmachine: (auto-035000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.2 HWAddress:4e:8b:35:2e:2a:1c ID:1,4e:8b:35:2e:2a:1c Lease:0x63d5e860}

	I0127 20:10:31.685504   10821 main.go:141] libmachine: (auto-035000) DBG | Attempt 2

	I0127 20:10:31.685519   10821 main.go:141] libmachine: (auto-035000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0

	I0127 20:10:31.685589   10821 main.go:141] libmachine: (auto-035000) DBG | hyperkit pid from json: 10841

	I0127 20:10:31.686420   10821 main.go:141] libmachine: (auto-035000) DBG | Searching for fa:b:55:1c:5b:fd in /var/db/dhcpd_leases ...

	I0127 20:10:31.686477   10821 main.go:141] libmachine: (auto-035000) DBG | Found 29 entries in /var/db/dhcpd_leases!

	I0127 20:10:31.686489   10821 main.go:141] libmachine: (auto-035000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.30 HWAddress:4e:ed:63:62:fc:74 ID:1,4e:ed:63:62:fc:74 Lease:0x63d4a034}

	I0127 20:10:31.686498   10821 main.go:141] libmachine: (auto-035000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.29 HWAddress:92:e8:e3:c4:f2:c8 ID:1,92:e8:e3:c4:f2:c8 Lease:0x63d4a00f}

	I0127 20:10:31.686506   10821 main.go:141] libmachine: (auto-035000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.28 HWAddress:42:0:b5:81:6b:25 ID:1,42:0:b5:81:6b:25 Lease:0x63d5f153}

	I0127 20:10:31.686532   10821 main.go:141] libmachine: (auto-035000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.27 HWAddress:e6:e7:10:11:60:d5 ID:1,e6:e7:10:11:60:d5 Lease:0x63d5f11f}

	I0127 20:10:31.686545   10821 main.go:141] libmachine: (auto-035000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.26 HWAddress:9a:fd:c9:ea:0:f4 ID:1,9a:fd:c9:ea:0:f4 Lease:0x63d5f0fa}

	I0127 20:10:31.686553   10821 main.go:141] libmachine: (auto-035000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.25 HWAddress:2:53:13:2c:ff:14 ID:1,2:53:13:2c:ff:14 Lease:0x63d5f010}

	I0127 20:10:31.686562   10821 main.go:141] libmachine: (auto-035000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.24 HWAddress:c6:3e:49:a7:8f:45 ID:1,c6:3e:49:a7:8f:45 Lease:0x63d49e7a}

	I0127 20:10:31.686570   10821 main.go:141] libmachine: (auto-035000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.23 HWAddress:6a:fe:f6:ef:e1:6e ID:1,6a:fe:f6:ef:e1:6e Lease:0x63d5efcb}

	I0127 20:10:31.686579   10821 main.go:141] libmachine: (auto-035000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.22 HWAddress:6a:2a:9:fd:ff:ea ID:1,6a:2a:9:fd:ff:ea Lease:0x63d5efaa}

	I0127 20:10:31.686593   10821 main.go:141] libmachine: (auto-035000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.21 HWAddress:8e:af:39:6e:2d:7e ID:1,8e:af:39:6e:2d:7e Lease:0x63d5ef9f}

	I0127 20:10:31.686606   10821 main.go:141] libmachine: (auto-035000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.20 HWAddress:26:9d:91:15:d7:c0 ID:1,26:9d:91:15:d7:c0 Lease:0x63d49e1e}

	I0127 20:10:31.686614   10821 main.go:141] libmachine: (auto-035000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.19 HWAddress:b2:e4:7a:80:49:eb ID:1,b2:e4:7a:80:49:eb Lease:0x63d5ef63}

	I0127 20:10:31.686623   10821 main.go:141] libmachine: (auto-035000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.18 HWAddress:82:e5:85:4a:11:dc ID:1,82:e5:85:4a:11:dc Lease:0x63d5ef18}

	I0127 20:10:31.686642   10821 main.go:141] libmachine: (auto-035000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.17 HWAddress:5e:9f:11:8c:b2:80 ID:1,5e:9f:11:8c:b2:80 Lease:0x63d5eea6}

	I0127 20:10:31.686652   10821 main.go:141] libmachine: (auto-035000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.16 HWAddress:6e:a5:9:d2:3e:da ID:1,6e:a5:9:d2:3e:da Lease:0x63d5ee59}

	I0127 20:10:31.686660   10821 main.go:141] libmachine: (auto-035000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.15 HWAddress:6a:76:72:7a:17:3c ID:1,6a:76:72:7a:17:3c Lease:0x63d49c4f}

	I0127 20:10:31.686668   10821 main.go:141] libmachine: (auto-035000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.14 HWAddress:ba:21:ea:d1:67:55 ID:1,ba:21:ea:d1:67:55 Lease:0x63d49bc2}

	I0127 20:10:31.686679   10821 main.go:141] libmachine: (auto-035000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.13 HWAddress:e2:9a:64:74:42:a7 ID:1,e2:9a:64:74:42:a7 Lease:0x63d5ed8f}

	I0127 20:10:31.686688   10821 main.go:141] libmachine: (auto-035000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.12 HWAddress:c6:ea:3a:34:4:15 ID:1,c6:ea:3a:34:4:15 Lease:0x63d5ed5c}

	I0127 20:10:31.686698   10821 main.go:141] libmachine: (auto-035000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.11 HWAddress:de:3e:8e:16:8c:c ID:1,de:3e:8e:16:8c:c Lease:0x63d49a8a}

	I0127 20:10:31.686708   10821 main.go:141] libmachine: (auto-035000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.10 HWAddress:ea:c4:22:14:f6:79 ID:1,ea:c4:22:14:f6:79 Lease:0x63d49a75}

	I0127 20:10:31.686716   10821 main.go:141] libmachine: (auto-035000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.9 HWAddress:be:1f:dd:9:d4:b2 ID:1,be:1f:dd:9:d4:b2 Lease:0x63d49a4f}

	I0127 20:10:31.686724   10821 main.go:141] libmachine: (auto-035000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.8 HWAddress:9e:12:e:46:1e:dc ID:1,9e:12:e:46:1e:dc Lease:0x63d5eb82}

	I0127 20:10:31.686733   10821 main.go:141] libmachine: (auto-035000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.7 HWAddress:a:f3:2f:66:84:69 ID:1,a:f3:2f:66:84:69 Lease:0x63d5eb41}

	I0127 20:10:31.686741   10821 main.go:141] libmachine: (auto-035000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.6 HWAddress:8a:32:b3:dc:47:42 ID:1,8a:32:b3:dc:47:42 Lease:0x63d5eaca}

	I0127 20:10:31.686749   10821 main.go:141] libmachine: (auto-035000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.5 HWAddress:ca:3a:99:12:85:7a ID:1,ca:3a:99:12:85:7a Lease:0x63d5ea6e}

	I0127 20:10:31.686757   10821 main.go:141] libmachine: (auto-035000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.4 HWAddress:a6:93:12:50:62:df ID:1,a6:93:12:50:62:df Lease:0x63d5e969}

	I0127 20:10:31.686764   10821 main.go:141] libmachine: (auto-035000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.3 HWAddress:86:ae:74:13:81:48 ID:1,86:ae:74:13:81:48 Lease:0x63d497de}

	I0127 20:10:31.686772   10821 main.go:141] libmachine: (auto-035000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.2 HWAddress:4e:8b:35:2e:2a:1c ID:1,4e:8b:35:2e:2a:1c Lease:0x63d5e860}

	I0127 20:10:32.632370   10821 main.go:141] libmachine: (auto-035000) DBG | 2023/01/27 20:10:32 INFO : hyperkit: stderr: rdmsr to register 0x64d on vcpu 1

	I0127 20:10:32.632388   10821 main.go:141] libmachine: (auto-035000) DBG | 2023/01/27 20:10:32 INFO : hyperkit: stderr: rdmsr to register 0x64e on vcpu 1

	I0127 20:10:32.632395   10821 main.go:141] libmachine: (auto-035000) DBG | 2023/01/27 20:10:32 INFO : hyperkit: stderr: rdmsr to register 0x34 on vcpu 1

	I0127 20:10:33.687454   10821 main.go:141] libmachine: (auto-035000) DBG | Attempt 3

	I0127 20:10:33.687468   10821 main.go:141] libmachine: (auto-035000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0

	I0127 20:10:33.687604   10821 main.go:141] libmachine: (auto-035000) DBG | hyperkit pid from json: 10841

	I0127 20:10:33.688335   10821 main.go:141] libmachine: (auto-035000) DBG | Searching for fa:b:55:1c:5b:fd in /var/db/dhcpd_leases ...

	I0127 20:10:33.688381   10821 main.go:141] libmachine: (auto-035000) DBG | Found 29 entries in /var/db/dhcpd_leases!

	I0127 20:10:33.688413   10821 main.go:141] libmachine: (auto-035000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.30 HWAddress:4e:ed:63:62:fc:74 ID:1,4e:ed:63:62:fc:74 Lease:0x63d4a034}

	I0127 20:10:33.688429   10821 main.go:141] libmachine: (auto-035000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.29 HWAddress:92:e8:e3:c4:f2:c8 ID:1,92:e8:e3:c4:f2:c8 Lease:0x63d4a00f}

	I0127 20:10:33.688456   10821 main.go:141] libmachine: (auto-035000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.28 HWAddress:42:0:b5:81:6b:25 ID:1,42:0:b5:81:6b:25 Lease:0x63d5f153}

	I0127 20:10:33.688468   10821 main.go:141] libmachine: (auto-035000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.27 HWAddress:e6:e7:10:11:60:d5 ID:1,e6:e7:10:11:60:d5 Lease:0x63d5f11f}

	I0127 20:10:33.688480   10821 main.go:141] libmachine: (auto-035000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.26 HWAddress:9a:fd:c9:ea:0:f4 ID:1,9a:fd:c9:ea:0:f4 Lease:0x63d5f0fa}

	I0127 20:10:33.688493   10821 main.go:141] libmachine: (auto-035000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.25 HWAddress:2:53:13:2c:ff:14 ID:1,2:53:13:2c:ff:14 Lease:0x63d5f010}

	I0127 20:10:33.688509   10821 main.go:141] libmachine: (auto-035000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.24 HWAddress:c6:3e:49:a7:8f:45 ID:1,c6:3e:49:a7:8f:45 Lease:0x63d49e7a}

	I0127 20:10:33.688520   10821 main.go:141] libmachine: (auto-035000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.23 HWAddress:6a:fe:f6:ef:e1:6e ID:1,6a:fe:f6:ef:e1:6e Lease:0x63d5efcb}

	I0127 20:10:33.688535   10821 main.go:141] libmachine: (auto-035000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.22 HWAddress:6a:2a:9:fd:ff:ea ID:1,6a:2a:9:fd:ff:ea Lease:0x63d5efaa}

	I0127 20:10:33.688545   10821 main.go:141] libmachine: (auto-035000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.21 HWAddress:8e:af:39:6e:2d:7e ID:1,8e:af:39:6e:2d:7e Lease:0x63d5ef9f}

	I0127 20:10:33.688552   10821 main.go:141] libmachine: (auto-035000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.20 HWAddress:26:9d:91:15:d7:c0 ID:1,26:9d:91:15:d7:c0 Lease:0x63d49e1e}

	I0127 20:10:33.688561   10821 main.go:141] libmachine: (auto-035000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.19 HWAddress:b2:e4:7a:80:49:eb ID:1,b2:e4:7a:80:49:eb Lease:0x63d5ef63}

	I0127 20:10:33.688575   10821 main.go:141] libmachine: (auto-035000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.18 HWAddress:82:e5:85:4a:11:dc ID:1,82:e5:85:4a:11:dc Lease:0x63d5ef18}

	I0127 20:10:33.688584   10821 main.go:141] libmachine: (auto-035000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.17 HWAddress:5e:9f:11:8c:b2:80 ID:1,5e:9f:11:8c:b2:80 Lease:0x63d5eea6}

	I0127 20:10:33.688595   10821 main.go:141] libmachine: (auto-035000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.16 HWAddress:6e:a5:9:d2:3e:da ID:1,6e:a5:9:d2:3e:da Lease:0x63d5ee59}

	I0127 20:10:33.688603   10821 main.go:141] libmachine: (auto-035000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.15 HWAddress:6a:76:72:7a:17:3c ID:1,6a:76:72:7a:17:3c Lease:0x63d49c4f}

	I0127 20:10:33.688611   10821 main.go:141] libmachine: (auto-035000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.14 HWAddress:ba:21:ea:d1:67:55 ID:1,ba:21:ea:d1:67:55 Lease:0x63d49bc2}

	I0127 20:10:33.688619   10821 main.go:141] libmachine: (auto-035000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.13 HWAddress:e2:9a:64:74:42:a7 ID:1,e2:9a:64:74:42:a7 Lease:0x63d5ed8f}

	I0127 20:10:33.688627   10821 main.go:141] libmachine: (auto-035000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.12 HWAddress:c6:ea:3a:34:4:15 ID:1,c6:ea:3a:34:4:15 Lease:0x63d5ed5c}

	I0127 20:10:33.688642   10821 main.go:141] libmachine: (auto-035000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.11 HWAddress:de:3e:8e:16:8c:c ID:1,de:3e:8e:16:8c:c Lease:0x63d49a8a}

	I0127 20:10:33.688651   10821 main.go:141] libmachine: (auto-035000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.10 HWAddress:ea:c4:22:14:f6:79 ID:1,ea:c4:22:14:f6:79 Lease:0x63d49a75}

	I0127 20:10:33.688659   10821 main.go:141] libmachine: (auto-035000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.9 HWAddress:be:1f:dd:9:d4:b2 ID:1,be:1f:dd:9:d4:b2 Lease:0x63d49a4f}

	I0127 20:10:33.688666   10821 main.go:141] libmachine: (auto-035000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.8 HWAddress:9e:12:e:46:1e:dc ID:1,9e:12:e:46:1e:dc Lease:0x63d5eb82}

	I0127 20:10:33.688674   10821 main.go:141] libmachine: (auto-035000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.7 HWAddress:a:f3:2f:66:84:69 ID:1,a:f3:2f:66:84:69 Lease:0x63d5eb41}

	I0127 20:10:33.688689   10821 main.go:141] libmachine: (auto-035000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.6 HWAddress:8a:32:b3:dc:47:42 ID:1,8a:32:b3:dc:47:42 Lease:0x63d5eaca}

	I0127 20:10:33.688704   10821 main.go:141] libmachine: (auto-035000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.5 HWAddress:ca:3a:99:12:85:7a ID:1,ca:3a:99:12:85:7a Lease:0x63d5ea6e}

	I0127 20:10:33.688712   10821 main.go:141] libmachine: (auto-035000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.4 HWAddress:a6:93:12:50:62:df ID:1,a6:93:12:50:62:df Lease:0x63d5e969}

	I0127 20:10:33.688720   10821 main.go:141] libmachine: (auto-035000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.3 HWAddress:86:ae:74:13:81:48 ID:1,86:ae:74:13:81:48 Lease:0x63d497de}

	I0127 20:10:33.688730   10821 main.go:141] libmachine: (auto-035000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.2 HWAddress:4e:8b:35:2e:2a:1c ID:1,4e:8b:35:2e:2a:1c Lease:0x63d5e860}

	I0127 20:10:35.688954   10821 main.go:141] libmachine: (auto-035000) DBG | Attempt 4

	I0127 20:10:35.688977   10821 main.go:141] libmachine: (auto-035000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0

	I0127 20:10:35.689018   10821 main.go:141] libmachine: (auto-035000) DBG | hyperkit pid from json: 10841

	I0127 20:10:35.689997   10821 main.go:141] libmachine: (auto-035000) DBG | Searching for fa:b:55:1c:5b:fd in /var/db/dhcpd_leases ...

	I0127 20:10:35.690065   10821 main.go:141] libmachine: (auto-035000) DBG | Found 30 entries in /var/db/dhcpd_leases!

	I0127 20:10:35.690082   10821 main.go:141] libmachine: (auto-035000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.31 HWAddress:fa:b:55:1c:5b:fd ID:1,fa:b:55:1c:5b:fd Lease:0x63d5f1bb}

	I0127 20:10:35.690121   10821 main.go:141] libmachine: (auto-035000) DBG | Found match: fa:b:55:1c:5b:fd

	I0127 20:10:35.690131   10821 main.go:141] libmachine: (auto-035000) DBG | IP: 192.168.64.31

	I0127 20:10:35.690145   10821 main.go:141] libmachine: (auto-035000) Calling .GetConfigRaw

	I0127 20:10:35.690702   10821 main.go:141] libmachine: (auto-035000) Calling .DriverName

	I0127 20:10:35.690817   10821 main.go:141] libmachine: (auto-035000) Calling .DriverName

	I0127 20:10:35.690905   10821 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...

	I0127 20:10:35.690914   10821 main.go:141] libmachine: (auto-035000) Calling .GetState

	I0127 20:10:35.691000   10821 main.go:141] libmachine: (auto-035000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0

	I0127 20:10:35.691063   10821 main.go:141] libmachine: (auto-035000) DBG | hyperkit pid from json: 10841

	I0127 20:10:35.691764   10821 main.go:141] libmachine: Detecting operating system of created instance...

	I0127 20:10:35.691772   10821 main.go:141] libmachine: Waiting for SSH to be available...

	I0127 20:10:35.691777   10821 main.go:141] libmachine: Getting to WaitForSSH function...

	I0127 20:10:35.691782   10821 main.go:141] libmachine: (auto-035000) Calling .GetSSHHostname

	I0127 20:10:35.691856   10821 main.go:141] libmachine: (auto-035000) Calling .GetSSHPort

	I0127 20:10:35.691947   10821 main.go:141] libmachine: (auto-035000) Calling .GetSSHKeyPath

	I0127 20:10:35.692028   10821 main.go:141] libmachine: (auto-035000) Calling .GetSSHKeyPath

	I0127 20:10:35.692109   10821 main.go:141] libmachine: (auto-035000) Calling .GetSSHUsername

	I0127 20:10:35.692212   10821 main.go:141] libmachine: Using SSH client type: native

	I0127 20:10:35.692412   10821 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x13ec500] 0x13ef680 <nil>  [] 0s} 192.168.64.31 22 <nil> <nil>}

	I0127 20:10:35.692420   10821 main.go:141] libmachine: About to run SSH command:

	exit 0

	I0127 20:10:36.775225   10821 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I0127 20:10:36.775239   10821 main.go:141] libmachine: Detecting the provisioner...

	I0127 20:10:36.775245   10821 main.go:141] libmachine: (auto-035000) Calling .GetSSHHostname

	I0127 20:10:36.775382   10821 main.go:141] libmachine: (auto-035000) Calling .GetSSHPort

	I0127 20:10:36.775487   10821 main.go:141] libmachine: (auto-035000) Calling .GetSSHKeyPath

	I0127 20:10:36.775586   10821 main.go:141] libmachine: (auto-035000) Calling .GetSSHKeyPath

	I0127 20:10:36.775678   10821 main.go:141] libmachine: (auto-035000) Calling .GetSSHUsername

	I0127 20:10:36.775812   10821 main.go:141] libmachine: Using SSH client type: native

	I0127 20:10:36.775937   10821 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x13ec500] 0x13ef680 <nil>  [] 0s} 192.168.64.31 22 <nil> <nil>}

	I0127 20:10:36.775945   10821 main.go:141] libmachine: About to run SSH command:

	cat /etc/os-release

	I0127 20:10:36.855214   10821 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot

	VERSION=2021.02.12-1-g4751c28-dirty

	ID=buildroot

	VERSION_ID=2021.02.12

	PRETTY_NAME="Buildroot 2021.02.12"

	I0127 20:10:36.855276   10821 main.go:141] libmachine: found compatible host: buildroot

	I0127 20:10:36.855283   10821 main.go:141] libmachine: Provisioning with buildroot...

	I0127 20:10:36.855292   10821 main.go:141] libmachine: (auto-035000) Calling .GetMachineName

	I0127 20:10:36.855427   10821 buildroot.go:166] provisioning hostname "auto-035000"

	I0127 20:10:36.855438   10821 main.go:141] libmachine: (auto-035000) Calling .GetMachineName

	I0127 20:10:36.855522   10821 main.go:141] libmachine: (auto-035000) Calling .GetSSHHostname

	I0127 20:10:36.855606   10821 main.go:141] libmachine: (auto-035000) Calling .GetSSHPort

	I0127 20:10:36.855717   10821 main.go:141] libmachine: (auto-035000) Calling .GetSSHKeyPath

	I0127 20:10:36.855790   10821 main.go:141] libmachine: (auto-035000) Calling .GetSSHKeyPath

	I0127 20:10:36.855900   10821 main.go:141] libmachine: (auto-035000) Calling .GetSSHUsername

	I0127 20:10:36.856029   10821 main.go:141] libmachine: Using SSH client type: native

	I0127 20:10:36.856152   10821 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x13ec500] 0x13ef680 <nil>  [] 0s} 192.168.64.31 22 <nil> <nil>}

	I0127 20:10:36.856161   10821 main.go:141] libmachine: About to run SSH command:

	sudo hostname auto-035000 && echo "auto-035000" | sudo tee /etc/hostname

	I0127 20:10:36.944051   10821 main.go:141] libmachine: SSH cmd err, output: <nil>: auto-035000

	I0127 20:10:36.944068   10821 main.go:141] libmachine: (auto-035000) Calling .GetSSHHostname

	I0127 20:10:36.944198   10821 main.go:141] libmachine: (auto-035000) Calling .GetSSHPort

	I0127 20:10:36.944297   10821 main.go:141] libmachine: (auto-035000) Calling .GetSSHKeyPath

	I0127 20:10:36.944387   10821 main.go:141] libmachine: (auto-035000) Calling .GetSSHKeyPath

	I0127 20:10:36.944463   10821 main.go:141] libmachine: (auto-035000) Calling .GetSSHUsername

	I0127 20:10:36.944596   10821 main.go:141] libmachine: Using SSH client type: native

	I0127 20:10:36.944725   10821 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x13ec500] 0x13ef680 <nil>  [] 0s} 192.168.64.31 22 <nil> <nil>}

	I0127 20:10:36.944737   10821 main.go:141] libmachine: About to run SSH command:

			if ! grep -xq '.*\sauto-035000' /etc/hosts; then

				if grep -xq '127.0.1.1\s.*' /etc/hosts; then

					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 auto-035000/g' /etc/hosts;

				else 

					echo '127.0.1.1 auto-035000' | sudo tee -a /etc/hosts; 

				fi

			fi

	I0127 20:10:37.028181   10821 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I0127 20:10:37.028197   10821 buildroot.go:172] set auth options {CertDir:/Users/jenkins/minikube-integration/15565-3235/.minikube CaCertPath:/Users/jenkins/minikube-integration/15565-3235/.minikube/certs/ca.pem CaPrivateKeyPath:/Users/jenkins/minikube-integration/15565-3235/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/Users/jenkins/minikube-integration/15565-3235/.minikube/machines/server.pem ServerKeyPath:/Users/jenkins/minikube-integration/15565-3235/.minikube/machines/server-key.pem ClientKeyPath:/Users/jenkins/minikube-integration/15565-3235/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/Users/jenkins/minikube-integration/15565-3235/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/Users/jenkins/minikube-integration/15565-3235/.minikube}

	I0127 20:10:37.028206   10821 buildroot.go:174] setting up certificates

	I0127 20:10:37.028215   10821 provision.go:83] configureAuth start

	I0127 20:10:37.028224   10821 main.go:141] libmachine: (auto-035000) Calling .GetMachineName

	I0127 20:10:37.028360   10821 main.go:141] libmachine: (auto-035000) Calling .GetIP

	I0127 20:10:37.028443   10821 main.go:141] libmachine: (auto-035000) Calling .GetSSHHostname

	I0127 20:10:37.028529   10821 provision.go:138] copyHostCerts

	I0127 20:10:37.028618   10821 exec_runner.go:144] found /Users/jenkins/minikube-integration/15565-3235/.minikube/ca.pem, removing ...

	I0127 20:10:37.028627   10821 exec_runner.go:207] rm: /Users/jenkins/minikube-integration/15565-3235/.minikube/ca.pem

	I0127 20:10:37.028787   10821 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/15565-3235/.minikube/certs/ca.pem --> /Users/jenkins/minikube-integration/15565-3235/.minikube/ca.pem (1082 bytes)

	I0127 20:10:37.028998   10821 exec_runner.go:144] found /Users/jenkins/minikube-integration/15565-3235/.minikube/cert.pem, removing ...

	I0127 20:10:37.029005   10821 exec_runner.go:207] rm: /Users/jenkins/minikube-integration/15565-3235/.minikube/cert.pem

	I0127 20:10:37.029102   10821 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/15565-3235/.minikube/certs/cert.pem --> /Users/jenkins/minikube-integration/15565-3235/.minikube/cert.pem (1123 bytes)

	I0127 20:10:37.029247   10821 exec_runner.go:144] found /Users/jenkins/minikube-integration/15565-3235/.minikube/key.pem, removing ...

	I0127 20:10:37.029253   10821 exec_runner.go:207] rm: /Users/jenkins/minikube-integration/15565-3235/.minikube/key.pem

	I0127 20:10:37.029405   10821 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/15565-3235/.minikube/certs/key.pem --> /Users/jenkins/minikube-integration/15565-3235/.minikube/key.pem (1675 bytes)

	I0127 20:10:37.029520   10821 provision.go:112] generating server cert: /Users/jenkins/minikube-integration/15565-3235/.minikube/machines/server.pem ca-key=/Users/jenkins/minikube-integration/15565-3235/.minikube/certs/ca.pem private-key=/Users/jenkins/minikube-integration/15565-3235/.minikube/certs/ca-key.pem org=jenkins.auto-035000 san=[192.168.64.31 192.168.64.31 localhost 127.0.0.1 minikube auto-035000]

	I0127 20:10:37.124345   10821 provision.go:172] copyRemoteCerts

	I0127 20:10:37.124393   10821 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker

	I0127 20:10:37.124409   10821 main.go:141] libmachine: (auto-035000) Calling .GetSSHHostname

	I0127 20:10:37.124549   10821 main.go:141] libmachine: (auto-035000) Calling .GetSSHPort

	I0127 20:10:37.124649   10821 main.go:141] libmachine: (auto-035000) Calling .GetSSHKeyPath

	I0127 20:10:37.124749   10821 main.go:141] libmachine: (auto-035000) Calling .GetSSHUsername

	I0127 20:10:37.124851   10821 sshutil.go:53] new ssh client: &{IP:192.168.64.31 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/15565-3235/.minikube/machines/auto-035000/id_rsa Username:docker}

	I0127 20:10:37.172621   10821 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15565-3235/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)

	I0127 20:10:37.188290   10821 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15565-3235/.minikube/machines/server.pem --> /etc/docker/server.pem (1212 bytes)

	I0127 20:10:37.204025   10821 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15565-3235/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)

	I0127 20:10:37.219323   10821 provision.go:86] duration metric: configureAuth took 191.102039ms

	I0127 20:10:37.219333   10821 buildroot.go:189] setting minikube options for container-runtime

	I0127 20:10:37.219481   10821 config.go:180] Loaded profile config "auto-035000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.26.1

	I0127 20:10:37.219496   10821 main.go:141] libmachine: (auto-035000) Calling .DriverName

	I0127 20:10:37.219626   10821 main.go:141] libmachine: (auto-035000) Calling .GetSSHHostname

	I0127 20:10:37.219702   10821 main.go:141] libmachine: (auto-035000) Calling .GetSSHPort

	I0127 20:10:37.219787   10821 main.go:141] libmachine: (auto-035000) Calling .GetSSHKeyPath

	I0127 20:10:37.219858   10821 main.go:141] libmachine: (auto-035000) Calling .GetSSHKeyPath

	I0127 20:10:37.219928   10821 main.go:141] libmachine: (auto-035000) Calling .GetSSHUsername

	I0127 20:10:37.220026   10821 main.go:141] libmachine: Using SSH client type: native

	I0127 20:10:37.220128   10821 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x13ec500] 0x13ef680 <nil>  [] 0s} 192.168.64.31 22 <nil> <nil>}

	I0127 20:10:37.220136   10821 main.go:141] libmachine: About to run SSH command:

	df --output=fstype / | tail -n 1

	I0127 20:10:37.303095   10821 main.go:141] libmachine: SSH cmd err, output: <nil>: tmpfs

	I0127 20:10:37.303108   10821 buildroot.go:70] root file system type: tmpfs

	I0127 20:10:37.303238   10821 provision.go:309] Updating docker unit: /lib/systemd/system/docker.service ...

	I0127 20:10:37.303257   10821 main.go:141] libmachine: (auto-035000) Calling .GetSSHHostname

	I0127 20:10:37.303408   10821 main.go:141] libmachine: (auto-035000) Calling .GetSSHPort

	I0127 20:10:37.303502   10821 main.go:141] libmachine: (auto-035000) Calling .GetSSHKeyPath

	I0127 20:10:37.303595   10821 main.go:141] libmachine: (auto-035000) Calling .GetSSHKeyPath

	I0127 20:10:37.303710   10821 main.go:141] libmachine: (auto-035000) Calling .GetSSHUsername

	I0127 20:10:37.303835   10821 main.go:141] libmachine: Using SSH client type: native

	I0127 20:10:37.303954   10821 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x13ec500] 0x13ef680 <nil>  [] 0s} 192.168.64.31 22 <nil> <nil>}

	I0127 20:10:37.304004   10821 main.go:141] libmachine: About to run SSH command:

	sudo mkdir -p /lib/systemd/system && printf %s "[Unit]

	Description=Docker Application Container Engine

	Documentation=https://docs.docker.com

	After=network.target  minikube-automount.service docker.socket

	Requires= minikube-automount.service docker.socket 

	StartLimitBurst=3

	StartLimitIntervalSec=60

	[Service]

	Type=notify

	Restart=on-failure

	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	# The base configuration already specifies an 'ExecStart=...' command. The first directive

	# here is to clear out that command inherited from the base configuration. Without this,

	# the command from the base configuration and the command specified here are treated as

	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	# will catch this invalid input and refuse to start the service with an error like:

	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	ExecStart=

	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=hyperkit --insecure-registry 10.96.0.0/12 

	ExecReload=/bin/kill -s HUP \$MAINPID

	# Having non-zero Limit*s causes performance problems due to accounting overhead

	# in the kernel. We recommend using cgroups to do container-local accounting.

	LimitNOFILE=infinity

	LimitNPROC=infinity

	LimitCORE=infinity

	# Uncomment TasksMax if your systemd version supports it.

	# Only systemd 226 and above support this version.

	TasksMax=infinity

	TimeoutStartSec=0

	# set delegate yes so that systemd does not reset the cgroups of docker containers

	Delegate=yes

	# kill only the docker process, not all processes in the cgroup

	KillMode=process

	[Install]

	WantedBy=multi-user.target

	" | sudo tee /lib/systemd/system/docker.service.new

	I0127 20:10:37.394212   10821 main.go:141] libmachine: SSH cmd err, output: <nil>: [Unit]

	Description=Docker Application Container Engine

	Documentation=https://docs.docker.com

	After=network.target  minikube-automount.service docker.socket

	Requires= minikube-automount.service docker.socket 

	StartLimitBurst=3

	StartLimitIntervalSec=60

	[Service]

	Type=notify

	Restart=on-failure

	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	# The base configuration already specifies an 'ExecStart=...' command. The first directive

	# here is to clear out that command inherited from the base configuration. Without this,

	# the command from the base configuration and the command specified here are treated as

	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	# will catch this invalid input and refuse to start the service with an error like:

	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	ExecStart=

	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=hyperkit --insecure-registry 10.96.0.0/12 

	ExecReload=/bin/kill -s HUP $MAINPID

	# Having non-zero Limit*s causes performance problems due to accounting overhead

	# in the kernel. We recommend using cgroups to do container-local accounting.

	LimitNOFILE=infinity

	LimitNPROC=infinity

	LimitCORE=infinity

	# Uncomment TasksMax if your systemd version supports it.

	# Only systemd 226 and above support this version.

	TasksMax=infinity

	TimeoutStartSec=0

	# set delegate yes so that systemd does not reset the cgroups of docker containers

	Delegate=yes

	# kill only the docker process, not all processes in the cgroup

	KillMode=process

	[Install]

	WantedBy=multi-user.target

	I0127 20:10:37.394235   10821 main.go:141] libmachine: (auto-035000) Calling .GetSSHHostname

	I0127 20:10:37.394377   10821 main.go:141] libmachine: (auto-035000) Calling .GetSSHPort

	I0127 20:10:37.394480   10821 main.go:141] libmachine: (auto-035000) Calling .GetSSHKeyPath

	I0127 20:10:37.394558   10821 main.go:141] libmachine: (auto-035000) Calling .GetSSHKeyPath

	I0127 20:10:37.394665   10821 main.go:141] libmachine: (auto-035000) Calling .GetSSHUsername

	I0127 20:10:37.394799   10821 main.go:141] libmachine: Using SSH client type: native

	I0127 20:10:37.394910   10821 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x13ec500] 0x13ef680 <nil>  [] 0s} 192.168.64.31 22 <nil> <nil>}

	I0127 20:10:37.394922   10821 main.go:141] libmachine: About to run SSH command:

	sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }

	I0127 20:10:37.876305   10821 main.go:141] libmachine: SSH cmd err, output: <nil>: diff: can't stat '/lib/systemd/system/docker.service': No such file or directory

	Created symlink /etc/systemd/system/multi-user.target.wants/docker.service → /usr/lib/systemd/system/docker.service.

	I0127 20:10:37.876329   10821 main.go:141] libmachine: Checking connection to Docker...

	I0127 20:10:37.876338   10821 main.go:141] libmachine: (auto-035000) Calling .GetURL

	I0127 20:10:37.876469   10821 main.go:141] libmachine: Docker is up and running!

	I0127 20:10:37.876477   10821 main.go:141] libmachine: Reticulating splines...

	I0127 20:10:37.876481   10821 client.go:171] LocalClient.Create took 10.631931984s

	I0127 20:10:37.876494   10821 start.go:167] duration metric: libmachine.API.Create for "auto-035000" took 10.63196978s

	I0127 20:10:37.876502   10821 start.go:300] post-start starting for "auto-035000" (driver="hyperkit")

	I0127 20:10:37.876506   10821 start.go:328] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]

	I0127 20:10:37.876522   10821 main.go:141] libmachine: (auto-035000) Calling .DriverName

	I0127 20:10:37.876679   10821 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs

	I0127 20:10:37.876694   10821 main.go:141] libmachine: (auto-035000) Calling .GetSSHHostname

	I0127 20:10:37.876778   10821 main.go:141] libmachine: (auto-035000) Calling .GetSSHPort

	I0127 20:10:37.876865   10821 main.go:141] libmachine: (auto-035000) Calling .GetSSHKeyPath

	I0127 20:10:37.876949   10821 main.go:141] libmachine: (auto-035000) Calling .GetSSHUsername

	I0127 20:10:37.877030   10821 sshutil.go:53] new ssh client: &{IP:192.168.64.31 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/15565-3235/.minikube/machines/auto-035000/id_rsa Username:docker}

	I0127 20:10:37.924465   10821 ssh_runner.go:195] Run: cat /etc/os-release

	I0127 20:10:37.927187   10821 info.go:137] Remote host: Buildroot 2021.02.12

	I0127 20:10:37.927200   10821 filesync.go:126] Scanning /Users/jenkins/minikube-integration/15565-3235/.minikube/addons for local assets ...

	I0127 20:10:37.927287   10821 filesync.go:126] Scanning /Users/jenkins/minikube-integration/15565-3235/.minikube/files for local assets ...

	I0127 20:10:37.927451   10821 filesync.go:149] local asset: /Users/jenkins/minikube-integration/15565-3235/.minikube/files/etc/ssl/certs/44422.pem -> 44422.pem in /etc/ssl/certs

	I0127 20:10:37.927634   10821 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs

	I0127 20:10:37.934080   10821 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15565-3235/.minikube/files/etc/ssl/certs/44422.pem --> /etc/ssl/certs/44422.pem (1708 bytes)

	I0127 20:10:37.950170   10821 start.go:303] post-start completed in 73.662895ms

	I0127 20:10:37.950197   10821 main.go:141] libmachine: (auto-035000) Calling .GetConfigRaw

	I0127 20:10:37.950759   10821 main.go:141] libmachine: (auto-035000) Calling .GetIP

	I0127 20:10:37.950911   10821 profile.go:148] Saving config to /Users/jenkins/minikube-integration/15565-3235/.minikube/profiles/auto-035000/config.json ...

	I0127 20:10:37.951193   10821 start.go:128] duration metric: createHost completed in 10.740796175s

	I0127 20:10:37.951213   10821 main.go:141] libmachine: (auto-035000) Calling .GetSSHHostname

	I0127 20:10:37.951292   10821 main.go:141] libmachine: (auto-035000) Calling .GetSSHPort

	I0127 20:10:37.951373   10821 main.go:141] libmachine: (auto-035000) Calling .GetSSHKeyPath

	I0127 20:10:37.951448   10821 main.go:141] libmachine: (auto-035000) Calling .GetSSHKeyPath

	I0127 20:10:37.951527   10821 main.go:141] libmachine: (auto-035000) Calling .GetSSHUsername

	I0127 20:10:37.951619   10821 main.go:141] libmachine: Using SSH client type: native

	I0127 20:10:37.951716   10821 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x13ec500] 0x13ef680 <nil>  [] 0s} 192.168.64.31 22 <nil> <nil>}

	I0127 20:10:37.951725   10821 main.go:141] libmachine: About to run SSH command:

	date +%s.%N

	I0127 20:10:38.030475   10821 main.go:141] libmachine: SSH cmd err, output: <nil>: 1674879037.992390733

	I0127 20:10:38.030492   10821 fix.go:207] guest clock: 1674879037.992390733

	I0127 20:10:38.030499   10821 fix.go:220] Guest: 2023-01-27 20:10:37.992390733 -0800 PST Remote: 2023-01-27 20:10:37.951203 -0800 PST m=+11.436873362 (delta=41.187733ms)

	I0127 20:10:38.030521   10821 fix.go:191] guest clock delta is within tolerance: 41.187733ms

	I0127 20:10:38.030526   10821 start.go:83] releasing machines lock for "auto-035000", held for 10.820215464s

	I0127 20:10:38.030544   10821 main.go:141] libmachine: (auto-035000) Calling .DriverName

	I0127 20:10:38.030700   10821 main.go:141] libmachine: (auto-035000) Calling .GetIP

	I0127 20:10:38.030810   10821 main.go:141] libmachine: (auto-035000) Calling .DriverName

	I0127 20:10:38.031148   10821 main.go:141] libmachine: (auto-035000) Calling .DriverName

	I0127 20:10:38.031253   10821 main.go:141] libmachine: (auto-035000) Calling .DriverName

	I0127 20:10:38.031332   10821 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/

	I0127 20:10:38.031357   10821 main.go:141] libmachine: (auto-035000) Calling .GetSSHHostname

	I0127 20:10:38.031443   10821 ssh_runner.go:195] Run: cat /version.json

	I0127 20:10:38.031459   10821 main.go:141] libmachine: (auto-035000) Calling .GetSSHHostname

	I0127 20:10:38.031478   10821 main.go:141] libmachine: (auto-035000) Calling .GetSSHPort

	I0127 20:10:38.031607   10821 main.go:141] libmachine: (auto-035000) Calling .GetSSHPort

	I0127 20:10:38.031609   10821 main.go:141] libmachine: (auto-035000) Calling .GetSSHKeyPath

	I0127 20:10:38.031724   10821 main.go:141] libmachine: (auto-035000) Calling .GetSSHKeyPath

	I0127 20:10:38.031738   10821 main.go:141] libmachine: (auto-035000) Calling .GetSSHUsername

	I0127 20:10:38.031856   10821 main.go:141] libmachine: (auto-035000) Calling .GetSSHUsername

	I0127 20:10:38.031868   10821 sshutil.go:53] new ssh client: &{IP:192.168.64.31 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/15565-3235/.minikube/machines/auto-035000/id_rsa Username:docker}

	I0127 20:10:38.031951   10821 sshutil.go:53] new ssh client: &{IP:192.168.64.31 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/15565-3235/.minikube/machines/auto-035000/id_rsa Username:docker}

	W0127 20:10:38.111825   10821 out.go:239] ! Image was not built for the current minikube version. To resolve this you can delete and recreate your minikube cluster using the latest images. Expected minikube version: v1.29.0-1674856271-15565 -> Actual minikube version: v1.28.0

	! Image was not built for the current minikube version. To resolve this you can delete and recreate your minikube cluster using the latest images. Expected minikube version: v1.29.0-1674856271-15565 -> Actual minikube version: v1.28.0

	I0127 20:10:38.111896   10821 ssh_runner.go:195] Run: systemctl --version

	I0127 20:10:38.115598   10821 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"

	W0127 20:10:38.118998   10821 cni.go:208] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found

	I0127 20:10:38.119063   10821 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/cri-docker.service.d

	I0127 20:10:38.124890   10821 ssh_runner.go:362] scp memory --> /etc/systemd/system/cri-docker.service.d/10-cni.conf (135 bytes)

	I0127 20:10:38.135822   10821 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;

	I0127 20:10:38.146157   10821 cni.go:261] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)

	I0127 20:10:38.146171   10821 preload.go:132] Checking if preload exists for k8s version v1.26.1 and runtime docker

	I0127 20:10:38.146262   10821 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}

	I0127 20:10:38.163727   10821 docker.go:630] Got preloaded images: 

	I0127 20:10:38.163740   10821 docker.go:636] registry.k8s.io/kube-apiserver:v1.26.1 wasn't preloaded

	I0127 20:10:38.163790   10821 ssh_runner.go:195] Run: sudo cat /var/lib/docker/image/overlay2/repositories.json

	I0127 20:10:38.170075   10821 ssh_runner.go:195] Run: which lz4

	I0127 20:10:38.172671   10821 ssh_runner.go:195] Run: stat -c "%s %y" /preloaded.tar.lz4

	I0127 20:10:38.175277   10821 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%s %y" /preloaded.tar.lz4: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/preloaded.tar.lz4': No such file or directory

	I0127 20:10:38.175300   10821 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15565-3235/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.26.1-docker-overlay2-amd64.tar.lz4 --> /preloaded.tar.lz4 (416334111 bytes)

	I0127 20:10:39.359249   10821 docker.go:594] Took 1.186662 seconds to copy over tarball

	I0127 20:10:39.359314   10821 ssh_runner.go:195] Run: sudo tar -I lz4 -C /var -xf /preloaded.tar.lz4

	I0127 20:10:43.515602   10821 ssh_runner.go:235] Completed: sudo tar -I lz4 -C /var -xf /preloaded.tar.lz4: (4.156368776s)

	I0127 20:10:43.515622   10821 ssh_runner.go:146] rm: /preloaded.tar.lz4

	I0127 20:10:43.542556   10821 ssh_runner.go:195] Run: sudo cat /var/lib/docker/image/overlay2/repositories.json

	I0127 20:10:43.549026   10821 ssh_runner.go:362] scp memory --> /var/lib/docker/image/overlay2/repositories.json (2628 bytes)

	I0127 20:10:43.560486   10821 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0127 20:10:43.650536   10821 ssh_runner.go:195] Run: sudo systemctl restart docker

	I0127 20:10:44.971428   10821 ssh_runner.go:235] Completed: sudo systemctl restart docker: (1.320897878s)

	I0127 20:10:44.971460   10821 start.go:472] detecting cgroup driver to use...

	I0127 20:10:44.971568   10821 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///run/containerd/containerd.sock

	image-endpoint: unix:///run/containerd/containerd.sock

	" | sudo tee /etc/crictl.yaml"

	I0127 20:10:44.983551   10821 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.9"|' /etc/containerd/config.toml"

	I0127 20:10:44.990508   10821 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"

	I0127 20:10:44.997846   10821 containerd.go:145] configuring containerd to use "cgroupfs" as cgroup driver...

	I0127 20:10:44.997904   10821 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"

	I0127 20:10:45.005135   10821 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"

	I0127 20:10:45.012600   10821 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"

	I0127 20:10:45.020003   10821 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"

	I0127 20:10:45.028220   10821 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"

	I0127 20:10:45.035701   10821 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"

	I0127 20:10:45.043057   10821 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables

	I0127 20:10:45.049649   10821 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"

	I0127 20:10:45.056346   10821 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0127 20:10:45.145699   10821 ssh_runner.go:195] Run: sudo systemctl restart containerd

	I0127 20:10:45.156873   10821 start.go:472] detecting cgroup driver to use...

	I0127 20:10:45.156944   10821 ssh_runner.go:195] Run: sudo systemctl cat docker.service

	I0127 20:10:45.170725   10821 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I0127 20:10:45.180954   10821 ssh_runner.go:195] Run: sudo systemctl stop -f containerd

	I0127 20:10:45.198126   10821 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I0127 20:10:45.207030   10821 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio

	I0127 20:10:45.216057   10821 ssh_runner.go:195] Run: sudo systemctl stop -f crio

	I0127 20:10:45.243997   10821 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio

	I0127 20:10:45.253440   10821 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/cri-dockerd.sock

	image-endpoint: unix:///var/run/cri-dockerd.sock

	" | sudo tee /etc/crictl.yaml"

	I0127 20:10:45.265659   10821 ssh_runner.go:195] Run: sudo systemctl unmask docker.service

	I0127 20:10:45.362697   10821 ssh_runner.go:195] Run: sudo systemctl enable docker.socket

	I0127 20:10:45.458978   10821 docker.go:529] configuring docker to use "cgroupfs" as cgroup driver...

	I0127 20:10:45.459001   10821 ssh_runner.go:362] scp memory --> /etc/docker/daemon.json (144 bytes)

	I0127 20:10:45.470469   10821 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0127 20:10:45.562029   10821 ssh_runner.go:195] Run: sudo systemctl restart docker

	I0127 20:10:46.783339   10821 ssh_runner.go:235] Completed: sudo systemctl restart docker: (1.22131753s)

	I0127 20:10:46.783407   10821 ssh_runner.go:195] Run: sudo systemctl enable cri-docker.socket

	I0127 20:10:46.868275   10821 ssh_runner.go:195] Run: sudo systemctl unmask cri-docker.socket

	I0127 20:10:46.966622   10821 ssh_runner.go:195] Run: sudo systemctl enable cri-docker.socket

	I0127 20:10:47.064053   10821 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0127 20:10:47.152069   10821 ssh_runner.go:195] Run: sudo systemctl restart cri-docker.socket

	I0127 20:10:47.193466   10821 out.go:177] 

	W0127 20:10:47.213405   10821 out.go:239] X Exiting due to RUNTIME_ENABLE: sudo systemctl restart cri-docker.socket: Process exited with status 1

	stdout:

	stderr:

	Job failed. See "journalctl -xe" for details.

	X Exiting due to RUNTIME_ENABLE: sudo systemctl restart cri-docker.socket: Process exited with status 1

	stdout:

	stderr:

	Job failed. See "journalctl -xe" for details.

	W0127 20:10:47.213447   10821 out.go:239] * 

	* 

	W0127 20:10:47.214827   10821 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	I0127 20:10:47.298195   10821 out.go:177] 

** /stderr **

net_test.go:113: failed start: exit status 90

--- FAIL: TestNetworkPlugins/group/auto/Start (20.83s)

=== RUN   TestStartStop/group/no-preload/serial/SecondStart

start_stop_delete_test.go:256: (dbg) Run:  out/minikube-darwin-amd64 start -p no-preload-272000 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=hyperkit  --kubernetes-version=v1.26.1

E0127 20:19:43.054488    4442 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/15565-3235/.minikube/profiles/false-035000/client.crt: no such file or directory

=== CONT  TestStartStop/group/no-preload/serial/SecondStart

start_stop_delete_test.go:256: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p no-preload-272000 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=hyperkit  --kubernetes-version=v1.26.1: exit status 90 (1m16.631372764s)

-- stdout --

	* [no-preload-272000] minikube v1.28.0 on Darwin 13.2

	  - MINIKUBE_LOCATION=15565

	  - KUBECONFIG=/Users/jenkins/minikube-integration/15565-3235/kubeconfig

	  - MINIKUBE_BIN=out/minikube-darwin-amd64

	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/15565-3235/.minikube

	  - MINIKUBE_FORCE_SYSTEMD=

	* Using the hyperkit driver based on existing profile

	* Starting control plane node no-preload-272000 in cluster no-preload-272000

	* Restarting existing hyperkit VM for "no-preload-272000" ...

-- /stdout --

** stderr ** 

	I0127 20:19:40.651878   13574 out.go:296] Setting OutFile to fd 1 ...

	I0127 20:19:40.652119   13574 out.go:343] TERM=,COLORTERM=, which probably does not support color

	I0127 20:19:40.652124   13574 out.go:309] Setting ErrFile to fd 2...

	I0127 20:19:40.652129   13574 out.go:343] TERM=,COLORTERM=, which probably does not support color

	I0127 20:19:40.652246   13574 root.go:334] Updating PATH: /Users/jenkins/minikube-integration/15565-3235/.minikube/bin

	I0127 20:19:40.652723   13574 out.go:303] Setting JSON to false

	I0127 20:19:40.671221   13574 start.go:125] hostinfo: {"hostname":"MacOS-Agent-4.local","uptime":4755,"bootTime":1674874825,"procs":399,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"13.2","kernelVersion":"22.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"f2f27e25-cfda-5ffd-9706-e98286194e62"}

	W0127 20:19:40.671316   13574 start.go:133] gopshost.Virtualization returned error: not implemented yet

	I0127 20:19:40.693439   13574 out.go:177] * [no-preload-272000] minikube v1.28.0 on Darwin 13.2

	I0127 20:19:40.736073   13574 notify.go:220] Checking for updates...

	I0127 20:19:40.758129   13574 out.go:177]   - MINIKUBE_LOCATION=15565

	I0127 20:19:40.779953   13574 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/15565-3235/kubeconfig

	I0127 20:19:40.801104   13574 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64

	I0127 20:19:40.822199   13574 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I0127 20:19:40.844148   13574 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/15565-3235/.minikube

	I0127 20:19:40.866271   13574 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=

	I0127 20:19:40.888662   13574 config.go:180] Loaded profile config "no-preload-272000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.26.1

	I0127 20:19:40.889380   13574 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit

	I0127 20:19:40.889466   13574 main.go:141] libmachine: Launching plugin server for driver hyperkit

	I0127 20:19:40.897201   13574 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:56210

	I0127 20:19:40.897560   13574 main.go:141] libmachine: () Calling .GetVersion

	I0127 20:19:40.897984   13574 main.go:141] libmachine: Using API Version  1

	I0127 20:19:40.897994   13574 main.go:141] libmachine: () Calling .SetConfigRaw

	I0127 20:19:40.898200   13574 main.go:141] libmachine: () Calling .GetMachineName

	I0127 20:19:40.898305   13574 main.go:141] libmachine: (no-preload-272000) Calling .DriverName

	I0127 20:19:40.898430   13574 driver.go:365] Setting default libvirt URI to qemu:///system

	I0127 20:19:40.898693   13574 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit

	I0127 20:19:40.898714   13574 main.go:141] libmachine: Launching plugin server for driver hyperkit

	I0127 20:19:40.905322   13574 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:56212

	I0127 20:19:40.905670   13574 main.go:141] libmachine: () Calling .GetVersion

	I0127 20:19:40.905983   13574 main.go:141] libmachine: Using API Version  1

	I0127 20:19:40.905996   13574 main.go:141] libmachine: () Calling .SetConfigRaw

	I0127 20:19:40.906230   13574 main.go:141] libmachine: () Calling .GetMachineName

	I0127 20:19:40.906354   13574 main.go:141] libmachine: (no-preload-272000) Calling .DriverName

	I0127 20:19:40.933889   13574 out.go:177] * Using the hyperkit driver based on existing profile

	I0127 20:19:40.955130   13574 start.go:296] selected driver: hyperkit

	I0127 20:19:40.955159   13574 start.go:840] validating driver "hyperkit" against &{Name:no-preload-272000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/15565/minikube-v1.29.0-1674856271-15565-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.36-1674164627-15541@sha256:0a2280301e955e0d3910d6e639e0b7341db1f4a25558521ac97b38c782c6189a Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 Kubernet

esConfig:{KubernetesVersion:v1.26.1 ClusterName:no-preload-272000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.64.41 Port:8443 KubernetesVersion:v1.26.1 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:k8s.gcr.io/echoserver:1.4 MetricsServer:k8s.gcr.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] Lis

tenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP:}

	I0127 20:19:40.955349   13574 start.go:851] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}

	I0127 20:19:40.959163   13574 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0127 20:19:40.959320   13574 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/15565-3235/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin

	I0127 20:19:40.966003   13574 install.go:137] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit version is 1.28.0

	I0127 20:19:40.969310   13574 install.go:79] stdout: /Users/jenkins/workspace/out/docker-machine-driver-hyperkit

	I0127 20:19:40.969328   13574 install.go:81] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit looks good

	I0127 20:19:40.969412   13574 start_flags.go:917] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]

	I0127 20:19:40.969434   13574 cni.go:84] Creating CNI manager for ""

	I0127 20:19:40.969447   13574 cni.go:157] "hyperkit" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge

	I0127 20:19:40.969456   13574 start_flags.go:319] config:

	{Name:no-preload-272000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/15565/minikube-v1.29.0-1674856271-15565-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.36-1674164627-15541@sha256:0a2280301e955e0d3910d6e639e0b7341db1f4a25558521ac97b38c782c6189a Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.26.1 ClusterName:no-preload-272000 Namespace:defaul

t APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.64.41 Port:8443 KubernetesVersion:v1.26.1 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:k8s.gcr.io/echoserver:1.4 MetricsServer:k8s.gcr.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:

26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP:}

	I0127 20:19:40.969554   13574 iso.go:125] acquiring lock: {Name:mkeeb6f52f7fa0577f04180383dbb7ed67f33d88 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0127 20:19:41.012780   13574 out.go:177] * Starting control plane node no-preload-272000 in cluster no-preload-272000

	I0127 20:19:41.034250   13574 preload.go:132] Checking if preload exists for k8s version v1.26.1 and runtime docker

	I0127 20:19:41.034521   13574 profile.go:148] Saving config to /Users/jenkins/minikube-integration/15565-3235/.minikube/profiles/no-preload-272000/config.json ...

	I0127 20:19:41.034587   13574 cache.go:107] acquiring lock: {Name:mk174b6d1530e6e18362835dc9b8686f577480f1 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0127 20:19:41.034612   13574 cache.go:107] acquiring lock: {Name:mk6979b08b94c64df32bf734a70e87dafa8904f3 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0127 20:19:41.034649   13574 cache.go:107] acquiring lock: {Name:mk6b172fb982cddade49a5386236e53cc3aa7acf Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0127 20:19:41.034736   13574 cache.go:107] acquiring lock: {Name:mkc41747601bbe405bf9dc83de63cc74e8734cd7 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0127 20:19:41.034784   13574 cache.go:107] acquiring lock: {Name:mk7c6de2f6ea5386c3aa01275f204777bbe06839 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0127 20:19:41.034751   13574 cache.go:107] acquiring lock: {Name:mkb44f3fd0307b7ab3357b477940330984f129b6 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0127 20:19:41.034866   13574 cache.go:115] /Users/jenkins/minikube-integration/15565-3235/.minikube/cache/images/amd64/registry.k8s.io/pause_3.9 exists

	I0127 20:19:41.034860   13574 cache.go:115] /Users/jenkins/minikube-integration/15565-3235/.minikube/cache/images/amd64/gcr.io/k8s-minikube/storage-provisioner_v5 exists

	I0127 20:19:41.034900   13574 cache.go:96] cache image "registry.k8s.io/pause:3.9" -> "/Users/jenkins/minikube-integration/15565-3235/.minikube/cache/images/amd64/registry.k8s.io/pause_3.9" took 275.505µs

	I0127 20:19:41.034844   13574 cache.go:107] acquiring lock: {Name:mk8d690d1d203d5750f44824f52e8888c1423716 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0127 20:19:41.034915   13574 cache.go:96] cache image "gcr.io/k8s-minikube/storage-provisioner:v5" -> "/Users/jenkins/minikube-integration/15565-3235/.minikube/cache/images/amd64/gcr.io/k8s-minikube/storage-provisioner_v5" took 335.08µs

	I0127 20:19:41.034950   13574 cache.go:80] save to tar file registry.k8s.io/pause:3.9 -> /Users/jenkins/minikube-integration/15565-3235/.minikube/cache/images/amd64/registry.k8s.io/pause_3.9 succeeded

	I0127 20:19:41.034957   13574 cache.go:80] save to tar file gcr.io/k8s-minikube/storage-provisioner:v5 -> /Users/jenkins/minikube-integration/15565-3235/.minikube/cache/images/amd64/gcr.io/k8s-minikube/storage-provisioner_v5 succeeded

	I0127 20:19:41.034950   13574 cache.go:107] acquiring lock: {Name:mk8cfa92d19880509b7bc8eac68bb9e9cd194010 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0127 20:19:41.034991   13574 cache.go:115] /Users/jenkins/minikube-integration/15565-3235/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.26.1 exists

	I0127 20:19:41.035005   13574 cache.go:115] /Users/jenkins/minikube-integration/15565-3235/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.5.6-0 exists

	I0127 20:19:41.035011   13574 cache.go:115] /Users/jenkins/minikube-integration/15565-3235/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.26.1 exists

	I0127 20:19:41.035043   13574 cache.go:96] cache image "registry.k8s.io/etcd:3.5.6-0" -> "/Users/jenkins/minikube-integration/15565-3235/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.5.6-0" took 265.327µs

	I0127 20:19:41.035042   13574 cache.go:96] cache image "registry.k8s.io/kube-proxy:v1.26.1" -> "/Users/jenkins/minikube-integration/15565-3235/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.26.1" took 312.217µs

	I0127 20:19:41.035065   13574 cache.go:80] save to tar file registry.k8s.io/etcd:3.5.6-0 -> /Users/jenkins/minikube-integration/15565-3235/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.5.6-0 succeeded

	I0127 20:19:41.035070   13574 cache.go:80] save to tar file registry.k8s.io/kube-proxy:v1.26.1 -> /Users/jenkins/minikube-integration/15565-3235/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.26.1 succeeded

	I0127 20:19:41.035057   13574 cache.go:96] cache image "registry.k8s.io/kube-scheduler:v1.26.1" -> "/Users/jenkins/minikube-integration/15565-3235/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.26.1" took 469.987µs

	I0127 20:19:41.035095   13574 cache.go:80] save to tar file registry.k8s.io/kube-scheduler:v1.26.1 -> /Users/jenkins/minikube-integration/15565-3235/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.26.1 succeeded

	I0127 20:19:41.035089   13574 cache.go:115] /Users/jenkins/minikube-integration/15565-3235/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.26.1 exists

	I0127 20:19:41.035124   13574 cache.go:96] cache image "registry.k8s.io/kube-apiserver:v1.26.1" -> "/Users/jenkins/minikube-integration/15565-3235/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.26.1" took 407.364µs

	I0127 20:19:41.035146   13574 cache.go:80] save to tar file registry.k8s.io/kube-apiserver:v1.26.1 -> /Users/jenkins/minikube-integration/15565-3235/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.26.1 succeeded

	I0127 20:19:41.035144   13574 cache.go:115] /Users/jenkins/minikube-integration/15565-3235/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.26.1 exists

	I0127 20:19:41.035170   13574 cache.go:96] cache image "registry.k8s.io/kube-controller-manager:v1.26.1" -> "/Users/jenkins/minikube-integration/15565-3235/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.26.1" took 387.016µs

	I0127 20:19:41.035185   13574 cache.go:115] /Users/jenkins/minikube-integration/15565-3235/.minikube/cache/images/amd64/registry.k8s.io/coredns/coredns_v1.9.3 exists

	I0127 20:19:41.035188   13574 cache.go:80] save to tar file registry.k8s.io/kube-controller-manager:v1.26.1 -> /Users/jenkins/minikube-integration/15565-3235/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.26.1 succeeded

	I0127 20:19:41.035207   13574 cache.go:96] cache image "registry.k8s.io/coredns/coredns:v1.9.3" -> "/Users/jenkins/minikube-integration/15565-3235/.minikube/cache/images/amd64/registry.k8s.io/coredns/coredns_v1.9.3" took 355.018µs

	I0127 20:19:41.035218   13574 cache.go:80] save to tar file registry.k8s.io/coredns/coredns:v1.9.3 -> /Users/jenkins/minikube-integration/15565-3235/.minikube/cache/images/amd64/registry.k8s.io/coredns/coredns_v1.9.3 succeeded

	I0127 20:19:41.035231   13574 cache.go:87] Successfully saved all images to host disk.

	I0127 20:19:41.035508   13574 cache.go:193] Successfully downloaded all kic artifacts

	I0127 20:19:41.035565   13574 start.go:364] acquiring machines lock for no-preload-272000: {Name:mk69c04a34b14d26e3f74e414bcb566a33d5b215 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0127 20:19:41.035664   13574 start.go:368] acquired machines lock for "no-preload-272000" in 81.944µs

	I0127 20:19:41.035693   13574 start.go:96] Skipping create...Using existing machine configuration

	I0127 20:19:41.035707   13574 fix.go:55] fixHost starting: 

	I0127 20:19:41.036147   13574 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit

	I0127 20:19:41.036183   13574 main.go:141] libmachine: Launching plugin server for driver hyperkit

	I0127 20:19:41.043759   13574 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:56214

	I0127 20:19:41.044120   13574 main.go:141] libmachine: () Calling .GetVersion

	I0127 20:19:41.044513   13574 main.go:141] libmachine: Using API Version  1

	I0127 20:19:41.044530   13574 main.go:141] libmachine: () Calling .SetConfigRaw

	I0127 20:19:41.044757   13574 main.go:141] libmachine: () Calling .GetMachineName

	I0127 20:19:41.044865   13574 main.go:141] libmachine: (no-preload-272000) Calling .DriverName

	I0127 20:19:41.044961   13574 main.go:141] libmachine: (no-preload-272000) Calling .GetState

	I0127 20:19:41.045052   13574 main.go:141] libmachine: (no-preload-272000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0

	I0127 20:19:41.045121   13574 main.go:141] libmachine: (no-preload-272000) DBG | hyperkit pid from json: 13252

	I0127 20:19:41.045975   13574 main.go:141] libmachine: (no-preload-272000) DBG | hyperkit pid 13252 missing from process table

	I0127 20:19:41.046008   13574 fix.go:103] recreateIfNeeded on no-preload-272000: state=Stopped err=<nil>

	I0127 20:19:41.046024   13574 main.go:141] libmachine: (no-preload-272000) Calling .DriverName

	W0127 20:19:41.046113   13574 fix.go:129] unexpected machine state, will restart: <nil>

	I0127 20:19:41.066936   13574 out.go:177] * Restarting existing hyperkit VM for "no-preload-272000" ...

	I0127 20:19:41.087907   13574 main.go:141] libmachine: (no-preload-272000) Calling .Start

	I0127 20:19:41.088126   13574 main.go:141] libmachine: (no-preload-272000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0

	I0127 20:19:41.088151   13574 main.go:141] libmachine: (no-preload-272000) minikube might have been shutdown in an unclean way, the hyperkit pid file still exists: /Users/jenkins/minikube-integration/15565-3235/.minikube/machines/no-preload-272000/hyperkit.pid

	I0127 20:19:41.088993   13574 main.go:141] libmachine: (no-preload-272000) DBG | hyperkit pid 13252 missing from process table

	I0127 20:19:41.089002   13574 main.go:141] libmachine: (no-preload-272000) DBG | pid 13252 is in state "Stopped"

	I0127 20:19:41.089017   13574 main.go:141] libmachine: (no-preload-272000) DBG | Removing stale pid file /Users/jenkins/minikube-integration/15565-3235/.minikube/machines/no-preload-272000/hyperkit.pid...

	I0127 20:19:41.089155   13574 main.go:141] libmachine: (no-preload-272000) DBG | Using UUID b65cf4ac-9ec2-11ed-a719-149d997fca88

	I0127 20:19:41.118221   13574 main.go:141] libmachine: (no-preload-272000) DBG | Generated MAC 96:1e:f3:16:73:71

	I0127 20:19:41.118248   13574 main.go:141] libmachine: (no-preload-272000) DBG | Starting with cmdline: loglevel=3 console=ttyS0 console=tty0 noembed nomodeset norestore waitusb=10 systemd.legacy_systemd_cgroup_controller=yes random.trust_cpu=on hw_rng_model=virtio base host=no-preload-272000

	I0127 20:19:41.118380   13574 main.go:141] libmachine: (no-preload-272000) DBG | 2023/01/27 20:19:41 DEBUG: hyperkit: Start &hyperkit.HyperKit{HyperKit:"/usr/local/bin/hyperkit", Argv0:"", StateDir:"/Users/jenkins/minikube-integration/15565-3235/.minikube/machines/no-preload-272000", VPNKitSock:"", VPNKitUUID:"", VPNKitPreferredIPv4:"", UUID:"b65cf4ac-9ec2-11ed-a719-149d997fca88", Disks:[]hyperkit.Disk{(*hyperkit.RawDisk)(0xc0003c7b90)}, ISOImages:[]string{"/Users/jenkins/minikube-integration/15565-3235/.minikube/machines/no-preload-272000/boot2docker.iso"}, VSock:false, VSockDir:"", VSockPorts:[]int(nil), VSockGuestCID:3, VMNet:true, Sockets9P:[]hyperkit.Socket9P(nil), Kernel:"/Users/jenkins/minikube-integration/15565-3235/.minikube/machines/no-preload-272000/bzimage", Initrd:"/Users/jenkins/minikube-integration/15565-3235/.minikube/machines/no-preload-272000/initrd", Bootrom:"", CPUs:2, Memory:2200, Console:1, Serials:[]hyperkit.Serial(nil), Pid:0, Arguments:[]string(nil), CmdLine:"", process:(*os.

Process)(nil)}

	I0127 20:19:41.118437   13574 main.go:141] libmachine: (no-preload-272000) DBG | 2023/01/27 20:19:41 DEBUG: hyperkit: check &hyperkit.HyperKit{HyperKit:"/usr/local/bin/hyperkit", Argv0:"", StateDir:"/Users/jenkins/minikube-integration/15565-3235/.minikube/machines/no-preload-272000", VPNKitSock:"", VPNKitUUID:"", VPNKitPreferredIPv4:"", UUID:"b65cf4ac-9ec2-11ed-a719-149d997fca88", Disks:[]hyperkit.Disk{(*hyperkit.RawDisk)(0xc0003c7b90)}, ISOImages:[]string{"/Users/jenkins/minikube-integration/15565-3235/.minikube/machines/no-preload-272000/boot2docker.iso"}, VSock:false, VSockDir:"", VSockPorts:[]int(nil), VSockGuestCID:3, VMNet:true, Sockets9P:[]hyperkit.Socket9P(nil), Kernel:"/Users/jenkins/minikube-integration/15565-3235/.minikube/machines/no-preload-272000/bzimage", Initrd:"/Users/jenkins/minikube-integration/15565-3235/.minikube/machines/no-preload-272000/initrd", Bootrom:"", CPUs:2, Memory:2200, Console:1, Serials:[]hyperkit.Serial(nil), Pid:0, Arguments:[]string(nil), CmdLine:"", process:(*os.

Process)(nil)}

	I0127 20:19:41.118494   13574 main.go:141] libmachine: (no-preload-272000) DBG | 2023/01/27 20:19:41 DEBUG: hyperkit: Arguments: []string{"-A", "-u", "-F", "/Users/jenkins/minikube-integration/15565-3235/.minikube/machines/no-preload-272000/hyperkit.pid", "-c", "2", "-m", "2200M", "-s", "0:0,hostbridge", "-s", "31,lpc", "-s", "1:0,virtio-net", "-U", "b65cf4ac-9ec2-11ed-a719-149d997fca88", "-s", "2:0,virtio-blk,/Users/jenkins/minikube-integration/15565-3235/.minikube/machines/no-preload-272000/no-preload-272000.rawdisk", "-s", "3,ahci-cd,/Users/jenkins/minikube-integration/15565-3235/.minikube/machines/no-preload-272000/boot2docker.iso", "-s", "4,virtio-rnd", "-l", "com1,autopty=/Users/jenkins/minikube-integration/15565-3235/.minikube/machines/no-preload-272000/tty,log=/Users/jenkins/minikube-integration/15565-3235/.minikube/machines/no-preload-272000/console-ring", "-f", "kexec,/Users/jenkins/minikube-integration/15565-3235/.minikube/machines/no-preload-272000/bzimage,/Users/jenkins/minikube-integrat

ion/15565-3235/.minikube/machines/no-preload-272000/initrd,earlyprintk=serial loglevel=3 console=ttyS0 console=tty0 noembed nomodeset norestore waitusb=10 systemd.legacy_systemd_cgroup_controller=yes random.trust_cpu=on hw_rng_model=virtio base host=no-preload-272000"}

	I0127 20:19:41.118528   13574 main.go:141] libmachine: (no-preload-272000) DBG | 2023/01/27 20:19:41 DEBUG: hyperkit: CmdLine: "/usr/local/bin/hyperkit -A -u -F /Users/jenkins/minikube-integration/15565-3235/.minikube/machines/no-preload-272000/hyperkit.pid -c 2 -m 2200M -s 0:0,hostbridge -s 31,lpc -s 1:0,virtio-net -U b65cf4ac-9ec2-11ed-a719-149d997fca88 -s 2:0,virtio-blk,/Users/jenkins/minikube-integration/15565-3235/.minikube/machines/no-preload-272000/no-preload-272000.rawdisk -s 3,ahci-cd,/Users/jenkins/minikube-integration/15565-3235/.minikube/machines/no-preload-272000/boot2docker.iso -s 4,virtio-rnd -l com1,autopty=/Users/jenkins/minikube-integration/15565-3235/.minikube/machines/no-preload-272000/tty,log=/Users/jenkins/minikube-integration/15565-3235/.minikube/machines/no-preload-272000/console-ring -f kexec,/Users/jenkins/minikube-integration/15565-3235/.minikube/machines/no-preload-272000/bzimage,/Users/jenkins/minikube-integration/15565-3235/.minikube/machines/no-preload-272000/initrd,ear

lyprintk=serial loglevel=3 console=ttyS0 console=tty0 noembed nomodeset norestore waitusb=10 systemd.legacy_systemd_cgroup_controller=yes random.trust_cpu=on hw_rng_model=virtio base host=no-preload-272000"

	I0127 20:19:41.118582   13574 main.go:141] libmachine: (no-preload-272000) DBG | 2023/01/27 20:19:41 DEBUG: hyperkit: Redirecting stdout/stderr to logger

	I0127 20:19:41.119669   13574 main.go:141] libmachine: (no-preload-272000) DBG | 2023/01/27 20:19:41 DEBUG: hyperkit: Pid is 13586

	I0127 20:19:41.120015   13574 main.go:141] libmachine: (no-preload-272000) DBG | Attempt 0

	I0127 20:19:41.120023   13574 main.go:141] libmachine: (no-preload-272000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0

	I0127 20:19:41.120120   13574 main.go:141] libmachine: (no-preload-272000) DBG | hyperkit pid from json: 13586

	I0127 20:19:41.121919   13574 main.go:141] libmachine: (no-preload-272000) DBG | Searching for 96:1e:f3:16:73:71 in /var/db/dhcpd_leases ...

	I0127 20:19:41.122007   13574 main.go:141] libmachine: (no-preload-272000) DBG | Found 40 entries in /var/db/dhcpd_leases!

	I0127 20:19:41.122023   13574 main.go:141] libmachine: (no-preload-272000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.41 HWAddress:96:1e:f3:16:73:71 ID:1,96:1e:f3:16:73:71 Lease:0x63d5f370}

	I0127 20:19:41.122032   13574 main.go:141] libmachine: (no-preload-272000) DBG | Found match: 96:1e:f3:16:73:71

	I0127 20:19:41.122043   13574 main.go:141] libmachine: (no-preload-272000) DBG | IP: 192.168.64.41

	I0127 20:19:41.122116   13574 main.go:141] libmachine: (no-preload-272000) Calling .GetConfigRaw

	I0127 20:19:41.122673   13574 main.go:141] libmachine: (no-preload-272000) Calling .GetIP

	I0127 20:19:41.122836   13574 profile.go:148] Saving config to /Users/jenkins/minikube-integration/15565-3235/.minikube/profiles/no-preload-272000/config.json ...

	I0127 20:19:41.123162   13574 machine.go:88] provisioning docker machine ...

	I0127 20:19:41.123172   13574 main.go:141] libmachine: (no-preload-272000) Calling .DriverName

	I0127 20:19:41.123301   13574 main.go:141] libmachine: (no-preload-272000) Calling .GetMachineName

	I0127 20:19:41.123414   13574 buildroot.go:166] provisioning hostname "no-preload-272000"

	I0127 20:19:41.123424   13574 main.go:141] libmachine: (no-preload-272000) Calling .GetMachineName

	I0127 20:19:41.123555   13574 main.go:141] libmachine: (no-preload-272000) Calling .GetSSHHostname

	I0127 20:19:41.123649   13574 main.go:141] libmachine: (no-preload-272000) Calling .GetSSHPort

	I0127 20:19:41.123755   13574 main.go:141] libmachine: (no-preload-272000) Calling .GetSSHKeyPath

	I0127 20:19:41.123855   13574 main.go:141] libmachine: (no-preload-272000) Calling .GetSSHKeyPath

	I0127 20:19:41.123946   13574 main.go:141] libmachine: (no-preload-272000) Calling .GetSSHUsername

	I0127 20:19:41.124099   13574 main.go:141] libmachine: Using SSH client type: native

	I0127 20:19:41.124307   13574 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x13ec500] 0x13ef680 <nil>  [] 0s} 192.168.64.41 22 <nil> <nil>}

	I0127 20:19:41.124320   13574 main.go:141] libmachine: About to run SSH command:

	sudo hostname no-preload-272000 && echo "no-preload-272000" | sudo tee /etc/hostname

	I0127 20:19:41.126448   13574 main.go:141] libmachine: (no-preload-272000) DBG | 2023/01/27 20:19:41 INFO : hyperkit: stderr: Using fd 5 for I/O notifications

	I0127 20:19:41.134059   13574 main.go:141] libmachine: (no-preload-272000) DBG | 2023/01/27 20:19:41 INFO : hyperkit: stderr: /Users/jenkins/minikube-integration/15565-3235/.minikube/machines/no-preload-272000/boot2docker.iso: fcntl(F_PUNCHHOLE) Operation not permitted: block device will not support TRIM/DISCARD

	I0127 20:19:41.134845   13574 main.go:141] libmachine: (no-preload-272000) DBG | 2023/01/27 20:19:41 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 2 bit: 22 unspecified don't care: bit is 0

	I0127 20:19:41.134858   13574 main.go:141] libmachine: (no-preload-272000) DBG | 2023/01/27 20:19:41 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 4 bit: 12 unspecified don't care: bit is 0

	I0127 20:19:41.134870   13574 main.go:141] libmachine: (no-preload-272000) DBG | 2023/01/27 20:19:41 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 4 bit: 20 unspecified don't care: bit is 0

	I0127 20:19:41.134883   13574 main.go:141] libmachine: (no-preload-272000) DBG | 2023/01/27 20:19:41 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 3 bit: 13 unspecified don't care: bit is 0

	I0127 20:19:41.494475   13574 main.go:141] libmachine: (no-preload-272000) DBG | 2023/01/27 20:19:41 INFO : hyperkit: stderr: rdmsr to register 0x3a on vcpu 0

	I0127 20:19:41.494491   13574 main.go:141] libmachine: (no-preload-272000) DBG | 2023/01/27 20:19:41 INFO : hyperkit: stderr: rdmsr to register 0x140 on vcpu 0

	I0127 20:19:41.598480   13574 main.go:141] libmachine: (no-preload-272000) DBG | 2023/01/27 20:19:41 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 2 bit: 22 unspecified don't care: bit is 0

	I0127 20:19:41.598498   13574 main.go:141] libmachine: (no-preload-272000) DBG | 2023/01/27 20:19:41 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 4 bit: 12 unspecified don't care: bit is 0

	I0127 20:19:41.598512   13574 main.go:141] libmachine: (no-preload-272000) DBG | 2023/01/27 20:19:41 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 4 bit: 20 unspecified don't care: bit is 0

	I0127 20:19:41.598577   13574 main.go:141] libmachine: (no-preload-272000) DBG | 2023/01/27 20:19:41 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 3 bit: 13 unspecified don't care: bit is 0

	I0127 20:19:41.599411   13574 main.go:141] libmachine: (no-preload-272000) DBG | 2023/01/27 20:19:41 INFO : hyperkit: stderr: rdmsr to register 0x3a on vcpu 1

	I0127 20:19:41.599424   13574 main.go:141] libmachine: (no-preload-272000) DBG | 2023/01/27 20:19:41 INFO : hyperkit: stderr: rdmsr to register 0x140 on vcpu 1

	I0127 20:19:46.060078   13574 main.go:141] libmachine: (no-preload-272000) DBG | 2023/01/27 20:19:46 INFO : hyperkit: stderr: rdmsr to register 0x64d on vcpu 1

	I0127 20:19:46.060116   13574 main.go:141] libmachine: (no-preload-272000) DBG | 2023/01/27 20:19:46 INFO : hyperkit: stderr: rdmsr to register 0x64e on vcpu 1

	I0127 20:19:46.060132   13574 main.go:141] libmachine: (no-preload-272000) DBG | 2023/01/27 20:19:46 INFO : hyperkit: stderr: rdmsr to register 0x34 on vcpu 1

	I0127 20:19:54.314652   13574 main.go:141] libmachine: SSH cmd err, output: <nil>: no-preload-272000

	I0127 20:19:54.314673   13574 main.go:141] libmachine: (no-preload-272000) Calling .GetSSHHostname

	I0127 20:19:54.314808   13574 main.go:141] libmachine: (no-preload-272000) Calling .GetSSHPort

	I0127 20:19:54.314907   13574 main.go:141] libmachine: (no-preload-272000) Calling .GetSSHKeyPath

	I0127 20:19:54.315004   13574 main.go:141] libmachine: (no-preload-272000) Calling .GetSSHKeyPath

	I0127 20:19:54.315093   13574 main.go:141] libmachine: (no-preload-272000) Calling .GetSSHUsername

	I0127 20:19:54.315264   13574 main.go:141] libmachine: Using SSH client type: native

	I0127 20:19:54.315399   13574 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x13ec500] 0x13ef680 <nil>  [] 0s} 192.168.64.41 22 <nil> <nil>}

	I0127 20:19:54.315411   13574 main.go:141] libmachine: About to run SSH command:

			if ! grep -xq '.*\sno-preload-272000' /etc/hosts; then

				if grep -xq '127.0.1.1\s.*' /etc/hosts; then

					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 no-preload-272000/g' /etc/hosts;

				else 

					echo '127.0.1.1 no-preload-272000' | sudo tee -a /etc/hosts; 

				fi

			fi

	I0127 20:19:54.384673   13574 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I0127 20:19:54.384689   13574 buildroot.go:172] set auth options {CertDir:/Users/jenkins/minikube-integration/15565-3235/.minikube CaCertPath:/Users/jenkins/minikube-integration/15565-3235/.minikube/certs/ca.pem CaPrivateKeyPath:/Users/jenkins/minikube-integration/15565-3235/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/Users/jenkins/minikube-integration/15565-3235/.minikube/machines/server.pem ServerKeyPath:/Users/jenkins/minikube-integration/15565-3235/.minikube/machines/server-key.pem ClientKeyPath:/Users/jenkins/minikube-integration/15565-3235/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/Users/jenkins/minikube-integration/15565-3235/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/Users/jenkins/minikube-integration/15565-3235/.minikube}

	I0127 20:19:54.384704   13574 buildroot.go:174] setting up certificates

	I0127 20:19:54.384714   13574 provision.go:83] configureAuth start

	I0127 20:19:54.384721   13574 main.go:141] libmachine: (no-preload-272000) Calling .GetMachineName

	I0127 20:19:54.384855   13574 main.go:141] libmachine: (no-preload-272000) Calling .GetIP

	I0127 20:19:54.384953   13574 main.go:141] libmachine: (no-preload-272000) Calling .GetSSHHostname

	I0127 20:19:54.385040   13574 provision.go:138] copyHostCerts

	I0127 20:19:54.385125   13574 exec_runner.go:144] found /Users/jenkins/minikube-integration/15565-3235/.minikube/key.pem, removing ...

	I0127 20:19:54.385134   13574 exec_runner.go:207] rm: /Users/jenkins/minikube-integration/15565-3235/.minikube/key.pem

	I0127 20:19:54.385256   13574 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/15565-3235/.minikube/certs/key.pem --> /Users/jenkins/minikube-integration/15565-3235/.minikube/key.pem (1675 bytes)

	I0127 20:19:54.385488   13574 exec_runner.go:144] found /Users/jenkins/minikube-integration/15565-3235/.minikube/ca.pem, removing ...

	I0127 20:19:54.385494   13574 exec_runner.go:207] rm: /Users/jenkins/minikube-integration/15565-3235/.minikube/ca.pem

	I0127 20:19:54.385557   13574 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/15565-3235/.minikube/certs/ca.pem --> /Users/jenkins/minikube-integration/15565-3235/.minikube/ca.pem (1082 bytes)

	I0127 20:19:54.385712   13574 exec_runner.go:144] found /Users/jenkins/minikube-integration/15565-3235/.minikube/cert.pem, removing ...

	I0127 20:19:54.385718   13574 exec_runner.go:207] rm: /Users/jenkins/minikube-integration/15565-3235/.minikube/cert.pem

	I0127 20:19:54.385777   13574 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/15565-3235/.minikube/certs/cert.pem --> /Users/jenkins/minikube-integration/15565-3235/.minikube/cert.pem (1123 bytes)

	I0127 20:19:54.385903   13574 provision.go:112] generating server cert: /Users/jenkins/minikube-integration/15565-3235/.minikube/machines/server.pem ca-key=/Users/jenkins/minikube-integration/15565-3235/.minikube/certs/ca.pem private-key=/Users/jenkins/minikube-integration/15565-3235/.minikube/certs/ca-key.pem org=jenkins.no-preload-272000 san=[192.168.64.41 192.168.64.41 localhost 127.0.0.1 minikube no-preload-272000]

	I0127 20:19:54.448389   13574 provision.go:172] copyRemoteCerts

	I0127 20:19:54.448440   13574 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker

	I0127 20:19:54.448453   13574 main.go:141] libmachine: (no-preload-272000) Calling .GetSSHHostname

	I0127 20:19:54.448570   13574 main.go:141] libmachine: (no-preload-272000) Calling .GetSSHPort

	I0127 20:19:54.448650   13574 main.go:141] libmachine: (no-preload-272000) Calling .GetSSHKeyPath

	I0127 20:19:54.448751   13574 main.go:141] libmachine: (no-preload-272000) Calling .GetSSHUsername

	I0127 20:19:54.448857   13574 sshutil.go:53] new ssh client: &{IP:192.168.64.41 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/15565-3235/.minikube/machines/no-preload-272000/id_rsa Username:docker}

	I0127 20:19:54.487040   13574 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15565-3235/.minikube/machines/server.pem --> /etc/docker/server.pem (1229 bytes)

	I0127 20:19:54.502118   13574 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15565-3235/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)

	I0127 20:19:54.517240   13574 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15565-3235/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)

	I0127 20:19:54.532219   13574 provision.go:86] duration metric: configureAuth took 147.490013ms

	I0127 20:19:54.532229   13574 buildroot.go:189] setting minikube options for container-runtime

	I0127 20:19:54.532382   13574 config.go:180] Loaded profile config "no-preload-272000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.26.1

	I0127 20:19:54.532394   13574 main.go:141] libmachine: (no-preload-272000) Calling .DriverName

	I0127 20:19:54.532517   13574 main.go:141] libmachine: (no-preload-272000) Calling .GetSSHHostname

	I0127 20:19:54.532601   13574 main.go:141] libmachine: (no-preload-272000) Calling .GetSSHPort

	I0127 20:19:54.532688   13574 main.go:141] libmachine: (no-preload-272000) Calling .GetSSHKeyPath

	I0127 20:19:54.532775   13574 main.go:141] libmachine: (no-preload-272000) Calling .GetSSHKeyPath

	I0127 20:19:54.532847   13574 main.go:141] libmachine: (no-preload-272000) Calling .GetSSHUsername

	I0127 20:19:54.532960   13574 main.go:141] libmachine: Using SSH client type: native

	I0127 20:19:54.533065   13574 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x13ec500] 0x13ef680 <nil>  [] 0s} 192.168.64.41 22 <nil> <nil>}

	I0127 20:19:54.533073   13574 main.go:141] libmachine: About to run SSH command:

	df --output=fstype / | tail -n 1

	I0127 20:19:54.598370   13574 main.go:141] libmachine: SSH cmd err, output: <nil>: tmpfs

	I0127 20:19:54.598382   13574 buildroot.go:70] root file system type: tmpfs

	I0127 20:19:54.598513   13574 provision.go:309] Updating docker unit: /lib/systemd/system/docker.service ...

	I0127 20:19:54.598529   13574 main.go:141] libmachine: (no-preload-272000) Calling .GetSSHHostname

	I0127 20:19:54.598658   13574 main.go:141] libmachine: (no-preload-272000) Calling .GetSSHPort

	I0127 20:19:54.598761   13574 main.go:141] libmachine: (no-preload-272000) Calling .GetSSHKeyPath

	I0127 20:19:54.598853   13574 main.go:141] libmachine: (no-preload-272000) Calling .GetSSHKeyPath

	I0127 20:19:54.598931   13574 main.go:141] libmachine: (no-preload-272000) Calling .GetSSHUsername

	I0127 20:19:54.599059   13574 main.go:141] libmachine: Using SSH client type: native

	I0127 20:19:54.599171   13574 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x13ec500] 0x13ef680 <nil>  [] 0s} 192.168.64.41 22 <nil> <nil>}

	I0127 20:19:54.599216   13574 main.go:141] libmachine: About to run SSH command:

	sudo mkdir -p /lib/systemd/system && printf %s "[Unit]

	Description=Docker Application Container Engine

	Documentation=https://docs.docker.com

	After=network.target  minikube-automount.service docker.socket

	Requires= minikube-automount.service docker.socket 

	StartLimitBurst=3

	StartLimitIntervalSec=60

	[Service]

	Type=notify

	Restart=on-failure

	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	# The base configuration already specifies an 'ExecStart=...' command. The first directive

	# here is to clear out that command inherited from the base configuration. Without this,

	# the command from the base configuration and the command specified here are treated as

	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	# will catch this invalid input and refuse to start the service with an error like:

	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	ExecStart=

	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=hyperkit --insecure-registry 10.96.0.0/12 

	ExecReload=/bin/kill -s HUP \$MAINPID

	# Having non-zero Limit*s causes performance problems due to accounting overhead

	# in the kernel. We recommend using cgroups to do container-local accounting.

	LimitNOFILE=infinity

	LimitNPROC=infinity

	LimitCORE=infinity

	# Uncomment TasksMax if your systemd version supports it.

	# Only systemd 226 and above support this version.

	TasksMax=infinity

	TimeoutStartSec=0

	# set delegate yes so that systemd does not reset the cgroups of docker containers

	Delegate=yes

	# kill only the docker process, not all processes in the cgroup

	KillMode=process

	[Install]

	WantedBy=multi-user.target

	" | sudo tee /lib/systemd/system/docker.service.new

	I0127 20:19:54.675973   13574 main.go:141] libmachine: SSH cmd err, output: <nil>: [Unit]

	Description=Docker Application Container Engine

	Documentation=https://docs.docker.com

	After=network.target  minikube-automount.service docker.socket

	Requires= minikube-automount.service docker.socket 

	StartLimitBurst=3

	StartLimitIntervalSec=60

	[Service]

	Type=notify

	Restart=on-failure

	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	# The base configuration already specifies an 'ExecStart=...' command. The first directive

	# here is to clear out that command inherited from the base configuration. Without this,

	# the command from the base configuration and the command specified here are treated as

	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	# will catch this invalid input and refuse to start the service with an error like:

	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	ExecStart=

	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=hyperkit --insecure-registry 10.96.0.0/12 

	ExecReload=/bin/kill -s HUP $MAINPID

	# Having non-zero Limit*s causes performance problems due to accounting overhead

	# in the kernel. We recommend using cgroups to do container-local accounting.

	LimitNOFILE=infinity

	LimitNPROC=infinity

	LimitCORE=infinity

	# Uncomment TasksMax if your systemd version supports it.

	# Only systemd 226 and above support this version.

	TasksMax=infinity

	TimeoutStartSec=0

	# set delegate yes so that systemd does not reset the cgroups of docker containers

	Delegate=yes

	# kill only the docker process, not all processes in the cgroup

	KillMode=process

	[Install]

	WantedBy=multi-user.target

	I0127 20:19:54.675994   13574 main.go:141] libmachine: (no-preload-272000) Calling .GetSSHHostname

	I0127 20:19:54.676143   13574 main.go:141] libmachine: (no-preload-272000) Calling .GetSSHPort

	I0127 20:19:54.676245   13574 main.go:141] libmachine: (no-preload-272000) Calling .GetSSHKeyPath

	I0127 20:19:54.676358   13574 main.go:141] libmachine: (no-preload-272000) Calling .GetSSHKeyPath

	I0127 20:19:54.676449   13574 main.go:141] libmachine: (no-preload-272000) Calling .GetSSHUsername

	I0127 20:19:54.676578   13574 main.go:141] libmachine: Using SSH client type: native

	I0127 20:19:54.676684   13574 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x13ec500] 0x13ef680 <nil>  [] 0s} 192.168.64.41 22 <nil> <nil>}

	I0127 20:19:54.676698   13574 main.go:141] libmachine: About to run SSH command:

	sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }

	I0127 20:19:55.214708   13574 main.go:141] libmachine: SSH cmd err, output: <nil>: diff: can't stat '/lib/systemd/system/docker.service': No such file or directory

	Created symlink /etc/systemd/system/multi-user.target.wants/docker.service → /usr/lib/systemd/system/docker.service.

	I0127 20:19:55.214721   13574 machine.go:91] provisioned docker machine in 14.09082043s

	I0127 20:19:55.214732   13574 start.go:300] post-start starting for "no-preload-272000" (driver="hyperkit")

	I0127 20:19:55.214738   13574 start.go:328] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]

	I0127 20:19:55.214748   13574 main.go:141] libmachine: (no-preload-272000) Calling .DriverName

	I0127 20:19:55.214937   13574 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs

	I0127 20:19:55.214952   13574 main.go:141] libmachine: (no-preload-272000) Calling .GetSSHHostname

	I0127 20:19:55.215043   13574 main.go:141] libmachine: (no-preload-272000) Calling .GetSSHPort

	I0127 20:19:55.215131   13574 main.go:141] libmachine: (no-preload-272000) Calling .GetSSHKeyPath

	I0127 20:19:55.215218   13574 main.go:141] libmachine: (no-preload-272000) Calling .GetSSHUsername

	I0127 20:19:55.215303   13574 sshutil.go:53] new ssh client: &{IP:192.168.64.41 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/15565-3235/.minikube/machines/no-preload-272000/id_rsa Username:docker}

	I0127 20:19:55.256698   13574 ssh_runner.go:195] Run: cat /etc/os-release

	I0127 20:19:55.259266   13574 info.go:137] Remote host: Buildroot 2021.02.12

	I0127 20:19:55.259278   13574 filesync.go:126] Scanning /Users/jenkins/minikube-integration/15565-3235/.minikube/addons for local assets ...

	I0127 20:19:55.259368   13574 filesync.go:126] Scanning /Users/jenkins/minikube-integration/15565-3235/.minikube/files for local assets ...

	I0127 20:19:55.259537   13574 filesync.go:149] local asset: /Users/jenkins/minikube-integration/15565-3235/.minikube/files/etc/ssl/certs/44422.pem -> 44422.pem in /etc/ssl/certs

	I0127 20:19:55.259722   13574 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs

	I0127 20:19:55.265443   13574 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15565-3235/.minikube/files/etc/ssl/certs/44422.pem --> /etc/ssl/certs/44422.pem (1708 bytes)

	I0127 20:19:55.281252   13574 start.go:303] post-start completed in 66.510907ms

	I0127 20:19:55.281267   13574 fix.go:57] fixHost completed within 14.244824641s

	I0127 20:19:55.281280   13574 main.go:141] libmachine: (no-preload-272000) Calling .GetSSHHostname

	I0127 20:19:55.281416   13574 main.go:141] libmachine: (no-preload-272000) Calling .GetSSHPort

	I0127 20:19:55.281505   13574 main.go:141] libmachine: (no-preload-272000) Calling .GetSSHKeyPath

	I0127 20:19:55.281595   13574 main.go:141] libmachine: (no-preload-272000) Calling .GetSSHKeyPath

	I0127 20:19:55.281690   13574 main.go:141] libmachine: (no-preload-272000) Calling .GetSSHUsername

	I0127 20:19:55.281825   13574 main.go:141] libmachine: Using SSH client type: native

	I0127 20:19:55.281939   13574 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x13ec500] 0x13ef680 <nil>  [] 0s} 192.168.64.41 22 <nil> <nil>}

	I0127 20:19:55.281947   13574 main.go:141] libmachine: About to run SSH command:

	date +%s.%N

	I0127 20:19:55.346523   13574 main.go:141] libmachine: SSH cmd err, output: <nil>: 1674879595.534611557

	I0127 20:19:55.346533   13574 fix.go:207] guest clock: 1674879595.534611557

	I0127 20:19:55.346538   13574 fix.go:220] Guest: 2023-01-27 20:19:55.534611557 -0800 PST Remote: 2023-01-27 20:19:55.28127 -0800 PST m=+14.677460358 (delta=253.341557ms)

	I0127 20:19:55.346559   13574 fix.go:191] guest clock delta is within tolerance: 253.341557ms

	I0127 20:19:55.346564   13574 start.go:83] releasing machines lock for "no-preload-272000", held for 14.310148981s

	I0127 20:19:55.346582   13574 main.go:141] libmachine: (no-preload-272000) Calling .DriverName

	I0127 20:19:55.346743   13574 main.go:141] libmachine: (no-preload-272000) Calling .GetIP

	I0127 20:19:55.346851   13574 main.go:141] libmachine: (no-preload-272000) Calling .DriverName

	I0127 20:19:55.347166   13574 main.go:141] libmachine: (no-preload-272000) Calling .DriverName

	I0127 20:19:55.347298   13574 main.go:141] libmachine: (no-preload-272000) Calling .DriverName

	I0127 20:19:55.347374   13574 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/

	I0127 20:19:55.347400   13574 main.go:141] libmachine: (no-preload-272000) Calling .GetSSHHostname

	I0127 20:19:55.347451   13574 ssh_runner.go:195] Run: cat /version.json

	I0127 20:19:55.347470   13574 main.go:141] libmachine: (no-preload-272000) Calling .GetSSHHostname

	I0127 20:19:55.347520   13574 main.go:141] libmachine: (no-preload-272000) Calling .GetSSHPort

	I0127 20:19:55.347588   13574 main.go:141] libmachine: (no-preload-272000) Calling .GetSSHPort

	I0127 20:19:55.347619   13574 main.go:141] libmachine: (no-preload-272000) Calling .GetSSHKeyPath

	I0127 20:19:55.347724   13574 main.go:141] libmachine: (no-preload-272000) Calling .GetSSHUsername

	I0127 20:19:55.347744   13574 main.go:141] libmachine: (no-preload-272000) Calling .GetSSHKeyPath

	I0127 20:19:55.347807   13574 sshutil.go:53] new ssh client: &{IP:192.168.64.41 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/15565-3235/.minikube/machines/no-preload-272000/id_rsa Username:docker}

	I0127 20:19:55.347827   13574 main.go:141] libmachine: (no-preload-272000) Calling .GetSSHUsername

	I0127 20:19:55.347924   13574 sshutil.go:53] new ssh client: &{IP:192.168.64.41 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/15565-3235/.minikube/machines/no-preload-272000/id_rsa Username:docker}

	W0127 20:19:55.383093   13574 out.go:239] ! Image was not built for the current minikube version. To resolve this you can delete and recreate your minikube cluster using the latest images. Expected minikube version: v1.29.0-1674856271-15565 -> Actual minikube version: v1.28.0

	! Image was not built for the current minikube version. To resolve this you can delete and recreate your minikube cluster using the latest images. Expected minikube version: v1.29.0-1674856271-15565 -> Actual minikube version: v1.28.0

	I0127 20:19:55.383162   13574 ssh_runner.go:195] Run: systemctl --version

	I0127 20:19:55.428724   13574 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"

	W0127 20:19:55.433582   13574 cni.go:208] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found

	I0127 20:19:55.433671   13574 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/cri-docker.service.d

	I0127 20:19:55.440969   13574 ssh_runner.go:362] scp memory --> /etc/systemd/system/cri-docker.service.d/10-cni.conf (135 bytes)

	I0127 20:19:55.455508   13574 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;

	I0127 20:19:55.469410   13574 cni.go:261] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)

	I0127 20:19:55.469425   13574 preload.go:132] Checking if preload exists for k8s version v1.26.1 and runtime docker

	I0127 20:19:55.469435   13574 start.go:472] detecting cgroup driver to use...

	I0127 20:19:55.469544   13574 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///run/containerd/containerd.sock

	image-endpoint: unix:///run/containerd/containerd.sock

	" | sudo tee /etc/crictl.yaml"

	I0127 20:19:55.486921   13574 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.9"|' /etc/containerd/config.toml"

	I0127 20:19:55.494163   13574 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"

	I0127 20:19:55.501386   13574 containerd.go:145] configuring containerd to use "cgroupfs" as cgroup driver...

	I0127 20:19:55.501449   13574 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"

	I0127 20:19:55.508830   13574 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"

	I0127 20:19:55.515676   13574 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"

	I0127 20:19:55.522654   13574 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"

	I0127 20:19:55.529686   13574 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"

	I0127 20:19:55.536910   13574 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"

	I0127 20:19:55.543922   13574 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables

	I0127 20:19:55.550299   13574 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"

	I0127 20:19:55.556707   13574 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0127 20:19:55.641310   13574 ssh_runner.go:195] Run: sudo systemctl restart containerd

	I0127 20:19:55.654354   13574 start.go:472] detecting cgroup driver to use...

	I0127 20:19:55.674567   13574 ssh_runner.go:195] Run: sudo systemctl cat docker.service

	I0127 20:19:55.684418   13574 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I0127 20:19:55.693494   13574 ssh_runner.go:195] Run: sudo systemctl stop -f containerd

	I0127 20:19:55.708316   13574 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I0127 20:19:55.717889   13574 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio

	I0127 20:19:55.726248   13574 ssh_runner.go:195] Run: sudo systemctl stop -f crio

	I0127 20:19:55.750568   13574 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio

	I0127 20:19:55.763478   13574 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/cri-dockerd.sock

	image-endpoint: unix:///var/run/cri-dockerd.sock

	" | sudo tee /etc/crictl.yaml"

	I0127 20:19:55.778370   13574 ssh_runner.go:195] Run: sudo systemctl unmask docker.service

	I0127 20:19:55.870107   13574 ssh_runner.go:195] Run: sudo systemctl enable docker.socket

	I0127 20:19:55.949187   13574 docker.go:529] configuring docker to use "cgroupfs" as cgroup driver...

	I0127 20:19:55.949206   13574 ssh_runner.go:362] scp memory --> /etc/docker/daemon.json (144 bytes)

	I0127 20:19:55.961448   13574 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0127 20:19:56.040241   13574 ssh_runner.go:195] Run: sudo systemctl restart docker

	I0127 20:20:57.072491   13574 ssh_runner.go:235] Completed: sudo systemctl restart docker: (1m1.032911028s)

	I0127 20:20:57.096981   13574 out.go:177] 

	W0127 20:20:57.117073   13574 out.go:239] X Exiting due to RUNTIME_ENABLE: sudo systemctl restart docker: Process exited with status 1

	stdout:

	stderr:

	Job for docker.service failed because the control process exited with error code.

	See "systemctl status docker.service" and "journalctl -xe" for details.

	X Exiting due to RUNTIME_ENABLE: sudo systemctl restart docker: Process exited with status 1

	stdout:

	stderr:

	Job for docker.service failed because the control process exited with error code.

	See "systemctl status docker.service" and "journalctl -xe" for details.

	W0127 20:20:57.117102   13574 out.go:239] * 

	* 

	W0127 20:20:57.118381   13574 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	I0127 20:20:57.203826   13574 out.go:177] 

** /stderr **

start_stop_delete_test.go:259: failed to start minikube post-stop. args "out/minikube-darwin-amd64 start -p no-preload-272000 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=hyperkit  --kubernetes-version=v1.26.1": exit status 90

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p no-preload-272000 -n no-preload-272000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p no-preload-272000 -n no-preload-272000: exit status 6 (146.307256ms)

-- stdout --

	Running

	WARNING: Your kubectl is pointing to stale minikube-vm.

	To fix the kubectl context, run `minikube update-context`

-- /stdout --

** stderr ** 

	E0127 20:20:57.372342   13672 status.go:415] kubeconfig endpoint: extract IP: "no-preload-272000" does not appear in /Users/jenkins/minikube-integration/15565-3235/kubeconfig

** /stderr **

helpers_test.go:239: status error: exit status 6 (may be ok)

helpers_test.go:241: "no-preload-272000" host is not running, skipping log retrieval (state="Running\nWARNING: Your kubectl is pointing to stale minikube-vm.\nTo fix the kubectl context, run `minikube update-context`")

--- FAIL: TestStartStop/group/no-preload/serial/SecondStart (76.79s)

=== RUN   TestStartStop/group/old-k8s-version/serial/SecondStart

start_stop_delete_test.go:256: (dbg) Run:  out/minikube-darwin-amd64 start -p old-k8s-version-159000 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=hyperkit  --kubernetes-version=v1.16.0

E0127 20:19:48.679931    4442 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/15565-3235/.minikube/profiles/custom-flannel-035000/client.crt: no such file or directory

E0127 20:19:58.159351    4442 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/15565-3235/.minikube/profiles/calico-035000/client.crt: no such file or directory

E0127 20:19:59.829519    4442 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/15565-3235/.minikube/profiles/enable-default-cni-035000/client.crt: no such file or directory

E0127 20:19:59.835236    4442 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/15565-3235/.minikube/profiles/enable-default-cni-035000/client.crt: no such file or directory

E0127 20:19:59.846408    4442 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/15565-3235/.minikube/profiles/enable-default-cni-035000/client.crt: no such file or directory

E0127 20:19:59.868269    4442 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/15565-3235/.minikube/profiles/enable-default-cni-035000/client.crt: no such file or directory

E0127 20:19:59.909494    4442 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/15565-3235/.minikube/profiles/enable-default-cni-035000/client.crt: no such file or directory

E0127 20:19:59.989943    4442 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/15565-3235/.minikube/profiles/enable-default-cni-035000/client.crt: no such file or directory

E0127 20:20:00.150318    4442 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/15565-3235/.minikube/profiles/enable-default-cni-035000/client.crt: no such file or directory

E0127 20:20:00.472125    4442 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/15565-3235/.minikube/profiles/enable-default-cni-035000/client.crt: no such file or directory

E0127 20:20:01.112789    4442 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/15565-3235/.minikube/profiles/enable-default-cni-035000/client.crt: no such file or directory

E0127 20:20:02.393532    4442 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/15565-3235/.minikube/profiles/enable-default-cni-035000/client.crt: no such file or directory

E0127 20:20:04.953987    4442 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/15565-3235/.minikube/profiles/enable-default-cni-035000/client.crt: no such file or directory

E0127 20:20:10.075066    4442 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/15565-3235/.minikube/profiles/enable-default-cni-035000/client.crt: no such file or directory

E0127 20:20:11.409835    4442 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/15565-3235/.minikube/profiles/skaffold-497000/client.crt: no such file or directory

E0127 20:20:11.643921    4442 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/15565-3235/.minikube/profiles/ingress-addon-legacy-294000/client.crt: no such file or directory

E0127 20:20:20.316318    4442 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/15565-3235/.minikube/profiles/enable-default-cni-035000/client.crt: no such file or directory

E0127 20:20:24.017277    4442 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/15565-3235/.minikube/profiles/false-035000/client.crt: no such file or directory

E0127 20:20:35.607544    4442 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/15565-3235/.minikube/profiles/flannel-035000/client.crt: no such file or directory

E0127 20:20:35.613929    4442 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/15565-3235/.minikube/profiles/flannel-035000/client.crt: no such file or directory

E0127 20:20:35.626181    4442 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/15565-3235/.minikube/profiles/flannel-035000/client.crt: no such file or directory

E0127 20:20:35.647295    4442 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/15565-3235/.minikube/profiles/flannel-035000/client.crt: no such file or directory

E0127 20:20:35.688083    4442 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/15565-3235/.minikube/profiles/flannel-035000/client.crt: no such file or directory

E0127 20:20:35.768342    4442 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/15565-3235/.minikube/profiles/flannel-035000/client.crt: no such file or directory

E0127 20:20:35.929345    4442 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/15565-3235/.minikube/profiles/flannel-035000/client.crt: no such file or directory

E0127 20:20:36.251769    4442 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/15565-3235/.minikube/profiles/flannel-035000/client.crt: no such file or directory

E0127 20:20:36.892330    4442 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/15565-3235/.minikube/profiles/flannel-035000/client.crt: no such file or directory

E0127 20:20:38.174529    4442 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/15565-3235/.minikube/profiles/flannel-035000/client.crt: no such file or directory

E0127 20:20:40.736722    4442 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/15565-3235/.minikube/profiles/flannel-035000/client.crt: no such file or directory

E0127 20:20:40.798207    4442 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/15565-3235/.minikube/profiles/enable-default-cni-035000/client.crt: no such file or directory

E0127 20:20:45.857689    4442 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/15565-3235/.minikube/profiles/flannel-035000/client.crt: no such file or directory

E0127 20:20:56.098069    4442 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/15565-3235/.minikube/profiles/flannel-035000/client.crt: no such file or directory

=== CONT  TestStartStop/group/old-k8s-version/serial/SecondStart

start_stop_delete_test.go:256: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p old-k8s-version-159000 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=hyperkit  --kubernetes-version=v1.16.0: exit status 90 (1m25.96182586s)

-- stdout --

	* [old-k8s-version-159000] minikube v1.28.0 on Darwin 13.2

	  - MINIKUBE_LOCATION=15565

	  - KUBECONFIG=/Users/jenkins/minikube-integration/15565-3235/kubeconfig

	  - MINIKUBE_BIN=out/minikube-darwin-amd64

	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/15565-3235/.minikube

	  - MINIKUBE_FORCE_SYSTEMD=

	* Kubernetes 1.26.1 is now available. If you would like to upgrade, specify: --kubernetes-version=v1.26.1

	* Using the hyperkit driver based on existing profile

	* Starting control plane node old-k8s-version-159000 in cluster old-k8s-version-159000

	* Restarting existing hyperkit VM for "old-k8s-version-159000" ...

-- /stdout --

** stderr ** 

	I0127 20:19:45.871025   13598 out.go:296] Setting OutFile to fd 1 ...

	I0127 20:19:45.871240   13598 out.go:343] TERM=,COLORTERM=, which probably does not support color

	I0127 20:19:45.871245   13598 out.go:309] Setting ErrFile to fd 2...

	I0127 20:19:45.871249   13598 out.go:343] TERM=,COLORTERM=, which probably does not support color

	I0127 20:19:45.871376   13598 root.go:334] Updating PATH: /Users/jenkins/minikube-integration/15565-3235/.minikube/bin

	I0127 20:19:45.871855   13598 out.go:303] Setting JSON to false

	I0127 20:19:45.890570   13598 start.go:125] hostinfo: {"hostname":"MacOS-Agent-4.local","uptime":4760,"bootTime":1674874825,"procs":403,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"13.2","kernelVersion":"22.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"f2f27e25-cfda-5ffd-9706-e98286194e62"}

	W0127 20:19:45.890668   13598 start.go:133] gopshost.Virtualization returned error: not implemented yet

	I0127 20:19:45.912341   13598 out.go:177] * [old-k8s-version-159000] minikube v1.28.0 on Darwin 13.2

	I0127 20:19:45.955274   13598 notify.go:220] Checking for updates...

	I0127 20:19:45.976336   13598 out.go:177]   - MINIKUBE_LOCATION=15565

	I0127 20:19:46.023753   13598 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/15565-3235/kubeconfig

	I0127 20:19:46.065949   13598 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64

	I0127 20:19:46.086821   13598 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I0127 20:19:46.108242   13598 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/15565-3235/.minikube

	I0127 20:19:46.130241   13598 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=

	I0127 20:19:46.152665   13598 config.go:180] Loaded profile config "old-k8s-version-159000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.16.0

	I0127 20:19:46.153357   13598 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit

	I0127 20:19:46.153433   13598 main.go:141] libmachine: Launching plugin server for driver hyperkit

	I0127 20:19:46.161164   13598 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:56229

	I0127 20:19:46.161588   13598 main.go:141] libmachine: () Calling .GetVersion

	I0127 20:19:46.162009   13598 main.go:141] libmachine: Using API Version  1

	I0127 20:19:46.162020   13598 main.go:141] libmachine: () Calling .SetConfigRaw

	I0127 20:19:46.162251   13598 main.go:141] libmachine: () Calling .GetMachineName

	I0127 20:19:46.162366   13598 main.go:141] libmachine: (old-k8s-version-159000) Calling .DriverName

	I0127 20:19:46.183958   13598 out.go:177] * Kubernetes 1.26.1 is now available. If you would like to upgrade, specify: --kubernetes-version=v1.26.1

	I0127 20:19:46.204955   13598 driver.go:365] Setting default libvirt URI to qemu:///system

	I0127 20:19:46.205532   13598 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit

	I0127 20:19:46.205578   13598 main.go:141] libmachine: Launching plugin server for driver hyperkit

	I0127 20:19:46.213672   13598 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:56231

	I0127 20:19:46.214054   13598 main.go:141] libmachine: () Calling .GetVersion

	I0127 20:19:46.214401   13598 main.go:141] libmachine: Using API Version  1

	I0127 20:19:46.214411   13598 main.go:141] libmachine: () Calling .SetConfigRaw

	I0127 20:19:46.214640   13598 main.go:141] libmachine: () Calling .GetMachineName

	I0127 20:19:46.214765   13598 main.go:141] libmachine: (old-k8s-version-159000) Calling .DriverName

	I0127 20:19:46.241957   13598 out.go:177] * Using the hyperkit driver based on existing profile

	I0127 20:19:46.284004   13598 start.go:296] selected driver: hyperkit

	I0127 20:19:46.284039   13598 start.go:840] validating driver "hyperkit" against &{Name:old-k8s-version-159000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/15565/minikube-v1.29.0-1674856271-15565-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.36-1674164627-15541@sha256:0a2280301e955e0d3910d6e639e0b7341db1f4a25558521ac97b38c782c6189a Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 Kube

rnetesConfig:{KubernetesVersion:v1.16.0 ClusterName:old-k8s-version-159000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.64.40 Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:k8s.gcr.io/echoserver:1.4 MetricsServer:k8s.gcr.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:

[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP:}

	I0127 20:19:46.284236   13598 start.go:851] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}

	I0127 20:19:46.287903   13598 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0127 20:19:46.288003   13598 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/15565-3235/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin

	I0127 20:19:46.294656   13598 install.go:137] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit version is 1.28.0

	I0127 20:19:46.298015   13598 install.go:79] stdout: /Users/jenkins/workspace/out/docker-machine-driver-hyperkit

	I0127 20:19:46.298032   13598 install.go:81] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit looks good

	I0127 20:19:46.298122   13598 start_flags.go:917] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]

	I0127 20:19:46.298143   13598 cni.go:84] Creating CNI manager for ""

	I0127 20:19:46.298157   13598 cni.go:161] CNI unnecessary in this configuration, recommending no CNI

	I0127 20:19:46.298168   13598 start_flags.go:319] config:

	{Name:old-k8s-version-159000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/15565/minikube-v1.29.0-1674856271-15565-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.36-1674164627-15541@sha256:0a2280301e955e0d3910d6e639e0b7341db1f4a25558521ac97b38c782c6189a Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.16.0 ClusterName:old-k8s-version-159000 Namespa

ce:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.64.40 Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:k8s.gcr.io/echoserver:1.4 MetricsServer:k8s.gcr.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpir

ation:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP:}

	I0127 20:19:46.298274   13598 iso.go:125] acquiring lock: {Name:mkeeb6f52f7fa0577f04180383dbb7ed67f33d88 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0127 20:19:46.319813   13598 out.go:177] * Starting control plane node old-k8s-version-159000 in cluster old-k8s-version-159000

	I0127 20:19:46.341065   13598 preload.go:132] Checking if preload exists for k8s version v1.16.0 and runtime docker

	I0127 20:19:46.341151   13598 preload.go:148] Found local preload: /Users/jenkins/minikube-integration/15565-3235/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.16.0-docker-overlay2-amd64.tar.lz4

	I0127 20:19:46.341189   13598 cache.go:57] Caching tarball of preloaded images

	I0127 20:19:46.341368   13598 preload.go:174] Found /Users/jenkins/minikube-integration/15565-3235/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.16.0-docker-overlay2-amd64.tar.lz4 in cache, skipping download

	I0127 20:19:46.341386   13598 cache.go:60] Finished verifying existence of preloaded tar for  v1.16.0 on docker

	I0127 20:19:46.341553   13598 profile.go:148] Saving config to /Users/jenkins/minikube-integration/15565-3235/.minikube/profiles/old-k8s-version-159000/config.json ...

	I0127 20:19:46.342318   13598 cache.go:193] Successfully downloaded all kic artifacts

	I0127 20:19:46.342389   13598 start.go:364] acquiring machines lock for old-k8s-version-159000: {Name:mk69c04a34b14d26e3f74e414bcb566a33d5b215 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0127 20:19:55.346620   13598 start.go:368] acquired machines lock for "old-k8s-version-159000" in 9.003837446s

	I0127 20:19:55.346675   13598 start.go:96] Skipping create...Using existing machine configuration

	I0127 20:19:55.346688   13598 fix.go:55] fixHost starting: 

	I0127 20:19:55.347021   13598 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit

	I0127 20:19:55.347045   13598 main.go:141] libmachine: Launching plugin server for driver hyperkit

	I0127 20:19:55.354375   13598 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:56249

	I0127 20:19:55.354785   13598 main.go:141] libmachine: () Calling .GetVersion

	I0127 20:19:55.355155   13598 main.go:141] libmachine: Using API Version  1

	I0127 20:19:55.355168   13598 main.go:141] libmachine: () Calling .SetConfigRaw

	I0127 20:19:55.355390   13598 main.go:141] libmachine: () Calling .GetMachineName

	I0127 20:19:55.355497   13598 main.go:141] libmachine: (old-k8s-version-159000) Calling .DriverName

	I0127 20:19:55.355748   13598 main.go:141] libmachine: (old-k8s-version-159000) Calling .GetState

	I0127 20:19:55.355844   13598 main.go:141] libmachine: (old-k8s-version-159000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0

	I0127 20:19:55.355923   13598 main.go:141] libmachine: (old-k8s-version-159000) DBG | hyperkit pid from json: 12977

	I0127 20:19:55.356787   13598 main.go:141] libmachine: (old-k8s-version-159000) DBG | hyperkit pid 12977 missing from process table

	I0127 20:19:55.356856   13598 fix.go:103] recreateIfNeeded on old-k8s-version-159000: state=Stopped err=<nil>

	I0127 20:19:55.356883   13598 main.go:141] libmachine: (old-k8s-version-159000) Calling .DriverName

	W0127 20:19:55.357001   13598 fix.go:129] unexpected machine state, will restart: <nil>

	I0127 20:19:55.380427   13598 out.go:177] * Restarting existing hyperkit VM for "old-k8s-version-159000" ...

	I0127 20:19:55.401575   13598 main.go:141] libmachine: (old-k8s-version-159000) Calling .Start

	I0127 20:19:55.401906   13598 main.go:141] libmachine: (old-k8s-version-159000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0

	I0127 20:19:55.402002   13598 main.go:141] libmachine: (old-k8s-version-159000) minikube might have been shutdown in an unclean way, the hyperkit pid file still exists: /Users/jenkins/minikube-integration/15565-3235/.minikube/machines/old-k8s-version-159000/hyperkit.pid

	I0127 20:19:55.403646   13598 main.go:141] libmachine: (old-k8s-version-159000) DBG | hyperkit pid 12977 missing from process table

	I0127 20:19:55.403666   13598 main.go:141] libmachine: (old-k8s-version-159000) DBG | pid 12977 is in state "Stopped"

	I0127 20:19:55.403721   13598 main.go:141] libmachine: (old-k8s-version-159000) DBG | Removing stale pid file /Users/jenkins/minikube-integration/15565-3235/.minikube/machines/old-k8s-version-159000/hyperkit.pid...

	I0127 20:19:55.422920   13598 main.go:141] libmachine: (old-k8s-version-159000) DBG | Using UUID a160b142-9ec2-11ed-84b5-149d997fca88

	I0127 20:19:55.450859   13598 main.go:141] libmachine: (old-k8s-version-159000) DBG | Generated MAC 2e:af:cf:a9:c:ca

	I0127 20:19:55.450877   13598 main.go:141] libmachine: (old-k8s-version-159000) DBG | Starting with cmdline: loglevel=3 console=ttyS0 console=tty0 noembed nomodeset norestore waitusb=10 systemd.legacy_systemd_cgroup_controller=yes random.trust_cpu=on hw_rng_model=virtio base host=old-k8s-version-159000

	I0127 20:19:55.451073   13598 main.go:141] libmachine: (old-k8s-version-159000) DBG | 2023/01/27 20:19:55 DEBUG: hyperkit: Start &hyperkit.HyperKit{HyperKit:"/usr/local/bin/hyperkit", Argv0:"", StateDir:"/Users/jenkins/minikube-integration/15565-3235/.minikube/machines/old-k8s-version-159000", VPNKitSock:"", VPNKitUUID:"", VPNKitPreferredIPv4:"", UUID:"a160b142-9ec2-11ed-84b5-149d997fca88", Disks:[]hyperkit.Disk{(*hyperkit.RawDisk)(0xc0003cade0)}, ISOImages:[]string{"/Users/jenkins/minikube-integration/15565-3235/.minikube/machines/old-k8s-version-159000/boot2docker.iso"}, VSock:false, VSockDir:"", VSockPorts:[]int(nil), VSockGuestCID:3, VMNet:true, Sockets9P:[]hyperkit.Socket9P(nil), Kernel:"/Users/jenkins/minikube-integration/15565-3235/.minikube/machines/old-k8s-version-159000/bzimage", Initrd:"/Users/jenkins/minikube-integration/15565-3235/.minikube/machines/old-k8s-version-159000/initrd", Bootrom:"", CPUs:2, Memory:2200, Console:1, Serials:[]hyperkit.Serial(nil), Pid:0, Arguments:[]string(nil),

CmdLine:"", process:(*os.Process)(nil)}

	I0127 20:19:55.451118   13598 main.go:141] libmachine: (old-k8s-version-159000) DBG | 2023/01/27 20:19:55 DEBUG: hyperkit: check &hyperkit.HyperKit{HyperKit:"/usr/local/bin/hyperkit", Argv0:"", StateDir:"/Users/jenkins/minikube-integration/15565-3235/.minikube/machines/old-k8s-version-159000", VPNKitSock:"", VPNKitUUID:"", VPNKitPreferredIPv4:"", UUID:"a160b142-9ec2-11ed-84b5-149d997fca88", Disks:[]hyperkit.Disk{(*hyperkit.RawDisk)(0xc0003cade0)}, ISOImages:[]string{"/Users/jenkins/minikube-integration/15565-3235/.minikube/machines/old-k8s-version-159000/boot2docker.iso"}, VSock:false, VSockDir:"", VSockPorts:[]int(nil), VSockGuestCID:3, VMNet:true, Sockets9P:[]hyperkit.Socket9P(nil), Kernel:"/Users/jenkins/minikube-integration/15565-3235/.minikube/machines/old-k8s-version-159000/bzimage", Initrd:"/Users/jenkins/minikube-integration/15565-3235/.minikube/machines/old-k8s-version-159000/initrd", Bootrom:"", CPUs:2, Memory:2200, Console:1, Serials:[]hyperkit.Serial(nil), Pid:0, Arguments:[]string(nil),

CmdLine:"", process:(*os.Process)(nil)}

	I0127 20:19:55.451187   13598 main.go:141] libmachine: (old-k8s-version-159000) DBG | 2023/01/27 20:19:55 DEBUG: hyperkit: Arguments: []string{"-A", "-u", "-F", "/Users/jenkins/minikube-integration/15565-3235/.minikube/machines/old-k8s-version-159000/hyperkit.pid", "-c", "2", "-m", "2200M", "-s", "0:0,hostbridge", "-s", "31,lpc", "-s", "1:0,virtio-net", "-U", "a160b142-9ec2-11ed-84b5-149d997fca88", "-s", "2:0,virtio-blk,/Users/jenkins/minikube-integration/15565-3235/.minikube/machines/old-k8s-version-159000/old-k8s-version-159000.rawdisk", "-s", "3,ahci-cd,/Users/jenkins/minikube-integration/15565-3235/.minikube/machines/old-k8s-version-159000/boot2docker.iso", "-s", "4,virtio-rnd", "-l", "com1,autopty=/Users/jenkins/minikube-integration/15565-3235/.minikube/machines/old-k8s-version-159000/tty,log=/Users/jenkins/minikube-integration/15565-3235/.minikube/machines/old-k8s-version-159000/console-ring", "-f", "kexec,/Users/jenkins/minikube-integration/15565-3235/.minikube/machines/old-k8s-version-159000/

bzimage,/Users/jenkins/minikube-integration/15565-3235/.minikube/machines/old-k8s-version-159000/initrd,earlyprintk=serial loglevel=3 console=ttyS0 console=tty0 noembed nomodeset norestore waitusb=10 systemd.legacy_systemd_cgroup_controller=yes random.trust_cpu=on hw_rng_model=virtio base host=old-k8s-version-159000"}

	I0127 20:19:55.451233   13598 main.go:141] libmachine: (old-k8s-version-159000) DBG | 2023/01/27 20:19:55 DEBUG: hyperkit: CmdLine: "/usr/local/bin/hyperkit -A -u -F /Users/jenkins/minikube-integration/15565-3235/.minikube/machines/old-k8s-version-159000/hyperkit.pid -c 2 -m 2200M -s 0:0,hostbridge -s 31,lpc -s 1:0,virtio-net -U a160b142-9ec2-11ed-84b5-149d997fca88 -s 2:0,virtio-blk,/Users/jenkins/minikube-integration/15565-3235/.minikube/machines/old-k8s-version-159000/old-k8s-version-159000.rawdisk -s 3,ahci-cd,/Users/jenkins/minikube-integration/15565-3235/.minikube/machines/old-k8s-version-159000/boot2docker.iso -s 4,virtio-rnd -l com1,autopty=/Users/jenkins/minikube-integration/15565-3235/.minikube/machines/old-k8s-version-159000/tty,log=/Users/jenkins/minikube-integration/15565-3235/.minikube/machines/old-k8s-version-159000/console-ring -f kexec,/Users/jenkins/minikube-integration/15565-3235/.minikube/machines/old-k8s-version-159000/bzimage,/Users/jenkins/minikube-integration/15565-3235/.miniku

be/machines/old-k8s-version-159000/initrd,earlyprintk=serial loglevel=3 console=ttyS0 console=tty0 noembed nomodeset norestore waitusb=10 systemd.legacy_systemd_cgroup_controller=yes random.trust_cpu=on hw_rng_model=virtio base host=old-k8s-version-159000"

	I0127 20:19:55.451257   13598 main.go:141] libmachine: (old-k8s-version-159000) DBG | 2023/01/27 20:19:55 DEBUG: hyperkit: Redirecting stdout/stderr to logger

	I0127 20:19:55.452552   13598 main.go:141] libmachine: (old-k8s-version-159000) DBG | 2023/01/27 20:19:55 DEBUG: hyperkit: Pid is 13617

	I0127 20:19:55.452916   13598 main.go:141] libmachine: (old-k8s-version-159000) DBG | Attempt 0

	I0127 20:19:55.452952   13598 main.go:141] libmachine: (old-k8s-version-159000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0

	I0127 20:19:55.453030   13598 main.go:141] libmachine: (old-k8s-version-159000) DBG | hyperkit pid from json: 13617

	I0127 20:19:55.454828   13598 main.go:141] libmachine: (old-k8s-version-159000) DBG | Searching for 2e:af:cf:a9:c:ca in /var/db/dhcpd_leases ...

	I0127 20:19:55.454936   13598 main.go:141] libmachine: (old-k8s-version-159000) DBG | Found 40 entries in /var/db/dhcpd_leases!

	I0127 20:19:55.454959   13598 main.go:141] libmachine: (old-k8s-version-159000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.41 HWAddress:96:1e:f3:16:73:71 ID:1,96:1e:f3:16:73:71 Lease:0x63d5f3e4}

	I0127 20:19:55.455002   13598 main.go:141] libmachine: (old-k8s-version-159000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.40 HWAddress:2e:af:cf:a9:c:ca ID:1,2e:af:cf:a9:c:ca Lease:0x63d5f34c}

	I0127 20:19:55.455020   13598 main.go:141] libmachine: (old-k8s-version-159000) DBG | Found match: 2e:af:cf:a9:c:ca

	I0127 20:19:55.455043   13598 main.go:141] libmachine: (old-k8s-version-159000) Calling .GetConfigRaw

	I0127 20:19:55.455043   13598 main.go:141] libmachine: (old-k8s-version-159000) DBG | IP: 192.168.64.40

	I0127 20:19:55.455657   13598 main.go:141] libmachine: (old-k8s-version-159000) Calling .GetIP

	I0127 20:19:55.455834   13598 profile.go:148] Saving config to /Users/jenkins/minikube-integration/15565-3235/.minikube/profiles/old-k8s-version-159000/config.json ...

	I0127 20:19:55.456274   13598 machine.go:88] provisioning docker machine ...

	I0127 20:19:55.456286   13598 main.go:141] libmachine: (old-k8s-version-159000) Calling .DriverName

	I0127 20:19:55.456426   13598 main.go:141] libmachine: (old-k8s-version-159000) Calling .GetMachineName

	I0127 20:19:55.456539   13598 buildroot.go:166] provisioning hostname "old-k8s-version-159000"

	I0127 20:19:55.456549   13598 main.go:141] libmachine: (old-k8s-version-159000) Calling .GetMachineName

	I0127 20:19:55.456639   13598 main.go:141] libmachine: (old-k8s-version-159000) Calling .GetSSHHostname

	I0127 20:19:55.456741   13598 main.go:141] libmachine: (old-k8s-version-159000) Calling .GetSSHPort

	I0127 20:19:55.456838   13598 main.go:141] libmachine: (old-k8s-version-159000) Calling .GetSSHKeyPath

	I0127 20:19:55.456945   13598 main.go:141] libmachine: (old-k8s-version-159000) Calling .GetSSHKeyPath

	I0127 20:19:55.457038   13598 main.go:141] libmachine: (old-k8s-version-159000) Calling .GetSSHUsername

	I0127 20:19:55.457148   13598 main.go:141] libmachine: Using SSH client type: native

	I0127 20:19:55.457315   13598 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x13ec500] 0x13ef680 <nil>  [] 0s} 192.168.64.40 22 <nil> <nil>}

	I0127 20:19:55.457326   13598 main.go:141] libmachine: About to run SSH command:

	sudo hostname old-k8s-version-159000 && echo "old-k8s-version-159000" | sudo tee /etc/hostname

	I0127 20:19:55.459650   13598 main.go:141] libmachine: (old-k8s-version-159000) DBG | 2023/01/27 20:19:55 INFO : hyperkit: stderr: Using fd 5 for I/O notifications

	I0127 20:19:55.467309   13598 main.go:141] libmachine: (old-k8s-version-159000) DBG | 2023/01/27 20:19:55 INFO : hyperkit: stderr: /Users/jenkins/minikube-integration/15565-3235/.minikube/machines/old-k8s-version-159000/boot2docker.iso: fcntl(F_PUNCHHOLE) Operation not permitted: block device will not support TRIM/DISCARD

	I0127 20:19:55.468360   13598 main.go:141] libmachine: (old-k8s-version-159000) DBG | 2023/01/27 20:19:55 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 2 bit: 22 unspecified don't care: bit is 0

	I0127 20:19:55.468377   13598 main.go:141] libmachine: (old-k8s-version-159000) DBG | 2023/01/27 20:19:55 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 4 bit: 12 unspecified don't care: bit is 0

	I0127 20:19:55.468404   13598 main.go:141] libmachine: (old-k8s-version-159000) DBG | 2023/01/27 20:19:55 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 4 bit: 20 unspecified don't care: bit is 0

	I0127 20:19:55.468418   13598 main.go:141] libmachine: (old-k8s-version-159000) DBG | 2023/01/27 20:19:55 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 3 bit: 13 unspecified don't care: bit is 0

	I0127 20:19:55.831278   13598 main.go:141] libmachine: (old-k8s-version-159000) DBG | 2023/01/27 20:19:55 INFO : hyperkit: stderr: rdmsr to register 0x3a on vcpu 0

	I0127 20:19:55.831298   13598 main.go:141] libmachine: (old-k8s-version-159000) DBG | 2023/01/27 20:19:55 INFO : hyperkit: stderr: rdmsr to register 0x140 on vcpu 0

	I0127 20:19:55.935469   13598 main.go:141] libmachine: (old-k8s-version-159000) DBG | 2023/01/27 20:19:55 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 2 bit: 22 unspecified don't care: bit is 0

	I0127 20:19:55.935499   13598 main.go:141] libmachine: (old-k8s-version-159000) DBG | 2023/01/27 20:19:55 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 4 bit: 12 unspecified don't care: bit is 0

	I0127 20:19:55.935511   13598 main.go:141] libmachine: (old-k8s-version-159000) DBG | 2023/01/27 20:19:55 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 4 bit: 20 unspecified don't care: bit is 0

	I0127 20:19:55.935526   13598 main.go:141] libmachine: (old-k8s-version-159000) DBG | 2023/01/27 20:19:55 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 3 bit: 13 unspecified don't care: bit is 0

	I0127 20:19:55.936345   13598 main.go:141] libmachine: (old-k8s-version-159000) DBG | 2023/01/27 20:19:55 INFO : hyperkit: stderr: rdmsr to register 0x3a on vcpu 1

	I0127 20:19:55.936358   13598 main.go:141] libmachine: (old-k8s-version-159000) DBG | 2023/01/27 20:19:55 INFO : hyperkit: stderr: rdmsr to register 0x140 on vcpu 1

	I0127 20:20:00.387048   13598 main.go:141] libmachine: (old-k8s-version-159000) DBG | 2023/01/27 20:20:00 INFO : hyperkit: stderr: rdmsr to register 0x64d on vcpu 1

	I0127 20:20:00.387082   13598 main.go:141] libmachine: (old-k8s-version-159000) DBG | 2023/01/27 20:20:00 INFO : hyperkit: stderr: rdmsr to register 0x64e on vcpu 1

	I0127 20:20:00.387100   13598 main.go:141] libmachine: (old-k8s-version-159000) DBG | 2023/01/27 20:20:00 INFO : hyperkit: stderr: rdmsr to register 0x34 on vcpu 1

	I0127 20:20:08.651356   13598 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-159000

	I0127 20:20:08.651373   13598 main.go:141] libmachine: (old-k8s-version-159000) Calling .GetSSHHostname

	I0127 20:20:08.651509   13598 main.go:141] libmachine: (old-k8s-version-159000) Calling .GetSSHPort

	I0127 20:20:08.651613   13598 main.go:141] libmachine: (old-k8s-version-159000) Calling .GetSSHKeyPath

	I0127 20:20:08.651707   13598 main.go:141] libmachine: (old-k8s-version-159000) Calling .GetSSHKeyPath

	I0127 20:20:08.651835   13598 main.go:141] libmachine: (old-k8s-version-159000) Calling .GetSSHUsername

	I0127 20:20:08.651979   13598 main.go:141] libmachine: Using SSH client type: native

	I0127 20:20:08.652143   13598 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x13ec500] 0x13ef680 <nil>  [] 0s} 192.168.64.40 22 <nil> <nil>}

	I0127 20:20:08.652155   13598 main.go:141] libmachine: About to run SSH command:

			if ! grep -xq '.*\sold-k8s-version-159000' /etc/hosts; then

				if grep -xq '127.0.1.1\s.*' /etc/hosts; then

					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-159000/g' /etc/hosts;

				else 

					echo '127.0.1.1 old-k8s-version-159000' | sudo tee -a /etc/hosts; 

				fi

			fi

	I0127 20:20:08.732720   13598 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I0127 20:20:08.732739   13598 buildroot.go:172] set auth options {CertDir:/Users/jenkins/minikube-integration/15565-3235/.minikube CaCertPath:/Users/jenkins/minikube-integration/15565-3235/.minikube/certs/ca.pem CaPrivateKeyPath:/Users/jenkins/minikube-integration/15565-3235/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/Users/jenkins/minikube-integration/15565-3235/.minikube/machines/server.pem ServerKeyPath:/Users/jenkins/minikube-integration/15565-3235/.minikube/machines/server-key.pem ClientKeyPath:/Users/jenkins/minikube-integration/15565-3235/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/Users/jenkins/minikube-integration/15565-3235/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/Users/jenkins/minikube-integration/15565-3235/.minikube}

	I0127 20:20:08.732754   13598 buildroot.go:174] setting up certificates

	I0127 20:20:08.732764   13598 provision.go:83] configureAuth start

	I0127 20:20:08.732772   13598 main.go:141] libmachine: (old-k8s-version-159000) Calling .GetMachineName

	I0127 20:20:08.732900   13598 main.go:141] libmachine: (old-k8s-version-159000) Calling .GetIP

	I0127 20:20:08.733013   13598 main.go:141] libmachine: (old-k8s-version-159000) Calling .GetSSHHostname

	I0127 20:20:08.733122   13598 provision.go:138] copyHostCerts

	I0127 20:20:08.733217   13598 exec_runner.go:144] found /Users/jenkins/minikube-integration/15565-3235/.minikube/cert.pem, removing ...

	I0127 20:20:08.733226   13598 exec_runner.go:207] rm: /Users/jenkins/minikube-integration/15565-3235/.minikube/cert.pem

	I0127 20:20:08.733347   13598 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/15565-3235/.minikube/certs/cert.pem --> /Users/jenkins/minikube-integration/15565-3235/.minikube/cert.pem (1123 bytes)

	I0127 20:20:08.733543   13598 exec_runner.go:144] found /Users/jenkins/minikube-integration/15565-3235/.minikube/key.pem, removing ...

	I0127 20:20:08.733549   13598 exec_runner.go:207] rm: /Users/jenkins/minikube-integration/15565-3235/.minikube/key.pem

	I0127 20:20:08.733607   13598 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/15565-3235/.minikube/certs/key.pem --> /Users/jenkins/minikube-integration/15565-3235/.minikube/key.pem (1675 bytes)

	I0127 20:20:08.733741   13598 exec_runner.go:144] found /Users/jenkins/minikube-integration/15565-3235/.minikube/ca.pem, removing ...

	I0127 20:20:08.733746   13598 exec_runner.go:207] rm: /Users/jenkins/minikube-integration/15565-3235/.minikube/ca.pem

	I0127 20:20:08.733800   13598 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/15565-3235/.minikube/certs/ca.pem --> /Users/jenkins/minikube-integration/15565-3235/.minikube/ca.pem (1082 bytes)

	I0127 20:20:08.733908   13598 provision.go:112] generating server cert: /Users/jenkins/minikube-integration/15565-3235/.minikube/machines/server.pem ca-key=/Users/jenkins/minikube-integration/15565-3235/.minikube/certs/ca.pem private-key=/Users/jenkins/minikube-integration/15565-3235/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-159000 san=[192.168.64.40 192.168.64.40 localhost 127.0.0.1 minikube old-k8s-version-159000]

	I0127 20:20:08.822428   13598 provision.go:172] copyRemoteCerts

	I0127 20:20:08.822482   13598 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker

	I0127 20:20:08.822495   13598 main.go:141] libmachine: (old-k8s-version-159000) Calling .GetSSHHostname

	I0127 20:20:08.822619   13598 main.go:141] libmachine: (old-k8s-version-159000) Calling .GetSSHPort

	I0127 20:20:08.822711   13598 main.go:141] libmachine: (old-k8s-version-159000) Calling .GetSSHKeyPath

	I0127 20:20:08.822805   13598 main.go:141] libmachine: (old-k8s-version-159000) Calling .GetSSHUsername

	I0127 20:20:08.822895   13598 sshutil.go:53] new ssh client: &{IP:192.168.64.40 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/15565-3235/.minikube/machines/old-k8s-version-159000/id_rsa Username:docker}

	I0127 20:20:08.867068   13598 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15565-3235/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)

	I0127 20:20:08.882243   13598 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15565-3235/.minikube/machines/server.pem --> /etc/docker/server.pem (1241 bytes)

	I0127 20:20:08.897241   13598 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15565-3235/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)

	I0127 20:20:08.912261   13598 provision.go:86] duration metric: configureAuth took 179.485478ms

	I0127 20:20:08.912273   13598 buildroot.go:189] setting minikube options for container-runtime

	I0127 20:20:08.912417   13598 config.go:180] Loaded profile config "old-k8s-version-159000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.16.0

	I0127 20:20:08.912432   13598 main.go:141] libmachine: (old-k8s-version-159000) Calling .DriverName

	I0127 20:20:08.912566   13598 main.go:141] libmachine: (old-k8s-version-159000) Calling .GetSSHHostname

	I0127 20:20:08.912660   13598 main.go:141] libmachine: (old-k8s-version-159000) Calling .GetSSHPort

	I0127 20:20:08.912750   13598 main.go:141] libmachine: (old-k8s-version-159000) Calling .GetSSHKeyPath

	I0127 20:20:08.912842   13598 main.go:141] libmachine: (old-k8s-version-159000) Calling .GetSSHKeyPath

	I0127 20:20:08.912913   13598 main.go:141] libmachine: (old-k8s-version-159000) Calling .GetSSHUsername

	I0127 20:20:08.913011   13598 main.go:141] libmachine: Using SSH client type: native

	I0127 20:20:08.913123   13598 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x13ec500] 0x13ef680 <nil>  [] 0s} 192.168.64.40 22 <nil> <nil>}

	I0127 20:20:08.913132   13598 main.go:141] libmachine: About to run SSH command:

	df --output=fstype / | tail -n 1

	I0127 20:20:08.992124   13598 main.go:141] libmachine: SSH cmd err, output: <nil>: tmpfs

	I0127 20:20:08.992136   13598 buildroot.go:70] root file system type: tmpfs

	I0127 20:20:08.992253   13598 provision.go:309] Updating docker unit: /lib/systemd/system/docker.service ...

	I0127 20:20:08.992276   13598 main.go:141] libmachine: (old-k8s-version-159000) Calling .GetSSHHostname

	I0127 20:20:08.992406   13598 main.go:141] libmachine: (old-k8s-version-159000) Calling .GetSSHPort

	I0127 20:20:08.992502   13598 main.go:141] libmachine: (old-k8s-version-159000) Calling .GetSSHKeyPath

	I0127 20:20:08.992615   13598 main.go:141] libmachine: (old-k8s-version-159000) Calling .GetSSHKeyPath

	I0127 20:20:08.992717   13598 main.go:141] libmachine: (old-k8s-version-159000) Calling .GetSSHUsername

	I0127 20:20:08.992847   13598 main.go:141] libmachine: Using SSH client type: native

	I0127 20:20:08.992956   13598 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x13ec500] 0x13ef680 <nil>  [] 0s} 192.168.64.40 22 <nil> <nil>}

	I0127 20:20:08.993006   13598 main.go:141] libmachine: About to run SSH command:

	sudo mkdir -p /lib/systemd/system && printf %s "[Unit]

	Description=Docker Application Container Engine

	Documentation=https://docs.docker.com

	After=network.target  minikube-automount.service docker.socket

	Requires= minikube-automount.service docker.socket 

	StartLimitBurst=3

	StartLimitIntervalSec=60

	[Service]

	Type=notify

	Restart=on-failure

	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	# The base configuration already specifies an 'ExecStart=...' command. The first directive

	# here is to clear out that command inherited from the base configuration. Without this,

	# the command from the base configuration and the command specified here are treated as

	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	# will catch this invalid input and refuse to start the service with an error like:

	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	ExecStart=

	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=hyperkit --insecure-registry 10.96.0.0/12 

	ExecReload=/bin/kill -s HUP \$MAINPID

	# Having non-zero Limit*s causes performance problems due to accounting overhead

	# in the kernel. We recommend using cgroups to do container-local accounting.

	LimitNOFILE=infinity

	LimitNPROC=infinity

	LimitCORE=infinity

	# Uncomment TasksMax if your systemd version supports it.

	# Only systemd 226 and above support this version.

	TasksMax=infinity

	TimeoutStartSec=0

	# set delegate yes so that systemd does not reset the cgroups of docker containers

	Delegate=yes

	# kill only the docker process, not all processes in the cgroup

	KillMode=process

	[Install]

	WantedBy=multi-user.target

	" | sudo tee /lib/systemd/system/docker.service.new

	I0127 20:20:09.077920   13598 main.go:141] libmachine: SSH cmd err, output: <nil>: [Unit]

	Description=Docker Application Container Engine

	Documentation=https://docs.docker.com

	After=network.target  minikube-automount.service docker.socket

	Requires= minikube-automount.service docker.socket 

	StartLimitBurst=3

	StartLimitIntervalSec=60

	[Service]

	Type=notify

	Restart=on-failure

	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	# The base configuration already specifies an 'ExecStart=...' command. The first directive

	# here is to clear out that command inherited from the base configuration. Without this,

	# the command from the base configuration and the command specified here are treated as

	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	# will catch this invalid input and refuse to start the service with an error like:

	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	ExecStart=

	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=hyperkit --insecure-registry 10.96.0.0/12 

	ExecReload=/bin/kill -s HUP $MAINPID

	# Having non-zero Limit*s causes performance problems due to accounting overhead

	# in the kernel. We recommend using cgroups to do container-local accounting.

	LimitNOFILE=infinity

	LimitNPROC=infinity

	LimitCORE=infinity

	# Uncomment TasksMax if your systemd version supports it.

	# Only systemd 226 and above support this version.

	TasksMax=infinity

	TimeoutStartSec=0

	# set delegate yes so that systemd does not reset the cgroups of docker containers

	Delegate=yes

	# kill only the docker process, not all processes in the cgroup

	KillMode=process

	[Install]

	WantedBy=multi-user.target

	I0127 20:20:09.077950   13598 main.go:141] libmachine: (old-k8s-version-159000) Calling .GetSSHHostname

	I0127 20:20:09.078083   13598 main.go:141] libmachine: (old-k8s-version-159000) Calling .GetSSHPort

	I0127 20:20:09.078172   13598 main.go:141] libmachine: (old-k8s-version-159000) Calling .GetSSHKeyPath

	I0127 20:20:09.078266   13598 main.go:141] libmachine: (old-k8s-version-159000) Calling .GetSSHKeyPath

	I0127 20:20:09.078365   13598 main.go:141] libmachine: (old-k8s-version-159000) Calling .GetSSHUsername

	I0127 20:20:09.078501   13598 main.go:141] libmachine: Using SSH client type: native

	I0127 20:20:09.078621   13598 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x13ec500] 0x13ef680 <nil>  [] 0s} 192.168.64.40 22 <nil> <nil>}

	I0127 20:20:09.078637   13598 main.go:141] libmachine: About to run SSH command:

	sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }

	I0127 20:20:09.616021   13598 main.go:141] libmachine: SSH cmd err, output: <nil>: diff: can't stat '/lib/systemd/system/docker.service': No such file or directory

	Created symlink /etc/systemd/system/multi-user.target.wants/docker.service → /usr/lib/systemd/system/docker.service.

	I0127 20:20:09.616044   13598 machine.go:91] provisioned docker machine in 14.159653527s

	I0127 20:20:09.616059   13598 start.go:300] post-start starting for "old-k8s-version-159000" (driver="hyperkit")

	I0127 20:20:09.616066   13598 start.go:328] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]

	I0127 20:20:09.616078   13598 main.go:141] libmachine: (old-k8s-version-159000) Calling .DriverName

	I0127 20:20:09.616260   13598 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs

	I0127 20:20:09.616272   13598 main.go:141] libmachine: (old-k8s-version-159000) Calling .GetSSHHostname

	I0127 20:20:09.616368   13598 main.go:141] libmachine: (old-k8s-version-159000) Calling .GetSSHPort

	I0127 20:20:09.616464   13598 main.go:141] libmachine: (old-k8s-version-159000) Calling .GetSSHKeyPath

	I0127 20:20:09.616561   13598 main.go:141] libmachine: (old-k8s-version-159000) Calling .GetSSHUsername

	I0127 20:20:09.616661   13598 sshutil.go:53] new ssh client: &{IP:192.168.64.40 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/15565-3235/.minikube/machines/old-k8s-version-159000/id_rsa Username:docker}

	I0127 20:20:09.661547   13598 ssh_runner.go:195] Run: cat /etc/os-release

	I0127 20:20:09.664186   13598 info.go:137] Remote host: Buildroot 2021.02.12

	I0127 20:20:09.664200   13598 filesync.go:126] Scanning /Users/jenkins/minikube-integration/15565-3235/.minikube/addons for local assets ...

	I0127 20:20:09.664283   13598 filesync.go:126] Scanning /Users/jenkins/minikube-integration/15565-3235/.minikube/files for local assets ...

	I0127 20:20:09.664458   13598 filesync.go:149] local asset: /Users/jenkins/minikube-integration/15565-3235/.minikube/files/etc/ssl/certs/44422.pem -> 44422.pem in /etc/ssl/certs

	I0127 20:20:09.664610   13598 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs

	I0127 20:20:09.670061   13598 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15565-3235/.minikube/files/etc/ssl/certs/44422.pem --> /etc/ssl/certs/44422.pem (1708 bytes)

	I0127 20:20:09.685746   13598 start.go:303] post-start completed in 69.672621ms

	I0127 20:20:09.685761   13598 fix.go:57] fixHost completed within 14.338970101s

	I0127 20:20:09.685789   13598 main.go:141] libmachine: (old-k8s-version-159000) Calling .GetSSHHostname

	I0127 20:20:09.685920   13598 main.go:141] libmachine: (old-k8s-version-159000) Calling .GetSSHPort

	I0127 20:20:09.686009   13598 main.go:141] libmachine: (old-k8s-version-159000) Calling .GetSSHKeyPath

	I0127 20:20:09.686101   13598 main.go:141] libmachine: (old-k8s-version-159000) Calling .GetSSHKeyPath

	I0127 20:20:09.686191   13598 main.go:141] libmachine: (old-k8s-version-159000) Calling .GetSSHUsername

	I0127 20:20:09.686309   13598 main.go:141] libmachine: Using SSH client type: native

	I0127 20:20:09.686417   13598 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x13ec500] 0x13ef680 <nil>  [] 0s} 192.168.64.40 22 <nil> <nil>}

	I0127 20:20:09.686428   13598 main.go:141] libmachine: About to run SSH command:

	date +%s.%N

	I0127 20:20:09.763160   13598 main.go:141] libmachine: SSH cmd err, output: <nil>: 1674879609.952460228

	I0127 20:20:09.763177   13598 fix.go:207] guest clock: 1674879609.952460228

	I0127 20:20:09.763182   13598 fix.go:220] Guest: 2023-01-27 20:20:09.952460228 -0800 PST Remote: 2023-01-27 20:20:09.685764 -0800 PST m=+23.863158941 (delta=266.696228ms)

	I0127 20:20:09.763202   13598 fix.go:191] guest clock delta is within tolerance: 266.696228ms

	I0127 20:20:09.763207   13598 start.go:83] releasing machines lock for "old-k8s-version-159000", held for 14.416468451s

	I0127 20:20:09.763229   13598 main.go:141] libmachine: (old-k8s-version-159000) Calling .DriverName

	I0127 20:20:09.763355   13598 main.go:141] libmachine: (old-k8s-version-159000) Calling .GetIP

	I0127 20:20:09.763452   13598 main.go:141] libmachine: (old-k8s-version-159000) Calling .DriverName

	I0127 20:20:09.763791   13598 main.go:141] libmachine: (old-k8s-version-159000) Calling .DriverName

	I0127 20:20:09.763907   13598 main.go:141] libmachine: (old-k8s-version-159000) Calling .DriverName

	I0127 20:20:09.763983   13598 ssh_runner.go:195] Run: curl -sS -m 2 https://k8s.gcr.io/

	I0127 20:20:09.764013   13598 main.go:141] libmachine: (old-k8s-version-159000) Calling .GetSSHHostname

	I0127 20:20:09.764053   13598 ssh_runner.go:195] Run: cat /version.json

	I0127 20:20:09.764066   13598 main.go:141] libmachine: (old-k8s-version-159000) Calling .GetSSHHostname

	I0127 20:20:09.764113   13598 main.go:141] libmachine: (old-k8s-version-159000) Calling .GetSSHPort

	I0127 20:20:09.764198   13598 main.go:141] libmachine: (old-k8s-version-159000) Calling .GetSSHKeyPath

	I0127 20:20:09.764215   13598 main.go:141] libmachine: (old-k8s-version-159000) Calling .GetSSHPort

	I0127 20:20:09.764293   13598 main.go:141] libmachine: (old-k8s-version-159000) Calling .GetSSHKeyPath

	I0127 20:20:09.764315   13598 main.go:141] libmachine: (old-k8s-version-159000) Calling .GetSSHUsername

	I0127 20:20:09.764380   13598 sshutil.go:53] new ssh client: &{IP:192.168.64.40 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/15565-3235/.minikube/machines/old-k8s-version-159000/id_rsa Username:docker}

	I0127 20:20:09.764397   13598 main.go:141] libmachine: (old-k8s-version-159000) Calling .GetSSHUsername

	I0127 20:20:09.764477   13598 sshutil.go:53] new ssh client: &{IP:192.168.64.40 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/15565-3235/.minikube/machines/old-k8s-version-159000/id_rsa Username:docker}

	W0127 20:20:09.805972   13598 out.go:239] ! Image was not built for the current minikube version. To resolve this you can delete and recreate your minikube cluster using the latest images. Expected minikube version: v1.29.0-1674856271-15565 -> Actual minikube version: v1.28.0

	! Image was not built for the current minikube version. To resolve this you can delete and recreate your minikube cluster using the latest images. Expected minikube version: v1.29.0-1674856271-15565 -> Actual minikube version: v1.28.0

	I0127 20:20:09.806032   13598 ssh_runner.go:195] Run: systemctl --version

	I0127 20:20:09.984615   13598 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"

	W0127 20:20:09.988879   13598 cni.go:208] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found

	I0127 20:20:09.988926   13598 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *bridge* -not -name *podman* -not -name *.mk_disabled -printf "%p, " -exec sh -c "sudo sed -i -r -e '/"dst": ".*:.*"/d' -e 's|^(.*)"dst": (.*)[,*]$|\1"dst": \2|g' -e '/"subnet": ".*:.*"/d' -e 's|^(.*)"subnet": ".*"(.*)[,*]$|\1"subnet": "10.244.0.0/16"\2|g' {}" ;

	I0127 20:20:09.996281   13598 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *podman* -not -name *.mk_disabled -printf "%p, " -exec sh -c "sudo sed -i -r -e 's|^(.*)"subnet": ".*"(.*)$|\1"subnet": "10.244.0.0/16"\2|g' -e 's|^(.*)"gateway": ".*"(.*)$|\1"gateway": "10.244.0.1"\2|g' {}" ;

	I0127 20:20:10.008553   13598 cni.go:307] configured [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)

	I0127 20:20:10.008566   13598 preload.go:132] Checking if preload exists for k8s version v1.16.0 and runtime docker

	I0127 20:20:10.008650   13598 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}

	I0127 20:20:10.027747   13598 docker.go:630] Got preloaded images: -- stdout --

	gcr.io/k8s-minikube/storage-provisioner:v5

	k8s.gcr.io/kube-apiserver:v1.16.0

	k8s.gcr.io/kube-proxy:v1.16.0

	k8s.gcr.io/kube-controller-manager:v1.16.0

	k8s.gcr.io/kube-scheduler:v1.16.0

	k8s.gcr.io/etcd:3.3.15-0

	k8s.gcr.io/coredns:1.6.2

	gcr.io/k8s-minikube/busybox:1.28.4-glibc

	k8s.gcr.io/pause:3.1

	-- /stdout --

	I0127 20:20:10.027761   13598 docker.go:560] Images already preloaded, skipping extraction

	I0127 20:20:10.027767   13598 start.go:472] detecting cgroup driver to use...

	I0127 20:20:10.027859   13598 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///run/containerd/containerd.sock

	image-endpoint: unix:///run/containerd/containerd.sock

	" | sudo tee /etc/crictl.yaml"

	I0127 20:20:10.040340   13598 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "k8s.gcr.io/pause:3.1"|' /etc/containerd/config.toml"

	I0127 20:20:10.047522   13598 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"

	I0127 20:20:10.054341   13598 containerd.go:145] configuring containerd to use "cgroupfs" as cgroup driver...

	I0127 20:20:10.054387   13598 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"

	I0127 20:20:10.061445   13598 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"

	I0127 20:20:10.068297   13598 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"

	I0127 20:20:10.075173   13598 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"

	I0127 20:20:10.082194   13598 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"

	I0127 20:20:10.089239   13598 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"

	I0127 20:20:10.096160   13598 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables

	I0127 20:20:10.102366   13598 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"

	I0127 20:20:10.108501   13598 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0127 20:20:10.191554   13598 ssh_runner.go:195] Run: sudo systemctl restart containerd

	I0127 20:20:10.204686   13598 start.go:472] detecting cgroup driver to use...

	I0127 20:20:10.204759   13598 ssh_runner.go:195] Run: sudo systemctl cat docker.service

	I0127 20:20:10.229127   13598 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I0127 20:20:10.238554   13598 ssh_runner.go:195] Run: sudo systemctl stop -f containerd

	I0127 20:20:10.261715   13598 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I0127 20:20:10.275845   13598 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio

	I0127 20:20:10.286954   13598 ssh_runner.go:195] Run: sudo systemctl stop -f crio

	I0127 20:20:10.310450   13598 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio

	I0127 20:20:10.320780   13598 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/dockershim.sock

	image-endpoint: unix:///var/run/dockershim.sock

	" | sudo tee /etc/crictl.yaml"

	I0127 20:20:10.337126   13598 ssh_runner.go:195] Run: sudo systemctl unmask docker.service

	I0127 20:20:10.420169   13598 ssh_runner.go:195] Run: sudo systemctl enable docker.socket

	I0127 20:20:10.510093   13598 docker.go:529] configuring docker to use "cgroupfs" as cgroup driver...

	I0127 20:20:10.510114   13598 ssh_runner.go:362] scp memory --> /etc/docker/daemon.json (144 bytes)

	I0127 20:20:10.521457   13598 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0127 20:20:10.614064   13598 ssh_runner.go:195] Run: sudo systemctl restart docker

	I0127 20:21:11.645895   13598 ssh_runner.go:235] Completed: sudo systemctl restart docker: (1m1.032889695s)

	I0127 20:21:11.667720   13598 out.go:177] 

	W0127 20:21:11.689502   13598 out.go:239] X Exiting due to RUNTIME_ENABLE: sudo systemctl restart docker: Process exited with status 1

	stdout:

	stderr:

	Job for docker.service failed because the control process exited with error code.

	See "systemctl status docker.service" and "journalctl -xe" for details.

	X Exiting due to RUNTIME_ENABLE: sudo systemctl restart docker: Process exited with status 1

	stdout:

	stderr:

	Job for docker.service failed because the control process exited with error code.

	See "systemctl status docker.service" and "journalctl -xe" for details.

	W0127 20:21:11.689527   13598 out.go:239] * 

	* 

	W0127 20:21:11.690788   13598 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	I0127 20:21:11.753335   13598 out.go:177] 

** /stderr **

start_stop_delete_test.go:259: failed to start minikube post-stop. args "out/minikube-darwin-amd64 start -p old-k8s-version-159000 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=hyperkit  --kubernetes-version=v1.16.0": exit status 90

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p old-k8s-version-159000 -n old-k8s-version-159000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p old-k8s-version-159000 -n old-k8s-version-159000: exit status 6 (158.322077ms)

-- stdout --

	Running

	WARNING: Your kubectl is pointing to stale minikube-vm.

	To fix the kubectl context, run `minikube update-context`

-- /stdout --

** stderr ** 

	E0127 20:21:11.933398   13705 status.go:415] kubeconfig endpoint: extract IP: "old-k8s-version-159000" does not appear in /Users/jenkins/minikube-integration/15565-3235/kubeconfig

** /stderr **

helpers_test.go:239: status error: exit status 6 (may be ok)

helpers_test.go:241: "old-k8s-version-159000" host is not running, skipping log retrieval (state="Running\nWARNING: Your kubectl is pointing to stale minikube-vm.\nTo fix the kubectl context, run `minikube update-context`")

--- FAIL: TestStartStop/group/old-k8s-version/serial/SecondStart (86.13s)

=== RUN   TestStartStop/group/no-preload/serial/UserAppExistsAfterStop

start_stop_delete_test.go:275: failed waiting for 'addon dashboard' pod post-stop-start: client config: context "no-preload-272000" does not exist

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p no-preload-272000 -n no-preload-272000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p no-preload-272000 -n no-preload-272000: exit status 6 (138.382164ms)

-- stdout --

	Running

	WARNING: Your kubectl is pointing to stale minikube-vm.

	To fix the kubectl context, run `minikube update-context`

-- /stdout --

** stderr ** 

	E0127 20:20:57.511760   13677 status.go:415] kubeconfig endpoint: extract IP: "no-preload-272000" does not appear in /Users/jenkins/minikube-integration/15565-3235/kubeconfig

** /stderr **

helpers_test.go:239: status error: exit status 6 (may be ok)

helpers_test.go:241: "no-preload-272000" host is not running, skipping log retrieval (state="Running\nWARNING: Your kubectl is pointing to stale minikube-vm.\nTo fix the kubectl context, run `minikube update-context`")

--- FAIL: TestStartStop/group/no-preload/serial/UserAppExistsAfterStop (0.14s)

=== RUN   TestStartStop/group/no-preload/serial/AddonExistsAfterStop

start_stop_delete_test.go:288: failed waiting for 'addon dashboard' pod post-stop-start: client config: context "no-preload-272000" does not exist

start_stop_delete_test.go:291: (dbg) Run:  kubectl --context no-preload-272000 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard

start_stop_delete_test.go:291: (dbg) Non-zero exit: kubectl --context no-preload-272000 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard: exit status 1 (34.855451ms)

** stderr ** 

	error: context "no-preload-272000" does not exist

** /stderr **

start_stop_delete_test.go:293: failed to get info on kubernetes-dashboard deployments. args "kubectl --context no-preload-272000 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard": exit status 1

start_stop_delete_test.go:297: addon did not load correct image. Expected to contain " k8s.gcr.io/echoserver:1.4". Addon deployment info: 

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p no-preload-272000 -n no-preload-272000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p no-preload-272000 -n no-preload-272000: exit status 6 (146.397532ms)

-- stdout --

	Running

	WARNING: Your kubectl is pointing to stale minikube-vm.

	To fix the kubectl context, run `minikube update-context`

-- /stdout --

** stderr ** 

	E0127 20:20:57.693603   13683 status.go:415] kubeconfig endpoint: extract IP: "no-preload-272000" does not appear in /Users/jenkins/minikube-integration/15565-3235/kubeconfig

** /stderr **

helpers_test.go:239: status error: exit status 6 (may be ok)

helpers_test.go:241: "no-preload-272000" host is not running, skipping log retrieval (state="Running\nWARNING: Your kubectl is pointing to stale minikube-vm.\nTo fix the kubectl context, run `minikube update-context`")

--- FAIL: TestStartStop/group/no-preload/serial/AddonExistsAfterStop (0.18s)

=== RUN   TestStartStop/group/no-preload/serial/VerifyKubernetesImages

start_stop_delete_test.go:304: (dbg) Run:  out/minikube-darwin-amd64 ssh -p no-preload-272000 "sudo crictl images -o json"

E0127 20:21:10.599451    4442 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/15565-3235/.minikube/profiles/custom-flannel-035000/client.crt: no such file or directory

=== CONT  TestStartStop/group/no-preload/serial/VerifyKubernetesImages

start_stop_delete_test.go:304: (dbg) Non-zero exit: out/minikube-darwin-amd64 ssh -p no-preload-272000 "sudo crictl images -o json": exit status 1 (59.627525323s)

-- stdout --

	FATA[0059] listing images: rpc error: code = Unknown desc = error during connect: Get "http://%2Fvar%2Frun%2Fdocker.sock/v1.41/images/json": read unix @->/var/run/docker.sock: read: connection reset by peer 

-- /stdout --

** stderr ** 

	ssh: Process exited with status 1

** /stderr **

start_stop_delete_test.go:304: failed tp get images inside minikube. args "out/minikube-darwin-amd64 ssh -p no-preload-272000 \"sudo crictl images -o json\"": exit status 1

start_stop_delete_test.go:304: failed to decode images json invalid character '\x1b' looking for beginning of value. output:

FATA[0059] listing images: rpc error: code = Unknown desc = error during connect: Get "http://%2Fvar%2Frun%2Fdocker.sock/v1.41/images/json": read unix @->/var/run/docker.sock: read: connection reset by peer 

start_stop_delete_test.go:304: v1.26.1 images missing (-want +got):

  []string{

- 	"gcr.io/k8s-minikube/storage-provisioner:v5",

- 	"registry.k8s.io/coredns/coredns:v1.9.3",

- 	"registry.k8s.io/etcd:3.5.6-0",

- 	"registry.k8s.io/kube-apiserver:v1.26.1",

- 	"registry.k8s.io/kube-controller-manager:v1.26.1",

- 	"registry.k8s.io/kube-proxy:v1.26.1",

- 	"registry.k8s.io/kube-scheduler:v1.26.1",

- 	"registry.k8s.io/pause:3.9",

  }

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p no-preload-272000 -n no-preload-272000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p no-preload-272000 -n no-preload-272000: exit status 6 (155.564259ms)

-- stdout --

	Running

	WARNING: Your kubectl is pointing to stale minikube-vm.

	To fix the kubectl context, run `minikube update-context`

-- /stdout --

** stderr ** 

	E0127 20:21:57.470251   13815 status.go:415] kubeconfig endpoint: extract IP: "no-preload-272000" does not appear in /Users/jenkins/minikube-integration/15565-3235/kubeconfig

** /stderr **

helpers_test.go:239: status error: exit status 6 (may be ok)

helpers_test.go:241: "no-preload-272000" host is not running, skipping log retrieval (state="Running\nWARNING: Your kubectl is pointing to stale minikube-vm.\nTo fix the kubectl context, run `minikube update-context`")

--- FAIL: TestStartStop/group/no-preload/serial/VerifyKubernetesImages (59.78s)

=== RUN   TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop

start_stop_delete_test.go:275: failed waiting for 'addon dashboard' pod post-stop-start: client config: context "old-k8s-version-159000" does not exist

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p old-k8s-version-159000 -n old-k8s-version-159000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p old-k8s-version-159000 -n old-k8s-version-159000: exit status 6 (151.978327ms)

-- stdout --

	Running

	WARNING: Your kubectl is pointing to stale minikube-vm.

	To fix the kubectl context, run `minikube update-context`

-- /stdout --

** stderr ** 

	E0127 20:21:12.086898   13710 status.go:415] kubeconfig endpoint: extract IP: "old-k8s-version-159000" does not appear in /Users/jenkins/minikube-integration/15565-3235/kubeconfig

** /stderr **

helpers_test.go:239: status error: exit status 6 (may be ok)

helpers_test.go:241: "old-k8s-version-159000" host is not running, skipping log retrieval (state="Running\nWARNING: Your kubectl is pointing to stale minikube-vm.\nTo fix the kubectl context, run `minikube update-context`")

--- FAIL: TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop (0.15s)

=== RUN   TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop

start_stop_delete_test.go:288: failed waiting for 'addon dashboard' pod post-stop-start: client config: context "old-k8s-version-159000" does not exist

start_stop_delete_test.go:291: (dbg) Run:  kubectl --context old-k8s-version-159000 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard

start_stop_delete_test.go:291: (dbg) Non-zero exit: kubectl --context old-k8s-version-159000 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard: exit status 1 (35.041574ms)

** stderr ** 

	error: context "old-k8s-version-159000" does not exist

** /stderr **

start_stop_delete_test.go:293: failed to get info on kubernetes-dashboard deployments. args "kubectl --context old-k8s-version-159000 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard": exit status 1

start_stop_delete_test.go:297: addon did not load correct image. Expected to contain " k8s.gcr.io/echoserver:1.4". Addon deployment info: 

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p old-k8s-version-159000 -n old-k8s-version-159000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p old-k8s-version-159000 -n old-k8s-version-159000: exit status 6 (148.456691ms)

-- stdout --

	Running

	WARNING: Your kubectl is pointing to stale minikube-vm.

	To fix the kubectl context, run `minikube update-context`

-- /stdout --

** stderr ** 

	E0127 20:21:12.270967   13716 status.go:415] kubeconfig endpoint: extract IP: "old-k8s-version-159000" does not appear in /Users/jenkins/minikube-integration/15565-3235/kubeconfig

** /stderr **

helpers_test.go:239: status error: exit status 6 (may be ok)

helpers_test.go:241: "old-k8s-version-159000" host is not running, skipping log retrieval (state="Running\nWARNING: Your kubectl is pointing to stale minikube-vm.\nTo fix the kubectl context, run `minikube update-context`")

--- FAIL: TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop (0.18s)

=== RUN   TestStartStop/group/old-k8s-version/serial/VerifyKubernetesImages

start_stop_delete_test.go:304: (dbg) Run:  out/minikube-darwin-amd64 ssh -p old-k8s-version-159000 "sudo crictl images -o json"

start_stop_delete_test.go:304: (dbg) Non-zero exit: out/minikube-darwin-amd64 ssh -p old-k8s-version-159000 "sudo crictl images -o json": exit status 1 (2.14451223s)

-- stdout --

	FATA[0002] connect: connect endpoint 'unix:///var/run/dockershim.sock', make sure you are running as root and the endpoint has been started: context deadline exceeded 

-- /stdout --

** stderr ** 

	ssh: Process exited with status 1

** /stderr **

start_stop_delete_test.go:304: failed tp get images inside minikube. args "out/minikube-darwin-amd64 ssh -p old-k8s-version-159000 \"sudo crictl images -o json\"": exit status 1

start_stop_delete_test.go:304: failed to decode images json invalid character '\x1b' looking for beginning of value. output:

FATA[0002] connect: connect endpoint 'unix:///var/run/dockershim.sock', make sure you are running as root and the endpoint has been started: context deadline exceeded 

start_stop_delete_test.go:304: v1.16.0 images missing (-want +got):

  []string{

- 	"gcr.io/k8s-minikube/storage-provisioner:v5",

- 	"k8s.gcr.io/coredns:1.6.2",

- 	"k8s.gcr.io/etcd:3.3.15-0",

- 	"k8s.gcr.io/kube-apiserver:v1.16.0",

- 	"k8s.gcr.io/kube-controller-manager:v1.16.0",

- 	"k8s.gcr.io/kube-proxy:v1.16.0",

- 	"k8s.gcr.io/kube-scheduler:v1.16.0",

- 	"k8s.gcr.io/pause:3.1",

  }

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p old-k8s-version-159000 -n old-k8s-version-159000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p old-k8s-version-159000 -n old-k8s-version-159000: exit status 6 (149.516543ms)

-- stdout --

	Running

	WARNING: Your kubectl is pointing to stale minikube-vm.

	To fix the kubectl context, run `minikube update-context`

-- /stdout --

** stderr ** 

	E0127 20:21:14.565600   13733 status.go:415] kubeconfig endpoint: extract IP: "old-k8s-version-159000" does not appear in /Users/jenkins/minikube-integration/15565-3235/kubeconfig

** /stderr **

helpers_test.go:239: status error: exit status 6 (may be ok)

helpers_test.go:241: "old-k8s-version-159000" host is not running, skipping log retrieval (state="Running\nWARNING: Your kubectl is pointing to stale minikube-vm.\nTo fix the kubectl context, run `minikube update-context`")

--- FAIL: TestStartStop/group/old-k8s-version/serial/VerifyKubernetesImages (2.29s)

=== RUN   TestStartStop/group/old-k8s-version/serial/Pause

start_stop_delete_test.go:311: (dbg) Run:  out/minikube-darwin-amd64 pause -p old-k8s-version-159000 --alsologtostderr -v=1

start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-darwin-amd64 pause -p old-k8s-version-159000 --alsologtostderr -v=1: exit status 80 (1.883183573s)

-- stdout --

	* Pausing node old-k8s-version-159000 ... 

-- /stdout --

** stderr ** 

	I0127 20:21:14.629770   13738 out.go:296] Setting OutFile to fd 1 ...

	I0127 20:21:14.630656   13738 out.go:343] TERM=,COLORTERM=, which probably does not support color

	I0127 20:21:14.630663   13738 out.go:309] Setting ErrFile to fd 2...

	I0127 20:21:14.630667   13738 out.go:343] TERM=,COLORTERM=, which probably does not support color

	I0127 20:21:14.630769   13738 root.go:334] Updating PATH: /Users/jenkins/minikube-integration/15565-3235/.minikube/bin

	I0127 20:21:14.631083   13738 out.go:303] Setting JSON to false

	I0127 20:21:14.631100   13738 mustload.go:65] Loading cluster: old-k8s-version-159000

	I0127 20:21:14.631359   13738 config.go:180] Loaded profile config "old-k8s-version-159000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.16.0

	I0127 20:21:14.631737   13738 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit

	I0127 20:21:14.631785   13738 main.go:141] libmachine: Launching plugin server for driver hyperkit

	I0127 20:21:14.638785   13738 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:56352

	I0127 20:21:14.639771   13738 main.go:141] libmachine: () Calling .GetVersion

	I0127 20:21:14.640210   13738 main.go:141] libmachine: Using API Version  1

	I0127 20:21:14.640228   13738 main.go:141] libmachine: () Calling .SetConfigRaw

	I0127 20:21:14.640440   13738 main.go:141] libmachine: () Calling .GetMachineName

	I0127 20:21:14.640555   13738 main.go:141] libmachine: (old-k8s-version-159000) Calling .GetState

	I0127 20:21:14.640647   13738 main.go:141] libmachine: (old-k8s-version-159000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0

	I0127 20:21:14.640718   13738 main.go:141] libmachine: (old-k8s-version-159000) DBG | hyperkit pid from json: 13617

	I0127 20:21:14.641631   13738 host.go:66] Checking if "old-k8s-version-159000" exists ...

	I0127 20:21:14.641874   13738 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit

	I0127 20:21:14.641910   13738 main.go:141] libmachine: Launching plugin server for driver hyperkit

	I0127 20:21:14.648615   13738 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:56354

	I0127 20:21:14.648971   13738 main.go:141] libmachine: () Calling .GetVersion

	I0127 20:21:14.649295   13738 main.go:141] libmachine: Using API Version  1

	I0127 20:21:14.649311   13738 main.go:141] libmachine: () Calling .SetConfigRaw

	I0127 20:21:14.649510   13738 main.go:141] libmachine: () Calling .GetMachineName

	I0127 20:21:14.649603   13738 main.go:141] libmachine: (old-k8s-version-159000) Calling .DriverName

	I0127 20:21:14.650206   13738 pause.go:58] "namespaces" [kube-system kubernetes-dashboard storage-gluster istio-operator]="keys" map[addons:[] all:%!s(bool=false) apiserver-ips:[] apiserver-name:minikubeCA apiserver-names:[] apiserver-port:%!s(int=8443) auto-update-drivers:%!s(bool=true) base-image:gcr.io/k8s-minikube/kicbase-builds:v0.0.36-1674164627-15541@sha256:0a2280301e955e0d3910d6e639e0b7341db1f4a25558521ac97b38c782c6189a binary-mirror: bootstrapper:kubeadm cache-images:%!s(bool=true) cancel-scheduled:%!s(bool=false) cert-expiration:26280h0m0s cni: container-runtime: cpus:2 cri-socket: delete-on-failure:%!s(bool=false) disable-driver-mounts:%!s(bool=false) disable-metrics:%!s(bool=false) disable-optimizations:%!s(bool=false) disk-size:20000mb dns-domain:cluster.local dns-proxy:%!s(bool=false) docker-env:[] docker-opt:[] download-only:%!s(bool=false) driver: dry-run:%!s(bool=false) embed-certs:%!s(bool=false) embedcerts:%!s(bool=false) enable-default-cni:%!s(bool=false) extra-config: extra-disks

:%!s(int=0) feature-gates: force:%!s(bool=false) force-systemd:%!s(bool=false) host-dns-resolver:%!s(bool=true) host-only-cidr:192.168.59.1/24 host-only-nic-type:virtio hyperkit-vpnkit-sock: hyperkit-vsock-ports:[] hyperv-external-adapter: hyperv-use-external-switch:%!s(bool=false) hyperv-virtual-switch: image-mirror-country: image-repository: insecure-registry:[] install-addons:%!s(bool=true) interactive:%!s(bool=true) iso-url:[https://storage.googleapis.com/minikube-builds/iso/15565/minikube-v1.29.0-1674856271-15565-amd64.iso https://github.com/kubernetes/minikube/releases/download/v1.29.0-1674856271-15565/minikube-v1.29.0-1674856271-15565-amd64.iso https://kubernetes.oss-cn-hangzhou.aliyuncs.com/minikube/iso/minikube-v1.29.0-1674856271-15565-amd64.iso] keep-context:%!s(bool=false) keep-context-active:%!s(bool=false) kubernetes-version: kvm-gpu:%!s(bool=false) kvm-hidden:%!s(bool=false) kvm-network:default kvm-numa-count:%!s(int=1) kvm-qemu-uri:qemu:///system listen-address: maxauditentries:%!s(int=1000) me

mory: mount:%!s(bool=false) mount-9p-version:9p2000.L mount-gid:docker mount-ip: mount-msize:%!s(int=262144) mount-options:[] mount-port:0 mount-string:/Users:/minikube-host mount-type:9p mount-uid:docker namespace:default nat-nic-type:virtio native-ssh:%!s(bool=true) network: network-plugin: nfs-share:[] nfs-shares-root:/nfsshares no-kubernetes:%!s(bool=false) no-vtx-check:%!s(bool=false) nodes:%!s(int=1) output:text ports:[] preload:%!s(bool=true) profile:old-k8s-version-159000 purge:%!s(bool=false) qemu-firmware-path: registry-mirror:[] reminderwaitperiodinhours:%!s(int=24) rootless:%!s(bool=false) schedule:0s service-cluster-ip-range:10.96.0.0/12 socket-vmnet-client-path:/opt/socket_vmnet/bin/socket_vmnet_client socket-vmnet-path:/var/run/socket_vmnet ssh-ip-address: ssh-key: ssh-port:%!s(int=22) ssh-user:root static-ip: subnet: trace: user: uuid: vm:%!s(bool=false) vm-driver: wait:[apiserver system_pods] wait-timeout:6m0s wantnonedriverwarning:%!s(bool=true) wantupdatenotification:%!s(bool=true) wantvirt

ualboxdriverwarning:%!s(bool=true)]="(MISSING)"

	I0127 20:21:14.694255   13738 out.go:177] * Pausing node old-k8s-version-159000 ... 

	I0127 20:21:14.715322   13738 host.go:66] Checking if "old-k8s-version-159000" exists ...

	I0127 20:21:14.715922   13738 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit

	I0127 20:21:14.715968   13738 main.go:141] libmachine: Launching plugin server for driver hyperkit

	I0127 20:21:14.724409   13738 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:56356

	I0127 20:21:14.724787   13738 main.go:141] libmachine: () Calling .GetVersion

	I0127 20:21:14.725150   13738 main.go:141] libmachine: Using API Version  1

	I0127 20:21:14.725162   13738 main.go:141] libmachine: () Calling .SetConfigRaw

	I0127 20:21:14.725384   13738 main.go:141] libmachine: () Calling .GetMachineName

	I0127 20:21:14.725503   13738 main.go:141] libmachine: (old-k8s-version-159000) Calling .DriverName

	I0127 20:21:14.725652   13738 ssh_runner.go:195] Run: systemctl --version

	I0127 20:21:14.725669   13738 main.go:141] libmachine: (old-k8s-version-159000) Calling .GetSSHHostname

	I0127 20:21:14.725739   13738 main.go:141] libmachine: (old-k8s-version-159000) Calling .GetSSHPort

	I0127 20:21:14.725816   13738 main.go:141] libmachine: (old-k8s-version-159000) Calling .GetSSHKeyPath

	I0127 20:21:14.725911   13738 main.go:141] libmachine: (old-k8s-version-159000) Calling .GetSSHUsername

	I0127 20:21:14.725998   13738 sshutil.go:53] new ssh client: &{IP:192.168.64.40 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/15565-3235/.minikube/machines/old-k8s-version-159000/id_rsa Username:docker}

	I0127 20:21:14.766325   13738 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0127 20:21:14.775076   13738 pause.go:51] kubelet running: false

	I0127 20:21:14.775126   13738 ssh_runner.go:195] Run: sudo systemctl disable --now kubelet

	I0127 20:21:14.784633   13738 retry.go:31] will retry after 276.165072ms: kubelet disable --now: sudo systemctl disable --now kubelet: Process exited with status 1

	stdout:

	stderr:

	Failed to disable unit: Unit file kubelet.service does not exist.

	I0127 20:21:15.061205   13738 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0127 20:21:15.073060   13738 pause.go:51] kubelet running: false

	I0127 20:21:15.073111   13738 ssh_runner.go:195] Run: sudo systemctl disable --now kubelet

	I0127 20:21:15.083250   13738 retry.go:31] will retry after 540.190908ms: kubelet disable --now: sudo systemctl disable --now kubelet: Process exited with status 1

	stdout:

	stderr:

	Failed to disable unit: Unit file kubelet.service does not exist.

	I0127 20:21:15.625330   13738 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0127 20:21:15.637123   13738 pause.go:51] kubelet running: false

	I0127 20:21:15.637188   13738 ssh_runner.go:195] Run: sudo systemctl disable --now kubelet

	I0127 20:21:15.647782   13738 retry.go:31] will retry after 655.06503ms: kubelet disable --now: sudo systemctl disable --now kubelet: Process exited with status 1

	stdout:

	stderr:

	Failed to disable unit: Unit file kubelet.service does not exist.

	I0127 20:21:16.303548   13738 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0127 20:21:16.313686   13738 pause.go:51] kubelet running: false

	I0127 20:21:16.313764   13738 ssh_runner.go:195] Run: sudo systemctl disable --now kubelet

	I0127 20:21:16.347009   13738 out.go:177] 

	W0127 20:21:16.368870   13738 out.go:239] X Exiting due to GUEST_PAUSE: kubelet disable --now: sudo systemctl disable --now kubelet: Process exited with status 1

	stdout:

	stderr:

	Failed to disable unit: Unit file kubelet.service does not exist.

	X Exiting due to GUEST_PAUSE: kubelet disable --now: sudo systemctl disable --now kubelet: Process exited with status 1

	stdout:

	stderr:

	Failed to disable unit: Unit file kubelet.service does not exist.

	W0127 20:21:16.368896   13738 out.go:239] * 

	* 

	W0127 20:21:16.373568   13738 out.go:239] ╭──────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                                                          │

	│    * If the above advice does not help, please let us know:                                                              │

	│      https://github.com/kubernetes/minikube/issues/new/choose                                                            │

	│                                                                                                                          │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                 │

	│    * Please also attach the following file to the GitHub issue:                                                          │

	│    * - /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/minikube_pause_49fdaea37aad8ebccb761973c21590cc64efe8d9_0.log    │

	│                                                                                                                          │

	╰──────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯

	╭──────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                                                          │

	│    * If the above advice does not help, please let us know:                                                              │

	│      https://github.com/kubernetes/minikube/issues/new/choose                                                            │

	│                                                                                                                          │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                 │

	│    * Please also attach the following file to the GitHub issue:                                                          │

	│    * - /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/minikube_pause_49fdaea37aad8ebccb761973c21590cc64efe8d9_0.log    │

	│                                                                                                                          │

	╰──────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯

	I0127 20:21:16.433869   13738 out.go:177] 

** /stderr **

start_stop_delete_test.go:311: out/minikube-darwin-amd64 pause -p old-k8s-version-159000 --alsologtostderr -v=1 failed: exit status 80

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p old-k8s-version-159000 -n old-k8s-version-159000

E0127 20:21:16.579001    4442 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/15565-3235/.minikube/profiles/flannel-035000/client.crt: no such file or directory

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p old-k8s-version-159000 -n old-k8s-version-159000: exit status 6 (149.118398ms)

-- stdout --

	Running

	WARNING: Your kubectl is pointing to stale minikube-vm.

	To fix the kubectl context, run `minikube update-context`

-- /stdout --

** stderr ** 

	E0127 20:21:16.598708   13743 status.go:415] kubeconfig endpoint: extract IP: "old-k8s-version-159000" does not appear in /Users/jenkins/minikube-integration/15565-3235/kubeconfig

** /stderr **

helpers_test.go:239: status error: exit status 6 (may be ok)

helpers_test.go:241: "old-k8s-version-159000" host is not running, skipping log retrieval (state="Running\nWARNING: Your kubectl is pointing to stale minikube-vm.\nTo fix the kubectl context, run `minikube update-context`")

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p old-k8s-version-159000 -n old-k8s-version-159000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p old-k8s-version-159000 -n old-k8s-version-159000: exit status 6 (149.862821ms)

-- stdout --

	Running

	WARNING: Your kubectl is pointing to stale minikube-vm.

	To fix the kubectl context, run `minikube update-context`

-- /stdout --

** stderr ** 

	E0127 20:21:16.749583   13748 status.go:415] kubeconfig endpoint: extract IP: "old-k8s-version-159000" does not appear in /Users/jenkins/minikube-integration/15565-3235/kubeconfig

** /stderr **

helpers_test.go:239: status error: exit status 6 (may be ok)

helpers_test.go:241: "old-k8s-version-159000" host is not running, skipping log retrieval (state="Running\nWARNING: Your kubectl is pointing to stale minikube-vm.\nTo fix the kubectl context, run `minikube update-context`")

--- FAIL: TestStartStop/group/old-k8s-version/serial/Pause (2.18s)

=== RUN   TestStartStop/group/no-preload/serial/Pause

start_stop_delete_test.go:311: (dbg) Run:  out/minikube-darwin-amd64 pause -p no-preload-272000 --alsologtostderr -v=1

E0127 20:21:57.538313    4442 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/15565-3235/.minikube/profiles/flannel-035000/client.crt: no such file or directory

start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-darwin-amd64 pause -p no-preload-272000 --alsologtostderr -v=1: exit status 80 (1.914312725s)

-- stdout --

	* Pausing node no-preload-272000 ... 

-- /stdout --

** stderr ** 

	I0127 20:21:57.542012   13820 out.go:296] Setting OutFile to fd 1 ...

	I0127 20:21:57.542263   13820 out.go:343] TERM=,COLORTERM=, which probably does not support color

	I0127 20:21:57.542268   13820 out.go:309] Setting ErrFile to fd 2...

	I0127 20:21:57.542272   13820 out.go:343] TERM=,COLORTERM=, which probably does not support color

	I0127 20:21:57.542410   13820 root.go:334] Updating PATH: /Users/jenkins/minikube-integration/15565-3235/.minikube/bin

	I0127 20:21:57.542757   13820 out.go:303] Setting JSON to false

	I0127 20:21:57.542774   13820 mustload.go:65] Loading cluster: no-preload-272000

	I0127 20:21:57.543058   13820 config.go:180] Loaded profile config "no-preload-272000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.26.1

	I0127 20:21:57.543422   13820 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit

	I0127 20:21:57.543480   13820 main.go:141] libmachine: Launching plugin server for driver hyperkit

	I0127 20:21:57.550443   13820 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:56419

	I0127 20:21:57.550828   13820 main.go:141] libmachine: () Calling .GetVersion

	I0127 20:21:57.551290   13820 main.go:141] libmachine: Using API Version  1

	I0127 20:21:57.551305   13820 main.go:141] libmachine: () Calling .SetConfigRaw

	I0127 20:21:57.551532   13820 main.go:141] libmachine: () Calling .GetMachineName

	I0127 20:21:57.551637   13820 main.go:141] libmachine: (no-preload-272000) Calling .GetState

	I0127 20:21:57.551725   13820 main.go:141] libmachine: (no-preload-272000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0

	I0127 20:21:57.551810   13820 main.go:141] libmachine: (no-preload-272000) DBG | hyperkit pid from json: 13586

	I0127 20:21:57.552711   13820 host.go:66] Checking if "no-preload-272000" exists ...

	I0127 20:21:57.552990   13820 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit

	I0127 20:21:57.553013   13820 main.go:141] libmachine: Launching plugin server for driver hyperkit

	I0127 20:21:57.560080   13820 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:56421

	I0127 20:21:57.560445   13820 main.go:141] libmachine: () Calling .GetVersion

	I0127 20:21:57.560778   13820 main.go:141] libmachine: Using API Version  1

	I0127 20:21:57.560797   13820 main.go:141] libmachine: () Calling .SetConfigRaw

	I0127 20:21:57.561011   13820 main.go:141] libmachine: () Calling .GetMachineName

	I0127 20:21:57.561126   13820 main.go:141] libmachine: (no-preload-272000) Calling .DriverName

	I0127 20:21:57.561761   13820 pause.go:58] "namespaces" [kube-system kubernetes-dashboard storage-gluster istio-operator]="keys" map[addons:[] all:%!s(bool=false) apiserver-ips:[] apiserver-name:minikubeCA apiserver-names:[] apiserver-port:%!s(int=8443) auto-update-drivers:%!s(bool=true) base-image:gcr.io/k8s-minikube/kicbase-builds:v0.0.36-1674164627-15541@sha256:0a2280301e955e0d3910d6e639e0b7341db1f4a25558521ac97b38c782c6189a binary-mirror: bootstrapper:kubeadm cache-images:%!s(bool=true) cancel-scheduled:%!s(bool=false) cert-expiration:26280h0m0s cni: container-runtime: cpus:2 cri-socket: delete-on-failure:%!s(bool=false) disable-driver-mounts:%!s(bool=false) disable-metrics:%!s(bool=false) disable-optimizations:%!s(bool=false) disk-size:20000mb dns-domain:cluster.local dns-proxy:%!s(bool=false) docker-env:[] docker-opt:[] download-only:%!s(bool=false) driver: dry-run:%!s(bool=false) embed-certs:%!s(bool=false) embedcerts:%!s(bool=false) enable-default-cni:%!s(bool=false) extra-config: extra-disks

:%!s(int=0) feature-gates: force:%!s(bool=false) force-systemd:%!s(bool=false) host-dns-resolver:%!s(bool=true) host-only-cidr:192.168.59.1/24 host-only-nic-type:virtio hyperkit-vpnkit-sock: hyperkit-vsock-ports:[] hyperv-external-adapter: hyperv-use-external-switch:%!s(bool=false) hyperv-virtual-switch: image-mirror-country: image-repository: insecure-registry:[] install-addons:%!s(bool=true) interactive:%!s(bool=true) iso-url:[https://storage.googleapis.com/minikube-builds/iso/15565/minikube-v1.29.0-1674856271-15565-amd64.iso https://github.com/kubernetes/minikube/releases/download/v1.29.0-1674856271-15565/minikube-v1.29.0-1674856271-15565-amd64.iso https://kubernetes.oss-cn-hangzhou.aliyuncs.com/minikube/iso/minikube-v1.29.0-1674856271-15565-amd64.iso] keep-context:%!s(bool=false) keep-context-active:%!s(bool=false) kubernetes-version: kvm-gpu:%!s(bool=false) kvm-hidden:%!s(bool=false) kvm-network:default kvm-numa-count:%!s(int=1) kvm-qemu-uri:qemu:///system listen-address: maxauditentries:%!s(int=1000) me

mory: mount:%!s(bool=false) mount-9p-version:9p2000.L mount-gid:docker mount-ip: mount-msize:%!s(int=262144) mount-options:[] mount-port:0 mount-string:/Users:/minikube-host mount-type:9p mount-uid:docker namespace:default nat-nic-type:virtio native-ssh:%!s(bool=true) network: network-plugin: nfs-share:[] nfs-shares-root:/nfsshares no-kubernetes:%!s(bool=false) no-vtx-check:%!s(bool=false) nodes:%!s(int=1) output:text ports:[] preload:%!s(bool=true) profile:no-preload-272000 purge:%!s(bool=false) qemu-firmware-path: registry-mirror:[] reminderwaitperiodinhours:%!s(int=24) rootless:%!s(bool=false) schedule:0s service-cluster-ip-range:10.96.0.0/12 socket-vmnet-client-path:/opt/socket_vmnet/bin/socket_vmnet_client socket-vmnet-path:/var/run/socket_vmnet ssh-ip-address: ssh-key: ssh-port:%!s(int=22) ssh-user:root static-ip: subnet: trace: user: uuid: vm:%!s(bool=false) vm-driver: wait:[apiserver system_pods] wait-timeout:6m0s wantnonedriverwarning:%!s(bool=true) wantupdatenotification:%!s(bool=true) wantvirtualbo

xdriverwarning:%!s(bool=true)]="(MISSING)"

	I0127 20:21:57.583149   13820 out.go:177] * Pausing node no-preload-272000 ... 

	I0127 20:21:57.624944   13820 host.go:66] Checking if "no-preload-272000" exists ...

	I0127 20:21:57.625303   13820 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit

	I0127 20:21:57.625331   13820 main.go:141] libmachine: Launching plugin server for driver hyperkit

	I0127 20:21:57.632371   13820 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:56423

	I0127 20:21:57.632747   13820 main.go:141] libmachine: () Calling .GetVersion

	I0127 20:21:57.633100   13820 main.go:141] libmachine: Using API Version  1

	I0127 20:21:57.633114   13820 main.go:141] libmachine: () Calling .SetConfigRaw

	I0127 20:21:57.633365   13820 main.go:141] libmachine: () Calling .GetMachineName

	I0127 20:21:57.633489   13820 main.go:141] libmachine: (no-preload-272000) Calling .DriverName

	I0127 20:21:57.633653   13820 ssh_runner.go:195] Run: systemctl --version

	I0127 20:21:57.633672   13820 main.go:141] libmachine: (no-preload-272000) Calling .GetSSHHostname

	I0127 20:21:57.633751   13820 main.go:141] libmachine: (no-preload-272000) Calling .GetSSHPort

	I0127 20:21:57.633833   13820 main.go:141] libmachine: (no-preload-272000) Calling .GetSSHKeyPath

	I0127 20:21:57.633909   13820 main.go:141] libmachine: (no-preload-272000) Calling .GetSSHUsername

	I0127 20:21:57.633989   13820 sshutil.go:53] new ssh client: &{IP:192.168.64.41 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/15565-3235/.minikube/machines/no-preload-272000/id_rsa Username:docker}

	I0127 20:21:57.669284   13820 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0127 20:21:57.677795   13820 pause.go:51] kubelet running: false

	I0127 20:21:57.677859   13820 ssh_runner.go:195] Run: sudo systemctl disable --now kubelet

	I0127 20:21:57.687048   13820 retry.go:31] will retry after 276.165072ms: kubelet disable --now: sudo systemctl disable --now kubelet: Process exited with status 1

	stdout:

	stderr:

	Failed to disable unit: Unit file kubelet.service does not exist.

	I0127 20:21:57.964188   13820 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0127 20:21:57.973491   13820 pause.go:51] kubelet running: false

	I0127 20:21:57.973563   13820 ssh_runner.go:195] Run: sudo systemctl disable --now kubelet

	I0127 20:21:57.983250   13820 retry.go:31] will retry after 540.190908ms: kubelet disable --now: sudo systemctl disable --now kubelet: Process exited with status 1

	stdout:

	stderr:

	Failed to disable unit: Unit file kubelet.service does not exist.

	I0127 20:21:58.523581   13820 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0127 20:21:58.534070   13820 pause.go:51] kubelet running: false

	I0127 20:21:58.534133   13820 ssh_runner.go:195] Run: sudo systemctl disable --now kubelet

	I0127 20:21:58.543663   13820 retry.go:31] will retry after 655.06503ms: kubelet disable --now: sudo systemctl disable --now kubelet: Process exited with status 1

	stdout:

	stderr:

	Failed to disable unit: Unit file kubelet.service does not exist.

	I0127 20:21:59.200944   13820 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0127 20:21:59.211588   13820 pause.go:51] kubelet running: false

	I0127 20:21:59.211646   13820 ssh_runner.go:195] Run: sudo systemctl disable --now kubelet

	I0127 20:21:59.259945   13820 out.go:177] 

	W0127 20:21:59.280988   13820 out.go:239] X Exiting due to GUEST_PAUSE: kubelet disable --now: sudo systemctl disable --now kubelet: Process exited with status 1

	stdout:

	stderr:

	Failed to disable unit: Unit file kubelet.service does not exist.

	X Exiting due to GUEST_PAUSE: kubelet disable --now: sudo systemctl disable --now kubelet: Process exited with status 1

	stdout:

	stderr:

	Failed to disable unit: Unit file kubelet.service does not exist.

	W0127 20:21:59.281004   13820 out.go:239] * 

	* 

	W0127 20:21:59.284231   13820 out.go:239] ╭──────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                                                          │

	│    * If the above advice does not help, please let us know:                                                              │

	│      https://github.com/kubernetes/minikube/issues/new/choose                                                            │

	│                                                                                                                          │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                 │

	│    * Please also attach the following file to the GitHub issue:                                                          │

	│    * - /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/minikube_pause_49fdaea37aad8ebccb761973c21590cc64efe8d9_0.log    │

	│                                                                                                                          │

	╰──────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯

	╭──────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                                                          │

	│    * If the above advice does not help, please let us know:                                                              │

	│      https://github.com/kubernetes/minikube/issues/new/choose                                                            │

	│                                                                                                                          │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                 │

	│    * Please also attach the following file to the GitHub issue:                                                          │

	│    * - /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/minikube_pause_49fdaea37aad8ebccb761973c21590cc64efe8d9_0.log    │

	│                                                                                                                          │

	╰──────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯

	I0127 20:21:59.359995   13820 out.go:177] 

** /stderr **

start_stop_delete_test.go:311: out/minikube-darwin-amd64 pause -p no-preload-272000 --alsologtostderr -v=1 failed: exit status 80

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p no-preload-272000 -n no-preload-272000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p no-preload-272000 -n no-preload-272000: exit status 6 (140.910137ms)

-- stdout --

	Running

	WARNING: Your kubectl is pointing to stale minikube-vm.

	To fix the kubectl context, run `minikube update-context`

-- /stdout --

** stderr ** 

	E0127 20:21:59.531763   13829 status.go:415] kubeconfig endpoint: extract IP: "no-preload-272000" does not appear in /Users/jenkins/minikube-integration/15565-3235/kubeconfig

** /stderr **

helpers_test.go:239: status error: exit status 6 (may be ok)

helpers_test.go:241: "no-preload-272000" host is not running, skipping log retrieval (state="Running\nWARNING: Your kubectl is pointing to stale minikube-vm.\nTo fix the kubectl context, run `minikube update-context`")

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p no-preload-272000 -n no-preload-272000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p no-preload-272000 -n no-preload-272000: exit status 6 (146.574425ms)

-- stdout --

	Running

	WARNING: Your kubectl is pointing to stale minikube-vm.

	To fix the kubectl context, run `minikube update-context`

-- /stdout --

** stderr ** 

	E0127 20:21:59.678541   13834 status.go:415] kubeconfig endpoint: extract IP: "no-preload-272000" does not appear in /Users/jenkins/minikube-integration/15565-3235/kubeconfig

** /stderr **

helpers_test.go:239: status error: exit status 6 (may be ok)

helpers_test.go:241: "no-preload-272000" host is not running, skipping log retrieval (state="Running\nWARNING: Your kubectl is pointing to stale minikube-vm.\nTo fix the kubectl context, run `minikube update-context`")

--- FAIL: TestStartStop/group/no-preload/serial/Pause (2.20s)

=== RUN   TestDownloadOnly/v1.16.0/json-events

aaa_download_only_test.go:71: (dbg) Run:  out/minikube-darwin-amd64 start -o=json --download-only -p download-only-953000 --force --alsologtostderr --kubernetes-version=v1.16.0 --container-runtime=docker --driver=hyperkit 

aaa_download_only_test.go:71: (dbg) Done: out/minikube-darwin-amd64 start -o=json --download-only -p download-only-953000 --force --alsologtostderr --kubernetes-version=v1.16.0 --container-runtime=docker --driver=hyperkit : (10.190413123s)

--- PASS: TestDownloadOnly/v1.16.0/json-events (10.19s)

=== RUN   TestDownloadOnly/v1.16.0/preload-exists

--- PASS: TestDownloadOnly/v1.16.0/preload-exists (0.00s)

=== RUN   TestDownloadOnly/v1.16.0/kubectl

--- PASS: TestDownloadOnly/v1.16.0/kubectl (0.00s)

=== RUN   TestDownloadOnly/v1.16.0/LogsDuration

aaa_download_only_test.go:173: (dbg) Run:  out/minikube-darwin-amd64 logs -p download-only-953000

aaa_download_only_test.go:173: (dbg) Non-zero exit: out/minikube-darwin-amd64 logs -p download-only-953000: exit status 85 (333.452069ms)

-- stdout --

	* 

	* ==> Audit <==

	* |---------|--------------------------------|----------------------|---------|---------|---------------------|----------|

	| Command |              Args              |       Profile        |  User   | Version |     Start Time      | End Time |

	|---------|--------------------------------|----------------------|---------|---------|---------------------|----------|

	| start   | -o=json --download-only        | download-only-953000 | jenkins | v1.28.0 | 27 Jan 23 19:30 PST |          |

	|         | -p download-only-953000        |                      |         |         |                     |          |

	|         | --force --alsologtostderr      |                      |         |         |                     |          |

	|         | --kubernetes-version=v1.16.0   |                      |         |         |                     |          |

	|         | --container-runtime=docker     |                      |         |         |                     |          |

	|         | --driver=hyperkit              |                      |         |         |                     |          |

	|---------|--------------------------------|----------------------|---------|---------|---------------------|----------|

	* 

	* ==> Last Start <==

	* Log file created at: 2023/01/27 19:30:11

	Running on machine: MacOS-Agent-4

	Binary: Built with gc go1.19.5 for darwin/amd64

	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg

	I0127 19:30:11.651394    4444 out.go:296] Setting OutFile to fd 1 ...

	I0127 19:30:11.651633    4444 out.go:343] TERM=,COLORTERM=, which probably does not support color

	I0127 19:30:11.651638    4444 out.go:309] Setting ErrFile to fd 2...

	I0127 19:30:11.651642    4444 out.go:343] TERM=,COLORTERM=, which probably does not support color

	I0127 19:30:11.651747    4444 root.go:334] Updating PATH: /Users/jenkins/minikube-integration/15565-3235/.minikube/bin

	W0127 19:30:11.651845    4444 root.go:311] Error reading config file at /Users/jenkins/minikube-integration/15565-3235/.minikube/config/config.json: open /Users/jenkins/minikube-integration/15565-3235/.minikube/config/config.json: no such file or directory

	I0127 19:30:11.652521    4444 out.go:303] Setting JSON to true

	I0127 19:30:11.670936    4444 start.go:125] hostinfo: {"hostname":"MacOS-Agent-4.local","uptime":1786,"bootTime":1674874825,"procs":401,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"13.2","kernelVersion":"22.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"f2f27e25-cfda-5ffd-9706-e98286194e62"}

	W0127 19:30:11.671022    4444 start.go:133] gopshost.Virtualization returned error: not implemented yet

	I0127 19:30:11.693311    4444 out.go:97] [download-only-953000] minikube v1.28.0 on Darwin 13.2

	I0127 19:30:11.693539    4444 notify.go:220] Checking for updates...

	W0127 19:30:11.693597    4444 preload.go:295] Failed to list preload files: open /Users/jenkins/minikube-integration/15565-3235/.minikube/cache/preloaded-tarball: no such file or directory

	I0127 19:30:11.714826    4444 out.go:169] MINIKUBE_LOCATION=15565

	I0127 19:30:11.737290    4444 out.go:169] KUBECONFIG=/Users/jenkins/minikube-integration/15565-3235/kubeconfig

	I0127 19:30:11.759183    4444 out.go:169] MINIKUBE_BIN=out/minikube-darwin-amd64

	I0127 19:30:11.780779    4444 out.go:169] MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I0127 19:30:11.802072    4444 out.go:169] MINIKUBE_HOME=/Users/jenkins/minikube-integration/15565-3235/.minikube

	W0127 19:30:11.844681    4444 out.go:272] minikube skips various validations when --force is supplied; this may lead to unexpected behavior

	I0127 19:30:11.845131    4444 driver.go:365] Setting default libvirt URI to qemu:///system

	I0127 19:30:11.933867    4444 out.go:97] Using the hyperkit driver based on user configuration

	I0127 19:30:11.933915    4444 start.go:296] selected driver: hyperkit

	I0127 19:30:11.933929    4444 start.go:840] validating driver "hyperkit" against <nil>

	I0127 19:30:11.934042    4444 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0127 19:30:11.934324    4444 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/15565-3235/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin

	I0127 19:30:12.071466    4444 install.go:137] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit version is 1.28.0

	I0127 19:30:12.075300    4444 install.go:79] stdout: /Users/jenkins/workspace/out/docker-machine-driver-hyperkit

	I0127 19:30:12.075316    4444 install.go:81] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit looks good

	I0127 19:30:12.075347    4444 start_flags.go:305] no existing cluster config was found, will generate one from the flags 

	I0127 19:30:12.079850    4444 start_flags.go:386] Using suggested 6000MB memory alloc based on sys=32768MB, container=0MB

	I0127 19:30:12.079959    4444 start_flags.go:899] Wait components to verify : map[apiserver:true system_pods:true]

	I0127 19:30:12.079988    4444 cni.go:84] Creating CNI manager for ""

	I0127 19:30:12.080004    4444 cni.go:161] CNI unnecessary in this configuration, recommending no CNI

	I0127 19:30:12.080013    4444 start_flags.go:319] config:

	{Name:download-only-953000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.36-1674164627-15541@sha256:0a2280301e955e0d3910d6e639e0b7341db1f4a25558521ac97b38c782c6189a Memory:6000 CPUs:2 DiskSize:20000 VMDriver: Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.16.0 ClusterName:download-only-953000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local Container

Runtime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP:}

	I0127 19:30:12.080232    4444 iso.go:125] acquiring lock: {Name:mkeeb6f52f7fa0577f04180383dbb7ed67f33d88 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0127 19:30:12.101926    4444 out.go:97] Downloading VM boot image ...

	I0127 19:30:12.102104    4444 download.go:101] Downloading: https://storage.googleapis.com/minikube-builds/iso/15565/minikube-v1.29.0-1674856271-15565-amd64.iso?checksum=file:https://storage.googleapis.com/minikube-builds/iso/15565/minikube-v1.29.0-1674856271-15565-amd64.iso.sha256 -> /Users/jenkins/minikube-integration/15565-3235/.minikube/cache/iso/amd64/minikube-v1.29.0-1674856271-15565-amd64.iso

	I0127 19:30:16.289106    4444 out.go:97] Starting control plane node download-only-953000 in cluster download-only-953000

	I0127 19:30:16.289190    4444 preload.go:132] Checking if preload exists for k8s version v1.16.0 and runtime docker

	I0127 19:30:16.343374    4444 preload.go:119] Found remote preload: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.16.0/preloaded-images-k8s-v18-v1.16.0-docker-overlay2-amd64.tar.lz4

	I0127 19:30:16.343406    4444 cache.go:57] Caching tarball of preloaded images

	I0127 19:30:16.343740    4444 preload.go:132] Checking if preload exists for k8s version v1.16.0 and runtime docker

	I0127 19:30:16.365182    4444 out.go:97] Downloading Kubernetes v1.16.0 preload ...

	I0127 19:30:16.365234    4444 preload.go:238] getting checksum for preloaded-images-k8s-v18-v1.16.0-docker-overlay2-amd64.tar.lz4 ...

	I0127 19:30:16.498838    4444 download.go:101] Downloading: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.16.0/preloaded-images-k8s-v18-v1.16.0-docker-overlay2-amd64.tar.lz4?checksum=md5:326f3ce331abb64565b50b8c9e791244 -> /Users/jenkins/minikube-integration/15565-3235/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.16.0-docker-overlay2-amd64.tar.lz4

	I0127 19:30:20.390568    4444 preload.go:249] saving checksum for preloaded-images-k8s-v18-v1.16.0-docker-overlay2-amd64.tar.lz4 ...

	I0127 19:30:20.390710    4444 preload.go:256] verifying checksum of /Users/jenkins/minikube-integration/15565-3235/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.16.0-docker-overlay2-amd64.tar.lz4 ...

	I0127 19:30:20.938678    4444 cache.go:60] Finished verifying existence of preloaded tar for  v1.16.0 on docker

	I0127 19:30:20.938904    4444 profile.go:148] Saving config to /Users/jenkins/minikube-integration/15565-3235/.minikube/profiles/download-only-953000/config.json ...

	I0127 19:30:20.938931    4444 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/15565-3235/.minikube/profiles/download-only-953000/config.json: {Name:mk6b80d5d1d2b4fbce7edac200358fc204378423 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0127 19:30:20.939200    4444 preload.go:132] Checking if preload exists for k8s version v1.16.0 and runtime docker

	I0127 19:30:20.939487    4444 download.go:101] Downloading: https://storage.googleapis.com/kubernetes-release/release/v1.16.0/bin/darwin/amd64/kubectl?checksum=file:https://storage.googleapis.com/kubernetes-release/release/v1.16.0/bin/darwin/amd64/kubectl.sha1 -> /Users/jenkins/minikube-integration/15565-3235/.minikube/cache/darwin/amd64/v1.16.0/kubectl

	* 

	* The control plane node "" does not exist.

	  To start a cluster, run: "minikube start -p download-only-953000"

-- /stdout --

aaa_download_only_test.go:174: minikube logs failed with error: exit status 85

--- PASS: TestDownloadOnly/v1.16.0/LogsDuration (0.33s)

=== RUN   TestDownloadOnly/v1.26.1/json-events

aaa_download_only_test.go:71: (dbg) Run:  out/minikube-darwin-amd64 start -o=json --download-only -p download-only-953000 --force --alsologtostderr --kubernetes-version=v1.26.1 --container-runtime=docker --driver=hyperkit 

aaa_download_only_test.go:71: (dbg) Done: out/minikube-darwin-amd64 start -o=json --download-only -p download-only-953000 --force --alsologtostderr --kubernetes-version=v1.26.1 --container-runtime=docker --driver=hyperkit : (6.613862903s)

--- PASS: TestDownloadOnly/v1.26.1/json-events (6.61s)

=== RUN   TestDownloadOnly/v1.26.1/preload-exists

--- PASS: TestDownloadOnly/v1.26.1/preload-exists (0.00s)

=== RUN   TestDownloadOnly/v1.26.1/kubectl

--- PASS: TestDownloadOnly/v1.26.1/kubectl (0.00s)

=== RUN   TestDownloadOnly/v1.26.1/LogsDuration

aaa_download_only_test.go:173: (dbg) Run:  out/minikube-darwin-amd64 logs -p download-only-953000

aaa_download_only_test.go:173: (dbg) Non-zero exit: out/minikube-darwin-amd64 logs -p download-only-953000: exit status 85 (294.264253ms)

-- stdout --

	* 

	* ==> Audit <==

	* |---------|--------------------------------|----------------------|---------|---------|---------------------|----------|

	| Command |              Args              |       Profile        |  User   | Version |     Start Time      | End Time |

	|---------|--------------------------------|----------------------|---------|---------|---------------------|----------|

	| start   | -o=json --download-only        | download-only-953000 | jenkins | v1.28.0 | 27 Jan 23 19:30 PST |          |

	|         | -p download-only-953000        |                      |         |         |                     |          |

	|         | --force --alsologtostderr      |                      |         |         |                     |          |

	|         | --kubernetes-version=v1.16.0   |                      |         |         |                     |          |

	|         | --container-runtime=docker     |                      |         |         |                     |          |

	|         | --driver=hyperkit              |                      |         |         |                     |          |

	| start   | -o=json --download-only        | download-only-953000 | jenkins | v1.28.0 | 27 Jan 23 19:30 PST |          |

	|         | -p download-only-953000        |                      |         |         |                     |          |

	|         | --force --alsologtostderr      |                      |         |         |                     |          |

	|         | --kubernetes-version=v1.26.1   |                      |         |         |                     |          |

	|         | --container-runtime=docker     |                      |         |         |                     |          |

	|         | --driver=hyperkit              |                      |         |         |                     |          |

	|---------|--------------------------------|----------------------|---------|---------|---------------------|----------|

	* 

	* ==> Last Start <==

	* Log file created at: 2023/01/27 19:30:22

	Running on machine: MacOS-Agent-4

	Binary: Built with gc go1.19.5 for darwin/amd64

	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg

	I0127 19:30:22.174912    4468 out.go:296] Setting OutFile to fd 1 ...

	I0127 19:30:22.175073    4468 out.go:343] TERM=,COLORTERM=, which probably does not support color

	I0127 19:30:22.175079    4468 out.go:309] Setting ErrFile to fd 2...

	I0127 19:30:22.175083    4468 out.go:343] TERM=,COLORTERM=, which probably does not support color

	I0127 19:30:22.175197    4468 root.go:334] Updating PATH: /Users/jenkins/minikube-integration/15565-3235/.minikube/bin

	W0127 19:30:22.175291    4468 root.go:311] Error reading config file at /Users/jenkins/minikube-integration/15565-3235/.minikube/config/config.json: open /Users/jenkins/minikube-integration/15565-3235/.minikube/config/config.json: no such file or directory

	I0127 19:30:22.175626    4468 out.go:303] Setting JSON to true

	I0127 19:30:22.194982    4468 start.go:125] hostinfo: {"hostname":"MacOS-Agent-4.local","uptime":1797,"bootTime":1674874825,"procs":404,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"13.2","kernelVersion":"22.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"f2f27e25-cfda-5ffd-9706-e98286194e62"}

	W0127 19:30:22.195061    4468 start.go:133] gopshost.Virtualization returned error: not implemented yet

	I0127 19:30:22.217024    4468 out.go:97] [download-only-953000] minikube v1.28.0 on Darwin 13.2

	I0127 19:30:22.217116    4468 notify.go:220] Checking for updates...

	I0127 19:30:22.237982    4468 out.go:169] MINIKUBE_LOCATION=15565

	I0127 19:30:22.258914    4468 out.go:169] KUBECONFIG=/Users/jenkins/minikube-integration/15565-3235/kubeconfig

	I0127 19:30:22.279722    4468 out.go:169] MINIKUBE_BIN=out/minikube-darwin-amd64

	I0127 19:30:22.303265    4468 out.go:169] MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I0127 19:30:22.325267    4468 out.go:169] MINIKUBE_HOME=/Users/jenkins/minikube-integration/15565-3235/.minikube

	W0127 19:30:22.367965    4468 out.go:272] minikube skips various validations when --force is supplied; this may lead to unexpected behavior

	I0127 19:30:22.368662    4468 config.go:180] Loaded profile config "download-only-953000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.16.0

	W0127 19:30:22.368758    4468 start.go:748] api.Load failed for download-only-953000: filestore "download-only-953000": Docker machine "download-only-953000" does not exist. Use "docker-machine ls" to list machines. Use "docker-machine create" to add a new one.

	I0127 19:30:22.368840    4468 driver.go:365] Setting default libvirt URI to qemu:///system

	W0127 19:30:22.368880    4468 start.go:748] api.Load failed for download-only-953000: filestore "download-only-953000": Docker machine "download-only-953000" does not exist. Use "docker-machine ls" to list machines. Use "docker-machine create" to add a new one.

	I0127 19:30:22.396856    4468 out.go:97] Using the hyperkit driver based on existing profile

	I0127 19:30:22.396905    4468 start.go:296] selected driver: hyperkit

	I0127 19:30:22.396916    4468 start.go:840] validating driver "hyperkit" against &{Name:download-only-953000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/15565/minikube-v1.29.0-1674856271-15565-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.36-1674164627-15541@sha256:0a2280301e955e0d3910d6e639e0b7341db1f4a25558521ac97b38c782c6189a Memory:6000 CPUs:2 DiskSize:20000 VMDriver: Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 Kuber

netesConfig:{KubernetesVersion:v1.16.0 ClusterName:download-only-953000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirro

r: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP:}

	I0127 19:30:22.397185    4468 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0127 19:30:22.397371    4468 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/15565-3235/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin

	I0127 19:30:22.404886    4468 install.go:137] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit version is 1.28.0

	I0127 19:30:22.408184    4468 install.go:79] stdout: /Users/jenkins/workspace/out/docker-machine-driver-hyperkit

	I0127 19:30:22.408221    4468 install.go:81] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit looks good

	I0127 19:30:22.410433    4468 cni.go:84] Creating CNI manager for ""

	I0127 19:30:22.410455    4468 cni.go:157] "hyperkit" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge

	I0127 19:30:22.410470    4468 start_flags.go:319] config:

	{Name:download-only-953000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/15565/minikube-v1.29.0-1674856271-15565-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.36-1674164627-15541@sha256:0a2280301e955e0d3910d6e639e0b7341db1f4a25558521ac97b38c782c6189a Memory:6000 CPUs:2 DiskSize:20000 VMDriver: Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.26.1 ClusterName:download-only-953000 Namespace:

default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketV

MnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP:}

	I0127 19:30:22.410609    4468 iso.go:125] acquiring lock: {Name:mkeeb6f52f7fa0577f04180383dbb7ed67f33d88 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0127 19:30:22.431746    4468 out.go:97] Starting control plane node download-only-953000 in cluster download-only-953000

	I0127 19:30:22.431772    4468 preload.go:132] Checking if preload exists for k8s version v1.26.1 and runtime docker

	I0127 19:30:22.492044    4468 preload.go:119] Found remote preload: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.26.1/preloaded-images-k8s-v18-v1.26.1-docker-overlay2-amd64.tar.lz4

	I0127 19:30:22.492062    4468 cache.go:57] Caching tarball of preloaded images

	I0127 19:30:22.492242    4468 preload.go:132] Checking if preload exists for k8s version v1.26.1 and runtime docker

	I0127 19:30:22.514060    4468 out.go:97] Downloading Kubernetes v1.26.1 preload ...

	I0127 19:30:22.514086    4468 preload.go:238] getting checksum for preloaded-images-k8s-v18-v1.26.1-docker-overlay2-amd64.tar.lz4 ...

	I0127 19:30:22.590677    4468 download.go:101] Downloading: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.26.1/preloaded-images-k8s-v18-v1.26.1-docker-overlay2-amd64.tar.lz4?checksum=md5:c6cc8ea1da4e19500d6fe35540785ea8 -> /Users/jenkins/minikube-integration/15565-3235/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.26.1-docker-overlay2-amd64.tar.lz4

	I0127 19:30:27.017792    4468 preload.go:249] saving checksum for preloaded-images-k8s-v18-v1.26.1-docker-overlay2-amd64.tar.lz4 ...

	I0127 19:30:27.017976    4468 preload.go:256] verifying checksum of /Users/jenkins/minikube-integration/15565-3235/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.26.1-docker-overlay2-amd64.tar.lz4 ...

	* 

	* The control plane node "" does not exist.

	  To start a cluster, run: "minikube start -p download-only-953000"

-- /stdout --

aaa_download_only_test.go:174: minikube logs failed with error: exit status 85

--- PASS: TestDownloadOnly/v1.26.1/LogsDuration (0.29s)

=== RUN   TestDownloadOnly/DeleteAll

aaa_download_only_test.go:191: (dbg) Run:  out/minikube-darwin-amd64 delete --all

--- PASS: TestDownloadOnly/DeleteAll (0.42s)

=== RUN   TestDownloadOnly/DeleteAlwaysSucceeds

aaa_download_only_test.go:203: (dbg) Run:  out/minikube-darwin-amd64 delete -p download-only-953000

--- PASS: TestDownloadOnly/DeleteAlwaysSucceeds (0.39s)

=== RUN   TestBinaryMirror

aaa_download_only_test.go:310: (dbg) Run:  out/minikube-darwin-amd64 start --download-only -p binary-mirror-033000 --alsologtostderr --binary-mirror http://127.0.0.1:49399 --driver=hyperkit 

helpers_test.go:175: Cleaning up "binary-mirror-033000" profile ...

helpers_test.go:178: (dbg) Run:  out/minikube-darwin-amd64 delete -p binary-mirror-033000

--- PASS: TestBinaryMirror (1.01s)

=== RUN   TestOffline

=== PAUSE TestOffline

=== CONT  TestOffline

=== CONT  TestOffline

aab_offline_test.go:55: (dbg) Run:  out/minikube-darwin-amd64 start -p offline-docker-310000 --alsologtostderr -v=1 --memory=2048 --wait=true --driver=hyperkit 

=== CONT  TestOffline

aab_offline_test.go:55: (dbg) Done: out/minikube-darwin-amd64 start -p offline-docker-310000 --alsologtostderr -v=1 --memory=2048 --wait=true --driver=hyperkit : (54.710958896s)

helpers_test.go:175: Cleaning up "offline-docker-310000" profile ...

helpers_test.go:178: (dbg) Run:  out/minikube-darwin-amd64 delete -p offline-docker-310000

helpers_test.go:178: (dbg) Done: out/minikube-darwin-amd64 delete -p offline-docker-310000: (5.269434913s)

--- PASS: TestOffline (59.98s)

=== RUN   TestAddons/Setup

addons_test.go:88: (dbg) Run:  out/minikube-darwin-amd64 start -p addons-113000 --wait=true --memory=4000 --alsologtostderr --addons=registry --addons=metrics-server --addons=volumesnapshots --addons=csi-hostpath-driver --addons=gcp-auth --addons=cloud-spanner --driver=hyperkit  --addons=ingress --addons=ingress-dns --addons=helm-tiller

addons_test.go:88: (dbg) Done: out/minikube-darwin-amd64 start -p addons-113000 --wait=true --memory=4000 --alsologtostderr --addons=registry --addons=metrics-server --addons=volumesnapshots --addons=csi-hostpath-driver --addons=gcp-auth --addons=cloud-spanner --driver=hyperkit  --addons=ingress --addons=ingress-dns --addons=helm-tiller: (2m15.829705019s)

--- PASS: TestAddons/Setup (135.83s)

=== RUN   TestAddons/parallel/Registry

=== PAUSE TestAddons/parallel/Registry

=== CONT  TestAddons/parallel/Registry

=== CONT  TestAddons/parallel/Registry

addons_test.go:295: registry stabilized in 10.940882ms

=== CONT  TestAddons/parallel/Registry

addons_test.go:297: (dbg) TestAddons/parallel/Registry: waiting 6m0s for pods matching "actual-registry=true" in namespace "kube-system" ...

=== CONT  TestAddons/parallel/Registry

helpers_test.go:344: "registry-77s6g" [5a2cc6b5-5b8c-40f8-baef-fba00baf14d3] Running

=== CONT  TestAddons/parallel/Registry

addons_test.go:297: (dbg) TestAddons/parallel/Registry: actual-registry=true healthy within 5.006555178s

addons_test.go:300: (dbg) TestAddons/parallel/Registry: waiting 10m0s for pods matching "registry-proxy=true" in namespace "kube-system" ...

helpers_test.go:344: "registry-proxy-k9j4z" [fac77c28-318f-40f3-92a5-30ab7c21a0b4] Running

=== CONT  TestAddons/parallel/Registry

addons_test.go:300: (dbg) TestAddons/parallel/Registry: registry-proxy=true healthy within 5.015864978s

addons_test.go:305: (dbg) Run:  kubectl --context addons-113000 delete po -l run=registry-test --now

addons_test.go:310: (dbg) Run:  kubectl --context addons-113000 run --rm registry-test --restart=Never --image=gcr.io/k8s-minikube/busybox -it -- sh -c "wget --spider -S http://registry.kube-system.svc.cluster.local"

=== CONT  TestAddons/parallel/Registry

addons_test.go:310: (dbg) Done: kubectl --context addons-113000 run --rm registry-test --restart=Never --image=gcr.io/k8s-minikube/busybox -it -- sh -c "wget --spider -S http://registry.kube-system.svc.cluster.local": (4.866706925s)

addons_test.go:324: (dbg) Run:  out/minikube-darwin-amd64 -p addons-113000 ip

2023/01/27 19:33:02 [DEBUG] GET http://192.168.64.2:5000

addons_test.go:353: (dbg) Run:  out/minikube-darwin-amd64 -p addons-113000 addons disable registry --alsologtostderr -v=1

--- PASS: TestAddons/parallel/Registry (15.48s)

=== RUN   TestAddons/parallel/Ingress

=== PAUSE TestAddons/parallel/Ingress

=== CONT  TestAddons/parallel/Ingress

addons_test.go:177: (dbg) Run:  kubectl --context addons-113000 wait --for=condition=ready --namespace=ingress-nginx pod --selector=app.kubernetes.io/component=controller --timeout=90s

addons_test.go:197: (dbg) Run:  kubectl --context addons-113000 replace --force -f testdata/nginx-ingress-v1.yaml

addons_test.go:210: (dbg) Run:  kubectl --context addons-113000 replace --force -f testdata/nginx-pod-svc.yaml

addons_test.go:215: (dbg) TestAddons/parallel/Ingress: waiting 8m0s for pods matching "run=nginx" in namespace "default" ...

helpers_test.go:344: "nginx" [4237c40c-ca0d-422d-9697-0104b3b48657] Pending / Ready:ContainersNotReady (containers with unready status: [nginx]) / ContainersReady:ContainersNotReady (containers with unready status: [nginx])

=== CONT  TestAddons/parallel/Ingress

helpers_test.go:344: "nginx" [4237c40c-ca0d-422d-9697-0104b3b48657] Running

=== CONT  TestAddons/parallel/Ingress

addons_test.go:215: (dbg) TestAddons/parallel/Ingress: run=nginx healthy within 11.010575953s

addons_test.go:227: (dbg) Run:  out/minikube-darwin-amd64 -p addons-113000 ssh "curl -s http://127.0.0.1/ -H 'Host: nginx.example.com'"

addons_test.go:251: (dbg) Run:  kubectl --context addons-113000 replace --force -f testdata/ingress-dns-example-v1.yaml

addons_test.go:256: (dbg) Run:  out/minikube-darwin-amd64 -p addons-113000 ip

addons_test.go:262: (dbg) Run:  nslookup hello-john.test 192.168.64.2

addons_test.go:271: (dbg) Run:  out/minikube-darwin-amd64 -p addons-113000 addons disable ingress-dns --alsologtostderr -v=1

addons_test.go:271: (dbg) Done: out/minikube-darwin-amd64 -p addons-113000 addons disable ingress-dns --alsologtostderr -v=1: (1.055331982s)

addons_test.go:276: (dbg) Run:  out/minikube-darwin-amd64 -p addons-113000 addons disable ingress --alsologtostderr -v=1

=== CONT  TestAddons/parallel/Ingress

addons_test.go:276: (dbg) Done: out/minikube-darwin-amd64 -p addons-113000 addons disable ingress --alsologtostderr -v=1: (7.44683411s)

--- PASS: TestAddons/parallel/Ingress (20.47s)

=== RUN   TestAddons/parallel/MetricsServer

=== PAUSE TestAddons/parallel/MetricsServer

=== CONT  TestAddons/parallel/MetricsServer

addons_test.go:372: metrics-server stabilized in 1.838819ms

addons_test.go:374: (dbg) TestAddons/parallel/MetricsServer: waiting 6m0s for pods matching "k8s-app=metrics-server" in namespace "kube-system" ...

helpers_test.go:344: "metrics-server-5f8fcc9bb7-4fcwv" [48a67406-b978-4975-afad-d19c8d6fe0c3] Running

=== CONT  TestAddons/parallel/MetricsServer

addons_test.go:374: (dbg) TestAddons/parallel/MetricsServer: k8s-app=metrics-server healthy within 5.007130692s

addons_test.go:380: (dbg) Run:  kubectl --context addons-113000 top pods -n kube-system

addons_test.go:397: (dbg) Run:  out/minikube-darwin-amd64 -p addons-113000 addons disable metrics-server --alsologtostderr -v=1

--- PASS: TestAddons/parallel/MetricsServer (5.54s)

=== RUN   TestAddons/parallel/HelmTiller

=== PAUSE TestAddons/parallel/HelmTiller

=== CONT  TestAddons/parallel/HelmTiller

addons_test.go:421: tiller-deploy stabilized in 1.496353ms

addons_test.go:423: (dbg) TestAddons/parallel/HelmTiller: waiting 6m0s for pods matching "app=helm" in namespace "kube-system" ...

helpers_test.go:344: "tiller-deploy-54cb789455-s9mh7" [6954db3d-f227-43d8-9ffb-cfc5f0723550] Running

=== CONT  TestAddons/parallel/HelmTiller

addons_test.go:423: (dbg) TestAddons/parallel/HelmTiller: app=helm healthy within 5.007081541s

addons_test.go:438: (dbg) Run:  kubectl --context addons-113000 run --rm helm-test --restart=Never --image=alpine/helm:2.16.3 -it --namespace=kube-system -- version

=== CONT  TestAddons/parallel/HelmTiller

addons_test.go:438: (dbg) Done: kubectl --context addons-113000 run --rm helm-test --restart=Never --image=alpine/helm:2.16.3 -it --namespace=kube-system -- version: (5.136653221s)

addons_test.go:455: (dbg) Run:  out/minikube-darwin-amd64 -p addons-113000 addons disable helm-tiller --alsologtostderr -v=1

--- PASS: TestAddons/parallel/HelmTiller (10.53s)

=== RUN   TestAddons/parallel/CSI

=== PAUSE TestAddons/parallel/CSI

=== CONT  TestAddons/parallel/CSI

addons_test.go:526: csi-hostpath-driver pods stabilized in 5.729321ms

addons_test.go:529: (dbg) Run:  kubectl --context addons-113000 create -f testdata/csi-hostpath-driver/pvc.yaml

addons_test.go:534: (dbg) TestAddons/parallel/CSI: waiting 6m0s for pvc "hpvc" in namespace "default" ...

helpers_test.go:394: (dbg) Run:  kubectl --context addons-113000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-113000 get pvc hpvc -o jsonpath={.status.phase} -n default

addons_test.go:539: (dbg) Run:  kubectl --context addons-113000 create -f testdata/csi-hostpath-driver/pv-pod.yaml

=== CONT  TestAddons/parallel/CSI

addons_test.go:544: (dbg) TestAddons/parallel/CSI: waiting 6m0s for pods matching "app=task-pv-pod" in namespace "default" ...

helpers_test.go:344: "task-pv-pod" [54bc582f-b937-4caf-8ae2-e0e379bde4b5] Pending

helpers_test.go:344: "task-pv-pod" [54bc582f-b937-4caf-8ae2-e0e379bde4b5] Pending / Ready:ContainersNotReady (containers with unready status: [task-pv-container]) / ContainersReady:ContainersNotReady (containers with unready status: [task-pv-container])

=== CONT  TestAddons/parallel/CSI

helpers_test.go:344: "task-pv-pod" [54bc582f-b937-4caf-8ae2-e0e379bde4b5] Running

=== CONT  TestAddons/parallel/CSI

addons_test.go:544: (dbg) TestAddons/parallel/CSI: app=task-pv-pod healthy within 15.012724815s

addons_test.go:549: (dbg) Run:  kubectl --context addons-113000 create -f testdata/csi-hostpath-driver/snapshot.yaml

addons_test.go:554: (dbg) TestAddons/parallel/CSI: waiting 6m0s for volume snapshot "new-snapshot-demo" in namespace "default" ...

helpers_test.go:419: (dbg) Run:  kubectl --context addons-113000 get volumesnapshot new-snapshot-demo -o jsonpath={.status.readyToUse} -n default

=== CONT  TestAddons/parallel/CSI

helpers_test.go:419: (dbg) Run:  kubectl --context addons-113000 get volumesnapshot new-snapshot-demo -o jsonpath={.status.readyToUse} -n default

addons_test.go:559: (dbg) Run:  kubectl --context addons-113000 delete pod task-pv-pod

addons_test.go:559: (dbg) Done: kubectl --context addons-113000 delete pod task-pv-pod: (1.041135505s)

addons_test.go:565: (dbg) Run:  kubectl --context addons-113000 delete pvc hpvc

addons_test.go:571: (dbg) Run:  kubectl --context addons-113000 create -f testdata/csi-hostpath-driver/pvc-restore.yaml

addons_test.go:576: (dbg) TestAddons/parallel/CSI: waiting 6m0s for pvc "hpvc-restore" in namespace "default" ...

helpers_test.go:394: (dbg) Run:  kubectl --context addons-113000 get pvc hpvc-restore -o jsonpath={.status.phase} -n default

addons_test.go:581: (dbg) Run:  kubectl --context addons-113000 create -f testdata/csi-hostpath-driver/pv-pod-restore.yaml

addons_test.go:586: (dbg) TestAddons/parallel/CSI: waiting 6m0s for pods matching "app=task-pv-pod-restore" in namespace "default" ...

helpers_test.go:344: "task-pv-pod-restore" [55c1b655-000c-42fd-8087-f0c24071b33d] Pending

helpers_test.go:344: "task-pv-pod-restore" [55c1b655-000c-42fd-8087-f0c24071b33d] Pending / Ready:ContainersNotReady (containers with unready status: [task-pv-container]) / ContainersReady:ContainersNotReady (containers with unready status: [task-pv-container])

=== CONT  TestAddons/parallel/CSI

helpers_test.go:344: "task-pv-pod-restore" [55c1b655-000c-42fd-8087-f0c24071b33d] Running

=== CONT  TestAddons/parallel/CSI

addons_test.go:586: (dbg) TestAddons/parallel/CSI: app=task-pv-pod-restore healthy within 13.017264156s

addons_test.go:591: (dbg) Run:  kubectl --context addons-113000 delete pod task-pv-pod-restore

addons_test.go:595: (dbg) Run:  kubectl --context addons-113000 delete pvc hpvc-restore

addons_test.go:599: (dbg) Run:  kubectl --context addons-113000 delete volumesnapshot new-snapshot-demo

addons_test.go:603: (dbg) Run:  out/minikube-darwin-amd64 -p addons-113000 addons disable csi-hostpath-driver --alsologtostderr -v=1

=== CONT  TestAddons/parallel/CSI

addons_test.go:603: (dbg) Done: out/minikube-darwin-amd64 -p addons-113000 addons disable csi-hostpath-driver --alsologtostderr -v=1: (6.600655758s)

addons_test.go:607: (dbg) Run:  out/minikube-darwin-amd64 -p addons-113000 addons disable volumesnapshots --alsologtostderr -v=1

--- PASS: TestAddons/parallel/CSI (40.76s)

=== RUN   TestAddons/parallel/Headlamp

=== PAUSE TestAddons/parallel/Headlamp

=== CONT  TestAddons/parallel/Headlamp

addons_test.go:789: (dbg) Run:  out/minikube-darwin-amd64 addons enable headlamp -p addons-113000 --alsologtostderr -v=1

addons_test.go:789: (dbg) Done: out/minikube-darwin-amd64 addons enable headlamp -p addons-113000 --alsologtostderr -v=1: (1.451039685s)

addons_test.go:794: (dbg) TestAddons/parallel/Headlamp: waiting 8m0s for pods matching "app.kubernetes.io/name=headlamp" in namespace "headlamp" ...

helpers_test.go:344: "headlamp-5759877c79-25kw9" [59091456-5f50-4387-9935-f7c14e3dde93] Pending

helpers_test.go:344: "headlamp-5759877c79-25kw9" [59091456-5f50-4387-9935-f7c14e3dde93] Pending / Ready:ContainersNotReady (containers with unready status: [headlamp]) / ContainersReady:ContainersNotReady (containers with unready status: [headlamp])

=== CONT  TestAddons/parallel/Headlamp

helpers_test.go:344: "headlamp-5759877c79-25kw9" [59091456-5f50-4387-9935-f7c14e3dde93] Running

=== CONT  TestAddons/parallel/Headlamp

addons_test.go:794: (dbg) TestAddons/parallel/Headlamp: app.kubernetes.io/name=headlamp healthy within 10.009350871s

--- PASS: TestAddons/parallel/Headlamp (11.46s)

=== RUN   TestAddons/parallel/CloudSpanner

=== PAUSE TestAddons/parallel/CloudSpanner

=== CONT  TestAddons/parallel/CloudSpanner

=== CONT  TestAddons/parallel/CloudSpanner

addons_test.go:810: (dbg) TestAddons/parallel/CloudSpanner: waiting 6m0s for pods matching "app=cloud-spanner-emulator" in namespace "default" ...

=== CONT  TestAddons/parallel/CloudSpanner

helpers_test.go:344: "cloud-spanner-emulator-5dcf58dbbb-9qq9q" [28eeb53e-800f-474b-b3d5-c03402143405] Running

=== CONT  TestAddons/parallel/CloudSpanner

addons_test.go:810: (dbg) TestAddons/parallel/CloudSpanner: app=cloud-spanner-emulator healthy within 5.005386375s

addons_test.go:813: (dbg) Run:  out/minikube-darwin-amd64 addons disable cloud-spanner -p addons-113000

--- PASS: TestAddons/parallel/CloudSpanner (5.32s)

=== RUN   TestAddons/serial/GCPAuth/Namespaces

addons_test.go:615: (dbg) Run:  kubectl --context addons-113000 create ns new-namespace

addons_test.go:629: (dbg) Run:  kubectl --context addons-113000 get secret gcp-auth -n new-namespace

--- PASS: TestAddons/serial/GCPAuth/Namespaces (0.09s)

=== RUN   TestAddons/StoppedEnableDisable

addons_test.go:147: (dbg) Run:  out/minikube-darwin-amd64 stop -p addons-113000

addons_test.go:147: (dbg) Done: out/minikube-darwin-amd64 stop -p addons-113000: (8.218739431s)

addons_test.go:151: (dbg) Run:  out/minikube-darwin-amd64 addons enable dashboard -p addons-113000

addons_test.go:155: (dbg) Run:  out/minikube-darwin-amd64 addons disable dashboard -p addons-113000

--- PASS: TestAddons/StoppedEnableDisable (8.59s)

=== RUN   TestCertOptions

=== PAUSE TestCertOptions

=== CONT  TestCertOptions

cert_options_test.go:49: (dbg) Run:  out/minikube-darwin-amd64 start -p cert-options-460000 --memory=2048 --apiserver-ips=127.0.0.1 --apiserver-ips=192.168.15.15 --apiserver-names=localhost --apiserver-names=www.google.com --apiserver-port=8555 --driver=hyperkit 

=== CONT  TestCertOptions

cert_options_test.go:49: (dbg) Done: out/minikube-darwin-amd64 start -p cert-options-460000 --memory=2048 --apiserver-ips=127.0.0.1 --apiserver-ips=192.168.15.15 --apiserver-names=localhost --apiserver-names=www.google.com --apiserver-port=8555 --driver=hyperkit : (37.639369569s)

cert_options_test.go:60: (dbg) Run:  out/minikube-darwin-amd64 -p cert-options-460000 ssh "openssl x509 -text -noout -in /var/lib/minikube/certs/apiserver.crt"

cert_options_test.go:88: (dbg) Run:  kubectl --context cert-options-460000 config view

cert_options_test.go:100: (dbg) Run:  out/minikube-darwin-amd64 ssh -p cert-options-460000 -- "sudo cat /etc/kubernetes/admin.conf"

helpers_test.go:175: Cleaning up "cert-options-460000" profile ...

helpers_test.go:178: (dbg) Run:  out/minikube-darwin-amd64 delete -p cert-options-460000

helpers_test.go:178: (dbg) Done: out/minikube-darwin-amd64 delete -p cert-options-460000: (3.448098948s)

--- PASS: TestCertOptions (41.45s)

=== RUN   TestDockerFlags

=== PAUSE TestDockerFlags

=== CONT  TestDockerFlags

docker_test.go:45: (dbg) Run:  out/minikube-darwin-amd64 start -p docker-flags-643000 --cache-images=false --memory=2048 --install-addons=false --wait=false --docker-env=FOO=BAR --docker-env=BAZ=BAT --docker-opt=debug --docker-opt=icc=true --alsologtostderr -v=5 --driver=hyperkit 

=== CONT  TestDockerFlags

docker_test.go:45: (dbg) Done: out/minikube-darwin-amd64 start -p docker-flags-643000 --cache-images=false --memory=2048 --install-addons=false --wait=false --docker-env=FOO=BAR --docker-env=BAZ=BAT --docker-opt=debug --docker-opt=icc=true --alsologtostderr -v=5 --driver=hyperkit : (44.758845193s)

docker_test.go:50: (dbg) Run:  out/minikube-darwin-amd64 -p docker-flags-643000 ssh "sudo systemctl show docker --property=Environment --no-pager"

docker_test.go:61: (dbg) Run:  out/minikube-darwin-amd64 -p docker-flags-643000 ssh "sudo systemctl show docker --property=ExecStart --no-pager"

helpers_test.go:175: Cleaning up "docker-flags-643000" profile ...

helpers_test.go:178: (dbg) Run:  out/minikube-darwin-amd64 delete -p docker-flags-643000

helpers_test.go:178: (dbg) Done: out/minikube-darwin-amd64 delete -p docker-flags-643000: (5.29208172s)

--- PASS: TestDockerFlags (50.37s)

=== RUN   TestForceSystemdFlag

=== PAUSE TestForceSystemdFlag

=== CONT  TestForceSystemdFlag

docker_test.go:85: (dbg) Run:  out/minikube-darwin-amd64 start -p force-systemd-flag-814000 --memory=2048 --force-systemd --alsologtostderr -v=5 --driver=hyperkit 

=== CONT  TestForceSystemdFlag

docker_test.go:85: (dbg) Done: out/minikube-darwin-amd64 start -p force-systemd-flag-814000 --memory=2048 --force-systemd --alsologtostderr -v=5 --driver=hyperkit : (38.846155854s)

docker_test.go:104: (dbg) Run:  out/minikube-darwin-amd64 -p force-systemd-flag-814000 ssh "docker info --format {{.CgroupDriver}}"

helpers_test.go:175: Cleaning up "force-systemd-flag-814000" profile ...

helpers_test.go:178: (dbg) Run:  out/minikube-darwin-amd64 delete -p force-systemd-flag-814000

E0127 20:02:08.596722    4442 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/15565-3235/.minikube/profiles/ingress-addon-legacy-294000/client.crt: no such file or directory

helpers_test.go:178: (dbg) Done: out/minikube-darwin-amd64 delete -p force-systemd-flag-814000: (5.342945195s)

--- PASS: TestForceSystemdFlag (44.36s)

=== RUN   TestForceSystemdEnv

=== PAUSE TestForceSystemdEnv

=== CONT  TestForceSystemdEnv

docker_test.go:149: (dbg) Run:  out/minikube-darwin-amd64 start -p force-systemd-env-631000 --memory=2048 --alsologtostderr -v=5 --driver=hyperkit 

=== CONT  TestForceSystemdEnv

docker_test.go:149: (dbg) Done: out/minikube-darwin-amd64 start -p force-systemd-env-631000 --memory=2048 --alsologtostderr -v=5 --driver=hyperkit : (39.864255902s)

docker_test.go:104: (dbg) Run:  out/minikube-darwin-amd64 -p force-systemd-env-631000 ssh "docker info --format {{.CgroupDriver}}"

helpers_test.go:175: Cleaning up "force-systemd-env-631000" profile ...

helpers_test.go:178: (dbg) Run:  out/minikube-darwin-amd64 delete -p force-systemd-env-631000

helpers_test.go:178: (dbg) Done: out/minikube-darwin-amd64 delete -p force-systemd-env-631000: (3.472070824s)

--- PASS: TestForceSystemdEnv (43.51s)

=== RUN   TestHyperKitDriverInstallOrUpdate

=== PAUSE TestHyperKitDriverInstallOrUpdate

=== CONT  TestHyperKitDriverInstallOrUpdate

--- PASS: TestHyperKitDriverInstallOrUpdate (10.98s)

=== RUN   TestErrorSpam/start

error_spam_test.go:216: Cleaning up 1 logfile(s) ...

error_spam_test.go:159: (dbg) Run:  out/minikube-darwin-amd64 -p nospam-259000 --log_dir /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-259000 start --dry-run

error_spam_test.go:159: (dbg) Run:  out/minikube-darwin-amd64 -p nospam-259000 --log_dir /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-259000 start --dry-run

error_spam_test.go:182: (dbg) Run:  out/minikube-darwin-amd64 -p nospam-259000 --log_dir /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-259000 start --dry-run

--- PASS: TestErrorSpam/start (1.56s)

=== RUN   TestErrorSpam/status

error_spam_test.go:216: Cleaning up 0 logfile(s) ...

error_spam_test.go:159: (dbg) Run:  out/minikube-darwin-amd64 -p nospam-259000 --log_dir /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-259000 status

error_spam_test.go:159: (dbg) Run:  out/minikube-darwin-amd64 -p nospam-259000 --log_dir /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-259000 status

error_spam_test.go:182: (dbg) Run:  out/minikube-darwin-amd64 -p nospam-259000 --log_dir /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-259000 status

--- PASS: TestErrorSpam/status (0.48s)

=== RUN   TestErrorSpam/pause

error_spam_test.go:216: Cleaning up 0 logfile(s) ...

error_spam_test.go:159: (dbg) Run:  out/minikube-darwin-amd64 -p nospam-259000 --log_dir /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-259000 pause

error_spam_test.go:159: (dbg) Run:  out/minikube-darwin-amd64 -p nospam-259000 --log_dir /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-259000 pause

error_spam_test.go:182: (dbg) Run:  out/minikube-darwin-amd64 -p nospam-259000 --log_dir /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-259000 pause

--- PASS: TestErrorSpam/pause (1.19s)

=== RUN   TestErrorSpam/unpause

error_spam_test.go:216: Cleaning up 0 logfile(s) ...

error_spam_test.go:159: (dbg) Run:  out/minikube-darwin-amd64 -p nospam-259000 --log_dir /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-259000 unpause

error_spam_test.go:159: (dbg) Run:  out/minikube-darwin-amd64 -p nospam-259000 --log_dir /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-259000 unpause

error_spam_test.go:182: (dbg) Run:  out/minikube-darwin-amd64 -p nospam-259000 --log_dir /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-259000 unpause

--- PASS: TestErrorSpam/unpause (1.32s)

=== RUN   TestErrorSpam/stop

error_spam_test.go:216: Cleaning up 0 logfile(s) ...

error_spam_test.go:159: (dbg) Run:  out/minikube-darwin-amd64 -p nospam-259000 --log_dir /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-259000 stop

error_spam_test.go:159: (dbg) Done: out/minikube-darwin-amd64 -p nospam-259000 --log_dir /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-259000 stop: (3.213890789s)

error_spam_test.go:159: (dbg) Run:  out/minikube-darwin-amd64 -p nospam-259000 --log_dir /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-259000 stop

error_spam_test.go:182: (dbg) Run:  out/minikube-darwin-amd64 -p nospam-259000 --log_dir /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-259000 stop

--- PASS: TestErrorSpam/stop (3.63s)

=== RUN   TestFunctional/serial/CopySyncFile

functional_test.go:1782: local sync path: /Users/jenkins/minikube-integration/15565-3235/.minikube/files/etc/test/nested/copy/4442/hosts

--- PASS: TestFunctional/serial/CopySyncFile (0.00s)

=== RUN   TestFunctional/serial/StartWithProxy

functional_test.go:2161: (dbg) Run:  out/minikube-darwin-amd64 start -p functional-093000 --memory=4000 --apiserver-port=8441 --wait=all --driver=hyperkit 

functional_test.go:2161: (dbg) Done: out/minikube-darwin-amd64 start -p functional-093000 --memory=4000 --apiserver-port=8441 --wait=all --driver=hyperkit : (58.292445943s)

--- PASS: TestFunctional/serial/StartWithProxy (58.29s)

=== RUN   TestFunctional/serial/AuditLog

--- PASS: TestFunctional/serial/AuditLog (0.00s)

=== RUN   TestFunctional/serial/SoftStart

functional_test.go:652: (dbg) Run:  out/minikube-darwin-amd64 start -p functional-093000 --alsologtostderr -v=8

functional_test.go:652: (dbg) Done: out/minikube-darwin-amd64 start -p functional-093000 --alsologtostderr -v=8: (1m10.628782263s)

functional_test.go:656: soft start took 1m10.629337458s for "functional-093000" cluster.

--- PASS: TestFunctional/serial/SoftStart (70.63s)

=== RUN   TestFunctional/serial/KubeContext

functional_test.go:674: (dbg) Run:  kubectl config current-context

--- PASS: TestFunctional/serial/KubeContext (0.03s)

=== RUN   TestFunctional/serial/KubectlGetPods

functional_test.go:689: (dbg) Run:  kubectl --context functional-093000 get po -A

--- PASS: TestFunctional/serial/KubectlGetPods (0.05s)

=== RUN   TestFunctional/serial/CacheCmd/cache/add_remote

functional_test.go:1042: (dbg) Run:  out/minikube-darwin-amd64 -p functional-093000 cache add k8s.gcr.io/pause:3.1

functional_test.go:1042: (dbg) Done: out/minikube-darwin-amd64 -p functional-093000 cache add k8s.gcr.io/pause:3.1: (2.234092764s)

functional_test.go:1042: (dbg) Run:  out/minikube-darwin-amd64 -p functional-093000 cache add k8s.gcr.io/pause:3.3

functional_test.go:1042: (dbg) Done: out/minikube-darwin-amd64 -p functional-093000 cache add k8s.gcr.io/pause:3.3: (2.289634384s)

functional_test.go:1042: (dbg) Run:  out/minikube-darwin-amd64 -p functional-093000 cache add k8s.gcr.io/pause:latest

functional_test.go:1042: (dbg) Done: out/minikube-darwin-amd64 -p functional-093000 cache add k8s.gcr.io/pause:latest: (2.140427535s)

--- PASS: TestFunctional/serial/CacheCmd/cache/add_remote (6.66s)

=== RUN   TestFunctional/serial/CacheCmd/cache/add_local

functional_test.go:1070: (dbg) Run:  docker build -t minikube-local-cache-test:functional-093000 /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/TestFunctionalserialCacheCmdcacheadd_local2587717124/001

functional_test.go:1082: (dbg) Run:  out/minikube-darwin-amd64 -p functional-093000 cache add minikube-local-cache-test:functional-093000

functional_test.go:1087: (dbg) Run:  out/minikube-darwin-amd64 -p functional-093000 cache delete minikube-local-cache-test:functional-093000

functional_test.go:1076: (dbg) Run:  docker rmi minikube-local-cache-test:functional-093000

--- PASS: TestFunctional/serial/CacheCmd/cache/add_local (1.50s)

=== RUN   TestFunctional/serial/CacheCmd/cache/delete_k8s.gcr.io/pause:3.3

functional_test.go:1095: (dbg) Run:  out/minikube-darwin-amd64 cache delete k8s.gcr.io/pause:3.3

--- PASS: TestFunctional/serial/CacheCmd/cache/delete_k8s.gcr.io/pause:3.3 (0.08s)

=== RUN   TestFunctional/serial/CacheCmd/cache/list

functional_test.go:1103: (dbg) Run:  out/minikube-darwin-amd64 cache list

--- PASS: TestFunctional/serial/CacheCmd/cache/list (0.08s)

=== RUN   TestFunctional/serial/CacheCmd/cache/verify_cache_inside_node

functional_test.go:1117: (dbg) Run:  out/minikube-darwin-amd64 -p functional-093000 ssh sudo crictl images

--- PASS: TestFunctional/serial/CacheCmd/cache/verify_cache_inside_node (0.16s)

=== RUN   TestFunctional/serial/CacheCmd/cache/cache_reload

functional_test.go:1140: (dbg) Run:  out/minikube-darwin-amd64 -p functional-093000 ssh sudo docker rmi k8s.gcr.io/pause:latest

functional_test.go:1146: (dbg) Run:  out/minikube-darwin-amd64 -p functional-093000 ssh sudo crictl inspecti k8s.gcr.io/pause:latest

functional_test.go:1146: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-093000 ssh sudo crictl inspecti k8s.gcr.io/pause:latest: exit status 1 (133.191591ms)

-- stdout --

	FATA[0000] no such image "k8s.gcr.io/pause:latest" present 

-- /stdout --

** stderr ** 

	ssh: Process exited with status 1

** /stderr **

functional_test.go:1151: (dbg) Run:  out/minikube-darwin-amd64 -p functional-093000 cache reload

functional_test.go:1151: (dbg) Done: out/minikube-darwin-amd64 -p functional-093000 cache reload: (1.251082919s)

functional_test.go:1156: (dbg) Run:  out/minikube-darwin-amd64 -p functional-093000 ssh sudo crictl inspecti k8s.gcr.io/pause:latest

--- PASS: TestFunctional/serial/CacheCmd/cache/cache_reload (1.70s)

=== RUN   TestFunctional/serial/CacheCmd/cache/delete

functional_test.go:1165: (dbg) Run:  out/minikube-darwin-amd64 cache delete k8s.gcr.io/pause:3.1

functional_test.go:1165: (dbg) Run:  out/minikube-darwin-amd64 cache delete k8s.gcr.io/pause:latest

--- PASS: TestFunctional/serial/CacheCmd/cache/delete (0.16s)

=== RUN   TestFunctional/serial/MinikubeKubectlCmd

functional_test.go:709: (dbg) Run:  out/minikube-darwin-amd64 -p functional-093000 kubectl -- --context functional-093000 get pods

--- PASS: TestFunctional/serial/MinikubeKubectlCmd (0.52s)

=== RUN   TestFunctional/serial/MinikubeKubectlCmdDirectly

functional_test.go:734: (dbg) Run:  out/kubectl --context functional-093000 get pods

--- PASS: TestFunctional/serial/MinikubeKubectlCmdDirectly (0.68s)

=== RUN   TestFunctional/serial/ExtraConfig

functional_test.go:750: (dbg) Run:  out/minikube-darwin-amd64 start -p functional-093000 --extra-config=apiserver.enable-admission-plugins=NamespaceAutoProvision --wait=all

E0127 19:37:47.057717    4442 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/15565-3235/.minikube/profiles/addons-113000/client.crt: no such file or directory

E0127 19:37:47.063498    4442 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/15565-3235/.minikube/profiles/addons-113000/client.crt: no such file or directory

E0127 19:37:47.073626    4442 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/15565-3235/.minikube/profiles/addons-113000/client.crt: no such file or directory

E0127 19:37:47.094167    4442 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/15565-3235/.minikube/profiles/addons-113000/client.crt: no such file or directory

E0127 19:37:47.135925    4442 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/15565-3235/.minikube/profiles/addons-113000/client.crt: no such file or directory

E0127 19:37:47.216731    4442 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/15565-3235/.minikube/profiles/addons-113000/client.crt: no such file or directory

E0127 19:37:47.378437    4442 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/15565-3235/.minikube/profiles/addons-113000/client.crt: no such file or directory

E0127 19:37:47.698839    4442 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/15565-3235/.minikube/profiles/addons-113000/client.crt: no such file or directory

E0127 19:37:48.339334    4442 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/15565-3235/.minikube/profiles/addons-113000/client.crt: no such file or directory

E0127 19:37:49.619521    4442 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/15565-3235/.minikube/profiles/addons-113000/client.crt: no such file or directory

E0127 19:37:52.180634    4442 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/15565-3235/.minikube/profiles/addons-113000/client.crt: no such file or directory

E0127 19:37:57.300723    4442 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/15565-3235/.minikube/profiles/addons-113000/client.crt: no such file or directory

functional_test.go:750: (dbg) Done: out/minikube-darwin-amd64 start -p functional-093000 --extra-config=apiserver.enable-admission-plugins=NamespaceAutoProvision --wait=all: (45.990424477s)

functional_test.go:754: restart took 45.990599851s for "functional-093000" cluster.

--- PASS: TestFunctional/serial/ExtraConfig (45.99s)

=== RUN   TestFunctional/serial/ComponentHealth

functional_test.go:803: (dbg) Run:  kubectl --context functional-093000 get po -l tier=control-plane -n kube-system -o=json

functional_test.go:818: etcd phase: Running

functional_test.go:828: etcd status: Ready

functional_test.go:818: kube-apiserver phase: Running

functional_test.go:828: kube-apiserver status: Ready

functional_test.go:818: kube-controller-manager phase: Running

functional_test.go:828: kube-controller-manager status: Ready

functional_test.go:818: kube-scheduler phase: Running

functional_test.go:828: kube-scheduler status: Ready

--- PASS: TestFunctional/serial/ComponentHealth (0.05s)