=== RUN   TestOffline

=== PAUSE TestOffline

=== CONT  TestOffline

aab_offline_test.go:55: (dbg) Run:  out/minikube-darwin-amd64 start -p offline-docker-595000 --alsologtostderr -v=1 --memory=2048 --wait=true --driver=docker 

aab_offline_test.go:55: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p offline-docker-595000 --alsologtostderr -v=1 --memory=2048 --wait=true --driver=docker : exit status 52 (12m30.451451085s)

-- stdout --

	* [offline-docker-595000] minikube v1.32.0 on Darwin 14.2.1

	  - MINIKUBE_LOCATION=17857

	  - KUBECONFIG=/Users/jenkins/minikube-integration/17857-1142/kubeconfig

	  - MINIKUBE_BIN=out/minikube-darwin-amd64

	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17857-1142/.minikube

	  - MINIKUBE_FORCE_SYSTEMD=

	* Using the docker driver based on user configuration

	* Using Docker Desktop driver with root privileges

	* Starting control plane node offline-docker-595000 in cluster offline-docker-595000

	* Pulling base image v0.0.42-1703498848-17857 ...

	* Creating docker container (CPUs=2, Memory=2048MB) ...

	* docker "offline-docker-595000" container is missing, will recreate.

	* Creating docker container (CPUs=2, Memory=2048MB) ...

-- /stdout --

** stderr ** 

	I1226 15:12:24.792893    8849 out.go:296] Setting OutFile to fd 1 ...

	I1226 15:12:24.793183    8849 out.go:343] TERM=,COLORTERM=, which probably does not support color

	I1226 15:12:24.793189    8849 out.go:309] Setting ErrFile to fd 2...

	I1226 15:12:24.793193    8849 out.go:343] TERM=,COLORTERM=, which probably does not support color

	I1226 15:12:24.793380    8849 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17857-1142/.minikube/bin

	I1226 15:12:24.795211    8849 out.go:303] Setting JSON to false

	I1226 15:12:24.820534    8849 start.go:128] hostinfo: {"hostname":"MacOS-Agent-3.local","uptime":6114,"bootTime":1703626230,"procs":466,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.2.1","kernelVersion":"23.2.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"bd1c05a8-24a6-5973-aa69-f3c7c66a87ce"}

	W1226 15:12:24.820651    8849 start.go:136] gopshost.Virtualization returned error: not implemented yet

	I1226 15:12:24.842392    8849 out.go:177] * [offline-docker-595000] minikube v1.32.0 on Darwin 14.2.1

	I1226 15:12:24.905297    8849 out.go:177]   - MINIKUBE_LOCATION=17857

	I1226 15:12:24.884350    8849 notify.go:220] Checking for updates...

	I1226 15:12:24.947322    8849 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/17857-1142/kubeconfig

	I1226 15:12:24.989271    8849 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64

	I1226 15:12:25.010345    8849 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I1226 15:12:25.031256    8849 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17857-1142/.minikube

	I1226 15:12:25.052285    8849 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=

	I1226 15:12:25.073584    8849 driver.go:392] Setting default libvirt URI to qemu:///system

	I1226 15:12:25.138254    8849 docker.go:122] docker version: linux-24.0.7:Docker Desktop 4.26.0 (130397)

	I1226 15:12:25.138455    8849 cli_runner.go:164] Run: docker system info --format "{{json .}}"

	I1226 15:12:25.295566    8849 info.go:266] docker info: {ID:c18f23ef-4e44-410e-b2ce-38db72a58e15 Containers:9 ContainersRunning:1 ContainersPaused:0 ContainersStopped:8 Images:2 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:78 OomKillDisable:false NGoroutines:148 SystemTime:2023-12-26 23:12:25.282252974 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:8 KernelVersion:6.5.11-linuxkit OperatingSystem:Docker Desktop OSType:linux Architecture:x86_64 IndexServ

erAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:12 MemTotal:6221275136 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy:http.docker.internal:3128 HTTPSProxy:http.docker.internal:3128 NoProxy:hubproxy.docker.internal Name:docker-desktop Labels:[] ExperimentalBuild:false ServerVersion:24.0.7 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:d8f198a4ed8892c764191ef7b3b06d8a2eeb5c7f Expected:d8f198a4ed8892c764191ef7b3b06d8a2eeb5c7f} RuncCommit:{ID:v1.1.10-0-g18a0cb0 Expected:v1.1.10-0-g18a0cb0} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=seccomp,profile=uncon

fined name=cgroupns] ProductLicense: Warnings:[WARNING: daemon is not using the default seccomp profile] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/Users/jenkins/.docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-buildx] ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.12.0-desktop.2] map[Name:compose Path:/Users/jenkins/.docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-compose] ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.23.3-desktop.2] map[Name:dev Path:/Users/jenkins/.docker/cli-plugins/docker-dev SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-dev] ShortDescription:Docker Dev Environments Vendor:Docker Inc. Version:v0.1.0] map[Name:extension Path:/Users/jenkins/.docker/cli-plugins/docker-extension SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-extension] ShortDescription:Man

ages Docker extensions Vendor:Docker Inc. Version:v0.2.21] map[Name:feedback Path:/Users/jenkins/.docker/cli-plugins/docker-feedback SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-feedback] ShortDescription:Provide feedback, right in your terminal! Vendor:Docker Inc. Version:0.1] map[Name:init Path:/Users/jenkins/.docker/cli-plugins/docker-init SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-init] ShortDescription:Creates Docker-related starter files for your project Vendor:Docker Inc. Version:v0.1.0-beta.10] map[Name:sbom Path:/Users/jenkins/.docker/cli-plugins/docker-sbom SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-sbom] ShortDescription:View the packaged-based Software Bill Of Materials (SBOM) for an image URL:https://github.com/docker/sbom-cli-plugin Vendor:Anchore Inc. Version:0.6.0] map[Name:scan Path:/Users/jenkins/.docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/

docker-scan] ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.26.0] map[Name:scout Path:/Users/jenkins/.docker/cli-plugins/docker-scout SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-scout] ShortDescription:Docker Scout Vendor:Docker Inc. Version:v1.2.0]] Warnings:<nil>}}

	I1226 15:12:25.318021    8849 out.go:177] * Using the docker driver based on user configuration

	I1226 15:12:25.339796    8849 start.go:298] selected driver: docker

	I1226 15:12:25.339813    8849 start.go:902] validating driver "docker" against <nil>

	I1226 15:12:25.339822    8849 start.go:913] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}

	I1226 15:12:25.342962    8849 cli_runner.go:164] Run: docker system info --format "{{json .}}"

	I1226 15:12:25.454454    8849 info.go:266] docker info: {ID:c18f23ef-4e44-410e-b2ce-38db72a58e15 Containers:9 ContainersRunning:1 ContainersPaused:0 ContainersStopped:8 Images:2 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:78 OomKillDisable:false NGoroutines:148 SystemTime:2023-12-26 23:12:25.442669719 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:8 KernelVersion:6.5.11-linuxkit OperatingSystem:Docker Desktop OSType:linux Architecture:x86_64 IndexServ

erAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:12 MemTotal:6221275136 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy:http.docker.internal:3128 HTTPSProxy:http.docker.internal:3128 NoProxy:hubproxy.docker.internal Name:docker-desktop Labels:[] ExperimentalBuild:false ServerVersion:24.0.7 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:d8f198a4ed8892c764191ef7b3b06d8a2eeb5c7f Expected:d8f198a4ed8892c764191ef7b3b06d8a2eeb5c7f} RuncCommit:{ID:v1.1.10-0-g18a0cb0 Expected:v1.1.10-0-g18a0cb0} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=seccomp,profile=uncon

fined name=cgroupns] ProductLicense: Warnings:[WARNING: daemon is not using the default seccomp profile] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/Users/jenkins/.docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-buildx] ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.12.0-desktop.2] map[Name:compose Path:/Users/jenkins/.docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-compose] ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.23.3-desktop.2] map[Name:dev Path:/Users/jenkins/.docker/cli-plugins/docker-dev SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-dev] ShortDescription:Docker Dev Environments Vendor:Docker Inc. Version:v0.1.0] map[Name:extension Path:/Users/jenkins/.docker/cli-plugins/docker-extension SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-extension] ShortDescription:Man

ages Docker extensions Vendor:Docker Inc. Version:v0.2.21] map[Name:feedback Path:/Users/jenkins/.docker/cli-plugins/docker-feedback SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-feedback] ShortDescription:Provide feedback, right in your terminal! Vendor:Docker Inc. Version:0.1] map[Name:init Path:/Users/jenkins/.docker/cli-plugins/docker-init SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-init] ShortDescription:Creates Docker-related starter files for your project Vendor:Docker Inc. Version:v0.1.0-beta.10] map[Name:sbom Path:/Users/jenkins/.docker/cli-plugins/docker-sbom SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-sbom] ShortDescription:View the packaged-based Software Bill Of Materials (SBOM) for an image URL:https://github.com/docker/sbom-cli-plugin Vendor:Anchore Inc. Version:0.6.0] map[Name:scan Path:/Users/jenkins/.docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/

docker-scan] ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.26.0] map[Name:scout Path:/Users/jenkins/.docker/cli-plugins/docker-scout SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-scout] ShortDescription:Docker Scout Vendor:Docker Inc. Version:v1.2.0]] Warnings:<nil>}}

	I1226 15:12:25.454666    8849 start_flags.go:309] no existing cluster config was found, will generate one from the flags 

	I1226 15:12:25.454879    8849 start_flags.go:931] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]

	I1226 15:12:25.475847    8849 out.go:177] * Using Docker Desktop driver with root privileges

	I1226 15:12:25.496900    8849 cni.go:84] Creating CNI manager for ""

	I1226 15:12:25.496925    8849 cni.go:158] "docker" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge

	I1226 15:12:25.496934    8849 start_flags.go:318] Found "bridge CNI" CNI - setting NetworkPlugin=cni

	I1226 15:12:25.496946    8849 start_flags.go:323] config:

	{Name:offline-docker-595000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1703498848-17857@sha256:81ae12a49915e4f02aa382dd3758a30a6649e1143c32b3d03309750104577c6c Memory:2048 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:offline-docker-595000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local Container

Runtime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:}

	I1226 15:12:25.560942    8849 out.go:177] * Starting control plane node offline-docker-595000 in cluster offline-docker-595000

	I1226 15:12:25.602791    8849 cache.go:121] Beginning downloading kic base image for docker with docker

	I1226 15:12:25.644893    8849 out.go:177] * Pulling base image v0.0.42-1703498848-17857 ...

	I1226 15:12:25.686988    8849 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker

	I1226 15:12:25.687047    8849 preload.go:148] Found local preload: /Users/jenkins/minikube-integration/17857-1142/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4

	I1226 15:12:25.687057    8849 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1703498848-17857@sha256:81ae12a49915e4f02aa382dd3758a30a6649e1143c32b3d03309750104577c6c in local docker daemon

	I1226 15:12:25.687074    8849 cache.go:56] Caching tarball of preloaded images

	I1226 15:12:25.687322    8849 preload.go:174] Found /Users/jenkins/minikube-integration/17857-1142/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4 in cache, skipping download

	I1226 15:12:25.687333    8849 cache.go:59] Finished verifying existence of preloaded tar for  v1.28.4 on docker

	I1226 15:12:25.688265    8849 profile.go:148] Saving config to /Users/jenkins/minikube-integration/17857-1142/.minikube/profiles/offline-docker-595000/config.json ...

	I1226 15:12:25.688337    8849 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/17857-1142/.minikube/profiles/offline-docker-595000/config.json: {Name:mk54131f5bc37b9927ce8ea572d35c5018d6a31d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1226 15:12:25.812079    8849 image.go:83] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1703498848-17857@sha256:81ae12a49915e4f02aa382dd3758a30a6649e1143c32b3d03309750104577c6c in local docker daemon, skipping pull

	I1226 15:12:25.812107    8849 cache.go:144] gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1703498848-17857@sha256:81ae12a49915e4f02aa382dd3758a30a6649e1143c32b3d03309750104577c6c exists in daemon, skipping load

	I1226 15:12:25.812133    8849 cache.go:194] Successfully downloaded all kic artifacts

	I1226 15:12:25.812208    8849 start.go:365] acquiring machines lock for offline-docker-595000: {Name:mkc57cb4fbd8dca830eb26f3cdd36af864c6929b Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I1226 15:12:25.812411    8849 start.go:369] acquired machines lock for "offline-docker-595000" in 184.18µs

	I1226 15:12:25.812446    8849 start.go:93] Provisioning new machine with config: &{Name:offline-docker-595000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1703498848-17857@sha256:81ae12a49915e4f02aa382dd3758a30a6649e1143c32b3d03309750104577c6c Memory:2048 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:offline-docker-595000 Namespace:default APIServerN

ame:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations

:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}

	I1226 15:12:25.812532    8849 start.go:125] createHost starting for "" (driver="docker")

	I1226 15:12:25.854783    8849 out.go:204] * Creating docker container (CPUs=2, Memory=2048MB) ...

	I1226 15:12:25.855086    8849 start.go:159] libmachine.API.Create for "offline-docker-595000" (driver="docker")

	I1226 15:12:25.855115    8849 client.go:168] LocalClient.Create starting

	I1226 15:12:25.855237    8849 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17857-1142/.minikube/certs/ca.pem

	I1226 15:12:25.855299    8849 main.go:141] libmachine: Decoding PEM data...

	I1226 15:12:25.855322    8849 main.go:141] libmachine: Parsing certificate...

	I1226 15:12:25.855400    8849 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17857-1142/.minikube/certs/cert.pem

	I1226 15:12:25.855438    8849 main.go:141] libmachine: Decoding PEM data...

	I1226 15:12:25.855446    8849 main.go:141] libmachine: Parsing certificate...

	I1226 15:12:25.855982    8849 cli_runner.go:164] Run: docker network inspect offline-docker-595000 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"

	W1226 15:12:25.958391    8849 cli_runner.go:211] docker network inspect offline-docker-595000 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1

	I1226 15:12:25.958479    8849 network_create.go:281] running [docker network inspect offline-docker-595000] to gather additional debugging logs...

	I1226 15:12:25.958509    8849 cli_runner.go:164] Run: docker network inspect offline-docker-595000

	W1226 15:12:26.016056    8849 cli_runner.go:211] docker network inspect offline-docker-595000 returned with exit code 1

	I1226 15:12:26.016105    8849 network_create.go:284] error running [docker network inspect offline-docker-595000]: docker network inspect offline-docker-595000: exit status 1

	stdout:

	[]

	stderr:

	Error response from daemon: network offline-docker-595000 not found

	I1226 15:12:26.016122    8849 network_create.go:286] output of [docker network inspect offline-docker-595000]: -- stdout --

	[]

	-- /stdout --

	** stderr ** 

	Error response from daemon: network offline-docker-595000 not found

	** /stderr **

	I1226 15:12:26.016267    8849 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"

	I1226 15:12:26.075342    8849 network.go:212] skipping subnet 192.168.49.0/24 that is reserved: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:<nil>}

	I1226 15:12:26.075794    8849 network.go:209] using free private subnet 192.168.58.0/24: &{IP:192.168.58.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.58.0/24 Gateway:192.168.58.1 ClientMin:192.168.58.2 ClientMax:192.168.58.254 Broadcast:192.168.58.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc002161340}

	I1226 15:12:26.075814    8849 network_create.go:124] attempt to create docker network offline-docker-595000 192.168.58.0/24 with gateway 192.168.58.1 and MTU of 65535 ...

	I1226 15:12:26.075889    8849 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.58.0/24 --gateway=192.168.58.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=65535 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=offline-docker-595000 offline-docker-595000

	W1226 15:12:26.135623    8849 cli_runner.go:211] docker network create --driver=bridge --subnet=192.168.58.0/24 --gateway=192.168.58.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=65535 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=offline-docker-595000 offline-docker-595000 returned with exit code 1

	W1226 15:12:26.135698    8849 network_create.go:149] failed to create docker network offline-docker-595000 192.168.58.0/24 with gateway 192.168.58.1 and mtu of 65535: docker network create --driver=bridge --subnet=192.168.58.0/24 --gateway=192.168.58.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=65535 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=offline-docker-595000 offline-docker-595000: exit status 1

	stdout:

	stderr:

	Error response from daemon: Pool overlaps with other one on this address space

	W1226 15:12:26.135729    8849 network_create.go:116] failed to create docker network offline-docker-595000 192.168.58.0/24, will retry: subnet is taken

	I1226 15:12:26.137361    8849 network.go:212] skipping subnet 192.168.58.0/24 that is reserved: &{IP:192.168.58.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.58.0/24 Gateway:192.168.58.1 ClientMin:192.168.58.2 ClientMax:192.168.58.254 Broadcast:192.168.58.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:<nil>}

	I1226 15:12:26.137875    8849 network.go:209] using free private subnet 192.168.67.0/24: &{IP:192.168.67.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.67.0/24 Gateway:192.168.67.1 ClientMin:192.168.67.2 ClientMax:192.168.67.254 Broadcast:192.168.67.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc00229bfe0}

	I1226 15:12:26.137893    8849 network_create.go:124] attempt to create docker network offline-docker-595000 192.168.67.0/24 with gateway 192.168.67.1 and MTU of 65535 ...

	I1226 15:12:26.137983    8849 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.67.0/24 --gateway=192.168.67.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=65535 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=offline-docker-595000 offline-docker-595000

	I1226 15:12:26.236822    8849 network_create.go:108] docker network offline-docker-595000 192.168.67.0/24 created

	I1226 15:12:26.236867    8849 kic.go:121] calculated static IP "192.168.67.2" for the "offline-docker-595000" container

	I1226 15:12:26.237066    8849 cli_runner.go:164] Run: docker ps -a --format {{.Names}}

	I1226 15:12:26.300293    8849 cli_runner.go:164] Run: docker volume create offline-docker-595000 --label name.minikube.sigs.k8s.io=offline-docker-595000 --label created_by.minikube.sigs.k8s.io=true

	I1226 15:12:26.467765    8849 oci.go:103] Successfully created a docker volume offline-docker-595000

	I1226 15:12:26.467897    8849 cli_runner.go:164] Run: docker run --rm --name offline-docker-595000-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=offline-docker-595000 --entrypoint /usr/bin/test -v offline-docker-595000:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1703498848-17857@sha256:81ae12a49915e4f02aa382dd3758a30a6649e1143c32b3d03309750104577c6c -d /var/lib

	I1226 15:12:27.006381    8849 oci.go:107] Successfully prepared a docker volume offline-docker-595000

	I1226 15:12:27.006456    8849 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker

	I1226 15:12:27.006468    8849 kic.go:194] Starting extracting preloaded images to volume ...

	I1226 15:12:27.006625    8849 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v /Users/jenkins/minikube-integration/17857-1142/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4:/preloaded.tar:ro -v offline-docker-595000:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1703498848-17857@sha256:81ae12a49915e4f02aa382dd3758a30a6649e1143c32b3d03309750104577c6c -I lz4 -xf /preloaded.tar -C /extractDir

	I1226 15:18:25.852753    8849 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I1226 15:18:25.852930    8849 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" offline-docker-595000

	W1226 15:18:25.909224    8849 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" offline-docker-595000 returned with exit code 1

	I1226 15:18:25.909329    8849 retry.go:31] will retry after 144.736633ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "offline-docker-595000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" offline-docker-595000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: offline-docker-595000

	I1226 15:18:26.054511    8849 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" offline-docker-595000

	W1226 15:18:26.109834    8849 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" offline-docker-595000 returned with exit code 1

	I1226 15:18:26.109947    8849 retry.go:31] will retry after 535.793508ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "offline-docker-595000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" offline-docker-595000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: offline-docker-595000

	I1226 15:18:26.647274    8849 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" offline-docker-595000

	W1226 15:18:26.701006    8849 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" offline-docker-595000 returned with exit code 1

	I1226 15:18:26.701138    8849 retry.go:31] will retry after 659.943071ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "offline-docker-595000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" offline-docker-595000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: offline-docker-595000

	I1226 15:18:27.361566    8849 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" offline-docker-595000

	W1226 15:18:27.415340    8849 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" offline-docker-595000 returned with exit code 1

	W1226 15:18:27.415448    8849 start.go:275] error running df -h /var: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "offline-docker-595000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" offline-docker-595000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: offline-docker-595000

	W1226 15:18:27.415474    8849 start.go:242] error getting percentage of /var that is free: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "offline-docker-595000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" offline-docker-595000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: offline-docker-595000

	I1226 15:18:27.415540    8849 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"

	I1226 15:18:27.415589    8849 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" offline-docker-595000

	W1226 15:18:27.467604    8849 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" offline-docker-595000 returned with exit code 1

	I1226 15:18:27.467700    8849 retry.go:31] will retry after 239.826614ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "offline-docker-595000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" offline-docker-595000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: offline-docker-595000

	I1226 15:18:27.708098    8849 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" offline-docker-595000

	W1226 15:18:27.762784    8849 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" offline-docker-595000 returned with exit code 1

	I1226 15:18:27.762879    8849 retry.go:31] will retry after 234.234819ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "offline-docker-595000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" offline-docker-595000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: offline-docker-595000

	I1226 15:18:27.998580    8849 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" offline-docker-595000

	W1226 15:18:28.052663    8849 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" offline-docker-595000 returned with exit code 1

	I1226 15:18:28.052762    8849 retry.go:31] will retry after 417.641148ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "offline-docker-595000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" offline-docker-595000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: offline-docker-595000

	I1226 15:18:28.471359    8849 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" offline-docker-595000

	W1226 15:18:28.525716    8849 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" offline-docker-595000 returned with exit code 1

	W1226 15:18:28.525832    8849 start.go:290] error running df -BG /var: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "offline-docker-595000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" offline-docker-595000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: offline-docker-595000

	W1226 15:18:28.525851    8849 start.go:247] error getting GiB of /var that is available: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "offline-docker-595000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" offline-docker-595000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: offline-docker-595000

	I1226 15:18:28.525864    8849 start.go:128] duration metric: createHost completed in 6m2.716515869s

	I1226 15:18:28.525871    8849 start.go:83] releasing machines lock for "offline-docker-595000", held for 6m2.71665411s

	W1226 15:18:28.525884    8849 start.go:694] error starting host: creating host: create host timed out in 360.000000 seconds

	I1226 15:18:28.526337    8849 cli_runner.go:164] Run: docker container inspect offline-docker-595000 --format={{.State.Status}}

	W1226 15:18:28.578623    8849 cli_runner.go:211] docker container inspect offline-docker-595000 --format={{.State.Status}} returned with exit code 1

	I1226 15:18:28.578686    8849 delete.go:82] Unable to get host status for offline-docker-595000, assuming it has already been deleted: state: unknown state "offline-docker-595000": docker container inspect offline-docker-595000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: offline-docker-595000

	W1226 15:18:28.578822    8849 out.go:239] ! StartHost failed, but will try again: creating host: create host timed out in 360.000000 seconds

	! StartHost failed, but will try again: creating host: create host timed out in 360.000000 seconds

	I1226 15:18:28.578832    8849 start.go:709] Will try again in 5 seconds ...

	I1226 15:18:33.579456    8849 start.go:365] acquiring machines lock for offline-docker-595000: {Name:mkc57cb4fbd8dca830eb26f3cdd36af864c6929b Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I1226 15:18:33.579625    8849 start.go:369] acquired machines lock for "offline-docker-595000" in 122.158µs

	I1226 15:18:33.579656    8849 start.go:96] Skipping create...Using existing machine configuration

	I1226 15:18:33.579670    8849 fix.go:54] fixHost starting: 

	I1226 15:18:33.580113    8849 cli_runner.go:164] Run: docker container inspect offline-docker-595000 --format={{.State.Status}}

	W1226 15:18:33.633345    8849 cli_runner.go:211] docker container inspect offline-docker-595000 --format={{.State.Status}} returned with exit code 1

	I1226 15:18:33.633398    8849 fix.go:102] recreateIfNeeded on offline-docker-595000: state= err=unknown state "offline-docker-595000": docker container inspect offline-docker-595000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: offline-docker-595000

	I1226 15:18:33.633421    8849 fix.go:107] machineExists: false. err=machine does not exist

	I1226 15:18:33.655138    8849 out.go:177] * docker "offline-docker-595000" container is missing, will recreate.

	I1226 15:18:33.698673    8849 delete.go:124] DEMOLISHING offline-docker-595000 ...

	I1226 15:18:33.698834    8849 cli_runner.go:164] Run: docker container inspect offline-docker-595000 --format={{.State.Status}}

	W1226 15:18:33.753494    8849 cli_runner.go:211] docker container inspect offline-docker-595000 --format={{.State.Status}} returned with exit code 1

	W1226 15:18:33.753543    8849 stop.go:75] unable to get state: unknown state "offline-docker-595000": docker container inspect offline-docker-595000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: offline-docker-595000

	I1226 15:18:33.753561    8849 delete.go:128] stophost failed (probably ok): ssh power off: unknown state "offline-docker-595000": docker container inspect offline-docker-595000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: offline-docker-595000

	I1226 15:18:33.753920    8849 cli_runner.go:164] Run: docker container inspect offline-docker-595000 --format={{.State.Status}}

	W1226 15:18:33.808489    8849 cli_runner.go:211] docker container inspect offline-docker-595000 --format={{.State.Status}} returned with exit code 1

	I1226 15:18:33.808543    8849 delete.go:82] Unable to get host status for offline-docker-595000, assuming it has already been deleted: state: unknown state "offline-docker-595000": docker container inspect offline-docker-595000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: offline-docker-595000

	I1226 15:18:33.808645    8849 cli_runner.go:164] Run: docker container inspect -f {{.Id}} offline-docker-595000

	W1226 15:18:33.861055    8849 cli_runner.go:211] docker container inspect -f {{.Id}} offline-docker-595000 returned with exit code 1

	I1226 15:18:33.861123    8849 kic.go:371] could not find the container offline-docker-595000 to remove it. will try anyways

	I1226 15:18:33.861186    8849 cli_runner.go:164] Run: docker container inspect offline-docker-595000 --format={{.State.Status}}

	W1226 15:18:33.915774    8849 cli_runner.go:211] docker container inspect offline-docker-595000 --format={{.State.Status}} returned with exit code 1

	W1226 15:18:33.915856    8849 oci.go:84] error getting container status, will try to delete anyways: unknown state "offline-docker-595000": docker container inspect offline-docker-595000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: offline-docker-595000

	I1226 15:18:33.916055    8849 cli_runner.go:164] Run: docker exec --privileged -t offline-docker-595000 /bin/bash -c "sudo init 0"

	W1226 15:18:33.968128    8849 cli_runner.go:211] docker exec --privileged -t offline-docker-595000 /bin/bash -c "sudo init 0" returned with exit code 1

	I1226 15:18:33.968163    8849 oci.go:650] error shutdown offline-docker-595000: docker exec --privileged -t offline-docker-595000 /bin/bash -c "sudo init 0": exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: offline-docker-595000

	I1226 15:18:34.969662    8849 cli_runner.go:164] Run: docker container inspect offline-docker-595000 --format={{.State.Status}}

	W1226 15:18:35.023891    8849 cli_runner.go:211] docker container inspect offline-docker-595000 --format={{.State.Status}} returned with exit code 1

	I1226 15:18:35.023955    8849 oci.go:662] temporary error verifying shutdown: unknown state "offline-docker-595000": docker container inspect offline-docker-595000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: offline-docker-595000

	I1226 15:18:35.023970    8849 oci.go:664] temporary error: container offline-docker-595000 status is  but expect it to be exited

	I1226 15:18:35.023994    8849 retry.go:31] will retry after 641.588641ms: couldn't verify container is exited. %v: unknown state "offline-docker-595000": docker container inspect offline-docker-595000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: offline-docker-595000

	I1226 15:18:35.666021    8849 cli_runner.go:164] Run: docker container inspect offline-docker-595000 --format={{.State.Status}}

	W1226 15:18:35.720567    8849 cli_runner.go:211] docker container inspect offline-docker-595000 --format={{.State.Status}} returned with exit code 1

	I1226 15:18:35.720617    8849 oci.go:662] temporary error verifying shutdown: unknown state "offline-docker-595000": docker container inspect offline-docker-595000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: offline-docker-595000

	I1226 15:18:35.720628    8849 oci.go:664] temporary error: container offline-docker-595000 status is  but expect it to be exited

	I1226 15:18:35.720651    8849 retry.go:31] will retry after 747.706384ms: couldn't verify container is exited. %v: unknown state "offline-docker-595000": docker container inspect offline-docker-595000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: offline-docker-595000

	I1226 15:18:36.469267    8849 cli_runner.go:164] Run: docker container inspect offline-docker-595000 --format={{.State.Status}}

	W1226 15:18:36.524748    8849 cli_runner.go:211] docker container inspect offline-docker-595000 --format={{.State.Status}} returned with exit code 1

	I1226 15:18:36.524796    8849 oci.go:662] temporary error verifying shutdown: unknown state "offline-docker-595000": docker container inspect offline-docker-595000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: offline-docker-595000

	I1226 15:18:36.524805    8849 oci.go:664] temporary error: container offline-docker-595000 status is  but expect it to be exited

	I1226 15:18:36.524830    8849 retry.go:31] will retry after 996.28852ms: couldn't verify container is exited. %v: unknown state "offline-docker-595000": docker container inspect offline-docker-595000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: offline-docker-595000

	I1226 15:18:37.521570    8849 cli_runner.go:164] Run: docker container inspect offline-docker-595000 --format={{.State.Status}}

	W1226 15:18:37.574825    8849 cli_runner.go:211] docker container inspect offline-docker-595000 --format={{.State.Status}} returned with exit code 1

	I1226 15:18:37.574874    8849 oci.go:662] temporary error verifying shutdown: unknown state "offline-docker-595000": docker container inspect offline-docker-595000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: offline-docker-595000

	I1226 15:18:37.574884    8849 oci.go:664] temporary error: container offline-docker-595000 status is  but expect it to be exited

	I1226 15:18:37.574910    8849 retry.go:31] will retry after 2.331781318s: couldn't verify container is exited. %v: unknown state "offline-docker-595000": docker container inspect offline-docker-595000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: offline-docker-595000

	I1226 15:18:39.906966    8849 cli_runner.go:164] Run: docker container inspect offline-docker-595000 --format={{.State.Status}}

	W1226 15:18:39.961896    8849 cli_runner.go:211] docker container inspect offline-docker-595000 --format={{.State.Status}} returned with exit code 1

	I1226 15:18:39.961946    8849 oci.go:662] temporary error verifying shutdown: unknown state "offline-docker-595000": docker container inspect offline-docker-595000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: offline-docker-595000

	I1226 15:18:39.961958    8849 oci.go:664] temporary error: container offline-docker-595000 status is  but expect it to be exited

	I1226 15:18:39.961981    8849 retry.go:31] will retry after 1.410735086s: couldn't verify container is exited. %v: unknown state "offline-docker-595000": docker container inspect offline-docker-595000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: offline-docker-595000

	I1226 15:18:41.373070    8849 cli_runner.go:164] Run: docker container inspect offline-docker-595000 --format={{.State.Status}}

	W1226 15:18:41.426506    8849 cli_runner.go:211] docker container inspect offline-docker-595000 --format={{.State.Status}} returned with exit code 1

	I1226 15:18:41.426554    8849 oci.go:662] temporary error verifying shutdown: unknown state "offline-docker-595000": docker container inspect offline-docker-595000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: offline-docker-595000

	I1226 15:18:41.426564    8849 oci.go:664] temporary error: container offline-docker-595000 status is  but expect it to be exited

	I1226 15:18:41.426587    8849 retry.go:31] will retry after 5.659721477s: couldn't verify container is exited. %v: unknown state "offline-docker-595000": docker container inspect offline-docker-595000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: offline-docker-595000

	I1226 15:18:47.086630    8849 cli_runner.go:164] Run: docker container inspect offline-docker-595000 --format={{.State.Status}}

	W1226 15:18:47.140711    8849 cli_runner.go:211] docker container inspect offline-docker-595000 --format={{.State.Status}} returned with exit code 1

	I1226 15:18:47.140770    8849 oci.go:662] temporary error verifying shutdown: unknown state "offline-docker-595000": docker container inspect offline-docker-595000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: offline-docker-595000

	I1226 15:18:47.140782    8849 oci.go:664] temporary error: container offline-docker-595000 status is  but expect it to be exited

	I1226 15:18:47.140809    8849 oci.go:88] couldn't shut down offline-docker-595000 (might be okay): verify shutdown: couldn't verify container is exited. %v: unknown state "offline-docker-595000": docker container inspect offline-docker-595000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: offline-docker-595000

	I1226 15:18:47.140880    8849 cli_runner.go:164] Run: docker rm -f -v offline-docker-595000

	I1226 15:18:47.196578    8849 cli_runner.go:164] Run: docker container inspect -f {{.Id}} offline-docker-595000

	W1226 15:18:47.249354    8849 cli_runner.go:211] docker container inspect -f {{.Id}} offline-docker-595000 returned with exit code 1

	I1226 15:18:47.249473    8849 cli_runner.go:164] Run: docker network inspect offline-docker-595000 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"

	I1226 15:18:47.302480    8849 cli_runner.go:164] Run: docker network rm offline-docker-595000

	I1226 15:18:47.420627    8849 fix.go:114] Sleeping 1 second for extra luck!

	I1226 15:18:48.420881    8849 start.go:125] createHost starting for "" (driver="docker")

	I1226 15:18:48.442769    8849 out.go:204] * Creating docker container (CPUs=2, Memory=2048MB) ...

	I1226 15:18:48.442949    8849 start.go:159] libmachine.API.Create for "offline-docker-595000" (driver="docker")

	I1226 15:18:48.442982    8849 client.go:168] LocalClient.Create starting

	I1226 15:18:48.443156    8849 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17857-1142/.minikube/certs/ca.pem

	I1226 15:18:48.443245    8849 main.go:141] libmachine: Decoding PEM data...

	I1226 15:18:48.443273    8849 main.go:141] libmachine: Parsing certificate...

	I1226 15:18:48.443346    8849 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17857-1142/.minikube/certs/cert.pem

	I1226 15:18:48.443414    8849 main.go:141] libmachine: Decoding PEM data...

	I1226 15:18:48.443428    8849 main.go:141] libmachine: Parsing certificate...

	I1226 15:18:48.444294    8849 cli_runner.go:164] Run: docker network inspect offline-docker-595000 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"

	W1226 15:18:48.498896    8849 cli_runner.go:211] docker network inspect offline-docker-595000 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1

	I1226 15:18:48.499000    8849 network_create.go:281] running [docker network inspect offline-docker-595000] to gather additional debugging logs...

	I1226 15:18:48.499016    8849 cli_runner.go:164] Run: docker network inspect offline-docker-595000

	W1226 15:18:48.551546    8849 cli_runner.go:211] docker network inspect offline-docker-595000 returned with exit code 1

	I1226 15:18:48.551581    8849 network_create.go:284] error running [docker network inspect offline-docker-595000]: docker network inspect offline-docker-595000: exit status 1

	stdout:

	[]

	stderr:

	Error response from daemon: network offline-docker-595000 not found

	I1226 15:18:48.551603    8849 network_create.go:286] output of [docker network inspect offline-docker-595000]: -- stdout --

	[]

	-- /stdout --

	** stderr ** 

	Error response from daemon: network offline-docker-595000 not found

	** /stderr **

	I1226 15:18:48.551756    8849 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"

	I1226 15:18:48.607272    8849 network.go:212] skipping subnet 192.168.49.0/24 that is reserved: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:<nil>}

	I1226 15:18:48.609012    8849 network.go:212] skipping subnet 192.168.58.0/24 that is reserved: &{IP:192.168.58.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.58.0/24 Gateway:192.168.58.1 ClientMin:192.168.58.2 ClientMax:192.168.58.254 Broadcast:192.168.58.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:<nil>}

	I1226 15:18:48.610594    8849 network.go:212] skipping subnet 192.168.67.0/24 that is reserved: &{IP:192.168.67.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.67.0/24 Gateway:192.168.67.1 ClientMin:192.168.67.2 ClientMax:192.168.67.254 Broadcast:192.168.67.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:<nil>}

	I1226 15:18:48.612256    8849 network.go:212] skipping subnet 192.168.76.0/24 that is reserved: &{IP:192.168.76.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.76.0/24 Gateway:192.168.76.1 ClientMin:192.168.76.2 ClientMax:192.168.76.254 Broadcast:192.168.76.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:<nil>}

	I1226 15:18:48.612699    8849 network.go:209] using free private subnet 192.168.85.0/24: &{IP:192.168.85.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.85.0/24 Gateway:192.168.85.1 ClientMin:192.168.85.2 ClientMax:192.168.85.254 Broadcast:192.168.85.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc002161aa0}

	I1226 15:18:48.612711    8849 network_create.go:124] attempt to create docker network offline-docker-595000 192.168.85.0/24 with gateway 192.168.85.1 and MTU of 65535 ...

	I1226 15:18:48.612778    8849 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.85.0/24 --gateway=192.168.85.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=65535 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=offline-docker-595000 offline-docker-595000

	I1226 15:18:48.704108    8849 network_create.go:108] docker network offline-docker-595000 192.168.85.0/24 created

	I1226 15:18:48.704157    8849 kic.go:121] calculated static IP "192.168.85.2" for the "offline-docker-595000" container

	I1226 15:18:48.704271    8849 cli_runner.go:164] Run: docker ps -a --format {{.Names}}

	I1226 15:18:48.759416    8849 cli_runner.go:164] Run: docker volume create offline-docker-595000 --label name.minikube.sigs.k8s.io=offline-docker-595000 --label created_by.minikube.sigs.k8s.io=true

	I1226 15:18:48.812734    8849 oci.go:103] Successfully created a docker volume offline-docker-595000

	I1226 15:18:48.812844    8849 cli_runner.go:164] Run: docker run --rm --name offline-docker-595000-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=offline-docker-595000 --entrypoint /usr/bin/test -v offline-docker-595000:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1703498848-17857@sha256:81ae12a49915e4f02aa382dd3758a30a6649e1143c32b3d03309750104577c6c -d /var/lib

	I1226 15:18:49.151356    8849 oci.go:107] Successfully prepared a docker volume offline-docker-595000

	I1226 15:18:49.151398    8849 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker

	I1226 15:18:49.151411    8849 kic.go:194] Starting extracting preloaded images to volume ...

	I1226 15:18:49.151523    8849 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v /Users/jenkins/minikube-integration/17857-1142/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4:/preloaded.tar:ro -v offline-docker-595000:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1703498848-17857@sha256:81ae12a49915e4f02aa382dd3758a30a6649e1143c32b3d03309750104577c6c -I lz4 -xf /preloaded.tar -C /extractDir

	I1226 15:24:48.499971    8849 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I1226 15:24:48.500119    8849 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" offline-docker-595000

	W1226 15:24:48.554007    8849 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" offline-docker-595000 returned with exit code 1

	I1226 15:24:48.554134    8849 retry.go:31] will retry after 287.987913ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "offline-docker-595000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" offline-docker-595000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: offline-docker-595000

	I1226 15:24:48.842509    8849 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" offline-docker-595000

	W1226 15:24:48.897485    8849 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" offline-docker-595000 returned with exit code 1

	I1226 15:24:48.897606    8849 retry.go:31] will retry after 305.16411ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "offline-docker-595000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" offline-docker-595000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: offline-docker-595000

	I1226 15:24:49.203496    8849 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" offline-docker-595000

	W1226 15:24:49.257025    8849 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" offline-docker-595000 returned with exit code 1

	I1226 15:24:49.257123    8849 retry.go:31] will retry after 483.254856ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "offline-docker-595000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" offline-docker-595000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: offline-docker-595000

	I1226 15:24:49.740802    8849 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" offline-docker-595000

	W1226 15:24:49.795995    8849 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" offline-docker-595000 returned with exit code 1

	W1226 15:24:49.796101    8849 start.go:275] error running df -h /var: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "offline-docker-595000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" offline-docker-595000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: offline-docker-595000

	W1226 15:24:49.796124    8849 start.go:242] error getting percentage of /var that is free: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "offline-docker-595000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" offline-docker-595000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: offline-docker-595000

	I1226 15:24:49.796188    8849 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"

	I1226 15:24:49.796244    8849 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" offline-docker-595000

	W1226 15:24:49.868549    8849 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" offline-docker-595000 returned with exit code 1

	I1226 15:24:49.868638    8849 retry.go:31] will retry after 265.716285ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "offline-docker-595000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" offline-docker-595000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: offline-docker-595000

	I1226 15:24:50.136613    8849 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" offline-docker-595000

	W1226 15:24:50.189149    8849 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" offline-docker-595000 returned with exit code 1

	I1226 15:24:50.189249    8849 retry.go:31] will retry after 241.859885ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "offline-docker-595000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" offline-docker-595000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: offline-docker-595000

	I1226 15:24:50.432764    8849 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" offline-docker-595000

	W1226 15:24:50.486383    8849 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" offline-docker-595000 returned with exit code 1

	I1226 15:24:50.486487    8849 retry.go:31] will retry after 614.906227ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "offline-docker-595000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" offline-docker-595000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: offline-docker-595000

	I1226 15:24:51.101723    8849 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" offline-docker-595000

	W1226 15:24:51.154604    8849 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" offline-docker-595000 returned with exit code 1

	I1226 15:24:51.154700    8849 retry.go:31] will retry after 595.700206ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "offline-docker-595000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" offline-docker-595000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: offline-docker-595000

	I1226 15:24:51.752014    8849 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" offline-docker-595000

	W1226 15:24:51.807602    8849 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" offline-docker-595000 returned with exit code 1

	W1226 15:24:51.807725    8849 start.go:290] error running df -BG /var: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "offline-docker-595000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" offline-docker-595000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: offline-docker-595000

	W1226 15:24:51.807742    8849 start.go:247] error getting GiB of /var that is available: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "offline-docker-595000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" offline-docker-595000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: offline-docker-595000

	I1226 15:24:51.807773    8849 start.go:128] duration metric: createHost completed in 6m3.331140975s

	I1226 15:24:51.807838    8849 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I1226 15:24:51.807899    8849 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" offline-docker-595000

	W1226 15:24:51.861309    8849 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" offline-docker-595000 returned with exit code 1

	I1226 15:24:51.861431    8849 retry.go:31] will retry after 332.994258ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "offline-docker-595000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" offline-docker-595000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: offline-docker-595000

	I1226 15:24:52.196734    8849 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" offline-docker-595000

	W1226 15:24:52.250469    8849 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" offline-docker-595000 returned with exit code 1

	I1226 15:24:52.250569    8849 retry.go:31] will retry after 338.233811ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "offline-docker-595000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" offline-docker-595000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: offline-docker-595000

	I1226 15:24:52.590980    8849 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" offline-docker-595000

	W1226 15:24:52.643358    8849 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" offline-docker-595000 returned with exit code 1

	I1226 15:24:52.643454    8849 retry.go:31] will retry after 712.438295ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "offline-docker-595000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" offline-docker-595000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: offline-docker-595000

	I1226 15:24:53.356319    8849 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" offline-docker-595000

	W1226 15:24:53.409294    8849 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" offline-docker-595000 returned with exit code 1

	W1226 15:24:53.409393    8849 start.go:275] error running df -h /var: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "offline-docker-595000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" offline-docker-595000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: offline-docker-595000

	W1226 15:24:53.409413    8849 start.go:242] error getting percentage of /var that is free: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "offline-docker-595000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" offline-docker-595000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: offline-docker-595000

	I1226 15:24:53.409469    8849 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"

	I1226 15:24:53.409530    8849 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" offline-docker-595000

	W1226 15:24:53.461862    8849 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" offline-docker-595000 returned with exit code 1

	I1226 15:24:53.462001    8849 retry.go:31] will retry after 276.31308ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "offline-docker-595000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" offline-docker-595000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: offline-docker-595000

	I1226 15:24:53.738762    8849 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" offline-docker-595000

	W1226 15:24:53.792324    8849 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" offline-docker-595000 returned with exit code 1

	I1226 15:24:53.792419    8849 retry.go:31] will retry after 481.187096ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "offline-docker-595000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" offline-docker-595000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: offline-docker-595000

	I1226 15:24:54.274312    8849 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" offline-docker-595000

	W1226 15:24:54.327633    8849 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" offline-docker-595000 returned with exit code 1

	I1226 15:24:54.327732    8849 retry.go:31] will retry after 698.51283ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "offline-docker-595000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" offline-docker-595000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: offline-docker-595000

	I1226 15:24:55.026556    8849 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" offline-docker-595000

	W1226 15:24:55.083688    8849 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" offline-docker-595000 returned with exit code 1

	W1226 15:24:55.083789    8849 start.go:290] error running df -BG /var: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "offline-docker-595000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" offline-docker-595000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: offline-docker-595000

	W1226 15:24:55.083809    8849 start.go:247] error getting GiB of /var that is available: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "offline-docker-595000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" offline-docker-595000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: offline-docker-595000

	I1226 15:24:55.083825    8849 fix.go:56] fixHost completed within 6m21.448653948s

	I1226 15:24:55.083849    8849 start.go:83] releasing machines lock for "offline-docker-595000", held for 6m21.448706766s

	W1226 15:24:55.083937    8849 out.go:239] * Failed to start docker container. Running "minikube delete -p offline-docker-595000" may fix it: recreate: creating host: create host timed out in 360.000000 seconds

	* Failed to start docker container. Running "minikube delete -p offline-docker-595000" may fix it: recreate: creating host: create host timed out in 360.000000 seconds

	I1226 15:24:55.127459    8849 out.go:177] 

	W1226 15:24:55.149685    8849 out.go:239] X Exiting due to DRV_CREATE_TIMEOUT: Failed to start host: recreate: creating host: create host timed out in 360.000000 seconds

	X Exiting due to DRV_CREATE_TIMEOUT: Failed to start host: recreate: creating host: create host timed out in 360.000000 seconds

	W1226 15:24:55.149767    8849 out.go:239] * Suggestion: Try 'minikube delete', and disable any conflicting VPN or firewall software

	* Suggestion: Try 'minikube delete', and disable any conflicting VPN or firewall software

	W1226 15:24:55.149808    8849 out.go:239] * Related issue: https://github.com/kubernetes/minikube/issues/7072

	* Related issue: https://github.com/kubernetes/minikube/issues/7072

	I1226 15:24:55.171250    8849 out.go:177] 

** /stderr **

aab_offline_test.go:58: out/minikube-darwin-amd64 start -p offline-docker-595000 --alsologtostderr -v=1 --memory=2048 --wait=true --driver=docker  failed: exit status 52

panic.go:523: *** TestOffline FAILED at 2023-12-26 15:24:55.247549 -0800 PST m=+6059.499967880

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:230: ======>  post-mortem[TestOffline]: docker inspect <======

helpers_test.go:231: (dbg) Run:  docker inspect offline-docker-595000

helpers_test.go:235: (dbg) docker inspect offline-docker-595000:

-- stdout --

	[

	    {

	        "Name": "offline-docker-595000",

	        "Id": "62f90c5c4b8a9cf9e969daf12c71d30d4ac829fd51d86ed90954abe5bb57be81",

	        "Created": "2023-12-26T23:18:48.66208623Z",

	        "Scope": "local",

	        "Driver": "bridge",

	        "EnableIPv6": false,

	        "IPAM": {

	            "Driver": "default",

	            "Options": {},

	            "Config": [

	                {

	                    "Subnet": "192.168.85.0/24",

	                    "Gateway": "192.168.85.1"

	                }

	            ]

	        },

	        "Internal": false,

	        "Attachable": false,

	        "Ingress": false,

	        "ConfigFrom": {

	            "Network": ""

	        },

	        "ConfigOnly": false,

	        "Containers": {},

	        "Options": {

	            "--icc": "",

	            "--ip-masq": "",

	            "com.docker.network.driver.mtu": "65535"

	        },

	        "Labels": {

	            "created_by.minikube.sigs.k8s.io": "true",

	            "name.minikube.sigs.k8s.io": "offline-docker-595000"

	        }

	    }

	]

-- /stdout --

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p offline-docker-595000 -n offline-docker-595000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p offline-docker-595000 -n offline-docker-595000: exit status 7 (115.044778ms)

-- stdout --

	Nonexistent

-- /stdout --

** stderr ** 

	E1226 15:24:55.422567    9533 status.go:249] status error: host: state: unknown state "offline-docker-595000": docker container inspect offline-docker-595000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: offline-docker-595000

** /stderr **

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "offline-docker-595000" host is not running, skipping log retrieval (state="Nonexistent")

helpers_test.go:175: Cleaning up "offline-docker-595000" profile ...

helpers_test.go:178: (dbg) Run:  out/minikube-darwin-amd64 delete -p offline-docker-595000

--- FAIL: TestOffline (751.40s)

=== RUN   TestCertOptions

=== PAUSE TestCertOptions

=== CONT  TestCertOptions

cert_options_test.go:49: (dbg) Run:  out/minikube-darwin-amd64 start -p cert-options-605000 --memory=2048 --apiserver-ips=127.0.0.1 --apiserver-ips=192.168.15.15 --apiserver-names=localhost --apiserver-names=www.google.com --apiserver-port=8555 --driver=docker  --apiserver-name=localhost

E1226 15:38:46.351227    1612 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/17857-1142/.minikube/profiles/addons-914000/client.crt: no such file or directory

E1226 15:39:19.382983    1612 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/17857-1142/.minikube/profiles/functional-155000/client.crt: no such file or directory

E1226 15:39:36.323109    1612 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/17857-1142/.minikube/profiles/functional-155000/client.crt: no such file or directory

E1226 15:43:46.349402    1612 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/17857-1142/.minikube/profiles/addons-914000/client.crt: no such file or directory

panic: test timed out after 2h0m0s

running tests:

	TestCertExpiration (6m23s)

	TestCertOptions (5m47s)

	TestNetworkPlugins (31m31s)

	TestNetworkPlugins/group (31m31s)

goroutine 2110 [running]:

testing.(*M).startAlarm.func1()

	/usr/local/go/src/testing/testing.go:2259 +0x3b9

created by time.goFunc

	/usr/local/go/src/time/sleep.go:176 +0x2d

goroutine 1 [chan receive, 19 minutes]:

testing.tRunner.func1()

	/usr/local/go/src/testing/testing.go:1561 +0x489

testing.tRunner(0xc0007eb040, 0xc000977b80)

	/usr/local/go/src/testing/testing.go:1601 +0x138

testing.runTests(0xc0006ea1e0?, {0x527bbe0, 0x2a, 0x2a}, {0x10b0145?, 0xc000068180?, 0x529d420?})

	/usr/local/go/src/testing/testing.go:2052 +0x445

testing.(*M).Run(0xc0006ea1e0)

	/usr/local/go/src/testing/testing.go:1925 +0x636

k8s.io/minikube/test/integration.TestMain(0xc00008a6f0?)

	/mnt/disks/sdb/jenkins/go/src/k8s.io/minikube/test/integration/main_test.go:62 +0x88

main.main()

	_testmain.go:131 +0x1c6

goroutine 35 [select]:

go.opencensus.io/stats/view.(*worker).start(0xc0001ad780)

	/var/lib/jenkins/go/pkg/mod/go.opencensus.io@v0.24.0/stats/view/worker.go:292 +0x9f

created by go.opencensus.io/stats/view.init.0 in goroutine 1

	/var/lib/jenkins/go/pkg/mod/go.opencensus.io@v0.24.0/stats/view/worker.go:34 +0x8d

goroutine 1801 [chan receive, 31 minutes]:

testing.(*testContext).waitParallel(0xc000c064b0)

	/usr/local/go/src/testing/testing.go:1715 +0xac

testing.(*T).Parallel(0xc002687040)

	/usr/local/go/src/testing/testing.go:1404 +0x219

k8s.io/minikube/test/integration.MaybeParallel(0xc002687040)

	/mnt/disks/sdb/jenkins/go/src/k8s.io/minikube/test/integration/helpers_test.go:483 +0x34

k8s.io/minikube/test/integration.TestNetworkPlugins.func1.1(0xc002687040)

	/mnt/disks/sdb/jenkins/go/src/k8s.io/minikube/test/integration/net_test.go:106 +0x33c

testing.tRunner(0xc002687040, 0xc002844480)

	/usr/local/go/src/testing/testing.go:1595 +0xff

created by testing.(*T).Run in goroutine 1795

	/usr/local/go/src/testing/testing.go:1648 +0x3ad

goroutine 38 [select]:

k8s.io/klog/v2.(*flushDaemon).run.func1()

	/var/lib/jenkins/go/pkg/mod/k8s.io/klog/v2@v2.110.1/klog.go:1157 +0x111

created by k8s.io/klog/v2.(*flushDaemon).run in goroutine 37

	/var/lib/jenkins/go/pkg/mod/k8s.io/klog/v2@v2.110.1/klog.go:1153 +0x171

goroutine 1784 [chan receive, 33 minutes]:

testing.(*testContext).waitParallel(0xc000c064b0)

	/usr/local/go/src/testing/testing.go:1715 +0xac

testing.(*T).Parallel(0xc002134680)

	/usr/local/go/src/testing/testing.go:1404 +0x219

k8s.io/minikube/test/integration.MaybeParallel(0xc002134680)

	/mnt/disks/sdb/jenkins/go/src/k8s.io/minikube/test/integration/helpers_test.go:483 +0x34

k8s.io/minikube/test/integration.TestKubernetesUpgrade(0xc002134680)

	/mnt/disks/sdb/jenkins/go/src/k8s.io/minikube/test/integration/version_upgrade_test.go:228 +0x39

testing.tRunner(0xc002134680, 0x3b43408)

	/usr/local/go/src/testing/testing.go:1595 +0xff

created by testing.(*T).Run in goroutine 1

	/usr/local/go/src/testing/testing.go:1648 +0x3ad

goroutine 1802 [chan receive, 31 minutes]:

testing.(*testContext).waitParallel(0xc000c064b0)

	/usr/local/go/src/testing/testing.go:1715 +0xac

testing.(*T).Parallel(0xc002687380)

	/usr/local/go/src/testing/testing.go:1404 +0x219

k8s.io/minikube/test/integration.MaybeParallel(0xc002687380)

	/mnt/disks/sdb/jenkins/go/src/k8s.io/minikube/test/integration/helpers_test.go:483 +0x34

k8s.io/minikube/test/integration.TestNetworkPlugins.func1.1(0xc002687380)

	/mnt/disks/sdb/jenkins/go/src/k8s.io/minikube/test/integration/net_test.go:106 +0x33c

testing.tRunner(0xc002687380, 0xc002844500)

	/usr/local/go/src/testing/testing.go:1595 +0xff

created by testing.(*T).Run in goroutine 1795

	/usr/local/go/src/testing/testing.go:1648 +0x3ad

goroutine 837 [chan receive, 110 minutes]:

k8s.io/client-go/transport.(*dynamicClientCert).Run(0xc0028a9e80, 0xc000064f60)

	/var/lib/jenkins/go/pkg/mod/k8s.io/client-go@v0.29.0/transport/cert_rotation.go:147 +0x2a9

created by k8s.io/client-go/transport.(*tlsTransportCache).get in goroutine 750

	/var/lib/jenkins/go/pkg/mod/k8s.io/client-go@v0.29.0/transport/cache.go:122 +0x594

goroutine 512 [syscall, 5 minutes]:

syscall.syscall6(0x1010585?, 0xc0007e38f8?, 0xc0007e37e8?, 0xc0007e3918?, 0x100c0007e38e0?, 0x1000000000003?, 0x4d2fd5c8?)

	/usr/local/go/src/runtime/sys_darwin.go:45 +0x98

syscall.wait4(0xc0007e3890?, 0x1010905?, 0x90?, 0x305b340?)

	/usr/local/go/src/syscall/zsyscall_darwin_amd64.go:43 +0x45

syscall.Wait4(0xc0028609e0?, 0xc0007e38c4, 0x0?, 0x0?)

	/usr/local/go/src/syscall/syscall_bsd.go:144 +0x25

os.(*Process).wait(0xc002972240)

	/usr/local/go/src/os/exec_unix.go:43 +0x6d

os.(*Process).Wait(...)

	/usr/local/go/src/os/exec.go:134

os/exec.(*Cmd).Wait(0xc0022426e0)

	/usr/local/go/src/os/exec/exec.go:890 +0x45

os/exec.(*Cmd).Run(0xc002aa0000?)

	/usr/local/go/src/os/exec/exec.go:590 +0x2d

k8s.io/minikube/test/integration.Run(0xc002aa0000, 0xc0022426e0)

	/mnt/disks/sdb/jenkins/go/src/k8s.io/minikube/test/integration/helpers_test.go:103 +0x1ed

k8s.io/minikube/test/integration.TestCertOptions(0xc002aa0000)

	/mnt/disks/sdb/jenkins/go/src/k8s.io/minikube/test/integration/cert_options_test.go:49 +0x40e

testing.tRunner(0xc002aa0000, 0x3b43358)

	/usr/local/go/src/testing/testing.go:1595 +0xff

created by testing.(*T).Run in goroutine 1

	/usr/local/go/src/testing/testing.go:1648 +0x3ad

goroutine 1693 [chan receive, 33 minutes]:

testing.(*testContext).waitParallel(0xc000c064b0)

	/usr/local/go/src/testing/testing.go:1715 +0xac

testing.(*T).Parallel(0xc002686340)

	/usr/local/go/src/testing/testing.go:1404 +0x219

k8s.io/minikube/test/integration.MaybeParallel(0xc002686340)

	/mnt/disks/sdb/jenkins/go/src/k8s.io/minikube/test/integration/helpers_test.go:483 +0x34

k8s.io/minikube/test/integration.TestNoKubernetes(0xc002686340)

	/mnt/disks/sdb/jenkins/go/src/k8s.io/minikube/test/integration/no_kubernetes_test.go:33 +0x36

testing.tRunner(0xc002686340, 0x3b43440)

	/usr/local/go/src/testing/testing.go:1595 +0xff

created by testing.(*T).Run in goroutine 1

	/usr/local/go/src/testing/testing.go:1648 +0x3ad

goroutine 545 [syscall, 6 minutes]:

syscall.syscall6(0x10106dd?, 0x59cd108?, 0xc000b7d917?, 0xc000b7dab8?, 0x100c000b7da80?, 0x1010000000003?, 0x4d2fd5c8?)

	/usr/local/go/src/runtime/sys_darwin.go:45 +0x98

syscall.wait4(0xc000b7da30?, 0x1010905?, 0x90?, 0x305b340?)

	/usr/local/go/src/syscall/zsyscall_darwin_amd64.go:43 +0x45

syscall.Wait4(0xc002860180?, 0xc000b7da64, 0x0?, 0x0?)

	/usr/local/go/src/syscall/syscall_bsd.go:144 +0x25

os.(*Process).wait(0xc002972000)

	/usr/local/go/src/os/exec_unix.go:43 +0x6d

os.(*Process).Wait(...)

	/usr/local/go/src/os/exec.go:134

os/exec.(*Cmd).Wait(0xc002242000)

	/usr/local/go/src/os/exec/exec.go:890 +0x45

os/exec.(*Cmd).Run(0xc002aa01a0?)

	/usr/local/go/src/os/exec/exec.go:590 +0x2d

k8s.io/minikube/test/integration.Run(0xc002aa01a0, 0xc002242000)

	/mnt/disks/sdb/jenkins/go/src/k8s.io/minikube/test/integration/helpers_test.go:103 +0x1ed

k8s.io/minikube/test/integration.TestCertExpiration(0xc002aa01a0)

	/mnt/disks/sdb/jenkins/go/src/k8s.io/minikube/test/integration/cert_options_test.go:123 +0x2d7

testing.tRunner(0xc002aa01a0, 0x3b43350)

	/usr/local/go/src/testing/testing.go:1595 +0xff

created by testing.(*T).Run in goroutine 1

	/usr/local/go/src/testing/testing.go:1648 +0x3ad

goroutine 1183 [select, 108 minutes]:

net/http.(*persistConn).writeLoop(0xc002564a20)

	/usr/local/go/src/net/http/transport.go:2421 +0xe5

created by net/http.(*Transport).dialConn in goroutine 1198

	/usr/local/go/src/net/http/transport.go:1777 +0x16f1

goroutine 2079 [IO wait]:

internal/poll.runtime_pollWait(0x4cac0168, 0x72)

	/usr/local/go/src/runtime/netpoll.go:343 +0x85

internal/poll.(*pollDesc).wait(0xc00275c060?, 0xc000671ad3?, 0x1)

	/usr/local/go/src/internal/poll/fd_poll_runtime.go:84 +0x27

internal/poll.(*pollDesc).waitRead(...)

	/usr/local/go/src/internal/poll/fd_poll_runtime.go:89

internal/poll.(*FD).Read(0xc00275c060, {0xc000671ad3, 0x52d, 0x52d})

	/usr/local/go/src/internal/poll/fd_unix.go:164 +0x27a

os.(*File).read(...)

	/usr/local/go/src/os/file_posix.go:29

os.(*File).Read(0xc0004d6090, {0xc000671ad3?, 0xc0027c0668?, 0xc0027c0668?})

	/usr/local/go/src/os/file.go:118 +0x52

bytes.(*Buffer).ReadFrom(0xc00223c240, {0x3f91b00, 0xc0004d6090})

	/usr/local/go/src/bytes/buffer.go:211 +0x98

io.copyBuffer({0x3f91b80, 0xc00223c240}, {0x3f91b00, 0xc0004d6090}, {0x0, 0x0, 0x0})

	/usr/local/go/src/io/io.go:416 +0x147

io.Copy(...)

	/usr/local/go/src/io/io.go:389

os/exec.(*Cmd).writerDescriptor.func1()

	/usr/local/go/src/os/exec/exec.go:560 +0x34

os/exec.(*Cmd).Start.func2(0xc002714a80?)

	/usr/local/go/src/os/exec/exec.go:717 +0x2c

created by os/exec.(*Cmd).Start in goroutine 545

	/usr/local/go/src/os/exec/exec.go:716 +0xa0a

goroutine 1129 [chan send, 108 minutes]:

os/exec.(*Cmd).watchCtx(0xc00256d340, 0xc00256e5a0)

	/usr/local/go/src/os/exec/exec.go:782 +0x3ef

created by os/exec.(*Cmd).Start in goroutine 1128

	/usr/local/go/src/os/exec/exec.go:743 +0x9c9

goroutine 2108 [IO wait, 5 minutes]:

internal/poll.runtime_pollWait(0x4cac0e00, 0x72)

	/usr/local/go/src/runtime/netpoll.go:343 +0x85

internal/poll.(*pollDesc).wait(0xc00275cba0?, 0xc000655800?, 0x1)

	/usr/local/go/src/internal/poll/fd_poll_runtime.go:84 +0x27

internal/poll.(*pollDesc).waitRead(...)

	/usr/local/go/src/internal/poll/fd_poll_runtime.go:89

internal/poll.(*FD).Read(0xc00275cba0, {0xc000655800, 0x200, 0x200})

	/usr/local/go/src/internal/poll/fd_unix.go:164 +0x27a

os.(*File).read(...)

	/usr/local/go/src/os/file_posix.go:29

os.(*File).Read(0xc0004d62c0, {0xc000655800?, 0xc000b55668?, 0xc000b55668?})

	/usr/local/go/src/os/file.go:118 +0x52

bytes.(*Buffer).ReadFrom(0xc00223c600, {0x3f91b00, 0xc0004d62c0})

	/usr/local/go/src/bytes/buffer.go:211 +0x98

io.copyBuffer({0x3f91b80, 0xc00223c600}, {0x3f91b00, 0xc0004d62c0}, {0x0, 0x0, 0x0})

	/usr/local/go/src/io/io.go:416 +0x147

io.Copy(...)

	/usr/local/go/src/io/io.go:389

os/exec.(*Cmd).writerDescriptor.func1()

	/usr/local/go/src/os/exec/exec.go:560 +0x34

os/exec.(*Cmd).Start.func2(0xc002714600?)

	/usr/local/go/src/os/exec/exec.go:717 +0x2c

created by os/exec.(*Cmd).Start in goroutine 512

	/usr/local/go/src/os/exec/exec.go:716 +0xa0a

goroutine 2107 [IO wait, 5 minutes]:

internal/poll.runtime_pollWait(0x4cac0738, 0x72)

	/usr/local/go/src/runtime/netpoll.go:343 +0x85

internal/poll.(*pollDesc).wait(0xc00275cae0?, 0xc0022ef283?, 0x1)

	/usr/local/go/src/internal/poll/fd_poll_runtime.go:84 +0x27

internal/poll.(*pollDesc).waitRead(...)

	/usr/local/go/src/internal/poll/fd_poll_runtime.go:89

internal/poll.(*FD).Read(0xc00275cae0, {0xc0022ef283, 0x57d, 0x57d})

	/usr/local/go/src/internal/poll/fd_unix.go:164 +0x27a

os.(*File).read(...)

	/usr/local/go/src/os/file_posix.go:29

os.(*File).Read(0xc0004d6298, {0xc0022ef283?, 0xc000b03500?, 0xc0027bb668?})

	/usr/local/go/src/os/file.go:118 +0x52

bytes.(*Buffer).ReadFrom(0xc00223c5d0, {0x3f91b00, 0xc0004d6298})

	/usr/local/go/src/bytes/buffer.go:211 +0x98

io.copyBuffer({0x3f91b80, 0xc00223c5d0}, {0x3f91b00, 0xc0004d6298}, {0x0, 0x0, 0x0})

	/usr/local/go/src/io/io.go:416 +0x147

io.Copy(...)

	/usr/local/go/src/io/io.go:389

os/exec.(*Cmd).writerDescriptor.func1()

	/usr/local/go/src/os/exec/exec.go:560 +0x34

os/exec.(*Cmd).Start.func2(0xc002726420?)

	/usr/local/go/src/os/exec/exec.go:717 +0x2c

created by os/exec.(*Cmd).Start in goroutine 512

	/usr/local/go/src/os/exec/exec.go:716 +0xa0a

goroutine 1182 [select, 108 minutes]:

net/http.(*persistConn).readLoop(0xc002564a20)

	/usr/local/go/src/net/http/transport.go:2238 +0xd25

created by net/http.(*Transport).dialConn in goroutine 1198

	/usr/local/go/src/net/http/transport.go:1776 +0x169f

goroutine 1804 [chan receive, 31 minutes]:

testing.(*testContext).waitParallel(0xc000c064b0)

	/usr/local/go/src/testing/testing.go:1715 +0xac

testing.(*T).Parallel(0xc0026876c0)

	/usr/local/go/src/testing/testing.go:1404 +0x219

k8s.io/minikube/test/integration.MaybeParallel(0xc0026876c0)

	/mnt/disks/sdb/jenkins/go/src/k8s.io/minikube/test/integration/helpers_test.go:483 +0x34

k8s.io/minikube/test/integration.TestNetworkPlugins.func1.1(0xc0026876c0)

	/mnt/disks/sdb/jenkins/go/src/k8s.io/minikube/test/integration/net_test.go:106 +0x33c

testing.tRunner(0xc0026876c0, 0xc002844600)

	/usr/local/go/src/testing/testing.go:1595 +0xff

created by testing.(*T).Run in goroutine 1795

	/usr/local/go/src/testing/testing.go:1648 +0x3ad

goroutine 1803 [chan receive, 31 minutes]:

testing.(*testContext).waitParallel(0xc000c064b0)

	/usr/local/go/src/testing/testing.go:1715 +0xac

testing.(*T).Parallel(0xc002687520)

	/usr/local/go/src/testing/testing.go:1404 +0x219

k8s.io/minikube/test/integration.MaybeParallel(0xc002687520)

	/mnt/disks/sdb/jenkins/go/src/k8s.io/minikube/test/integration/helpers_test.go:483 +0x34

k8s.io/minikube/test/integration.TestNetworkPlugins.func1.1(0xc002687520)

	/mnt/disks/sdb/jenkins/go/src/k8s.io/minikube/test/integration/net_test.go:106 +0x33c

testing.tRunner(0xc002687520, 0xc002844580)

	/usr/local/go/src/testing/testing.go:1595 +0xff

created by testing.(*T).Run in goroutine 1795

	/usr/local/go/src/testing/testing.go:1648 +0x3ad

goroutine 1175 [chan send, 108 minutes]:

os/exec.(*Cmd).watchCtx(0xc00261fe40, 0xc002453d40)

	/usr/local/go/src/os/exec/exec.go:782 +0x3ef

created by os/exec.(*Cmd).Start in goroutine 737

	/usr/local/go/src/os/exec/exec.go:743 +0x9c9

goroutine 185 [select]:

k8s.io/client-go/util/workqueue.(*delayingType).waitingLoop(0xc000b03200)

	/var/lib/jenkins/go/pkg/mod/k8s.io/client-go@v0.29.0/util/workqueue/delaying_queue.go:276 +0x305

created by k8s.io/client-go/util/workqueue.newDelayingQueue in goroutine 157

	/var/lib/jenkins/go/pkg/mod/k8s.io/client-go@v0.29.0/util/workqueue/delaying_queue.go:113 +0x21f

goroutine 186 [chan receive, 116 minutes]:

k8s.io/client-go/transport.(*dynamicClientCert).Run(0xc000b07280, 0xc000064f60)

	/var/lib/jenkins/go/pkg/mod/k8s.io/client-go@v0.29.0/transport/cert_rotation.go:147 +0x2a9

created by k8s.io/client-go/transport.(*tlsTransportCache).get in goroutine 157

	/var/lib/jenkins/go/pkg/mod/k8s.io/client-go@v0.29.0/transport/cache.go:122 +0x594

goroutine 1797 [chan receive, 31 minutes]:

testing.(*testContext).waitParallel(0xc000c064b0)

	/usr/local/go/src/testing/testing.go:1715 +0xac

testing.(*T).Parallel(0xc0026869c0)

	/usr/local/go/src/testing/testing.go:1404 +0x219

k8s.io/minikube/test/integration.MaybeParallel(0xc0026869c0)

	/mnt/disks/sdb/jenkins/go/src/k8s.io/minikube/test/integration/helpers_test.go:483 +0x34

k8s.io/minikube/test/integration.TestNetworkPlugins.func1.1(0xc0026869c0)

	/mnt/disks/sdb/jenkins/go/src/k8s.io/minikube/test/integration/net_test.go:106 +0x33c

testing.tRunner(0xc0026869c0, 0xc002844280)

	/usr/local/go/src/testing/testing.go:1595 +0xff

created by testing.(*T).Run in goroutine 1795

	/usr/local/go/src/testing/testing.go:1648 +0x3ad

goroutine 189 [sync.Cond.Wait]:

sync.runtime_notifyListWait(0xc000b07250, 0x2d)

	/usr/local/go/src/runtime/sema.go:527 +0x159

sync.(*Cond).Wait(0x3f8eaf0?)

	/usr/local/go/src/sync/cond.go:70 +0x85

k8s.io/client-go/util/workqueue.(*Type).Get(0xc000b030e0)

	/var/lib/jenkins/go/pkg/mod/k8s.io/client-go@v0.29.0/util/workqueue/queue.go:200 +0x99

k8s.io/client-go/transport.(*dynamicClientCert).processNextWorkItem(0xc000b07280)

	/var/lib/jenkins/go/pkg/mod/k8s.io/client-go@v0.29.0/transport/cert_rotation.go:156 +0x47

k8s.io/client-go/transport.(*dynamicClientCert).runWorker(...)

	/var/lib/jenkins/go/pkg/mod/k8s.io/client-go@v0.29.0/transport/cert_rotation.go:151

k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0x30?)

	/var/lib/jenkins/go/pkg/mod/k8s.io/apimachinery@v0.29.0/pkg/util/wait/backoff.go:226 +0x33

k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0x0?, {0x3f93000, 0xc0006757d0}, 0x1, 0xc000064f60)

	/var/lib/jenkins/go/pkg/mod/k8s.io/apimachinery@v0.29.0/pkg/util/wait/backoff.go:227 +0xaf

k8s.io/apimachinery/pkg/util/wait.JitterUntil(0x0?, 0x3b9aca00, 0x0, 0x0?, 0x0?)

	/var/lib/jenkins/go/pkg/mod/k8s.io/apimachinery@v0.29.0/pkg/util/wait/backoff.go:204 +0x7f

k8s.io/apimachinery/pkg/util/wait.Until(0xc000b55fd0?, 0x15e8c85?, 0xc000b03200?)

	/var/lib/jenkins/go/pkg/mod/k8s.io/apimachinery@v0.29.0/pkg/util/wait/backoff.go:161 +0x1e

created by k8s.io/client-go/transport.(*dynamicClientCert).Run in goroutine 186

	/var/lib/jenkins/go/pkg/mod/k8s.io/client-go@v0.29.0/transport/cert_rotation.go:140 +0x1ef

goroutine 190 [select]:

k8s.io/apimachinery/pkg/util/wait.waitForWithContext({0x3fb5b38, 0xc000064f60}, 0xc00010ef50, 0x0?)

	/var/lib/jenkins/go/pkg/mod/k8s.io/apimachinery@v0.29.0/pkg/util/wait/wait.go:205 +0xd7

k8s.io/apimachinery/pkg/util/wait.poll({0x3fb5b38, 0xc000064f60}, 0x0?, 0x0?, 0x0?)

	/var/lib/jenkins/go/pkg/mod/k8s.io/apimachinery@v0.29.0/pkg/util/wait/poll.go:260 +0x89

k8s.io/apimachinery/pkg/util/wait.PollImmediateUntilWithContext({0x3fb5b38?, 0xc000064f60?}, 0x0?, 0x0?)

	/var/lib/jenkins/go/pkg/mod/k8s.io/apimachinery@v0.29.0/pkg/util/wait/poll.go:200 +0x53

k8s.io/apimachinery/pkg/util/wait.PollImmediateUntil(0x0?, 0x0?, 0x0?)

	/var/lib/jenkins/go/pkg/mod/k8s.io/apimachinery@v0.29.0/pkg/util/wait/poll.go:187 +0x3c

created by k8s.io/client-go/transport.(*dynamicClientCert).Run in goroutine 186

	/var/lib/jenkins/go/pkg/mod/k8s.io/client-go@v0.29.0/transport/cert_rotation.go:142 +0x29a

goroutine 191 [select]:

k8s.io/apimachinery/pkg/util/wait.PollImmediateUntilWithContext.poller.func1.1()

	/var/lib/jenkins/go/pkg/mod/k8s.io/apimachinery@v0.29.0/pkg/util/wait/poll.go:297 +0x1c5

created by k8s.io/apimachinery/pkg/util/wait.PollImmediateUntilWithContext.poller.func1 in goroutine 190

	/var/lib/jenkins/go/pkg/mod/k8s.io/apimachinery@v0.29.0/pkg/util/wait/poll.go:280 +0xc5

goroutine 631 [IO wait, 112 minutes]:

internal/poll.runtime_pollWait(0x4cac0640, 0x72)

	/usr/local/go/src/runtime/netpoll.go:343 +0x85

internal/poll.(*pollDesc).wait(0xc002844100?, 0x0?, 0x0)

	/usr/local/go/src/internal/poll/fd_poll_runtime.go:84 +0x27

internal/poll.(*pollDesc).waitRead(...)

	/usr/local/go/src/internal/poll/fd_poll_runtime.go:89

internal/poll.(*FD).Accept(0xc002844100)

	/usr/local/go/src/internal/poll/fd_unix.go:611 +0x2ac

net.(*netFD).accept(0xc002844100)

	/usr/local/go/src/net/fd_unix.go:172 +0x29

net.(*TCPListener).accept(0xc000689080)

	/usr/local/go/src/net/tcpsock_posix.go:152 +0x1e

net.(*TCPListener).Accept(0xc000689080)

	/usr/local/go/src/net/tcpsock.go:315 +0x30

net/http.(*Server).Serve(0xc00043e1e0, {0x3fa92c0, 0xc000689080})

	/usr/local/go/src/net/http/server.go:3056 +0x364

net/http.(*Server).ListenAndServe(0xc00043e1e0)

	/usr/local/go/src/net/http/server.go:2985 +0x71

k8s.io/minikube/test/integration.startHTTPProxy.func1(0xd?, 0xc000738680)

	/mnt/disks/sdb/jenkins/go/src/k8s.io/minikube/test/integration/functional_test.go:2212 +0x18

created by k8s.io/minikube/test/integration.startHTTPProxy in goroutine 628

	/mnt/disks/sdb/jenkins/go/src/k8s.io/minikube/test/integration/functional_test.go:2211 +0x13a

goroutine 1783 [chan receive, 33 minutes]:

testing.(*testContext).waitParallel(0xc000c064b0)

	/usr/local/go/src/testing/testing.go:1715 +0xac

testing.(*T).Parallel(0xc0021344e0)

	/usr/local/go/src/testing/testing.go:1404 +0x219

k8s.io/minikube/test/integration.MaybeParallel(0xc0021344e0)

	/mnt/disks/sdb/jenkins/go/src/k8s.io/minikube/test/integration/helpers_test.go:483 +0x34

k8s.io/minikube/test/integration.TestStoppedBinaryUpgrade(0xc0021344e0)

	/mnt/disks/sdb/jenkins/go/src/k8s.io/minikube/test/integration/version_upgrade_test.go:156 +0x86

testing.tRunner(0xc0021344e0, 0x3b43488)

	/usr/local/go/src/testing/testing.go:1595 +0xff

created by testing.(*T).Run in goroutine 1

	/usr/local/go/src/testing/testing.go:1648 +0x3ad

goroutine 1692 [chan receive, 33 minutes]:

testing.(*T).Run(0xc002686000, {0x30ed0c9?, 0x497946ea52c?}, 0xc0021ae240)

	/usr/local/go/src/testing/testing.go:1649 +0x3c8

k8s.io/minikube/test/integration.TestNetworkPlugins(0xc002686000)

	/mnt/disks/sdb/jenkins/go/src/k8s.io/minikube/test/integration/net_test.go:52 +0xd4

testing.tRunner(0xc002686000, 0x3b43438)

	/usr/local/go/src/testing/testing.go:1595 +0xff

created by testing.(*T).Run in goroutine 1

	/usr/local/go/src/testing/testing.go:1648 +0x3ad

goroutine 1796 [chan receive, 31 minutes]:

testing.(*testContext).waitParallel(0xc000c064b0)

	/usr/local/go/src/testing/testing.go:1715 +0xac

testing.(*T).Parallel(0xc002686820)

	/usr/local/go/src/testing/testing.go:1404 +0x219

k8s.io/minikube/test/integration.MaybeParallel(0xc002686820)

	/mnt/disks/sdb/jenkins/go/src/k8s.io/minikube/test/integration/helpers_test.go:483 +0x34

k8s.io/minikube/test/integration.TestNetworkPlugins.func1.1(0xc002686820)

	/mnt/disks/sdb/jenkins/go/src/k8s.io/minikube/test/integration/net_test.go:106 +0x33c

testing.tRunner(0xc002686820, 0xc002844000)

	/usr/local/go/src/testing/testing.go:1595 +0xff

created by testing.(*T).Run in goroutine 1795

	/usr/local/go/src/testing/testing.go:1648 +0x3ad

goroutine 1799 [chan receive, 31 minutes]:

testing.(*testContext).waitParallel(0xc000c064b0)

	/usr/local/go/src/testing/testing.go:1715 +0xac

testing.(*T).Parallel(0xc002686d00)

	/usr/local/go/src/testing/testing.go:1404 +0x219

k8s.io/minikube/test/integration.MaybeParallel(0xc002686d00)

	/mnt/disks/sdb/jenkins/go/src/k8s.io/minikube/test/integration/helpers_test.go:483 +0x34

k8s.io/minikube/test/integration.TestNetworkPlugins.func1.1(0xc002686d00)

	/mnt/disks/sdb/jenkins/go/src/k8s.io/minikube/test/integration/net_test.go:106 +0x33c

testing.tRunner(0xc002686d00, 0xc002844380)

	/usr/local/go/src/testing/testing.go:1595 +0xff

created by testing.(*T).Run in goroutine 1795

	/usr/local/go/src/testing/testing.go:1648 +0x3ad

goroutine 1798 [chan receive, 31 minutes]:

testing.(*testContext).waitParallel(0xc000c064b0)

	/usr/local/go/src/testing/testing.go:1715 +0xac

testing.(*T).Parallel(0xc002686b60)

	/usr/local/go/src/testing/testing.go:1404 +0x219

k8s.io/minikube/test/integration.MaybeParallel(0xc002686b60)

	/mnt/disks/sdb/jenkins/go/src/k8s.io/minikube/test/integration/helpers_test.go:483 +0x34

k8s.io/minikube/test/integration.TestNetworkPlugins.func1.1(0xc002686b60)

	/mnt/disks/sdb/jenkins/go/src/k8s.io/minikube/test/integration/net_test.go:106 +0x33c

testing.tRunner(0xc002686b60, 0xc002844300)

	/usr/local/go/src/testing/testing.go:1595 +0xff

created by testing.(*T).Run in goroutine 1795

	/usr/local/go/src/testing/testing.go:1648 +0x3ad

goroutine 2109 [select, 5 minutes]:

os/exec.(*Cmd).watchCtx(0xc0022426e0, 0xc0027264e0)

	/usr/local/go/src/os/exec/exec.go:757 +0xb5

created by os/exec.(*Cmd).Start in goroutine 512

	/usr/local/go/src/os/exec/exec.go:743 +0x9c9

goroutine 1800 [chan receive, 31 minutes]:

testing.(*testContext).waitParallel(0xc000c064b0)

	/usr/local/go/src/testing/testing.go:1715 +0xac

testing.(*T).Parallel(0xc002686ea0)

	/usr/local/go/src/testing/testing.go:1404 +0x219

k8s.io/minikube/test/integration.MaybeParallel(0xc002686ea0)

	/mnt/disks/sdb/jenkins/go/src/k8s.io/minikube/test/integration/helpers_test.go:483 +0x34

k8s.io/minikube/test/integration.TestNetworkPlugins.func1.1(0xc002686ea0)

	/mnt/disks/sdb/jenkins/go/src/k8s.io/minikube/test/integration/net_test.go:106 +0x33c

testing.tRunner(0xc002686ea0, 0xc002844400)

	/usr/local/go/src/testing/testing.go:1595 +0xff

created by testing.(*T).Run in goroutine 1795

	/usr/local/go/src/testing/testing.go:1648 +0x3ad

goroutine 1795 [chan receive, 31 minutes]:

testing.tRunner.func1()

	/usr/local/go/src/testing/testing.go:1561 +0x489

testing.tRunner(0xc0026861a0, 0xc0021ae240)

	/usr/local/go/src/testing/testing.go:1601 +0x138

created by testing.(*T).Run in goroutine 1692

	/usr/local/go/src/testing/testing.go:1648 +0x3ad

goroutine 1694 [chan receive, 33 minutes]:

testing.(*testContext).waitParallel(0xc000c064b0)

	/usr/local/go/src/testing/testing.go:1715 +0xac

testing.(*T).Parallel(0xc0026864e0)

	/usr/local/go/src/testing/testing.go:1404 +0x219

k8s.io/minikube/test/integration.MaybeParallel(0xc0026864e0)

	/mnt/disks/sdb/jenkins/go/src/k8s.io/minikube/test/integration/helpers_test.go:483 +0x34

k8s.io/minikube/test/integration.TestPause(0xc0026864e0)

	/mnt/disks/sdb/jenkins/go/src/k8s.io/minikube/test/integration/pause_test.go:33 +0x2b

testing.tRunner(0xc0026864e0, 0x3b43450)

	/usr/local/go/src/testing/testing.go:1595 +0xff

created by testing.(*T).Run in goroutine 1

	/usr/local/go/src/testing/testing.go:1648 +0x3ad

goroutine 1005 [chan send, 108 minutes]:

os/exec.(*Cmd).watchCtx(0xc0021b09a0, 0xc0023d6d80)

	/usr/local/go/src/os/exec/exec.go:782 +0x3ef

created by os/exec.(*Cmd).Start in goroutine 1004

	/usr/local/go/src/os/exec/exec.go:743 +0x9c9

goroutine 1782 [chan receive, 33 minutes]:

testing.(*testContext).waitParallel(0xc000c064b0)

	/usr/local/go/src/testing/testing.go:1715 +0xac

testing.(*T).Parallel(0xc002134340)

	/usr/local/go/src/testing/testing.go:1404 +0x219

k8s.io/minikube/test/integration.MaybeParallel(0xc002134340)

	/mnt/disks/sdb/jenkins/go/src/k8s.io/minikube/test/integration/helpers_test.go:483 +0x34

k8s.io/minikube/test/integration.TestRunningBinaryUpgrade(0xc002134340)

	/mnt/disks/sdb/jenkins/go/src/k8s.io/minikube/test/integration/version_upgrade_test.go:98 +0x89

testing.tRunner(0xc002134340, 0x3b43460)

	/usr/local/go/src/testing/testing.go:1595 +0xff

created by testing.(*T).Run in goroutine 1

	/usr/local/go/src/testing/testing.go:1648 +0x3ad

goroutine 2097 [select, 6 minutes]:

os/exec.(*Cmd).watchCtx(0xc002242000, 0xc002726060)

	/usr/local/go/src/os/exec/exec.go:757 +0xb5

created by os/exec.(*Cmd).Start in goroutine 545

	/usr/local/go/src/os/exec/exec.go:743 +0x9c9

goroutine 2080 [IO wait]:

internal/poll.runtime_pollWait(0x4cac0358, 0x72)

	/usr/local/go/src/runtime/netpoll.go:343 +0x85

internal/poll.(*pollDesc).wait(0xc00275c120?, 0xc00054d463?, 0x1)

	/usr/local/go/src/internal/poll/fd_poll_runtime.go:84 +0x27

internal/poll.(*pollDesc).waitRead(...)

	/usr/local/go/src/internal/poll/fd_poll_runtime.go:89

internal/poll.(*FD).Read(0xc00275c120, {0xc00054d463, 0x39d, 0x39d})

	/usr/local/go/src/internal/poll/fd_unix.go:164 +0x27a

os.(*File).read(...)

	/usr/local/go/src/os/file_posix.go:29

os.(*File).Read(0xc0004d60c0, {0xc00054d463?, 0xc000114668?, 0xc000114668?})

	/usr/local/go/src/os/file.go:118 +0x52

bytes.(*Buffer).ReadFrom(0xc00223c270, {0x3f91b00, 0xc0004d60c0})

	/usr/local/go/src/bytes/buffer.go:211 +0x98

io.copyBuffer({0x3f91b80, 0xc00223c270}, {0x3f91b00, 0xc0004d60c0}, {0x0, 0x0, 0x0})

	/usr/local/go/src/io/io.go:416 +0x147

io.Copy(...)

	/usr/local/go/src/io/io.go:389

os/exec.(*Cmd).writerDescriptor.func1()

	/usr/local/go/src/os/exec/exec.go:560 +0x34

os/exec.(*Cmd).Start.func2(0xc002714d80?)

	/usr/local/go/src/os/exec/exec.go:717 +0x2c

created by os/exec.(*Cmd).Start in goroutine 545

	/usr/local/go/src/os/exec/exec.go:716 +0xa0a

goroutine 1194 [chan send, 108 minutes]:

os/exec.(*Cmd).watchCtx(0xc00256dce0, 0xc00256ed80)

	/usr/local/go/src/os/exec/exec.go:782 +0x3ef

created by os/exec.(*Cmd).Start in goroutine 1193

	/usr/local/go/src/os/exec/exec.go:743 +0x9c9

goroutine 1785 [chan receive, 33 minutes]:

testing.(*testContext).waitParallel(0xc000c064b0)

	/usr/local/go/src/testing/testing.go:1715 +0xac

testing.(*T).Parallel(0xc002134820)

	/usr/local/go/src/testing/testing.go:1404 +0x219

k8s.io/minikube/test/integration.MaybeParallel(0xc002134820)

	/mnt/disks/sdb/jenkins/go/src/k8s.io/minikube/test/integration/helpers_test.go:483 +0x34

k8s.io/minikube/test/integration.TestMissingContainerUpgrade(0xc002134820)

	/mnt/disks/sdb/jenkins/go/src/k8s.io/minikube/test/integration/version_upgrade_test.go:305 +0xb4

testing.tRunner(0xc002134820, 0x3b43420)

	/usr/local/go/src/testing/testing.go:1595 +0xff

created by testing.(*T).Run in goroutine 1

	/usr/local/go/src/testing/testing.go:1648 +0x3ad

goroutine 836 [select]:

k8s.io/client-go/util/workqueue.(*delayingType).waitingLoop(0xc00280f200)

	/var/lib/jenkins/go/pkg/mod/k8s.io/client-go@v0.29.0/util/workqueue/delaying_queue.go:276 +0x305

created by k8s.io/client-go/util/workqueue.newDelayingQueue in goroutine 750

	/var/lib/jenkins/go/pkg/mod/k8s.io/client-go@v0.29.0/util/workqueue/delaying_queue.go:113 +0x21f

goroutine 868 [select, 5 minutes]:

k8s.io/apimachinery/pkg/util/wait.waitForWithContext({0x3fb5b38, 0xc000064f60}, 0xc00010ff50, 0xc0026577f8?)

	/var/lib/jenkins/go/pkg/mod/k8s.io/apimachinery@v0.29.0/pkg/util/wait/wait.go:205 +0xd7

k8s.io/apimachinery/pkg/util/wait.poll({0x3fb5b38, 0xc000064f60}, 0x1?, 0x1?, 0xc00010ffb8?)

	/var/lib/jenkins/go/pkg/mod/k8s.io/apimachinery@v0.29.0/pkg/util/wait/poll.go:260 +0x89

k8s.io/apimachinery/pkg/util/wait.PollImmediateUntilWithContext({0x3fb5b38?, 0xc000064f60?}, 0x1?, 0x0?)

	/var/lib/jenkins/go/pkg/mod/k8s.io/apimachinery@v0.29.0/pkg/util/wait/poll.go:200 +0x53

k8s.io/apimachinery/pkg/util/wait.PollImmediateUntil(0xc00010ffd0?, 0x117bdc7?, 0xc000b1f020?)

	/var/lib/jenkins/go/pkg/mod/k8s.io/apimachinery@v0.29.0/pkg/util/wait/poll.go:187 +0x3c

created by k8s.io/client-go/transport.(*dynamicClientCert).Run in goroutine 837

	/var/lib/jenkins/go/pkg/mod/k8s.io/client-go@v0.29.0/transport/cert_rotation.go:142 +0x29a

goroutine 867 [sync.Cond.Wait, 5 minutes]:

sync.runtime_notifyListWait(0xc0028a9e50, 0x2b)

	/usr/local/go/src/runtime/sema.go:527 +0x159

sync.(*Cond).Wait(0x3f8eaf0?)

	/usr/local/go/src/sync/cond.go:70 +0x85

k8s.io/client-go/util/workqueue.(*Type).Get(0xc00280f0e0)

	/var/lib/jenkins/go/pkg/mod/k8s.io/client-go@v0.29.0/util/workqueue/queue.go:200 +0x99

k8s.io/client-go/transport.(*dynamicClientCert).processNextWorkItem(0xc0028a9e80)

	/var/lib/jenkins/go/pkg/mod/k8s.io/client-go@v0.29.0/transport/cert_rotation.go:156 +0x47

k8s.io/client-go/transport.(*dynamicClientCert).runWorker(...)

	/var/lib/jenkins/go/pkg/mod/k8s.io/client-go@v0.29.0/transport/cert_rotation.go:151

k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0x30?)

	/var/lib/jenkins/go/pkg/mod/k8s.io/apimachinery@v0.29.0/pkg/util/wait/backoff.go:226 +0x33

k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0x0?, {0x3f93000, 0xc002222a80}, 0x1, 0xc000064f60)

	/var/lib/jenkins/go/pkg/mod/k8s.io/apimachinery@v0.29.0/pkg/util/wait/backoff.go:227 +0xaf

k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc0029f1200?, 0x3b9aca00, 0x0, 0xd0?, 0x104475c?)

	/var/lib/jenkins/go/pkg/mod/k8s.io/apimachinery@v0.29.0/pkg/util/wait/backoff.go:204 +0x7f

k8s.io/apimachinery/pkg/util/wait.Until(0x117bd65?, 0xc0021b1b80?, 0xc000b1f140?)

	/var/lib/jenkins/go/pkg/mod/k8s.io/apimachinery@v0.29.0/pkg/util/wait/backoff.go:161 +0x1e

created by k8s.io/client-go/transport.(*dynamicClientCert).Run in goroutine 837

	/var/lib/jenkins/go/pkg/mod/k8s.io/client-go@v0.29.0/transport/cert_rotation.go:140 +0x1ef

goroutine 869 [select, 5 minutes]:

k8s.io/apimachinery/pkg/util/wait.PollImmediateUntilWithContext.poller.func1.1()

	/var/lib/jenkins/go/pkg/mod/k8s.io/apimachinery@v0.29.0/pkg/util/wait/poll.go:297 +0x1c5

created by k8s.io/apimachinery/pkg/util/wait.PollImmediateUntilWithContext.poller.func1 in goroutine 868

	/var/lib/jenkins/go/pkg/mod/k8s.io/apimachinery@v0.29.0/pkg/util/wait/poll.go:280 +0xc5

goroutine 1760 [chan receive, 33 minutes]:

testing.(*testContext).waitParallel(0xc000c064b0)

	/usr/local/go/src/testing/testing.go:1715 +0xac

testing.(*T).Parallel(0xc002134000)

	/usr/local/go/src/testing/testing.go:1404 +0x219

k8s.io/minikube/test/integration.MaybeParallel(0xc002134000)

	/mnt/disks/sdb/jenkins/go/src/k8s.io/minikube/test/integration/helpers_test.go:483 +0x34

k8s.io/minikube/test/integration.TestStartStop(0xc00084f020?)

	/mnt/disks/sdb/jenkins/go/src/k8s.io/minikube/test/integration/start_stop_delete_test.go:44 +0x18

testing.tRunner(0xc002134000, 0x3b43480)

	/usr/local/go/src/testing/testing.go:1595 +0xff

created by testing.(*T).Run in goroutine 1

	/usr/local/go/src/testing/testing.go:1648 +0x3ad

=== RUN   TestDockerFlags

=== PAUSE TestDockerFlags

=== CONT  TestDockerFlags

docker_test.go:51: (dbg) Run:  out/minikube-darwin-amd64 start -p docker-flags-557000 --cache-images=false --memory=2048 --install-addons=false --wait=false --docker-env=FOO=BAR --docker-env=BAZ=BAT --docker-opt=debug --docker-opt=icc=true --alsologtostderr -v=5 --driver=docker 

E1226 15:28:46.354906    1612 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/17857-1142/.minikube/profiles/addons-914000/client.crt: no such file or directory

E1226 15:29:36.327378    1612 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/17857-1142/.minikube/profiles/functional-155000/client.crt: no such file or directory

E1226 15:33:29.409855    1612 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/17857-1142/.minikube/profiles/addons-914000/client.crt: no such file or directory

E1226 15:33:46.353068    1612 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/17857-1142/.minikube/profiles/addons-914000/client.crt: no such file or directory

E1226 15:34:36.326863    1612 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/17857-1142/.minikube/profiles/functional-155000/client.crt: no such file or directory

docker_test.go:51: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p docker-flags-557000 --cache-images=false --memory=2048 --install-addons=false --wait=false --docker-env=FOO=BAR --docker-env=BAZ=BAT --docker-opt=debug --docker-opt=icc=true --alsologtostderr -v=5 --driver=docker : exit status 52 (12m33.397221942s)

-- stdout --

	* [docker-flags-557000] minikube v1.32.0 on Darwin 14.2.1

	  - MINIKUBE_LOCATION=17857

	  - KUBECONFIG=/Users/jenkins/minikube-integration/17857-1142/kubeconfig

	  - MINIKUBE_BIN=out/minikube-darwin-amd64

	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17857-1142/.minikube

	  - MINIKUBE_FORCE_SYSTEMD=

	* Using the docker driver based on user configuration

	* Using Docker Desktop driver with root privileges

	* Starting control plane node docker-flags-557000 in cluster docker-flags-557000

	* Pulling base image v0.0.42-1703498848-17857 ...

	* Creating docker container (CPUs=2, Memory=2048MB) ...

	* docker "docker-flags-557000" container is missing, will recreate.

	* Creating docker container (CPUs=2, Memory=2048MB) ...

-- /stdout --

** stderr ** 

	I1226 15:25:33.985497    9679 out.go:296] Setting OutFile to fd 1 ...

	I1226 15:25:33.985795    9679 out.go:343] TERM=,COLORTERM=, which probably does not support color

	I1226 15:25:33.985801    9679 out.go:309] Setting ErrFile to fd 2...

	I1226 15:25:33.985805    9679 out.go:343] TERM=,COLORTERM=, which probably does not support color

	I1226 15:25:33.985985    9679 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17857-1142/.minikube/bin

	I1226 15:25:33.987643    9679 out.go:303] Setting JSON to false

	I1226 15:25:34.010915    9679 start.go:128] hostinfo: {"hostname":"MacOS-Agent-3.local","uptime":6903,"bootTime":1703626230,"procs":470,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.2.1","kernelVersion":"23.2.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"bd1c05a8-24a6-5973-aa69-f3c7c66a87ce"}

	W1226 15:25:34.011014    9679 start.go:136] gopshost.Virtualization returned error: not implemented yet

	I1226 15:25:34.032932    9679 out.go:177] * [docker-flags-557000] minikube v1.32.0 on Darwin 14.2.1

	I1226 15:25:34.054678    9679 out.go:177]   - MINIKUBE_LOCATION=17857

	I1226 15:25:34.054774    9679 notify.go:220] Checking for updates...

	I1226 15:25:34.075784    9679 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/17857-1142/kubeconfig

	I1226 15:25:34.097705    9679 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64

	I1226 15:25:34.119673    9679 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I1226 15:25:34.140671    9679 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17857-1142/.minikube

	I1226 15:25:34.161688    9679 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=

	I1226 15:25:34.183460    9679 config.go:182] Loaded profile config "force-systemd-flag-051000": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.28.4

	I1226 15:25:34.183622    9679 driver.go:392] Setting default libvirt URI to qemu:///system

	I1226 15:25:34.243971    9679 docker.go:122] docker version: linux-24.0.7:Docker Desktop 4.26.0 (130397)

	I1226 15:25:34.244131    9679 cli_runner.go:164] Run: docker system info --format "{{json .}}"

	I1226 15:25:34.350468    9679 info.go:266] docker info: {ID:c18f23ef-4e44-410e-b2ce-38db72a58e15 Containers:14 ContainersRunning:1 ContainersPaused:0 ContainersStopped:13 Images:2 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:94 OomKillDisable:false NGoroutines:198 SystemTime:2023-12-26 23:25:34.338787454 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:8 KernelVersion:6.5.11-linuxkit OperatingSystem:Docker Desktop OSType:linux Architecture:x86_64 IndexSe

rverAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:12 MemTotal:6221275136 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy:http.docker.internal:3128 HTTPSProxy:http.docker.internal:3128 NoProxy:hubproxy.docker.internal Name:docker-desktop Labels:[] ExperimentalBuild:false ServerVersion:24.0.7 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:d8f198a4ed8892c764191ef7b3b06d8a2eeb5c7f Expected:d8f198a4ed8892c764191ef7b3b06d8a2eeb5c7f} RuncCommit:{ID:v1.1.10-0-g18a0cb0 Expected:v1.1.10-0-g18a0cb0} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=seccomp,profile=unc

onfined name=cgroupns] ProductLicense: Warnings:[WARNING: daemon is not using the default seccomp profile] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/Users/jenkins/.docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-buildx] ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.12.0-desktop.2] map[Name:compose Path:/Users/jenkins/.docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-compose] ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.23.3-desktop.2] map[Name:dev Path:/Users/jenkins/.docker/cli-plugins/docker-dev SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-dev] ShortDescription:Docker Dev Environments Vendor:Docker Inc. Version:v0.1.0] map[Name:extension Path:/Users/jenkins/.docker/cli-plugins/docker-extension SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-extension] ShortDescription:M

anages Docker extensions Vendor:Docker Inc. Version:v0.2.21] map[Name:feedback Path:/Users/jenkins/.docker/cli-plugins/docker-feedback SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-feedback] ShortDescription:Provide feedback, right in your terminal! Vendor:Docker Inc. Version:0.1] map[Name:init Path:/Users/jenkins/.docker/cli-plugins/docker-init SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-init] ShortDescription:Creates Docker-related starter files for your project Vendor:Docker Inc. Version:v0.1.0-beta.10] map[Name:sbom Path:/Users/jenkins/.docker/cli-plugins/docker-sbom SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-sbom] ShortDescription:View the packaged-based Software Bill Of Materials (SBOM) for an image URL:https://github.com/docker/sbom-cli-plugin Vendor:Anchore Inc. Version:0.6.0] map[Name:scan Path:/Users/jenkins/.docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugin

s/docker-scan] ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.26.0] map[Name:scout Path:/Users/jenkins/.docker/cli-plugins/docker-scout SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-scout] ShortDescription:Docker Scout Vendor:Docker Inc. Version:v1.2.0]] Warnings:<nil>}}

	I1226 15:25:34.372158    9679 out.go:177] * Using the docker driver based on user configuration

	I1226 15:25:34.394089    9679 start.go:298] selected driver: docker

	I1226 15:25:34.394110    9679 start.go:902] validating driver "docker" against <nil>

	I1226 15:25:34.394123    9679 start.go:913] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}

	I1226 15:25:34.398496    9679 cli_runner.go:164] Run: docker system info --format "{{json .}}"

	I1226 15:25:34.505211    9679 info.go:266] docker info: {ID:c18f23ef-4e44-410e-b2ce-38db72a58e15 Containers:14 ContainersRunning:1 ContainersPaused:0 ContainersStopped:13 Images:2 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:94 OomKillDisable:false NGoroutines:198 SystemTime:2023-12-26 23:25:34.494766271 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:8 KernelVersion:6.5.11-linuxkit OperatingSystem:Docker Desktop OSType:linux Architecture:x86_64 IndexSe

rverAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:12 MemTotal:6221275136 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy:http.docker.internal:3128 HTTPSProxy:http.docker.internal:3128 NoProxy:hubproxy.docker.internal Name:docker-desktop Labels:[] ExperimentalBuild:false ServerVersion:24.0.7 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:d8f198a4ed8892c764191ef7b3b06d8a2eeb5c7f Expected:d8f198a4ed8892c764191ef7b3b06d8a2eeb5c7f} RuncCommit:{ID:v1.1.10-0-g18a0cb0 Expected:v1.1.10-0-g18a0cb0} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=seccomp,profile=unc

onfined name=cgroupns] ProductLicense: Warnings:[WARNING: daemon is not using the default seccomp profile] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/Users/jenkins/.docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-buildx] ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.12.0-desktop.2] map[Name:compose Path:/Users/jenkins/.docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-compose] ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.23.3-desktop.2] map[Name:dev Path:/Users/jenkins/.docker/cli-plugins/docker-dev SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-dev] ShortDescription:Docker Dev Environments Vendor:Docker Inc. Version:v0.1.0] map[Name:extension Path:/Users/jenkins/.docker/cli-plugins/docker-extension SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-extension] ShortDescription:M

anages Docker extensions Vendor:Docker Inc. Version:v0.2.21] map[Name:feedback Path:/Users/jenkins/.docker/cli-plugins/docker-feedback SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-feedback] ShortDescription:Provide feedback, right in your terminal! Vendor:Docker Inc. Version:0.1] map[Name:init Path:/Users/jenkins/.docker/cli-plugins/docker-init SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-init] ShortDescription:Creates Docker-related starter files for your project Vendor:Docker Inc. Version:v0.1.0-beta.10] map[Name:sbom Path:/Users/jenkins/.docker/cli-plugins/docker-sbom SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-sbom] ShortDescription:View the packaged-based Software Bill Of Materials (SBOM) for an image URL:https://github.com/docker/sbom-cli-plugin Vendor:Anchore Inc. Version:0.6.0] map[Name:scan Path:/Users/jenkins/.docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugin

s/docker-scan] ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.26.0] map[Name:scout Path:/Users/jenkins/.docker/cli-plugins/docker-scout SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-scout] ShortDescription:Docker Scout Vendor:Docker Inc. Version:v1.2.0]] Warnings:<nil>}}

	I1226 15:25:34.505386    9679 start_flags.go:309] no existing cluster config was found, will generate one from the flags 

	I1226 15:25:34.505570    9679 start_flags.go:926] Waiting for no components: map[apiserver:false apps_running:false default_sa:false extra:false kubelet:false node_ready:false system_pods:false]

	I1226 15:25:34.526731    9679 out.go:177] * Using Docker Desktop driver with root privileges

	I1226 15:25:34.548651    9679 cni.go:84] Creating CNI manager for ""

	I1226 15:25:34.548687    9679 cni.go:158] "docker" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge

	I1226 15:25:34.548715    9679 start_flags.go:318] Found "bridge CNI" CNI - setting NetworkPlugin=cni

	I1226 15:25:34.548729    9679 start_flags.go:323] config:

	{Name:docker-flags-557000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1703498848-17857@sha256:81ae12a49915e4f02aa382dd3758a30a6649e1143c32b3d03309750104577c6c Memory:2048 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[FOO=BAR BAZ=BAT] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[debug icc=true] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:docker-flags-557000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomai

n:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:false EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:false apps_running:false default_sa:false extra:false kubelet:false node_ready:false system_pods:false] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0

s GPUs:}

	I1226 15:25:34.570506    9679 out.go:177] * Starting control plane node docker-flags-557000 in cluster docker-flags-557000

	I1226 15:25:34.612512    9679 cache.go:121] Beginning downloading kic base image for docker with docker

	I1226 15:25:34.634547    9679 out.go:177] * Pulling base image v0.0.42-1703498848-17857 ...

	I1226 15:25:34.676623    9679 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker

	I1226 15:25:34.676686    9679 preload.go:148] Found local preload: /Users/jenkins/minikube-integration/17857-1142/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4

	I1226 15:25:34.676708    9679 cache.go:56] Caching tarball of preloaded images

	I1226 15:25:34.676718    9679 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1703498848-17857@sha256:81ae12a49915e4f02aa382dd3758a30a6649e1143c32b3d03309750104577c6c in local docker daemon

	I1226 15:25:34.676916    9679 preload.go:174] Found /Users/jenkins/minikube-integration/17857-1142/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4 in cache, skipping download

	I1226 15:25:34.676934    9679 cache.go:59] Finished verifying existence of preloaded tar for  v1.28.4 on docker

	I1226 15:25:34.677141    9679 profile.go:148] Saving config to /Users/jenkins/minikube-integration/17857-1142/.minikube/profiles/docker-flags-557000/config.json ...

	I1226 15:25:34.677819    9679 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/17857-1142/.minikube/profiles/docker-flags-557000/config.json: {Name:mk89cdb8e7e0e69e43c6def0d1f7cb33991eb178 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1226 15:25:34.731660    9679 image.go:83] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1703498848-17857@sha256:81ae12a49915e4f02aa382dd3758a30a6649e1143c32b3d03309750104577c6c in local docker daemon, skipping pull

	I1226 15:25:34.731709    9679 cache.go:144] gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1703498848-17857@sha256:81ae12a49915e4f02aa382dd3758a30a6649e1143c32b3d03309750104577c6c exists in daemon, skipping load

	I1226 15:25:34.731730    9679 cache.go:194] Successfully downloaded all kic artifacts

	I1226 15:25:34.731778    9679 start.go:365] acquiring machines lock for docker-flags-557000: {Name:mk2e5f1835773a2eaa2cfd1b1714af6efc1d6495 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I1226 15:25:34.731937    9679 start.go:369] acquired machines lock for "docker-flags-557000" in 143.231µs

	I1226 15:25:34.731965    9679 start.go:93] Provisioning new machine with config: &{Name:docker-flags-557000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1703498848-17857@sha256:81ae12a49915e4f02aa382dd3758a30a6649e1143c32b3d03309750104577c6c Memory:2048 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[FOO=BAR BAZ=BAT] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[debug icc=true] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:docker-flags-557000 Nam

espace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:false EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:false apps_running:false default_sa:false extra:false kubelet:false node_ready:false system_pods:false] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker B

inaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}

	I1226 15:25:34.732033    9679 start.go:125] createHost starting for "" (driver="docker")

	I1226 15:25:34.754273    9679 out.go:204] * Creating docker container (CPUs=2, Memory=2048MB) ...

	I1226 15:25:34.754673    9679 start.go:159] libmachine.API.Create for "docker-flags-557000" (driver="docker")

	I1226 15:25:34.754726    9679 client.go:168] LocalClient.Create starting

	I1226 15:25:34.754872    9679 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17857-1142/.minikube/certs/ca.pem

	I1226 15:25:34.754958    9679 main.go:141] libmachine: Decoding PEM data...

	I1226 15:25:34.754991    9679 main.go:141] libmachine: Parsing certificate...

	I1226 15:25:34.755087    9679 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17857-1142/.minikube/certs/cert.pem

	I1226 15:25:34.755160    9679 main.go:141] libmachine: Decoding PEM data...

	I1226 15:25:34.755176    9679 main.go:141] libmachine: Parsing certificate...

	I1226 15:25:34.755882    9679 cli_runner.go:164] Run: docker network inspect docker-flags-557000 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"

	W1226 15:25:34.811990    9679 cli_runner.go:211] docker network inspect docker-flags-557000 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1

	I1226 15:25:34.812088    9679 network_create.go:281] running [docker network inspect docker-flags-557000] to gather additional debugging logs...

	I1226 15:25:34.812110    9679 cli_runner.go:164] Run: docker network inspect docker-flags-557000

	W1226 15:25:34.865903    9679 cli_runner.go:211] docker network inspect docker-flags-557000 returned with exit code 1

	I1226 15:25:34.865951    9679 network_create.go:284] error running [docker network inspect docker-flags-557000]: docker network inspect docker-flags-557000: exit status 1

	stdout:

	[]

	stderr:

	Error response from daemon: network docker-flags-557000 not found

	I1226 15:25:34.865971    9679 network_create.go:286] output of [docker network inspect docker-flags-557000]: -- stdout --

	[]

	-- /stdout --

	** stderr ** 

	Error response from daemon: network docker-flags-557000 not found

	** /stderr **

	I1226 15:25:34.866125    9679 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"

	I1226 15:25:34.921821    9679 network.go:212] skipping subnet 192.168.49.0/24 that is reserved: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:<nil>}

	I1226 15:25:34.923510    9679 network.go:212] skipping subnet 192.168.58.0/24 that is reserved: &{IP:192.168.58.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.58.0/24 Gateway:192.168.58.1 ClientMin:192.168.58.2 ClientMax:192.168.58.254 Broadcast:192.168.58.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:<nil>}

	I1226 15:25:34.925116    9679 network.go:212] skipping subnet 192.168.67.0/24 that is reserved: &{IP:192.168.67.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.67.0/24 Gateway:192.168.67.1 ClientMin:192.168.67.2 ClientMax:192.168.67.254 Broadcast:192.168.67.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:<nil>}

	I1226 15:25:34.925469    9679 network.go:209] using free private subnet 192.168.76.0/24: &{IP:192.168.76.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.76.0/24 Gateway:192.168.76.1 ClientMin:192.168.76.2 ClientMax:192.168.76.254 Broadcast:192.168.76.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc002408a20}

	I1226 15:25:34.925484    9679 network_create.go:124] attempt to create docker network docker-flags-557000 192.168.76.0/24 with gateway 192.168.76.1 and MTU of 65535 ...

	I1226 15:25:34.925551    9679 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.76.0/24 --gateway=192.168.76.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=65535 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=docker-flags-557000 docker-flags-557000

	I1226 15:25:35.104822    9679 network_create.go:108] docker network docker-flags-557000 192.168.76.0/24 created

	I1226 15:25:35.104884    9679 kic.go:121] calculated static IP "192.168.76.2" for the "docker-flags-557000" container

	I1226 15:25:35.105010    9679 cli_runner.go:164] Run: docker ps -a --format {{.Names}}

	I1226 15:25:35.163206    9679 cli_runner.go:164] Run: docker volume create docker-flags-557000 --label name.minikube.sigs.k8s.io=docker-flags-557000 --label created_by.minikube.sigs.k8s.io=true

	I1226 15:25:35.218304    9679 oci.go:103] Successfully created a docker volume docker-flags-557000

	I1226 15:25:35.218431    9679 cli_runner.go:164] Run: docker run --rm --name docker-flags-557000-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=docker-flags-557000 --entrypoint /usr/bin/test -v docker-flags-557000:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1703498848-17857@sha256:81ae12a49915e4f02aa382dd3758a30a6649e1143c32b3d03309750104577c6c -d /var/lib

	I1226 15:25:35.598840    9679 oci.go:107] Successfully prepared a docker volume docker-flags-557000

	I1226 15:25:35.598880    9679 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker

	I1226 15:25:35.598893    9679 kic.go:194] Starting extracting preloaded images to volume ...

	I1226 15:25:35.599023    9679 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v /Users/jenkins/minikube-integration/17857-1142/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4:/preloaded.tar:ro -v docker-flags-557000:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1703498848-17857@sha256:81ae12a49915e4f02aa382dd3758a30a6649e1143c32b3d03309750104577c6c -I lz4 -xf /preloaded.tar -C /extractDir

	I1226 15:31:34.753715    9679 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I1226 15:31:34.753854    9679 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" docker-flags-557000

	W1226 15:31:34.811189    9679 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" docker-flags-557000 returned with exit code 1

	I1226 15:31:34.811318    9679 retry.go:31] will retry after 166.290545ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "docker-flags-557000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" docker-flags-557000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: docker-flags-557000

	I1226 15:31:34.978022    9679 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" docker-flags-557000

	W1226 15:31:35.032294    9679 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" docker-flags-557000 returned with exit code 1

	I1226 15:31:35.032408    9679 retry.go:31] will retry after 457.930346ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "docker-flags-557000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" docker-flags-557000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: docker-flags-557000

	I1226 15:31:35.490769    9679 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" docker-flags-557000

	W1226 15:31:35.547670    9679 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" docker-flags-557000 returned with exit code 1

	I1226 15:31:35.547782    9679 retry.go:31] will retry after 794.192737ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "docker-flags-557000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" docker-flags-557000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: docker-flags-557000

	I1226 15:31:36.342551    9679 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" docker-flags-557000

	W1226 15:31:36.397726    9679 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" docker-flags-557000 returned with exit code 1

	W1226 15:31:36.397830    9679 start.go:275] error running df -h /var: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "docker-flags-557000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" docker-flags-557000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: docker-flags-557000

	W1226 15:31:36.397854    9679 start.go:242] error getting percentage of /var that is free: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "docker-flags-557000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" docker-flags-557000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: docker-flags-557000

	I1226 15:31:36.397915    9679 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"

	I1226 15:31:36.397984    9679 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" docker-flags-557000

	W1226 15:31:36.451780    9679 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" docker-flags-557000 returned with exit code 1

	I1226 15:31:36.451893    9679 retry.go:31] will retry after 333.63206ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "docker-flags-557000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" docker-flags-557000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: docker-flags-557000

	I1226 15:31:36.785909    9679 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" docker-flags-557000

	W1226 15:31:36.839766    9679 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" docker-flags-557000 returned with exit code 1

	I1226 15:31:36.839876    9679 retry.go:31] will retry after 510.160753ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "docker-flags-557000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" docker-flags-557000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: docker-flags-557000

	I1226 15:31:37.352363    9679 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" docker-flags-557000

	W1226 15:31:37.405298    9679 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" docker-flags-557000 returned with exit code 1

	I1226 15:31:37.405400    9679 retry.go:31] will retry after 370.475689ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "docker-flags-557000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" docker-flags-557000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: docker-flags-557000

	I1226 15:31:37.776866    9679 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" docker-flags-557000

	W1226 15:31:37.829903    9679 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" docker-flags-557000 returned with exit code 1

	W1226 15:31:37.830003    9679 start.go:290] error running df -BG /var: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "docker-flags-557000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" docker-flags-557000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: docker-flags-557000

	W1226 15:31:37.830026    9679 start.go:247] error getting GiB of /var that is available: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "docker-flags-557000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" docker-flags-557000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: docker-flags-557000

	I1226 15:31:37.830042    9679 start.go:128] duration metric: createHost completed in 6m3.10020056s

	I1226 15:31:37.830049    9679 start.go:83] releasing machines lock for "docker-flags-557000", held for 6m3.100315728s

	W1226 15:31:37.830061    9679 start.go:694] error starting host: creating host: create host timed out in 360.000000 seconds

	I1226 15:31:37.830553    9679 cli_runner.go:164] Run: docker container inspect docker-flags-557000 --format={{.State.Status}}

	W1226 15:31:37.886131    9679 cli_runner.go:211] docker container inspect docker-flags-557000 --format={{.State.Status}} returned with exit code 1

	I1226 15:31:37.886189    9679 delete.go:82] Unable to get host status for docker-flags-557000, assuming it has already been deleted: state: unknown state "docker-flags-557000": docker container inspect docker-flags-557000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: docker-flags-557000

	W1226 15:31:37.886277    9679 out.go:239] ! StartHost failed, but will try again: creating host: create host timed out in 360.000000 seconds

	! StartHost failed, but will try again: creating host: create host timed out in 360.000000 seconds

	I1226 15:31:37.886286    9679 start.go:709] Will try again in 5 seconds ...

	I1226 15:31:42.886534    9679 start.go:365] acquiring machines lock for docker-flags-557000: {Name:mk2e5f1835773a2eaa2cfd1b1714af6efc1d6495 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I1226 15:31:42.887443    9679 start.go:369] acquired machines lock for "docker-flags-557000" in 861.884µs

	I1226 15:31:42.887541    9679 start.go:96] Skipping create...Using existing machine configuration

	I1226 15:31:42.887559    9679 fix.go:54] fixHost starting: 

	I1226 15:31:42.888012    9679 cli_runner.go:164] Run: docker container inspect docker-flags-557000 --format={{.State.Status}}

	W1226 15:31:42.941117    9679 cli_runner.go:211] docker container inspect docker-flags-557000 --format={{.State.Status}} returned with exit code 1

	I1226 15:31:42.941176    9679 fix.go:102] recreateIfNeeded on docker-flags-557000: state= err=unknown state "docker-flags-557000": docker container inspect docker-flags-557000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: docker-flags-557000

	I1226 15:31:42.941207    9679 fix.go:107] machineExists: false. err=machine does not exist

	I1226 15:31:42.962949    9679 out.go:177] * docker "docker-flags-557000" container is missing, will recreate.

	I1226 15:31:43.005535    9679 delete.go:124] DEMOLISHING docker-flags-557000 ...

	I1226 15:31:43.005745    9679 cli_runner.go:164] Run: docker container inspect docker-flags-557000 --format={{.State.Status}}

	W1226 15:31:43.060446    9679 cli_runner.go:211] docker container inspect docker-flags-557000 --format={{.State.Status}} returned with exit code 1

	W1226 15:31:43.060489    9679 stop.go:75] unable to get state: unknown state "docker-flags-557000": docker container inspect docker-flags-557000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: docker-flags-557000

	I1226 15:31:43.060509    9679 delete.go:128] stophost failed (probably ok): ssh power off: unknown state "docker-flags-557000": docker container inspect docker-flags-557000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: docker-flags-557000

	I1226 15:31:43.060907    9679 cli_runner.go:164] Run: docker container inspect docker-flags-557000 --format={{.State.Status}}

	W1226 15:31:43.114306    9679 cli_runner.go:211] docker container inspect docker-flags-557000 --format={{.State.Status}} returned with exit code 1

	I1226 15:31:43.114374    9679 delete.go:82] Unable to get host status for docker-flags-557000, assuming it has already been deleted: state: unknown state "docker-flags-557000": docker container inspect docker-flags-557000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: docker-flags-557000

	I1226 15:31:43.114458    9679 cli_runner.go:164] Run: docker container inspect -f {{.Id}} docker-flags-557000

	W1226 15:31:43.167753    9679 cli_runner.go:211] docker container inspect -f {{.Id}} docker-flags-557000 returned with exit code 1

	I1226 15:31:43.167802    9679 kic.go:371] could not find the container docker-flags-557000 to remove it. will try anyways

	I1226 15:31:43.167941    9679 cli_runner.go:164] Run: docker container inspect docker-flags-557000 --format={{.State.Status}}

	W1226 15:31:43.221137    9679 cli_runner.go:211] docker container inspect docker-flags-557000 --format={{.State.Status}} returned with exit code 1

	W1226 15:31:43.221186    9679 oci.go:84] error getting container status, will try to delete anyways: unknown state "docker-flags-557000": docker container inspect docker-flags-557000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: docker-flags-557000

	I1226 15:31:43.221285    9679 cli_runner.go:164] Run: docker exec --privileged -t docker-flags-557000 /bin/bash -c "sudo init 0"

	W1226 15:31:43.274028    9679 cli_runner.go:211] docker exec --privileged -t docker-flags-557000 /bin/bash -c "sudo init 0" returned with exit code 1

	I1226 15:31:43.274061    9679 oci.go:650] error shutdown docker-flags-557000: docker exec --privileged -t docker-flags-557000 /bin/bash -c "sudo init 0": exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: docker-flags-557000

	I1226 15:31:44.275374    9679 cli_runner.go:164] Run: docker container inspect docker-flags-557000 --format={{.State.Status}}

	W1226 15:31:44.329052    9679 cli_runner.go:211] docker container inspect docker-flags-557000 --format={{.State.Status}} returned with exit code 1

	I1226 15:31:44.329100    9679 oci.go:662] temporary error verifying shutdown: unknown state "docker-flags-557000": docker container inspect docker-flags-557000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: docker-flags-557000

	I1226 15:31:44.329119    9679 oci.go:664] temporary error: container docker-flags-557000 status is  but expect it to be exited

	I1226 15:31:44.329142    9679 retry.go:31] will retry after 673.730334ms: couldn't verify container is exited. %v: unknown state "docker-flags-557000": docker container inspect docker-flags-557000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: docker-flags-557000

	I1226 15:31:45.003836    9679 cli_runner.go:164] Run: docker container inspect docker-flags-557000 --format={{.State.Status}}

	W1226 15:31:45.060747    9679 cli_runner.go:211] docker container inspect docker-flags-557000 --format={{.State.Status}} returned with exit code 1

	I1226 15:31:45.060801    9679 oci.go:662] temporary error verifying shutdown: unknown state "docker-flags-557000": docker container inspect docker-flags-557000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: docker-flags-557000

	I1226 15:31:45.060813    9679 oci.go:664] temporary error: container docker-flags-557000 status is  but expect it to be exited

	I1226 15:31:45.060838    9679 retry.go:31] will retry after 942.949953ms: couldn't verify container is exited. %v: unknown state "docker-flags-557000": docker container inspect docker-flags-557000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: docker-flags-557000

	I1226 15:31:46.004218    9679 cli_runner.go:164] Run: docker container inspect docker-flags-557000 --format={{.State.Status}}

	W1226 15:31:46.059478    9679 cli_runner.go:211] docker container inspect docker-flags-557000 --format={{.State.Status}} returned with exit code 1

	I1226 15:31:46.059537    9679 oci.go:662] temporary error verifying shutdown: unknown state "docker-flags-557000": docker container inspect docker-flags-557000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: docker-flags-557000

	I1226 15:31:46.059547    9679 oci.go:664] temporary error: container docker-flags-557000 status is  but expect it to be exited

	I1226 15:31:46.059589    9679 retry.go:31] will retry after 874.508502ms: couldn't verify container is exited. %v: unknown state "docker-flags-557000": docker container inspect docker-flags-557000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: docker-flags-557000

	I1226 15:31:46.934922    9679 cli_runner.go:164] Run: docker container inspect docker-flags-557000 --format={{.State.Status}}

	W1226 15:31:46.988809    9679 cli_runner.go:211] docker container inspect docker-flags-557000 --format={{.State.Status}} returned with exit code 1

	I1226 15:31:46.988859    9679 oci.go:662] temporary error verifying shutdown: unknown state "docker-flags-557000": docker container inspect docker-flags-557000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: docker-flags-557000

	I1226 15:31:46.988869    9679 oci.go:664] temporary error: container docker-flags-557000 status is  but expect it to be exited

	I1226 15:31:46.988893    9679 retry.go:31] will retry after 1.368224467s: couldn't verify container is exited. %v: unknown state "docker-flags-557000": docker container inspect docker-flags-557000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: docker-flags-557000

	I1226 15:31:48.357501    9679 cli_runner.go:164] Run: docker container inspect docker-flags-557000 --format={{.State.Status}}

	W1226 15:31:48.413221    9679 cli_runner.go:211] docker container inspect docker-flags-557000 --format={{.State.Status}} returned with exit code 1

	I1226 15:31:48.413283    9679 oci.go:662] temporary error verifying shutdown: unknown state "docker-flags-557000": docker container inspect docker-flags-557000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: docker-flags-557000

	I1226 15:31:48.413292    9679 oci.go:664] temporary error: container docker-flags-557000 status is  but expect it to be exited

	I1226 15:31:48.413317    9679 retry.go:31] will retry after 2.734220359s: couldn't verify container is exited. %v: unknown state "docker-flags-557000": docker container inspect docker-flags-557000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: docker-flags-557000

	I1226 15:31:51.148093    9679 cli_runner.go:164] Run: docker container inspect docker-flags-557000 --format={{.State.Status}}

	W1226 15:31:51.202553    9679 cli_runner.go:211] docker container inspect docker-flags-557000 --format={{.State.Status}} returned with exit code 1

	I1226 15:31:51.202601    9679 oci.go:662] temporary error verifying shutdown: unknown state "docker-flags-557000": docker container inspect docker-flags-557000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: docker-flags-557000

	I1226 15:31:51.202612    9679 oci.go:664] temporary error: container docker-flags-557000 status is  but expect it to be exited

	I1226 15:31:51.202639    9679 retry.go:31] will retry after 4.623024987s: couldn't verify container is exited. %v: unknown state "docker-flags-557000": docker container inspect docker-flags-557000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: docker-flags-557000

	I1226 15:31:55.826036    9679 cli_runner.go:164] Run: docker container inspect docker-flags-557000 --format={{.State.Status}}

	W1226 15:31:55.879760    9679 cli_runner.go:211] docker container inspect docker-flags-557000 --format={{.State.Status}} returned with exit code 1

	I1226 15:31:55.879811    9679 oci.go:662] temporary error verifying shutdown: unknown state "docker-flags-557000": docker container inspect docker-flags-557000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: docker-flags-557000

	I1226 15:31:55.879821    9679 oci.go:664] temporary error: container docker-flags-557000 status is  but expect it to be exited

	I1226 15:31:55.879846    9679 retry.go:31] will retry after 4.201358379s: couldn't verify container is exited. %v: unknown state "docker-flags-557000": docker container inspect docker-flags-557000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: docker-flags-557000

	I1226 15:32:00.081487    9679 cli_runner.go:164] Run: docker container inspect docker-flags-557000 --format={{.State.Status}}

	W1226 15:32:00.137439    9679 cli_runner.go:211] docker container inspect docker-flags-557000 --format={{.State.Status}} returned with exit code 1

	I1226 15:32:00.137486    9679 oci.go:662] temporary error verifying shutdown: unknown state "docker-flags-557000": docker container inspect docker-flags-557000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: docker-flags-557000

	I1226 15:32:00.137499    9679 oci.go:664] temporary error: container docker-flags-557000 status is  but expect it to be exited

	I1226 15:32:00.137531    9679 oci.go:88] couldn't shut down docker-flags-557000 (might be okay): verify shutdown: couldn't verify container is exited. %v: unknown state "docker-flags-557000": docker container inspect docker-flags-557000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: docker-flags-557000

	I1226 15:32:00.137609    9679 cli_runner.go:164] Run: docker rm -f -v docker-flags-557000

	I1226 15:32:00.193958    9679 cli_runner.go:164] Run: docker container inspect -f {{.Id}} docker-flags-557000

	W1226 15:32:00.247076    9679 cli_runner.go:211] docker container inspect -f {{.Id}} docker-flags-557000 returned with exit code 1

	I1226 15:32:00.247192    9679 cli_runner.go:164] Run: docker network inspect docker-flags-557000 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"

	I1226 15:32:00.303291    9679 cli_runner.go:164] Run: docker network rm docker-flags-557000

	I1226 15:32:00.406456    9679 fix.go:114] Sleeping 1 second for extra luck!

	I1226 15:32:01.406639    9679 start.go:125] createHost starting for "" (driver="docker")

	I1226 15:32:01.429599    9679 out.go:204] * Creating docker container (CPUs=2, Memory=2048MB) ...

	I1226 15:32:01.429773    9679 start.go:159] libmachine.API.Create for "docker-flags-557000" (driver="docker")

	I1226 15:32:01.429809    9679 client.go:168] LocalClient.Create starting

	I1226 15:32:01.430112    9679 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17857-1142/.minikube/certs/ca.pem

	I1226 15:32:01.430211    9679 main.go:141] libmachine: Decoding PEM data...

	I1226 15:32:01.430239    9679 main.go:141] libmachine: Parsing certificate...

	I1226 15:32:01.430322    9679 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17857-1142/.minikube/certs/cert.pem

	I1226 15:32:01.430390    9679 main.go:141] libmachine: Decoding PEM data...

	I1226 15:32:01.430406    9679 main.go:141] libmachine: Parsing certificate...

	I1226 15:32:01.452187    9679 cli_runner.go:164] Run: docker network inspect docker-flags-557000 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"

	W1226 15:32:01.507621    9679 cli_runner.go:211] docker network inspect docker-flags-557000 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1

	I1226 15:32:01.507729    9679 network_create.go:281] running [docker network inspect docker-flags-557000] to gather additional debugging logs...

	I1226 15:32:01.507751    9679 cli_runner.go:164] Run: docker network inspect docker-flags-557000

	W1226 15:32:01.561623    9679 cli_runner.go:211] docker network inspect docker-flags-557000 returned with exit code 1

	I1226 15:32:01.561669    9679 network_create.go:284] error running [docker network inspect docker-flags-557000]: docker network inspect docker-flags-557000: exit status 1

	stdout:

	[]

	stderr:

	Error response from daemon: network docker-flags-557000 not found

	I1226 15:32:01.561688    9679 network_create.go:286] output of [docker network inspect docker-flags-557000]: -- stdout --

	[]

	-- /stdout --

	** stderr ** 

	Error response from daemon: network docker-flags-557000 not found

	** /stderr **

	I1226 15:32:01.561842    9679 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"

	I1226 15:32:01.617634    9679 network.go:212] skipping subnet 192.168.49.0/24 that is reserved: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:<nil>}

	I1226 15:32:01.619241    9679 network.go:212] skipping subnet 192.168.58.0/24 that is reserved: &{IP:192.168.58.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.58.0/24 Gateway:192.168.58.1 ClientMin:192.168.58.2 ClientMax:192.168.58.254 Broadcast:192.168.58.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:<nil>}

	I1226 15:32:01.620892    9679 network.go:212] skipping subnet 192.168.67.0/24 that is reserved: &{IP:192.168.67.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.67.0/24 Gateway:192.168.67.1 ClientMin:192.168.67.2 ClientMax:192.168.67.254 Broadcast:192.168.67.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:<nil>}

	I1226 15:32:01.622378    9679 network.go:212] skipping subnet 192.168.76.0/24 that is reserved: &{IP:192.168.76.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.76.0/24 Gateway:192.168.76.1 ClientMin:192.168.76.2 ClientMax:192.168.76.254 Broadcast:192.168.76.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:<nil>}

	I1226 15:32:01.623913    9679 network.go:212] skipping subnet 192.168.85.0/24 that is reserved: &{IP:192.168.85.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.85.0/24 Gateway:192.168.85.1 ClientMin:192.168.85.2 ClientMax:192.168.85.254 Broadcast:192.168.85.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:<nil>}

	I1226 15:32:01.624565    9679 network.go:209] using free private subnet 192.168.94.0/24: &{IP:192.168.94.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.94.0/24 Gateway:192.168.94.1 ClientMin:192.168.94.2 ClientMax:192.168.94.254 Broadcast:192.168.94.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc00049df50}

	I1226 15:32:01.624583    9679 network_create.go:124] attempt to create docker network docker-flags-557000 192.168.94.0/24 with gateway 192.168.94.1 and MTU of 65535 ...

	I1226 15:32:01.624716    9679 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.94.0/24 --gateway=192.168.94.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=65535 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=docker-flags-557000 docker-flags-557000

	I1226 15:32:01.716347    9679 network_create.go:108] docker network docker-flags-557000 192.168.94.0/24 created

	I1226 15:32:01.716390    9679 kic.go:121] calculated static IP "192.168.94.2" for the "docker-flags-557000" container

	I1226 15:32:01.716496    9679 cli_runner.go:164] Run: docker ps -a --format {{.Names}}

	I1226 15:32:01.771955    9679 cli_runner.go:164] Run: docker volume create docker-flags-557000 --label name.minikube.sigs.k8s.io=docker-flags-557000 --label created_by.minikube.sigs.k8s.io=true

	I1226 15:32:01.823765    9679 oci.go:103] Successfully created a docker volume docker-flags-557000

	I1226 15:32:01.823891    9679 cli_runner.go:164] Run: docker run --rm --name docker-flags-557000-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=docker-flags-557000 --entrypoint /usr/bin/test -v docker-flags-557000:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1703498848-17857@sha256:81ae12a49915e4f02aa382dd3758a30a6649e1143c32b3d03309750104577c6c -d /var/lib

	I1226 15:32:02.154027    9679 oci.go:107] Successfully prepared a docker volume docker-flags-557000

	I1226 15:32:02.154064    9679 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker

	I1226 15:32:02.154077    9679 kic.go:194] Starting extracting preloaded images to volume ...

	I1226 15:32:02.154185    9679 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v /Users/jenkins/minikube-integration/17857-1142/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4:/preloaded.tar:ro -v docker-flags-557000:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1703498848-17857@sha256:81ae12a49915e4f02aa382dd3758a30a6649e1143c32b3d03309750104577c6c -I lz4 -xf /preloaded.tar -C /extractDir

	I1226 15:38:01.429999    9679 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I1226 15:38:01.430148    9679 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" docker-flags-557000

	W1226 15:38:01.484795    9679 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" docker-flags-557000 returned with exit code 1

	I1226 15:38:01.484902    9679 retry.go:31] will retry after 331.731433ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "docker-flags-557000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" docker-flags-557000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: docker-flags-557000

	I1226 15:38:01.818540    9679 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" docker-flags-557000

	W1226 15:38:01.872114    9679 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" docker-flags-557000 returned with exit code 1

	I1226 15:38:01.872231    9679 retry.go:31] will retry after 445.933536ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "docker-flags-557000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" docker-flags-557000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: docker-flags-557000

	I1226 15:38:02.318577    9679 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" docker-flags-557000

	W1226 15:38:02.372189    9679 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" docker-flags-557000 returned with exit code 1

	I1226 15:38:02.372299    9679 retry.go:31] will retry after 305.635893ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "docker-flags-557000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" docker-flags-557000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: docker-flags-557000

	I1226 15:38:02.678328    9679 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" docker-flags-557000

	W1226 15:38:02.731268    9679 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" docker-flags-557000 returned with exit code 1

	W1226 15:38:02.731369    9679 start.go:275] error running df -h /var: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "docker-flags-557000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" docker-flags-557000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: docker-flags-557000

	W1226 15:38:02.731435    9679 start.go:242] error getting percentage of /var that is free: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "docker-flags-557000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" docker-flags-557000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: docker-flags-557000

	I1226 15:38:02.731518    9679 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"

	I1226 15:38:02.731588    9679 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" docker-flags-557000

	W1226 15:38:02.787477    9679 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" docker-flags-557000 returned with exit code 1

	I1226 15:38:02.787646    9679 retry.go:31] will retry after 274.393149ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "docker-flags-557000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" docker-flags-557000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: docker-flags-557000

	I1226 15:38:03.064068    9679 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" docker-flags-557000

	W1226 15:38:03.126281    9679 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" docker-flags-557000 returned with exit code 1

	I1226 15:38:03.126396    9679 retry.go:31] will retry after 213.441242ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "docker-flags-557000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" docker-flags-557000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: docker-flags-557000

	I1226 15:38:03.340186    9679 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" docker-flags-557000

	W1226 15:38:03.394526    9679 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" docker-flags-557000 returned with exit code 1

	I1226 15:38:03.394624    9679 retry.go:31] will retry after 768.250737ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "docker-flags-557000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" docker-flags-557000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: docker-flags-557000

	I1226 15:38:04.163171    9679 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" docker-flags-557000

	W1226 15:38:04.219290    9679 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" docker-flags-557000 returned with exit code 1

	W1226 15:38:04.219401    9679 start.go:290] error running df -BG /var: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "docker-flags-557000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" docker-flags-557000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: docker-flags-557000

	W1226 15:38:04.219433    9679 start.go:247] error getting GiB of /var that is available: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "docker-flags-557000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" docker-flags-557000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: docker-flags-557000

	I1226 15:38:04.219455    9679 start.go:128] duration metric: createHost completed in 6m2.815004268s

	I1226 15:38:04.219525    9679 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I1226 15:38:04.219582    9679 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" docker-flags-557000

	W1226 15:38:04.272813    9679 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" docker-flags-557000 returned with exit code 1

	I1226 15:38:04.272913    9679 retry.go:31] will retry after 221.085141ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "docker-flags-557000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" docker-flags-557000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: docker-flags-557000

	I1226 15:38:04.495459    9679 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" docker-flags-557000

	W1226 15:38:04.549622    9679 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" docker-flags-557000 returned with exit code 1

	I1226 15:38:04.549722    9679 retry.go:31] will retry after 360.503304ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "docker-flags-557000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" docker-flags-557000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: docker-flags-557000

	I1226 15:38:04.912575    9679 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" docker-flags-557000

	W1226 15:38:04.966786    9679 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" docker-flags-557000 returned with exit code 1

	I1226 15:38:04.966877    9679 retry.go:31] will retry after 508.996795ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "docker-flags-557000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" docker-flags-557000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: docker-flags-557000

	I1226 15:38:05.476607    9679 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" docker-flags-557000

	W1226 15:38:05.530477    9679 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" docker-flags-557000 returned with exit code 1

	W1226 15:38:05.530575    9679 start.go:275] error running df -h /var: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "docker-flags-557000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" docker-flags-557000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: docker-flags-557000

	W1226 15:38:05.530593    9679 start.go:242] error getting percentage of /var that is free: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "docker-flags-557000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" docker-flags-557000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: docker-flags-557000

	I1226 15:38:05.530655    9679 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"

	I1226 15:38:05.530720    9679 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" docker-flags-557000

	W1226 15:38:05.583253    9679 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" docker-flags-557000 returned with exit code 1

	I1226 15:38:05.583371    9679 retry.go:31] will retry after 285.358859ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "docker-flags-557000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" docker-flags-557000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: docker-flags-557000

	I1226 15:38:05.871091    9679 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" docker-flags-557000

	W1226 15:38:05.926297    9679 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" docker-flags-557000 returned with exit code 1

	I1226 15:38:05.926450    9679 retry.go:31] will retry after 505.916616ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "docker-flags-557000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" docker-flags-557000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: docker-flags-557000

	I1226 15:38:06.432835    9679 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" docker-flags-557000

	W1226 15:38:06.487696    9679 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" docker-flags-557000 returned with exit code 1

	I1226 15:38:06.487785    9679 retry.go:31] will retry after 648.481298ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "docker-flags-557000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" docker-flags-557000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: docker-flags-557000

	I1226 15:38:07.137172    9679 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" docker-flags-557000

	W1226 15:38:07.191068    9679 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" docker-flags-557000 returned with exit code 1

	W1226 15:38:07.191170    9679 start.go:290] error running df -BG /var: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "docker-flags-557000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" docker-flags-557000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: docker-flags-557000

	W1226 15:38:07.191187    9679 start.go:247] error getting GiB of /var that is available: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "docker-flags-557000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" docker-flags-557000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: docker-flags-557000

	I1226 15:38:07.191199    9679 fix.go:56] fixHost completed within 6m24.30598288s

	I1226 15:38:07.191205    9679 start.go:83] releasing machines lock for "docker-flags-557000", held for 6m24.306032155s

	W1226 15:38:07.191281    9679 out.go:239] * Failed to start docker container. Running "minikube delete -p docker-flags-557000" may fix it: recreate: creating host: create host timed out in 360.000000 seconds

	* Failed to start docker container. Running "minikube delete -p docker-flags-557000" may fix it: recreate: creating host: create host timed out in 360.000000 seconds

	I1226 15:38:07.234585    9679 out.go:177] 

	W1226 15:38:07.255741    9679 out.go:239] X Exiting due to DRV_CREATE_TIMEOUT: Failed to start host: recreate: creating host: create host timed out in 360.000000 seconds

	X Exiting due to DRV_CREATE_TIMEOUT: Failed to start host: recreate: creating host: create host timed out in 360.000000 seconds

	W1226 15:38:07.255794    9679 out.go:239] * Suggestion: Try 'minikube delete', and disable any conflicting VPN or firewall software

	* Suggestion: Try 'minikube delete', and disable any conflicting VPN or firewall software

	W1226 15:38:07.255844    9679 out.go:239] * Related issue: https://github.com/kubernetes/minikube/issues/7072

	* Related issue: https://github.com/kubernetes/minikube/issues/7072

	I1226 15:38:07.277602    9679 out.go:177] 

** /stderr **

docker_test.go:53: failed to start minikube with args: "out/minikube-darwin-amd64 start -p docker-flags-557000 --cache-images=false --memory=2048 --install-addons=false --wait=false --docker-env=FOO=BAR --docker-env=BAZ=BAT --docker-opt=debug --docker-opt=icc=true --alsologtostderr -v=5 --driver=docker " : exit status 52

docker_test.go:56: (dbg) Run:  out/minikube-darwin-amd64 -p docker-flags-557000 ssh "sudo systemctl show docker --property=Environment --no-pager"

docker_test.go:56: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p docker-flags-557000 ssh "sudo systemctl show docker --property=Environment --no-pager": exit status 80 (209.166927ms)

-- stdout --

-- /stdout --

** stderr ** 

	X Exiting due to GUEST_STATUS: Unable to get machine status: state: unknown state "docker-flags-557000": docker container inspect docker-flags-557000 --format=<no value>: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: docker-flags-557000

	* 

	╭────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                                                        │

	│    * If the above advice does not help, please let us know:                                                            │

	│      https://github.com/kubernetes/minikube/issues/new/choose                                                          │

	│                                                                                                                        │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                               │

	│    * Please also attach the following file to the GitHub issue:                                                        │

	│    * - /var/folders/xd/3vdzn10d2gb_wxr7lj_p8h5c0000gp/T/minikube_ssh_45ab9b4ee43b1ccee1cc1cad42a504b375b49bd8_0.log    │

	│                                                                                                                        │

	╰────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯

** /stderr **

docker_test.go:58: failed to 'systemctl show docker' inside minikube. args "out/minikube-darwin-amd64 -p docker-flags-557000 ssh \"sudo systemctl show docker --property=Environment --no-pager\"": exit status 80

docker_test.go:63: expected env key/value "FOO=BAR" to be passed to minikube's docker and be included in: *"\n\n"*.

docker_test.go:63: expected env key/value "BAZ=BAT" to be passed to minikube's docker and be included in: *"\n\n"*.

docker_test.go:67: (dbg) Run:  out/minikube-darwin-amd64 -p docker-flags-557000 ssh "sudo systemctl show docker --property=ExecStart --no-pager"

docker_test.go:67: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p docker-flags-557000 ssh "sudo systemctl show docker --property=ExecStart --no-pager": exit status 80 (203.130571ms)

-- stdout --

-- /stdout --

** stderr ** 

	X Exiting due to GUEST_STATUS: Unable to get machine status: state: unknown state "docker-flags-557000": docker container inspect docker-flags-557000 --format=<no value>: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: docker-flags-557000

	* 

	╭────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                                                        │

	│    * If the above advice does not help, please let us know:                                                            │

	│      https://github.com/kubernetes/minikube/issues/new/choose                                                          │

	│                                                                                                                        │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                               │

	│    * Please also attach the following file to the GitHub issue:                                                        │

	│    * - /var/folders/xd/3vdzn10d2gb_wxr7lj_p8h5c0000gp/T/minikube_ssh_0c4d48d3465e4cc08ca5bd2bd06b407509a1612b_0.log    │

	│                                                                                                                        │

	╰────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯

** /stderr **

docker_test.go:69: failed on the second 'systemctl show docker' inside minikube. args "out/minikube-darwin-amd64 -p docker-flags-557000 ssh \"sudo systemctl show docker --property=ExecStart --no-pager\"": exit status 80

docker_test.go:73: expected "out/minikube-darwin-amd64 -p docker-flags-557000 ssh \"sudo systemctl show docker --property=ExecStart --no-pager\"" output to have include *--debug* . output: "\n\n"

panic.go:523: *** TestDockerFlags FAILED at 2023-12-26 15:38:07.7457 -0800 PST m=+6852.002943722

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:230: ======>  post-mortem[TestDockerFlags]: docker inspect <======

helpers_test.go:231: (dbg) Run:  docker inspect docker-flags-557000

helpers_test.go:235: (dbg) docker inspect docker-flags-557000:

-- stdout --

	[

	    {

	        "Name": "docker-flags-557000",

	        "Id": "447cf43cea170202e5377fc794fe730bee9c59adc06feb83045d5fa31bec9369",

	        "Created": "2023-12-26T23:32:01.675163569Z",

	        "Scope": "local",

	        "Driver": "bridge",

	        "EnableIPv6": false,

	        "IPAM": {

	            "Driver": "default",

	            "Options": {},

	            "Config": [

	                {

	                    "Subnet": "192.168.94.0/24",

	                    "Gateway": "192.168.94.1"

	                }

	            ]

	        },

	        "Internal": false,

	        "Attachable": false,

	        "Ingress": false,

	        "ConfigFrom": {

	            "Network": ""

	        },

	        "ConfigOnly": false,

	        "Containers": {},

	        "Options": {

	            "--icc": "",

	            "--ip-masq": "",

	            "com.docker.network.driver.mtu": "65535"

	        },

	        "Labels": {

	            "created_by.minikube.sigs.k8s.io": "true",

	            "name.minikube.sigs.k8s.io": "docker-flags-557000"

	        }

	    }

	]

-- /stdout --

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p docker-flags-557000 -n docker-flags-557000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p docker-flags-557000 -n docker-flags-557000: exit status 7 (113.210138ms)

-- stdout --

	Nonexistent

-- /stdout --

** stderr ** 

	E1226 15:38:07.913689   10291 status.go:249] status error: host: state: unknown state "docker-flags-557000": docker container inspect docker-flags-557000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: docker-flags-557000

** /stderr **

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "docker-flags-557000" host is not running, skipping log retrieval (state="Nonexistent")

helpers_test.go:175: Cleaning up "docker-flags-557000" profile ...

helpers_test.go:178: (dbg) Run:  out/minikube-darwin-amd64 delete -p docker-flags-557000

--- FAIL: TestDockerFlags (754.75s)

=== RUN   TestForceSystemdFlag

=== PAUSE TestForceSystemdFlag

=== CONT  TestForceSystemdFlag

docker_test.go:91: (dbg) Run:  out/minikube-darwin-amd64 start -p force-systemd-flag-051000 --memory=2048 --force-systemd --alsologtostderr -v=5 --driver=docker 

docker_test.go:91: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p force-systemd-flag-051000 --memory=2048 --force-systemd --alsologtostderr -v=5 --driver=docker : exit status 52 (12m35.714950544s)

-- stdout --

	* [force-systemd-flag-051000] minikube v1.32.0 on Darwin 14.2.1

	  - MINIKUBE_LOCATION=17857

	  - KUBECONFIG=/Users/jenkins/minikube-integration/17857-1142/kubeconfig

	  - MINIKUBE_BIN=out/minikube-darwin-amd64

	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17857-1142/.minikube

	  - MINIKUBE_FORCE_SYSTEMD=

	* Using the docker driver based on user configuration

	* Using Docker Desktop driver with root privileges

	* Starting control plane node force-systemd-flag-051000 in cluster force-systemd-flag-051000

	* Pulling base image v0.0.42-1703498848-17857 ...

	* Creating docker container (CPUs=2, Memory=2048MB) ...

	* docker "force-systemd-flag-051000" container is missing, will recreate.

	* Creating docker container (CPUs=2, Memory=2048MB) ...

-- /stdout --

** stderr ** 

	I1226 15:24:56.237729    9557 out.go:296] Setting OutFile to fd 1 ...

	I1226 15:24:56.237928    9557 out.go:343] TERM=,COLORTERM=, which probably does not support color

	I1226 15:24:56.237934    9557 out.go:309] Setting ErrFile to fd 2...

	I1226 15:24:56.237939    9557 out.go:343] TERM=,COLORTERM=, which probably does not support color

	I1226 15:24:56.238121    9557 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17857-1142/.minikube/bin

	I1226 15:24:56.239756    9557 out.go:303] Setting JSON to false

	I1226 15:24:56.263638    9557 start.go:128] hostinfo: {"hostname":"MacOS-Agent-3.local","uptime":6866,"bootTime":1703626230,"procs":465,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.2.1","kernelVersion":"23.2.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"bd1c05a8-24a6-5973-aa69-f3c7c66a87ce"}

	W1226 15:24:56.263733    9557 start.go:136] gopshost.Virtualization returned error: not implemented yet

	I1226 15:24:56.292686    9557 out.go:177] * [force-systemd-flag-051000] minikube v1.32.0 on Darwin 14.2.1

	I1226 15:24:56.313714    9557 out.go:177]   - MINIKUBE_LOCATION=17857

	I1226 15:24:56.313809    9557 notify.go:220] Checking for updates...

	I1226 15:24:56.356792    9557 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/17857-1142/kubeconfig

	I1226 15:24:56.377654    9557 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64

	I1226 15:24:56.398718    9557 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I1226 15:24:56.419643    9557 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17857-1142/.minikube

	I1226 15:24:56.440541    9557 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=

	I1226 15:24:56.462619    9557 config.go:182] Loaded profile config "force-systemd-env-026000": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.28.4

	I1226 15:24:56.462780    9557 driver.go:392] Setting default libvirt URI to qemu:///system

	I1226 15:24:56.523591    9557 docker.go:122] docker version: linux-24.0.7:Docker Desktop 4.26.0 (130397)

	I1226 15:24:56.523741    9557 cli_runner.go:164] Run: docker system info --format "{{json .}}"

	I1226 15:24:56.630685    9557 info.go:266] docker info: {ID:c18f23ef-4e44-410e-b2ce-38db72a58e15 Containers:13 ContainersRunning:1 ContainersPaused:0 ContainersStopped:12 Images:2 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:90 OomKillDisable:false NGoroutines:188 SystemTime:2023-12-26 23:24:56.620350799 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:8 KernelVersion:6.5.11-linuxkit OperatingSystem:Docker Desktop OSType:linux Architecture:x86_64 IndexSe

rverAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:12 MemTotal:6221275136 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy:http.docker.internal:3128 HTTPSProxy:http.docker.internal:3128 NoProxy:hubproxy.docker.internal Name:docker-desktop Labels:[] ExperimentalBuild:false ServerVersion:24.0.7 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:d8f198a4ed8892c764191ef7b3b06d8a2eeb5c7f Expected:d8f198a4ed8892c764191ef7b3b06d8a2eeb5c7f} RuncCommit:{ID:v1.1.10-0-g18a0cb0 Expected:v1.1.10-0-g18a0cb0} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=seccomp,profile=unc

onfined name=cgroupns] ProductLicense: Warnings:[WARNING: daemon is not using the default seccomp profile] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/Users/jenkins/.docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-buildx] ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.12.0-desktop.2] map[Name:compose Path:/Users/jenkins/.docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-compose] ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.23.3-desktop.2] map[Name:dev Path:/Users/jenkins/.docker/cli-plugins/docker-dev SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-dev] ShortDescription:Docker Dev Environments Vendor:Docker Inc. Version:v0.1.0] map[Name:extension Path:/Users/jenkins/.docker/cli-plugins/docker-extension SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-extension] ShortDescription:M

anages Docker extensions Vendor:Docker Inc. Version:v0.2.21] map[Name:feedback Path:/Users/jenkins/.docker/cli-plugins/docker-feedback SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-feedback] ShortDescription:Provide feedback, right in your terminal! Vendor:Docker Inc. Version:0.1] map[Name:init Path:/Users/jenkins/.docker/cli-plugins/docker-init SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-init] ShortDescription:Creates Docker-related starter files for your project Vendor:Docker Inc. Version:v0.1.0-beta.10] map[Name:sbom Path:/Users/jenkins/.docker/cli-plugins/docker-sbom SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-sbom] ShortDescription:View the packaged-based Software Bill Of Materials (SBOM) for an image URL:https://github.com/docker/sbom-cli-plugin Vendor:Anchore Inc. Version:0.6.0] map[Name:scan Path:/Users/jenkins/.docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugin

s/docker-scan] ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.26.0] map[Name:scout Path:/Users/jenkins/.docker/cli-plugins/docker-scout SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-scout] ShortDescription:Docker Scout Vendor:Docker Inc. Version:v1.2.0]] Warnings:<nil>}}

	I1226 15:24:56.652368    9557 out.go:177] * Using the docker driver based on user configuration

	I1226 15:24:56.694322    9557 start.go:298] selected driver: docker

	I1226 15:24:56.694371    9557 start.go:902] validating driver "docker" against <nil>

	I1226 15:24:56.694385    9557 start.go:913] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}

	I1226 15:24:56.698791    9557 cli_runner.go:164] Run: docker system info --format "{{json .}}"

	I1226 15:24:56.805026    9557 info.go:266] docker info: {ID:c18f23ef-4e44-410e-b2ce-38db72a58e15 Containers:13 ContainersRunning:1 ContainersPaused:0 ContainersStopped:12 Images:2 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:90 OomKillDisable:false NGoroutines:188 SystemTime:2023-12-26 23:24:56.794548252 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:8 KernelVersion:6.5.11-linuxkit OperatingSystem:Docker Desktop OSType:linux Architecture:x86_64 IndexSe

rverAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:12 MemTotal:6221275136 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy:http.docker.internal:3128 HTTPSProxy:http.docker.internal:3128 NoProxy:hubproxy.docker.internal Name:docker-desktop Labels:[] ExperimentalBuild:false ServerVersion:24.0.7 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:d8f198a4ed8892c764191ef7b3b06d8a2eeb5c7f Expected:d8f198a4ed8892c764191ef7b3b06d8a2eeb5c7f} RuncCommit:{ID:v1.1.10-0-g18a0cb0 Expected:v1.1.10-0-g18a0cb0} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=seccomp,profile=unc

onfined name=cgroupns] ProductLicense: Warnings:[WARNING: daemon is not using the default seccomp profile] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/Users/jenkins/.docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-buildx] ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.12.0-desktop.2] map[Name:compose Path:/Users/jenkins/.docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-compose] ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.23.3-desktop.2] map[Name:dev Path:/Users/jenkins/.docker/cli-plugins/docker-dev SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-dev] ShortDescription:Docker Dev Environments Vendor:Docker Inc. Version:v0.1.0] map[Name:extension Path:/Users/jenkins/.docker/cli-plugins/docker-extension SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-extension] ShortDescription:M

anages Docker extensions Vendor:Docker Inc. Version:v0.2.21] map[Name:feedback Path:/Users/jenkins/.docker/cli-plugins/docker-feedback SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-feedback] ShortDescription:Provide feedback, right in your terminal! Vendor:Docker Inc. Version:0.1] map[Name:init Path:/Users/jenkins/.docker/cli-plugins/docker-init SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-init] ShortDescription:Creates Docker-related starter files for your project Vendor:Docker Inc. Version:v0.1.0-beta.10] map[Name:sbom Path:/Users/jenkins/.docker/cli-plugins/docker-sbom SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-sbom] ShortDescription:View the packaged-based Software Bill Of Materials (SBOM) for an image URL:https://github.com/docker/sbom-cli-plugin Vendor:Anchore Inc. Version:0.6.0] map[Name:scan Path:/Users/jenkins/.docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugin

s/docker-scan] ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.26.0] map[Name:scout Path:/Users/jenkins/.docker/cli-plugins/docker-scout SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-scout] ShortDescription:Docker Scout Vendor:Docker Inc. Version:v1.2.0]] Warnings:<nil>}}

	I1226 15:24:56.805200    9557 start_flags.go:309] no existing cluster config was found, will generate one from the flags 

	I1226 15:24:56.805409    9557 start_flags.go:913] Wait components to verify : map[apiserver:true system_pods:true]

	I1226 15:24:56.826433    9557 out.go:177] * Using Docker Desktop driver with root privileges

	I1226 15:24:56.847256    9557 cni.go:84] Creating CNI manager for ""

	I1226 15:24:56.847291    9557 cni.go:158] "docker" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge

	I1226 15:24:56.847321    9557 start_flags.go:318] Found "bridge CNI" CNI - setting NetworkPlugin=cni

	I1226 15:24:56.847336    9557 start_flags.go:323] config:

	{Name:force-systemd-flag-051000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1703498848-17857@sha256:81ae12a49915e4f02aa382dd3758a30a6649e1143c32b3d03309750104577c6c Memory:2048 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:force-systemd-flag-051000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local C

ontainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:}

	I1226 15:24:56.869237    9557 out.go:177] * Starting control plane node force-systemd-flag-051000 in cluster force-systemd-flag-051000

	I1226 15:24:56.890292    9557 cache.go:121] Beginning downloading kic base image for docker with docker

	I1226 15:24:56.911086    9557 out.go:177] * Pulling base image v0.0.42-1703498848-17857 ...

	I1226 15:24:56.953218    9557 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker

	I1226 15:24:56.953282    9557 preload.go:148] Found local preload: /Users/jenkins/minikube-integration/17857-1142/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4

	I1226 15:24:56.953304    9557 cache.go:56] Caching tarball of preloaded images

	I1226 15:24:56.953317    9557 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1703498848-17857@sha256:81ae12a49915e4f02aa382dd3758a30a6649e1143c32b3d03309750104577c6c in local docker daemon

	I1226 15:24:56.953524    9557 preload.go:174] Found /Users/jenkins/minikube-integration/17857-1142/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4 in cache, skipping download

	I1226 15:24:56.953542    9557 cache.go:59] Finished verifying existence of preloaded tar for  v1.28.4 on docker

	I1226 15:24:56.953648    9557 profile.go:148] Saving config to /Users/jenkins/minikube-integration/17857-1142/.minikube/profiles/force-systemd-flag-051000/config.json ...

	I1226 15:24:56.953680    9557 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/17857-1142/.minikube/profiles/force-systemd-flag-051000/config.json: {Name:mke0c03d0e458b854270047f42e990803f91789b Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1226 15:24:57.009782    9557 image.go:83] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1703498848-17857@sha256:81ae12a49915e4f02aa382dd3758a30a6649e1143c32b3d03309750104577c6c in local docker daemon, skipping pull

	I1226 15:24:57.009831    9557 cache.go:144] gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1703498848-17857@sha256:81ae12a49915e4f02aa382dd3758a30a6649e1143c32b3d03309750104577c6c exists in daemon, skipping load

	I1226 15:24:57.009851    9557 cache.go:194] Successfully downloaded all kic artifacts

	I1226 15:24:57.009915    9557 start.go:365] acquiring machines lock for force-systemd-flag-051000: {Name:mk61e543f3cada2792cbe66c8d45f212f3035bec Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I1226 15:24:57.010085    9557 start.go:369] acquired machines lock for "force-systemd-flag-051000" in 154.913µs

	I1226 15:24:57.010112    9557 start.go:93] Provisioning new machine with config: &{Name:force-systemd-flag-051000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1703498848-17857@sha256:81ae12a49915e4f02aa382dd3758a30a6649e1143c32b3d03309750104577c6c Memory:2048 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:force-systemd-flag-051000 Namespace:default AP

IServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetCli

entPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}

	I1226 15:24:57.010214    9557 start.go:125] createHost starting for "" (driver="docker")

	I1226 15:24:57.031746    9557 out.go:204] * Creating docker container (CPUs=2, Memory=2048MB) ...

	I1226 15:24:57.032137    9557 start.go:159] libmachine.API.Create for "force-systemd-flag-051000" (driver="docker")

	I1226 15:24:57.032212    9557 client.go:168] LocalClient.Create starting

	I1226 15:24:57.032399    9557 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17857-1142/.minikube/certs/ca.pem

	I1226 15:24:57.032485    9557 main.go:141] libmachine: Decoding PEM data...

	I1226 15:24:57.032513    9557 main.go:141] libmachine: Parsing certificate...

	I1226 15:24:57.032616    9557 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17857-1142/.minikube/certs/cert.pem

	I1226 15:24:57.032684    9557 main.go:141] libmachine: Decoding PEM data...

	I1226 15:24:57.032701    9557 main.go:141] libmachine: Parsing certificate...

	I1226 15:24:57.033725    9557 cli_runner.go:164] Run: docker network inspect force-systemd-flag-051000 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"

	W1226 15:24:57.091485    9557 cli_runner.go:211] docker network inspect force-systemd-flag-051000 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1

	I1226 15:24:57.091592    9557 network_create.go:281] running [docker network inspect force-systemd-flag-051000] to gather additional debugging logs...

	I1226 15:24:57.091609    9557 cli_runner.go:164] Run: docker network inspect force-systemd-flag-051000

	W1226 15:24:57.146525    9557 cli_runner.go:211] docker network inspect force-systemd-flag-051000 returned with exit code 1

	I1226 15:24:57.146554    9557 network_create.go:284] error running [docker network inspect force-systemd-flag-051000]: docker network inspect force-systemd-flag-051000: exit status 1

	stdout:

	[]

	stderr:

	Error response from daemon: network force-systemd-flag-051000 not found

	I1226 15:24:57.146568    9557 network_create.go:286] output of [docker network inspect force-systemd-flag-051000]: -- stdout --

	[]

	-- /stdout --

	** stderr ** 

	Error response from daemon: network force-systemd-flag-051000 not found

	** /stderr **

	I1226 15:24:57.146740    9557 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"

	I1226 15:24:57.202075    9557 network.go:212] skipping subnet 192.168.49.0/24 that is reserved: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:<nil>}

	I1226 15:24:57.202530    9557 network.go:209] using free private subnet 192.168.58.0/24: &{IP:192.168.58.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.58.0/24 Gateway:192.168.58.1 ClientMin:192.168.58.2 ClientMax:192.168.58.254 Broadcast:192.168.58.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc0021c1e30}

	I1226 15:24:57.202548    9557 network_create.go:124] attempt to create docker network force-systemd-flag-051000 192.168.58.0/24 with gateway 192.168.58.1 and MTU of 65535 ...

	I1226 15:24:57.202615    9557 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.58.0/24 --gateway=192.168.58.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=65535 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=force-systemd-flag-051000 force-systemd-flag-051000

	W1226 15:24:57.256734    9557 cli_runner.go:211] docker network create --driver=bridge --subnet=192.168.58.0/24 --gateway=192.168.58.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=65535 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=force-systemd-flag-051000 force-systemd-flag-051000 returned with exit code 1

	W1226 15:24:57.256779    9557 network_create.go:149] failed to create docker network force-systemd-flag-051000 192.168.58.0/24 with gateway 192.168.58.1 and mtu of 65535: docker network create --driver=bridge --subnet=192.168.58.0/24 --gateway=192.168.58.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=65535 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=force-systemd-flag-051000 force-systemd-flag-051000: exit status 1

	stdout:

	stderr:

	Error response from daemon: Pool overlaps with other one on this address space

	W1226 15:24:57.256795    9557 network_create.go:116] failed to create docker network force-systemd-flag-051000 192.168.58.0/24, will retry: subnet is taken

	I1226 15:24:57.258212    9557 network.go:212] skipping subnet 192.168.58.0/24 that is reserved: &{IP:192.168.58.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.58.0/24 Gateway:192.168.58.1 ClientMin:192.168.58.2 ClientMax:192.168.58.254 Broadcast:192.168.58.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:<nil>}

	I1226 15:24:57.258583    9557 network.go:209] using free private subnet 192.168.67.0/24: &{IP:192.168.67.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.67.0/24 Gateway:192.168.67.1 ClientMin:192.168.67.2 ClientMax:192.168.67.254 Broadcast:192.168.67.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc0022ee5a0}

	I1226 15:24:57.258597    9557 network_create.go:124] attempt to create docker network force-systemd-flag-051000 192.168.67.0/24 with gateway 192.168.67.1 and MTU of 65535 ...

	I1226 15:24:57.258657    9557 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.67.0/24 --gateway=192.168.67.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=65535 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=force-systemd-flag-051000 force-systemd-flag-051000

	I1226 15:24:57.351604    9557 network_create.go:108] docker network force-systemd-flag-051000 192.168.67.0/24 created

	I1226 15:24:57.351641    9557 kic.go:121] calculated static IP "192.168.67.2" for the "force-systemd-flag-051000" container

	I1226 15:24:57.351771    9557 cli_runner.go:164] Run: docker ps -a --format {{.Names}}

	I1226 15:24:57.409816    9557 cli_runner.go:164] Run: docker volume create force-systemd-flag-051000 --label name.minikube.sigs.k8s.io=force-systemd-flag-051000 --label created_by.minikube.sigs.k8s.io=true

	I1226 15:24:57.464080    9557 oci.go:103] Successfully created a docker volume force-systemd-flag-051000

	I1226 15:24:57.464196    9557 cli_runner.go:164] Run: docker run --rm --name force-systemd-flag-051000-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=force-systemd-flag-051000 --entrypoint /usr/bin/test -v force-systemd-flag-051000:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1703498848-17857@sha256:81ae12a49915e4f02aa382dd3758a30a6649e1143c32b3d03309750104577c6c -d /var/lib

	I1226 15:24:57.852093    9557 oci.go:107] Successfully prepared a docker volume force-systemd-flag-051000

	I1226 15:24:57.852135    9557 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker

	I1226 15:24:57.852148    9557 kic.go:194] Starting extracting preloaded images to volume ...

	I1226 15:24:57.852284    9557 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v /Users/jenkins/minikube-integration/17857-1142/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4:/preloaded.tar:ro -v force-systemd-flag-051000:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1703498848-17857@sha256:81ae12a49915e4f02aa382dd3758a30a6649e1143c32b3d03309750104577c6c -I lz4 -xf /preloaded.tar -C /extractDir

	I1226 15:30:57.030629    9557 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I1226 15:30:57.030766    9557 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-flag-051000

	W1226 15:30:57.084406    9557 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-flag-051000 returned with exit code 1

	I1226 15:30:57.084511    9557 retry.go:31] will retry after 369.203544ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "force-systemd-flag-051000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-flag-051000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: force-systemd-flag-051000

	I1226 15:30:57.455992    9557 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-flag-051000

	W1226 15:30:57.508865    9557 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-flag-051000 returned with exit code 1

	I1226 15:30:57.508984    9557 retry.go:31] will retry after 384.793379ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "force-systemd-flag-051000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-flag-051000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: force-systemd-flag-051000

	I1226 15:30:57.896137    9557 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-flag-051000

	W1226 15:30:57.951661    9557 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-flag-051000 returned with exit code 1

	I1226 15:30:57.951803    9557 retry.go:31] will retry after 828.390513ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "force-systemd-flag-051000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-flag-051000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: force-systemd-flag-051000

	I1226 15:30:58.780904    9557 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-flag-051000

	W1226 15:30:58.835850    9557 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-flag-051000 returned with exit code 1

	W1226 15:30:58.835985    9557 start.go:275] error running df -h /var: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "force-systemd-flag-051000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-flag-051000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: force-systemd-flag-051000

	W1226 15:30:58.836036    9557 start.go:242] error getting percentage of /var that is free: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "force-systemd-flag-051000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-flag-051000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: force-systemd-flag-051000

	I1226 15:30:58.836114    9557 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"

	I1226 15:30:58.836191    9557 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-flag-051000

	W1226 15:30:58.889292    9557 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-flag-051000 returned with exit code 1

	I1226 15:30:58.889388    9557 retry.go:31] will retry after 296.766297ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "force-systemd-flag-051000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-flag-051000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: force-systemd-flag-051000

	I1226 15:30:59.186558    9557 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-flag-051000

	W1226 15:30:59.239729    9557 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-flag-051000 returned with exit code 1

	I1226 15:30:59.239824    9557 retry.go:31] will retry after 536.598248ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "force-systemd-flag-051000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-flag-051000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: force-systemd-flag-051000

	I1226 15:30:59.776822    9557 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-flag-051000

	W1226 15:30:59.830310    9557 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-flag-051000 returned with exit code 1

	I1226 15:30:59.830405    9557 retry.go:31] will retry after 755.500081ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "force-systemd-flag-051000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-flag-051000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: force-systemd-flag-051000

	I1226 15:31:00.586722    9557 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-flag-051000

	W1226 15:31:00.639798    9557 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-flag-051000 returned with exit code 1

	W1226 15:31:00.639914    9557 start.go:290] error running df -BG /var: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "force-systemd-flag-051000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-flag-051000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: force-systemd-flag-051000

	W1226 15:31:00.639931    9557 start.go:247] error getting GiB of /var that is available: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "force-systemd-flag-051000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-flag-051000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: force-systemd-flag-051000

	I1226 15:31:00.639955    9557 start.go:128] duration metric: createHost completed in 6m3.631944134s

	I1226 15:31:00.639985    9557 start.go:83] releasing machines lock for "force-systemd-flag-051000", held for 6m3.632106242s

	W1226 15:31:00.639998    9557 start.go:694] error starting host: creating host: create host timed out in 360.000000 seconds

	I1226 15:31:00.640441    9557 cli_runner.go:164] Run: docker container inspect force-systemd-flag-051000 --format={{.State.Status}}

	W1226 15:31:00.693204    9557 cli_runner.go:211] docker container inspect force-systemd-flag-051000 --format={{.State.Status}} returned with exit code 1

	I1226 15:31:00.693260    9557 delete.go:82] Unable to get host status for force-systemd-flag-051000, assuming it has already been deleted: state: unknown state "force-systemd-flag-051000": docker container inspect force-systemd-flag-051000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: force-systemd-flag-051000

	W1226 15:31:00.693339    9557 out.go:239] ! StartHost failed, but will try again: creating host: create host timed out in 360.000000 seconds

	! StartHost failed, but will try again: creating host: create host timed out in 360.000000 seconds

	I1226 15:31:00.693351    9557 start.go:709] Will try again in 5 seconds ...

	I1226 15:31:05.693480    9557 start.go:365] acquiring machines lock for force-systemd-flag-051000: {Name:mk61e543f3cada2792cbe66c8d45f212f3035bec Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I1226 15:31:05.694244    9557 start.go:369] acquired machines lock for "force-systemd-flag-051000" in 96.289µs

	I1226 15:31:05.694271    9557 start.go:96] Skipping create...Using existing machine configuration

	I1226 15:31:05.694283    9557 fix.go:54] fixHost starting: 

	I1226 15:31:05.694662    9557 cli_runner.go:164] Run: docker container inspect force-systemd-flag-051000 --format={{.State.Status}}

	W1226 15:31:05.748230    9557 cli_runner.go:211] docker container inspect force-systemd-flag-051000 --format={{.State.Status}} returned with exit code 1

	I1226 15:31:05.748279    9557 fix.go:102] recreateIfNeeded on force-systemd-flag-051000: state= err=unknown state "force-systemd-flag-051000": docker container inspect force-systemd-flag-051000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: force-systemd-flag-051000

	I1226 15:31:05.748304    9557 fix.go:107] machineExists: false. err=machine does not exist

	I1226 15:31:05.770021    9557 out.go:177] * docker "force-systemd-flag-051000" container is missing, will recreate.

	I1226 15:31:05.813782    9557 delete.go:124] DEMOLISHING force-systemd-flag-051000 ...

	I1226 15:31:05.813935    9557 cli_runner.go:164] Run: docker container inspect force-systemd-flag-051000 --format={{.State.Status}}

	W1226 15:31:05.868437    9557 cli_runner.go:211] docker container inspect force-systemd-flag-051000 --format={{.State.Status}} returned with exit code 1

	W1226 15:31:05.868536    9557 stop.go:75] unable to get state: unknown state "force-systemd-flag-051000": docker container inspect force-systemd-flag-051000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: force-systemd-flag-051000

	I1226 15:31:05.868578    9557 delete.go:128] stophost failed (probably ok): ssh power off: unknown state "force-systemd-flag-051000": docker container inspect force-systemd-flag-051000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: force-systemd-flag-051000

	I1226 15:31:05.868986    9557 cli_runner.go:164] Run: docker container inspect force-systemd-flag-051000 --format={{.State.Status}}

	W1226 15:31:05.922587    9557 cli_runner.go:211] docker container inspect force-systemd-flag-051000 --format={{.State.Status}} returned with exit code 1

	I1226 15:31:05.922639    9557 delete.go:82] Unable to get host status for force-systemd-flag-051000, assuming it has already been deleted: state: unknown state "force-systemd-flag-051000": docker container inspect force-systemd-flag-051000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: force-systemd-flag-051000

	I1226 15:31:05.922736    9557 cli_runner.go:164] Run: docker container inspect -f {{.Id}} force-systemd-flag-051000

	W1226 15:31:05.977276    9557 cli_runner.go:211] docker container inspect -f {{.Id}} force-systemd-flag-051000 returned with exit code 1

	I1226 15:31:05.977319    9557 kic.go:371] could not find the container force-systemd-flag-051000 to remove it. will try anyways

	I1226 15:31:05.977401    9557 cli_runner.go:164] Run: docker container inspect force-systemd-flag-051000 --format={{.State.Status}}

	W1226 15:31:06.032121    9557 cli_runner.go:211] docker container inspect force-systemd-flag-051000 --format={{.State.Status}} returned with exit code 1

	W1226 15:31:06.032183    9557 oci.go:84] error getting container status, will try to delete anyways: unknown state "force-systemd-flag-051000": docker container inspect force-systemd-flag-051000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: force-systemd-flag-051000

	I1226 15:31:06.032273    9557 cli_runner.go:164] Run: docker exec --privileged -t force-systemd-flag-051000 /bin/bash -c "sudo init 0"

	W1226 15:31:06.085582    9557 cli_runner.go:211] docker exec --privileged -t force-systemd-flag-051000 /bin/bash -c "sudo init 0" returned with exit code 1

	I1226 15:31:06.085620    9557 oci.go:650] error shutdown force-systemd-flag-051000: docker exec --privileged -t force-systemd-flag-051000 /bin/bash -c "sudo init 0": exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: force-systemd-flag-051000

	I1226 15:31:07.086009    9557 cli_runner.go:164] Run: docker container inspect force-systemd-flag-051000 --format={{.State.Status}}

	W1226 15:31:07.139260    9557 cli_runner.go:211] docker container inspect force-systemd-flag-051000 --format={{.State.Status}} returned with exit code 1

	I1226 15:31:07.139326    9557 oci.go:662] temporary error verifying shutdown: unknown state "force-systemd-flag-051000": docker container inspect force-systemd-flag-051000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: force-systemd-flag-051000

	I1226 15:31:07.139340    9557 oci.go:664] temporary error: container force-systemd-flag-051000 status is  but expect it to be exited

	I1226 15:31:07.139366    9557 retry.go:31] will retry after 596.98242ms: couldn't verify container is exited. %v: unknown state "force-systemd-flag-051000": docker container inspect force-systemd-flag-051000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: force-systemd-flag-051000

	I1226 15:31:07.736624    9557 cli_runner.go:164] Run: docker container inspect force-systemd-flag-051000 --format={{.State.Status}}

	W1226 15:31:07.790349    9557 cli_runner.go:211] docker container inspect force-systemd-flag-051000 --format={{.State.Status}} returned with exit code 1

	I1226 15:31:07.790417    9557 oci.go:662] temporary error verifying shutdown: unknown state "force-systemd-flag-051000": docker container inspect force-systemd-flag-051000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: force-systemd-flag-051000

	I1226 15:31:07.790431    9557 oci.go:664] temporary error: container force-systemd-flag-051000 status is  but expect it to be exited

	I1226 15:31:07.790455    9557 retry.go:31] will retry after 1.070605599s: couldn't verify container is exited. %v: unknown state "force-systemd-flag-051000": docker container inspect force-systemd-flag-051000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: force-systemd-flag-051000

	I1226 15:31:08.861385    9557 cli_runner.go:164] Run: docker container inspect force-systemd-flag-051000 --format={{.State.Status}}

	W1226 15:31:08.914051    9557 cli_runner.go:211] docker container inspect force-systemd-flag-051000 --format={{.State.Status}} returned with exit code 1

	I1226 15:31:08.914102    9557 oci.go:662] temporary error verifying shutdown: unknown state "force-systemd-flag-051000": docker container inspect force-systemd-flag-051000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: force-systemd-flag-051000

	I1226 15:31:08.914117    9557 oci.go:664] temporary error: container force-systemd-flag-051000 status is  but expect it to be exited

	I1226 15:31:08.914141    9557 retry.go:31] will retry after 706.328056ms: couldn't verify container is exited. %v: unknown state "force-systemd-flag-051000": docker container inspect force-systemd-flag-051000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: force-systemd-flag-051000

	I1226 15:31:09.621053    9557 cli_runner.go:164] Run: docker container inspect force-systemd-flag-051000 --format={{.State.Status}}

	W1226 15:31:09.674690    9557 cli_runner.go:211] docker container inspect force-systemd-flag-051000 --format={{.State.Status}} returned with exit code 1

	I1226 15:31:09.674744    9557 oci.go:662] temporary error verifying shutdown: unknown state "force-systemd-flag-051000": docker container inspect force-systemd-flag-051000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: force-systemd-flag-051000

	I1226 15:31:09.674758    9557 oci.go:664] temporary error: container force-systemd-flag-051000 status is  but expect it to be exited

	I1226 15:31:09.674782    9557 retry.go:31] will retry after 1.548782327s: couldn't verify container is exited. %v: unknown state "force-systemd-flag-051000": docker container inspect force-systemd-flag-051000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: force-systemd-flag-051000

	I1226 15:31:11.223802    9557 cli_runner.go:164] Run: docker container inspect force-systemd-flag-051000 --format={{.State.Status}}

	W1226 15:31:11.277582    9557 cli_runner.go:211] docker container inspect force-systemd-flag-051000 --format={{.State.Status}} returned with exit code 1

	I1226 15:31:11.277642    9557 oci.go:662] temporary error verifying shutdown: unknown state "force-systemd-flag-051000": docker container inspect force-systemd-flag-051000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: force-systemd-flag-051000

	I1226 15:31:11.277654    9557 oci.go:664] temporary error: container force-systemd-flag-051000 status is  but expect it to be exited

	I1226 15:31:11.277681    9557 retry.go:31] will retry after 3.292487824s: couldn't verify container is exited. %v: unknown state "force-systemd-flag-051000": docker container inspect force-systemd-flag-051000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: force-systemd-flag-051000

	I1226 15:31:14.570903    9557 cli_runner.go:164] Run: docker container inspect force-systemd-flag-051000 --format={{.State.Status}}

	W1226 15:31:14.625525    9557 cli_runner.go:211] docker container inspect force-systemd-flag-051000 --format={{.State.Status}} returned with exit code 1

	I1226 15:31:14.625576    9557 oci.go:662] temporary error verifying shutdown: unknown state "force-systemd-flag-051000": docker container inspect force-systemd-flag-051000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: force-systemd-flag-051000

	I1226 15:31:14.625587    9557 oci.go:664] temporary error: container force-systemd-flag-051000 status is  but expect it to be exited

	I1226 15:31:14.625613    9557 retry.go:31] will retry after 5.013394751s: couldn't verify container is exited. %v: unknown state "force-systemd-flag-051000": docker container inspect force-systemd-flag-051000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: force-systemd-flag-051000

	I1226 15:31:19.640575    9557 cli_runner.go:164] Run: docker container inspect force-systemd-flag-051000 --format={{.State.Status}}

	W1226 15:31:19.694854    9557 cli_runner.go:211] docker container inspect force-systemd-flag-051000 --format={{.State.Status}} returned with exit code 1

	I1226 15:31:19.694901    9557 oci.go:662] temporary error verifying shutdown: unknown state "force-systemd-flag-051000": docker container inspect force-systemd-flag-051000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: force-systemd-flag-051000

	I1226 15:31:19.694912    9557 oci.go:664] temporary error: container force-systemd-flag-051000 status is  but expect it to be exited

	I1226 15:31:19.694938    9557 retry.go:31] will retry after 5.131998564s: couldn't verify container is exited. %v: unknown state "force-systemd-flag-051000": docker container inspect force-systemd-flag-051000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: force-systemd-flag-051000

	I1226 15:31:24.828028    9557 cli_runner.go:164] Run: docker container inspect force-systemd-flag-051000 --format={{.State.Status}}

	W1226 15:31:24.883510    9557 cli_runner.go:211] docker container inspect force-systemd-flag-051000 --format={{.State.Status}} returned with exit code 1

	I1226 15:31:24.883563    9557 oci.go:662] temporary error verifying shutdown: unknown state "force-systemd-flag-051000": docker container inspect force-systemd-flag-051000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: force-systemd-flag-051000

	I1226 15:31:24.883574    9557 oci.go:664] temporary error: container force-systemd-flag-051000 status is  but expect it to be exited

	I1226 15:31:24.883605    9557 oci.go:88] couldn't shut down force-systemd-flag-051000 (might be okay): verify shutdown: couldn't verify container is exited. %v: unknown state "force-systemd-flag-051000": docker container inspect force-systemd-flag-051000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: force-systemd-flag-051000

	I1226 15:31:24.883685    9557 cli_runner.go:164] Run: docker rm -f -v force-systemd-flag-051000

	I1226 15:31:24.935775    9557 cli_runner.go:164] Run: docker container inspect -f {{.Id}} force-systemd-flag-051000

	W1226 15:31:24.988753    9557 cli_runner.go:211] docker container inspect -f {{.Id}} force-systemd-flag-051000 returned with exit code 1

	I1226 15:31:24.988887    9557 cli_runner.go:164] Run: docker network inspect force-systemd-flag-051000 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"

	I1226 15:31:25.043795    9557 cli_runner.go:164] Run: docker network rm force-systemd-flag-051000

	I1226 15:31:25.144725    9557 fix.go:114] Sleeping 1 second for extra luck!

	I1226 15:31:26.144976    9557 start.go:125] createHost starting for "" (driver="docker")

	I1226 15:31:26.168156    9557 out.go:204] * Creating docker container (CPUs=2, Memory=2048MB) ...

	I1226 15:31:26.168347    9557 start.go:159] libmachine.API.Create for "force-systemd-flag-051000" (driver="docker")

	I1226 15:31:26.168421    9557 client.go:168] LocalClient.Create starting

	I1226 15:31:26.168632    9557 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17857-1142/.minikube/certs/ca.pem

	I1226 15:31:26.168721    9557 main.go:141] libmachine: Decoding PEM data...

	I1226 15:31:26.168746    9557 main.go:141] libmachine: Parsing certificate...

	I1226 15:31:26.168824    9557 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17857-1142/.minikube/certs/cert.pem

	I1226 15:31:26.168891    9557 main.go:141] libmachine: Decoding PEM data...

	I1226 15:31:26.168908    9557 main.go:141] libmachine: Parsing certificate...

	I1226 15:31:26.169556    9557 cli_runner.go:164] Run: docker network inspect force-systemd-flag-051000 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"

	W1226 15:31:26.223482    9557 cli_runner.go:211] docker network inspect force-systemd-flag-051000 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1

	I1226 15:31:26.223571    9557 network_create.go:281] running [docker network inspect force-systemd-flag-051000] to gather additional debugging logs...

	I1226 15:31:26.223604    9557 cli_runner.go:164] Run: docker network inspect force-systemd-flag-051000

	W1226 15:31:26.276784    9557 cli_runner.go:211] docker network inspect force-systemd-flag-051000 returned with exit code 1

	I1226 15:31:26.276811    9557 network_create.go:284] error running [docker network inspect force-systemd-flag-051000]: docker network inspect force-systemd-flag-051000: exit status 1

	stdout:

	[]

	stderr:

	Error response from daemon: network force-systemd-flag-051000 not found

	I1226 15:31:26.276829    9557 network_create.go:286] output of [docker network inspect force-systemd-flag-051000]: -- stdout --

	[]

	-- /stdout --

	** stderr ** 

	Error response from daemon: network force-systemd-flag-051000 not found

	** /stderr **

	I1226 15:31:26.276987    9557 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"

	I1226 15:31:26.331275    9557 network.go:212] skipping subnet 192.168.49.0/24 that is reserved: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:<nil>}

	I1226 15:31:26.332683    9557 network.go:212] skipping subnet 192.168.58.0/24 that is reserved: &{IP:192.168.58.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.58.0/24 Gateway:192.168.58.1 ClientMin:192.168.58.2 ClientMax:192.168.58.254 Broadcast:192.168.58.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:<nil>}

	I1226 15:31:26.334215    9557 network.go:212] skipping subnet 192.168.67.0/24 that is reserved: &{IP:192.168.67.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.67.0/24 Gateway:192.168.67.1 ClientMin:192.168.67.2 ClientMax:192.168.67.254 Broadcast:192.168.67.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:<nil>}

	I1226 15:31:26.335601    9557 network.go:212] skipping subnet 192.168.76.0/24 that is reserved: &{IP:192.168.76.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.76.0/24 Gateway:192.168.76.1 ClientMin:192.168.76.2 ClientMax:192.168.76.254 Broadcast:192.168.76.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:<nil>}

	I1226 15:31:26.335945    9557 network.go:209] using free private subnet 192.168.85.0/24: &{IP:192.168.85.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.85.0/24 Gateway:192.168.85.1 ClientMin:192.168.85.2 ClientMax:192.168.85.254 Broadcast:192.168.85.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc00049da40}

	I1226 15:31:26.335960    9557 network_create.go:124] attempt to create docker network force-systemd-flag-051000 192.168.85.0/24 with gateway 192.168.85.1 and MTU of 65535 ...

	I1226 15:31:26.336027    9557 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.85.0/24 --gateway=192.168.85.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=65535 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=force-systemd-flag-051000 force-systemd-flag-051000

	I1226 15:31:26.428656    9557 network_create.go:108] docker network force-systemd-flag-051000 192.168.85.0/24 created

	I1226 15:31:26.428723    9557 kic.go:121] calculated static IP "192.168.85.2" for the "force-systemd-flag-051000" container

	I1226 15:31:26.428845    9557 cli_runner.go:164] Run: docker ps -a --format {{.Names}}

	I1226 15:31:26.486690    9557 cli_runner.go:164] Run: docker volume create force-systemd-flag-051000 --label name.minikube.sigs.k8s.io=force-systemd-flag-051000 --label created_by.minikube.sigs.k8s.io=true

	I1226 15:31:26.540719    9557 oci.go:103] Successfully created a docker volume force-systemd-flag-051000

	I1226 15:31:26.540906    9557 cli_runner.go:164] Run: docker run --rm --name force-systemd-flag-051000-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=force-systemd-flag-051000 --entrypoint /usr/bin/test -v force-systemd-flag-051000:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1703498848-17857@sha256:81ae12a49915e4f02aa382dd3758a30a6649e1143c32b3d03309750104577c6c -d /var/lib

	I1226 15:31:26.847049    9557 oci.go:107] Successfully prepared a docker volume force-systemd-flag-051000

	I1226 15:31:26.847086    9557 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker

	I1226 15:31:26.847098    9557 kic.go:194] Starting extracting preloaded images to volume ...

	I1226 15:31:26.847204    9557 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v /Users/jenkins/minikube-integration/17857-1142/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4:/preloaded.tar:ro -v force-systemd-flag-051000:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1703498848-17857@sha256:81ae12a49915e4f02aa382dd3758a30a6649e1143c32b3d03309750104577c6c -I lz4 -xf /preloaded.tar -C /extractDir

	I1226 15:37:26.166413    9557 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I1226 15:37:26.166486    9557 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-flag-051000

	W1226 15:37:26.218809    9557 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-flag-051000 returned with exit code 1

	I1226 15:37:26.218947    9557 retry.go:31] will retry after 282.185784ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "force-systemd-flag-051000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-flag-051000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: force-systemd-flag-051000

	I1226 15:37:26.501951    9557 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-flag-051000

	W1226 15:37:26.554771    9557 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-flag-051000 returned with exit code 1

	I1226 15:37:26.554875    9557 retry.go:31] will retry after 430.6084ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "force-systemd-flag-051000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-flag-051000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: force-systemd-flag-051000

	I1226 15:37:26.987470    9557 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-flag-051000

	W1226 15:37:27.040534    9557 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-flag-051000 returned with exit code 1

	I1226 15:37:27.040645    9557 retry.go:31] will retry after 348.691132ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "force-systemd-flag-051000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-flag-051000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: force-systemd-flag-051000

	I1226 15:37:27.390555    9557 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-flag-051000

	W1226 15:37:27.447525    9557 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-flag-051000 returned with exit code 1

	W1226 15:37:27.447679    9557 start.go:275] error running df -h /var: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "force-systemd-flag-051000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-flag-051000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: force-systemd-flag-051000

	W1226 15:37:27.447731    9557 start.go:242] error getting percentage of /var that is free: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "force-systemd-flag-051000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-flag-051000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: force-systemd-flag-051000

	I1226 15:37:27.447831    9557 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"

	I1226 15:37:27.447915    9557 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-flag-051000

	W1226 15:37:27.500731    9557 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-flag-051000 returned with exit code 1

	I1226 15:37:27.500835    9557 retry.go:31] will retry after 203.000921ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "force-systemd-flag-051000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-flag-051000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: force-systemd-flag-051000

	I1226 15:37:27.704828    9557 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-flag-051000

	W1226 15:37:27.757798    9557 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-flag-051000 returned with exit code 1

	I1226 15:37:27.757896    9557 retry.go:31] will retry after 356.601672ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "force-systemd-flag-051000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-flag-051000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: force-systemd-flag-051000

	I1226 15:37:28.115066    9557 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-flag-051000

	W1226 15:37:28.169607    9557 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-flag-051000 returned with exit code 1

	I1226 15:37:28.169734    9557 retry.go:31] will retry after 791.025833ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "force-systemd-flag-051000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-flag-051000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: force-systemd-flag-051000

	I1226 15:37:28.962602    9557 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-flag-051000

	W1226 15:37:29.016108    9557 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-flag-051000 returned with exit code 1

	W1226 15:37:29.016213    9557 start.go:290] error running df -BG /var: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "force-systemd-flag-051000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-flag-051000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: force-systemd-flag-051000

	W1226 15:37:29.016232    9557 start.go:247] error getting GiB of /var that is available: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "force-systemd-flag-051000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-flag-051000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: force-systemd-flag-051000

	I1226 15:37:29.016242    9557 start.go:128] duration metric: createHost completed in 6m2.873453916s

	I1226 15:37:29.016311    9557 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I1226 15:37:29.016380    9557 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-flag-051000

	W1226 15:37:29.072505    9557 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-flag-051000 returned with exit code 1

	I1226 15:37:29.072615    9557 retry.go:31] will retry after 193.140496ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "force-systemd-flag-051000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-flag-051000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: force-systemd-flag-051000

	I1226 15:37:29.266563    9557 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-flag-051000

	W1226 15:37:29.320616    9557 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-flag-051000 returned with exit code 1

	I1226 15:37:29.320734    9557 retry.go:31] will retry after 316.319249ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "force-systemd-flag-051000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-flag-051000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: force-systemd-flag-051000

	I1226 15:37:29.637391    9557 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-flag-051000

	W1226 15:37:29.690665    9557 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-flag-051000 returned with exit code 1

	I1226 15:37:29.690782    9557 retry.go:31] will retry after 677.443709ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "force-systemd-flag-051000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-flag-051000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: force-systemd-flag-051000

	I1226 15:37:30.368617    9557 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-flag-051000

	W1226 15:37:30.422181    9557 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-flag-051000 returned with exit code 1

	W1226 15:37:30.422282    9557 start.go:275] error running df -h /var: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "force-systemd-flag-051000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-flag-051000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: force-systemd-flag-051000

	W1226 15:37:30.422301    9557 start.go:242] error getting percentage of /var that is free: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "force-systemd-flag-051000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-flag-051000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: force-systemd-flag-051000

	I1226 15:37:30.422357    9557 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"

	I1226 15:37:30.422442    9557 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-flag-051000

	W1226 15:37:30.474542    9557 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-flag-051000 returned with exit code 1

	I1226 15:37:30.474640    9557 retry.go:31] will retry after 349.059887ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "force-systemd-flag-051000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-flag-051000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: force-systemd-flag-051000

	I1226 15:37:30.823983    9557 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-flag-051000

	W1226 15:37:30.878502    9557 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-flag-051000 returned with exit code 1

	I1226 15:37:30.878600    9557 retry.go:31] will retry after 271.182234ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "force-systemd-flag-051000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-flag-051000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: force-systemd-flag-051000

	I1226 15:37:31.150223    9557 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-flag-051000

	W1226 15:37:31.203257    9557 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-flag-051000 returned with exit code 1

	I1226 15:37:31.203350    9557 retry.go:31] will retry after 458.03672ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "force-systemd-flag-051000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-flag-051000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: force-systemd-flag-051000

	I1226 15:37:31.661761    9557 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-flag-051000

	W1226 15:37:31.713091    9557 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-flag-051000 returned with exit code 1

	W1226 15:37:31.713195    9557 start.go:290] error running df -BG /var: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "force-systemd-flag-051000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-flag-051000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: force-systemd-flag-051000

	W1226 15:37:31.713210    9557 start.go:247] error getting GiB of /var that is available: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "force-systemd-flag-051000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-flag-051000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: force-systemd-flag-051000

	I1226 15:37:31.713227    9557 fix.go:56] fixHost completed within 6m26.021295674s

	I1226 15:37:31.713236    9557 start.go:83] releasing machines lock for "force-systemd-flag-051000", held for 6m26.021332986s

	W1226 15:37:31.713332    9557 out.go:239] * Failed to start docker container. Running "minikube delete -p force-systemd-flag-051000" may fix it: recreate: creating host: create host timed out in 360.000000 seconds

	* Failed to start docker container. Running "minikube delete -p force-systemd-flag-051000" may fix it: recreate: creating host: create host timed out in 360.000000 seconds

	I1226 15:37:31.756449    9557 out.go:177] 

	W1226 15:37:31.785799    9557 out.go:239] X Exiting due to DRV_CREATE_TIMEOUT: Failed to start host: recreate: creating host: create host timed out in 360.000000 seconds

	X Exiting due to DRV_CREATE_TIMEOUT: Failed to start host: recreate: creating host: create host timed out in 360.000000 seconds

	W1226 15:37:31.785902    9557 out.go:239] * Suggestion: Try 'minikube delete', and disable any conflicting VPN or firewall software

	* Suggestion: Try 'minikube delete', and disable any conflicting VPN or firewall software

	W1226 15:37:31.785940    9557 out.go:239] * Related issue: https://github.com/kubernetes/minikube/issues/7072

	* Related issue: https://github.com/kubernetes/minikube/issues/7072

	I1226 15:37:31.826953    9557 out.go:177] 

** /stderr **

docker_test.go:93: failed to start minikube with args: "out/minikube-darwin-amd64 start -p force-systemd-flag-051000 --memory=2048 --force-systemd --alsologtostderr -v=5 --driver=docker " : exit status 52

docker_test.go:110: (dbg) Run:  out/minikube-darwin-amd64 -p force-systemd-flag-051000 ssh "docker info --format {{.CgroupDriver}}"

docker_test.go:110: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p force-systemd-flag-051000 ssh "docker info --format {{.CgroupDriver}}": exit status 80 (203.735112ms)

-- stdout --

-- /stdout --

** stderr ** 

	X Exiting due to GUEST_STATUS: Unable to get machine status: state: unknown state "force-systemd-flag-051000": docker container inspect force-systemd-flag-051000 --format=<no value>: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: force-systemd-flag-051000

	* 

	╭────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                                                        │

	│    * If the above advice does not help, please let us know:                                                            │

	│      https://github.com/kubernetes/minikube/issues/new/choose                                                          │

	│                                                                                                                        │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                               │

	│    * Please also attach the following file to the GitHub issue:                                                        │

	│    * - /var/folders/xd/3vdzn10d2gb_wxr7lj_p8h5c0000gp/T/minikube_ssh_bee0f26250c13d3e98e295459d643952c0091a53_0.log    │

	│                                                                                                                        │

	╰────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯

** /stderr **

docker_test.go:112: failed to get docker cgroup driver. args "out/minikube-darwin-amd64 -p force-systemd-flag-051000 ssh \"docker info --format {{.CgroupDriver}}\"": exit status 80

docker_test.go:106: *** TestForceSystemdFlag FAILED at 2023-12-26 15:37:32.109611 -0800 PST m=+6816.366637393

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:230: ======>  post-mortem[TestForceSystemdFlag]: docker inspect <======

helpers_test.go:231: (dbg) Run:  docker inspect force-systemd-flag-051000

helpers_test.go:235: (dbg) docker inspect force-systemd-flag-051000:

-- stdout --

	[

	    {

	        "Name": "force-systemd-flag-051000",

	        "Id": "0b3bcd7d47e9c6eaa981548df97e8367652e3ad2a531cf288879bb02def52b3e",

	        "Created": "2023-12-26T23:31:26.385799129Z",

	        "Scope": "local",

	        "Driver": "bridge",

	        "EnableIPv6": false,

	        "IPAM": {

	            "Driver": "default",

	            "Options": {},

	            "Config": [

	                {

	                    "Subnet": "192.168.85.0/24",

	                    "Gateway": "192.168.85.1"

	                }

	            ]

	        },

	        "Internal": false,

	        "Attachable": false,

	        "Ingress": false,

	        "ConfigFrom": {

	            "Network": ""

	        },

	        "ConfigOnly": false,

	        "Containers": {},

	        "Options": {

	            "--icc": "",

	            "--ip-masq": "",

	            "com.docker.network.driver.mtu": "65535"

	        },

	        "Labels": {

	            "created_by.minikube.sigs.k8s.io": "true",

	            "name.minikube.sigs.k8s.io": "force-systemd-flag-051000"

	        }

	    }

	]

-- /stdout --

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p force-systemd-flag-051000 -n force-systemd-flag-051000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p force-systemd-flag-051000 -n force-systemd-flag-051000: exit status 7 (113.155457ms)

-- stdout --

	Nonexistent

-- /stdout --

** stderr ** 

	E1226 15:37:32.280042   10167 status.go:249] status error: host: state: unknown state "force-systemd-flag-051000": docker container inspect force-systemd-flag-051000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: force-systemd-flag-051000

** /stderr **

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "force-systemd-flag-051000" host is not running, skipping log retrieval (state="Nonexistent")

helpers_test.go:175: Cleaning up "force-systemd-flag-051000" profile ...

helpers_test.go:178: (dbg) Run:  out/minikube-darwin-amd64 delete -p force-systemd-flag-051000

--- FAIL: TestForceSystemdFlag (756.86s)

=== RUN   TestForceSystemdEnv

=== PAUSE TestForceSystemdEnv

=== CONT  TestForceSystemdEnv

docker_test.go:155: (dbg) Run:  out/minikube-darwin-amd64 start -p force-systemd-env-026000 --memory=2048 --alsologtostderr -v=5 --driver=docker 

E1226 15:13:46.304532    1612 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/17857-1142/.minikube/profiles/addons-914000/client.crt: no such file or directory

E1226 15:14:36.275148    1612 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/17857-1142/.minikube/profiles/functional-155000/client.crt: no such file or directory

E1226 15:16:49.357320    1612 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/17857-1142/.minikube/profiles/addons-914000/client.crt: no such file or directory

E1226 15:18:46.300655    1612 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/17857-1142/.minikube/profiles/addons-914000/client.crt: no such file or directory

E1226 15:19:36.272438    1612 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/17857-1142/.minikube/profiles/functional-155000/client.crt: no such file or directory

E1226 15:22:39.388764    1612 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/17857-1142/.minikube/profiles/functional-155000/client.crt: no such file or directory

E1226 15:23:46.356680    1612 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/17857-1142/.minikube/profiles/addons-914000/client.crt: no such file or directory

E1226 15:24:36.328484    1612 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/17857-1142/.minikube/profiles/functional-155000/client.crt: no such file or directory

docker_test.go:155: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p force-systemd-env-026000 --memory=2048 --alsologtostderr -v=5 --driver=docker : exit status 52 (12m34.869844285s)

-- stdout --

	* [force-systemd-env-026000] minikube v1.32.0 on Darwin 14.2.1

	  - MINIKUBE_LOCATION=17857

	  - KUBECONFIG=/Users/jenkins/minikube-integration/17857-1142/kubeconfig

	  - MINIKUBE_BIN=out/minikube-darwin-amd64

	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17857-1142/.minikube

	  - MINIKUBE_FORCE_SYSTEMD=true

	* Using the docker driver based on user configuration

	* Using Docker Desktop driver with root privileges

	* Starting control plane node force-systemd-env-026000 in cluster force-systemd-env-026000

	* Pulling base image v0.0.42-1703498848-17857 ...

	* Creating docker container (CPUs=2, Memory=2048MB) ...

	* docker "force-systemd-env-026000" container is missing, will recreate.

	* Creating docker container (CPUs=2, Memory=2048MB) ...

-- /stdout --

** stderr ** 

	I1226 15:12:57.915938    9071 out.go:296] Setting OutFile to fd 1 ...

	I1226 15:12:57.916140    9071 out.go:343] TERM=,COLORTERM=, which probably does not support color

	I1226 15:12:57.916147    9071 out.go:309] Setting ErrFile to fd 2...

	I1226 15:12:57.916151    9071 out.go:343] TERM=,COLORTERM=, which probably does not support color

	I1226 15:12:57.916335    9071 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17857-1142/.minikube/bin

	I1226 15:12:57.917960    9071 out.go:303] Setting JSON to false

	I1226 15:12:57.941415    9071 start.go:128] hostinfo: {"hostname":"MacOS-Agent-3.local","uptime":6147,"bootTime":1703626230,"procs":473,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.2.1","kernelVersion":"23.2.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"bd1c05a8-24a6-5973-aa69-f3c7c66a87ce"}

	W1226 15:12:57.941505    9071 start.go:136] gopshost.Virtualization returned error: not implemented yet

	I1226 15:12:57.963321    9071 out.go:177] * [force-systemd-env-026000] minikube v1.32.0 on Darwin 14.2.1

	I1226 15:12:57.984058    9071 out.go:177]   - MINIKUBE_LOCATION=17857

	I1226 15:12:57.984204    9071 notify.go:220] Checking for updates...

	I1226 15:12:58.027907    9071 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/17857-1142/kubeconfig

	I1226 15:12:58.049924    9071 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64

	I1226 15:12:58.070999    9071 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I1226 15:12:58.091949    9071 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17857-1142/.minikube

	I1226 15:12:58.112972    9071 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=true

	I1226 15:12:58.134755    9071 config.go:182] Loaded profile config "offline-docker-595000": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.28.4

	I1226 15:12:58.134911    9071 driver.go:392] Setting default libvirt URI to qemu:///system

	I1226 15:12:58.196725    9071 docker.go:122] docker version: linux-24.0.7:Docker Desktop 4.26.0 (130397)

	I1226 15:12:58.196868    9071 cli_runner.go:164] Run: docker system info --format "{{json .}}"

	I1226 15:12:58.303679    9071 info.go:266] docker info: {ID:c18f23ef-4e44-410e-b2ce-38db72a58e15 Containers:10 ContainersRunning:1 ContainersPaused:0 ContainersStopped:9 Images:2 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:81 OomKillDisable:false NGoroutines:158 SystemTime:2023-12-26 23:12:58.293412123 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:8 KernelVersion:6.5.11-linuxkit OperatingSystem:Docker Desktop OSType:linux Architecture:x86_64 IndexSer

verAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:12 MemTotal:6221275136 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy:http.docker.internal:3128 HTTPSProxy:http.docker.internal:3128 NoProxy:hubproxy.docker.internal Name:docker-desktop Labels:[] ExperimentalBuild:false ServerVersion:24.0.7 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:d8f198a4ed8892c764191ef7b3b06d8a2eeb5c7f Expected:d8f198a4ed8892c764191ef7b3b06d8a2eeb5c7f} RuncCommit:{ID:v1.1.10-0-g18a0cb0 Expected:v1.1.10-0-g18a0cb0} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=seccomp,profile=unco

nfined name=cgroupns] ProductLicense: Warnings:[WARNING: daemon is not using the default seccomp profile] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/Users/jenkins/.docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-buildx] ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.12.0-desktop.2] map[Name:compose Path:/Users/jenkins/.docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-compose] ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.23.3-desktop.2] map[Name:dev Path:/Users/jenkins/.docker/cli-plugins/docker-dev SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-dev] ShortDescription:Docker Dev Environments Vendor:Docker Inc. Version:v0.1.0] map[Name:extension Path:/Users/jenkins/.docker/cli-plugins/docker-extension SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-extension] ShortDescription:Ma

nages Docker extensions Vendor:Docker Inc. Version:v0.2.21] map[Name:feedback Path:/Users/jenkins/.docker/cli-plugins/docker-feedback SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-feedback] ShortDescription:Provide feedback, right in your terminal! Vendor:Docker Inc. Version:0.1] map[Name:init Path:/Users/jenkins/.docker/cli-plugins/docker-init SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-init] ShortDescription:Creates Docker-related starter files for your project Vendor:Docker Inc. Version:v0.1.0-beta.10] map[Name:sbom Path:/Users/jenkins/.docker/cli-plugins/docker-sbom SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-sbom] ShortDescription:View the packaged-based Software Bill Of Materials (SBOM) for an image URL:https://github.com/docker/sbom-cli-plugin Vendor:Anchore Inc. Version:0.6.0] map[Name:scan Path:/Users/jenkins/.docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins

/docker-scan] ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.26.0] map[Name:scout Path:/Users/jenkins/.docker/cli-plugins/docker-scout SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-scout] ShortDescription:Docker Scout Vendor:Docker Inc. Version:v1.2.0]] Warnings:<nil>}}

	I1226 15:12:58.347163    9071 out.go:177] * Using the docker driver based on user configuration

	I1226 15:12:58.368076    9071 start.go:298] selected driver: docker

	I1226 15:12:58.368099    9071 start.go:902] validating driver "docker" against <nil>

	I1226 15:12:58.368113    9071 start.go:913] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}

	I1226 15:12:58.372551    9071 cli_runner.go:164] Run: docker system info --format "{{json .}}"

	I1226 15:12:58.481300    9071 info.go:266] docker info: {ID:c18f23ef-4e44-410e-b2ce-38db72a58e15 Containers:10 ContainersRunning:1 ContainersPaused:0 ContainersStopped:9 Images:2 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:81 OomKillDisable:false NGoroutines:158 SystemTime:2023-12-26 23:12:58.471012831 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:8 KernelVersion:6.5.11-linuxkit OperatingSystem:Docker Desktop OSType:linux Architecture:x86_64 IndexSer

verAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:12 MemTotal:6221275136 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy:http.docker.internal:3128 HTTPSProxy:http.docker.internal:3128 NoProxy:hubproxy.docker.internal Name:docker-desktop Labels:[] ExperimentalBuild:false ServerVersion:24.0.7 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:d8f198a4ed8892c764191ef7b3b06d8a2eeb5c7f Expected:d8f198a4ed8892c764191ef7b3b06d8a2eeb5c7f} RuncCommit:{ID:v1.1.10-0-g18a0cb0 Expected:v1.1.10-0-g18a0cb0} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=seccomp,profile=unco

nfined name=cgroupns] ProductLicense: Warnings:[WARNING: daemon is not using the default seccomp profile] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/Users/jenkins/.docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-buildx] ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.12.0-desktop.2] map[Name:compose Path:/Users/jenkins/.docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-compose] ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.23.3-desktop.2] map[Name:dev Path:/Users/jenkins/.docker/cli-plugins/docker-dev SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-dev] ShortDescription:Docker Dev Environments Vendor:Docker Inc. Version:v0.1.0] map[Name:extension Path:/Users/jenkins/.docker/cli-plugins/docker-extension SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-extension] ShortDescription:Ma

nages Docker extensions Vendor:Docker Inc. Version:v0.2.21] map[Name:feedback Path:/Users/jenkins/.docker/cli-plugins/docker-feedback SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-feedback] ShortDescription:Provide feedback, right in your terminal! Vendor:Docker Inc. Version:0.1] map[Name:init Path:/Users/jenkins/.docker/cli-plugins/docker-init SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-init] ShortDescription:Creates Docker-related starter files for your project Vendor:Docker Inc. Version:v0.1.0-beta.10] map[Name:sbom Path:/Users/jenkins/.docker/cli-plugins/docker-sbom SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-sbom] ShortDescription:View the packaged-based Software Bill Of Materials (SBOM) for an image URL:https://github.com/docker/sbom-cli-plugin Vendor:Anchore Inc. Version:0.6.0] map[Name:scan Path:/Users/jenkins/.docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins

/docker-scan] ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.26.0] map[Name:scout Path:/Users/jenkins/.docker/cli-plugins/docker-scout SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-scout] ShortDescription:Docker Scout Vendor:Docker Inc. Version:v1.2.0]] Warnings:<nil>}}

	I1226 15:12:58.481479    9071 start_flags.go:309] no existing cluster config was found, will generate one from the flags 

	I1226 15:12:58.481682    9071 start_flags.go:913] Wait components to verify : map[apiserver:true system_pods:true]

	I1226 15:12:58.503339    9071 out.go:177] * Using Docker Desktop driver with root privileges

	I1226 15:12:58.524103    9071 cni.go:84] Creating CNI manager for ""

	I1226 15:12:58.524138    9071 cni.go:158] "docker" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge

	I1226 15:12:58.524157    9071 start_flags.go:318] Found "bridge CNI" CNI - setting NetworkPlugin=cni

	I1226 15:12:58.524170    9071 start_flags.go:323] config:

	{Name:force-systemd-env-026000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1703498848-17857@sha256:81ae12a49915e4f02aa382dd3758a30a6649e1143c32b3d03309750104577c6c Memory:2048 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:force-systemd-env-026000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local Con

tainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:}

	I1226 15:12:58.546041    9071 out.go:177] * Starting control plane node force-systemd-env-026000 in cluster force-systemd-env-026000

	I1226 15:12:58.588124    9071 cache.go:121] Beginning downloading kic base image for docker with docker

	I1226 15:12:58.609978    9071 out.go:177] * Pulling base image v0.0.42-1703498848-17857 ...

	I1226 15:12:58.631195    9071 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker

	I1226 15:12:58.631248    9071 preload.go:148] Found local preload: /Users/jenkins/minikube-integration/17857-1142/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4

	I1226 15:12:58.631270    9071 cache.go:56] Caching tarball of preloaded images

	I1226 15:12:58.631268    9071 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1703498848-17857@sha256:81ae12a49915e4f02aa382dd3758a30a6649e1143c32b3d03309750104577c6c in local docker daemon

	I1226 15:12:58.631470    9071 preload.go:174] Found /Users/jenkins/minikube-integration/17857-1142/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4 in cache, skipping download

	I1226 15:12:58.631488    9071 cache.go:59] Finished verifying existence of preloaded tar for  v1.28.4 on docker

	I1226 15:12:58.631655    9071 profile.go:148] Saving config to /Users/jenkins/minikube-integration/17857-1142/.minikube/profiles/force-systemd-env-026000/config.json ...

	I1226 15:12:58.632473    9071 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/17857-1142/.minikube/profiles/force-systemd-env-026000/config.json: {Name:mk315bfd4747657103f1cbe9ccae617424a83a04 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1226 15:12:58.687598    9071 image.go:83] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1703498848-17857@sha256:81ae12a49915e4f02aa382dd3758a30a6649e1143c32b3d03309750104577c6c in local docker daemon, skipping pull

	I1226 15:12:58.687618    9071 cache.go:144] gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1703498848-17857@sha256:81ae12a49915e4f02aa382dd3758a30a6649e1143c32b3d03309750104577c6c exists in daemon, skipping load

	I1226 15:12:58.687838    9071 cache.go:194] Successfully downloaded all kic artifacts

	I1226 15:12:58.687886    9071 start.go:365] acquiring machines lock for force-systemd-env-026000: {Name:mk2d001d23859e05fc2e941b9831d3ba77d3ca0a Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I1226 15:12:58.688044    9071 start.go:369] acquired machines lock for "force-systemd-env-026000" in 143.087µs

	I1226 15:12:58.688072    9071 start.go:93] Provisioning new machine with config: &{Name:force-systemd-env-026000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1703498848-17857@sha256:81ae12a49915e4f02aa382dd3758a30a6649e1143c32b3d03309750104577c6c Memory:2048 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:force-systemd-env-026000 Namespace:default APIS

erverName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClien

tPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}

	I1226 15:12:58.688124    9071 start.go:125] createHost starting for "" (driver="docker")

	I1226 15:12:58.709874    9071 out.go:204] * Creating docker container (CPUs=2, Memory=2048MB) ...

	I1226 15:12:58.710231    9071 start.go:159] libmachine.API.Create for "force-systemd-env-026000" (driver="docker")

	I1226 15:12:58.710283    9071 client.go:168] LocalClient.Create starting

	I1226 15:12:58.710458    9071 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17857-1142/.minikube/certs/ca.pem

	I1226 15:12:58.710544    9071 main.go:141] libmachine: Decoding PEM data...

	I1226 15:12:58.710573    9071 main.go:141] libmachine: Parsing certificate...

	I1226 15:12:58.710681    9071 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17857-1142/.minikube/certs/cert.pem

	I1226 15:12:58.710750    9071 main.go:141] libmachine: Decoding PEM data...

	I1226 15:12:58.710777    9071 main.go:141] libmachine: Parsing certificate...

	I1226 15:12:58.711623    9071 cli_runner.go:164] Run: docker network inspect force-systemd-env-026000 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"

	W1226 15:12:58.766297    9071 cli_runner.go:211] docker network inspect force-systemd-env-026000 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1

	I1226 15:12:58.766420    9071 network_create.go:281] running [docker network inspect force-systemd-env-026000] to gather additional debugging logs...

	I1226 15:12:58.766434    9071 cli_runner.go:164] Run: docker network inspect force-systemd-env-026000

	W1226 15:12:58.819228    9071 cli_runner.go:211] docker network inspect force-systemd-env-026000 returned with exit code 1

	I1226 15:12:58.819261    9071 network_create.go:284] error running [docker network inspect force-systemd-env-026000]: docker network inspect force-systemd-env-026000: exit status 1

	stdout:

	[]

	stderr:

	Error response from daemon: network force-systemd-env-026000 not found

	I1226 15:12:58.819278    9071 network_create.go:286] output of [docker network inspect force-systemd-env-026000]: -- stdout --

	[]

	-- /stdout --

	** stderr ** 

	Error response from daemon: network force-systemd-env-026000 not found

	** /stderr **

	I1226 15:12:58.819421    9071 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"

	I1226 15:12:58.872926    9071 network.go:212] skipping subnet 192.168.49.0/24 that is reserved: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:<nil>}

	I1226 15:12:58.874408    9071 network.go:212] skipping subnet 192.168.58.0/24 that is reserved: &{IP:192.168.58.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.58.0/24 Gateway:192.168.58.1 ClientMin:192.168.58.2 ClientMax:192.168.58.254 Broadcast:192.168.58.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:<nil>}

	I1226 15:12:58.876111    9071 network.go:212] skipping subnet 192.168.67.0/24 that is reserved: &{IP:192.168.67.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.67.0/24 Gateway:192.168.67.1 ClientMin:192.168.67.2 ClientMax:192.168.67.254 Broadcast:192.168.67.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:<nil>}

	I1226 15:12:58.876486    9071 network.go:209] using free private subnet 192.168.76.0/24: &{IP:192.168.76.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.76.0/24 Gateway:192.168.76.1 ClientMin:192.168.76.2 ClientMax:192.168.76.254 Broadcast:192.168.76.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc0021eb840}

	I1226 15:12:58.876505    9071 network_create.go:124] attempt to create docker network force-systemd-env-026000 192.168.76.0/24 with gateway 192.168.76.1 and MTU of 65535 ...

	I1226 15:12:58.876566    9071 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.76.0/24 --gateway=192.168.76.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=65535 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=force-systemd-env-026000 force-systemd-env-026000

	I1226 15:12:58.967040    9071 network_create.go:108] docker network force-systemd-env-026000 192.168.76.0/24 created

	I1226 15:12:58.967081    9071 kic.go:121] calculated static IP "192.168.76.2" for the "force-systemd-env-026000" container

	I1226 15:12:58.967193    9071 cli_runner.go:164] Run: docker ps -a --format {{.Names}}

	I1226 15:12:59.022110    9071 cli_runner.go:164] Run: docker volume create force-systemd-env-026000 --label name.minikube.sigs.k8s.io=force-systemd-env-026000 --label created_by.minikube.sigs.k8s.io=true

	I1226 15:12:59.078355    9071 oci.go:103] Successfully created a docker volume force-systemd-env-026000

	I1226 15:12:59.078519    9071 cli_runner.go:164] Run: docker run --rm --name force-systemd-env-026000-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=force-systemd-env-026000 --entrypoint /usr/bin/test -v force-systemd-env-026000:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1703498848-17857@sha256:81ae12a49915e4f02aa382dd3758a30a6649e1143c32b3d03309750104577c6c -d /var/lib

	I1226 15:12:59.482947    9071 oci.go:107] Successfully prepared a docker volume force-systemd-env-026000

	I1226 15:12:59.483008    9071 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker

	I1226 15:12:59.483023    9071 kic.go:194] Starting extracting preloaded images to volume ...

	I1226 15:12:59.483136    9071 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v /Users/jenkins/minikube-integration/17857-1142/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4:/preloaded.tar:ro -v force-systemd-env-026000:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1703498848-17857@sha256:81ae12a49915e4f02aa382dd3758a30a6649e1143c32b3d03309750104577c6c -I lz4 -xf /preloaded.tar -C /extractDir

	I1226 15:18:58.709403    9071 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I1226 15:18:58.709531    9071 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-env-026000

	W1226 15:18:58.763312    9071 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-env-026000 returned with exit code 1

	I1226 15:18:58.763453    9071 retry.go:31] will retry after 173.346203ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "force-systemd-env-026000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-env-026000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: force-systemd-env-026000

	I1226 15:18:58.937765    9071 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-env-026000

	W1226 15:18:58.991414    9071 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-env-026000 returned with exit code 1

	I1226 15:18:58.991514    9071 retry.go:31] will retry after 531.966838ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "force-systemd-env-026000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-env-026000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: force-systemd-env-026000

	I1226 15:18:59.523979    9071 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-env-026000

	W1226 15:18:59.578115    9071 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-env-026000 returned with exit code 1

	I1226 15:18:59.578211    9071 retry.go:31] will retry after 842.195152ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "force-systemd-env-026000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-env-026000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: force-systemd-env-026000

	I1226 15:19:00.420815    9071 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-env-026000

	W1226 15:19:00.475042    9071 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-env-026000 returned with exit code 1

	W1226 15:19:00.475217    9071 start.go:275] error running df -h /var: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "force-systemd-env-026000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-env-026000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: force-systemd-env-026000

	W1226 15:19:00.475244    9071 start.go:242] error getting percentage of /var that is free: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "force-systemd-env-026000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-env-026000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: force-systemd-env-026000

	I1226 15:19:00.475340    9071 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"

	I1226 15:19:00.475407    9071 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-env-026000

	W1226 15:19:00.528439    9071 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-env-026000 returned with exit code 1

	I1226 15:19:00.528561    9071 retry.go:31] will retry after 333.851941ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "force-systemd-env-026000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-env-026000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: force-systemd-env-026000

	I1226 15:19:00.862701    9071 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-env-026000

	W1226 15:19:00.916037    9071 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-env-026000 returned with exit code 1

	I1226 15:19:00.916161    9071 retry.go:31] will retry after 442.125064ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "force-systemd-env-026000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-env-026000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: force-systemd-env-026000

	I1226 15:19:01.359465    9071 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-env-026000

	W1226 15:19:01.413655    9071 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-env-026000 returned with exit code 1

	I1226 15:19:01.413754    9071 retry.go:31] will retry after 725.854118ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "force-systemd-env-026000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-env-026000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: force-systemd-env-026000

	I1226 15:19:02.140059    9071 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-env-026000

	W1226 15:19:02.193762    9071 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-env-026000 returned with exit code 1

	W1226 15:19:02.193861    9071 start.go:290] error running df -BG /var: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "force-systemd-env-026000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-env-026000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: force-systemd-env-026000

	W1226 15:19:02.193881    9071 start.go:247] error getting GiB of /var that is available: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "force-systemd-env-026000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-env-026000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: force-systemd-env-026000

	I1226 15:19:02.193896    9071 start.go:128] duration metric: createHost completed in 6m3.50895453s

	I1226 15:19:02.193904    9071 start.go:83] releasing machines lock for "force-systemd-env-026000", held for 6m3.509062167s

	W1226 15:19:02.193916    9071 start.go:694] error starting host: creating host: create host timed out in 360.000000 seconds

	I1226 15:19:02.194367    9071 cli_runner.go:164] Run: docker container inspect force-systemd-env-026000 --format={{.State.Status}}

	W1226 15:19:02.246934    9071 cli_runner.go:211] docker container inspect force-systemd-env-026000 --format={{.State.Status}} returned with exit code 1

	I1226 15:19:02.246993    9071 delete.go:82] Unable to get host status for force-systemd-env-026000, assuming it has already been deleted: state: unknown state "force-systemd-env-026000": docker container inspect force-systemd-env-026000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: force-systemd-env-026000

	W1226 15:19:02.247098    9071 out.go:239] ! StartHost failed, but will try again: creating host: create host timed out in 360.000000 seconds

	! StartHost failed, but will try again: creating host: create host timed out in 360.000000 seconds

	I1226 15:19:02.247107    9071 start.go:709] Will try again in 5 seconds ...

	I1226 15:19:07.248092    9071 start.go:365] acquiring machines lock for force-systemd-env-026000: {Name:mk2d001d23859e05fc2e941b9831d3ba77d3ca0a Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I1226 15:19:07.248338    9071 start.go:369] acquired machines lock for "force-systemd-env-026000" in 180.348µs

	I1226 15:19:07.248373    9071 start.go:96] Skipping create...Using existing machine configuration

	I1226 15:19:07.248388    9071 fix.go:54] fixHost starting: 

	I1226 15:19:07.248860    9071 cli_runner.go:164] Run: docker container inspect force-systemd-env-026000 --format={{.State.Status}}

	W1226 15:19:07.303263    9071 cli_runner.go:211] docker container inspect force-systemd-env-026000 --format={{.State.Status}} returned with exit code 1

	I1226 15:19:07.303306    9071 fix.go:102] recreateIfNeeded on force-systemd-env-026000: state= err=unknown state "force-systemd-env-026000": docker container inspect force-systemd-env-026000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: force-systemd-env-026000

	I1226 15:19:07.303326    9071 fix.go:107] machineExists: false. err=machine does not exist

	I1226 15:19:07.324898    9071 out.go:177] * docker "force-systemd-env-026000" container is missing, will recreate.

	I1226 15:19:07.345712    9071 delete.go:124] DEMOLISHING force-systemd-env-026000 ...

	I1226 15:19:07.345873    9071 cli_runner.go:164] Run: docker container inspect force-systemd-env-026000 --format={{.State.Status}}

	W1226 15:19:07.401268    9071 cli_runner.go:211] docker container inspect force-systemd-env-026000 --format={{.State.Status}} returned with exit code 1

	W1226 15:19:07.401326    9071 stop.go:75] unable to get state: unknown state "force-systemd-env-026000": docker container inspect force-systemd-env-026000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: force-systemd-env-026000

	I1226 15:19:07.401349    9071 delete.go:128] stophost failed (probably ok): ssh power off: unknown state "force-systemd-env-026000": docker container inspect force-systemd-env-026000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: force-systemd-env-026000

	I1226 15:19:07.401763    9071 cli_runner.go:164] Run: docker container inspect force-systemd-env-026000 --format={{.State.Status}}

	W1226 15:19:07.454183    9071 cli_runner.go:211] docker container inspect force-systemd-env-026000 --format={{.State.Status}} returned with exit code 1

	I1226 15:19:07.454265    9071 delete.go:82] Unable to get host status for force-systemd-env-026000, assuming it has already been deleted: state: unknown state "force-systemd-env-026000": docker container inspect force-systemd-env-026000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: force-systemd-env-026000

	I1226 15:19:07.454384    9071 cli_runner.go:164] Run: docker container inspect -f {{.Id}} force-systemd-env-026000

	W1226 15:19:07.506723    9071 cli_runner.go:211] docker container inspect -f {{.Id}} force-systemd-env-026000 returned with exit code 1

	I1226 15:19:07.506761    9071 kic.go:371] could not find the container force-systemd-env-026000 to remove it. will try anyways

	I1226 15:19:07.506837    9071 cli_runner.go:164] Run: docker container inspect force-systemd-env-026000 --format={{.State.Status}}

	W1226 15:19:07.559478    9071 cli_runner.go:211] docker container inspect force-systemd-env-026000 --format={{.State.Status}} returned with exit code 1

	W1226 15:19:07.559523    9071 oci.go:84] error getting container status, will try to delete anyways: unknown state "force-systemd-env-026000": docker container inspect force-systemd-env-026000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: force-systemd-env-026000

	I1226 15:19:07.559628    9071 cli_runner.go:164] Run: docker exec --privileged -t force-systemd-env-026000 /bin/bash -c "sudo init 0"

	W1226 15:19:07.611323    9071 cli_runner.go:211] docker exec --privileged -t force-systemd-env-026000 /bin/bash -c "sudo init 0" returned with exit code 1

	I1226 15:19:07.611353    9071 oci.go:650] error shutdown force-systemd-env-026000: docker exec --privileged -t force-systemd-env-026000 /bin/bash -c "sudo init 0": exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: force-systemd-env-026000

	I1226 15:19:08.611583    9071 cli_runner.go:164] Run: docker container inspect force-systemd-env-026000 --format={{.State.Status}}

	W1226 15:19:08.665984    9071 cli_runner.go:211] docker container inspect force-systemd-env-026000 --format={{.State.Status}} returned with exit code 1

	I1226 15:19:08.666036    9071 oci.go:662] temporary error verifying shutdown: unknown state "force-systemd-env-026000": docker container inspect force-systemd-env-026000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: force-systemd-env-026000

	I1226 15:19:08.666052    9071 oci.go:664] temporary error: container force-systemd-env-026000 status is  but expect it to be exited

	I1226 15:19:08.666074    9071 retry.go:31] will retry after 458.291627ms: couldn't verify container is exited. %v: unknown state "force-systemd-env-026000": docker container inspect force-systemd-env-026000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: force-systemd-env-026000

	I1226 15:19:09.125502    9071 cli_runner.go:164] Run: docker container inspect force-systemd-env-026000 --format={{.State.Status}}

	W1226 15:19:09.178297    9071 cli_runner.go:211] docker container inspect force-systemd-env-026000 --format={{.State.Status}} returned with exit code 1

	I1226 15:19:09.178355    9071 oci.go:662] temporary error verifying shutdown: unknown state "force-systemd-env-026000": docker container inspect force-systemd-env-026000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: force-systemd-env-026000

	I1226 15:19:09.178368    9071 oci.go:664] temporary error: container force-systemd-env-026000 status is  but expect it to be exited

	I1226 15:19:09.178396    9071 retry.go:31] will retry after 798.626296ms: couldn't verify container is exited. %v: unknown state "force-systemd-env-026000": docker container inspect force-systemd-env-026000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: force-systemd-env-026000

	I1226 15:19:09.977413    9071 cli_runner.go:164] Run: docker container inspect force-systemd-env-026000 --format={{.State.Status}}

	W1226 15:19:10.031811    9071 cli_runner.go:211] docker container inspect force-systemd-env-026000 --format={{.State.Status}} returned with exit code 1

	I1226 15:19:10.031855    9071 oci.go:662] temporary error verifying shutdown: unknown state "force-systemd-env-026000": docker container inspect force-systemd-env-026000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: force-systemd-env-026000

	I1226 15:19:10.031869    9071 oci.go:664] temporary error: container force-systemd-env-026000 status is  but expect it to be exited

	I1226 15:19:10.031894    9071 retry.go:31] will retry after 1.357220984s: couldn't verify container is exited. %v: unknown state "force-systemd-env-026000": docker container inspect force-systemd-env-026000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: force-systemd-env-026000

	I1226 15:19:11.390488    9071 cli_runner.go:164] Run: docker container inspect force-systemd-env-026000 --format={{.State.Status}}

	W1226 15:19:11.444804    9071 cli_runner.go:211] docker container inspect force-systemd-env-026000 --format={{.State.Status}} returned with exit code 1

	I1226 15:19:11.444858    9071 oci.go:662] temporary error verifying shutdown: unknown state "force-systemd-env-026000": docker container inspect force-systemd-env-026000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: force-systemd-env-026000

	I1226 15:19:11.444870    9071 oci.go:664] temporary error: container force-systemd-env-026000 status is  but expect it to be exited

	I1226 15:19:11.444897    9071 retry.go:31] will retry after 2.101772491s: couldn't verify container is exited. %v: unknown state "force-systemd-env-026000": docker container inspect force-systemd-env-026000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: force-systemd-env-026000

	I1226 15:19:13.546997    9071 cli_runner.go:164] Run: docker container inspect force-systemd-env-026000 --format={{.State.Status}}

	W1226 15:19:13.601092    9071 cli_runner.go:211] docker container inspect force-systemd-env-026000 --format={{.State.Status}} returned with exit code 1

	I1226 15:19:13.601150    9071 oci.go:662] temporary error verifying shutdown: unknown state "force-systemd-env-026000": docker container inspect force-systemd-env-026000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: force-systemd-env-026000

	I1226 15:19:13.601160    9071 oci.go:664] temporary error: container force-systemd-env-026000 status is  but expect it to be exited

	I1226 15:19:13.601188    9071 retry.go:31] will retry after 3.41160334s: couldn't verify container is exited. %v: unknown state "force-systemd-env-026000": docker container inspect force-systemd-env-026000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: force-systemd-env-026000

	I1226 15:19:17.013861    9071 cli_runner.go:164] Run: docker container inspect force-systemd-env-026000 --format={{.State.Status}}

	W1226 15:19:17.066048    9071 cli_runner.go:211] docker container inspect force-systemd-env-026000 --format={{.State.Status}} returned with exit code 1

	I1226 15:19:17.066115    9071 oci.go:662] temporary error verifying shutdown: unknown state "force-systemd-env-026000": docker container inspect force-systemd-env-026000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: force-systemd-env-026000

	I1226 15:19:17.066127    9071 oci.go:664] temporary error: container force-systemd-env-026000 status is  but expect it to be exited

	I1226 15:19:17.066149    9071 retry.go:31] will retry after 3.104911371s: couldn't verify container is exited. %v: unknown state "force-systemd-env-026000": docker container inspect force-systemd-env-026000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: force-systemd-env-026000

	I1226 15:19:20.172886    9071 cli_runner.go:164] Run: docker container inspect force-systemd-env-026000 --format={{.State.Status}}

	W1226 15:19:20.227796    9071 cli_runner.go:211] docker container inspect force-systemd-env-026000 --format={{.State.Status}} returned with exit code 1

	I1226 15:19:20.227845    9071 oci.go:662] temporary error verifying shutdown: unknown state "force-systemd-env-026000": docker container inspect force-systemd-env-026000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: force-systemd-env-026000

	I1226 15:19:20.227859    9071 oci.go:664] temporary error: container force-systemd-env-026000 status is  but expect it to be exited

	I1226 15:19:20.227886    9071 retry.go:31] will retry after 5.461056159s: couldn't verify container is exited. %v: unknown state "force-systemd-env-026000": docker container inspect force-systemd-env-026000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: force-systemd-env-026000

	I1226 15:19:25.689304    9071 cli_runner.go:164] Run: docker container inspect force-systemd-env-026000 --format={{.State.Status}}

	W1226 15:19:25.742649    9071 cli_runner.go:211] docker container inspect force-systemd-env-026000 --format={{.State.Status}} returned with exit code 1

	I1226 15:19:25.742714    9071 oci.go:662] temporary error verifying shutdown: unknown state "force-systemd-env-026000": docker container inspect force-systemd-env-026000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: force-systemd-env-026000

	I1226 15:19:25.742724    9071 oci.go:664] temporary error: container force-systemd-env-026000 status is  but expect it to be exited

	I1226 15:19:25.742761    9071 oci.go:88] couldn't shut down force-systemd-env-026000 (might be okay): verify shutdown: couldn't verify container is exited. %v: unknown state "force-systemd-env-026000": docker container inspect force-systemd-env-026000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: force-systemd-env-026000

	I1226 15:19:25.742851    9071 cli_runner.go:164] Run: docker rm -f -v force-systemd-env-026000

	I1226 15:19:25.796351    9071 cli_runner.go:164] Run: docker container inspect -f {{.Id}} force-systemd-env-026000

	W1226 15:19:25.847936    9071 cli_runner.go:211] docker container inspect -f {{.Id}} force-systemd-env-026000 returned with exit code 1

	I1226 15:19:25.848046    9071 cli_runner.go:164] Run: docker network inspect force-systemd-env-026000 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"

	I1226 15:19:25.902625    9071 cli_runner.go:164] Run: docker network rm force-systemd-env-026000

	I1226 15:19:26.008186    9071 fix.go:114] Sleeping 1 second for extra luck!

	I1226 15:19:27.009298    9071 start.go:125] createHost starting for "" (driver="docker")

	I1226 15:19:27.032475    9071 out.go:204] * Creating docker container (CPUs=2, Memory=2048MB) ...

	I1226 15:19:27.032627    9071 start.go:159] libmachine.API.Create for "force-systemd-env-026000" (driver="docker")

	I1226 15:19:27.032668    9071 client.go:168] LocalClient.Create starting

	I1226 15:19:27.032904    9071 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17857-1142/.minikube/certs/ca.pem

	I1226 15:19:27.032996    9071 main.go:141] libmachine: Decoding PEM data...

	I1226 15:19:27.033022    9071 main.go:141] libmachine: Parsing certificate...

	I1226 15:19:27.033102    9071 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17857-1142/.minikube/certs/cert.pem

	I1226 15:19:27.033169    9071 main.go:141] libmachine: Decoding PEM data...

	I1226 15:19:27.033190    9071 main.go:141] libmachine: Parsing certificate...

	I1226 15:19:27.054315    9071 cli_runner.go:164] Run: docker network inspect force-systemd-env-026000 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"

	W1226 15:19:27.108768    9071 cli_runner.go:211] docker network inspect force-systemd-env-026000 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1

	I1226 15:19:27.108862    9071 network_create.go:281] running [docker network inspect force-systemd-env-026000] to gather additional debugging logs...

	I1226 15:19:27.108879    9071 cli_runner.go:164] Run: docker network inspect force-systemd-env-026000

	W1226 15:19:27.161884    9071 cli_runner.go:211] docker network inspect force-systemd-env-026000 returned with exit code 1

	I1226 15:19:27.161916    9071 network_create.go:284] error running [docker network inspect force-systemd-env-026000]: docker network inspect force-systemd-env-026000: exit status 1

	stdout:

	[]

	stderr:

	Error response from daemon: network force-systemd-env-026000 not found

	I1226 15:19:27.161927    9071 network_create.go:286] output of [docker network inspect force-systemd-env-026000]: -- stdout --

	[]

	-- /stdout --

	** stderr ** 

	Error response from daemon: network force-systemd-env-026000 not found

	** /stderr **

	I1226 15:19:27.162062    9071 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"

	I1226 15:19:27.216734    9071 network.go:212] skipping subnet 192.168.49.0/24 that is reserved: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:<nil>}

	I1226 15:19:27.218277    9071 network.go:212] skipping subnet 192.168.58.0/24 that is reserved: &{IP:192.168.58.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.58.0/24 Gateway:192.168.58.1 ClientMin:192.168.58.2 ClientMax:192.168.58.254 Broadcast:192.168.58.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:<nil>}

	I1226 15:19:27.219779    9071 network.go:212] skipping subnet 192.168.67.0/24 that is reserved: &{IP:192.168.67.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.67.0/24 Gateway:192.168.67.1 ClientMin:192.168.67.2 ClientMax:192.168.67.254 Broadcast:192.168.67.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:<nil>}

	I1226 15:19:27.221137    9071 network.go:212] skipping subnet 192.168.76.0/24 that is reserved: &{IP:192.168.76.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.76.0/24 Gateway:192.168.76.1 ClientMin:192.168.76.2 ClientMax:192.168.76.254 Broadcast:192.168.76.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:<nil>}

	I1226 15:19:27.222640    9071 network.go:212] skipping subnet 192.168.85.0/24 that is reserved: &{IP:192.168.85.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.85.0/24 Gateway:192.168.85.1 ClientMin:192.168.85.2 ClientMax:192.168.85.254 Broadcast:192.168.85.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:<nil>}

	I1226 15:19:27.223083    9071 network.go:209] using free private subnet 192.168.94.0/24: &{IP:192.168.94.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.94.0/24 Gateway:192.168.94.1 ClientMin:192.168.94.2 ClientMax:192.168.94.254 Broadcast:192.168.94.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc0021eb9c0}

	I1226 15:19:27.223096    9071 network_create.go:124] attempt to create docker network force-systemd-env-026000 192.168.94.0/24 with gateway 192.168.94.1 and MTU of 65535 ...

	I1226 15:19:27.223170    9071 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.94.0/24 --gateway=192.168.94.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=65535 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=force-systemd-env-026000 force-systemd-env-026000

	I1226 15:19:27.313571    9071 network_create.go:108] docker network force-systemd-env-026000 192.168.94.0/24 created

	I1226 15:19:27.313701    9071 kic.go:121] calculated static IP "192.168.94.2" for the "force-systemd-env-026000" container

	I1226 15:19:27.313830    9071 cli_runner.go:164] Run: docker ps -a --format {{.Names}}

	I1226 15:19:27.369036    9071 cli_runner.go:164] Run: docker volume create force-systemd-env-026000 --label name.minikube.sigs.k8s.io=force-systemd-env-026000 --label created_by.minikube.sigs.k8s.io=true

	I1226 15:19:27.421821    9071 oci.go:103] Successfully created a docker volume force-systemd-env-026000

	I1226 15:19:27.421946    9071 cli_runner.go:164] Run: docker run --rm --name force-systemd-env-026000-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=force-systemd-env-026000 --entrypoint /usr/bin/test -v force-systemd-env-026000:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1703498848-17857@sha256:81ae12a49915e4f02aa382dd3758a30a6649e1143c32b3d03309750104577c6c -d /var/lib

	I1226 15:19:27.757479    9071 oci.go:107] Successfully prepared a docker volume force-systemd-env-026000

	I1226 15:19:27.757520    9071 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker

	I1226 15:19:27.757546    9071 kic.go:194] Starting extracting preloaded images to volume ...

	I1226 15:19:27.757634    9071 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v /Users/jenkins/minikube-integration/17857-1142/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4:/preloaded.tar:ro -v force-systemd-env-026000:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1703498848-17857@sha256:81ae12a49915e4f02aa382dd3758a30a6649e1143c32b3d03309750104577c6c -I lz4 -xf /preloaded.tar -C /extractDir

	I1226 15:25:27.089153    9071 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I1226 15:25:27.089276    9071 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-env-026000

	W1226 15:25:27.142482    9071 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-env-026000 returned with exit code 1

	I1226 15:25:27.142602    9071 retry.go:31] will retry after 292.195365ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "force-systemd-env-026000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-env-026000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: force-systemd-env-026000

	I1226 15:25:27.435566    9071 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-env-026000

	W1226 15:25:27.489425    9071 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-env-026000 returned with exit code 1

	I1226 15:25:27.489548    9071 retry.go:31] will retry after 208.569238ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "force-systemd-env-026000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-env-026000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: force-systemd-env-026000

	I1226 15:25:27.698590    9071 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-env-026000

	W1226 15:25:27.753150    9071 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-env-026000 returned with exit code 1

	I1226 15:25:27.753248    9071 retry.go:31] will retry after 693.940831ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "force-systemd-env-026000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-env-026000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: force-systemd-env-026000

	I1226 15:25:28.449490    9071 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-env-026000

	W1226 15:25:28.502374    9071 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-env-026000 returned with exit code 1

	W1226 15:25:28.502506    9071 start.go:275] error running df -h /var: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "force-systemd-env-026000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-env-026000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: force-systemd-env-026000

	W1226 15:25:28.502533    9071 start.go:242] error getting percentage of /var that is free: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "force-systemd-env-026000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-env-026000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: force-systemd-env-026000

	I1226 15:25:28.502592    9071 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"

	I1226 15:25:28.502655    9071 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-env-026000

	W1226 15:25:28.555955    9071 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-env-026000 returned with exit code 1

	I1226 15:25:28.556066    9071 retry.go:31] will retry after 219.582156ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "force-systemd-env-026000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-env-026000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: force-systemd-env-026000

	I1226 15:25:28.775932    9071 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-env-026000

	W1226 15:25:28.830392    9071 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-env-026000 returned with exit code 1

	I1226 15:25:28.830507    9071 retry.go:31] will retry after 361.75715ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "force-systemd-env-026000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-env-026000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: force-systemd-env-026000

	I1226 15:25:29.194609    9071 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-env-026000

	W1226 15:25:29.249096    9071 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-env-026000 returned with exit code 1

	I1226 15:25:29.249191    9071 retry.go:31] will retry after 677.0475ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "force-systemd-env-026000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-env-026000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: force-systemd-env-026000

	I1226 15:25:29.926639    9071 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-env-026000

	W1226 15:25:29.981244    9071 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-env-026000 returned with exit code 1

	W1226 15:25:29.981349    9071 start.go:290] error running df -BG /var: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "force-systemd-env-026000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-env-026000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: force-systemd-env-026000

	W1226 15:25:29.981363    9071 start.go:247] error getting GiB of /var that is available: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "force-systemd-env-026000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-env-026000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: force-systemd-env-026000

	I1226 15:25:29.981383    9071 start.go:128] duration metric: createHost completed in 6m2.916270326s

	I1226 15:25:29.981451    9071 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I1226 15:25:29.981520    9071 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-env-026000

	W1226 15:25:30.034060    9071 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-env-026000 returned with exit code 1

	I1226 15:25:30.034165    9071 retry.go:31] will retry after 196.66046ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "force-systemd-env-026000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-env-026000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: force-systemd-env-026000

	I1226 15:25:30.231354    9071 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-env-026000

	W1226 15:25:30.286154    9071 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-env-026000 returned with exit code 1

	I1226 15:25:30.286262    9071 retry.go:31] will retry after 472.990627ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "force-systemd-env-026000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-env-026000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: force-systemd-env-026000

	I1226 15:25:30.760223    9071 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-env-026000

	W1226 15:25:30.814248    9071 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-env-026000 returned with exit code 1

	I1226 15:25:30.814346    9071 retry.go:31] will retry after 416.975455ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "force-systemd-env-026000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-env-026000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: force-systemd-env-026000

	I1226 15:25:31.231751    9071 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-env-026000

	W1226 15:25:31.285579    9071 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-env-026000 returned with exit code 1

	W1226 15:25:31.285685    9071 start.go:275] error running df -h /var: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "force-systemd-env-026000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-env-026000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: force-systemd-env-026000

	W1226 15:25:31.285702    9071 start.go:242] error getting percentage of /var that is free: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "force-systemd-env-026000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-env-026000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: force-systemd-env-026000

	I1226 15:25:31.285764    9071 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"

	I1226 15:25:31.285831    9071 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-env-026000

	W1226 15:25:31.338721    9071 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-env-026000 returned with exit code 1

	I1226 15:25:31.338814    9071 retry.go:31] will retry after 308.991264ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "force-systemd-env-026000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-env-026000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: force-systemd-env-026000

	I1226 15:25:31.648095    9071 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-env-026000

	W1226 15:25:31.700752    9071 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-env-026000 returned with exit code 1

	I1226 15:25:31.700844    9071 retry.go:31] will retry after 346.023777ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "force-systemd-env-026000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-env-026000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: force-systemd-env-026000

	I1226 15:25:32.047309    9071 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-env-026000

	W1226 15:25:32.102100    9071 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-env-026000 returned with exit code 1

	I1226 15:25:32.102188    9071 retry.go:31] will retry after 476.102644ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "force-systemd-env-026000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-env-026000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: force-systemd-env-026000

	I1226 15:25:32.580573    9071 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-env-026000

	W1226 15:25:32.634483    9071 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-env-026000 returned with exit code 1

	W1226 15:25:32.634588    9071 start.go:290] error running df -BG /var: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "force-systemd-env-026000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-env-026000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: force-systemd-env-026000

	W1226 15:25:32.634605    9071 start.go:247] error getting GiB of /var that is available: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "force-systemd-env-026000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-env-026000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: force-systemd-env-026000

	I1226 15:25:32.634620    9071 fix.go:56] fixHost completed within 6m25.330664134s

	I1226 15:25:32.634627    9071 start.go:83] releasing machines lock for "force-systemd-env-026000", held for 6m25.330706292s

	W1226 15:25:32.634741    9071 out.go:239] * Failed to start docker container. Running "minikube delete -p force-systemd-env-026000" may fix it: recreate: creating host: create host timed out in 360.000000 seconds

	* Failed to start docker container. Running "minikube delete -p force-systemd-env-026000" may fix it: recreate: creating host: create host timed out in 360.000000 seconds

	I1226 15:25:32.677040    9071 out.go:177] 

	W1226 15:25:32.699160    9071 out.go:239] X Exiting due to DRV_CREATE_TIMEOUT: Failed to start host: recreate: creating host: create host timed out in 360.000000 seconds

	X Exiting due to DRV_CREATE_TIMEOUT: Failed to start host: recreate: creating host: create host timed out in 360.000000 seconds

	W1226 15:25:32.699198    9071 out.go:239] * Suggestion: Try 'minikube delete', and disable any conflicting VPN or firewall software

	* Suggestion: Try 'minikube delete', and disable any conflicting VPN or firewall software

	W1226 15:25:32.699232    9071 out.go:239] * Related issue: https://github.com/kubernetes/minikube/issues/7072

	* Related issue: https://github.com/kubernetes/minikube/issues/7072

	I1226 15:25:32.721058    9071 out.go:177] 

** /stderr **

docker_test.go:157: failed to start minikube with args: "out/minikube-darwin-amd64 start -p force-systemd-env-026000 --memory=2048 --alsologtostderr -v=5 --driver=docker " : exit status 52

docker_test.go:110: (dbg) Run:  out/minikube-darwin-amd64 -p force-systemd-env-026000 ssh "docker info --format {{.CgroupDriver}}"

docker_test.go:110: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p force-systemd-env-026000 ssh "docker info --format {{.CgroupDriver}}": exit status 80 (208.708728ms)

-- stdout --

-- /stdout --

** stderr ** 

	X Exiting due to GUEST_STATUS: Unable to get machine status: state: unknown state "force-systemd-env-026000": docker container inspect force-systemd-env-026000 --format=<no value>: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: force-systemd-env-026000

	* 

	╭────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                                                        │

	│    * If the above advice does not help, please let us know:                                                            │

	│      https://github.com/kubernetes/minikube/issues/new/choose                                                          │

	│                                                                                                                        │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                               │

	│    * Please also attach the following file to the GitHub issue:                                                        │

	│    * - /var/folders/xd/3vdzn10d2gb_wxr7lj_p8h5c0000gp/T/minikube_ssh_bee0f26250c13d3e98e295459d643952c0091a53_0.log    │

	│                                                                                                                        │

	╰────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯

** /stderr **

docker_test.go:112: failed to get docker cgroup driver. args "out/minikube-darwin-amd64 -p force-systemd-env-026000 ssh \"docker info --format {{.CgroupDriver}}\"": exit status 80

docker_test.go:166: *** TestForceSystemdEnv FAILED at 2023-12-26 15:25:33.004215 -0800 PST m=+6097.256862834

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:230: ======>  post-mortem[TestForceSystemdEnv]: docker inspect <======

helpers_test.go:231: (dbg) Run:  docker inspect force-systemd-env-026000

helpers_test.go:235: (dbg) docker inspect force-systemd-env-026000:

-- stdout --

	[

	    {

	        "Name": "force-systemd-env-026000",

	        "Id": "3f40eb1ef446e1a3c7aebd5fbda708523951527651af10a3274c4bb07cc7693b",

	        "Created": "2023-12-26T23:19:27.272282374Z",

	        "Scope": "local",

	        "Driver": "bridge",

	        "EnableIPv6": false,

	        "IPAM": {

	            "Driver": "default",

	            "Options": {},

	            "Config": [

	                {

	                    "Subnet": "192.168.94.0/24",

	                    "Gateway": "192.168.94.1"

	                }

	            ]

	        },

	        "Internal": false,

	        "Attachable": false,

	        "Ingress": false,

	        "ConfigFrom": {

	            "Network": ""

	        },

	        "ConfigOnly": false,

	        "Containers": {},

	        "Options": {

	            "--icc": "",

	            "--ip-masq": "",

	            "com.docker.network.driver.mtu": "65535"

	        },

	        "Labels": {

	            "created_by.minikube.sigs.k8s.io": "true",

	            "name.minikube.sigs.k8s.io": "force-systemd-env-026000"

	        }

	    }

	]

-- /stdout --

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p force-systemd-env-026000 -n force-systemd-env-026000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p force-systemd-env-026000 -n force-systemd-env-026000: exit status 7 (118.371037ms)

-- stdout --

	Nonexistent

-- /stdout --

** stderr ** 

	E1226 15:25:33.177482    9655 status.go:249] status error: host: state: unknown state "force-systemd-env-026000": docker container inspect force-systemd-env-026000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: force-systemd-env-026000

** /stderr **

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "force-systemd-env-026000" host is not running, skipping log retrieval (state="Nonexistent")

helpers_test.go:175: Cleaning up "force-systemd-env-026000" profile ...

helpers_test.go:178: (dbg) Run:  out/minikube-darwin-amd64 delete -p force-systemd-env-026000

--- FAIL: TestForceSystemdEnv (756.02s)

=== RUN   TestIngressAddonLegacy/StartLegacyK8sCluster

ingress_addon_legacy_test.go:39: (dbg) Run:  out/minikube-darwin-amd64 start -p ingress-addon-legacy-212000 --kubernetes-version=v1.18.20 --memory=4096 --wait=true --alsologtostderr -v=5 --driver=docker 

E1226 13:58:46.226870    1612 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/17857-1142/.minikube/profiles/addons-914000/client.crt: no such file or directory

E1226 13:59:13.919929    1612 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/17857-1142/.minikube/profiles/addons-914000/client.crt: no such file or directory

E1226 13:59:36.198950    1612 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/17857-1142/.minikube/profiles/functional-155000/client.crt: no such file or directory

E1226 13:59:36.205431    1612 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/17857-1142/.minikube/profiles/functional-155000/client.crt: no such file or directory

E1226 13:59:36.217637    1612 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/17857-1142/.minikube/profiles/functional-155000/client.crt: no such file or directory

E1226 13:59:36.238277    1612 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/17857-1142/.minikube/profiles/functional-155000/client.crt: no such file or directory

E1226 13:59:36.279278    1612 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/17857-1142/.minikube/profiles/functional-155000/client.crt: no such file or directory

E1226 13:59:36.359724    1612 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/17857-1142/.minikube/profiles/functional-155000/client.crt: no such file or directory

E1226 13:59:36.521290    1612 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/17857-1142/.minikube/profiles/functional-155000/client.crt: no such file or directory

E1226 13:59:36.843533    1612 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/17857-1142/.minikube/profiles/functional-155000/client.crt: no such file or directory

E1226 13:59:37.484791    1612 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/17857-1142/.minikube/profiles/functional-155000/client.crt: no such file or directory

E1226 13:59:38.765394    1612 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/17857-1142/.minikube/profiles/functional-155000/client.crt: no such file or directory

E1226 13:59:41.326848    1612 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/17857-1142/.minikube/profiles/functional-155000/client.crt: no such file or directory

E1226 13:59:46.448376    1612 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/17857-1142/.minikube/profiles/functional-155000/client.crt: no such file or directory

E1226 13:59:56.688515    1612 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/17857-1142/.minikube/profiles/functional-155000/client.crt: no such file or directory

E1226 14:00:17.170521    1612 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/17857-1142/.minikube/profiles/functional-155000/client.crt: no such file or directory

E1226 14:00:58.131865    1612 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/17857-1142/.minikube/profiles/functional-155000/client.crt: no such file or directory

ingress_addon_legacy_test.go:39: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p ingress-addon-legacy-212000 --kubernetes-version=v1.18.20 --memory=4096 --wait=true --alsologtostderr -v=5 --driver=docker : exit status 109 (4m23.228260093s)

-- stdout --

	* [ingress-addon-legacy-212000] minikube v1.32.0 on Darwin 14.2.1

	  - MINIKUBE_LOCATION=17857

	  - KUBECONFIG=/Users/jenkins/minikube-integration/17857-1142/kubeconfig

	  - MINIKUBE_BIN=out/minikube-darwin-amd64

	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17857-1142/.minikube

	  - MINIKUBE_FORCE_SYSTEMD=

	* Using the docker driver based on user configuration

	* Using Docker Desktop driver with root privileges

	* Starting control plane node ingress-addon-legacy-212000 in cluster ingress-addon-legacy-212000

	* Pulling base image v0.0.42-1703498848-17857 ...

	* Downloading Kubernetes v1.18.20 preload ...

	* Creating docker container (CPUs=2, Memory=4096MB) ...

	* Preparing Kubernetes v1.18.20 on Docker 24.0.7 ...

	  - Generating certificates and keys ...

	  - Booting up control plane ...

	  - Generating certificates and keys ...

	  - Booting up control plane ...

-- /stdout --

** stderr ** 

	I1226 13:57:02.907704    4606 out.go:296] Setting OutFile to fd 1 ...

	I1226 13:57:02.907898    4606 out.go:343] TERM=,COLORTERM=, which probably does not support color

	I1226 13:57:02.907902    4606 out.go:309] Setting ErrFile to fd 2...

	I1226 13:57:02.907906    4606 out.go:343] TERM=,COLORTERM=, which probably does not support color

	I1226 13:57:02.908124    4606 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17857-1142/.minikube/bin

	I1226 13:57:02.909547    4606 out.go:303] Setting JSON to false

	I1226 13:57:02.931657    4606 start.go:128] hostinfo: {"hostname":"MacOS-Agent-3.local","uptime":1592,"bootTime":1703626230,"procs":434,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.2.1","kernelVersion":"23.2.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"bd1c05a8-24a6-5973-aa69-f3c7c66a87ce"}

	W1226 13:57:02.931823    4606 start.go:136] gopshost.Virtualization returned error: not implemented yet

	I1226 13:57:02.954610    4606 out.go:177] * [ingress-addon-legacy-212000] minikube v1.32.0 on Darwin 14.2.1

	I1226 13:57:03.019391    4606 out.go:177]   - MINIKUBE_LOCATION=17857

	I1226 13:57:02.997624    4606 notify.go:220] Checking for updates...

	I1226 13:57:03.063466    4606 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/17857-1142/kubeconfig

	I1226 13:57:03.106433    4606 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64

	I1226 13:57:03.163931    4606 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I1226 13:57:03.206285    4606 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17857-1142/.minikube

	I1226 13:57:03.228194    4606 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=

	I1226 13:57:03.249678    4606 driver.go:392] Setting default libvirt URI to qemu:///system

	I1226 13:57:03.306166    4606 docker.go:122] docker version: linux-24.0.7:Docker Desktop 4.26.0 (130397)

	I1226 13:57:03.306317    4606 cli_runner.go:164] Run: docker system info --format "{{json .}}"

	I1226 13:57:03.406086    4606 info.go:266] docker info: {ID:c18f23ef-4e44-410e-b2ce-38db72a58e15 Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:2 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:45 OomKillDisable:false NGoroutines:61 SystemTime:2023-12-26 21:57:03.396809615 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:8 KernelVersion:6.5.11-linuxkit OperatingSystem:Docker Desktop OSType:linux Architecture:x86_64 IndexServe

rAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:12 MemTotal:6221275136 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy:http.docker.internal:3128 HTTPSProxy:http.docker.internal:3128 NoProxy:hubproxy.docker.internal Name:docker-desktop Labels:[] ExperimentalBuild:false ServerVersion:24.0.7 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:d8f198a4ed8892c764191ef7b3b06d8a2eeb5c7f Expected:d8f198a4ed8892c764191ef7b3b06d8a2eeb5c7f} RuncCommit:{ID:v1.1.10-0-g18a0cb0 Expected:v1.1.10-0-g18a0cb0} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=seccomp,profile=unconf

ined name=cgroupns] ProductLicense: Warnings:[WARNING: daemon is not using the default seccomp profile] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/Users/jenkins/.docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-buildx] ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.12.0-desktop.2] map[Name:compose Path:/Users/jenkins/.docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-compose] ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.23.3-desktop.2] map[Name:dev Path:/Users/jenkins/.docker/cli-plugins/docker-dev SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-dev] ShortDescription:Docker Dev Environments Vendor:Docker Inc. Version:v0.1.0] map[Name:extension Path:/Users/jenkins/.docker/cli-plugins/docker-extension SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-extension] ShortDescription:Mana

ges Docker extensions Vendor:Docker Inc. Version:v0.2.21] map[Name:feedback Path:/Users/jenkins/.docker/cli-plugins/docker-feedback SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-feedback] ShortDescription:Provide feedback, right in your terminal! Vendor:Docker Inc. Version:0.1] map[Name:init Path:/Users/jenkins/.docker/cli-plugins/docker-init SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-init] ShortDescription:Creates Docker-related starter files for your project Vendor:Docker Inc. Version:v0.1.0-beta.10] map[Name:sbom Path:/Users/jenkins/.docker/cli-plugins/docker-sbom SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-sbom] ShortDescription:View the packaged-based Software Bill Of Materials (SBOM) for an image URL:https://github.com/docker/sbom-cli-plugin Vendor:Anchore Inc. Version:0.6.0] map[Name:scan Path:/Users/jenkins/.docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/d

ocker-scan] ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.26.0] map[Name:scout Path:/Users/jenkins/.docker/cli-plugins/docker-scout SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-scout] ShortDescription:Docker Scout Vendor:Docker Inc. Version:v1.2.0]] Warnings:<nil>}}

	I1226 13:57:03.448241    4606 out.go:177] * Using the docker driver based on user configuration

	I1226 13:57:03.469396    4606 start.go:298] selected driver: docker

	I1226 13:57:03.469428    4606 start.go:902] validating driver "docker" against <nil>

	I1226 13:57:03.469442    4606 start.go:913] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}

	I1226 13:57:03.473861    4606 cli_runner.go:164] Run: docker system info --format "{{json .}}"

	I1226 13:57:03.573646    4606 info.go:266] docker info: {ID:c18f23ef-4e44-410e-b2ce-38db72a58e15 Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:2 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:45 OomKillDisable:false NGoroutines:61 SystemTime:2023-12-26 21:57:03.563742517 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:8 KernelVersion:6.5.11-linuxkit OperatingSystem:Docker Desktop OSType:linux Architecture:x86_64 IndexServe

rAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:12 MemTotal:6221275136 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy:http.docker.internal:3128 HTTPSProxy:http.docker.internal:3128 NoProxy:hubproxy.docker.internal Name:docker-desktop Labels:[] ExperimentalBuild:false ServerVersion:24.0.7 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:d8f198a4ed8892c764191ef7b3b06d8a2eeb5c7f Expected:d8f198a4ed8892c764191ef7b3b06d8a2eeb5c7f} RuncCommit:{ID:v1.1.10-0-g18a0cb0 Expected:v1.1.10-0-g18a0cb0} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=seccomp,profile=unconf

ined name=cgroupns] ProductLicense: Warnings:[WARNING: daemon is not using the default seccomp profile] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/Users/jenkins/.docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-buildx] ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.12.0-desktop.2] map[Name:compose Path:/Users/jenkins/.docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-compose] ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.23.3-desktop.2] map[Name:dev Path:/Users/jenkins/.docker/cli-plugins/docker-dev SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-dev] ShortDescription:Docker Dev Environments Vendor:Docker Inc. Version:v0.1.0] map[Name:extension Path:/Users/jenkins/.docker/cli-plugins/docker-extension SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-extension] ShortDescription:Mana

ges Docker extensions Vendor:Docker Inc. Version:v0.2.21] map[Name:feedback Path:/Users/jenkins/.docker/cli-plugins/docker-feedback SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-feedback] ShortDescription:Provide feedback, right in your terminal! Vendor:Docker Inc. Version:0.1] map[Name:init Path:/Users/jenkins/.docker/cli-plugins/docker-init SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-init] ShortDescription:Creates Docker-related starter files for your project Vendor:Docker Inc. Version:v0.1.0-beta.10] map[Name:sbom Path:/Users/jenkins/.docker/cli-plugins/docker-sbom SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-sbom] ShortDescription:View the packaged-based Software Bill Of Materials (SBOM) for an image URL:https://github.com/docker/sbom-cli-plugin Vendor:Anchore Inc. Version:0.6.0] map[Name:scan Path:/Users/jenkins/.docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/d

ocker-scan] ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.26.0] map[Name:scout Path:/Users/jenkins/.docker/cli-plugins/docker-scout SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-scout] ShortDescription:Docker Scout Vendor:Docker Inc. Version:v1.2.0]] Warnings:<nil>}}

	I1226 13:57:03.573804    4606 start_flags.go:309] no existing cluster config was found, will generate one from the flags 

	I1226 13:57:03.573984    4606 start_flags.go:931] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]

	I1226 13:57:03.594859    4606 out.go:177] * Using Docker Desktop driver with root privileges

	I1226 13:57:03.616778    4606 cni.go:84] Creating CNI manager for ""

	I1226 13:57:03.616822    4606 cni.go:162] CNI unnecessary in this configuration, recommending no CNI

	I1226 13:57:03.616854    4606 start_flags.go:323] config:

	{Name:ingress-addon-legacy-212000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1703498848-17857@sha256:81ae12a49915e4f02aa382dd3758a30a6649e1143c32b3d03309750104577c6c Memory:4096 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.18.20 ClusterName:ingress-addon-legacy-212000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.lo

cal ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:}

	I1226 13:57:03.660912    4606 out.go:177] * Starting control plane node ingress-addon-legacy-212000 in cluster ingress-addon-legacy-212000

	I1226 13:57:03.682556    4606 cache.go:121] Beginning downloading kic base image for docker with docker

	I1226 13:57:03.725846    4606 out.go:177] * Pulling base image v0.0.42-1703498848-17857 ...

	I1226 13:57:03.746791    4606 preload.go:132] Checking if preload exists for k8s version v1.18.20 and runtime docker

	I1226 13:57:03.746901    4606 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1703498848-17857@sha256:81ae12a49915e4f02aa382dd3758a30a6649e1143c32b3d03309750104577c6c in local docker daemon

	I1226 13:57:03.800558    4606 image.go:83] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1703498848-17857@sha256:81ae12a49915e4f02aa382dd3758a30a6649e1143c32b3d03309750104577c6c in local docker daemon, skipping pull

	I1226 13:57:03.800586    4606 cache.go:144] gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1703498848-17857@sha256:81ae12a49915e4f02aa382dd3758a30a6649e1143c32b3d03309750104577c6c exists in daemon, skipping load

	I1226 13:57:03.801007    4606 preload.go:119] Found remote preload: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.18.20/preloaded-images-k8s-v18-v1.18.20-docker-overlay2-amd64.tar.lz4

	I1226 13:57:03.801020    4606 cache.go:56] Caching tarball of preloaded images

	I1226 13:57:03.801210    4606 preload.go:132] Checking if preload exists for k8s version v1.18.20 and runtime docker

	I1226 13:57:03.822851    4606 out.go:177] * Downloading Kubernetes v1.18.20 preload ...

	I1226 13:57:03.864752    4606 preload.go:238] getting checksum for preloaded-images-k8s-v18-v1.18.20-docker-overlay2-amd64.tar.lz4 ...

	I1226 13:57:03.948053    4606 download.go:107] Downloading: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.18.20/preloaded-images-k8s-v18-v1.18.20-docker-overlay2-amd64.tar.lz4?checksum=md5:ff35f06d4f6c0bac9297b8f85d8ebf70 -> /Users/jenkins/minikube-integration/17857-1142/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.18.20-docker-overlay2-amd64.tar.lz4

	I1226 13:57:10.304141    4606 preload.go:249] saving checksum for preloaded-images-k8s-v18-v1.18.20-docker-overlay2-amd64.tar.lz4 ...

	I1226 13:57:10.304359    4606 preload.go:256] verifying checksum of /Users/jenkins/minikube-integration/17857-1142/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.18.20-docker-overlay2-amd64.tar.lz4 ...

	I1226 13:57:10.932324    4606 cache.go:59] Finished verifying existence of preloaded tar for  v1.18.20 on docker

	I1226 13:57:10.932569    4606 profile.go:148] Saving config to /Users/jenkins/minikube-integration/17857-1142/.minikube/profiles/ingress-addon-legacy-212000/config.json ...

	I1226 13:57:10.932594    4606 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/17857-1142/.minikube/profiles/ingress-addon-legacy-212000/config.json: {Name:mk22d943146ac289402f868f4e5c16404c688e70 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1226 13:57:10.932891    4606 cache.go:194] Successfully downloaded all kic artifacts

	I1226 13:57:10.932920    4606 start.go:365] acquiring machines lock for ingress-addon-legacy-212000: {Name:mk28134f41ff1fe832a9a6056c4f616b43d6267d Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I1226 13:57:10.933051    4606 start.go:369] acquired machines lock for "ingress-addon-legacy-212000" in 121.711µs

	I1226 13:57:10.933071    4606 start.go:93] Provisioning new machine with config: &{Name:ingress-addon-legacy-212000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1703498848-17857@sha256:81ae12a49915e4f02aa382dd3758a30a6649e1143c32b3d03309750104577c6c Memory:4096 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.18.20 ClusterName:ingress-addon-legacy-212000 Namespace:defau

lt APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.18.20 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOp

timizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:} &{Name: IP: Port:8443 KubernetesVersion:v1.18.20 ContainerRuntime:docker ControlPlane:true Worker:true}

	I1226 13:57:10.933117    4606 start.go:125] createHost starting for "" (driver="docker")

	I1226 13:57:10.955521    4606 out.go:204] * Creating docker container (CPUs=2, Memory=4096MB) ...

	I1226 13:57:10.955833    4606 start.go:159] libmachine.API.Create for "ingress-addon-legacy-212000" (driver="docker")

	I1226 13:57:10.955884    4606 client.go:168] LocalClient.Create starting

	I1226 13:57:10.956057    4606 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17857-1142/.minikube/certs/ca.pem

	I1226 13:57:10.956147    4606 main.go:141] libmachine: Decoding PEM data...

	I1226 13:57:10.956180    4606 main.go:141] libmachine: Parsing certificate...

	I1226 13:57:10.956271    4606 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17857-1142/.minikube/certs/cert.pem

	I1226 13:57:10.956342    4606 main.go:141] libmachine: Decoding PEM data...

	I1226 13:57:10.956359    4606 main.go:141] libmachine: Parsing certificate...

	I1226 13:57:10.965943    4606 cli_runner.go:164] Run: docker network inspect ingress-addon-legacy-212000 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"

	W1226 13:57:11.019953    4606 cli_runner.go:211] docker network inspect ingress-addon-legacy-212000 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1

	I1226 13:57:11.020082    4606 network_create.go:281] running [docker network inspect ingress-addon-legacy-212000] to gather additional debugging logs...

	I1226 13:57:11.020105    4606 cli_runner.go:164] Run: docker network inspect ingress-addon-legacy-212000

	W1226 13:57:11.070664    4606 cli_runner.go:211] docker network inspect ingress-addon-legacy-212000 returned with exit code 1

	I1226 13:57:11.070705    4606 network_create.go:284] error running [docker network inspect ingress-addon-legacy-212000]: docker network inspect ingress-addon-legacy-212000: exit status 1

	stdout:

	[]

	stderr:

	Error response from daemon: network ingress-addon-legacy-212000 not found

	I1226 13:57:11.070723    4606 network_create.go:286] output of [docker network inspect ingress-addon-legacy-212000]: -- stdout --

	[]

	-- /stdout --

	** stderr ** 

	Error response from daemon: network ingress-addon-legacy-212000 not found

	** /stderr **

	I1226 13:57:11.070880    4606 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"

	I1226 13:57:11.122701    4606 network.go:209] using free private subnet 192.168.49.0/24: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc0005f7640}

	I1226 13:57:11.122737    4606 network_create.go:124] attempt to create docker network ingress-addon-legacy-212000 192.168.49.0/24 with gateway 192.168.49.1 and MTU of 65535 ...

	I1226 13:57:11.122822    4606 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.49.0/24 --gateway=192.168.49.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=65535 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=ingress-addon-legacy-212000 ingress-addon-legacy-212000

	I1226 13:57:11.207824    4606 network_create.go:108] docker network ingress-addon-legacy-212000 192.168.49.0/24 created

	I1226 13:57:11.207874    4606 kic.go:121] calculated static IP "192.168.49.2" for the "ingress-addon-legacy-212000" container

	I1226 13:57:11.207986    4606 cli_runner.go:164] Run: docker ps -a --format {{.Names}}

	I1226 13:57:11.258210    4606 cli_runner.go:164] Run: docker volume create ingress-addon-legacy-212000 --label name.minikube.sigs.k8s.io=ingress-addon-legacy-212000 --label created_by.minikube.sigs.k8s.io=true

	I1226 13:57:11.309451    4606 oci.go:103] Successfully created a docker volume ingress-addon-legacy-212000

	I1226 13:57:11.309564    4606 cli_runner.go:164] Run: docker run --rm --name ingress-addon-legacy-212000-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=ingress-addon-legacy-212000 --entrypoint /usr/bin/test -v ingress-addon-legacy-212000:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1703498848-17857@sha256:81ae12a49915e4f02aa382dd3758a30a6649e1143c32b3d03309750104577c6c -d /var/lib

	I1226 13:57:11.699734    4606 oci.go:107] Successfully prepared a docker volume ingress-addon-legacy-212000

	I1226 13:57:11.699773    4606 preload.go:132] Checking if preload exists for k8s version v1.18.20 and runtime docker

	I1226 13:57:11.699787    4606 kic.go:194] Starting extracting preloaded images to volume ...

	I1226 13:57:11.699918    4606 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v /Users/jenkins/minikube-integration/17857-1142/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.18.20-docker-overlay2-amd64.tar.lz4:/preloaded.tar:ro -v ingress-addon-legacy-212000:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1703498848-17857@sha256:81ae12a49915e4f02aa382dd3758a30a6649e1143c32b3d03309750104577c6c -I lz4 -xf /preloaded.tar -C /extractDir

	I1226 13:57:14.078568    4606 cli_runner.go:217] Completed: docker run --rm --entrypoint /usr/bin/tar -v /Users/jenkins/minikube-integration/17857-1142/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.18.20-docker-overlay2-amd64.tar.lz4:/preloaded.tar:ro -v ingress-addon-legacy-212000:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1703498848-17857@sha256:81ae12a49915e4f02aa382dd3758a30a6649e1143c32b3d03309750104577c6c -I lz4 -xf /preloaded.tar -C /extractDir: (2.378587163s)

	I1226 13:57:14.078594    4606 kic.go:203] duration metric: took 2.378821 seconds to extract preloaded images to volume

	I1226 13:57:14.078720    4606 cli_runner.go:164] Run: docker info --format "'{{json .SecurityOptions}}'"

	I1226 13:57:14.178688    4606 cli_runner.go:164] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname ingress-addon-legacy-212000 --name ingress-addon-legacy-212000 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=ingress-addon-legacy-212000 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=ingress-addon-legacy-212000 --network ingress-addon-legacy-212000 --ip 192.168.49.2 --volume ingress-addon-legacy-212000:/var --security-opt apparmor=unconfined --memory=4096mb --memory-swap=4096mb --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1703498848-17857@sha256:81ae12a49915e4f02aa382dd3758a30a6649e1143c32b3d03309750104577c6c

	I1226 13:57:14.452173    4606 cli_runner.go:164] Run: docker container inspect ingress-addon-legacy-212000 --format={{.State.Running}}

	I1226 13:57:14.507771    4606 cli_runner.go:164] Run: docker container inspect ingress-addon-legacy-212000 --format={{.State.Status}}

	I1226 13:57:14.564282    4606 cli_runner.go:164] Run: docker exec ingress-addon-legacy-212000 stat /var/lib/dpkg/alternatives/iptables

	I1226 13:57:14.676947    4606 oci.go:144] the created container "ingress-addon-legacy-212000" has a running status.

	I1226 13:57:14.676996    4606 kic.go:225] Creating ssh key for kic: /Users/jenkins/minikube-integration/17857-1142/.minikube/machines/ingress-addon-legacy-212000/id_rsa...

	I1226 13:57:14.957030    4606 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/17857-1142/.minikube/machines/ingress-addon-legacy-212000/id_rsa.pub -> /home/docker/.ssh/authorized_keys

	I1226 13:57:14.957091    4606 kic_runner.go:191] docker (temp): /Users/jenkins/minikube-integration/17857-1142/.minikube/machines/ingress-addon-legacy-212000/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)

	I1226 13:57:15.019011    4606 cli_runner.go:164] Run: docker container inspect ingress-addon-legacy-212000 --format={{.State.Status}}

	I1226 13:57:15.073571    4606 kic_runner.go:93] Run: chown docker:docker /home/docker/.ssh/authorized_keys

	I1226 13:57:15.073592    4606 kic_runner.go:114] Args: [docker exec --privileged ingress-addon-legacy-212000 chown docker:docker /home/docker/.ssh/authorized_keys]

	I1226 13:57:15.170390    4606 cli_runner.go:164] Run: docker container inspect ingress-addon-legacy-212000 --format={{.State.Status}}

	I1226 13:57:15.222437    4606 machine.go:88] provisioning docker machine ...

	I1226 13:57:15.222480    4606 ubuntu.go:169] provisioning hostname "ingress-addon-legacy-212000"

	I1226 13:57:15.222586    4606 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ingress-addon-legacy-212000

	I1226 13:57:15.273696    4606 main.go:141] libmachine: Using SSH client type: native

	I1226 13:57:15.274042    4606 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x1406660] 0x1409340 <nil>  [] 0s} 127.0.0.1 50500 <nil> <nil>}

	I1226 13:57:15.274056    4606 main.go:141] libmachine: About to run SSH command:

	sudo hostname ingress-addon-legacy-212000 && echo "ingress-addon-legacy-212000" | sudo tee /etc/hostname

	I1226 13:57:15.402819    4606 main.go:141] libmachine: SSH cmd err, output: <nil>: ingress-addon-legacy-212000

	I1226 13:57:15.402913    4606 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ingress-addon-legacy-212000

	I1226 13:57:15.453898    4606 main.go:141] libmachine: Using SSH client type: native

	I1226 13:57:15.454199    4606 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x1406660] 0x1409340 <nil>  [] 0s} 127.0.0.1 50500 <nil> <nil>}

	I1226 13:57:15.454216    4606 main.go:141] libmachine: About to run SSH command:

			if ! grep -xq '.*\singress-addon-legacy-212000' /etc/hosts; then

				if grep -xq '127.0.1.1\s.*' /etc/hosts; then

					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 ingress-addon-legacy-212000/g' /etc/hosts;

				else 

					echo '127.0.1.1 ingress-addon-legacy-212000' | sudo tee -a /etc/hosts; 

				fi

			fi

	I1226 13:57:15.573025    4606 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I1226 13:57:15.573049    4606 ubuntu.go:175] set auth options {CertDir:/Users/jenkins/minikube-integration/17857-1142/.minikube CaCertPath:/Users/jenkins/minikube-integration/17857-1142/.minikube/certs/ca.pem CaPrivateKeyPath:/Users/jenkins/minikube-integration/17857-1142/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/Users/jenkins/minikube-integration/17857-1142/.minikube/machines/server.pem ServerKeyPath:/Users/jenkins/minikube-integration/17857-1142/.minikube/machines/server-key.pem ClientKeyPath:/Users/jenkins/minikube-integration/17857-1142/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/Users/jenkins/minikube-integration/17857-1142/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/Users/jenkins/minikube-integration/17857-1142/.minikube}

	I1226 13:57:15.573076    4606 ubuntu.go:177] setting up certificates

	I1226 13:57:15.573084    4606 provision.go:83] configureAuth start

	I1226 13:57:15.573159    4606 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ingress-addon-legacy-212000

	I1226 13:57:15.669462    4606 provision.go:138] copyHostCerts

	I1226 13:57:15.669508    4606 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/17857-1142/.minikube/certs/ca.pem -> /Users/jenkins/minikube-integration/17857-1142/.minikube/ca.pem

	I1226 13:57:15.669553    4606 exec_runner.go:144] found /Users/jenkins/minikube-integration/17857-1142/.minikube/ca.pem, removing ...

	I1226 13:57:15.669561    4606 exec_runner.go:203] rm: /Users/jenkins/minikube-integration/17857-1142/.minikube/ca.pem

	I1226 13:57:15.669723    4606 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/17857-1142/.minikube/certs/ca.pem --> /Users/jenkins/minikube-integration/17857-1142/.minikube/ca.pem (1078 bytes)

	I1226 13:57:15.669903    4606 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/17857-1142/.minikube/certs/cert.pem -> /Users/jenkins/minikube-integration/17857-1142/.minikube/cert.pem

	I1226 13:57:15.669937    4606 exec_runner.go:144] found /Users/jenkins/minikube-integration/17857-1142/.minikube/cert.pem, removing ...

	I1226 13:57:15.669942    4606 exec_runner.go:203] rm: /Users/jenkins/minikube-integration/17857-1142/.minikube/cert.pem

	I1226 13:57:15.670015    4606 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/17857-1142/.minikube/certs/cert.pem --> /Users/jenkins/minikube-integration/17857-1142/.minikube/cert.pem (1123 bytes)

	I1226 13:57:15.670152    4606 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/17857-1142/.minikube/certs/key.pem -> /Users/jenkins/minikube-integration/17857-1142/.minikube/key.pem

	I1226 13:57:15.670191    4606 exec_runner.go:144] found /Users/jenkins/minikube-integration/17857-1142/.minikube/key.pem, removing ...

	I1226 13:57:15.670196    4606 exec_runner.go:203] rm: /Users/jenkins/minikube-integration/17857-1142/.minikube/key.pem

	I1226 13:57:15.670266    4606 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/17857-1142/.minikube/certs/key.pem --> /Users/jenkins/minikube-integration/17857-1142/.minikube/key.pem (1679 bytes)

	I1226 13:57:15.670402    4606 provision.go:112] generating server cert: /Users/jenkins/minikube-integration/17857-1142/.minikube/machines/server.pem ca-key=/Users/jenkins/minikube-integration/17857-1142/.minikube/certs/ca.pem private-key=/Users/jenkins/minikube-integration/17857-1142/.minikube/certs/ca-key.pem org=jenkins.ingress-addon-legacy-212000 san=[192.168.49.2 127.0.0.1 localhost 127.0.0.1 minikube ingress-addon-legacy-212000]

	I1226 13:57:16.033021    4606 provision.go:172] copyRemoteCerts

	I1226 13:57:16.033081    4606 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker

	I1226 13:57:16.033136    4606 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ingress-addon-legacy-212000

	I1226 13:57:16.083954    4606 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:50500 SSHKeyPath:/Users/jenkins/minikube-integration/17857-1142/.minikube/machines/ingress-addon-legacy-212000/id_rsa Username:docker}

	I1226 13:57:16.171580    4606 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/17857-1142/.minikube/certs/ca.pem -> /etc/docker/ca.pem

	I1226 13:57:16.171669    4606 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17857-1142/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)

	I1226 13:57:16.191668    4606 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/17857-1142/.minikube/machines/server.pem -> /etc/docker/server.pem

	I1226 13:57:16.191744    4606 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17857-1142/.minikube/machines/server.pem --> /etc/docker/server.pem (1257 bytes)

	I1226 13:57:16.212021    4606 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/17857-1142/.minikube/machines/server-key.pem -> /etc/docker/server-key.pem

	I1226 13:57:16.212091    4606 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17857-1142/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)

	I1226 13:57:16.232220    4606 provision.go:86] duration metric: configureAuth took 659.123403ms

	I1226 13:57:16.232238    4606 ubuntu.go:193] setting minikube options for container-runtime

	I1226 13:57:16.232392    4606 config.go:182] Loaded profile config "ingress-addon-legacy-212000": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.18.20

	I1226 13:57:16.232464    4606 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ingress-addon-legacy-212000

	I1226 13:57:16.282772    4606 main.go:141] libmachine: Using SSH client type: native

	I1226 13:57:16.283067    4606 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x1406660] 0x1409340 <nil>  [] 0s} 127.0.0.1 50500 <nil> <nil>}

	I1226 13:57:16.283078    4606 main.go:141] libmachine: About to run SSH command:

	df --output=fstype / | tail -n 1

	I1226 13:57:16.402405    4606 main.go:141] libmachine: SSH cmd err, output: <nil>: overlay

	I1226 13:57:16.402422    4606 ubuntu.go:71] root file system type: overlay

	I1226 13:57:16.402536    4606 provision.go:309] Updating docker unit: /lib/systemd/system/docker.service ...

	I1226 13:57:16.402631    4606 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ingress-addon-legacy-212000

	I1226 13:57:16.453811    4606 main.go:141] libmachine: Using SSH client type: native

	I1226 13:57:16.454107    4606 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x1406660] 0x1409340 <nil>  [] 0s} 127.0.0.1 50500 <nil> <nil>}

	I1226 13:57:16.454159    4606 main.go:141] libmachine: About to run SSH command:

	sudo mkdir -p /lib/systemd/system && printf %s "[Unit]

	Description=Docker Application Container Engine

	Documentation=https://docs.docker.com

	BindsTo=containerd.service

	After=network-online.target firewalld.service containerd.service

	Wants=network-online.target

	Requires=docker.socket

	StartLimitBurst=3

	StartLimitIntervalSec=60

	[Service]

	Type=notify

	Restart=on-failure

	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	# The base configuration already specifies an 'ExecStart=...' command. The first directive

	# here is to clear out that command inherited from the base configuration. Without this,

	# the command from the base configuration and the command specified here are treated as

	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	# will catch this invalid input and refuse to start the service with an error like:

	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	ExecStart=

	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12 

	ExecReload=/bin/kill -s HUP \$MAINPID

	# Having non-zero Limit*s causes performance problems due to accounting overhead

	# in the kernel. We recommend using cgroups to do container-local accounting.

	LimitNOFILE=infinity

	LimitNPROC=infinity

	LimitCORE=infinity

	# Uncomment TasksMax if your systemd version supports it.

	# Only systemd 226 and above support this version.

	TasksMax=infinity

	TimeoutStartSec=0

	# set delegate yes so that systemd does not reset the cgroups of docker containers

	Delegate=yes

	# kill only the docker process, not all processes in the cgroup

	KillMode=process

	[Install]

	WantedBy=multi-user.target

	" | sudo tee /lib/systemd/system/docker.service.new

	I1226 13:57:16.582392    4606 main.go:141] libmachine: SSH cmd err, output: <nil>: [Unit]

	Description=Docker Application Container Engine

	Documentation=https://docs.docker.com

	BindsTo=containerd.service

	After=network-online.target firewalld.service containerd.service

	Wants=network-online.target

	Requires=docker.socket

	StartLimitBurst=3

	StartLimitIntervalSec=60

	[Service]

	Type=notify

	Restart=on-failure

	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	# The base configuration already specifies an 'ExecStart=...' command. The first directive

	# here is to clear out that command inherited from the base configuration. Without this,

	# the command from the base configuration and the command specified here are treated as

	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	# will catch this invalid input and refuse to start the service with an error like:

	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	ExecStart=

	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12 

	ExecReload=/bin/kill -s HUP $MAINPID

	# Having non-zero Limit*s causes performance problems due to accounting overhead

	# in the kernel. We recommend using cgroups to do container-local accounting.

	LimitNOFILE=infinity

	LimitNPROC=infinity

	LimitCORE=infinity

	# Uncomment TasksMax if your systemd version supports it.

	# Only systemd 226 and above support this version.

	TasksMax=infinity

	TimeoutStartSec=0

	# set delegate yes so that systemd does not reset the cgroups of docker containers

	Delegate=yes

	# kill only the docker process, not all processes in the cgroup

	KillMode=process

	[Install]

	WantedBy=multi-user.target

	I1226 13:57:16.582486    4606 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ingress-addon-legacy-212000

	I1226 13:57:16.633249    4606 main.go:141] libmachine: Using SSH client type: native

	I1226 13:57:16.633565    4606 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x1406660] 0x1409340 <nil>  [] 0s} 127.0.0.1 50500 <nil> <nil>}

	I1226 13:57:16.633578    4606 main.go:141] libmachine: About to run SSH command:

	sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }

	I1226 13:57:17.192004    4606 main.go:141] libmachine: SSH cmd err, output: <nil>: --- /lib/systemd/system/docker.service	2023-10-26 09:06:22.000000000 +0000

	+++ /lib/systemd/system/docker.service.new	2023-12-26 21:57:16.580055962 +0000

	@@ -1,30 +1,32 @@

	 [Unit]

	 Description=Docker Application Container Engine

	 Documentation=https://docs.docker.com

	-After=network-online.target docker.socket firewalld.service containerd.service time-set.target

	-Wants=network-online.target containerd.service

	+BindsTo=containerd.service

	+After=network-online.target firewalld.service containerd.service

	+Wants=network-online.target

	 Requires=docker.socket

	+StartLimitBurst=3

	+StartLimitIntervalSec=60

	 [Service]

	 Type=notify

	-# the default is not to use systemd for cgroups because the delegate issues still

	-# exists and systemd currently does not support the cgroup feature set required

	-# for containers run by docker

	-ExecStart=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock

	-ExecReload=/bin/kill -s HUP $MAINPID

	-TimeoutStartSec=0

	-RestartSec=2

	-Restart=always

	+Restart=on-failure

	-# Note that StartLimit* options were moved from "Service" to "Unit" in systemd 229.

	-# Both the old, and new location are accepted by systemd 229 and up, so using the old location

	-# to make them work for either version of systemd.

	-StartLimitBurst=3

	-# Note that StartLimitInterval was renamed to StartLimitIntervalSec in systemd 230.

	-# Both the old, and new name are accepted by systemd 230 and up, so using the old name to make

	-# this option work for either version of systemd.

	-StartLimitInterval=60s

	+

	+# This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	+# The base configuration already specifies an 'ExecStart=...' command. The first directive

	+# here is to clear out that command inherited from the base configuration. Without this,

	+# the command from the base configuration and the command specified here are treated as

	+# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	+# will catch this invalid input and refuse to start the service with an error like:

	+#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	+

	+# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	+# container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	+ExecStart=

	+ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12 

	+ExecReload=/bin/kill -s HUP $MAINPID

	 # Having non-zero Limit*s causes performance problems due to accounting overhead

	 # in the kernel. We recommend using cgroups to do container-local accounting.

	@@ -32,16 +34,16 @@

	 LimitNPROC=infinity

	 LimitCORE=infinity

	-# Comment TasksMax if your systemd version does not support it.

	-# Only systemd 226 and above support this option.

	+# Uncomment TasksMax if your systemd version supports it.

	+# Only systemd 226 and above support this version.

	 TasksMax=infinity

	+TimeoutStartSec=0

	 # set delegate yes so that systemd does not reset the cgroups of docker containers

	 Delegate=yes

	 # kill only the docker process, not all processes in the cgroup

	 KillMode=process

	-OOMScoreAdjust=-500

	 [Install]

	 WantedBy=multi-user.target

	Synchronizing state of docker.service with SysV service script with /lib/systemd/systemd-sysv-install.

	Executing: /lib/systemd/systemd-sysv-install enable docker

	I1226 13:57:17.192029    4606 machine.go:91] provisioned docker machine in 1.969581285s

	I1226 13:57:17.192045    4606 client.go:171] LocalClient.Create took 6.236193413s

	I1226 13:57:17.192062    4606 start.go:167] duration metric: libmachine.API.Create for "ingress-addon-legacy-212000" took 6.236273162s

	I1226 13:57:17.192069    4606 start.go:300] post-start starting for "ingress-addon-legacy-212000" (driver="docker")

	I1226 13:57:17.192078    4606 start.go:329] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]

	I1226 13:57:17.192143    4606 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs

	I1226 13:57:17.192198    4606 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ingress-addon-legacy-212000

	I1226 13:57:17.245654    4606 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:50500 SSHKeyPath:/Users/jenkins/minikube-integration/17857-1142/.minikube/machines/ingress-addon-legacy-212000/id_rsa Username:docker}

	I1226 13:57:17.333320    4606 ssh_runner.go:195] Run: cat /etc/os-release

	I1226 13:57:17.337228    4606 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found

	I1226 13:57:17.337252    4606 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found

	I1226 13:57:17.337266    4606 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found

	I1226 13:57:17.337272    4606 info.go:137] Remote host: Ubuntu 22.04.3 LTS

	I1226 13:57:17.337282    4606 filesync.go:126] Scanning /Users/jenkins/minikube-integration/17857-1142/.minikube/addons for local assets ...

	I1226 13:57:17.337375    4606 filesync.go:126] Scanning /Users/jenkins/minikube-integration/17857-1142/.minikube/files for local assets ...

	I1226 13:57:17.337565    4606 filesync.go:149] local asset: /Users/jenkins/minikube-integration/17857-1142/.minikube/files/etc/ssl/certs/16122.pem -> 16122.pem in /etc/ssl/certs

	I1226 13:57:17.337572    4606 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/17857-1142/.minikube/files/etc/ssl/certs/16122.pem -> /etc/ssl/certs/16122.pem

	I1226 13:57:17.337773    4606 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs

	I1226 13:57:17.345809    4606 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17857-1142/.minikube/files/etc/ssl/certs/16122.pem --> /etc/ssl/certs/16122.pem (1708 bytes)

	I1226 13:57:17.365828    4606 start.go:303] post-start completed in 173.750694ms

	I1226 13:57:17.366399    4606 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ingress-addon-legacy-212000

	I1226 13:57:17.418173    4606 profile.go:148] Saving config to /Users/jenkins/minikube-integration/17857-1142/.minikube/profiles/ingress-addon-legacy-212000/config.json ...

	I1226 13:57:17.418617    4606 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I1226 13:57:17.418688    4606 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ingress-addon-legacy-212000

	I1226 13:57:17.469530    4606 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:50500 SSHKeyPath:/Users/jenkins/minikube-integration/17857-1142/.minikube/machines/ingress-addon-legacy-212000/id_rsa Username:docker}

	I1226 13:57:17.553826    4606 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"

	I1226 13:57:17.558661    4606 start.go:128] duration metric: createHost completed in 6.625573873s

	I1226 13:57:17.558676    4606 start.go:83] releasing machines lock for "ingress-addon-legacy-212000", held for 6.625660387s

	I1226 13:57:17.558755    4606 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ingress-addon-legacy-212000

	I1226 13:57:17.609491    4606 ssh_runner.go:195] Run: cat /version.json

	I1226 13:57:17.609516    4606 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/

	I1226 13:57:17.609559    4606 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ingress-addon-legacy-212000

	I1226 13:57:17.609590    4606 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ingress-addon-legacy-212000

	I1226 13:57:17.664444    4606 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:50500 SSHKeyPath:/Users/jenkins/minikube-integration/17857-1142/.minikube/machines/ingress-addon-legacy-212000/id_rsa Username:docker}

	I1226 13:57:17.664455    4606 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:50500 SSHKeyPath:/Users/jenkins/minikube-integration/17857-1142/.minikube/machines/ingress-addon-legacy-212000/id_rsa Username:docker}

	I1226 13:57:17.856305    4606 ssh_runner.go:195] Run: systemctl --version

	I1226 13:57:17.861183    4606 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"

	I1226 13:57:17.865974    4606 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "grep -q loopback {} && ( grep -q name {} || sudo sed -i '/"type": "loopback"/i \ \ \ \ "name": "loopback",' {} ) && sudo sed -i 's|"cniVersion": ".*"|"cniVersion": "1.0.0"|g' {}" ;

	I1226 13:57:17.887674    4606 cni.go:230] loopback cni configuration patched: "/etc/cni/net.d/*loopback.conf*" found

	I1226 13:57:17.887757    4606 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *bridge* -not -name *podman* -not -name *.mk_disabled -printf "%p, " -exec sh -c "sudo sed -i -r -e '/"dst": ".*:.*"/d' -e 's|^(.*)"dst": (.*)[,*]$|\1"dst": \2|g' -e '/"subnet": ".*:.*"/d' -e 's|^(.*)"subnet": ".*"(.*)[,*]$|\1"subnet": "10.244.0.0/16"\2|g' {}" ;

	I1226 13:57:17.903080    4606 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *podman* -not -name *.mk_disabled -printf "%p, " -exec sh -c "sudo sed -i -r -e 's|^(.*)"subnet": ".*"(.*)$|\1"subnet": "10.244.0.0/16"\2|g' -e 's|^(.*)"gateway": ".*"(.*)$|\1"gateway": "10.244.0.1"\2|g' {}" ;

	I1226 13:57:17.917961    4606 cni.go:308] configured [/etc/cni/net.d/100-crio-bridge.conf, /etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)

	I1226 13:57:17.932229    4606 start.go:475] detecting cgroup driver to use...

	I1226 13:57:17.932246    4606 detect.go:196] detected "cgroupfs" cgroup driver on host os

	I1226 13:57:17.932358    4606 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///run/containerd/containerd.sock

	" | sudo tee /etc/crictl.yaml"

	I1226 13:57:17.946713    4606 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.2"|' /etc/containerd/config.toml"

	I1226 13:57:17.956039    4606 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"

	I1226 13:57:17.965283    4606 containerd.go:145] configuring containerd to use "cgroupfs" as cgroup driver...

	I1226 13:57:17.965346    4606 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"

	I1226 13:57:17.974559    4606 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"

	I1226 13:57:17.983669    4606 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"

	I1226 13:57:17.992839    4606 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"

	I1226 13:57:18.001900    4606 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"

	I1226 13:57:18.010496    4606 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"

	I1226 13:57:18.019665    4606 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables

	I1226 13:57:18.027774    4606 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"

	I1226 13:57:18.035680    4606 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I1226 13:57:18.089735    4606 ssh_runner.go:195] Run: sudo systemctl restart containerd

	I1226 13:57:18.166349    4606 start.go:475] detecting cgroup driver to use...

	I1226 13:57:18.166375    4606 detect.go:196] detected "cgroupfs" cgroup driver on host os

	I1226 13:57:18.166450    4606 ssh_runner.go:195] Run: sudo systemctl cat docker.service

	I1226 13:57:18.191607    4606 cruntime.go:279] skipping containerd shutdown because we are bound to it

	I1226 13:57:18.191682    4606 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio

	I1226 13:57:18.202891    4606 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/dockershim.sock

	" | sudo tee /etc/crictl.yaml"

	I1226 13:57:18.219675    4606 ssh_runner.go:195] Run: which cri-dockerd

	I1226 13:57:18.224706    4606 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/cri-docker.service.d

	I1226 13:57:18.233896    4606 ssh_runner.go:362] scp memory --> /etc/systemd/system/cri-docker.service.d/10-cni.conf (189 bytes)

	I1226 13:57:18.251219    4606 ssh_runner.go:195] Run: sudo systemctl unmask docker.service

	I1226 13:57:18.317295    4606 ssh_runner.go:195] Run: sudo systemctl enable docker.socket

	I1226 13:57:18.396748    4606 docker.go:560] configuring docker to use "cgroupfs" as cgroup driver...

	I1226 13:57:18.396844    4606 ssh_runner.go:362] scp memory --> /etc/docker/daemon.json (130 bytes)

	I1226 13:57:18.412891    4606 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I1226 13:57:18.496401    4606 ssh_runner.go:195] Run: sudo systemctl restart docker

	I1226 13:57:18.727739    4606 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}

	I1226 13:57:18.749913    4606 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}

	I1226 13:57:18.798028    4606 out.go:204] * Preparing Kubernetes v1.18.20 on Docker 24.0.7 ...

	I1226 13:57:18.798155    4606 cli_runner.go:164] Run: docker exec -t ingress-addon-legacy-212000 dig +short host.docker.internal

	I1226 13:57:18.916423    4606 network.go:96] got host ip for mount in container by digging dns: 192.168.65.254

	I1226 13:57:18.916523    4606 ssh_runner.go:195] Run: grep 192.168.65.254	host.minikube.internal$ /etc/hosts

	I1226 13:57:18.920986    4606 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.65.254	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I1226 13:57:18.931683    4606 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "8443/tcp") 0).HostPort}}'" ingress-addon-legacy-212000

	I1226 13:57:18.983359    4606 preload.go:132] Checking if preload exists for k8s version v1.18.20 and runtime docker

	I1226 13:57:18.983437    4606 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}

	I1226 13:57:19.003545    4606 docker.go:671] Got preloaded images: -- stdout --

	k8s.gcr.io/kube-proxy:v1.18.20

	k8s.gcr.io/kube-apiserver:v1.18.20

	k8s.gcr.io/kube-scheduler:v1.18.20

	k8s.gcr.io/kube-controller-manager:v1.18.20

	gcr.io/k8s-minikube/storage-provisioner:v5

	k8s.gcr.io/pause:3.2

	k8s.gcr.io/coredns:1.6.7

	k8s.gcr.io/etcd:3.4.3-0

	-- /stdout --

	I1226 13:57:19.003561    4606 docker.go:677] registry.k8s.io/kube-apiserver:v1.18.20 wasn't preloaded

	I1226 13:57:19.003616    4606 ssh_runner.go:195] Run: sudo cat /var/lib/docker/image/overlay2/repositories.json

	I1226 13:57:19.011748    4606 ssh_runner.go:195] Run: which lz4

	I1226 13:57:19.015627    4606 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/17857-1142/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.18.20-docker-overlay2-amd64.tar.lz4 -> /preloaded.tar.lz4

	I1226 13:57:19.015732    4606 ssh_runner.go:195] Run: stat -c "%s %y" /preloaded.tar.lz4

	I1226 13:57:19.019570    4606 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%s %y" /preloaded.tar.lz4: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/preloaded.tar.lz4': No such file or directory

	I1226 13:57:19.019592    4606 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17857-1142/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.18.20-docker-overlay2-amd64.tar.lz4 --> /preloaded.tar.lz4 (424164442 bytes)

	I1226 13:57:24.732744    4606 docker.go:635] Took 5.717089 seconds to copy over tarball

	I1226 13:57:24.732837    4606 ssh_runner.go:195] Run: sudo tar -I lz4 -C /var -xf /preloaded.tar.lz4

	I1226 13:57:26.403410    4606 ssh_runner.go:235] Completed: sudo tar -I lz4 -C /var -xf /preloaded.tar.lz4: (1.670568152s)

	I1226 13:57:26.403426    4606 ssh_runner.go:146] rm: /preloaded.tar.lz4

	I1226 13:57:26.447137    4606 ssh_runner.go:195] Run: sudo cat /var/lib/docker/image/overlay2/repositories.json

	I1226 13:57:26.455879    4606 ssh_runner.go:362] scp memory --> /var/lib/docker/image/overlay2/repositories.json (2502 bytes)

	I1226 13:57:26.470967    4606 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I1226 13:57:26.525945    4606 ssh_runner.go:195] Run: sudo systemctl restart docker

	I1226 13:57:27.554884    4606 ssh_runner.go:235] Completed: sudo systemctl restart docker: (1.02892653s)

	I1226 13:57:27.554993    4606 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}

	I1226 13:57:27.574741    4606 docker.go:671] Got preloaded images: -- stdout --

	k8s.gcr.io/kube-proxy:v1.18.20

	k8s.gcr.io/kube-apiserver:v1.18.20

	k8s.gcr.io/kube-scheduler:v1.18.20

	k8s.gcr.io/kube-controller-manager:v1.18.20

	gcr.io/k8s-minikube/storage-provisioner:v5

	k8s.gcr.io/pause:3.2

	k8s.gcr.io/coredns:1.6.7

	k8s.gcr.io/etcd:3.4.3-0

	-- /stdout --

	I1226 13:57:27.574758    4606 docker.go:677] registry.k8s.io/kube-apiserver:v1.18.20 wasn't preloaded

	I1226 13:57:27.574769    4606 cache_images.go:88] LoadImages start: [registry.k8s.io/kube-apiserver:v1.18.20 registry.k8s.io/kube-controller-manager:v1.18.20 registry.k8s.io/kube-scheduler:v1.18.20 registry.k8s.io/kube-proxy:v1.18.20 registry.k8s.io/pause:3.2 registry.k8s.io/etcd:3.4.3-0 registry.k8s.io/coredns:1.6.7 gcr.io/k8s-minikube/storage-provisioner:v5]

	I1226 13:57:27.580798    4606 image.go:134] retrieving image: registry.k8s.io/kube-controller-manager:v1.18.20

	I1226 13:57:27.580973    4606 image.go:134] retrieving image: registry.k8s.io/kube-scheduler:v1.18.20

	I1226 13:57:27.581974    4606 image.go:134] retrieving image: registry.k8s.io/kube-apiserver:v1.18.20

	I1226 13:57:27.583731    4606 image.go:134] retrieving image: registry.k8s.io/etcd:3.4.3-0

	I1226 13:57:27.583885    4606 image.go:134] retrieving image: registry.k8s.io/coredns:1.6.7

	I1226 13:57:27.583928    4606 image.go:134] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v5

	I1226 13:57:27.583956    4606 image.go:134] retrieving image: registry.k8s.io/pause:3.2

	I1226 13:57:27.584301    4606 image.go:134] retrieving image: registry.k8s.io/kube-proxy:v1.18.20

	I1226 13:57:27.587914    4606 image.go:177] daemon lookup for registry.k8s.io/kube-scheduler:v1.18.20: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.18.20

	I1226 13:57:27.588265    4606 image.go:177] daemon lookup for registry.k8s.io/kube-controller-manager:v1.18.20: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.18.20

	I1226 13:57:27.589608    4606 image.go:177] daemon lookup for registry.k8s.io/kube-apiserver:v1.18.20: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.18.20

	I1226 13:57:27.590725    4606 image.go:177] daemon lookup for registry.k8s.io/coredns:1.6.7: Error response from daemon: No such image: registry.k8s.io/coredns:1.6.7

	I1226 13:57:27.591278    4606 image.go:177] daemon lookup for registry.k8s.io/etcd:3.4.3-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.4.3-0

	I1226 13:57:27.591341    4606 image.go:177] daemon lookup for gcr.io/k8s-minikube/storage-provisioner:v5: Error response from daemon: No such image: gcr.io/k8s-minikube/storage-provisioner:v5

	I1226 13:57:27.592766    4606 image.go:177] daemon lookup for registry.k8s.io/pause:3.2: Error response from daemon: No such image: registry.k8s.io/pause:3.2

	I1226 13:57:27.593413    4606 image.go:177] daemon lookup for registry.k8s.io/kube-proxy:v1.18.20: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.18.20

	I1226 13:57:29.391790    4606 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/kube-scheduler:v1.18.20

	I1226 13:57:29.410292    4606 cache_images.go:116] "registry.k8s.io/kube-scheduler:v1.18.20" needs transfer: "registry.k8s.io/kube-scheduler:v1.18.20" does not exist at hash "a05a1a79adaad058478b7638d2e73cf408b283305081516fbe02706b0e205346" in container runtime

	I1226 13:57:29.410330    4606 docker.go:323] Removing image: registry.k8s.io/kube-scheduler:v1.18.20

	I1226 13:57:29.410391    4606 ssh_runner.go:195] Run: docker rmi registry.k8s.io/kube-scheduler:v1.18.20

	I1226 13:57:29.429449    4606 cache_images.go:286] Loading image from: /Users/jenkins/minikube-integration/17857-1142/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.18.20

	I1226 13:57:29.449224    4606 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/kube-apiserver:v1.18.20

	I1226 13:57:29.466526    4606 cache_images.go:116] "registry.k8s.io/kube-apiserver:v1.18.20" needs transfer: "registry.k8s.io/kube-apiserver:v1.18.20" does not exist at hash "7d8d2960de69688eab5698081441539a1662f47e092488973e455a8334955cb1" in container runtime

	I1226 13:57:29.466550    4606 docker.go:323] Removing image: registry.k8s.io/kube-apiserver:v1.18.20

	I1226 13:57:29.466612    4606 ssh_runner.go:195] Run: docker rmi registry.k8s.io/kube-apiserver:v1.18.20

	I1226 13:57:29.485387    4606 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/kube-controller-manager:v1.18.20

	I1226 13:57:29.485610    4606 cache_images.go:286] Loading image from: /Users/jenkins/minikube-integration/17857-1142/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.18.20

	I1226 13:57:29.487521    4606 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/pause:3.2

	I1226 13:57:29.501601    4606 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/kube-proxy:v1.18.20

	I1226 13:57:29.503178    4606 cache_images.go:116] "registry.k8s.io/kube-controller-manager:v1.18.20" needs transfer: "registry.k8s.io/kube-controller-manager:v1.18.20" does not exist at hash "e7c545a60706cf009a893afdc7dba900cc2e342b8042b9c421d607ca41e8b290" in container runtime

	I1226 13:57:29.503209    4606 docker.go:323] Removing image: registry.k8s.io/kube-controller-manager:v1.18.20

	I1226 13:57:29.503286    4606 ssh_runner.go:195] Run: docker rmi registry.k8s.io/kube-controller-manager:v1.18.20

	I1226 13:57:29.505135    4606 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/coredns:1.6.7

	I1226 13:57:29.507876    4606 cache_images.go:116] "registry.k8s.io/pause:3.2" needs transfer: "registry.k8s.io/pause:3.2" does not exist at hash "80d28bedfe5dec59da9ebf8e6260224ac9008ab5c11dbbe16ee3ba3e4439ac2c" in container runtime

	I1226 13:57:29.507906    4606 docker.go:323] Removing image: registry.k8s.io/pause:3.2

	I1226 13:57:29.507984    4606 ssh_runner.go:195] Run: docker rmi registry.k8s.io/pause:3.2

	I1226 13:57:29.517005    4606 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/etcd:3.4.3-0

	I1226 13:57:29.563352    4606 cache_images.go:116] "registry.k8s.io/kube-proxy:v1.18.20" needs transfer: "registry.k8s.io/kube-proxy:v1.18.20" does not exist at hash "27f8b8d51985f755cfb3ffea424fa34865cc0da63e99378d8202f923c3c5a8ba" in container runtime

	I1226 13:57:29.563404    4606 docker.go:323] Removing image: registry.k8s.io/kube-proxy:v1.18.20

	I1226 13:57:29.563532    4606 ssh_runner.go:195] Run: docker rmi registry.k8s.io/kube-proxy:v1.18.20

	I1226 13:57:29.567915    4606 cache_images.go:286] Loading image from: /Users/jenkins/minikube-integration/17857-1142/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.18.20

	I1226 13:57:29.569725    4606 cache_images.go:116] "registry.k8s.io/coredns:1.6.7" needs transfer: "registry.k8s.io/coredns:1.6.7" does not exist at hash "67da37a9a360e600e74464da48437257b00a754c77c40f60c65e4cb327c34bd5" in container runtime

	I1226 13:57:29.569760    4606 docker.go:323] Removing image: registry.k8s.io/coredns:1.6.7

	I1226 13:57:29.569798    4606 cache_images.go:286] Loading image from: /Users/jenkins/minikube-integration/17857-1142/.minikube/cache/images/amd64/registry.k8s.io/pause_3.2

	I1226 13:57:29.569846    4606 ssh_runner.go:195] Run: docker rmi registry.k8s.io/coredns:1.6.7

	I1226 13:57:29.577062    4606 cache_images.go:116] "registry.k8s.io/etcd:3.4.3-0" needs transfer: "registry.k8s.io/etcd:3.4.3-0" does not exist at hash "303ce5db0e90dab1c5728ec70d21091201a23cdf8aeca70ab54943bbaaf0833f" in container runtime

	I1226 13:57:29.577100    4606 docker.go:323] Removing image: registry.k8s.io/etcd:3.4.3-0

	I1226 13:57:29.577186    4606 ssh_runner.go:195] Run: docker rmi registry.k8s.io/etcd:3.4.3-0

	I1226 13:57:29.586503    4606 cache_images.go:286] Loading image from: /Users/jenkins/minikube-integration/17857-1142/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.18.20

	I1226 13:57:29.591767    4606 cache_images.go:286] Loading image from: /Users/jenkins/minikube-integration/17857-1142/.minikube/cache/images/amd64/registry.k8s.io/coredns_1.6.7

	I1226 13:57:29.597776    4606 cache_images.go:286] Loading image from: /Users/jenkins/minikube-integration/17857-1142/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.4.3-0

	I1226 13:57:29.999231    4606 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} gcr.io/k8s-minikube/storage-provisioner:v5

	I1226 13:57:30.018593    4606 cache_images.go:92] LoadImages completed in 2.443825866s

	W1226 13:57:30.018645    4606 out.go:239] X Unable to load cached images: loading cached images: stat /Users/jenkins/minikube-integration/17857-1142/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.18.20: no such file or directory

	X Unable to load cached images: loading cached images: stat /Users/jenkins/minikube-integration/17857-1142/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.18.20: no such file or directory

	I1226 13:57:30.018733    4606 ssh_runner.go:195] Run: docker info --format {{.CgroupDriver}}

	I1226 13:57:30.067912    4606 cni.go:84] Creating CNI manager for ""

	I1226 13:57:30.067930    4606 cni.go:162] CNI unnecessary in this configuration, recommending no CNI

	I1226 13:57:30.067941    4606 kubeadm.go:87] Using pod CIDR: 10.244.0.0/16

	I1226 13:57:30.067957    4606 kubeadm.go:176] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.49.2 APIServerPort:8443 KubernetesVersion:v1.18.20 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:ingress-addon-legacy-212000 NodeName:ingress-addon-legacy-212000 DNSDomain:cluster.local CRISocket:/var/run/dockershim.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.49.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.49.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.

crt StaticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}

	I1226 13:57:30.068041    4606 kubeadm.go:181] kubeadm config:

	apiVersion: kubeadm.k8s.io/v1beta2

	kind: InitConfiguration

	localAPIEndpoint:

	  advertiseAddress: 192.168.49.2

	  bindPort: 8443

	bootstrapTokens:

	  - groups:

	      - system:bootstrappers:kubeadm:default-node-token

	    ttl: 24h0m0s

	    usages:

	      - signing

	      - authentication

	nodeRegistration:

	  criSocket: /var/run/dockershim.sock

	  name: "ingress-addon-legacy-212000"

	  kubeletExtraArgs:

	    node-ip: 192.168.49.2

	  taints: []

	---

	apiVersion: kubeadm.k8s.io/v1beta2

	kind: ClusterConfiguration

	apiServer:

	  certSANs: ["127.0.0.1", "localhost", "192.168.49.2"]

	  extraArgs:

	    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"

	controllerManager:

	  extraArgs:

	    allocate-node-cidrs: "true"

	    leader-elect: "false"

	scheduler:

	  extraArgs:

	    leader-elect: "false"

	certificatesDir: /var/lib/minikube/certs

	clusterName: mk

	controlPlaneEndpoint: control-plane.minikube.internal:8443

	dns:

	  type: CoreDNS

	etcd:

	  local:

	    dataDir: /var/lib/minikube/etcd

	    extraArgs:

	      proxy-refresh-interval: "70000"

	kubernetesVersion: v1.18.20

	networking:

	  dnsDomain: cluster.local

	  podSubnet: "10.244.0.0/16"

	  serviceSubnet: 10.96.0.0/12

	---

	apiVersion: kubelet.config.k8s.io/v1beta1

	kind: KubeletConfiguration

	authentication:

	  x509:

	    clientCAFile: /var/lib/minikube/certs/ca.crt

	cgroupDriver: cgroupfs

	hairpinMode: hairpin-veth

	runtimeRequestTimeout: 15m

	clusterDomain: "cluster.local"

	# disable disk resource management by default

	imageGCHighThresholdPercent: 100

	evictionHard:

	  nodefs.available: "0%"

	  nodefs.inodesFree: "0%"

	  imagefs.available: "0%"

	failSwapOn: false

	staticPodPath: /etc/kubernetes/manifests

	---

	apiVersion: kubeproxy.config.k8s.io/v1alpha1

	kind: KubeProxyConfiguration

	clusterCIDR: "10.244.0.0/16"

	metricsBindAddress: 0.0.0.0:10249

	conntrack:

	  maxPerCore: 0

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"

	  tcpEstablishedTimeout: 0s

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"

	  tcpCloseWaitTimeout: 0s

	I1226 13:57:30.068086    4606 kubeadm.go:976] kubelet [Unit]

	Wants=docker.socket

	[Service]

	ExecStart=

	ExecStart=/var/lib/minikube/binaries/v1.18.20/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=docker --hostname-override=ingress-addon-legacy-212000 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.49.2

	[Install]

	 config:

	{KubernetesVersion:v1.18.20 ClusterName:ingress-addon-legacy-212000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:}

	I1226 13:57:30.068148    4606 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.18.20

	I1226 13:57:30.076911    4606 binaries.go:44] Found k8s binaries, skipping transfer

	I1226 13:57:30.076975    4606 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube

	I1226 13:57:30.085091    4606 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (354 bytes)

	I1226 13:57:30.100516    4606 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (353 bytes)

	I1226 13:57:30.116002    4606 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2124 bytes)

	I1226 13:57:30.131365    4606 ssh_runner.go:195] Run: grep 192.168.49.2	control-plane.minikube.internal$ /etc/hosts

	I1226 13:57:30.135525    4606 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.49.2	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I1226 13:57:30.145672    4606 certs.go:56] Setting up /Users/jenkins/minikube-integration/17857-1142/.minikube/profiles/ingress-addon-legacy-212000 for IP: 192.168.49.2

	I1226 13:57:30.145692    4606 certs.go:190] acquiring lock for shared ca certs: {Name:mka50056f4f913dbfc39d9ec6dce51b7903f470c Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1226 13:57:30.145882    4606 certs.go:199] skipping minikubeCA CA generation: /Users/jenkins/minikube-integration/17857-1142/.minikube/ca.key

	I1226 13:57:30.145950    4606 certs.go:199] skipping proxyClientCA CA generation: /Users/jenkins/minikube-integration/17857-1142/.minikube/proxy-client-ca.key

	I1226 13:57:30.145996    4606 certs.go:319] generating minikube-user signed cert: /Users/jenkins/minikube-integration/17857-1142/.minikube/profiles/ingress-addon-legacy-212000/client.key

	I1226 13:57:30.146009    4606 crypto.go:68] Generating cert /Users/jenkins/minikube-integration/17857-1142/.minikube/profiles/ingress-addon-legacy-212000/client.crt with IP's: []

	I1226 13:57:30.216088    4606 crypto.go:156] Writing cert to /Users/jenkins/minikube-integration/17857-1142/.minikube/profiles/ingress-addon-legacy-212000/client.crt ...

	I1226 13:57:30.216101    4606 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/17857-1142/.minikube/profiles/ingress-addon-legacy-212000/client.crt: {Name:mkdb89593cda27d340c2fc40a1cc08d197bab546 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1226 13:57:30.216403    4606 crypto.go:164] Writing key to /Users/jenkins/minikube-integration/17857-1142/.minikube/profiles/ingress-addon-legacy-212000/client.key ...

	I1226 13:57:30.216412    4606 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/17857-1142/.minikube/profiles/ingress-addon-legacy-212000/client.key: {Name:mk5500dd889f869ee19b4be531f65696e771272f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1226 13:57:30.216636    4606 certs.go:319] generating minikube signed cert: /Users/jenkins/minikube-integration/17857-1142/.minikube/profiles/ingress-addon-legacy-212000/apiserver.key.dd3b5fb2

	I1226 13:57:30.216655    4606 crypto.go:68] Generating cert /Users/jenkins/minikube-integration/17857-1142/.minikube/profiles/ingress-addon-legacy-212000/apiserver.crt.dd3b5fb2 with IP's: [192.168.49.2 10.96.0.1 127.0.0.1 10.0.0.1]

	I1226 13:57:30.373223    4606 crypto.go:156] Writing cert to /Users/jenkins/minikube-integration/17857-1142/.minikube/profiles/ingress-addon-legacy-212000/apiserver.crt.dd3b5fb2 ...

	I1226 13:57:30.373234    4606 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/17857-1142/.minikube/profiles/ingress-addon-legacy-212000/apiserver.crt.dd3b5fb2: {Name:mk9341822f5ae85d7bfe80adcbdf65e2d2422e0a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1226 13:57:30.373493    4606 crypto.go:164] Writing key to /Users/jenkins/minikube-integration/17857-1142/.minikube/profiles/ingress-addon-legacy-212000/apiserver.key.dd3b5fb2 ...

	I1226 13:57:30.373502    4606 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/17857-1142/.minikube/profiles/ingress-addon-legacy-212000/apiserver.key.dd3b5fb2: {Name:mk24e5b8e5888d42d7ca37620dd788ed2eafb6a5 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1226 13:57:30.373692    4606 certs.go:337] copying /Users/jenkins/minikube-integration/17857-1142/.minikube/profiles/ingress-addon-legacy-212000/apiserver.crt.dd3b5fb2 -> /Users/jenkins/minikube-integration/17857-1142/.minikube/profiles/ingress-addon-legacy-212000/apiserver.crt

	I1226 13:57:30.373868    4606 certs.go:341] copying /Users/jenkins/minikube-integration/17857-1142/.minikube/profiles/ingress-addon-legacy-212000/apiserver.key.dd3b5fb2 -> /Users/jenkins/minikube-integration/17857-1142/.minikube/profiles/ingress-addon-legacy-212000/apiserver.key

	I1226 13:57:30.374039    4606 certs.go:319] generating aggregator signed cert: /Users/jenkins/minikube-integration/17857-1142/.minikube/profiles/ingress-addon-legacy-212000/proxy-client.key

	I1226 13:57:30.374052    4606 crypto.go:68] Generating cert /Users/jenkins/minikube-integration/17857-1142/.minikube/profiles/ingress-addon-legacy-212000/proxy-client.crt with IP's: []

	I1226 13:57:30.536242    4606 crypto.go:156] Writing cert to /Users/jenkins/minikube-integration/17857-1142/.minikube/profiles/ingress-addon-legacy-212000/proxy-client.crt ...

	I1226 13:57:30.536257    4606 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/17857-1142/.minikube/profiles/ingress-addon-legacy-212000/proxy-client.crt: {Name:mkd69346a6f54560ee8de5643374cff16fdc56e2 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1226 13:57:30.536574    4606 crypto.go:164] Writing key to /Users/jenkins/minikube-integration/17857-1142/.minikube/profiles/ingress-addon-legacy-212000/proxy-client.key ...

	I1226 13:57:30.536583    4606 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/17857-1142/.minikube/profiles/ingress-addon-legacy-212000/proxy-client.key: {Name:mk52b8c8e0cac965b70977c514743dc17a8e0dca Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1226 13:57:30.536828    4606 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/17857-1142/.minikube/profiles/ingress-addon-legacy-212000/apiserver.crt -> /var/lib/minikube/certs/apiserver.crt

	I1226 13:57:30.536859    4606 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/17857-1142/.minikube/profiles/ingress-addon-legacy-212000/apiserver.key -> /var/lib/minikube/certs/apiserver.key

	I1226 13:57:30.536880    4606 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/17857-1142/.minikube/profiles/ingress-addon-legacy-212000/proxy-client.crt -> /var/lib/minikube/certs/proxy-client.crt

	I1226 13:57:30.536900    4606 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/17857-1142/.minikube/profiles/ingress-addon-legacy-212000/proxy-client.key -> /var/lib/minikube/certs/proxy-client.key

	I1226 13:57:30.536919    4606 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/17857-1142/.minikube/ca.crt -> /var/lib/minikube/certs/ca.crt

	I1226 13:57:30.536937    4606 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/17857-1142/.minikube/ca.key -> /var/lib/minikube/certs/ca.key

	I1226 13:57:30.536956    4606 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/17857-1142/.minikube/proxy-client-ca.crt -> /var/lib/minikube/certs/proxy-client-ca.crt

	I1226 13:57:30.536978    4606 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/17857-1142/.minikube/proxy-client-ca.key -> /var/lib/minikube/certs/proxy-client-ca.key

	I1226 13:57:30.537090    4606 certs.go:437] found cert: /Users/jenkins/minikube-integration/17857-1142/.minikube/certs/Users/jenkins/minikube-integration/17857-1142/.minikube/certs/1612.pem (1338 bytes)

	W1226 13:57:30.537143    4606 certs.go:433] ignoring /Users/jenkins/minikube-integration/17857-1142/.minikube/certs/Users/jenkins/minikube-integration/17857-1142/.minikube/certs/1612_empty.pem, impossibly tiny 0 bytes

	I1226 13:57:30.537153    4606 certs.go:437] found cert: /Users/jenkins/minikube-integration/17857-1142/.minikube/certs/Users/jenkins/minikube-integration/17857-1142/.minikube/certs/ca-key.pem (1679 bytes)

	I1226 13:57:30.537186    4606 certs.go:437] found cert: /Users/jenkins/minikube-integration/17857-1142/.minikube/certs/Users/jenkins/minikube-integration/17857-1142/.minikube/certs/ca.pem (1078 bytes)

	I1226 13:57:30.537218    4606 certs.go:437] found cert: /Users/jenkins/minikube-integration/17857-1142/.minikube/certs/Users/jenkins/minikube-integration/17857-1142/.minikube/certs/cert.pem (1123 bytes)

	I1226 13:57:30.537250    4606 certs.go:437] found cert: /Users/jenkins/minikube-integration/17857-1142/.minikube/certs/Users/jenkins/minikube-integration/17857-1142/.minikube/certs/key.pem (1679 bytes)

	I1226 13:57:30.537323    4606 certs.go:437] found cert: /Users/jenkins/minikube-integration/17857-1142/.minikube/files/etc/ssl/certs/Users/jenkins/minikube-integration/17857-1142/.minikube/files/etc/ssl/certs/16122.pem (1708 bytes)

	I1226 13:57:30.537370    4606 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/17857-1142/.minikube/files/etc/ssl/certs/16122.pem -> /usr/share/ca-certificates/16122.pem

	I1226 13:57:30.537392    4606 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/17857-1142/.minikube/ca.crt -> /usr/share/ca-certificates/minikubeCA.pem

	I1226 13:57:30.537409    4606 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/17857-1142/.minikube/certs/1612.pem -> /usr/share/ca-certificates/1612.pem

	I1226 13:57:30.537880    4606 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17857-1142/.minikube/profiles/ingress-addon-legacy-212000/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1399 bytes)

	I1226 13:57:30.558580    4606 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17857-1142/.minikube/profiles/ingress-addon-legacy-212000/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)

	I1226 13:57:30.579031    4606 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17857-1142/.minikube/profiles/ingress-addon-legacy-212000/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)

	I1226 13:57:30.599504    4606 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17857-1142/.minikube/profiles/ingress-addon-legacy-212000/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)

	I1226 13:57:30.619650    4606 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17857-1142/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)

	I1226 13:57:30.639968    4606 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17857-1142/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)

	I1226 13:57:30.660257    4606 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17857-1142/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)

	I1226 13:57:30.680459    4606 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17857-1142/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)

	I1226 13:57:30.700950    4606 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17857-1142/.minikube/files/etc/ssl/certs/16122.pem --> /usr/share/ca-certificates/16122.pem (1708 bytes)

	I1226 13:57:30.721509    4606 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17857-1142/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)

	I1226 13:57:30.741769    4606 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17857-1142/.minikube/certs/1612.pem --> /usr/share/ca-certificates/1612.pem (1338 bytes)

	I1226 13:57:30.761891    4606 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)

	I1226 13:57:30.777264    4606 ssh_runner.go:195] Run: openssl version

	I1226 13:57:30.782700    4606 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"

	I1226 13:57:30.791686    4606 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem

	I1226 13:57:30.795541    4606 certs.go:480] hashing: -rw-r--r-- 1 root root 1111 Dec 26 21:45 /usr/share/ca-certificates/minikubeCA.pem

	I1226 13:57:30.795582    4606 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem

	I1226 13:57:30.802161    4606 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"

	I1226 13:57:30.811320    4606 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/1612.pem && ln -fs /usr/share/ca-certificates/1612.pem /etc/ssl/certs/1612.pem"

	I1226 13:57:30.820047    4606 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/1612.pem

	I1226 13:57:30.824289    4606 certs.go:480] hashing: -rw-r--r-- 1 root root 1338 Dec 26 21:51 /usr/share/ca-certificates/1612.pem

	I1226 13:57:30.824336    4606 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/1612.pem

	I1226 13:57:30.830836    4606 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/1612.pem /etc/ssl/certs/51391683.0"

	I1226 13:57:30.839838    4606 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/16122.pem && ln -fs /usr/share/ca-certificates/16122.pem /etc/ssl/certs/16122.pem"

	I1226 13:57:30.848832    4606 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/16122.pem

	I1226 13:57:30.852898    4606 certs.go:480] hashing: -rw-r--r-- 1 root root 1708 Dec 26 21:51 /usr/share/ca-certificates/16122.pem

	I1226 13:57:30.852943    4606 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/16122.pem

	I1226 13:57:30.859492    4606 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/16122.pem /etc/ssl/certs/3ec20f2e.0"

	I1226 13:57:30.868242    4606 ssh_runner.go:195] Run: ls /var/lib/minikube/certs/etcd

	I1226 13:57:30.872160    4606 certs.go:353] certs directory doesn't exist, likely first start: ls /var/lib/minikube/certs/etcd: Process exited with status 2

	stdout:

	stderr:

	ls: cannot access '/var/lib/minikube/certs/etcd': No such file or directory

	I1226 13:57:30.872205    4606 kubeadm.go:404] StartCluster: {Name:ingress-addon-legacy-212000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1703498848-17857@sha256:81ae12a49915e4f02aa382dd3758a30a6649e1143c32b3d03309750104577c6c Memory:4096 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.18.20 ClusterName:ingress-addon-legacy-212000 Namespace:default APIServerName:minik

ubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.18.20 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimization

s:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:}

	I1226 13:57:30.872308    4606 ssh_runner.go:195] Run: docker ps --filter status=paused --filter=name=k8s_.*_(kube-system)_ --format={{.ID}}

	I1226 13:57:30.890411    4606 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd

	I1226 13:57:30.898766    4606 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml

	I1226 13:57:30.906983    4606 kubeadm.go:226] ignoring SystemVerification for kubeadm because of docker driver

	I1226 13:57:30.907037    4606 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf

	I1226 13:57:30.915051    4606 kubeadm.go:152] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2

	stdout:

	stderr:

	ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory

	I1226 13:57:30.915083    4606 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.18.20:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"

	I1226 13:57:30.971651    4606 kubeadm.go:322] [init] Using Kubernetes version: v1.18.20

	I1226 13:57:30.971697    4606 kubeadm.go:322] [preflight] Running pre-flight checks

	I1226 13:57:31.197522    4606 kubeadm.go:322] [preflight] Pulling images required for setting up a Kubernetes cluster

	I1226 13:57:31.197603    4606 kubeadm.go:322] [preflight] This might take a minute or two, depending on the speed of your internet connection

	I1226 13:57:31.197683    4606 kubeadm.go:322] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'

	I1226 13:57:31.361969    4606 kubeadm.go:322] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"

	I1226 13:57:31.362578    4606 kubeadm.go:322] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"

	I1226 13:57:31.362626    4606 kubeadm.go:322] [kubelet-start] Starting the kubelet

	I1226 13:57:31.434699    4606 kubeadm.go:322] [certs] Using certificateDir folder "/var/lib/minikube/certs"

	I1226 13:57:31.476831    4606 out.go:204]   - Generating certificates and keys ...

	I1226 13:57:31.476917    4606 kubeadm.go:322] [certs] Using existing ca certificate authority

	I1226 13:57:31.476992    4606 kubeadm.go:322] [certs] Using existing apiserver certificate and key on disk

	I1226 13:57:31.483596    4606 kubeadm.go:322] [certs] Generating "apiserver-kubelet-client" certificate and key

	I1226 13:57:31.678634    4606 kubeadm.go:322] [certs] Generating "front-proxy-ca" certificate and key

	I1226 13:57:31.927547    4606 kubeadm.go:322] [certs] Generating "front-proxy-client" certificate and key

	I1226 13:57:32.180858    4606 kubeadm.go:322] [certs] Generating "etcd/ca" certificate and key

	I1226 13:57:32.293313    4606 kubeadm.go:322] [certs] Generating "etcd/server" certificate and key

	I1226 13:57:32.293464    4606 kubeadm.go:322] [certs] etcd/server serving cert is signed for DNS names [ingress-addon-legacy-212000 localhost] and IPs [192.168.49.2 127.0.0.1 ::1]

	I1226 13:57:32.348274    4606 kubeadm.go:322] [certs] Generating "etcd/peer" certificate and key

	I1226 13:57:32.348425    4606 kubeadm.go:322] [certs] etcd/peer serving cert is signed for DNS names [ingress-addon-legacy-212000 localhost] and IPs [192.168.49.2 127.0.0.1 ::1]

	I1226 13:57:32.625473    4606 kubeadm.go:322] [certs] Generating "etcd/healthcheck-client" certificate and key

	I1226 13:57:32.703786    4606 kubeadm.go:322] [certs] Generating "apiserver-etcd-client" certificate and key

	I1226 13:57:32.988600    4606 kubeadm.go:322] [certs] Generating "sa" key and public key

	I1226 13:57:32.988658    4606 kubeadm.go:322] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"

	I1226 13:57:33.218376    4606 kubeadm.go:322] [kubeconfig] Writing "admin.conf" kubeconfig file

	I1226 13:57:33.490530    4606 kubeadm.go:322] [kubeconfig] Writing "kubelet.conf" kubeconfig file

	I1226 13:57:33.583878    4606 kubeadm.go:322] [kubeconfig] Writing "controller-manager.conf" kubeconfig file

	I1226 13:57:33.788228    4606 kubeadm.go:322] [kubeconfig] Writing "scheduler.conf" kubeconfig file

	I1226 13:57:33.789734    4606 kubeadm.go:322] [control-plane] Using manifest folder "/etc/kubernetes/manifests"

	I1226 13:57:33.811412    4606 out.go:204]   - Booting up control plane ...

	I1226 13:57:33.811584    4606 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-apiserver"

	I1226 13:57:33.811724    4606 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-controller-manager"

	I1226 13:57:33.811847    4606 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-scheduler"

	I1226 13:57:33.811987    4606 kubeadm.go:322] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"

	I1226 13:57:33.812250    4606 kubeadm.go:322] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s

	I1226 13:58:13.797771    4606 kubeadm.go:322] [kubelet-check] Initial timeout of 40s passed.

	I1226 13:58:13.798199    4606 kubeadm.go:322] [kubelet-check] It seems like the kubelet isn't running or healthy.

	I1226 13:58:13.798347    4606 kubeadm.go:322] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.

	I1226 13:58:18.799620    4606 kubeadm.go:322] [kubelet-check] It seems like the kubelet isn't running or healthy.

	I1226 13:58:18.799858    4606 kubeadm.go:322] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.

	I1226 13:58:28.800091    4606 kubeadm.go:322] [kubelet-check] It seems like the kubelet isn't running or healthy.

	I1226 13:58:28.800242    4606 kubeadm.go:322] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.

	I1226 13:58:48.801043    4606 kubeadm.go:322] [kubelet-check] It seems like the kubelet isn't running or healthy.

	I1226 13:58:48.801202    4606 kubeadm.go:322] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.

	I1226 13:59:28.803533    4606 kubeadm.go:322] [kubelet-check] It seems like the kubelet isn't running or healthy.

	I1226 13:59:28.803875    4606 kubeadm.go:322] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.

	I1226 13:59:28.803900    4606 kubeadm.go:322] 

	I1226 13:59:28.803966    4606 kubeadm.go:322] 	Unfortunately, an error has occurred:

	I1226 13:59:28.804063    4606 kubeadm.go:322] 		timed out waiting for the condition

	I1226 13:59:28.804087    4606 kubeadm.go:322] 

	I1226 13:59:28.804138    4606 kubeadm.go:322] 	This error is likely caused by:

	I1226 13:59:28.804198    4606 kubeadm.go:322] 		- The kubelet is not running

	I1226 13:59:28.804392    4606 kubeadm.go:322] 		- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)

	I1226 13:59:28.804404    4606 kubeadm.go:322] 

	I1226 13:59:28.804537    4606 kubeadm.go:322] 	If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:

	I1226 13:59:28.804581    4606 kubeadm.go:322] 		- 'systemctl status kubelet'

	I1226 13:59:28.804628    4606 kubeadm.go:322] 		- 'journalctl -xeu kubelet'

	I1226 13:59:28.804640    4606 kubeadm.go:322] 

	I1226 13:59:28.804769    4606 kubeadm.go:322] 	Additionally, a control plane component may have crashed or exited when started by the container runtime.

	I1226 13:59:28.804855    4606 kubeadm.go:322] 	To troubleshoot, list all containers using your preferred container runtimes CLI.

	I1226 13:59:28.804864    4606 kubeadm.go:322] 

	I1226 13:59:28.804960    4606 kubeadm.go:322] 	Here is one example how you may list all Kubernetes containers running in docker:

	I1226 13:59:28.805010    4606 kubeadm.go:322] 		- 'docker ps -a | grep kube | grep -v pause'

	I1226 13:59:28.805105    4606 kubeadm.go:322] 		Once you have found the failing container, you can inspect its logs with:

	I1226 13:59:28.805148    4606 kubeadm.go:322] 		- 'docker logs CONTAINERID'

	I1226 13:59:28.805160    4606 kubeadm.go:322] 

	I1226 13:59:28.806141    4606 kubeadm.go:322] W1226 21:57:30.971047    1703 configset.go:202] WARNING: kubeadm cannot validate component configs for API groups [kubelet.config.k8s.io kubeproxy.config.k8s.io]

	I1226 13:59:28.806324    4606 kubeadm.go:322] 	[WARNING IsDockerSystemdCheck]: detected "cgroupfs" as the Docker cgroup driver. The recommended driver is "systemd". Please follow the guide at https://kubernetes.io/docs/setup/cri/

	I1226 13:59:28.806467    4606 kubeadm.go:322] 	[WARNING Swap]: running with swap on is not supported. Please disable swap

	I1226 13:59:28.806607    4606 kubeadm.go:322] 	[WARNING SystemVerification]: this Docker version is not on the list of validated versions: 24.0.7. Latest validated version: 19.03

	I1226 13:59:28.806704    4606 kubeadm.go:322] 	[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'

	I1226 13:59:28.806819    4606 kubeadm.go:322] W1226 21:57:33.793703    1703 manifests.go:225] the default kube-apiserver authorization-mode is "Node,RBAC"; using "Node,RBAC"

	I1226 13:59:28.806925    4606 kubeadm.go:322] W1226 21:57:33.794458    1703 manifests.go:225] the default kube-apiserver authorization-mode is "Node,RBAC"; using "Node,RBAC"

	I1226 13:59:28.807011    4606 kubeadm.go:322] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster

	I1226 13:59:28.807085    4606 kubeadm.go:322] To see the stack trace of this error execute with --v=5 or higher

	W1226 13:59:28.807187    4606 out.go:239] ! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.18.20:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables": Process exited with status 1

	stdout:

	[init] Using Kubernetes version: v1.18.20

	[preflight] Running pre-flight checks

	[preflight] Pulling images required for setting up a Kubernetes cluster

	[preflight] This might take a minute or two, depending on the speed of your internet connection

	[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'

	[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"

	[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"

	[kubelet-start] Starting the kubelet

	[certs] Using certificateDir folder "/var/lib/minikube/certs"

	[certs] Using existing ca certificate authority

	[certs] Using existing apiserver certificate and key on disk

	[certs] Generating "apiserver-kubelet-client" certificate and key

	[certs] Generating "front-proxy-ca" certificate and key

	[certs] Generating "front-proxy-client" certificate and key

	[certs] Generating "etcd/ca" certificate and key

	[certs] Generating "etcd/server" certificate and key

	[certs] etcd/server serving cert is signed for DNS names [ingress-addon-legacy-212000 localhost] and IPs [192.168.49.2 127.0.0.1 ::1]

	[certs] Generating "etcd/peer" certificate and key

	[certs] etcd/peer serving cert is signed for DNS names [ingress-addon-legacy-212000 localhost] and IPs [192.168.49.2 127.0.0.1 ::1]

	[certs] Generating "etcd/healthcheck-client" certificate and key

	[certs] Generating "apiserver-etcd-client" certificate and key

	[certs] Generating "sa" key and public key

	[kubeconfig] Using kubeconfig folder "/etc/kubernetes"

	[kubeconfig] Writing "admin.conf" kubeconfig file

	[kubeconfig] Writing "kubelet.conf" kubeconfig file

	[kubeconfig] Writing "controller-manager.conf" kubeconfig file

	[kubeconfig] Writing "scheduler.conf" kubeconfig file

	[control-plane] Using manifest folder "/etc/kubernetes/manifests"

	[control-plane] Creating static Pod manifest for "kube-apiserver"

	[control-plane] Creating static Pod manifest for "kube-controller-manager"

	[control-plane] Creating static Pod manifest for "kube-scheduler"

	[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"

	[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s

	[kubelet-check] Initial timeout of 40s passed.

	[kubelet-check] It seems like the kubelet isn't running or healthy.

	[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.

	[kubelet-check] It seems like the kubelet isn't running or healthy.

	[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.

	[kubelet-check] It seems like the kubelet isn't running or healthy.

	[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.

	[kubelet-check] It seems like the kubelet isn't running or healthy.

	[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.

	[kubelet-check] It seems like the kubelet isn't running or healthy.

	[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.

		Unfortunately, an error has occurred:

			timed out waiting for the condition

		This error is likely caused by:

			- The kubelet is not running

			- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)

		If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:

			- 'systemctl status kubelet'

			- 'journalctl -xeu kubelet'

		Additionally, a control plane component may have crashed or exited when started by the container runtime.

		To troubleshoot, list all containers using your preferred container runtimes CLI.

		Here is one example how you may list all Kubernetes containers running in docker:

			- 'docker ps -a | grep kube | grep -v pause'

			Once you have found the failing container, you can inspect its logs with:

			- 'docker logs CONTAINERID'

	stderr:

	W1226 21:57:30.971047    1703 configset.go:202] WARNING: kubeadm cannot validate component configs for API groups [kubelet.config.k8s.io kubeproxy.config.k8s.io]

		[WARNING IsDockerSystemdCheck]: detected "cgroupfs" as the Docker cgroup driver. The recommended driver is "systemd". Please follow the guide at https://kubernetes.io/docs/setup/cri/

		[WARNING Swap]: running with swap on is not supported. Please disable swap

		[WARNING SystemVerification]: this Docker version is not on the list of validated versions: 24.0.7. Latest validated version: 19.03

		[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'

	W1226 21:57:33.793703    1703 manifests.go:225] the default kube-apiserver authorization-mode is "Node,RBAC"; using "Node,RBAC"

	W1226 21:57:33.794458    1703 manifests.go:225] the default kube-apiserver authorization-mode is "Node,RBAC"; using "Node,RBAC"

	error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster

	To see the stack trace of this error execute with --v=5 or higher

	! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.18.20:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables": Process exited with status 1

	stdout:

	[init] Using Kubernetes version: v1.18.20

	[preflight] Running pre-flight checks

	[preflight] Pulling images required for setting up a Kubernetes cluster

	[preflight] This might take a minute or two, depending on the speed of your internet connection

	[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'

	[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"

	[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"

	[kubelet-start] Starting the kubelet

	[certs] Using certificateDir folder "/var/lib/minikube/certs"

	[certs] Using existing ca certificate authority

	[certs] Using existing apiserver certificate and key on disk

	[certs] Generating "apiserver-kubelet-client" certificate and key

	[certs] Generating "front-proxy-ca" certificate and key

	[certs] Generating "front-proxy-client" certificate and key

	[certs] Generating "etcd/ca" certificate and key

	[certs] Generating "etcd/server" certificate and key

	[certs] etcd/server serving cert is signed for DNS names [ingress-addon-legacy-212000 localhost] and IPs [192.168.49.2 127.0.0.1 ::1]

	[certs] Generating "etcd/peer" certificate and key

	[certs] etcd/peer serving cert is signed for DNS names [ingress-addon-legacy-212000 localhost] and IPs [192.168.49.2 127.0.0.1 ::1]

	[certs] Generating "etcd/healthcheck-client" certificate and key

	[certs] Generating "apiserver-etcd-client" certificate and key

	[certs] Generating "sa" key and public key

	[kubeconfig] Using kubeconfig folder "/etc/kubernetes"

	[kubeconfig] Writing "admin.conf" kubeconfig file

	[kubeconfig] Writing "kubelet.conf" kubeconfig file

	[kubeconfig] Writing "controller-manager.conf" kubeconfig file

	[kubeconfig] Writing "scheduler.conf" kubeconfig file

	[control-plane] Using manifest folder "/etc/kubernetes/manifests"

	[control-plane] Creating static Pod manifest for "kube-apiserver"

	[control-plane] Creating static Pod manifest for "kube-controller-manager"

	[control-plane] Creating static Pod manifest for "kube-scheduler"

	[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"

	[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s

	[kubelet-check] Initial timeout of 40s passed.

	[kubelet-check] It seems like the kubelet isn't running or healthy.

	[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.

	[kubelet-check] It seems like the kubelet isn't running or healthy.

	[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.

	[kubelet-check] It seems like the kubelet isn't running or healthy.

	[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.

	[kubelet-check] It seems like the kubelet isn't running or healthy.

	[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.

	[kubelet-check] It seems like the kubelet isn't running or healthy.

	[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.

		Unfortunately, an error has occurred:

			timed out waiting for the condition

		This error is likely caused by:

			- The kubelet is not running

			- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)

		If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:

			- 'systemctl status kubelet'

			- 'journalctl -xeu kubelet'

		Additionally, a control plane component may have crashed or exited when started by the container runtime.

		To troubleshoot, list all containers using your preferred container runtimes CLI.

		Here is one example how you may list all Kubernetes containers running in docker:

			- 'docker ps -a | grep kube | grep -v pause'

			Once you have found the failing container, you can inspect its logs with:

			- 'docker logs CONTAINERID'

	stderr:

	W1226 21:57:30.971047    1703 configset.go:202] WARNING: kubeadm cannot validate component configs for API groups [kubelet.config.k8s.io kubeproxy.config.k8s.io]

		[WARNING IsDockerSystemdCheck]: detected "cgroupfs" as the Docker cgroup driver. The recommended driver is "systemd". Please follow the guide at https://kubernetes.io/docs/setup/cri/

		[WARNING Swap]: running with swap on is not supported. Please disable swap

		[WARNING SystemVerification]: this Docker version is not on the list of validated versions: 24.0.7. Latest validated version: 19.03

		[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'

	W1226 21:57:33.793703    1703 manifests.go:225] the default kube-apiserver authorization-mode is "Node,RBAC"; using "Node,RBAC"

	W1226 21:57:33.794458    1703 manifests.go:225] the default kube-apiserver authorization-mode is "Node,RBAC"; using "Node,RBAC"

	error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster

	To see the stack trace of this error execute with --v=5 or higher

	I1226 13:59:28.807223    4606 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.18.20:$PATH" kubeadm reset --cri-socket /var/run/dockershim.sock --force"

	I1226 13:59:29.213999    4606 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I1226 13:59:29.224483    4606 kubeadm.go:226] ignoring SystemVerification for kubeadm because of docker driver

	I1226 13:59:29.224553    4606 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf

	I1226 13:59:29.232739    4606 kubeadm.go:152] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2

	stdout:

	stderr:

	ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory

	I1226 13:59:29.232758    4606 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.18.20:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"

	I1226 13:59:29.281357    4606 kubeadm.go:322] [init] Using Kubernetes version: v1.18.20

	I1226 13:59:29.281407    4606 kubeadm.go:322] [preflight] Running pre-flight checks

	I1226 13:59:29.523755    4606 kubeadm.go:322] [preflight] Pulling images required for setting up a Kubernetes cluster

	I1226 13:59:29.523838    4606 kubeadm.go:322] [preflight] This might take a minute or two, depending on the speed of your internet connection

	I1226 13:59:29.523920    4606 kubeadm.go:322] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'

	I1226 13:59:29.699306    4606 kubeadm.go:322] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"

	I1226 13:59:29.699990    4606 kubeadm.go:322] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"

	I1226 13:59:29.700027    4606 kubeadm.go:322] [kubelet-start] Starting the kubelet

	I1226 13:59:29.780171    4606 kubeadm.go:322] [certs] Using certificateDir folder "/var/lib/minikube/certs"

	I1226 13:59:29.801634    4606 out.go:204]   - Generating certificates and keys ...

	I1226 13:59:29.801737    4606 kubeadm.go:322] [certs] Using existing ca certificate authority

	I1226 13:59:29.801810    4606 kubeadm.go:322] [certs] Using existing apiserver certificate and key on disk

	I1226 13:59:29.801904    4606 kubeadm.go:322] [certs] Using existing apiserver-kubelet-client certificate and key on disk

	I1226 13:59:29.801971    4606 kubeadm.go:322] [certs] Using existing front-proxy-ca certificate authority

	I1226 13:59:29.802034    4606 kubeadm.go:322] [certs] Using existing front-proxy-client certificate and key on disk

	I1226 13:59:29.802109    4606 kubeadm.go:322] [certs] Using existing etcd/ca certificate authority

	I1226 13:59:29.802177    4606 kubeadm.go:322] [certs] Using existing etcd/server certificate and key on disk

	I1226 13:59:29.802222    4606 kubeadm.go:322] [certs] Using existing etcd/peer certificate and key on disk

	I1226 13:59:29.802278    4606 kubeadm.go:322] [certs] Using existing etcd/healthcheck-client certificate and key on disk

	I1226 13:59:29.802344    4606 kubeadm.go:322] [certs] Using existing apiserver-etcd-client certificate and key on disk

	I1226 13:59:29.802398    4606 kubeadm.go:322] [certs] Using the existing "sa" key

	I1226 13:59:29.802459    4606 kubeadm.go:322] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"

	I1226 13:59:29.890562    4606 kubeadm.go:322] [kubeconfig] Writing "admin.conf" kubeconfig file

	I1226 13:59:30.438601    4606 kubeadm.go:322] [kubeconfig] Writing "kubelet.conf" kubeconfig file

	I1226 13:59:30.505082    4606 kubeadm.go:322] [kubeconfig] Writing "controller-manager.conf" kubeconfig file

	I1226 13:59:30.551324    4606 kubeadm.go:322] [kubeconfig] Writing "scheduler.conf" kubeconfig file

	I1226 13:59:30.552439    4606 kubeadm.go:322] [control-plane] Using manifest folder "/etc/kubernetes/manifests"

	I1226 13:59:30.574125    4606 out.go:204]   - Booting up control plane ...

	I1226 13:59:30.574265    4606 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-apiserver"

	I1226 13:59:30.574408    4606 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-controller-manager"

	I1226 13:59:30.574524    4606 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-scheduler"

	I1226 13:59:30.574636    4606 kubeadm.go:322] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"

	I1226 13:59:30.574894    4606 kubeadm.go:322] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s

	I1226 14:00:10.559948    4606 kubeadm.go:322] [kubelet-check] Initial timeout of 40s passed.

	I1226 14:00:10.560266    4606 kubeadm.go:322] [kubelet-check] It seems like the kubelet isn't running or healthy.

	I1226 14:00:10.560411    4606 kubeadm.go:322] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.

	I1226 14:00:15.562278    4606 kubeadm.go:322] [kubelet-check] It seems like the kubelet isn't running or healthy.

	I1226 14:00:15.562497    4606 kubeadm.go:322] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.

	I1226 14:00:25.563630    4606 kubeadm.go:322] [kubelet-check] It seems like the kubelet isn't running or healthy.

	I1226 14:00:25.563840    4606 kubeadm.go:322] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.

	I1226 14:00:45.564647    4606 kubeadm.go:322] [kubelet-check] It seems like the kubelet isn't running or healthy.

	I1226 14:00:45.564791    4606 kubeadm.go:322] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.

	I1226 14:01:25.537784    4606 kubeadm.go:322] [kubelet-check] It seems like the kubelet isn't running or healthy.

	I1226 14:01:25.537994    4606 kubeadm.go:322] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.

	I1226 14:01:25.538009    4606 kubeadm.go:322] 

	I1226 14:01:25.538072    4606 kubeadm.go:322] 	Unfortunately, an error has occurred:

	I1226 14:01:25.538114    4606 kubeadm.go:322] 		timed out waiting for the condition

	I1226 14:01:25.538123    4606 kubeadm.go:322] 

	I1226 14:01:25.538170    4606 kubeadm.go:322] 	This error is likely caused by:

	I1226 14:01:25.538205    4606 kubeadm.go:322] 		- The kubelet is not running

	I1226 14:01:25.538389    4606 kubeadm.go:322] 		- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)

	I1226 14:01:25.538410    4606 kubeadm.go:322] 

	I1226 14:01:25.538586    4606 kubeadm.go:322] 	If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:

	I1226 14:01:25.538629    4606 kubeadm.go:322] 		- 'systemctl status kubelet'

	I1226 14:01:25.538672    4606 kubeadm.go:322] 		- 'journalctl -xeu kubelet'

	I1226 14:01:25.538686    4606 kubeadm.go:322] 

	I1226 14:01:25.538782    4606 kubeadm.go:322] 	Additionally, a control plane component may have crashed or exited when started by the container runtime.

	I1226 14:01:25.538886    4606 kubeadm.go:322] 	To troubleshoot, list all containers using your preferred container runtimes CLI.

	I1226 14:01:25.538901    4606 kubeadm.go:322] 

	I1226 14:01:25.538997    4606 kubeadm.go:322] 	Here is one example how you may list all Kubernetes containers running in docker:

	I1226 14:01:25.539054    4606 kubeadm.go:322] 		- 'docker ps -a | grep kube | grep -v pause'

	I1226 14:01:25.539144    4606 kubeadm.go:322] 		Once you have found the failing container, you can inspect its logs with:

	I1226 14:01:25.539179    4606 kubeadm.go:322] 		- 'docker logs CONTAINERID'

	I1226 14:01:25.539187    4606 kubeadm.go:322] 

	I1226 14:01:25.540923    4606 kubeadm.go:322] W1226 21:59:29.280640    4737 configset.go:202] WARNING: kubeadm cannot validate component configs for API groups [kubelet.config.k8s.io kubeproxy.config.k8s.io]

	I1226 14:01:25.541068    4606 kubeadm.go:322] 	[WARNING IsDockerSystemdCheck]: detected "cgroupfs" as the Docker cgroup driver. The recommended driver is "systemd". Please follow the guide at https://kubernetes.io/docs/setup/cri/

	I1226 14:01:25.541128    4606 kubeadm.go:322] 	[WARNING Swap]: running with swap on is not supported. Please disable swap

	I1226 14:01:25.541252    4606 kubeadm.go:322] 	[WARNING SystemVerification]: this Docker version is not on the list of validated versions: 24.0.7. Latest validated version: 19.03

	I1226 14:01:25.541377    4606 kubeadm.go:322] 	[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'

	I1226 14:01:25.541480    4606 kubeadm.go:322] W1226 21:59:30.555976    4737 manifests.go:225] the default kube-apiserver authorization-mode is "Node,RBAC"; using "Node,RBAC"

	I1226 14:01:25.541586    4606 kubeadm.go:322] W1226 21:59:30.556830    4737 manifests.go:225] the default kube-apiserver authorization-mode is "Node,RBAC"; using "Node,RBAC"

	I1226 14:01:25.541650    4606 kubeadm.go:322] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster

	I1226 14:01:25.541714    4606 kubeadm.go:322] To see the stack trace of this error execute with --v=5 or higher

	I1226 14:01:25.541744    4606 kubeadm.go:406] StartCluster complete in 3m54.699433052s

	I1226 14:01:25.541835    4606 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}

	I1226 14:01:25.559863    4606 logs.go:284] 0 containers: []

	W1226 14:01:25.559877    4606 logs.go:286] No container was found matching "kube-apiserver"

	I1226 14:01:25.559947    4606 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}

	I1226 14:01:25.577645    4606 logs.go:284] 0 containers: []

	W1226 14:01:25.577659    4606 logs.go:286] No container was found matching "etcd"

	I1226 14:01:25.577717    4606 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}

	I1226 14:01:25.596771    4606 logs.go:284] 0 containers: []

	W1226 14:01:25.596785    4606 logs.go:286] No container was found matching "coredns"

	I1226 14:01:25.596865    4606 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}

	I1226 14:01:25.614968    4606 logs.go:284] 0 containers: []

	W1226 14:01:25.614981    4606 logs.go:286] No container was found matching "kube-scheduler"

	I1226 14:01:25.615054    4606 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}

	I1226 14:01:25.633017    4606 logs.go:284] 0 containers: []

	W1226 14:01:25.633030    4606 logs.go:286] No container was found matching "kube-proxy"

	I1226 14:01:25.633101    4606 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}

	I1226 14:01:25.651753    4606 logs.go:284] 0 containers: []

	W1226 14:01:25.651766    4606 logs.go:286] No container was found matching "kube-controller-manager"

	I1226 14:01:25.651836    4606 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}

	I1226 14:01:25.670405    4606 logs.go:284] 0 containers: []

	W1226 14:01:25.670419    4606 logs.go:286] No container was found matching "kindnet"

	I1226 14:01:25.670431    4606 logs.go:123] Gathering logs for kubelet ...

	I1226 14:01:25.670439    4606 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"

	I1226 14:01:25.705603    4606 logs.go:123] Gathering logs for dmesg ...

	I1226 14:01:25.705618    4606 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"

	I1226 14:01:25.717601    4606 logs.go:123] Gathering logs for describe nodes ...

	I1226 14:01:25.717619    4606 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.18.20/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"

	W1226 14:01:25.769649    4606 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.18.20/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.18.20/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	 output: 

	** stderr ** 

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	** /stderr **

	I1226 14:01:25.769664    4606 logs.go:123] Gathering logs for Docker ...

	I1226 14:01:25.769672    4606 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"

	I1226 14:01:25.785859    4606 logs.go:123] Gathering logs for container status ...

	I1226 14:01:25.785874    4606 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"

	W1226 14:01:25.857488    4606 out.go:369] Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.18.20:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables": Process exited with status 1

	stdout:

	[init] Using Kubernetes version: v1.18.20

	[preflight] Running pre-flight checks

	[preflight] Pulling images required for setting up a Kubernetes cluster

	[preflight] This might take a minute or two, depending on the speed of your internet connection

	[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'

	[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"

	[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"

	[kubelet-start] Starting the kubelet

	[certs] Using certificateDir folder "/var/lib/minikube/certs"

	[certs] Using existing ca certificate authority

	[certs] Using existing apiserver certificate and key on disk

	[certs] Using existing apiserver-kubelet-client certificate and key on disk

	[certs] Using existing front-proxy-ca certificate authority

	[certs] Using existing front-proxy-client certificate and key on disk

	[certs] Using existing etcd/ca certificate authority

	[certs] Using existing etcd/server certificate and key on disk

	[certs] Using existing etcd/peer certificate and key on disk

	[certs] Using existing etcd/healthcheck-client certificate and key on disk

	[certs] Using existing apiserver-etcd-client certificate and key on disk

	[certs] Using the existing "sa" key

	[kubeconfig] Using kubeconfig folder "/etc/kubernetes"

	[kubeconfig] Writing "admin.conf" kubeconfig file

	[kubeconfig] Writing "kubelet.conf" kubeconfig file

	[kubeconfig] Writing "controller-manager.conf" kubeconfig file

	[kubeconfig] Writing "scheduler.conf" kubeconfig file

	[control-plane] Using manifest folder "/etc/kubernetes/manifests"

	[control-plane] Creating static Pod manifest for "kube-apiserver"

	[control-plane] Creating static Pod manifest for "kube-controller-manager"

	[control-plane] Creating static Pod manifest for "kube-scheduler"

	[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"

	[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s

	[kubelet-check] Initial timeout of 40s passed.

	[kubelet-check] It seems like the kubelet isn't running or healthy.

	[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.

	[kubelet-check] It seems like the kubelet isn't running or healthy.

	[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.

	[kubelet-check] It seems like the kubelet isn't running or healthy.

	[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.

	[kubelet-check] It seems like the kubelet isn't running or healthy.

	[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.

	[kubelet-check] It seems like the kubelet isn't running or healthy.

	[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.

		Unfortunately, an error has occurred:

			timed out waiting for the condition

		This error is likely caused by:

			- The kubelet is not running

			- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)

		If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:

			- 'systemctl status kubelet'

			- 'journalctl -xeu kubelet'

		Additionally, a control plane component may have crashed or exited when started by the container runtime.

		To troubleshoot, list all containers using your preferred container runtimes CLI.

		Here is one example how you may list all Kubernetes containers running in docker:

			- 'docker ps -a | grep kube | grep -v pause'

			Once you have found the failing container, you can inspect its logs with:

			- 'docker logs CONTAINERID'

	stderr:

	W1226 21:59:29.280640    4737 configset.go:202] WARNING: kubeadm cannot validate component configs for API groups [kubelet.config.k8s.io kubeproxy.config.k8s.io]

		[WARNING IsDockerSystemdCheck]: detected "cgroupfs" as the Docker cgroup driver. The recommended driver is "systemd". Please follow the guide at https://kubernetes.io/docs/setup/cri/

		[WARNING Swap]: running with swap on is not supported. Please disable swap

		[WARNING SystemVerification]: this Docker version is not on the list of validated versions: 24.0.7. Latest validated version: 19.03

		[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'

	W1226 21:59:30.555976    4737 manifests.go:225] the default kube-apiserver authorization-mode is "Node,RBAC"; using "Node,RBAC"

	W1226 21:59:30.556830    4737 manifests.go:225] the default kube-apiserver authorization-mode is "Node,RBAC"; using "Node,RBAC"

	error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster

	To see the stack trace of this error execute with --v=5 or higher

	W1226 14:01:25.857511    4606 out.go:239] * 

	* 

	W1226 14:01:25.857551    4606 out.go:239] X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.18.20:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables": Process exited with status 1

	stdout:

	[init] Using Kubernetes version: v1.18.20

	[preflight] Running pre-flight checks

	[preflight] Pulling images required for setting up a Kubernetes cluster

	[preflight] This might take a minute or two, depending on the speed of your internet connection

	[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'

	[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"

	[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"

	[kubelet-start] Starting the kubelet

	[certs] Using certificateDir folder "/var/lib/minikube/certs"

	[certs] Using existing ca certificate authority

	[certs] Using existing apiserver certificate and key on disk

	[certs] Using existing apiserver-kubelet-client certificate and key on disk

	[certs] Using existing front-proxy-ca certificate authority

	[certs] Using existing front-proxy-client certificate and key on disk

	[certs] Using existing etcd/ca certificate authority

	[certs] Using existing etcd/server certificate and key on disk

	[certs] Using existing etcd/peer certificate and key on disk

	[certs] Using existing etcd/healthcheck-client certificate and key on disk

	[certs] Using existing apiserver-etcd-client certificate and key on disk

	[certs] Using the existing "sa" key

	[kubeconfig] Using kubeconfig folder "/etc/kubernetes"

	[kubeconfig] Writing "admin.conf" kubeconfig file

	[kubeconfig] Writing "kubelet.conf" kubeconfig file

	[kubeconfig] Writing "controller-manager.conf" kubeconfig file

	[kubeconfig] Writing "scheduler.conf" kubeconfig file

	[control-plane] Using manifest folder "/etc/kubernetes/manifests"

	[control-plane] Creating static Pod manifest for "kube-apiserver"

	[control-plane] Creating static Pod manifest for "kube-controller-manager"

	[control-plane] Creating static Pod manifest for "kube-scheduler"

	[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"

	[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s

	[kubelet-check] Initial timeout of 40s passed.

	[kubelet-check] It seems like the kubelet isn't running or healthy.

	[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.

	[kubelet-check] It seems like the kubelet isn't running or healthy.

	[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.

	[kubelet-check] It seems like the kubelet isn't running or healthy.

	[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.

	[kubelet-check] It seems like the kubelet isn't running or healthy.

	[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.

	[kubelet-check] It seems like the kubelet isn't running or healthy.

	[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.

		Unfortunately, an error has occurred:

			timed out waiting for the condition

		This error is likely caused by:

			- The kubelet is not running

			- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)

		If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:

			- 'systemctl status kubelet'

			- 'journalctl -xeu kubelet'

		Additionally, a control plane component may have crashed or exited when started by the container runtime.

		To troubleshoot, list all containers using your preferred container runtimes CLI.

		Here is one example how you may list all Kubernetes containers running in docker:

			- 'docker ps -a | grep kube | grep -v pause'

			Once you have found the failing container, you can inspect its logs with:

			- 'docker logs CONTAINERID'

	stderr:

	W1226 21:59:29.280640    4737 configset.go:202] WARNING: kubeadm cannot validate component configs for API groups [kubelet.config.k8s.io kubeproxy.config.k8s.io]

		[WARNING IsDockerSystemdCheck]: detected "cgroupfs" as the Docker cgroup driver. The recommended driver is "systemd". Please follow the guide at https://kubernetes.io/docs/setup/cri/

		[WARNING Swap]: running with swap on is not supported. Please disable swap

		[WARNING SystemVerification]: this Docker version is not on the list of validated versions: 24.0.7. Latest validated version: 19.03

		[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'

	W1226 21:59:30.555976    4737 manifests.go:225] the default kube-apiserver authorization-mode is "Node,RBAC"; using "Node,RBAC"

	W1226 21:59:30.556830    4737 manifests.go:225] the default kube-apiserver authorization-mode is "Node,RBAC"; using "Node,RBAC"

	error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster

	To see the stack trace of this error execute with --v=5 or higher

	X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.18.20:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables": Process exited with status 1

	stdout:

	[init] Using Kubernetes version: v1.18.20

	[preflight] Running pre-flight checks

	[preflight] Pulling images required for setting up a Kubernetes cluster

	[preflight] This might take a minute or two, depending on the speed of your internet connection

	[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'

	[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"

	[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"

	[kubelet-start] Starting the kubelet

	[certs] Using certificateDir folder "/var/lib/minikube/certs"

	[certs] Using existing ca certificate authority

	[certs] Using existing apiserver certificate and key on disk

	[certs] Using existing apiserver-kubelet-client certificate and key on disk

	[certs] Using existing front-proxy-ca certificate authority

	[certs] Using existing front-proxy-client certificate and key on disk

	[certs] Using existing etcd/ca certificate authority

	[certs] Using existing etcd/server certificate and key on disk

	[certs] Using existing etcd/peer certificate and key on disk

	[certs] Using existing etcd/healthcheck-client certificate and key on disk

	[certs] Using existing apiserver-etcd-client certificate and key on disk

	[certs] Using the existing "sa" key

	[kubeconfig] Using kubeconfig folder "/etc/kubernetes"

	[kubeconfig] Writing "admin.conf" kubeconfig file

	[kubeconfig] Writing "kubelet.conf" kubeconfig file

	[kubeconfig] Writing "controller-manager.conf" kubeconfig file

	[kubeconfig] Writing "scheduler.conf" kubeconfig file

	[control-plane] Using manifest folder "/etc/kubernetes/manifests"

	[control-plane] Creating static Pod manifest for "kube-apiserver"

	[control-plane] Creating static Pod manifest for "kube-controller-manager"

	[control-plane] Creating static Pod manifest for "kube-scheduler"

	[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"

	[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s

	[kubelet-check] Initial timeout of 40s passed.

	[kubelet-check] It seems like the kubelet isn't running or healthy.

	[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.

	[kubelet-check] It seems like the kubelet isn't running or healthy.

	[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.

	[kubelet-check] It seems like the kubelet isn't running or healthy.

	[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.

	[kubelet-check] It seems like the kubelet isn't running or healthy.

	[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.

	[kubelet-check] It seems like the kubelet isn't running or healthy.

	[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.

		Unfortunately, an error has occurred:

			timed out waiting for the condition

		This error is likely caused by:

			- The kubelet is not running

			- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)

		If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:

			- 'systemctl status kubelet'

			- 'journalctl -xeu kubelet'

		Additionally, a control plane component may have crashed or exited when started by the container runtime.

		To troubleshoot, list all containers using your preferred container runtimes CLI.

		Here is one example how you may list all Kubernetes containers running in docker:

			- 'docker ps -a | grep kube | grep -v pause'

			Once you have found the failing container, you can inspect its logs with:

			- 'docker logs CONTAINERID'

	stderr:

	W1226 21:59:29.280640    4737 configset.go:202] WARNING: kubeadm cannot validate component configs for API groups [kubelet.config.k8s.io kubeproxy.config.k8s.io]

		[WARNING IsDockerSystemdCheck]: detected "cgroupfs" as the Docker cgroup driver. The recommended driver is "systemd". Please follow the guide at https://kubernetes.io/docs/setup/cri/

		[WARNING Swap]: running with swap on is not supported. Please disable swap

		[WARNING SystemVerification]: this Docker version is not on the list of validated versions: 24.0.7. Latest validated version: 19.03

		[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'

	W1226 21:59:30.555976    4737 manifests.go:225] the default kube-apiserver authorization-mode is "Node,RBAC"; using "Node,RBAC"

	W1226 21:59:30.556830    4737 manifests.go:225] the default kube-apiserver authorization-mode is "Node,RBAC"; using "Node,RBAC"

	error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster

	To see the stack trace of this error execute with --v=5 or higher

	W1226 14:01:25.857565    4606 out.go:239] * 

	* 

	W1226 14:01:25.858222    4606 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	I1226 14:01:25.921893    4606 out.go:177] 

	W1226 14:01:25.965012    4606 out.go:239] X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.18.20:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables": Process exited with status 1

	stdout:

	[init] Using Kubernetes version: v1.18.20

	[preflight] Running pre-flight checks

	[preflight] Pulling images required for setting up a Kubernetes cluster

	[preflight] This might take a minute or two, depending on the speed of your internet connection

	[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'

	[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"

	[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"

	[kubelet-start] Starting the kubelet

	[certs] Using certificateDir folder "/var/lib/minikube/certs"

	[certs] Using existing ca certificate authority

	[certs] Using existing apiserver certificate and key on disk

	[certs] Using existing apiserver-kubelet-client certificate and key on disk

	[certs] Using existing front-proxy-ca certificate authority

	[certs] Using existing front-proxy-client certificate and key on disk

	[certs] Using existing etcd/ca certificate authority

	[certs] Using existing etcd/server certificate and key on disk

	[certs] Using existing etcd/peer certificate and key on disk

	[certs] Using existing etcd/healthcheck-client certificate and key on disk

	[certs] Using existing apiserver-etcd-client certificate and key on disk

	[certs] Using the existing "sa" key

	[kubeconfig] Using kubeconfig folder "/etc/kubernetes"

	[kubeconfig] Writing "admin.conf" kubeconfig file

	[kubeconfig] Writing "kubelet.conf" kubeconfig file

	[kubeconfig] Writing "controller-manager.conf" kubeconfig file

	[kubeconfig] Writing "scheduler.conf" kubeconfig file

	[control-plane] Using manifest folder "/etc/kubernetes/manifests"

	[control-plane] Creating static Pod manifest for "kube-apiserver"

	[control-plane] Creating static Pod manifest for "kube-controller-manager"

	[control-plane] Creating static Pod manifest for "kube-scheduler"

	[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"

	[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s

	[kubelet-check] Initial timeout of 40s passed.

	[kubelet-check] It seems like the kubelet isn't running or healthy.

	[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.

	[kubelet-check] It seems like the kubelet isn't running or healthy.

	[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.

	[kubelet-check] It seems like the kubelet isn't running or healthy.

	[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.

	[kubelet-check] It seems like the kubelet isn't running or healthy.

	[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.

	[kubelet-check] It seems like the kubelet isn't running or healthy.

	[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.

		Unfortunately, an error has occurred:

			timed out waiting for the condition

		This error is likely caused by:

			- The kubelet is not running

			- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)

		If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:

			- 'systemctl status kubelet'

			- 'journalctl -xeu kubelet'

		Additionally, a control plane component may have crashed or exited when started by the container runtime.

		To troubleshoot, list all containers using your preferred container runtimes CLI.

		Here is one example how you may list all Kubernetes containers running in docker:

			- 'docker ps -a | grep kube | grep -v pause'

			Once you have found the failing container, you can inspect its logs with:

			- 'docker logs CONTAINERID'

	stderr:

	W1226 21:59:29.280640    4737 configset.go:202] WARNING: kubeadm cannot validate component configs for API groups [kubelet.config.k8s.io kubeproxy.config.k8s.io]

		[WARNING IsDockerSystemdCheck]: detected "cgroupfs" as the Docker cgroup driver. The recommended driver is "systemd". Please follow the guide at https://kubernetes.io/docs/setup/cri/

		[WARNING Swap]: running with swap on is not supported. Please disable swap

		[WARNING SystemVerification]: this Docker version is not on the list of validated versions: 24.0.7. Latest validated version: 19.03

		[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'

	W1226 21:59:30.555976    4737 manifests.go:225] the default kube-apiserver authorization-mode is "Node,RBAC"; using "Node,RBAC"

	W1226 21:59:30.556830    4737 manifests.go:225] the default kube-apiserver authorization-mode is "Node,RBAC"; using "Node,RBAC"

	error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster

	To see the stack trace of this error execute with --v=5 or higher

	X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.18.20:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables": Process exited with status 1

	stdout:

	[init] Using Kubernetes version: v1.18.20

	[preflight] Running pre-flight checks

	[preflight] Pulling images required for setting up a Kubernetes cluster

	[preflight] This might take a minute or two, depending on the speed of your internet connection

	[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'

	[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"

	[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"

	[kubelet-start] Starting the kubelet

	[certs] Using certificateDir folder "/var/lib/minikube/certs"

	[certs] Using existing ca certificate authority

	[certs] Using existing apiserver certificate and key on disk

	[certs] Using existing apiserver-kubelet-client certificate and key on disk

	[certs] Using existing front-proxy-ca certificate authority

	[certs] Using existing front-proxy-client certificate and key on disk

	[certs] Using existing etcd/ca certificate authority

	[certs] Using existing etcd/server certificate and key on disk

	[certs] Using existing etcd/peer certificate and key on disk

	[certs] Using existing etcd/healthcheck-client certificate and key on disk

	[certs] Using existing apiserver-etcd-client certificate and key on disk

	[certs] Using the existing "sa" key

	[kubeconfig] Using kubeconfig folder "/etc/kubernetes"

	[kubeconfig] Writing "admin.conf" kubeconfig file

	[kubeconfig] Writing "kubelet.conf" kubeconfig file

	[kubeconfig] Writing "controller-manager.conf" kubeconfig file

	[kubeconfig] Writing "scheduler.conf" kubeconfig file

	[control-plane] Using manifest folder "/etc/kubernetes/manifests"

	[control-plane] Creating static Pod manifest for "kube-apiserver"

	[control-plane] Creating static Pod manifest for "kube-controller-manager"

	[control-plane] Creating static Pod manifest for "kube-scheduler"

	[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"

	[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s

	[kubelet-check] Initial timeout of 40s passed.

	[kubelet-check] It seems like the kubelet isn't running or healthy.

	[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.

	[kubelet-check] It seems like the kubelet isn't running or healthy.

	[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.

	[kubelet-check] It seems like the kubelet isn't running or healthy.

	[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.

	[kubelet-check] It seems like the kubelet isn't running or healthy.

	[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.

	[kubelet-check] It seems like the kubelet isn't running or healthy.

	[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.

		Unfortunately, an error has occurred:

			timed out waiting for the condition

		This error is likely caused by:

			- The kubelet is not running

			- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)

		If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:

			- 'systemctl status kubelet'

			- 'journalctl -xeu kubelet'

		Additionally, a control plane component may have crashed or exited when started by the container runtime.

		To troubleshoot, list all containers using your preferred container runtimes CLI.

		Here is one example how you may list all Kubernetes containers running in docker:

			- 'docker ps -a | grep kube | grep -v pause'

			Once you have found the failing container, you can inspect its logs with:

			- 'docker logs CONTAINERID'

	stderr:

	W1226 21:59:29.280640    4737 configset.go:202] WARNING: kubeadm cannot validate component configs for API groups [kubelet.config.k8s.io kubeproxy.config.k8s.io]

		[WARNING IsDockerSystemdCheck]: detected "cgroupfs" as the Docker cgroup driver. The recommended driver is "systemd". Please follow the guide at https://kubernetes.io/docs/setup/cri/

		[WARNING Swap]: running with swap on is not supported. Please disable swap

		[WARNING SystemVerification]: this Docker version is not on the list of validated versions: 24.0.7. Latest validated version: 19.03

		[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'

	W1226 21:59:30.555976    4737 manifests.go:225] the default kube-apiserver authorization-mode is "Node,RBAC"; using "Node,RBAC"

	W1226 21:59:30.556830    4737 manifests.go:225] the default kube-apiserver authorization-mode is "Node,RBAC"; using "Node,RBAC"

	error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster

	To see the stack trace of this error execute with --v=5 or higher

	W1226 14:01:25.965085    4606 out.go:239] * Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start

	* Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start

	W1226 14:01:25.965111    4606 out.go:239] * Related issue: https://github.com/kubernetes/minikube/issues/4172

	* Related issue: https://github.com/kubernetes/minikube/issues/4172

	I1226 14:01:25.986911    4606 out.go:177] 

** /stderr **

ingress_addon_legacy_test.go:41: failed to start minikube with args: "out/minikube-darwin-amd64 start -p ingress-addon-legacy-212000 --kubernetes-version=v1.18.20 --memory=4096 --wait=true --alsologtostderr -v=5 --driver=docker " : exit status 109

--- FAIL: TestIngressAddonLegacy/StartLegacyK8sCluster (263.27s)

=== RUN   TestIngressAddonLegacy/serial/ValidateIngressAddonActivation

ingress_addon_legacy_test.go:70: (dbg) Run:  out/minikube-darwin-amd64 -p ingress-addon-legacy-212000 addons enable ingress --alsologtostderr -v=5

E1226 14:02:20.013504    1612 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/17857-1142/.minikube/profiles/functional-155000/client.crt: no such file or directory

ingress_addon_legacy_test.go:70: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p ingress-addon-legacy-212000 addons enable ingress --alsologtostderr -v=5: exit status 10 (1m29.334558951s)

-- stdout --

	* ingress is an addon maintained by Kubernetes. For any concerns contact minikube on GitHub.

	You can view the list of minikube maintainers at: https://github.com/kubernetes/minikube/blob/master/OWNERS

	* After the addon is enabled, please run "minikube tunnel" and your ingress resources would be available at "127.0.0.1"

	  - Using image registry.k8s.io/ingress-nginx/controller:v0.49.3

	  - Using image docker.io/jettech/kube-webhook-certgen:v1.5.1

	  - Using image docker.io/jettech/kube-webhook-certgen:v1.5.1

	* Verifying ingress addon...

-- /stdout --

** stderr ** 

	I1226 14:01:26.143364    4862 out.go:296] Setting OutFile to fd 1 ...

	I1226 14:01:26.143683    4862 out.go:343] TERM=,COLORTERM=, which probably does not support color

	I1226 14:01:26.143689    4862 out.go:309] Setting ErrFile to fd 2...

	I1226 14:01:26.143693    4862 out.go:343] TERM=,COLORTERM=, which probably does not support color

	I1226 14:01:26.143878    4862 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17857-1142/.minikube/bin

	I1226 14:01:26.144252    4862 mustload.go:65] Loading cluster: ingress-addon-legacy-212000

	I1226 14:01:26.144567    4862 config.go:182] Loaded profile config "ingress-addon-legacy-212000": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.18.20

	I1226 14:01:26.144583    4862 addons.go:600] checking whether the cluster is paused

	I1226 14:01:26.144665    4862 config.go:182] Loaded profile config "ingress-addon-legacy-212000": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.18.20

	I1226 14:01:26.144682    4862 host.go:66] Checking if "ingress-addon-legacy-212000" exists ...

	I1226 14:01:26.145123    4862 cli_runner.go:164] Run: docker container inspect ingress-addon-legacy-212000 --format={{.State.Status}}

	I1226 14:01:26.195241    4862 ssh_runner.go:195] Run: systemctl --version

	I1226 14:01:26.195331    4862 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ingress-addon-legacy-212000

	I1226 14:01:26.246960    4862 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:50500 SSHKeyPath:/Users/jenkins/minikube-integration/17857-1142/.minikube/machines/ingress-addon-legacy-212000/id_rsa Username:docker}

	I1226 14:01:26.330779    4862 ssh_runner.go:195] Run: docker ps --filter status=paused --filter=name=k8s_.*_(kube-system)_ --format={{.ID}}

	I1226 14:01:26.371025    4862 out.go:177] * ingress is an addon maintained by Kubernetes. For any concerns contact minikube on GitHub.

	You can view the list of minikube maintainers at: https://github.com/kubernetes/minikube/blob/master/OWNERS

	I1226 14:01:26.391936    4862 config.go:182] Loaded profile config "ingress-addon-legacy-212000": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.18.20

	I1226 14:01:26.391951    4862 addons.go:69] Setting ingress=true in profile "ingress-addon-legacy-212000"

	I1226 14:01:26.391959    4862 addons.go:237] Setting addon ingress=true in "ingress-addon-legacy-212000"

	I1226 14:01:26.391985    4862 host.go:66] Checking if "ingress-addon-legacy-212000" exists ...

	I1226 14:01:26.392282    4862 cli_runner.go:164] Run: docker container inspect ingress-addon-legacy-212000 --format={{.State.Status}}

	I1226 14:01:26.464590    4862 out.go:177] * After the addon is enabled, please run "minikube tunnel" and your ingress resources would be available at "127.0.0.1"

	I1226 14:01:26.485734    4862 out.go:177]   - Using image registry.k8s.io/ingress-nginx/controller:v0.49.3

	I1226 14:01:26.506724    4862 out.go:177]   - Using image docker.io/jettech/kube-webhook-certgen:v1.5.1

	I1226 14:01:26.527524    4862 out.go:177]   - Using image docker.io/jettech/kube-webhook-certgen:v1.5.1

	I1226 14:01:26.549031    4862 addons.go:429] installing /etc/kubernetes/addons/ingress-deploy.yaml

	I1226 14:01:26.549057    4862 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ingress-deploy.yaml (15618 bytes)

	I1226 14:01:26.549151    4862 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ingress-addon-legacy-212000

	I1226 14:01:26.600704    4862 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:50500 SSHKeyPath:/Users/jenkins/minikube-integration/17857-1142/.minikube/machines/ingress-addon-legacy-212000/id_rsa Username:docker}

	I1226 14:01:26.695890    4862 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply -f /etc/kubernetes/addons/ingress-deploy.yaml

	W1226 14:01:26.743410    4862 addons.go:455] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply -f /etc/kubernetes/addons/ingress-deploy.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	I1226 14:01:26.743437    4862 retry.go:31] will retry after 164.030373ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply -f /etc/kubernetes/addons/ingress-deploy.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	I1226 14:01:26.908807    4862 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply --force -f /etc/kubernetes/addons/ingress-deploy.yaml

	W1226 14:01:26.959703    4862 addons.go:455] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply --force -f /etc/kubernetes/addons/ingress-deploy.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	I1226 14:01:26.959720    4862 retry.go:31] will retry after 398.496073ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply --force -f /etc/kubernetes/addons/ingress-deploy.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	I1226 14:01:27.358455    4862 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply --force -f /etc/kubernetes/addons/ingress-deploy.yaml

	W1226 14:01:27.407715    4862 addons.go:455] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply --force -f /etc/kubernetes/addons/ingress-deploy.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	I1226 14:01:27.407738    4862 retry.go:31] will retry after 301.792464ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply --force -f /etc/kubernetes/addons/ingress-deploy.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	I1226 14:01:27.709666    4862 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply --force -f /etc/kubernetes/addons/ingress-deploy.yaml

	W1226 14:01:27.760417    4862 addons.go:455] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply --force -f /etc/kubernetes/addons/ingress-deploy.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	I1226 14:01:27.760436    4862 retry.go:31] will retry after 688.735082ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply --force -f /etc/kubernetes/addons/ingress-deploy.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	I1226 14:01:28.449362    4862 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply --force -f /etc/kubernetes/addons/ingress-deploy.yaml

	W1226 14:01:28.500185    4862 addons.go:455] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply --force -f /etc/kubernetes/addons/ingress-deploy.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	I1226 14:01:28.500202    4862 retry.go:31] will retry after 1.831922127s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply --force -f /etc/kubernetes/addons/ingress-deploy.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	I1226 14:01:30.331853    4862 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply --force -f /etc/kubernetes/addons/ingress-deploy.yaml

	W1226 14:01:30.379115    4862 addons.go:455] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply --force -f /etc/kubernetes/addons/ingress-deploy.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	I1226 14:01:30.379133    4862 retry.go:31] will retry after 1.070489126s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply --force -f /etc/kubernetes/addons/ingress-deploy.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	I1226 14:01:31.449665    4862 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply --force -f /etc/kubernetes/addons/ingress-deploy.yaml

	W1226 14:01:31.505899    4862 addons.go:455] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply --force -f /etc/kubernetes/addons/ingress-deploy.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	I1226 14:01:31.505927    4862 retry.go:31] will retry after 3.80501616s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply --force -f /etc/kubernetes/addons/ingress-deploy.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	I1226 14:01:35.310998    4862 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply --force -f /etc/kubernetes/addons/ingress-deploy.yaml

	W1226 14:01:35.361624    4862 addons.go:455] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply --force -f /etc/kubernetes/addons/ingress-deploy.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	I1226 14:01:35.361642    4862 retry.go:31] will retry after 6.210641915s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply --force -f /etc/kubernetes/addons/ingress-deploy.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	I1226 14:01:41.570706    4862 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply --force -f /etc/kubernetes/addons/ingress-deploy.yaml

	W1226 14:01:41.626002    4862 addons.go:455] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply --force -f /etc/kubernetes/addons/ingress-deploy.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	I1226 14:01:41.626020    4862 retry.go:31] will retry after 4.487934665s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply --force -f /etc/kubernetes/addons/ingress-deploy.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	I1226 14:01:46.113749    4862 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply --force -f /etc/kubernetes/addons/ingress-deploy.yaml

	W1226 14:01:46.164191    4862 addons.go:455] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply --force -f /etc/kubernetes/addons/ingress-deploy.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	I1226 14:01:46.164209    4862 retry.go:31] will retry after 10.107122974s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply --force -f /etc/kubernetes/addons/ingress-deploy.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	I1226 14:01:56.270818    4862 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply --force -f /etc/kubernetes/addons/ingress-deploy.yaml

	W1226 14:01:56.321402    4862 addons.go:455] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply --force -f /etc/kubernetes/addons/ingress-deploy.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	I1226 14:01:56.321420    4862 retry.go:31] will retry after 18.889757153s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply --force -f /etc/kubernetes/addons/ingress-deploy.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	I1226 14:02:15.211530    4862 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply --force -f /etc/kubernetes/addons/ingress-deploy.yaml

	W1226 14:02:15.266670    4862 addons.go:455] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply --force -f /etc/kubernetes/addons/ingress-deploy.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	I1226 14:02:15.266693    4862 retry.go:31] will retry after 19.608327686s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply --force -f /etc/kubernetes/addons/ingress-deploy.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	I1226 14:02:34.874812    4862 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply --force -f /etc/kubernetes/addons/ingress-deploy.yaml

	W1226 14:02:34.938422    4862 addons.go:455] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply --force -f /etc/kubernetes/addons/ingress-deploy.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	I1226 14:02:34.938440    4862 retry.go:31] will retry after 20.309973163s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply --force -f /etc/kubernetes/addons/ingress-deploy.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	I1226 14:02:55.248190    4862 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply --force -f /etc/kubernetes/addons/ingress-deploy.yaml

	W1226 14:02:55.297070    4862 addons.go:455] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply --force -f /etc/kubernetes/addons/ingress-deploy.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	I1226 14:02:55.297098    4862 addons.go:473] Verifying addon ingress=true in "ingress-addon-legacy-212000"

	I1226 14:02:55.318741    4862 out.go:177] * Verifying ingress addon...

	I1226 14:02:55.341528    4862 out.go:177] 

	W1226 14:02:55.363692    4862 out.go:239] X Exiting due to MK_ADDON_ENABLE: enable failed: run callbacks: running callbacks: [sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply --force -f /etc/kubernetes/addons/ingress-deploy.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	 get kube-client to validate ingress addon: client config: context "ingress-addon-legacy-212000" does not exist: client config: context "ingress-addon-legacy-212000" does not exist]

	X Exiting due to MK_ADDON_ENABLE: enable failed: run callbacks: running callbacks: [sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply --force -f /etc/kubernetes/addons/ingress-deploy.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	 get kube-client to validate ingress addon: client config: context "ingress-addon-legacy-212000" does not exist: client config: context "ingress-addon-legacy-212000" does not exist]

	W1226 14:02:55.363719    4862 out.go:239] * 

	* 

	W1226 14:02:55.366901    4862 out.go:239] ╭───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                                                           │

	│    * If the above advice does not help, please let us know:                                                               │

	│      https://github.com/kubernetes/minikube/issues/new/choose                                                             │

	│                                                                                                                           │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                  │

	│    * Please also attach the following file to the GitHub issue:                                                           │

	│    * - /var/folders/xd/3vdzn10d2gb_wxr7lj_p8h5c0000gp/T/minikube_addons_ecab7b1157b569c129811d3c2b680fbca2a6f3d2_0.log    │

	│                                                                                                                           │

	╰───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯

	╭───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                                                           │

	│    * If the above advice does not help, please let us know:                                                               │

	│      https://github.com/kubernetes/minikube/issues/new/choose                                                             │

	│                                                                                                                           │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                  │

	│    * Please also attach the following file to the GitHub issue:                                                           │

	│    * - /var/folders/xd/3vdzn10d2gb_wxr7lj_p8h5c0000gp/T/minikube_addons_ecab7b1157b569c129811d3c2b680fbca2a6f3d2_0.log    │

	│                                                                                                                           │

	╰───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯

	I1226 14:02:55.388594    4862 out.go:177] 

** /stderr **

ingress_addon_legacy_test.go:71: failed to enable ingress addon: exit status 10

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:230: ======>  post-mortem[TestIngressAddonLegacy/serial/ValidateIngressAddonActivation]: docker inspect <======

helpers_test.go:231: (dbg) Run:  docker inspect ingress-addon-legacy-212000

helpers_test.go:235: (dbg) docker inspect ingress-addon-legacy-212000:

-- stdout --

	[

	    {

	        "Id": "755360b2e3aeeb9d98803dbe341b3cbf61692a6a2ec8e0099c2e06d7558563e9",

	        "Created": "2023-12-26T21:57:14.231378159Z",

	        "Path": "/usr/local/bin/entrypoint",

	        "Args": [

	            "/sbin/init"

	        ],

	        "State": {

	            "Status": "running",

	            "Running": true,

	            "Paused": false,

	            "Restarting": false,

	            "OOMKilled": false,

	            "Dead": false,

	            "Pid": 53221,

	            "ExitCode": 0,

	            "Error": "",

	            "StartedAt": "2023-12-26T21:57:14.44476773Z",

	            "FinishedAt": "0001-01-01T00:00:00Z"

	        },

	        "Image": "sha256:b531f61d9bfacb74e25e3fb20a2533b78fa4bf98ca9061755006074ff8c2c789",

	        "ResolvConfPath": "/var/lib/docker/containers/755360b2e3aeeb9d98803dbe341b3cbf61692a6a2ec8e0099c2e06d7558563e9/resolv.conf",

	        "HostnamePath": "/var/lib/docker/containers/755360b2e3aeeb9d98803dbe341b3cbf61692a6a2ec8e0099c2e06d7558563e9/hostname",

	        "HostsPath": "/var/lib/docker/containers/755360b2e3aeeb9d98803dbe341b3cbf61692a6a2ec8e0099c2e06d7558563e9/hosts",

	        "LogPath": "/var/lib/docker/containers/755360b2e3aeeb9d98803dbe341b3cbf61692a6a2ec8e0099c2e06d7558563e9/755360b2e3aeeb9d98803dbe341b3cbf61692a6a2ec8e0099c2e06d7558563e9-json.log",

	        "Name": "/ingress-addon-legacy-212000",

	        "RestartCount": 0,

	        "Driver": "overlay2",

	        "Platform": "linux",

	        "MountLabel": "",

	        "ProcessLabel": "",

	        "AppArmorProfile": "",

	        "ExecIDs": null,

	        "HostConfig": {

	            "Binds": [

	                "/lib/modules:/lib/modules:ro",

	                "ingress-addon-legacy-212000:/var"

	            ],

	            "ContainerIDFile": "",

	            "LogConfig": {

	                "Type": "json-file",

	                "Config": {}

	            },

	            "NetworkMode": "ingress-addon-legacy-212000",

	            "PortBindings": {

	                "22/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "0"

	                    }

	                ],

	                "2376/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "0"

	                    }

	                ],

	                "32443/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "0"

	                    }

	                ],

	                "5000/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "0"

	                    }

	                ],

	                "8443/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "0"

	                    }

	                ]

	            },

	            "RestartPolicy": {

	                "Name": "no",

	                "MaximumRetryCount": 0

	            },

	            "AutoRemove": false,

	            "VolumeDriver": "",

	            "VolumesFrom": null,

	            "ConsoleSize": [

	                0,

	                0

	            ],

	            "CapAdd": null,

	            "CapDrop": null,

	            "CgroupnsMode": "private",

	            "Dns": [],

	            "DnsOptions": [],

	            "DnsSearch": [],

	            "ExtraHosts": null,

	            "GroupAdd": null,

	            "IpcMode": "private",

	            "Cgroup": "",

	            "Links": null,

	            "OomScoreAdj": 0,

	            "PidMode": "",

	            "Privileged": true,

	            "PublishAllPorts": false,

	            "ReadonlyRootfs": false,

	            "SecurityOpt": [

	                "seccomp=unconfined",

	                "apparmor=unconfined",

	                "label=disable"

	            ],

	            "Tmpfs": {

	                "/run": "",

	                "/tmp": ""

	            },

	            "UTSMode": "",

	            "UsernsMode": "",

	            "ShmSize": 67108864,

	            "Runtime": "runc",

	            "Isolation": "",

	            "CpuShares": 0,

	            "Memory": 4294967296,

	            "NanoCpus": 2000000000,

	            "CgroupParent": "",

	            "BlkioWeight": 0,

	            "BlkioWeightDevice": [],

	            "BlkioDeviceReadBps": [],

	            "BlkioDeviceWriteBps": [],

	            "BlkioDeviceReadIOps": [],

	            "BlkioDeviceWriteIOps": [],

	            "CpuPeriod": 0,

	            "CpuQuota": 0,

	            "CpuRealtimePeriod": 0,

	            "CpuRealtimeRuntime": 0,

	            "CpusetCpus": "",

	            "CpusetMems": "",

	            "Devices": [],

	            "DeviceCgroupRules": null,

	            "DeviceRequests": null,

	            "MemoryReservation": 0,

	            "MemorySwap": 4294967296,

	            "MemorySwappiness": null,

	            "OomKillDisable": null,

	            "PidsLimit": null,

	            "Ulimits": null,

	            "CpuCount": 0,

	            "CpuPercent": 0,

	            "IOMaximumIOps": 0,

	            "IOMaximumBandwidth": 0,

	            "MaskedPaths": null,

	            "ReadonlyPaths": null

	        },

	        "GraphDriver": {

	            "Data": {

	                "LowerDir": "/var/lib/docker/overlay2/f4a9a8fc432a420afdcc03c7ff045d48660305f8f5fed07ed90a8137d52cd1ad-init/diff:/var/lib/docker/overlay2/9504b64c51e562d355bf6588d6f3a8de52c401736ff8b5d6bc5c642b8ed6a207/diff",

	                "MergedDir": "/var/lib/docker/overlay2/f4a9a8fc432a420afdcc03c7ff045d48660305f8f5fed07ed90a8137d52cd1ad/merged",

	                "UpperDir": "/var/lib/docker/overlay2/f4a9a8fc432a420afdcc03c7ff045d48660305f8f5fed07ed90a8137d52cd1ad/diff",

	                "WorkDir": "/var/lib/docker/overlay2/f4a9a8fc432a420afdcc03c7ff045d48660305f8f5fed07ed90a8137d52cd1ad/work"

	            },

	            "Name": "overlay2"

	        },

	        "Mounts": [

	            {

	                "Type": "volume",

	                "Name": "ingress-addon-legacy-212000",

	                "Source": "/var/lib/docker/volumes/ingress-addon-legacy-212000/_data",

	                "Destination": "/var",

	                "Driver": "local",

	                "Mode": "z",

	                "RW": true,

	                "Propagation": ""

	            },

	            {

	                "Type": "bind",

	                "Source": "/lib/modules",

	                "Destination": "/lib/modules",

	                "Mode": "ro",

	                "RW": false,

	                "Propagation": "rprivate"

	            }

	        ],

	        "Config": {

	            "Hostname": "ingress-addon-legacy-212000",

	            "Domainname": "",

	            "User": "",

	            "AttachStdin": false,

	            "AttachStdout": false,

	            "AttachStderr": false,

	            "ExposedPorts": {

	                "22/tcp": {},

	                "2376/tcp": {},

	                "32443/tcp": {},

	                "5000/tcp": {},

	                "8443/tcp": {}

	            },

	            "Tty": true,

	            "OpenStdin": false,

	            "StdinOnce": false,

	            "Env": [

	                "container=docker",

	                "PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"

	            ],

	            "Cmd": null,

	            "Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1703498848-17857@sha256:81ae12a49915e4f02aa382dd3758a30a6649e1143c32b3d03309750104577c6c",

	            "Volumes": null,

	            "WorkingDir": "/",

	            "Entrypoint": [

	                "/usr/local/bin/entrypoint",

	                "/sbin/init"

	            ],

	            "OnBuild": null,

	            "Labels": {

	                "created_by.minikube.sigs.k8s.io": "true",

	                "mode.minikube.sigs.k8s.io": "ingress-addon-legacy-212000",

	                "name.minikube.sigs.k8s.io": "ingress-addon-legacy-212000",

	                "role.minikube.sigs.k8s.io": ""

	            },

	            "StopSignal": "SIGRTMIN+3"

	        },

	        "NetworkSettings": {

	            "Bridge": "",

	            "SandboxID": "a6cfee8a401de57eac3c02136fab23478d742649b5313ba558204f08f2d4ceef",

	            "HairpinMode": false,

	            "LinkLocalIPv6Address": "",

	            "LinkLocalIPv6PrefixLen": 0,

	            "Ports": {

	                "22/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "50500"

	                    }

	                ],

	                "2376/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "50501"

	                    }

	                ],

	                "32443/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "50502"

	                    }

	                ],

	                "5000/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "50498"

	                    }

	                ],

	                "8443/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "50499"

	                    }

	                ]

	            },

	            "SandboxKey": "/var/run/docker/netns/a6cfee8a401d",

	            "SecondaryIPAddresses": null,

	            "SecondaryIPv6Addresses": null,

	            "EndpointID": "",

	            "Gateway": "",

	            "GlobalIPv6Address": "",

	            "GlobalIPv6PrefixLen": 0,

	            "IPAddress": "",

	            "IPPrefixLen": 0,

	            "IPv6Gateway": "",

	            "MacAddress": "",

	            "Networks": {

	                "ingress-addon-legacy-212000": {

	                    "IPAMConfig": {

	                        "IPv4Address": "192.168.49.2"

	                    },

	                    "Links": null,

	                    "Aliases": [

	                        "755360b2e3ae",

	                        "ingress-addon-legacy-212000"

	                    ],

	                    "MacAddress": "02:42:c0:a8:31:02",

	                    "NetworkID": "f18f3794c7e5fddb27c76273f30f639278bf224b14dcb34feb82a422c43b9ebc",

	                    "EndpointID": "850cd54f9d707054f402b3965f5b70312c302c6c4b4b7e112f185020ad080ce7",

	                    "Gateway": "192.168.49.1",

	                    "IPAddress": "192.168.49.2",

	                    "IPPrefixLen": 24,

	                    "IPv6Gateway": "",

	                    "GlobalIPv6Address": "",

	                    "GlobalIPv6PrefixLen": 0,

	                    "DriverOpts": null

	                }

	            }

	        }

	    }

	]

-- /stdout --

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p ingress-addon-legacy-212000 -n ingress-addon-legacy-212000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p ingress-addon-legacy-212000 -n ingress-addon-legacy-212000: exit status 6 (372.84059ms)

-- stdout --

	Running

	WARNING: Your kubectl is pointing to stale minikube-vm.

	To fix the kubectl context, run `minikube update-context`

-- /stdout --

** stderr ** 

	E1226 14:02:55.828186    4910 status.go:415] kubeconfig endpoint: extract IP: "ingress-addon-legacy-212000" does not appear in /Users/jenkins/minikube-integration/17857-1142/kubeconfig

** /stderr **

helpers_test.go:239: status error: exit status 6 (may be ok)

helpers_test.go:241: "ingress-addon-legacy-212000" host is not running, skipping log retrieval (state="Running\nWARNING: Your kubectl is pointing to stale minikube-vm.\nTo fix the kubectl context, run `minikube update-context`")

--- FAIL: TestIngressAddonLegacy/serial/ValidateIngressAddonActivation (89.76s)

=== RUN   TestIngressAddonLegacy/serial/ValidateIngressDNSAddonActivation

ingress_addon_legacy_test.go:79: (dbg) Run:  out/minikube-darwin-amd64 -p ingress-addon-legacy-212000 addons enable ingress-dns --alsologtostderr -v=5

E1226 14:03:46.184946    1612 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/17857-1142/.minikube/profiles/addons-914000/client.crt: no such file or directory

E1226 14:04:36.157495    1612 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/17857-1142/.minikube/profiles/functional-155000/client.crt: no such file or directory

ingress_addon_legacy_test.go:79: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p ingress-addon-legacy-212000 addons enable ingress-dns --alsologtostderr -v=5: exit status 10 (1m53.680781814s)

-- stdout --

	* ingress-dns is an addon maintained by minikube. For any concerns contact minikube on GitHub.

	You can view the list of minikube maintainers at: https://github.com/kubernetes/minikube/blob/master/OWNERS

	* After the addon is enabled, please run "minikube tunnel" and your ingress resources would be available at "127.0.0.1"

	  - Using image cryptexlabs/minikube-ingress-dns:0.3.0

-- /stdout --

** stderr ** 

	I1226 14:02:55.892966    4920 out.go:296] Setting OutFile to fd 1 ...

	I1226 14:02:55.893351    4920 out.go:343] TERM=,COLORTERM=, which probably does not support color

	I1226 14:02:55.893357    4920 out.go:309] Setting ErrFile to fd 2...

	I1226 14:02:55.893361    4920 out.go:343] TERM=,COLORTERM=, which probably does not support color

	I1226 14:02:55.893535    4920 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17857-1142/.minikube/bin

	I1226 14:02:55.893931    4920 mustload.go:65] Loading cluster: ingress-addon-legacy-212000

	I1226 14:02:55.894206    4920 config.go:182] Loaded profile config "ingress-addon-legacy-212000": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.18.20

	I1226 14:02:55.894222    4920 addons.go:600] checking whether the cluster is paused

	I1226 14:02:55.894300    4920 config.go:182] Loaded profile config "ingress-addon-legacy-212000": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.18.20

	I1226 14:02:55.894316    4920 host.go:66] Checking if "ingress-addon-legacy-212000" exists ...

	I1226 14:02:55.894691    4920 cli_runner.go:164] Run: docker container inspect ingress-addon-legacy-212000 --format={{.State.Status}}

	I1226 14:02:55.944763    4920 ssh_runner.go:195] Run: systemctl --version

	I1226 14:02:55.944849    4920 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ingress-addon-legacy-212000

	I1226 14:02:55.994656    4920 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:50500 SSHKeyPath:/Users/jenkins/minikube-integration/17857-1142/.minikube/machines/ingress-addon-legacy-212000/id_rsa Username:docker}

	I1226 14:02:56.080267    4920 ssh_runner.go:195] Run: docker ps --filter status=paused --filter=name=k8s_.*_(kube-system)_ --format={{.ID}}

	I1226 14:02:56.121505    4920 out.go:177] * ingress-dns is an addon maintained by minikube. For any concerns contact minikube on GitHub.

	You can view the list of minikube maintainers at: https://github.com/kubernetes/minikube/blob/master/OWNERS

	I1226 14:02:56.142261    4920 config.go:182] Loaded profile config "ingress-addon-legacy-212000": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.18.20

	I1226 14:02:56.142276    4920 addons.go:69] Setting ingress-dns=true in profile "ingress-addon-legacy-212000"

	I1226 14:02:56.142286    4920 addons.go:237] Setting addon ingress-dns=true in "ingress-addon-legacy-212000"

	I1226 14:02:56.142325    4920 host.go:66] Checking if "ingress-addon-legacy-212000" exists ...

	I1226 14:02:56.142747    4920 cli_runner.go:164] Run: docker container inspect ingress-addon-legacy-212000 --format={{.State.Status}}

	I1226 14:02:56.214958    4920 out.go:177] * After the addon is enabled, please run "minikube tunnel" and your ingress resources would be available at "127.0.0.1"

	I1226 14:02:56.236202    4920 out.go:177]   - Using image cryptexlabs/minikube-ingress-dns:0.3.0

	I1226 14:02:56.257165    4920 addons.go:429] installing /etc/kubernetes/addons/ingress-dns-pod.yaml

	I1226 14:02:56.257186    4920 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ingress-dns-pod.yaml (2434 bytes)

	I1226 14:02:56.257272    4920 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ingress-addon-legacy-212000

	I1226 14:02:56.310863    4920 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:50500 SSHKeyPath:/Users/jenkins/minikube-integration/17857-1142/.minikube/machines/ingress-addon-legacy-212000/id_rsa Username:docker}

	I1226 14:02:56.405463    4920 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply -f /etc/kubernetes/addons/ingress-dns-pod.yaml

	W1226 14:02:56.453190    4920 addons.go:455] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply -f /etc/kubernetes/addons/ingress-dns-pod.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	I1226 14:02:56.453218    4920 retry.go:31] will retry after 339.943369ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply -f /etc/kubernetes/addons/ingress-dns-pod.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	I1226 14:02:56.793916    4920 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply --force -f /etc/kubernetes/addons/ingress-dns-pod.yaml

	W1226 14:02:56.844338    4920 addons.go:455] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply --force -f /etc/kubernetes/addons/ingress-dns-pod.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	I1226 14:02:56.844360    4920 retry.go:31] will retry after 236.083313ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply --force -f /etc/kubernetes/addons/ingress-dns-pod.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	I1226 14:02:57.080993    4920 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply --force -f /etc/kubernetes/addons/ingress-dns-pod.yaml

	W1226 14:02:57.142718    4920 addons.go:455] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply --force -f /etc/kubernetes/addons/ingress-dns-pod.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	I1226 14:02:57.142739    4920 retry.go:31] will retry after 768.337257ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply --force -f /etc/kubernetes/addons/ingress-dns-pod.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	I1226 14:02:57.911348    4920 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply --force -f /etc/kubernetes/addons/ingress-dns-pod.yaml

	W1226 14:02:57.964751    4920 addons.go:455] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply --force -f /etc/kubernetes/addons/ingress-dns-pod.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	I1226 14:02:57.964770    4920 retry.go:31] will retry after 441.11233ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply --force -f /etc/kubernetes/addons/ingress-dns-pod.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	I1226 14:02:58.406194    4920 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply --force -f /etc/kubernetes/addons/ingress-dns-pod.yaml

	W1226 14:02:58.464474    4920 addons.go:455] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply --force -f /etc/kubernetes/addons/ingress-dns-pod.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	I1226 14:02:58.464499    4920 retry.go:31] will retry after 1.687221757s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply --force -f /etc/kubernetes/addons/ingress-dns-pod.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	I1226 14:03:00.152286    4920 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply --force -f /etc/kubernetes/addons/ingress-dns-pod.yaml

	W1226 14:03:00.213051    4920 addons.go:455] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply --force -f /etc/kubernetes/addons/ingress-dns-pod.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	I1226 14:03:00.213067    4920 retry.go:31] will retry after 2.708014266s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply --force -f /etc/kubernetes/addons/ingress-dns-pod.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	I1226 14:03:02.921232    4920 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply --force -f /etc/kubernetes/addons/ingress-dns-pod.yaml

	W1226 14:03:02.973269    4920 addons.go:455] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply --force -f /etc/kubernetes/addons/ingress-dns-pod.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	I1226 14:03:02.973287    4920 retry.go:31] will retry after 2.188871117s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply --force -f /etc/kubernetes/addons/ingress-dns-pod.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	I1226 14:03:05.162508    4920 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply --force -f /etc/kubernetes/addons/ingress-dns-pod.yaml

	W1226 14:03:05.212320    4920 addons.go:455] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply --force -f /etc/kubernetes/addons/ingress-dns-pod.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	I1226 14:03:05.212347    4920 retry.go:31] will retry after 5.813488108s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply --force -f /etc/kubernetes/addons/ingress-dns-pod.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	I1226 14:03:11.026654    4920 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply --force -f /etc/kubernetes/addons/ingress-dns-pod.yaml

	W1226 14:03:11.088438    4920 addons.go:455] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply --force -f /etc/kubernetes/addons/ingress-dns-pod.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	I1226 14:03:11.088457    4920 retry.go:31] will retry after 5.863686618s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply --force -f /etc/kubernetes/addons/ingress-dns-pod.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	I1226 14:03:16.954346    4920 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply --force -f /etc/kubernetes/addons/ingress-dns-pod.yaml

	W1226 14:03:17.006642    4920 addons.go:455] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply --force -f /etc/kubernetes/addons/ingress-dns-pod.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	I1226 14:03:17.006669    4920 retry.go:31] will retry after 11.32025415s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply --force -f /etc/kubernetes/addons/ingress-dns-pod.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	I1226 14:03:28.327450    4920 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply --force -f /etc/kubernetes/addons/ingress-dns-pod.yaml

	W1226 14:03:28.383015    4920 addons.go:455] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply --force -f /etc/kubernetes/addons/ingress-dns-pod.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	I1226 14:03:28.383031    4920 retry.go:31] will retry after 17.567102449s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply --force -f /etc/kubernetes/addons/ingress-dns-pod.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	I1226 14:03:45.951763    4920 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply --force -f /etc/kubernetes/addons/ingress-dns-pod.yaml

	W1226 14:03:46.005142    4920 addons.go:455] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply --force -f /etc/kubernetes/addons/ingress-dns-pod.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	I1226 14:03:46.005165    4920 retry.go:31] will retry after 27.604226493s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply --force -f /etc/kubernetes/addons/ingress-dns-pod.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	I1226 14:04:13.609430    4920 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply --force -f /etc/kubernetes/addons/ingress-dns-pod.yaml

	W1226 14:04:13.666427    4920 addons.go:455] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply --force -f /etc/kubernetes/addons/ingress-dns-pod.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	I1226 14:04:13.666451    4920 retry.go:31] will retry after 35.692410103s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply --force -f /etc/kubernetes/addons/ingress-dns-pod.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	I1226 14:04:49.360488    4920 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply --force -f /etc/kubernetes/addons/ingress-dns-pod.yaml

	W1226 14:04:49.428178    4920 addons.go:455] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply --force -f /etc/kubernetes/addons/ingress-dns-pod.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	I1226 14:04:49.450005    4920 out.go:177] 

	W1226 14:04:49.470933    4920 out.go:239] X Exiting due to MK_ADDON_ENABLE: enable failed: run callbacks: running callbacks: [sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply --force -f /etc/kubernetes/addons/ingress-dns-pod.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	]

	X Exiting due to MK_ADDON_ENABLE: enable failed: run callbacks: running callbacks: [sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply --force -f /etc/kubernetes/addons/ingress-dns-pod.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	]

	W1226 14:04:49.470970    4920 out.go:239] * 

	* 

	W1226 14:04:49.474308    4920 out.go:239] ╭───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                                                           │

	│    * If the above advice does not help, please let us know:                                                               │

	│      https://github.com/kubernetes/minikube/issues/new/choose                                                             │

	│                                                                                                                           │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                  │

	│    * Please also attach the following file to the GitHub issue:                                                           │

	│    * - /var/folders/xd/3vdzn10d2gb_wxr7lj_p8h5c0000gp/T/minikube_addons_26091442b04c5e26589fdfa18b5031c2ff11dd6b_0.log    │

	│                                                                                                                           │

	╰───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯

	╭───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                                                           │

	│    * If the above advice does not help, please let us know:                                                               │

	│      https://github.com/kubernetes/minikube/issues/new/choose                                                             │

	│                                                                                                                           │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                  │

	│    * Please also attach the following file to the GitHub issue:                                                           │

	│    * - /var/folders/xd/3vdzn10d2gb_wxr7lj_p8h5c0000gp/T/minikube_addons_26091442b04c5e26589fdfa18b5031c2ff11dd6b_0.log    │

	│                                                                                                                           │

	╰───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯

	I1226 14:04:49.495576    4920 out.go:177] 

** /stderr **

ingress_addon_legacy_test.go:80: failed to enable ingress-dns addon: exit status 10

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:230: ======>  post-mortem[TestIngressAddonLegacy/serial/ValidateIngressDNSAddonActivation]: docker inspect <======

helpers_test.go:231: (dbg) Run:  docker inspect ingress-addon-legacy-212000

helpers_test.go:235: (dbg) docker inspect ingress-addon-legacy-212000:

-- stdout --

	[

	    {

	        "Id": "755360b2e3aeeb9d98803dbe341b3cbf61692a6a2ec8e0099c2e06d7558563e9",

	        "Created": "2023-12-26T21:57:14.231378159Z",

	        "Path": "/usr/local/bin/entrypoint",

	        "Args": [

	            "/sbin/init"

	        ],

	        "State": {

	            "Status": "running",

	            "Running": true,

	            "Paused": false,

	            "Restarting": false,

	            "OOMKilled": false,

	            "Dead": false,

	            "Pid": 53221,

	            "ExitCode": 0,

	            "Error": "",

	            "StartedAt": "2023-12-26T21:57:14.44476773Z",

	            "FinishedAt": "0001-01-01T00:00:00Z"

	        },

	        "Image": "sha256:b531f61d9bfacb74e25e3fb20a2533b78fa4bf98ca9061755006074ff8c2c789",

	        "ResolvConfPath": "/var/lib/docker/containers/755360b2e3aeeb9d98803dbe341b3cbf61692a6a2ec8e0099c2e06d7558563e9/resolv.conf",

	        "HostnamePath": "/var/lib/docker/containers/755360b2e3aeeb9d98803dbe341b3cbf61692a6a2ec8e0099c2e06d7558563e9/hostname",

	        "HostsPath": "/var/lib/docker/containers/755360b2e3aeeb9d98803dbe341b3cbf61692a6a2ec8e0099c2e06d7558563e9/hosts",

	        "LogPath": "/var/lib/docker/containers/755360b2e3aeeb9d98803dbe341b3cbf61692a6a2ec8e0099c2e06d7558563e9/755360b2e3aeeb9d98803dbe341b3cbf61692a6a2ec8e0099c2e06d7558563e9-json.log",

	        "Name": "/ingress-addon-legacy-212000",

	        "RestartCount": 0,

	        "Driver": "overlay2",

	        "Platform": "linux",

	        "MountLabel": "",

	        "ProcessLabel": "",

	        "AppArmorProfile": "",

	        "ExecIDs": null,

	        "HostConfig": {

	            "Binds": [

	                "/lib/modules:/lib/modules:ro",

	                "ingress-addon-legacy-212000:/var"

	            ],

	            "ContainerIDFile": "",

	            "LogConfig": {

	                "Type": "json-file",

	                "Config": {}

	            },

	            "NetworkMode": "ingress-addon-legacy-212000",

	            "PortBindings": {

	                "22/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "0"

	                    }

	                ],

	                "2376/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "0"

	                    }

	                ],

	                "32443/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "0"

	                    }

	                ],

	                "5000/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "0"

	                    }

	                ],

	                "8443/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "0"

	                    }

	                ]

	            },

	            "RestartPolicy": {

	                "Name": "no",

	                "MaximumRetryCount": 0

	            },

	            "AutoRemove": false,

	            "VolumeDriver": "",

	            "VolumesFrom": null,

	            "ConsoleSize": [

	                0,

	                0

	            ],

	            "CapAdd": null,

	            "CapDrop": null,

	            "CgroupnsMode": "private",

	            "Dns": [],

	            "DnsOptions": [],

	            "DnsSearch": [],

	            "ExtraHosts": null,

	            "GroupAdd": null,

	            "IpcMode": "private",

	            "Cgroup": "",

	            "Links": null,

	            "OomScoreAdj": 0,

	            "PidMode": "",

	            "Privileged": true,

	            "PublishAllPorts": false,

	            "ReadonlyRootfs": false,

	            "SecurityOpt": [

	                "seccomp=unconfined",

	                "apparmor=unconfined",

	                "label=disable"

	            ],

	            "Tmpfs": {

	                "/run": "",

	                "/tmp": ""

	            },

	            "UTSMode": "",

	            "UsernsMode": "",

	            "ShmSize": 67108864,

	            "Runtime": "runc",

	            "Isolation": "",

	            "CpuShares": 0,

	            "Memory": 4294967296,

	            "NanoCpus": 2000000000,

	            "CgroupParent": "",

	            "BlkioWeight": 0,

	            "BlkioWeightDevice": [],

	            "BlkioDeviceReadBps": [],

	            "BlkioDeviceWriteBps": [],

	            "BlkioDeviceReadIOps": [],

	            "BlkioDeviceWriteIOps": [],

	            "CpuPeriod": 0,

	            "CpuQuota": 0,

	            "CpuRealtimePeriod": 0,

	            "CpuRealtimeRuntime": 0,

	            "CpusetCpus": "",

	            "CpusetMems": "",

	            "Devices": [],

	            "DeviceCgroupRules": null,

	            "DeviceRequests": null,

	            "MemoryReservation": 0,

	            "MemorySwap": 4294967296,

	            "MemorySwappiness": null,

	            "OomKillDisable": null,

	            "PidsLimit": null,

	            "Ulimits": null,

	            "CpuCount": 0,

	            "CpuPercent": 0,

	            "IOMaximumIOps": 0,

	            "IOMaximumBandwidth": 0,

	            "MaskedPaths": null,

	            "ReadonlyPaths": null

	        },

	        "GraphDriver": {

	            "Data": {

	                "LowerDir": "/var/lib/docker/overlay2/f4a9a8fc432a420afdcc03c7ff045d48660305f8f5fed07ed90a8137d52cd1ad-init/diff:/var/lib/docker/overlay2/9504b64c51e562d355bf6588d6f3a8de52c401736ff8b5d6bc5c642b8ed6a207/diff",

	                "MergedDir": "/var/lib/docker/overlay2/f4a9a8fc432a420afdcc03c7ff045d48660305f8f5fed07ed90a8137d52cd1ad/merged",

	                "UpperDir": "/var/lib/docker/overlay2/f4a9a8fc432a420afdcc03c7ff045d48660305f8f5fed07ed90a8137d52cd1ad/diff",

	                "WorkDir": "/var/lib/docker/overlay2/f4a9a8fc432a420afdcc03c7ff045d48660305f8f5fed07ed90a8137d52cd1ad/work"

	            },

	            "Name": "overlay2"

	        },

	        "Mounts": [

	            {

	                "Type": "bind",

	                "Source": "/lib/modules",

	                "Destination": "/lib/modules",

	                "Mode": "ro",

	                "RW": false,

	                "Propagation": "rprivate"

	            },

	            {

	                "Type": "volume",

	                "Name": "ingress-addon-legacy-212000",

	                "Source": "/var/lib/docker/volumes/ingress-addon-legacy-212000/_data",

	                "Destination": "/var",

	                "Driver": "local",

	                "Mode": "z",

	                "RW": true,

	                "Propagation": ""

	            }

	        ],

	        "Config": {

	            "Hostname": "ingress-addon-legacy-212000",

	            "Domainname": "",

	            "User": "",

	            "AttachStdin": false,

	            "AttachStdout": false,

	            "AttachStderr": false,

	            "ExposedPorts": {

	                "22/tcp": {},

	                "2376/tcp": {},

	                "32443/tcp": {},

	                "5000/tcp": {},

	                "8443/tcp": {}

	            },

	            "Tty": true,

	            "OpenStdin": false,

	            "StdinOnce": false,

	            "Env": [

	                "container=docker",

	                "PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"

	            ],

	            "Cmd": null,

	            "Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1703498848-17857@sha256:81ae12a49915e4f02aa382dd3758a30a6649e1143c32b3d03309750104577c6c",

	            "Volumes": null,

	            "WorkingDir": "/",

	            "Entrypoint": [

	                "/usr/local/bin/entrypoint",

	                "/sbin/init"

	            ],

	            "OnBuild": null,

	            "Labels": {

	                "created_by.minikube.sigs.k8s.io": "true",

	                "mode.minikube.sigs.k8s.io": "ingress-addon-legacy-212000",

	                "name.minikube.sigs.k8s.io": "ingress-addon-legacy-212000",

	                "role.minikube.sigs.k8s.io": ""

	            },

	            "StopSignal": "SIGRTMIN+3"

	        },

	        "NetworkSettings": {

	            "Bridge": "",

	            "SandboxID": "a6cfee8a401de57eac3c02136fab23478d742649b5313ba558204f08f2d4ceef",

	            "HairpinMode": false,

	            "LinkLocalIPv6Address": "",

	            "LinkLocalIPv6PrefixLen": 0,

	            "Ports": {

	                "22/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "50500"

	                    }

	                ],

	                "2376/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "50501"

	                    }

	                ],

	                "32443/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "50502"

	                    }

	                ],

	                "5000/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "50498"

	                    }

	                ],

	                "8443/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "50499"

	                    }

	                ]

	            },

	            "SandboxKey": "/var/run/docker/netns/a6cfee8a401d",

	            "SecondaryIPAddresses": null,

	            "SecondaryIPv6Addresses": null,

	            "EndpointID": "",

	            "Gateway": "",

	            "GlobalIPv6Address": "",

	            "GlobalIPv6PrefixLen": 0,

	            "IPAddress": "",

	            "IPPrefixLen": 0,

	            "IPv6Gateway": "",

	            "MacAddress": "",

	            "Networks": {

	                "ingress-addon-legacy-212000": {

	                    "IPAMConfig": {

	                        "IPv4Address": "192.168.49.2"

	                    },

	                    "Links": null,

	                    "Aliases": [

	                        "755360b2e3ae",

	                        "ingress-addon-legacy-212000"

	                    ],

	                    "MacAddress": "02:42:c0:a8:31:02",

	                    "NetworkID": "f18f3794c7e5fddb27c76273f30f639278bf224b14dcb34feb82a422c43b9ebc",

	                    "EndpointID": "850cd54f9d707054f402b3965f5b70312c302c6c4b4b7e112f185020ad080ce7",

	                    "Gateway": "192.168.49.1",

	                    "IPAddress": "192.168.49.2",

	                    "IPPrefixLen": 24,

	                    "IPv6Gateway": "",

	                    "GlobalIPv6Address": "",

	                    "GlobalIPv6PrefixLen": 0,

	                    "DriverOpts": null

	                }

	            }

	        }

	    }

	]

-- /stdout --

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p ingress-addon-legacy-212000 -n ingress-addon-legacy-212000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p ingress-addon-legacy-212000 -n ingress-addon-legacy-212000: exit status 6 (369.771136ms)

-- stdout --

	Running

	WARNING: Your kubectl is pointing to stale minikube-vm.

	To fix the kubectl context, run `minikube update-context`

-- /stdout --

** stderr ** 

	E1226 14:04:49.936343    4978 status.go:415] kubeconfig endpoint: extract IP: "ingress-addon-legacy-212000" does not appear in /Users/jenkins/minikube-integration/17857-1142/kubeconfig

** /stderr **

helpers_test.go:239: status error: exit status 6 (may be ok)

helpers_test.go:241: "ingress-addon-legacy-212000" host is not running, skipping log retrieval (state="Running\nWARNING: Your kubectl is pointing to stale minikube-vm.\nTo fix the kubectl context, run `minikube update-context`")

--- FAIL: TestIngressAddonLegacy/serial/ValidateIngressDNSAddonActivation (114.11s)

=== RUN   TestIngressAddonLegacy/serial/ValidateIngressAddons

addons_test.go:201: failed to get Kubernetes client: <nil>

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:230: ======>  post-mortem[TestIngressAddonLegacy/serial/ValidateIngressAddons]: docker inspect <======

helpers_test.go:231: (dbg) Run:  docker inspect ingress-addon-legacy-212000

helpers_test.go:235: (dbg) docker inspect ingress-addon-legacy-212000:

-- stdout --

	[

	    {

	        "Id": "755360b2e3aeeb9d98803dbe341b3cbf61692a6a2ec8e0099c2e06d7558563e9",

	        "Created": "2023-12-26T21:57:14.231378159Z",

	        "Path": "/usr/local/bin/entrypoint",

	        "Args": [

	            "/sbin/init"

	        ],

	        "State": {

	            "Status": "running",

	            "Running": true,

	            "Paused": false,

	            "Restarting": false,

	            "OOMKilled": false,

	            "Dead": false,

	            "Pid": 53221,

	            "ExitCode": 0,

	            "Error": "",

	            "StartedAt": "2023-12-26T21:57:14.44476773Z",

	            "FinishedAt": "0001-01-01T00:00:00Z"

	        },

	        "Image": "sha256:b531f61d9bfacb74e25e3fb20a2533b78fa4bf98ca9061755006074ff8c2c789",

	        "ResolvConfPath": "/var/lib/docker/containers/755360b2e3aeeb9d98803dbe341b3cbf61692a6a2ec8e0099c2e06d7558563e9/resolv.conf",

	        "HostnamePath": "/var/lib/docker/containers/755360b2e3aeeb9d98803dbe341b3cbf61692a6a2ec8e0099c2e06d7558563e9/hostname",

	        "HostsPath": "/var/lib/docker/containers/755360b2e3aeeb9d98803dbe341b3cbf61692a6a2ec8e0099c2e06d7558563e9/hosts",

	        "LogPath": "/var/lib/docker/containers/755360b2e3aeeb9d98803dbe341b3cbf61692a6a2ec8e0099c2e06d7558563e9/755360b2e3aeeb9d98803dbe341b3cbf61692a6a2ec8e0099c2e06d7558563e9-json.log",

	        "Name": "/ingress-addon-legacy-212000",

	        "RestartCount": 0,

	        "Driver": "overlay2",

	        "Platform": "linux",

	        "MountLabel": "",

	        "ProcessLabel": "",

	        "AppArmorProfile": "",

	        "ExecIDs": null,

	        "HostConfig": {

	            "Binds": [

	                "/lib/modules:/lib/modules:ro",

	                "ingress-addon-legacy-212000:/var"

	            ],

	            "ContainerIDFile": "",

	            "LogConfig": {

	                "Type": "json-file",

	                "Config": {}

	            },

	            "NetworkMode": "ingress-addon-legacy-212000",

	            "PortBindings": {

	                "22/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "0"

	                    }

	                ],

	                "2376/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "0"

	                    }

	                ],

	                "32443/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "0"

	                    }

	                ],

	                "5000/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "0"

	                    }

	                ],

	                "8443/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "0"

	                    }

	                ]

	            },

	            "RestartPolicy": {

	                "Name": "no",

	                "MaximumRetryCount": 0

	            },

	            "AutoRemove": false,

	            "VolumeDriver": "",

	            "VolumesFrom": null,

	            "ConsoleSize": [

	                0,

	                0

	            ],

	            "CapAdd": null,

	            "CapDrop": null,

	            "CgroupnsMode": "private",

	            "Dns": [],

	            "DnsOptions": [],

	            "DnsSearch": [],

	            "ExtraHosts": null,

	            "GroupAdd": null,

	            "IpcMode": "private",

	            "Cgroup": "",

	            "Links": null,

	            "OomScoreAdj": 0,

	            "PidMode": "",

	            "Privileged": true,

	            "PublishAllPorts": false,

	            "ReadonlyRootfs": false,

	            "SecurityOpt": [

	                "seccomp=unconfined",

	                "apparmor=unconfined",

	                "label=disable"

	            ],

	            "Tmpfs": {

	                "/run": "",

	                "/tmp": ""

	            },

	            "UTSMode": "",

	            "UsernsMode": "",

	            "ShmSize": 67108864,

	            "Runtime": "runc",

	            "Isolation": "",

	            "CpuShares": 0,

	            "Memory": 4294967296,

	            "NanoCpus": 2000000000,

	            "CgroupParent": "",

	            "BlkioWeight": 0,

	            "BlkioWeightDevice": [],

	            "BlkioDeviceReadBps": [],

	            "BlkioDeviceWriteBps": [],

	            "BlkioDeviceReadIOps": [],

	            "BlkioDeviceWriteIOps": [],

	            "CpuPeriod": 0,

	            "CpuQuota": 0,

	            "CpuRealtimePeriod": 0,

	            "CpuRealtimeRuntime": 0,

	            "CpusetCpus": "",

	            "CpusetMems": "",

	            "Devices": [],

	            "DeviceCgroupRules": null,

	            "DeviceRequests": null,

	            "MemoryReservation": 0,

	            "MemorySwap": 4294967296,

	            "MemorySwappiness": null,

	            "OomKillDisable": null,

	            "PidsLimit": null,

	            "Ulimits": null,

	            "CpuCount": 0,

	            "CpuPercent": 0,

	            "IOMaximumIOps": 0,

	            "IOMaximumBandwidth": 0,

	            "MaskedPaths": null,

	            "ReadonlyPaths": null

	        },

	        "GraphDriver": {

	            "Data": {

	                "LowerDir": "/var/lib/docker/overlay2/f4a9a8fc432a420afdcc03c7ff045d48660305f8f5fed07ed90a8137d52cd1ad-init/diff:/var/lib/docker/overlay2/9504b64c51e562d355bf6588d6f3a8de52c401736ff8b5d6bc5c642b8ed6a207/diff",

	                "MergedDir": "/var/lib/docker/overlay2/f4a9a8fc432a420afdcc03c7ff045d48660305f8f5fed07ed90a8137d52cd1ad/merged",

	                "UpperDir": "/var/lib/docker/overlay2/f4a9a8fc432a420afdcc03c7ff045d48660305f8f5fed07ed90a8137d52cd1ad/diff",

	                "WorkDir": "/var/lib/docker/overlay2/f4a9a8fc432a420afdcc03c7ff045d48660305f8f5fed07ed90a8137d52cd1ad/work"

	            },

	            "Name": "overlay2"

	        },

	        "Mounts": [

	            {

	                "Type": "volume",

	                "Name": "ingress-addon-legacy-212000",

	                "Source": "/var/lib/docker/volumes/ingress-addon-legacy-212000/_data",

	                "Destination": "/var",

	                "Driver": "local",

	                "Mode": "z",

	                "RW": true,

	                "Propagation": ""

	            },

	            {

	                "Type": "bind",

	                "Source": "/lib/modules",

	                "Destination": "/lib/modules",

	                "Mode": "ro",

	                "RW": false,

	                "Propagation": "rprivate"

	            }

	        ],

	        "Config": {

	            "Hostname": "ingress-addon-legacy-212000",

	            "Domainname": "",

	            "User": "",

	            "AttachStdin": false,

	            "AttachStdout": false,

	            "AttachStderr": false,

	            "ExposedPorts": {

	                "22/tcp": {},

	                "2376/tcp": {},

	                "32443/tcp": {},

	                "5000/tcp": {},

	                "8443/tcp": {}

	            },

	            "Tty": true,

	            "OpenStdin": false,

	            "StdinOnce": false,

	            "Env": [

	                "container=docker",

	                "PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"

	            ],

	            "Cmd": null,

	            "Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1703498848-17857@sha256:81ae12a49915e4f02aa382dd3758a30a6649e1143c32b3d03309750104577c6c",

	            "Volumes": null,

	            "WorkingDir": "/",

	            "Entrypoint": [

	                "/usr/local/bin/entrypoint",

	                "/sbin/init"

	            ],

	            "OnBuild": null,

	            "Labels": {

	                "created_by.minikube.sigs.k8s.io": "true",

	                "mode.minikube.sigs.k8s.io": "ingress-addon-legacy-212000",

	                "name.minikube.sigs.k8s.io": "ingress-addon-legacy-212000",

	                "role.minikube.sigs.k8s.io": ""

	            },

	            "StopSignal": "SIGRTMIN+3"

	        },

	        "NetworkSettings": {

	            "Bridge": "",

	            "SandboxID": "a6cfee8a401de57eac3c02136fab23478d742649b5313ba558204f08f2d4ceef",

	            "HairpinMode": false,

	            "LinkLocalIPv6Address": "",

	            "LinkLocalIPv6PrefixLen": 0,

	            "Ports": {

	                "22/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "50500"

	                    }

	                ],

	                "2376/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "50501"

	                    }

	                ],

	                "32443/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "50502"

	                    }

	                ],

	                "5000/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "50498"

	                    }

	                ],

	                "8443/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "50499"

	                    }

	                ]

	            },

	            "SandboxKey": "/var/run/docker/netns/a6cfee8a401d",

	            "SecondaryIPAddresses": null,

	            "SecondaryIPv6Addresses": null,

	            "EndpointID": "",

	            "Gateway": "",

	            "GlobalIPv6Address": "",

	            "GlobalIPv6PrefixLen": 0,

	            "IPAddress": "",

	            "IPPrefixLen": 0,

	            "IPv6Gateway": "",

	            "MacAddress": "",

	            "Networks": {

	                "ingress-addon-legacy-212000": {

	                    "IPAMConfig": {

	                        "IPv4Address": "192.168.49.2"

	                    },

	                    "Links": null,

	                    "Aliases": [

	                        "755360b2e3ae",

	                        "ingress-addon-legacy-212000"

	                    ],

	                    "MacAddress": "02:42:c0:a8:31:02",

	                    "NetworkID": "f18f3794c7e5fddb27c76273f30f639278bf224b14dcb34feb82a422c43b9ebc",

	                    "EndpointID": "850cd54f9d707054f402b3965f5b70312c302c6c4b4b7e112f185020ad080ce7",

	                    "Gateway": "192.168.49.1",

	                    "IPAddress": "192.168.49.2",

	                    "IPPrefixLen": 24,

	                    "IPv6Gateway": "",

	                    "GlobalIPv6Address": "",

	                    "GlobalIPv6PrefixLen": 0,

	                    "DriverOpts": null

	                }

	            }

	        }

	    }

	]

-- /stdout --

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p ingress-addon-legacy-212000 -n ingress-addon-legacy-212000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p ingress-addon-legacy-212000 -n ingress-addon-legacy-212000: exit status 6 (369.936673ms)

-- stdout --

	Running

	WARNING: Your kubectl is pointing to stale minikube-vm.

	To fix the kubectl context, run `minikube update-context`

-- /stdout --

** stderr ** 

	E1226 14:04:50.359882    4990 status.go:415] kubeconfig endpoint: extract IP: "ingress-addon-legacy-212000" does not appear in /Users/jenkins/minikube-integration/17857-1142/kubeconfig

** /stderr **

helpers_test.go:239: status error: exit status 6 (may be ok)

helpers_test.go:241: "ingress-addon-legacy-212000" host is not running, skipping log retrieval (state="Running\nWARNING: Your kubectl is pointing to stale minikube-vm.\nTo fix the kubectl context, run `minikube update-context`")

--- FAIL: TestIngressAddonLegacy/serial/ValidateIngressAddons (0.42s)

=== RUN   TestMountStart/serial/VerifyMountFirst

mount_start_test.go:114: (dbg) Run:  out/minikube-darwin-amd64 -p mount-start-1-581000 ssh -- ls /minikube-host

E1226 14:08:46.179261    1612 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/17857-1142/.minikube/profiles/addons-914000/client.crt: no such file or directory

E1226 14:09:36.152070    1612 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/17857-1142/.minikube/profiles/functional-155000/client.crt: no such file or directory

E1226 14:10:09.231691    1612 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/17857-1142/.minikube/profiles/addons-914000/client.crt: no such file or directory

E1226 14:13:46.174919    1612 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/17857-1142/.minikube/profiles/addons-914000/client.crt: no such file or directory

E1226 14:14:36.145514    1612 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/17857-1142/.minikube/profiles/functional-155000/client.crt: no such file or directory

E1226 14:15:59.200036    1612 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/17857-1142/.minikube/profiles/functional-155000/client.crt: no such file or directory

E1226 14:18:46.220224    1612 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/17857-1142/.minikube/profiles/addons-914000/client.crt: no such file or directory

E1226 14:19:36.193260    1612 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/17857-1142/.minikube/profiles/functional-155000/client.crt: no such file or directory

mount_start_test.go:114: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p mount-start-1-581000 ssh -- ls /minikube-host: signal: killed (14m52.746420351s)

mount_start_test.go:116: mount failed: "out/minikube-darwin-amd64 -p mount-start-1-581000 ssh -- ls /minikube-host" : signal: killed

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:230: ======>  post-mortem[TestMountStart/serial/VerifyMountFirst]: docker inspect <======

helpers_test.go:231: (dbg) Run:  docker inspect mount-start-1-581000

helpers_test.go:235: (dbg) docker inspect mount-start-1-581000:

-- stdout --

	[

	    {

	        "Id": "a25c0fcf2dc7ac9d20f4acc095ba339aee11f2b72db4179ba478d82ee530c20a",

	        "Created": "2023-12-26T22:08:29.656317258Z",

	        "Path": "/usr/local/bin/entrypoint",

	        "Args": [

	            "/sbin/init"

	        ],

	        "State": {

	            "Status": "running",

	            "Running": true,

	            "Paused": false,

	            "Restarting": false,

	            "OOMKilled": false,

	            "Dead": false,

	            "Pid": 98805,

	            "ExitCode": 0,

	            "Error": "",

	            "StartedAt": "2023-12-26T22:08:29.864874763Z",

	            "FinishedAt": "0001-01-01T00:00:00Z"

	        },

	        "Image": "sha256:b531f61d9bfacb74e25e3fb20a2533b78fa4bf98ca9061755006074ff8c2c789",

	        "ResolvConfPath": "/var/lib/docker/containers/a25c0fcf2dc7ac9d20f4acc095ba339aee11f2b72db4179ba478d82ee530c20a/resolv.conf",

	        "HostnamePath": "/var/lib/docker/containers/a25c0fcf2dc7ac9d20f4acc095ba339aee11f2b72db4179ba478d82ee530c20a/hostname",

	        "HostsPath": "/var/lib/docker/containers/a25c0fcf2dc7ac9d20f4acc095ba339aee11f2b72db4179ba478d82ee530c20a/hosts",

	        "LogPath": "/var/lib/docker/containers/a25c0fcf2dc7ac9d20f4acc095ba339aee11f2b72db4179ba478d82ee530c20a/a25c0fcf2dc7ac9d20f4acc095ba339aee11f2b72db4179ba478d82ee530c20a-json.log",

	        "Name": "/mount-start-1-581000",

	        "RestartCount": 0,

	        "Driver": "overlay2",

	        "Platform": "linux",

	        "MountLabel": "",

	        "ProcessLabel": "",

	        "AppArmorProfile": "",

	        "ExecIDs": null,

	        "HostConfig": {

	            "Binds": [

	                "/lib/modules:/lib/modules:ro",

	                "mount-start-1-581000:/var",

	                "/host_mnt/Users:/minikube-host"

	            ],

	            "ContainerIDFile": "",

	            "LogConfig": {

	                "Type": "json-file",

	                "Config": {}

	            },

	            "NetworkMode": "mount-start-1-581000",

	            "PortBindings": {

	                "22/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "0"

	                    }

	                ],

	                "2376/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "0"

	                    }

	                ],

	                "32443/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "0"

	                    }

	                ],

	                "5000/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "0"

	                    }

	                ],

	                "8443/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "0"

	                    }

	                ]

	            },

	            "RestartPolicy": {

	                "Name": "no",

	                "MaximumRetryCount": 0

	            },

	            "AutoRemove": false,

	            "VolumeDriver": "",

	            "VolumesFrom": null,

	            "ConsoleSize": [

	                0,

	                0

	            ],

	            "CapAdd": null,

	            "CapDrop": null,

	            "CgroupnsMode": "private",

	            "Dns": [],

	            "DnsOptions": [],

	            "DnsSearch": [],

	            "ExtraHosts": null,

	            "GroupAdd": null,

	            "IpcMode": "private",

	            "Cgroup": "",

	            "Links": null,

	            "OomScoreAdj": 0,

	            "PidMode": "",

	            "Privileged": true,

	            "PublishAllPorts": false,

	            "ReadonlyRootfs": false,

	            "SecurityOpt": [

	                "seccomp=unconfined",

	                "apparmor=unconfined",

	                "label=disable"

	            ],

	            "Tmpfs": {

	                "/run": "",

	                "/tmp": ""

	            },

	            "UTSMode": "",

	            "UsernsMode": "",

	            "ShmSize": 67108864,

	            "Runtime": "runc",

	            "Isolation": "",

	            "CpuShares": 0,

	            "Memory": 2147483648,

	            "NanoCpus": 2000000000,

	            "CgroupParent": "",

	            "BlkioWeight": 0,

	            "BlkioWeightDevice": [],

	            "BlkioDeviceReadBps": [],

	            "BlkioDeviceWriteBps": [],

	            "BlkioDeviceReadIOps": [],

	            "BlkioDeviceWriteIOps": [],

	            "CpuPeriod": 0,

	            "CpuQuota": 0,

	            "CpuRealtimePeriod": 0,

	            "CpuRealtimeRuntime": 0,

	            "CpusetCpus": "",

	            "CpusetMems": "",

	            "Devices": [],

	            "DeviceCgroupRules": null,

	            "DeviceRequests": null,

	            "MemoryReservation": 0,

	            "MemorySwap": 2147483648,

	            "MemorySwappiness": null,

	            "OomKillDisable": null,

	            "PidsLimit": null,

	            "Ulimits": null,

	            "CpuCount": 0,

	            "CpuPercent": 0,

	            "IOMaximumIOps": 0,

	            "IOMaximumBandwidth": 0,

	            "MaskedPaths": null,

	            "ReadonlyPaths": null

	        },

	        "GraphDriver": {

	            "Data": {

	                "LowerDir": "/var/lib/docker/overlay2/e2a468fd88a9e6a2ff0de445cf006f96d787d0a6d79a843827ca16a0a40a8e84-init/diff:/var/lib/docker/overlay2/9504b64c51e562d355bf6588d6f3a8de52c401736ff8b5d6bc5c642b8ed6a207/diff",

	                "MergedDir": "/var/lib/docker/overlay2/e2a468fd88a9e6a2ff0de445cf006f96d787d0a6d79a843827ca16a0a40a8e84/merged",

	                "UpperDir": "/var/lib/docker/overlay2/e2a468fd88a9e6a2ff0de445cf006f96d787d0a6d79a843827ca16a0a40a8e84/diff",

	                "WorkDir": "/var/lib/docker/overlay2/e2a468fd88a9e6a2ff0de445cf006f96d787d0a6d79a843827ca16a0a40a8e84/work"

	            },

	            "Name": "overlay2"

	        },

	        "Mounts": [

	            {

	                "Type": "bind",

	                "Source": "/lib/modules",

	                "Destination": "/lib/modules",

	                "Mode": "ro",

	                "RW": false,

	                "Propagation": "rprivate"

	            },

	            {

	                "Type": "volume",

	                "Name": "mount-start-1-581000",

	                "Source": "/var/lib/docker/volumes/mount-start-1-581000/_data",

	                "Destination": "/var",

	                "Driver": "local",

	                "Mode": "z",

	                "RW": true,

	                "Propagation": ""

	            },

	            {

	                "Type": "bind",

	                "Source": "/host_mnt/Users",

	                "Destination": "/minikube-host",

	                "Mode": "",

	                "RW": true,

	                "Propagation": "rprivate"

	            }

	        ],

	        "Config": {

	            "Hostname": "mount-start-1-581000",

	            "Domainname": "",

	            "User": "",

	            "AttachStdin": false,

	            "AttachStdout": false,

	            "AttachStderr": false,

	            "ExposedPorts": {

	                "22/tcp": {},

	                "2376/tcp": {},

	                "32443/tcp": {},

	                "5000/tcp": {},

	                "8443/tcp": {}

	            },

	            "Tty": true,

	            "OpenStdin": false,

	            "StdinOnce": false,

	            "Env": [

	                "container=docker",

	                "PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"

	            ],

	            "Cmd": null,

	            "Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1703498848-17857@sha256:81ae12a49915e4f02aa382dd3758a30a6649e1143c32b3d03309750104577c6c",

	            "Volumes": null,

	            "WorkingDir": "/",

	            "Entrypoint": [

	                "/usr/local/bin/entrypoint",

	                "/sbin/init"

	            ],

	            "OnBuild": null,

	            "Labels": {

	                "created_by.minikube.sigs.k8s.io": "true",

	                "mode.minikube.sigs.k8s.io": "mount-start-1-581000",

	                "name.minikube.sigs.k8s.io": "mount-start-1-581000",

	                "role.minikube.sigs.k8s.io": ""

	            },

	            "StopSignal": "SIGRTMIN+3"

	        },

	        "NetworkSettings": {

	            "Bridge": "",

	            "SandboxID": "c479fb01feca12ef1c24a35417deb3aa08b325c40e40f99a8d16ac47bd5569a3",

	            "HairpinMode": false,

	            "LinkLocalIPv6Address": "",

	            "LinkLocalIPv6PrefixLen": 0,

	            "Ports": {

	                "22/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "50771"

	                    }

	                ],

	                "2376/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "50772"

	                    }

	                ],

	                "32443/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "50773"

	                    }

	                ],

	                "5000/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "50769"

	                    }

	                ],

	                "8443/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "50770"

	                    }

	                ]

	            },

	            "SandboxKey": "/var/run/docker/netns/c479fb01feca",

	            "SecondaryIPAddresses": null,

	            "SecondaryIPv6Addresses": null,

	            "EndpointID": "",

	            "Gateway": "",

	            "GlobalIPv6Address": "",

	            "GlobalIPv6PrefixLen": 0,

	            "IPAddress": "",

	            "IPPrefixLen": 0,

	            "IPv6Gateway": "",

	            "MacAddress": "",

	            "Networks": {

	                "mount-start-1-581000": {

	                    "IPAMConfig": {

	                        "IPv4Address": "192.168.58.2"

	                    },

	                    "Links": null,

	                    "Aliases": [

	                        "a25c0fcf2dc7",

	                        "mount-start-1-581000"

	                    ],

	                    "MacAddress": "02:42:c0:a8:3a:02",

	                    "NetworkID": "6685105f2d41537144a7363d303854eebc3ed5c6fc2b7721772dbf568efa2a42",

	                    "EndpointID": "16db72f9ee27db816a32b69543a3240323130e2ab0785c7e399701048227e05f",

	                    "Gateway": "192.168.58.1",

	                    "IPAddress": "192.168.58.2",

	                    "IPPrefixLen": 24,

	                    "IPv6Gateway": "",

	                    "GlobalIPv6Address": "",

	                    "GlobalIPv6PrefixLen": 0,

	                    "DriverOpts": null

	                }

	            }

	        }

	    }

	]

-- /stdout --

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p mount-start-1-581000 -n mount-start-1-581000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p mount-start-1-581000 -n mount-start-1-581000: exit status 6 (370.883187ms)

-- stdout --

	Running

	WARNING: Your kubectl is pointing to stale minikube-vm.

	To fix the kubectl context, run `minikube update-context`

-- /stdout --

** stderr ** 

	E1226 14:23:28.331061    6745 status.go:415] kubeconfig endpoint: extract IP: "mount-start-1-581000" does not appear in /Users/jenkins/minikube-integration/17857-1142/kubeconfig

** /stderr **

helpers_test.go:239: status error: exit status 6 (may be ok)

helpers_test.go:241: "mount-start-1-581000" host is not running, skipping log retrieval (state="Running\nWARNING: Your kubectl is pointing to stale minikube-vm.\nTo fix the kubectl context, run `minikube update-context`")

--- FAIL: TestMountStart/serial/VerifyMountFirst (893.17s)

=== RUN   TestMultiNode/serial/FreshStart2Nodes

multinode_test.go:86: (dbg) Run:  out/minikube-darwin-amd64 start -p multinode-053000 --wait=true --memory=2200 --nodes=2 -v=8 --alsologtostderr --driver=docker 

E1226 14:26:49.268319    1612 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/17857-1142/.minikube/profiles/addons-914000/client.crt: no such file or directory

E1226 14:28:46.213768    1612 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/17857-1142/.minikube/profiles/addons-914000/client.crt: no such file or directory

E1226 14:29:36.186164    1612 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/17857-1142/.minikube/profiles/functional-155000/client.crt: no such file or directory

E1226 14:32:39.303819    1612 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/17857-1142/.minikube/profiles/functional-155000/client.crt: no such file or directory

E1226 14:33:46.275432    1612 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/17857-1142/.minikube/profiles/addons-914000/client.crt: no such file or directory

E1226 14:34:36.247777    1612 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/17857-1142/.minikube/profiles/functional-155000/client.crt: no such file or directory

multinode_test.go:86: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p multinode-053000 --wait=true --memory=2200 --nodes=2 -v=8 --alsologtostderr --driver=docker : exit status 52 (12m35.82475287s)

-- stdout --

	* [multinode-053000] minikube v1.32.0 on Darwin 14.2.1

	  - MINIKUBE_LOCATION=17857

	  - KUBECONFIG=/Users/jenkins/minikube-integration/17857-1142/kubeconfig

	  - MINIKUBE_BIN=out/minikube-darwin-amd64

	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17857-1142/.minikube

	  - MINIKUBE_FORCE_SYSTEMD=

	* Using the docker driver based on user configuration

	* Using Docker Desktop driver with root privileges

	* Starting control plane node multinode-053000 in cluster multinode-053000

	* Pulling base image v0.0.42-1703498848-17857 ...

	* Creating docker container (CPUs=2, Memory=2200MB) ...

	* docker "multinode-053000" container is missing, will recreate.

	* Creating docker container (CPUs=2, Memory=2200MB) ...

-- /stdout --

** stderr ** 

	I1226 14:24:37.344737    6851 out.go:296] Setting OutFile to fd 1 ...

	I1226 14:24:37.345004    6851 out.go:343] TERM=,COLORTERM=, which probably does not support color

	I1226 14:24:37.345010    6851 out.go:309] Setting ErrFile to fd 2...

	I1226 14:24:37.345015    6851 out.go:343] TERM=,COLORTERM=, which probably does not support color

	I1226 14:24:37.345201    6851 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17857-1142/.minikube/bin

	I1226 14:24:37.346626    6851 out.go:303] Setting JSON to false

	I1226 14:24:37.368968    6851 start.go:128] hostinfo: {"hostname":"MacOS-Agent-3.local","uptime":3247,"bootTime":1703626230,"procs":427,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.2.1","kernelVersion":"23.2.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"bd1c05a8-24a6-5973-aa69-f3c7c66a87ce"}

	W1226 14:24:37.369088    6851 start.go:136] gopshost.Virtualization returned error: not implemented yet

	I1226 14:24:37.391253    6851 out.go:177] * [multinode-053000] minikube v1.32.0 on Darwin 14.2.1

	I1226 14:24:37.434759    6851 out.go:177]   - MINIKUBE_LOCATION=17857

	I1226 14:24:37.434830    6851 notify.go:220] Checking for updates...

	I1226 14:24:37.456908    6851 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/17857-1142/kubeconfig

	I1226 14:24:37.477904    6851 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64

	I1226 14:24:37.499680    6851 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I1226 14:24:37.520701    6851 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17857-1142/.minikube

	I1226 14:24:37.541695    6851 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=

	I1226 14:24:37.563164    6851 driver.go:392] Setting default libvirt URI to qemu:///system

	I1226 14:24:37.618875    6851 docker.go:122] docker version: linux-24.0.7:Docker Desktop 4.26.0 (130397)

	I1226 14:24:37.619025    6851 cli_runner.go:164] Run: docker system info --format "{{json .}}"

	I1226 14:24:37.718038    6851 info.go:266] docker info: {ID:c18f23ef-4e44-410e-b2ce-38db72a58e15 Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:2 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:54 OomKillDisable:false NGoroutines:68 SystemTime:2023-12-26 22:24:37.708084453 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:8 KernelVersion:6.5.11-linuxkit OperatingSystem:Docker Desktop OSType:linux Architecture:x86_64 IndexServe

rAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:12 MemTotal:6221275136 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy:http.docker.internal:3128 HTTPSProxy:http.docker.internal:3128 NoProxy:hubproxy.docker.internal Name:docker-desktop Labels:[] ExperimentalBuild:false ServerVersion:24.0.7 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:d8f198a4ed8892c764191ef7b3b06d8a2eeb5c7f Expected:d8f198a4ed8892c764191ef7b3b06d8a2eeb5c7f} RuncCommit:{ID:v1.1.10-0-g18a0cb0 Expected:v1.1.10-0-g18a0cb0} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=seccomp,profile=unconf

ined name=cgroupns] ProductLicense: Warnings:[WARNING: daemon is not using the default seccomp profile] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/Users/jenkins/.docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-buildx] ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.12.0-desktop.2] map[Name:compose Path:/Users/jenkins/.docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-compose] ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.23.3-desktop.2] map[Name:dev Path:/Users/jenkins/.docker/cli-plugins/docker-dev SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-dev] ShortDescription:Docker Dev Environments Vendor:Docker Inc. Version:v0.1.0] map[Name:extension Path:/Users/jenkins/.docker/cli-plugins/docker-extension SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-extension] ShortDescription:Mana

ges Docker extensions Vendor:Docker Inc. Version:v0.2.21] map[Name:feedback Path:/Users/jenkins/.docker/cli-plugins/docker-feedback SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-feedback] ShortDescription:Provide feedback, right in your terminal! Vendor:Docker Inc. Version:0.1] map[Name:init Path:/Users/jenkins/.docker/cli-plugins/docker-init SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-init] ShortDescription:Creates Docker-related starter files for your project Vendor:Docker Inc. Version:v0.1.0-beta.10] map[Name:sbom Path:/Users/jenkins/.docker/cli-plugins/docker-sbom SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-sbom] ShortDescription:View the packaged-based Software Bill Of Materials (SBOM) for an image URL:https://github.com/docker/sbom-cli-plugin Vendor:Anchore Inc. Version:0.6.0] map[Name:scan Path:/Users/jenkins/.docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/d

ocker-scan] ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.26.0] map[Name:scout Path:/Users/jenkins/.docker/cli-plugins/docker-scout SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-scout] ShortDescription:Docker Scout Vendor:Docker Inc. Version:v1.2.0]] Warnings:<nil>}}

	I1226 14:24:37.739751    6851 out.go:177] * Using the docker driver based on user configuration

	I1226 14:24:37.760644    6851 start.go:298] selected driver: docker

	I1226 14:24:37.760680    6851 start.go:902] validating driver "docker" against <nil>

	I1226 14:24:37.760696    6851 start.go:913] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}

	I1226 14:24:37.765139    6851 cli_runner.go:164] Run: docker system info --format "{{json .}}"

	I1226 14:24:37.863554    6851 info.go:266] docker info: {ID:c18f23ef-4e44-410e-b2ce-38db72a58e15 Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:2 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:54 OomKillDisable:false NGoroutines:68 SystemTime:2023-12-26 22:24:37.854589535 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:8 KernelVersion:6.5.11-linuxkit OperatingSystem:Docker Desktop OSType:linux Architecture:x86_64 IndexServe

rAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:12 MemTotal:6221275136 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy:http.docker.internal:3128 HTTPSProxy:http.docker.internal:3128 NoProxy:hubproxy.docker.internal Name:docker-desktop Labels:[] ExperimentalBuild:false ServerVersion:24.0.7 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:d8f198a4ed8892c764191ef7b3b06d8a2eeb5c7f Expected:d8f198a4ed8892c764191ef7b3b06d8a2eeb5c7f} RuncCommit:{ID:v1.1.10-0-g18a0cb0 Expected:v1.1.10-0-g18a0cb0} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=seccomp,profile=unconf

ined name=cgroupns] ProductLicense: Warnings:[WARNING: daemon is not using the default seccomp profile] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/Users/jenkins/.docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-buildx] ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.12.0-desktop.2] map[Name:compose Path:/Users/jenkins/.docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-compose] ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.23.3-desktop.2] map[Name:dev Path:/Users/jenkins/.docker/cli-plugins/docker-dev SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-dev] ShortDescription:Docker Dev Environments Vendor:Docker Inc. Version:v0.1.0] map[Name:extension Path:/Users/jenkins/.docker/cli-plugins/docker-extension SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-extension] ShortDescription:Mana

ges Docker extensions Vendor:Docker Inc. Version:v0.2.21] map[Name:feedback Path:/Users/jenkins/.docker/cli-plugins/docker-feedback SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-feedback] ShortDescription:Provide feedback, right in your terminal! Vendor:Docker Inc. Version:0.1] map[Name:init Path:/Users/jenkins/.docker/cli-plugins/docker-init SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-init] ShortDescription:Creates Docker-related starter files for your project Vendor:Docker Inc. Version:v0.1.0-beta.10] map[Name:sbom Path:/Users/jenkins/.docker/cli-plugins/docker-sbom SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-sbom] ShortDescription:View the packaged-based Software Bill Of Materials (SBOM) for an image URL:https://github.com/docker/sbom-cli-plugin Vendor:Anchore Inc. Version:0.6.0] map[Name:scan Path:/Users/jenkins/.docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/d

ocker-scan] ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.26.0] map[Name:scout Path:/Users/jenkins/.docker/cli-plugins/docker-scout SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-scout] ShortDescription:Docker Scout Vendor:Docker Inc. Version:v1.2.0]] Warnings:<nil>}}

	I1226 14:24:37.863732    6851 start_flags.go:309] no existing cluster config was found, will generate one from the flags 

	I1226 14:24:37.863921    6851 start_flags.go:931] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]

	I1226 14:24:37.885079    6851 out.go:177] * Using Docker Desktop driver with root privileges

	I1226 14:24:37.906861    6851 cni.go:84] Creating CNI manager for ""

	I1226 14:24:37.906892    6851 cni.go:136] 0 nodes found, recommending kindnet

	I1226 14:24:37.906916    6851 start_flags.go:318] Found "CNI" CNI - setting NetworkPlugin=cni

	I1226 14:24:37.906942    6851 start_flags.go:323] config:

	{Name:multinode-053000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1703498848-17857@sha256:81ae12a49915e4f02aa382dd3758a30a6649e1143c32b3d03309750104577c6c Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:multinode-053000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:do

cker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:}

	I1226 14:24:37.950708    6851 out.go:177] * Starting control plane node multinode-053000 in cluster multinode-053000

	I1226 14:24:37.973931    6851 cache.go:121] Beginning downloading kic base image for docker with docker

	I1226 14:24:37.995933    6851 out.go:177] * Pulling base image v0.0.42-1703498848-17857 ...

	I1226 14:24:38.037889    6851 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker

	I1226 14:24:38.037968    6851 preload.go:148] Found local preload: /Users/jenkins/minikube-integration/17857-1142/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4

	I1226 14:24:38.037990    6851 cache.go:56] Caching tarball of preloaded images

	I1226 14:24:38.037988    6851 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1703498848-17857@sha256:81ae12a49915e4f02aa382dd3758a30a6649e1143c32b3d03309750104577c6c in local docker daemon

	I1226 14:24:38.038221    6851 preload.go:174] Found /Users/jenkins/minikube-integration/17857-1142/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4 in cache, skipping download

	I1226 14:24:38.038243    6851 cache.go:59] Finished verifying existence of preloaded tar for  v1.28.4 on docker

	I1226 14:24:38.039825    6851 profile.go:148] Saving config to /Users/jenkins/minikube-integration/17857-1142/.minikube/profiles/multinode-053000/config.json ...

	I1226 14:24:38.039927    6851 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/17857-1142/.minikube/profiles/multinode-053000/config.json: {Name:mk360dd7f83cb16adf37956fd979a7b15c41f288 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1226 14:24:38.089337    6851 image.go:83] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1703498848-17857@sha256:81ae12a49915e4f02aa382dd3758a30a6649e1143c32b3d03309750104577c6c in local docker daemon, skipping pull

	I1226 14:24:38.089357    6851 cache.go:144] gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1703498848-17857@sha256:81ae12a49915e4f02aa382dd3758a30a6649e1143c32b3d03309750104577c6c exists in daemon, skipping load

	I1226 14:24:38.089385    6851 cache.go:194] Successfully downloaded all kic artifacts

	I1226 14:24:38.089426    6851 start.go:365] acquiring machines lock for multinode-053000: {Name:mk82cdb133de64b89b280b825892397413990144 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I1226 14:24:38.089576    6851 start.go:369] acquired machines lock for "multinode-053000" in 137.162µs

	I1226 14:24:38.089602    6851 start.go:93] Provisioning new machine with config: &{Name:multinode-053000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1703498848-17857@sha256:81ae12a49915e4f02aa382dd3758a30a6649e1143c32b3d03309750104577c6c Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:multinode-053000 Namespace:default APIServerName:miniku

beCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false Disa

bleMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}

	I1226 14:24:38.089682    6851 start.go:125] createHost starting for "" (driver="docker")

	I1226 14:24:38.110831    6851 out.go:204] * Creating docker container (CPUs=2, Memory=2200MB) ...

	I1226 14:24:38.111202    6851 start.go:159] libmachine.API.Create for "multinode-053000" (driver="docker")

	I1226 14:24:38.111262    6851 client.go:168] LocalClient.Create starting

	I1226 14:24:38.111397    6851 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17857-1142/.minikube/certs/ca.pem

	I1226 14:24:38.111460    6851 main.go:141] libmachine: Decoding PEM data...

	I1226 14:24:38.111482    6851 main.go:141] libmachine: Parsing certificate...

	I1226 14:24:38.111550    6851 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17857-1142/.minikube/certs/cert.pem

	I1226 14:24:38.111599    6851 main.go:141] libmachine: Decoding PEM data...

	I1226 14:24:38.111613    6851 main.go:141] libmachine: Parsing certificate...

	I1226 14:24:38.112221    6851 cli_runner.go:164] Run: docker network inspect multinode-053000 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"

	W1226 14:24:38.163679    6851 cli_runner.go:211] docker network inspect multinode-053000 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1

	I1226 14:24:38.163764    6851 network_create.go:281] running [docker network inspect multinode-053000] to gather additional debugging logs...

	I1226 14:24:38.163783    6851 cli_runner.go:164] Run: docker network inspect multinode-053000

	W1226 14:24:38.213162    6851 cli_runner.go:211] docker network inspect multinode-053000 returned with exit code 1

	I1226 14:24:38.213185    6851 network_create.go:284] error running [docker network inspect multinode-053000]: docker network inspect multinode-053000: exit status 1

	stdout:

	[]

	stderr:

	Error response from daemon: network multinode-053000 not found

	I1226 14:24:38.213205    6851 network_create.go:286] output of [docker network inspect multinode-053000]: -- stdout --

	[]

	-- /stdout --

	** stderr ** 

	Error response from daemon: network multinode-053000 not found

	** /stderr **

	I1226 14:24:38.213337    6851 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"

	I1226 14:24:38.264411    6851 network.go:212] skipping subnet 192.168.49.0/24 that is reserved: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:<nil>}

	I1226 14:24:38.264796    6851 network.go:209] using free private subnet 192.168.58.0/24: &{IP:192.168.58.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.58.0/24 Gateway:192.168.58.1 ClientMin:192.168.58.2 ClientMax:192.168.58.254 Broadcast:192.168.58.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc00231cfd0}

	I1226 14:24:38.264813    6851 network_create.go:124] attempt to create docker network multinode-053000 192.168.58.0/24 with gateway 192.168.58.1 and MTU of 65535 ...

	I1226 14:24:38.264886    6851 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.58.0/24 --gateway=192.168.58.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=65535 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=multinode-053000 multinode-053000

	W1226 14:24:38.315185    6851 cli_runner.go:211] docker network create --driver=bridge --subnet=192.168.58.0/24 --gateway=192.168.58.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=65535 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=multinode-053000 multinode-053000 returned with exit code 1

	W1226 14:24:38.315233    6851 network_create.go:149] failed to create docker network multinode-053000 192.168.58.0/24 with gateway 192.168.58.1 and mtu of 65535: docker network create --driver=bridge --subnet=192.168.58.0/24 --gateway=192.168.58.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=65535 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=multinode-053000 multinode-053000: exit status 1

	stdout:

	stderr:

	Error response from daemon: Pool overlaps with other one on this address space

	W1226 14:24:38.315252    6851 network_create.go:116] failed to create docker network multinode-053000 192.168.58.0/24, will retry: subnet is taken

	I1226 14:24:38.316665    6851 network.go:212] skipping subnet 192.168.58.0/24 that is reserved: &{IP:192.168.58.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.58.0/24 Gateway:192.168.58.1 ClientMin:192.168.58.2 ClientMax:192.168.58.254 Broadcast:192.168.58.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:<nil>}

	I1226 14:24:38.317071    6851 network.go:209] using free private subnet 192.168.67.0/24: &{IP:192.168.67.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.67.0/24 Gateway:192.168.67.1 ClientMin:192.168.67.2 ClientMax:192.168.67.254 Broadcast:192.168.67.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc0022544e0}

	I1226 14:24:38.317083    6851 network_create.go:124] attempt to create docker network multinode-053000 192.168.67.0/24 with gateway 192.168.67.1 and MTU of 65535 ...

	I1226 14:24:38.317152    6851 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.67.0/24 --gateway=192.168.67.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=65535 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=multinode-053000 multinode-053000

	I1226 14:24:38.402238    6851 network_create.go:108] docker network multinode-053000 192.168.67.0/24 created

	I1226 14:24:38.402279    6851 kic.go:121] calculated static IP "192.168.67.2" for the "multinode-053000" container

	I1226 14:24:38.402386    6851 cli_runner.go:164] Run: docker ps -a --format {{.Names}}

	I1226 14:24:38.453079    6851 cli_runner.go:164] Run: docker volume create multinode-053000 --label name.minikube.sigs.k8s.io=multinode-053000 --label created_by.minikube.sigs.k8s.io=true

	I1226 14:24:38.504462    6851 oci.go:103] Successfully created a docker volume multinode-053000

	I1226 14:24:38.504584    6851 cli_runner.go:164] Run: docker run --rm --name multinode-053000-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=multinode-053000 --entrypoint /usr/bin/test -v multinode-053000:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1703498848-17857@sha256:81ae12a49915e4f02aa382dd3758a30a6649e1143c32b3d03309750104577c6c -d /var/lib

	I1226 14:24:38.905018    6851 oci.go:107] Successfully prepared a docker volume multinode-053000

	I1226 14:24:38.905068    6851 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker

	I1226 14:24:38.905081    6851 kic.go:194] Starting extracting preloaded images to volume ...

	I1226 14:24:38.905169    6851 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v /Users/jenkins/minikube-integration/17857-1142/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4:/preloaded.tar:ro -v multinode-053000:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1703498848-17857@sha256:81ae12a49915e4f02aa382dd3758a30a6649e1143c32b3d03309750104577c6c -I lz4 -xf /preloaded.tar -C /extractDir

	I1226 14:30:38.108796    6851 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I1226 14:30:38.108928    6851 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-053000

	W1226 14:30:38.163870    6851 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-053000 returned with exit code 1

	I1226 14:30:38.163991    6851 retry.go:31] will retry after 283.512865ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "multinode-053000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-053000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-053000

	I1226 14:30:38.448992    6851 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-053000

	W1226 14:30:38.502402    6851 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-053000 returned with exit code 1

	I1226 14:30:38.502496    6851 retry.go:31] will retry after 346.168101ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "multinode-053000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-053000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-053000

	I1226 14:30:38.849223    6851 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-053000

	W1226 14:30:38.901582    6851 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-053000 returned with exit code 1

	I1226 14:30:38.901695    6851 retry.go:31] will retry after 658.244839ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "multinode-053000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-053000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-053000

	I1226 14:30:39.561325    6851 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-053000

	W1226 14:30:39.614944    6851 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-053000 returned with exit code 1

	I1226 14:30:39.615061    6851 retry.go:31] will retry after 462.478325ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "multinode-053000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-053000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-053000

	I1226 14:30:40.079807    6851 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-053000

	W1226 14:30:40.130176    6851 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-053000 returned with exit code 1

	W1226 14:30:40.130286    6851 start.go:275] error running df -h /var: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "multinode-053000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-053000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-053000

	W1226 14:30:40.130305    6851 start.go:242] error getting percentage of /var that is free: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "multinode-053000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-053000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-053000

	I1226 14:30:40.130363    6851 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"

	I1226 14:30:40.130438    6851 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-053000

	W1226 14:30:40.179752    6851 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-053000 returned with exit code 1

	I1226 14:30:40.179845    6851 retry.go:31] will retry after 371.792327ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "multinode-053000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-053000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-053000

	I1226 14:30:40.552198    6851 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-053000

	W1226 14:30:40.605003    6851 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-053000 returned with exit code 1

	I1226 14:30:40.605091    6851 retry.go:31] will retry after 284.334924ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "multinode-053000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-053000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-053000

	I1226 14:30:40.891649    6851 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-053000

	W1226 14:30:40.942928    6851 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-053000 returned with exit code 1

	I1226 14:30:40.943022    6851 retry.go:31] will retry after 474.389793ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "multinode-053000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-053000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-053000

	I1226 14:30:41.419764    6851 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-053000

	W1226 14:30:41.470635    6851 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-053000 returned with exit code 1

	I1226 14:30:41.470728    6851 retry.go:31] will retry after 467.708725ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "multinode-053000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-053000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-053000

	I1226 14:30:41.939388    6851 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-053000

	W1226 14:30:41.994210    6851 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-053000 returned with exit code 1

	W1226 14:30:41.994304    6851 start.go:290] error running df -BG /var: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "multinode-053000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-053000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-053000

	W1226 14:30:41.994324    6851 start.go:247] error getting GiB of /var that is available: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "multinode-053000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-053000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-053000

	I1226 14:30:41.994338    6851 start.go:128] duration metric: createHost completed in 6m3.908954655s

	I1226 14:30:41.994345    6851 start.go:83] releasing machines lock for "multinode-053000", held for 6m3.909075518s

	W1226 14:30:41.994358    6851 start.go:694] error starting host: creating host: create host timed out in 360.000000 seconds

	I1226 14:30:41.994775    6851 cli_runner.go:164] Run: docker container inspect multinode-053000 --format={{.State.Status}}

	W1226 14:30:42.045759    6851 cli_runner.go:211] docker container inspect multinode-053000 --format={{.State.Status}} returned with exit code 1

	I1226 14:30:42.045814    6851 delete.go:82] Unable to get host status for multinode-053000, assuming it has already been deleted: state: unknown state "multinode-053000": docker container inspect multinode-053000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-053000

	W1226 14:30:42.045890    6851 out.go:239] ! StartHost failed, but will try again: creating host: create host timed out in 360.000000 seconds

	! StartHost failed, but will try again: creating host: create host timed out in 360.000000 seconds

	I1226 14:30:42.045903    6851 start.go:709] Will try again in 5 seconds ...

	I1226 14:30:47.046865    6851 start.go:365] acquiring machines lock for multinode-053000: {Name:mk82cdb133de64b89b280b825892397413990144 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I1226 14:30:47.047106    6851 start.go:369] acquired machines lock for "multinode-053000" in 144.081µs

	I1226 14:30:47.047138    6851 start.go:96] Skipping create...Using existing machine configuration

	I1226 14:30:47.047152    6851 fix.go:54] fixHost starting: 

	I1226 14:30:47.047627    6851 cli_runner.go:164] Run: docker container inspect multinode-053000 --format={{.State.Status}}

	W1226 14:30:47.099973    6851 cli_runner.go:211] docker container inspect multinode-053000 --format={{.State.Status}} returned with exit code 1

	I1226 14:30:47.100029    6851 fix.go:102] recreateIfNeeded on multinode-053000: state= err=unknown state "multinode-053000": docker container inspect multinode-053000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-053000

	I1226 14:30:47.100052    6851 fix.go:107] machineExists: false. err=machine does not exist

	I1226 14:30:47.120686    6851 out.go:177] * docker "multinode-053000" container is missing, will recreate.

	I1226 14:30:47.164306    6851 delete.go:124] DEMOLISHING multinode-053000 ...

	I1226 14:30:47.164497    6851 cli_runner.go:164] Run: docker container inspect multinode-053000 --format={{.State.Status}}

	W1226 14:30:47.215718    6851 cli_runner.go:211] docker container inspect multinode-053000 --format={{.State.Status}} returned with exit code 1

	W1226 14:30:47.215763    6851 stop.go:75] unable to get state: unknown state "multinode-053000": docker container inspect multinode-053000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-053000

	I1226 14:30:47.215781    6851 delete.go:128] stophost failed (probably ok): ssh power off: unknown state "multinode-053000": docker container inspect multinode-053000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-053000

	I1226 14:30:47.216164    6851 cli_runner.go:164] Run: docker container inspect multinode-053000 --format={{.State.Status}}

	W1226 14:30:47.265919    6851 cli_runner.go:211] docker container inspect multinode-053000 --format={{.State.Status}} returned with exit code 1

	I1226 14:30:47.265989    6851 delete.go:82] Unable to get host status for multinode-053000, assuming it has already been deleted: state: unknown state "multinode-053000": docker container inspect multinode-053000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-053000

	I1226 14:30:47.266098    6851 cli_runner.go:164] Run: docker container inspect -f {{.Id}} multinode-053000

	W1226 14:30:47.315508    6851 cli_runner.go:211] docker container inspect -f {{.Id}} multinode-053000 returned with exit code 1

	I1226 14:30:47.315536    6851 kic.go:371] could not find the container multinode-053000 to remove it. will try anyways

	I1226 14:30:47.315608    6851 cli_runner.go:164] Run: docker container inspect multinode-053000 --format={{.State.Status}}

	W1226 14:30:47.368481    6851 cli_runner.go:211] docker container inspect multinode-053000 --format={{.State.Status}} returned with exit code 1

	W1226 14:30:47.368522    6851 oci.go:84] error getting container status, will try to delete anyways: unknown state "multinode-053000": docker container inspect multinode-053000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-053000

	I1226 14:30:47.368613    6851 cli_runner.go:164] Run: docker exec --privileged -t multinode-053000 /bin/bash -c "sudo init 0"

	W1226 14:30:47.418992    6851 cli_runner.go:211] docker exec --privileged -t multinode-053000 /bin/bash -c "sudo init 0" returned with exit code 1

	I1226 14:30:47.419035    6851 oci.go:650] error shutdown multinode-053000: docker exec --privileged -t multinode-053000 /bin/bash -c "sudo init 0": exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-053000

	I1226 14:30:48.419197    6851 cli_runner.go:164] Run: docker container inspect multinode-053000 --format={{.State.Status}}

	W1226 14:30:48.469064    6851 cli_runner.go:211] docker container inspect multinode-053000 --format={{.State.Status}} returned with exit code 1

	I1226 14:30:48.469118    6851 oci.go:662] temporary error verifying shutdown: unknown state "multinode-053000": docker container inspect multinode-053000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-053000

	I1226 14:30:48.469130    6851 oci.go:664] temporary error: container multinode-053000 status is  but expect it to be exited

	I1226 14:30:48.469154    6851 retry.go:31] will retry after 369.016809ms: couldn't verify container is exited. %v: unknown state "multinode-053000": docker container inspect multinode-053000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-053000

	I1226 14:30:48.838604    6851 cli_runner.go:164] Run: docker container inspect multinode-053000 --format={{.State.Status}}

	W1226 14:30:48.890919    6851 cli_runner.go:211] docker container inspect multinode-053000 --format={{.State.Status}} returned with exit code 1

	I1226 14:30:48.890971    6851 oci.go:662] temporary error verifying shutdown: unknown state "multinode-053000": docker container inspect multinode-053000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-053000

	I1226 14:30:48.890982    6851 oci.go:664] temporary error: container multinode-053000 status is  but expect it to be exited

	I1226 14:30:48.891006    6851 retry.go:31] will retry after 806.010338ms: couldn't verify container is exited. %v: unknown state "multinode-053000": docker container inspect multinode-053000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-053000

	I1226 14:30:49.697440    6851 cli_runner.go:164] Run: docker container inspect multinode-053000 --format={{.State.Status}}

	W1226 14:30:49.751134    6851 cli_runner.go:211] docker container inspect multinode-053000 --format={{.State.Status}} returned with exit code 1

	I1226 14:30:49.751184    6851 oci.go:662] temporary error verifying shutdown: unknown state "multinode-053000": docker container inspect multinode-053000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-053000

	I1226 14:30:49.751195    6851 oci.go:664] temporary error: container multinode-053000 status is  but expect it to be exited

	I1226 14:30:49.751218    6851 retry.go:31] will retry after 604.216729ms: couldn't verify container is exited. %v: unknown state "multinode-053000": docker container inspect multinode-053000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-053000

	I1226 14:30:50.356230    6851 cli_runner.go:164] Run: docker container inspect multinode-053000 --format={{.State.Status}}

	W1226 14:30:50.408837    6851 cli_runner.go:211] docker container inspect multinode-053000 --format={{.State.Status}} returned with exit code 1

	I1226 14:30:50.408883    6851 oci.go:662] temporary error verifying shutdown: unknown state "multinode-053000": docker container inspect multinode-053000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-053000

	I1226 14:30:50.408898    6851 oci.go:664] temporary error: container multinode-053000 status is  but expect it to be exited

	I1226 14:30:50.408923    6851 retry.go:31] will retry after 2.137352203s: couldn't verify container is exited. %v: unknown state "multinode-053000": docker container inspect multinode-053000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-053000

	I1226 14:30:52.547224    6851 cli_runner.go:164] Run: docker container inspect multinode-053000 --format={{.State.Status}}

	W1226 14:30:52.600335    6851 cli_runner.go:211] docker container inspect multinode-053000 --format={{.State.Status}} returned with exit code 1

	I1226 14:30:52.600384    6851 oci.go:662] temporary error verifying shutdown: unknown state "multinode-053000": docker container inspect multinode-053000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-053000

	I1226 14:30:52.600393    6851 oci.go:664] temporary error: container multinode-053000 status is  but expect it to be exited

	I1226 14:30:52.600417    6851 retry.go:31] will retry after 2.691835581s: couldn't verify container is exited. %v: unknown state "multinode-053000": docker container inspect multinode-053000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-053000

	I1226 14:30:55.292518    6851 cli_runner.go:164] Run: docker container inspect multinode-053000 --format={{.State.Status}}

	W1226 14:30:55.346376    6851 cli_runner.go:211] docker container inspect multinode-053000 --format={{.State.Status}} returned with exit code 1

	I1226 14:30:55.346419    6851 oci.go:662] temporary error verifying shutdown: unknown state "multinode-053000": docker container inspect multinode-053000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-053000

	I1226 14:30:55.346428    6851 oci.go:664] temporary error: container multinode-053000 status is  but expect it to be exited

	I1226 14:30:55.346454    6851 retry.go:31] will retry after 2.876664458s: couldn't verify container is exited. %v: unknown state "multinode-053000": docker container inspect multinode-053000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-053000

	I1226 14:30:58.225432    6851 cli_runner.go:164] Run: docker container inspect multinode-053000 --format={{.State.Status}}

	W1226 14:30:58.281834    6851 cli_runner.go:211] docker container inspect multinode-053000 --format={{.State.Status}} returned with exit code 1

	I1226 14:30:58.281881    6851 oci.go:662] temporary error verifying shutdown: unknown state "multinode-053000": docker container inspect multinode-053000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-053000

	I1226 14:30:58.281895    6851 oci.go:664] temporary error: container multinode-053000 status is  but expect it to be exited

	I1226 14:30:58.281918    6851 retry.go:31] will retry after 7.337959991s: couldn't verify container is exited. %v: unknown state "multinode-053000": docker container inspect multinode-053000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-053000

	I1226 14:31:05.622142    6851 cli_runner.go:164] Run: docker container inspect multinode-053000 --format={{.State.Status}}

	W1226 14:31:05.677068    6851 cli_runner.go:211] docker container inspect multinode-053000 --format={{.State.Status}} returned with exit code 1

	I1226 14:31:05.677113    6851 oci.go:662] temporary error verifying shutdown: unknown state "multinode-053000": docker container inspect multinode-053000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-053000

	I1226 14:31:05.677130    6851 oci.go:664] temporary error: container multinode-053000 status is  but expect it to be exited

	I1226 14:31:05.677160    6851 oci.go:88] couldn't shut down multinode-053000 (might be okay): verify shutdown: couldn't verify container is exited. %v: unknown state "multinode-053000": docker container inspect multinode-053000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-053000

	I1226 14:31:05.677236    6851 cli_runner.go:164] Run: docker rm -f -v multinode-053000

	I1226 14:31:05.727411    6851 cli_runner.go:164] Run: docker container inspect -f {{.Id}} multinode-053000

	W1226 14:31:05.777275    6851 cli_runner.go:211] docker container inspect -f {{.Id}} multinode-053000 returned with exit code 1

	I1226 14:31:05.777383    6851 cli_runner.go:164] Run: docker network inspect multinode-053000 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"

	I1226 14:31:05.827496    6851 cli_runner.go:164] Run: docker network rm multinode-053000

	I1226 14:31:05.931371    6851 fix.go:114] Sleeping 1 second for extra luck!

	I1226 14:31:06.932046    6851 start.go:125] createHost starting for "" (driver="docker")

	I1226 14:31:06.954140    6851 out.go:204] * Creating docker container (CPUs=2, Memory=2200MB) ...

	I1226 14:31:06.954323    6851 start.go:159] libmachine.API.Create for "multinode-053000" (driver="docker")

	I1226 14:31:06.954363    6851 client.go:168] LocalClient.Create starting

	I1226 14:31:06.954566    6851 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17857-1142/.minikube/certs/ca.pem

	I1226 14:31:06.954657    6851 main.go:141] libmachine: Decoding PEM data...

	I1226 14:31:06.954686    6851 main.go:141] libmachine: Parsing certificate...

	I1226 14:31:06.954762    6851 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17857-1142/.minikube/certs/cert.pem

	I1226 14:31:06.954832    6851 main.go:141] libmachine: Decoding PEM data...

	I1226 14:31:06.954848    6851 main.go:141] libmachine: Parsing certificate...

	I1226 14:31:06.955544    6851 cli_runner.go:164] Run: docker network inspect multinode-053000 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"

	W1226 14:31:07.008640    6851 cli_runner.go:211] docker network inspect multinode-053000 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1

	I1226 14:31:07.008725    6851 network_create.go:281] running [docker network inspect multinode-053000] to gather additional debugging logs...

	I1226 14:31:07.008745    6851 cli_runner.go:164] Run: docker network inspect multinode-053000

	W1226 14:31:07.058047    6851 cli_runner.go:211] docker network inspect multinode-053000 returned with exit code 1

	I1226 14:31:07.058079    6851 network_create.go:284] error running [docker network inspect multinode-053000]: docker network inspect multinode-053000: exit status 1

	stdout:

	[]

	stderr:

	Error response from daemon: network multinode-053000 not found

	I1226 14:31:07.058092    6851 network_create.go:286] output of [docker network inspect multinode-053000]: -- stdout --

	[]

	-- /stdout --

	** stderr ** 

	Error response from daemon: network multinode-053000 not found

	** /stderr **

	I1226 14:31:07.058239    6851 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"

	I1226 14:31:07.109865    6851 network.go:212] skipping subnet 192.168.49.0/24 that is reserved: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:<nil>}

	I1226 14:31:07.111446    6851 network.go:212] skipping subnet 192.168.58.0/24 that is reserved: &{IP:192.168.58.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.58.0/24 Gateway:192.168.58.1 ClientMin:192.168.58.2 ClientMax:192.168.58.254 Broadcast:192.168.58.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:<nil>}

	I1226 14:31:07.112858    6851 network.go:212] skipping subnet 192.168.67.0/24 that is reserved: &{IP:192.168.67.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.67.0/24 Gateway:192.168.67.1 ClientMin:192.168.67.2 ClientMax:192.168.67.254 Broadcast:192.168.67.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:<nil>}

	I1226 14:31:07.113307    6851 network.go:209] using free private subnet 192.168.76.0/24: &{IP:192.168.76.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.76.0/24 Gateway:192.168.76.1 ClientMin:192.168.76.2 ClientMax:192.168.76.254 Broadcast:192.168.76.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc0004f6d70}

	I1226 14:31:07.113319    6851 network_create.go:124] attempt to create docker network multinode-053000 192.168.76.0/24 with gateway 192.168.76.1 and MTU of 65535 ...

	I1226 14:31:07.113386    6851 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.76.0/24 --gateway=192.168.76.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=65535 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=multinode-053000 multinode-053000

	I1226 14:31:07.199032    6851 network_create.go:108] docker network multinode-053000 192.168.76.0/24 created

	I1226 14:31:07.199070    6851 kic.go:121] calculated static IP "192.168.76.2" for the "multinode-053000" container

	I1226 14:31:07.199175    6851 cli_runner.go:164] Run: docker ps -a --format {{.Names}}

	I1226 14:31:07.252106    6851 cli_runner.go:164] Run: docker volume create multinode-053000 --label name.minikube.sigs.k8s.io=multinode-053000 --label created_by.minikube.sigs.k8s.io=true

	I1226 14:31:07.301778    6851 oci.go:103] Successfully created a docker volume multinode-053000

	I1226 14:31:07.301923    6851 cli_runner.go:164] Run: docker run --rm --name multinode-053000-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=multinode-053000 --entrypoint /usr/bin/test -v multinode-053000:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1703498848-17857@sha256:81ae12a49915e4f02aa382dd3758a30a6649e1143c32b3d03309750104577c6c -d /var/lib

	I1226 14:31:07.627728    6851 oci.go:107] Successfully prepared a docker volume multinode-053000

	I1226 14:31:07.627755    6851 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker

	I1226 14:31:07.627783    6851 kic.go:194] Starting extracting preloaded images to volume ...

	I1226 14:31:07.627897    6851 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v /Users/jenkins/minikube-integration/17857-1142/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4:/preloaded.tar:ro -v multinode-053000:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1703498848-17857@sha256:81ae12a49915e4f02aa382dd3758a30a6649e1143c32b3d03309750104577c6c -I lz4 -xf /preloaded.tar -C /extractDir

	I1226 14:37:07.018091    6851 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I1226 14:37:07.018217    6851 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-053000

	W1226 14:37:07.071151    6851 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-053000 returned with exit code 1

	I1226 14:37:07.071268    6851 retry.go:31] will retry after 290.103713ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "multinode-053000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-053000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-053000

	I1226 14:37:07.361914    6851 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-053000

	W1226 14:37:07.432755    6851 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-053000 returned with exit code 1

	I1226 14:37:07.432847    6851 retry.go:31] will retry after 281.134592ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "multinode-053000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-053000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-053000

	I1226 14:37:07.714937    6851 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-053000

	W1226 14:37:07.766855    6851 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-053000 returned with exit code 1

	I1226 14:37:07.766950    6851 retry.go:31] will retry after 313.070469ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "multinode-053000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-053000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-053000

	I1226 14:37:08.080775    6851 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-053000

	W1226 14:37:08.133905    6851 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-053000 returned with exit code 1

	W1226 14:37:08.134010    6851 start.go:275] error running df -h /var: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "multinode-053000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-053000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-053000

	W1226 14:37:08.134029    6851 start.go:242] error getting percentage of /var that is free: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "multinode-053000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-053000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-053000

	I1226 14:37:08.134082    6851 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"

	I1226 14:37:08.134132    6851 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-053000

	W1226 14:37:08.183576    6851 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-053000 returned with exit code 1

	I1226 14:37:08.183681    6851 retry.go:31] will retry after 342.525377ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "multinode-053000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-053000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-053000

	I1226 14:37:08.527894    6851 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-053000

	W1226 14:37:08.580714    6851 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-053000 returned with exit code 1

	I1226 14:37:08.580834    6851 retry.go:31] will retry after 258.66176ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "multinode-053000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-053000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-053000

	I1226 14:37:08.840661    6851 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-053000

	W1226 14:37:08.894218    6851 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-053000 returned with exit code 1

	I1226 14:37:08.894320    6851 retry.go:31] will retry after 318.405765ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "multinode-053000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-053000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-053000

	I1226 14:37:09.213361    6851 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-053000

	W1226 14:37:09.266069    6851 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-053000 returned with exit code 1

	I1226 14:37:09.266164    6851 retry.go:31] will retry after 737.745975ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "multinode-053000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-053000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-053000

	I1226 14:37:10.006299    6851 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-053000

	W1226 14:37:10.060502    6851 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-053000 returned with exit code 1

	W1226 14:37:10.060619    6851 start.go:290] error running df -BG /var: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "multinode-053000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-053000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-053000

	W1226 14:37:10.060639    6851 start.go:247] error getting GiB of /var that is available: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "multinode-053000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-053000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-053000

	I1226 14:37:10.060648    6851 start.go:128] duration metric: createHost completed in 6m3.066101176s

	I1226 14:37:10.060715    6851 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I1226 14:37:10.060772    6851 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-053000

	W1226 14:37:10.109890    6851 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-053000 returned with exit code 1

	I1226 14:37:10.109984    6851 retry.go:31] will retry after 288.664585ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "multinode-053000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-053000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-053000

	I1226 14:37:10.400674    6851 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-053000

	W1226 14:37:10.454036    6851 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-053000 returned with exit code 1

	I1226 14:37:10.454126    6851 retry.go:31] will retry after 485.104899ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "multinode-053000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-053000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-053000

	I1226 14:37:10.941322    6851 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-053000

	W1226 14:37:10.995072    6851 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-053000 returned with exit code 1

	I1226 14:37:10.995175    6851 retry.go:31] will retry after 527.276049ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "multinode-053000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-053000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-053000

	I1226 14:37:11.524127    6851 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-053000

	W1226 14:37:11.574742    6851 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-053000 returned with exit code 1

	W1226 14:37:11.574855    6851 start.go:275] error running df -h /var: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "multinode-053000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-053000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-053000

	W1226 14:37:11.574875    6851 start.go:242] error getting percentage of /var that is free: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "multinode-053000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-053000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-053000

	I1226 14:37:11.574933    6851 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"

	I1226 14:37:11.574986    6851 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-053000

	W1226 14:37:11.623933    6851 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-053000 returned with exit code 1

	I1226 14:37:11.624030    6851 retry.go:31] will retry after 200.25431ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "multinode-053000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-053000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-053000

	I1226 14:37:11.826645    6851 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-053000

	W1226 14:37:11.879493    6851 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-053000 returned with exit code 1

	I1226 14:37:11.879585    6851 retry.go:31] will retry after 308.299488ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "multinode-053000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-053000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-053000

	I1226 14:37:12.188614    6851 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-053000

	W1226 14:37:12.242900    6851 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-053000 returned with exit code 1

	I1226 14:37:12.242992    6851 retry.go:31] will retry after 702.167941ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "multinode-053000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-053000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-053000

	I1226 14:37:12.945915    6851 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-053000

	W1226 14:37:12.997368    6851 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-053000 returned with exit code 1

	W1226 14:37:12.997465    6851 start.go:290] error running df -BG /var: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "multinode-053000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-053000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-053000

	W1226 14:37:12.997489    6851 start.go:247] error getting GiB of /var that is available: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "multinode-053000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-053000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-053000

	I1226 14:37:12.997500    6851 fix.go:56] fixHost completed within 6m25.88812291s

	I1226 14:37:12.997506    6851 start.go:83] releasing machines lock for "multinode-053000", held for 6m25.888160437s

	W1226 14:37:12.997588    6851 out.go:239] * Failed to start docker container. Running "minikube delete -p multinode-053000" may fix it: recreate: creating host: create host timed out in 360.000000 seconds

	* Failed to start docker container. Running "minikube delete -p multinode-053000" may fix it: recreate: creating host: create host timed out in 360.000000 seconds

	I1226 14:37:13.040849    6851 out.go:177] 

	W1226 14:37:13.063050    6851 out.go:239] X Exiting due to DRV_CREATE_TIMEOUT: Failed to start host: recreate: creating host: create host timed out in 360.000000 seconds

	X Exiting due to DRV_CREATE_TIMEOUT: Failed to start host: recreate: creating host: create host timed out in 360.000000 seconds

	W1226 14:37:13.063098    6851 out.go:239] * Suggestion: Try 'minikube delete', and disable any conflicting VPN or firewall software

	* Suggestion: Try 'minikube delete', and disable any conflicting VPN or firewall software

	W1226 14:37:13.063233    6851 out.go:239] * Related issue: https://github.com/kubernetes/minikube/issues/7072

	* Related issue: https://github.com/kubernetes/minikube/issues/7072

	I1226 14:37:13.106747    6851 out.go:177] 

** /stderr **

multinode_test.go:88: failed to start cluster. args "out/minikube-darwin-amd64 start -p multinode-053000 --wait=true --memory=2200 --nodes=2 -v=8 --alsologtostderr --driver=docker " : exit status 52

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:230: ======>  post-mortem[TestMultiNode/serial/FreshStart2Nodes]: docker inspect <======

helpers_test.go:231: (dbg) Run:  docker inspect multinode-053000

helpers_test.go:235: (dbg) docker inspect multinode-053000:

-- stdout --

	[

	    {

	        "Name": "multinode-053000",

	        "Id": "a45a12338cbdceb3c6b1f43dfcc67b01617418d44142b6dff7b2e4f52844ece0",

	        "Created": "2023-12-26T22:31:07.160542463Z",

	        "Scope": "local",

	        "Driver": "bridge",

	        "EnableIPv6": false,

	        "IPAM": {

	            "Driver": "default",

	            "Options": {},

	            "Config": [

	                {

	                    "Subnet": "192.168.76.0/24",

	                    "Gateway": "192.168.76.1"

	                }

	            ]

	        },

	        "Internal": false,

	        "Attachable": false,

	        "Ingress": false,

	        "ConfigFrom": {

	            "Network": ""

	        },

	        "ConfigOnly": false,

	        "Containers": {},

	        "Options": {

	            "--icc": "",

	            "--ip-masq": "",

	            "com.docker.network.driver.mtu": "65535"

	        },

	        "Labels": {

	            "created_by.minikube.sigs.k8s.io": "true",

	            "name.minikube.sigs.k8s.io": "multinode-053000"

	        }

	    }

	]

-- /stdout --

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-053000 -n multinode-053000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-053000 -n multinode-053000: exit status 7 (107.346653ms)

-- stdout --

	Nonexistent

-- /stdout --

** stderr ** 

	E1226 14:37:13.344244    7188 status.go:249] status error: host: state: unknown state "multinode-053000": docker container inspect multinode-053000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-053000

** /stderr **

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "multinode-053000" host is not running, skipping log retrieval (state="Nonexistent")

--- FAIL: TestMultiNode/serial/FreshStart2Nodes (756.00s)