=== RUN   TestOffline

=== PAUSE TestOffline

=== CONT  TestOffline

aab_offline_test.go:55: (dbg) Run:  out/minikube-darwin-amd64 start -p offline-docker-158000 --alsologtostderr -v=1 --memory=2048 --wait=true --driver=docker 

aab_offline_test.go:55: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p offline-docker-158000 --alsologtostderr -v=1 --memory=2048 --wait=true --driver=docker : exit status 52 (12m33.354265939s)

-- stdout --

	* [offline-docker-158000] minikube v1.32.0 on Darwin 14.3.1

	  - MINIKUBE_LOCATION=18259

	  - KUBECONFIG=/Users/jenkins/minikube-integration/18259-932/kubeconfig

	  - MINIKUBE_BIN=out/minikube-darwin-amd64

	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18259-932/.minikube

	  - MINIKUBE_FORCE_SYSTEMD=

	* Using the docker driver based on user configuration

	* Using Docker Desktop driver with root privileges

	* Starting control plane node offline-docker-158000 in cluster offline-docker-158000

	* Pulling base image v0.0.42-1708944392-18244 ...

	* Creating docker container (CPUs=2, Memory=2048MB) ...

	* docker "offline-docker-158000" container is missing, will recreate.

	* Creating docker container (CPUs=2, Memory=2048MB) ...

-- /stdout --

** stderr ** 

	I0229 11:08:51.200120    9021 out.go:291] Setting OutFile to fd 1 ...

	I0229 11:08:51.200366    9021 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0229 11:08:51.200371    9021 out.go:304] Setting ErrFile to fd 2...

	I0229 11:08:51.200375    9021 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0229 11:08:51.200546    9021 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18259-932/.minikube/bin

	I0229 11:08:51.201938    9021 out.go:298] Setting JSON to false

	I0229 11:08:51.224053    9021 start.go:129] hostinfo: {"hostname":"MacOS-Agent-1.local","uptime":5901,"bootTime":1709227830,"procs":497,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"b7610dcb-1435-5842-8d5a-b2388403fea3"}

	W0229 11:08:51.224143    9021 start.go:137] gopshost.Virtualization returned error: not implemented yet

	I0229 11:08:51.246488    9021 out.go:177] * [offline-docker-158000] minikube v1.32.0 on Darwin 14.3.1

	I0229 11:08:51.290059    9021 out.go:177]   - MINIKUBE_LOCATION=18259

	I0229 11:08:51.290186    9021 notify.go:220] Checking for updates...

	I0229 11:08:51.311179    9021 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/18259-932/kubeconfig

	I0229 11:08:51.333271    9021 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64

	I0229 11:08:51.355100    9021 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I0229 11:08:51.376930    9021 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18259-932/.minikube

	I0229 11:08:51.398079    9021 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=

	I0229 11:08:51.419509    9021 driver.go:392] Setting default libvirt URI to qemu:///system

	I0229 11:08:51.475017    9021 docker.go:122] docker version: linux-25.0.3:Docker Desktop 4.27.2 (137060)

	I0229 11:08:51.475212    9021 cli_runner.go:164] Run: docker system info --format "{{json .}}"

	I0229 11:08:51.576975    9021 info.go:266] docker info: {ID:37b3081a-8cd6-457e-b2a4-79dc82345b06 Containers:9 ContainersRunning:1 ContainersPaused:0 ContainersStopped:8 Images:2 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:96 OomKillDisable:false NGoroutines:195 SystemTime:2024-02-29 19:08:51.567571994 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:26 KernelVersion:6.6.12-linuxkit OperatingSystem:Docker Desktop OSType:linux Architecture:x86_64 IndexServerAddress:

https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:12 MemTotal:6213292032 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy:http.docker.internal:3128 HTTPSProxy:http.docker.internal:3128 NoProxy:hubproxy.docker.internal Name:docker-desktop Labels:[] ExperimentalBuild:false ServerVersion:25.0.3 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:ae07eda36dd25f8a1b98dfbf587313b99c0190bb Expected:ae07eda36dd25f8a1b98dfbf587313b99c0190bb} RuncCommit:{ID:v1.1.12-0-g51d5e94 Expected:v1.1.12-0-g51d5e94} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=seccomp,profile=unconfined name

=cgroupns] ProductLicense: Warnings:[WARNING: daemon is not using the default seccomp profile] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/Users/jenkins/.docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-buildx] ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.12.1-desktop.4] map[Name:compose Path:/Users/jenkins/.docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-compose] ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.24.5-desktop.1] map[Name:debug Path:/Users/jenkins/.docker/cli-plugins/docker-debug SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-debug] ShortDescription:Get a shell into any image or container. Vendor:Docker Inc. Version:0.0.24] map[Name:dev Path:/Users/jenkins/.docker/cli-plugins/docker-dev SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-dev] ShortDescription:Docker D

ev Environments Vendor:Docker Inc. Version:v0.1.0] map[Name:extension Path:/Users/jenkins/.docker/cli-plugins/docker-extension SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-extension] ShortDescription:Manages Docker extensions Vendor:Docker Inc. Version:v0.2.21] map[Name:feedback Path:/Users/jenkins/.docker/cli-plugins/docker-feedback SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-feedback] ShortDescription:Provide feedback, right in your terminal! Vendor:Docker Inc. Version:v1.0.4] map[Name:init Path:/Users/jenkins/.docker/cli-plugins/docker-init SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-init] ShortDescription:Creates Docker-related starter files for your project Vendor:Docker Inc. Version:v1.0.0] map[Name:sbom Path:/Users/jenkins/.docker/cli-plugins/docker-sbom SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-sbom] ShortDescription:View the packaged-based Software Bill Of Materials (SBOM)

for an image URL:https://github.com/docker/sbom-cli-plugin Vendor:Anchore Inc. Version:0.6.0] map[Err:failed to fetch metadata: fork/exec /Users/jenkins/.docker/cli-plugins/docker-scan: no such file or directory Name:scan Path:/Users/jenkins/.docker/cli-plugins/docker-scan] map[Name:scout Path:/Users/jenkins/.docker/cli-plugins/docker-scout SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-scout] ShortDescription:Docker Scout Vendor:Docker Inc. Version:v1.4.1]] Warnings:<nil>}}

	I0229 11:08:51.620430    9021 out.go:177] * Using the docker driver based on user configuration

	I0229 11:08:51.641438    9021 start.go:299] selected driver: docker

	I0229 11:08:51.641487    9021 start.go:903] validating driver "docker" against <nil>

	I0229 11:08:51.641503    9021 start.go:914] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}

	I0229 11:08:51.645764    9021 cli_runner.go:164] Run: docker system info --format "{{json .}}"

	I0229 11:08:51.743480    9021 info.go:266] docker info: {ID:37b3081a-8cd6-457e-b2a4-79dc82345b06 Containers:9 ContainersRunning:1 ContainersPaused:0 ContainersStopped:8 Images:2 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:96 OomKillDisable:false NGoroutines:195 SystemTime:2024-02-29 19:08:51.734005768 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:26 KernelVersion:6.6.12-linuxkit OperatingSystem:Docker Desktop OSType:linux Architecture:x86_64 IndexServerAddress:

https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:12 MemTotal:6213292032 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy:http.docker.internal:3128 HTTPSProxy:http.docker.internal:3128 NoProxy:hubproxy.docker.internal Name:docker-desktop Labels:[] ExperimentalBuild:false ServerVersion:25.0.3 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:ae07eda36dd25f8a1b98dfbf587313b99c0190bb Expected:ae07eda36dd25f8a1b98dfbf587313b99c0190bb} RuncCommit:{ID:v1.1.12-0-g51d5e94 Expected:v1.1.12-0-g51d5e94} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=seccomp,profile=unconfined name

=cgroupns] ProductLicense: Warnings:[WARNING: daemon is not using the default seccomp profile] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/Users/jenkins/.docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-buildx] ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.12.1-desktop.4] map[Name:compose Path:/Users/jenkins/.docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-compose] ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.24.5-desktop.1] map[Name:debug Path:/Users/jenkins/.docker/cli-plugins/docker-debug SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-debug] ShortDescription:Get a shell into any image or container. Vendor:Docker Inc. Version:0.0.24] map[Name:dev Path:/Users/jenkins/.docker/cli-plugins/docker-dev SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-dev] ShortDescription:Docker D

ev Environments Vendor:Docker Inc. Version:v0.1.0] map[Name:extension Path:/Users/jenkins/.docker/cli-plugins/docker-extension SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-extension] ShortDescription:Manages Docker extensions Vendor:Docker Inc. Version:v0.2.21] map[Name:feedback Path:/Users/jenkins/.docker/cli-plugins/docker-feedback SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-feedback] ShortDescription:Provide feedback, right in your terminal! Vendor:Docker Inc. Version:v1.0.4] map[Name:init Path:/Users/jenkins/.docker/cli-plugins/docker-init SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-init] ShortDescription:Creates Docker-related starter files for your project Vendor:Docker Inc. Version:v1.0.0] map[Name:sbom Path:/Users/jenkins/.docker/cli-plugins/docker-sbom SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-sbom] ShortDescription:View the packaged-based Software Bill Of Materials (SBOM)

for an image URL:https://github.com/docker/sbom-cli-plugin Vendor:Anchore Inc. Version:0.6.0] map[Err:failed to fetch metadata: fork/exec /Users/jenkins/.docker/cli-plugins/docker-scan: no such file or directory Name:scan Path:/Users/jenkins/.docker/cli-plugins/docker-scan] map[Name:scout Path:/Users/jenkins/.docker/cli-plugins/docker-scout SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-scout] ShortDescription:Docker Scout Vendor:Docker Inc. Version:v1.4.1]] Warnings:<nil>}}

	I0229 11:08:51.743647    9021 start_flags.go:309] no existing cluster config was found, will generate one from the flags 

	I0229 11:08:51.743844    9021 start_flags.go:931] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]

	I0229 11:08:51.764725    9021 out.go:177] * Using Docker Desktop driver with root privileges

	I0229 11:08:51.786748    9021 cni.go:84] Creating CNI manager for ""

	I0229 11:08:51.786788    9021 cni.go:158] "docker" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge

	I0229 11:08:51.786803    9021 start_flags.go:318] Found "bridge CNI" CNI - setting NetworkPlugin=cni

	I0229 11:08:51.786831    9021 start_flags.go:323] config:

	{Name:offline-docker-158000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2048 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:offline-docker-158000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local Container

Runtime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I0229 11:08:51.808580    9021 out.go:177] * Starting control plane node offline-docker-158000 in cluster offline-docker-158000

	I0229 11:08:51.850805    9021 cache.go:121] Beginning downloading kic base image for docker with docker

	I0229 11:08:51.871829    9021 out.go:177] * Pulling base image v0.0.42-1708944392-18244 ...

	I0229 11:08:51.913557    9021 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker

	I0229 11:08:51.913590    9021 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 in local docker daemon

	I0229 11:08:51.913627    9021 preload.go:148] Found local preload: /Users/jenkins/minikube-integration/18259-932/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4

	I0229 11:08:51.913642    9021 cache.go:56] Caching tarball of preloaded images

	I0229 11:08:51.913804    9021 preload.go:174] Found /Users/jenkins/minikube-integration/18259-932/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4 in cache, skipping download

	I0229 11:08:51.913821    9021 cache.go:59] Finished verifying existence of preloaded tar for  v1.28.4 on docker

	I0229 11:08:51.914930    9021 profile.go:148] Saving config to /Users/jenkins/minikube-integration/18259-932/.minikube/profiles/offline-docker-158000/config.json ...

	I0229 11:08:51.915026    9021 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/18259-932/.minikube/profiles/offline-docker-158000/config.json: {Name:mk78600c558f75f5976317b20b749da276f751db Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0229 11:08:51.963707    9021 image.go:83] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 in local docker daemon, skipping pull

	I0229 11:08:51.963770    9021 cache.go:144] gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 exists in daemon, skipping load

	I0229 11:08:51.963789    9021 cache.go:194] Successfully downloaded all kic artifacts

	I0229 11:08:51.963861    9021 start.go:365] acquiring machines lock for offline-docker-158000: {Name:mk8c342834689ae2d1b377c1888c5b8336679323 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0229 11:08:51.964010    9021 start.go:369] acquired machines lock for "offline-docker-158000" in 135.783µs

	I0229 11:08:51.964034    9021 start.go:93] Provisioning new machine with config: &{Name:offline-docker-158000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2048 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:offline-docker-158000 Namespace:default APIServerN

ame:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations

:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}

	I0229 11:08:51.964105    9021 start.go:125] createHost starting for "" (driver="docker")

	I0229 11:08:52.006439    9021 out.go:204] * Creating docker container (CPUs=2, Memory=2048MB) ...

	I0229 11:08:52.006700    9021 start.go:159] libmachine.API.Create for "offline-docker-158000" (driver="docker")

	I0229 11:08:52.006741    9021 client.go:168] LocalClient.Create starting

	I0229 11:08:52.006896    9021 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18259-932/.minikube/certs/ca.pem

	I0229 11:08:52.006982    9021 main.go:141] libmachine: Decoding PEM data...

	I0229 11:08:52.006999    9021 main.go:141] libmachine: Parsing certificate...

	I0229 11:08:52.007080    9021 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18259-932/.minikube/certs/cert.pem

	I0229 11:08:52.007120    9021 main.go:141] libmachine: Decoding PEM data...

	I0229 11:08:52.007127    9021 main.go:141] libmachine: Parsing certificate...

	I0229 11:08:52.007636    9021 cli_runner.go:164] Run: docker network inspect offline-docker-158000 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"

	W0229 11:08:52.057248    9021 cli_runner.go:211] docker network inspect offline-docker-158000 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1

	I0229 11:08:52.057346    9021 network_create.go:281] running [docker network inspect offline-docker-158000] to gather additional debugging logs...

	I0229 11:08:52.057363    9021 cli_runner.go:164] Run: docker network inspect offline-docker-158000

	W0229 11:08:52.106630    9021 cli_runner.go:211] docker network inspect offline-docker-158000 returned with exit code 1

	I0229 11:08:52.106664    9021 network_create.go:284] error running [docker network inspect offline-docker-158000]: docker network inspect offline-docker-158000: exit status 1

	stdout:

	[]

	stderr:

	Error response from daemon: network offline-docker-158000 not found

	I0229 11:08:52.106676    9021 network_create.go:286] output of [docker network inspect offline-docker-158000]: -- stdout --

	[]

	-- /stdout --

	** stderr ** 

	Error response from daemon: network offline-docker-158000 not found

	** /stderr **

	I0229 11:08:52.106797    9021 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"

	I0229 11:08:52.157657    9021 network.go:210] skipping subnet 192.168.49.0/24 that is reserved: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:<nil>}

	I0229 11:08:52.158058    9021 network.go:207] using free private subnet 192.168.58.0/24: &{IP:192.168.58.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.58.0/24 Gateway:192.168.58.1 ClientMin:192.168.58.2 ClientMax:192.168.58.254 Broadcast:192.168.58.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc002312e70}

	I0229 11:08:52.158074    9021 network_create.go:124] attempt to create docker network offline-docker-158000 192.168.58.0/24 with gateway 192.168.58.1 and MTU of 65535 ...

	I0229 11:08:52.158155    9021 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.58.0/24 --gateway=192.168.58.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=65535 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=offline-docker-158000 offline-docker-158000

	I0229 11:08:52.243291    9021 network_create.go:108] docker network offline-docker-158000 192.168.58.0/24 created

	I0229 11:08:52.243335    9021 kic.go:121] calculated static IP "192.168.58.2" for the "offline-docker-158000" container

	I0229 11:08:52.243448    9021 cli_runner.go:164] Run: docker ps -a --format {{.Names}}

	I0229 11:08:52.294123    9021 cli_runner.go:164] Run: docker volume create offline-docker-158000 --label name.minikube.sigs.k8s.io=offline-docker-158000 --label created_by.minikube.sigs.k8s.io=true

	I0229 11:08:52.344247    9021 oci.go:103] Successfully created a docker volume offline-docker-158000

	I0229 11:08:52.344351    9021 cli_runner.go:164] Run: docker run --rm --name offline-docker-158000-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=offline-docker-158000 --entrypoint /usr/bin/test -v offline-docker-158000:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 -d /var/lib

	I0229 11:08:52.704505    9021 oci.go:107] Successfully prepared a docker volume offline-docker-158000

	I0229 11:08:52.704540    9021 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker

	I0229 11:08:52.704552    9021 kic.go:194] Starting extracting preloaded images to volume ...

	I0229 11:08:52.704671    9021 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v /Users/jenkins/minikube-integration/18259-932/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4:/preloaded.tar:ro -v offline-docker-158000:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 -I lz4 -xf /preloaded.tar -C /extractDir

	I0229 11:14:51.995679    9021 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0229 11:14:51.995813    9021 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" offline-docker-158000

	W0229 11:14:52.046482    9021 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" offline-docker-158000 returned with exit code 1

	I0229 11:14:52.046609    9021 retry.go:31] will retry after 261.266233ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "offline-docker-158000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" offline-docker-158000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: offline-docker-158000

	I0229 11:14:52.308680    9021 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" offline-docker-158000

	W0229 11:14:52.367111    9021 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" offline-docker-158000 returned with exit code 1

	I0229 11:14:52.367222    9021 retry.go:31] will retry after 503.54145ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "offline-docker-158000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" offline-docker-158000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: offline-docker-158000

	I0229 11:14:52.871201    9021 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" offline-docker-158000

	W0229 11:14:52.920495    9021 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" offline-docker-158000 returned with exit code 1

	I0229 11:14:52.920609    9021 retry.go:31] will retry after 678.638757ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "offline-docker-158000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" offline-docker-158000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: offline-docker-158000

	I0229 11:14:53.601480    9021 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" offline-docker-158000

	W0229 11:14:53.653099    9021 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" offline-docker-158000 returned with exit code 1

	W0229 11:14:53.653204    9021 start.go:275] error running df -h /var: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "offline-docker-158000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" offline-docker-158000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: offline-docker-158000

	W0229 11:14:53.653230    9021 start.go:242] error getting percentage of /var that is free: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "offline-docker-158000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" offline-docker-158000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: offline-docker-158000

	I0229 11:14:53.653285    9021 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"

	I0229 11:14:53.653340    9021 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" offline-docker-158000

	W0229 11:14:53.702652    9021 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" offline-docker-158000 returned with exit code 1

	I0229 11:14:53.702750    9021 retry.go:31] will retry after 313.017095ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "offline-docker-158000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" offline-docker-158000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: offline-docker-158000

	I0229 11:14:54.016517    9021 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" offline-docker-158000

	W0229 11:14:54.066774    9021 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" offline-docker-158000 returned with exit code 1

	I0229 11:14:54.066870    9021 retry.go:31] will retry after 463.413159ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "offline-docker-158000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" offline-docker-158000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: offline-docker-158000

	I0229 11:14:54.530582    9021 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" offline-docker-158000

	W0229 11:14:54.581616    9021 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" offline-docker-158000 returned with exit code 1

	I0229 11:14:54.581708    9021 retry.go:31] will retry after 458.342107ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "offline-docker-158000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" offline-docker-158000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: offline-docker-158000

	I0229 11:14:55.040634    9021 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" offline-docker-158000

	W0229 11:14:55.091451    9021 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" offline-docker-158000 returned with exit code 1

	W0229 11:14:55.091557    9021 start.go:290] error running df -BG /var: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "offline-docker-158000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" offline-docker-158000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: offline-docker-158000

	W0229 11:14:55.091575    9021 start.go:247] error getting GiB of /var that is available: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "offline-docker-158000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" offline-docker-158000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: offline-docker-158000

	I0229 11:14:55.091587    9021 start.go:128] duration metric: createHost completed in 6m3.139526963s

	I0229 11:14:55.091594    9021 start.go:83] releasing machines lock for "offline-docker-158000", held for 6m3.139632996s

	W0229 11:14:55.091609    9021 start.go:694] error starting host: creating host: create host timed out in 360.000000 seconds

	I0229 11:14:55.092041    9021 cli_runner.go:164] Run: docker container inspect offline-docker-158000 --format={{.State.Status}}

	W0229 11:14:55.141670    9021 cli_runner.go:211] docker container inspect offline-docker-158000 --format={{.State.Status}} returned with exit code 1

	I0229 11:14:55.141740    9021 delete.go:82] Unable to get host status for offline-docker-158000, assuming it has already been deleted: state: unknown state "offline-docker-158000": docker container inspect offline-docker-158000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: offline-docker-158000

	W0229 11:14:55.141831    9021 out.go:239] ! StartHost failed, but will try again: creating host: create host timed out in 360.000000 seconds

	! StartHost failed, but will try again: creating host: create host timed out in 360.000000 seconds

	I0229 11:14:55.141840    9021 start.go:709] Will try again in 5 seconds ...

	I0229 11:15:00.142086    9021 start.go:365] acquiring machines lock for offline-docker-158000: {Name:mk8c342834689ae2d1b377c1888c5b8336679323 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0229 11:15:00.142776    9021 start.go:369] acquired machines lock for "offline-docker-158000" in 628.851µs

	I0229 11:15:00.142904    9021 start.go:96] Skipping create...Using existing machine configuration

	I0229 11:15:00.142917    9021 fix.go:54] fixHost starting: 

	I0229 11:15:00.143293    9021 cli_runner.go:164] Run: docker container inspect offline-docker-158000 --format={{.State.Status}}

	W0229 11:15:00.193494    9021 cli_runner.go:211] docker container inspect offline-docker-158000 --format={{.State.Status}} returned with exit code 1

	I0229 11:15:00.193539    9021 fix.go:102] recreateIfNeeded on offline-docker-158000: state= err=unknown state "offline-docker-158000": docker container inspect offline-docker-158000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: offline-docker-158000

	I0229 11:15:00.193558    9021 fix.go:107] machineExists: false. err=machine does not exist

	I0229 11:15:00.215222    9021 out.go:177] * docker "offline-docker-158000" container is missing, will recreate.

	I0229 11:15:00.258072    9021 delete.go:124] DEMOLISHING offline-docker-158000 ...

	I0229 11:15:00.258242    9021 cli_runner.go:164] Run: docker container inspect offline-docker-158000 --format={{.State.Status}}

	W0229 11:15:00.309199    9021 cli_runner.go:211] docker container inspect offline-docker-158000 --format={{.State.Status}} returned with exit code 1

	W0229 11:15:00.309262    9021 stop.go:75] unable to get state: unknown state "offline-docker-158000": docker container inspect offline-docker-158000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: offline-docker-158000

	I0229 11:15:00.309284    9021 delete.go:128] stophost failed (probably ok): ssh power off: unknown state "offline-docker-158000": docker container inspect offline-docker-158000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: offline-docker-158000

	I0229 11:15:00.309663    9021 cli_runner.go:164] Run: docker container inspect offline-docker-158000 --format={{.State.Status}}

	W0229 11:15:00.359144    9021 cli_runner.go:211] docker container inspect offline-docker-158000 --format={{.State.Status}} returned with exit code 1

	I0229 11:15:00.359211    9021 delete.go:82] Unable to get host status for offline-docker-158000, assuming it has already been deleted: state: unknown state "offline-docker-158000": docker container inspect offline-docker-158000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: offline-docker-158000

	I0229 11:15:00.359292    9021 cli_runner.go:164] Run: docker container inspect -f {{.Id}} offline-docker-158000

	W0229 11:15:00.408241    9021 cli_runner.go:211] docker container inspect -f {{.Id}} offline-docker-158000 returned with exit code 1

	I0229 11:15:00.408285    9021 kic.go:371] could not find the container offline-docker-158000 to remove it. will try anyways

	I0229 11:15:00.408355    9021 cli_runner.go:164] Run: docker container inspect offline-docker-158000 --format={{.State.Status}}

	W0229 11:15:00.456731    9021 cli_runner.go:211] docker container inspect offline-docker-158000 --format={{.State.Status}} returned with exit code 1

	W0229 11:15:00.456777    9021 oci.go:84] error getting container status, will try to delete anyways: unknown state "offline-docker-158000": docker container inspect offline-docker-158000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: offline-docker-158000

	I0229 11:15:00.456861    9021 cli_runner.go:164] Run: docker exec --privileged -t offline-docker-158000 /bin/bash -c "sudo init 0"

	W0229 11:15:00.505926    9021 cli_runner.go:211] docker exec --privileged -t offline-docker-158000 /bin/bash -c "sudo init 0" returned with exit code 1

	I0229 11:15:00.505959    9021 oci.go:650] error shutdown offline-docker-158000: docker exec --privileged -t offline-docker-158000 /bin/bash -c "sudo init 0": exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: offline-docker-158000

	I0229 11:15:01.506292    9021 cli_runner.go:164] Run: docker container inspect offline-docker-158000 --format={{.State.Status}}

	W0229 11:15:01.558285    9021 cli_runner.go:211] docker container inspect offline-docker-158000 --format={{.State.Status}} returned with exit code 1

	I0229 11:15:01.558339    9021 oci.go:662] temporary error verifying shutdown: unknown state "offline-docker-158000": docker container inspect offline-docker-158000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: offline-docker-158000

	I0229 11:15:01.558349    9021 oci.go:664] temporary error: container offline-docker-158000 status is  but expect it to be exited

	I0229 11:15:01.558377    9021 retry.go:31] will retry after 425.655537ms: couldn't verify container is exited. %v: unknown state "offline-docker-158000": docker container inspect offline-docker-158000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: offline-docker-158000

	I0229 11:15:01.986165    9021 cli_runner.go:164] Run: docker container inspect offline-docker-158000 --format={{.State.Status}}

	W0229 11:15:02.036399    9021 cli_runner.go:211] docker container inspect offline-docker-158000 --format={{.State.Status}} returned with exit code 1

	I0229 11:15:02.036453    9021 oci.go:662] temporary error verifying shutdown: unknown state "offline-docker-158000": docker container inspect offline-docker-158000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: offline-docker-158000

	I0229 11:15:02.036466    9021 oci.go:664] temporary error: container offline-docker-158000 status is  but expect it to be exited

	I0229 11:15:02.036490    9021 retry.go:31] will retry after 709.928297ms: couldn't verify container is exited. %v: unknown state "offline-docker-158000": docker container inspect offline-docker-158000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: offline-docker-158000

	I0229 11:15:02.747857    9021 cli_runner.go:164] Run: docker container inspect offline-docker-158000 --format={{.State.Status}}

	W0229 11:15:02.799348    9021 cli_runner.go:211] docker container inspect offline-docker-158000 --format={{.State.Status}} returned with exit code 1

	I0229 11:15:02.799397    9021 oci.go:662] temporary error verifying shutdown: unknown state "offline-docker-158000": docker container inspect offline-docker-158000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: offline-docker-158000

	I0229 11:15:02.799409    9021 oci.go:664] temporary error: container offline-docker-158000 status is  but expect it to be exited

	I0229 11:15:02.799429    9021 retry.go:31] will retry after 930.679299ms: couldn't verify container is exited. %v: unknown state "offline-docker-158000": docker container inspect offline-docker-158000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: offline-docker-158000

	I0229 11:15:03.730335    9021 cli_runner.go:164] Run: docker container inspect offline-docker-158000 --format={{.State.Status}}

	W0229 11:15:03.782770    9021 cli_runner.go:211] docker container inspect offline-docker-158000 --format={{.State.Status}} returned with exit code 1

	I0229 11:15:03.782820    9021 oci.go:662] temporary error verifying shutdown: unknown state "offline-docker-158000": docker container inspect offline-docker-158000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: offline-docker-158000

	I0229 11:15:03.782831    9021 oci.go:664] temporary error: container offline-docker-158000 status is  but expect it to be exited

	I0229 11:15:03.782850    9021 retry.go:31] will retry after 2.43634524s: couldn't verify container is exited. %v: unknown state "offline-docker-158000": docker container inspect offline-docker-158000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: offline-docker-158000

	I0229 11:15:06.220071    9021 cli_runner.go:164] Run: docker container inspect offline-docker-158000 --format={{.State.Status}}

	W0229 11:15:06.270576    9021 cli_runner.go:211] docker container inspect offline-docker-158000 --format={{.State.Status}} returned with exit code 1

	I0229 11:15:06.270623    9021 oci.go:662] temporary error verifying shutdown: unknown state "offline-docker-158000": docker container inspect offline-docker-158000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: offline-docker-158000

	I0229 11:15:06.270634    9021 oci.go:664] temporary error: container offline-docker-158000 status is  but expect it to be exited

	I0229 11:15:06.270658    9021 retry.go:31] will retry after 1.544774328s: couldn't verify container is exited. %v: unknown state "offline-docker-158000": docker container inspect offline-docker-158000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: offline-docker-158000

	I0229 11:15:07.816851    9021 cli_runner.go:164] Run: docker container inspect offline-docker-158000 --format={{.State.Status}}

	W0229 11:15:07.867387    9021 cli_runner.go:211] docker container inspect offline-docker-158000 --format={{.State.Status}} returned with exit code 1

	I0229 11:15:07.867442    9021 oci.go:662] temporary error verifying shutdown: unknown state "offline-docker-158000": docker container inspect offline-docker-158000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: offline-docker-158000

	I0229 11:15:07.867450    9021 oci.go:664] temporary error: container offline-docker-158000 status is  but expect it to be exited

	I0229 11:15:07.867476    9021 retry.go:31] will retry after 3.34373003s: couldn't verify container is exited. %v: unknown state "offline-docker-158000": docker container inspect offline-docker-158000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: offline-docker-158000

	I0229 11:15:11.212786    9021 cli_runner.go:164] Run: docker container inspect offline-docker-158000 --format={{.State.Status}}

	W0229 11:15:11.263628    9021 cli_runner.go:211] docker container inspect offline-docker-158000 --format={{.State.Status}} returned with exit code 1

	I0229 11:15:11.263686    9021 oci.go:662] temporary error verifying shutdown: unknown state "offline-docker-158000": docker container inspect offline-docker-158000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: offline-docker-158000

	I0229 11:15:11.263698    9021 oci.go:664] temporary error: container offline-docker-158000 status is  but expect it to be exited

	I0229 11:15:11.263721    9021 retry.go:31] will retry after 6.458647032s: couldn't verify container is exited. %v: unknown state "offline-docker-158000": docker container inspect offline-docker-158000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: offline-docker-158000

	I0229 11:15:17.722558    9021 cli_runner.go:164] Run: docker container inspect offline-docker-158000 --format={{.State.Status}}

	W0229 11:15:17.773111    9021 cli_runner.go:211] docker container inspect offline-docker-158000 --format={{.State.Status}} returned with exit code 1

	I0229 11:15:17.773157    9021 oci.go:662] temporary error verifying shutdown: unknown state "offline-docker-158000": docker container inspect offline-docker-158000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: offline-docker-158000

	I0229 11:15:17.773167    9021 oci.go:664] temporary error: container offline-docker-158000 status is  but expect it to be exited

	I0229 11:15:17.773199    9021 oci.go:88] couldn't shut down offline-docker-158000 (might be okay): verify shutdown: couldn't verify container is exited. %v: unknown state "offline-docker-158000": docker container inspect offline-docker-158000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: offline-docker-158000

	I0229 11:15:17.773271    9021 cli_runner.go:164] Run: docker rm -f -v offline-docker-158000

	I0229 11:15:17.823187    9021 cli_runner.go:164] Run: docker container inspect -f {{.Id}} offline-docker-158000

	W0229 11:15:17.872204    9021 cli_runner.go:211] docker container inspect -f {{.Id}} offline-docker-158000 returned with exit code 1

	I0229 11:15:17.872309    9021 cli_runner.go:164] Run: docker network inspect offline-docker-158000 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"

	I0229 11:15:17.922549    9021 cli_runner.go:164] Run: docker network rm offline-docker-158000

	I0229 11:15:18.022857    9021 fix.go:114] Sleeping 1 second for extra luck!

	I0229 11:15:19.024276    9021 start.go:125] createHost starting for "" (driver="docker")

	I0229 11:15:19.046310    9021 out.go:204] * Creating docker container (CPUs=2, Memory=2048MB) ...

	I0229 11:15:19.046544    9021 start.go:159] libmachine.API.Create for "offline-docker-158000" (driver="docker")

	I0229 11:15:19.046579    9021 client.go:168] LocalClient.Create starting

	I0229 11:15:19.046779    9021 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18259-932/.minikube/certs/ca.pem

	I0229 11:15:19.046873    9021 main.go:141] libmachine: Decoding PEM data...

	I0229 11:15:19.046899    9021 main.go:141] libmachine: Parsing certificate...

	I0229 11:15:19.046985    9021 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18259-932/.minikube/certs/cert.pem

	I0229 11:15:19.047069    9021 main.go:141] libmachine: Decoding PEM data...

	I0229 11:15:19.047084    9021 main.go:141] libmachine: Parsing certificate...

	I0229 11:15:19.068597    9021 cli_runner.go:164] Run: docker network inspect offline-docker-158000 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"

	W0229 11:15:19.119970    9021 cli_runner.go:211] docker network inspect offline-docker-158000 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1

	I0229 11:15:19.120072    9021 network_create.go:281] running [docker network inspect offline-docker-158000] to gather additional debugging logs...

	I0229 11:15:19.120088    9021 cli_runner.go:164] Run: docker network inspect offline-docker-158000

	W0229 11:15:19.169999    9021 cli_runner.go:211] docker network inspect offline-docker-158000 returned with exit code 1

	I0229 11:15:19.170032    9021 network_create.go:284] error running [docker network inspect offline-docker-158000]: docker network inspect offline-docker-158000: exit status 1

	stdout:

	[]

	stderr:

	Error response from daemon: network offline-docker-158000 not found

	I0229 11:15:19.170048    9021 network_create.go:286] output of [docker network inspect offline-docker-158000]: -- stdout --

	[]

	-- /stdout --

	** stderr ** 

	Error response from daemon: network offline-docker-158000 not found

	** /stderr **

	I0229 11:15:19.170177    9021 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"

	I0229 11:15:19.221987    9021 network.go:210] skipping subnet 192.168.49.0/24 that is reserved: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:<nil>}

	I0229 11:15:19.223554    9021 network.go:210] skipping subnet 192.168.58.0/24 that is reserved: &{IP:192.168.58.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.58.0/24 Gateway:192.168.58.1 ClientMin:192.168.58.2 ClientMax:192.168.58.254 Broadcast:192.168.58.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:<nil>}

	I0229 11:15:19.223914    9021 network.go:207] using free private subnet 192.168.67.0/24: &{IP:192.168.67.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.67.0/24 Gateway:192.168.67.1 ClientMin:192.168.67.2 ClientMax:192.168.67.254 Broadcast:192.168.67.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc000013b10}

	I0229 11:15:19.223930    9021 network_create.go:124] attempt to create docker network offline-docker-158000 192.168.67.0/24 with gateway 192.168.67.1 and MTU of 65535 ...

	I0229 11:15:19.223998    9021 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.67.0/24 --gateway=192.168.67.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=65535 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=offline-docker-158000 offline-docker-158000

	W0229 11:15:19.273406    9021 cli_runner.go:211] docker network create --driver=bridge --subnet=192.168.67.0/24 --gateway=192.168.67.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=65535 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=offline-docker-158000 offline-docker-158000 returned with exit code 1

	W0229 11:15:19.273447    9021 network_create.go:149] failed to create docker network offline-docker-158000 192.168.67.0/24 with gateway 192.168.67.1 and mtu of 65535: docker network create --driver=bridge --subnet=192.168.67.0/24 --gateway=192.168.67.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=65535 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=offline-docker-158000 offline-docker-158000: exit status 1

	stdout:

	stderr:

	Error response from daemon: Pool overlaps with other one on this address space

	W0229 11:15:19.273467    9021 network_create.go:116] failed to create docker network offline-docker-158000 192.168.67.0/24, will retry: subnet is taken

	I0229 11:15:19.275116    9021 network.go:210] skipping subnet 192.168.67.0/24 that is reserved: &{IP:192.168.67.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.67.0/24 Gateway:192.168.67.1 ClientMin:192.168.67.2 ClientMax:192.168.67.254 Broadcast:192.168.67.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:<nil>}

	I0229 11:15:19.275506    9021 network.go:207] using free private subnet 192.168.76.0/24: &{IP:192.168.76.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.76.0/24 Gateway:192.168.76.1 ClientMin:192.168.76.2 ClientMax:192.168.76.254 Broadcast:192.168.76.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc00231a9d0}

	I0229 11:15:19.275518    9021 network_create.go:124] attempt to create docker network offline-docker-158000 192.168.76.0/24 with gateway 192.168.76.1 and MTU of 65535 ...

	I0229 11:15:19.275582    9021 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.76.0/24 --gateway=192.168.76.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=65535 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=offline-docker-158000 offline-docker-158000

	W0229 11:15:19.325268    9021 cli_runner.go:211] docker network create --driver=bridge --subnet=192.168.76.0/24 --gateway=192.168.76.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=65535 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=offline-docker-158000 offline-docker-158000 returned with exit code 1

	W0229 11:15:19.325304    9021 network_create.go:149] failed to create docker network offline-docker-158000 192.168.76.0/24 with gateway 192.168.76.1 and mtu of 65535: docker network create --driver=bridge --subnet=192.168.76.0/24 --gateway=192.168.76.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=65535 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=offline-docker-158000 offline-docker-158000: exit status 1

	stdout:

	stderr:

	Error response from daemon: Pool overlaps with other one on this address space

	W0229 11:15:19.325323    9021 network_create.go:116] failed to create docker network offline-docker-158000 192.168.76.0/24, will retry: subnet is taken

	I0229 11:15:19.326703    9021 network.go:210] skipping subnet 192.168.76.0/24 that is reserved: &{IP:192.168.76.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.76.0/24 Gateway:192.168.76.1 ClientMin:192.168.76.2 ClientMax:192.168.76.254 Broadcast:192.168.76.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:<nil>}

	I0229 11:15:19.327146    9021 network.go:207] using free private subnet 192.168.85.0/24: &{IP:192.168.85.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.85.0/24 Gateway:192.168.85.1 ClientMin:192.168.85.2 ClientMax:192.168.85.254 Broadcast:192.168.85.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc00240e640}

	I0229 11:15:19.327162    9021 network_create.go:124] attempt to create docker network offline-docker-158000 192.168.85.0/24 with gateway 192.168.85.1 and MTU of 65535 ...

	I0229 11:15:19.327236    9021 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.85.0/24 --gateway=192.168.85.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=65535 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=offline-docker-158000 offline-docker-158000

	I0229 11:15:19.413054    9021 network_create.go:108] docker network offline-docker-158000 192.168.85.0/24 created

	I0229 11:15:19.413097    9021 kic.go:121] calculated static IP "192.168.85.2" for the "offline-docker-158000" container

	I0229 11:15:19.413202    9021 cli_runner.go:164] Run: docker ps -a --format {{.Names}}

	I0229 11:15:19.464788    9021 cli_runner.go:164] Run: docker volume create offline-docker-158000 --label name.minikube.sigs.k8s.io=offline-docker-158000 --label created_by.minikube.sigs.k8s.io=true

	I0229 11:15:19.513756    9021 oci.go:103] Successfully created a docker volume offline-docker-158000

	I0229 11:15:19.513867    9021 cli_runner.go:164] Run: docker run --rm --name offline-docker-158000-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=offline-docker-158000 --entrypoint /usr/bin/test -v offline-docker-158000:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 -d /var/lib

	I0229 11:15:19.790288    9021 oci.go:107] Successfully prepared a docker volume offline-docker-158000

	I0229 11:15:19.790326    9021 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker

	I0229 11:15:19.790339    9021 kic.go:194] Starting extracting preloaded images to volume ...

	I0229 11:15:19.790459    9021 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v /Users/jenkins/minikube-integration/18259-932/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4:/preloaded.tar:ro -v offline-docker-158000:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 -I lz4 -xf /preloaded.tar -C /extractDir

	I0229 11:21:19.035015    9021 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0229 11:21:19.035087    9021 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" offline-docker-158000

	W0229 11:21:19.083921    9021 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" offline-docker-158000 returned with exit code 1

	I0229 11:21:19.084038    9021 retry.go:31] will retry after 219.016636ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "offline-docker-158000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" offline-docker-158000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: offline-docker-158000

	I0229 11:21:19.303588    9021 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" offline-docker-158000

	W0229 11:21:19.355410    9021 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" offline-docker-158000 returned with exit code 1

	I0229 11:21:19.355511    9021 retry.go:31] will retry after 419.2579ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "offline-docker-158000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" offline-docker-158000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: offline-docker-158000

	I0229 11:21:19.775559    9021 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" offline-docker-158000

	W0229 11:21:19.825965    9021 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" offline-docker-158000 returned with exit code 1

	I0229 11:21:19.826073    9021 retry.go:31] will retry after 536.937411ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "offline-docker-158000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" offline-docker-158000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: offline-docker-158000

	I0229 11:21:20.364079    9021 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" offline-docker-158000

	W0229 11:21:20.414368    9021 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" offline-docker-158000 returned with exit code 1

	W0229 11:21:20.414475    9021 start.go:275] error running df -h /var: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "offline-docker-158000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" offline-docker-158000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: offline-docker-158000

	W0229 11:21:20.414497    9021 start.go:242] error getting percentage of /var that is free: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "offline-docker-158000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" offline-docker-158000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: offline-docker-158000

	I0229 11:21:20.414551    9021 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"

	I0229 11:21:20.414606    9021 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" offline-docker-158000

	W0229 11:21:20.463694    9021 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" offline-docker-158000 returned with exit code 1

	I0229 11:21:20.463804    9021 retry.go:31] will retry after 226.701455ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "offline-docker-158000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" offline-docker-158000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: offline-docker-158000

	I0229 11:21:20.692093    9021 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" offline-docker-158000

	W0229 11:21:20.741807    9021 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" offline-docker-158000 returned with exit code 1

	I0229 11:21:20.741909    9021 retry.go:31] will retry after 327.530219ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "offline-docker-158000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" offline-docker-158000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: offline-docker-158000

	I0229 11:21:21.070089    9021 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" offline-docker-158000

	W0229 11:21:21.120598    9021 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" offline-docker-158000 returned with exit code 1

	I0229 11:21:21.120698    9021 retry.go:31] will retry after 574.834933ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "offline-docker-158000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" offline-docker-158000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: offline-docker-158000

	I0229 11:21:21.696254    9021 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" offline-docker-158000

	W0229 11:21:21.747243    9021 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" offline-docker-158000 returned with exit code 1

	W0229 11:21:21.747351    9021 start.go:290] error running df -BG /var: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "offline-docker-158000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" offline-docker-158000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: offline-docker-158000

	W0229 11:21:21.747390    9021 start.go:247] error getting GiB of /var that is available: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "offline-docker-158000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" offline-docker-158000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: offline-docker-158000

	I0229 11:21:21.747405    9021 start.go:128] duration metric: createHost completed in 6m2.735154236s

	I0229 11:21:21.747494    9021 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0229 11:21:21.747557    9021 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" offline-docker-158000

	W0229 11:21:21.796853    9021 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" offline-docker-158000 returned with exit code 1

	I0229 11:21:21.796945    9021 retry.go:31] will retry after 252.518913ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "offline-docker-158000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" offline-docker-158000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: offline-docker-158000

	I0229 11:21:22.051409    9021 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" offline-docker-158000

	W0229 11:21:22.104504    9021 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" offline-docker-158000 returned with exit code 1

	I0229 11:21:22.104595    9021 retry.go:31] will retry after 298.573848ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "offline-docker-158000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" offline-docker-158000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: offline-docker-158000

	I0229 11:21:22.405523    9021 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" offline-docker-158000

	W0229 11:21:22.456640    9021 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" offline-docker-158000 returned with exit code 1

	I0229 11:21:22.456741    9021 retry.go:31] will retry after 630.542274ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "offline-docker-158000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" offline-docker-158000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: offline-docker-158000

	I0229 11:21:23.087817    9021 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" offline-docker-158000

	W0229 11:21:23.137976    9021 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" offline-docker-158000 returned with exit code 1

	W0229 11:21:23.138073    9021 start.go:275] error running df -h /var: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "offline-docker-158000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" offline-docker-158000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: offline-docker-158000

	W0229 11:21:23.138090    9021 start.go:242] error getting percentage of /var that is free: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "offline-docker-158000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" offline-docker-158000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: offline-docker-158000

	I0229 11:21:23.138162    9021 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"

	I0229 11:21:23.138220    9021 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" offline-docker-158000

	W0229 11:21:23.186930    9021 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" offline-docker-158000 returned with exit code 1

	I0229 11:21:23.187024    9021 retry.go:31] will retry after 201.626365ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "offline-docker-158000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" offline-docker-158000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: offline-docker-158000

	I0229 11:21:23.389476    9021 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" offline-docker-158000

	W0229 11:21:23.441346    9021 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" offline-docker-158000 returned with exit code 1

	I0229 11:21:23.441447    9021 retry.go:31] will retry after 475.864758ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "offline-docker-158000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" offline-docker-158000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: offline-docker-158000

	I0229 11:21:23.919170    9021 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" offline-docker-158000

	W0229 11:21:23.971561    9021 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" offline-docker-158000 returned with exit code 1

	I0229 11:21:23.971726    9021 retry.go:31] will retry after 312.736445ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "offline-docker-158000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" offline-docker-158000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: offline-docker-158000

	I0229 11:21:24.285226    9021 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" offline-docker-158000

	W0229 11:21:24.335801    9021 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" offline-docker-158000 returned with exit code 1

	W0229 11:21:24.335905    9021 start.go:290] error running df -BG /var: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "offline-docker-158000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" offline-docker-158000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: offline-docker-158000

	W0229 11:21:24.335925    9021 start.go:247] error getting GiB of /var that is available: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "offline-docker-158000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" offline-docker-158000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: offline-docker-158000

	I0229 11:21:24.335932    9021 fix.go:56] fixHost completed within 6m24.205772264s

	I0229 11:21:24.335937    9021 start.go:83] releasing machines lock for "offline-docker-158000", held for 6m24.20582082s

	W0229 11:21:24.336028    9021 out.go:239] * Failed to start docker container. Running "minikube delete -p offline-docker-158000" may fix it: recreate: creating host: create host timed out in 360.000000 seconds

	* Failed to start docker container. Running "minikube delete -p offline-docker-158000" may fix it: recreate: creating host: create host timed out in 360.000000 seconds

	I0229 11:21:24.357763    9021 out.go:177] 

	W0229 11:21:24.379539    9021 out.go:239] X Exiting due to DRV_CREATE_TIMEOUT: Failed to start host: recreate: creating host: create host timed out in 360.000000 seconds

	X Exiting due to DRV_CREATE_TIMEOUT: Failed to start host: recreate: creating host: create host timed out in 360.000000 seconds

	W0229 11:21:24.379586    9021 out.go:239] * Suggestion: Try 'minikube delete', and disable any conflicting VPN or firewall software

	* Suggestion: Try 'minikube delete', and disable any conflicting VPN or firewall software

	W0229 11:21:24.379615    9021 out.go:239] * Related issue: https://github.com/kubernetes/minikube/issues/7072

	* Related issue: https://github.com/kubernetes/minikube/issues/7072

	I0229 11:21:24.422488    9021 out.go:177] 

** /stderr **

aab_offline_test.go:58: out/minikube-darwin-amd64 start -p offline-docker-158000 --alsologtostderr -v=1 --memory=2048 --wait=true --driver=docker  failed: exit status 52

panic.go:626: *** TestOffline FAILED at 2024-02-29 11:21:24.478915 -0800 PST m=+6268.757601077

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:230: ======>  post-mortem[TestOffline]: docker inspect <======

helpers_test.go:231: (dbg) Run:  docker inspect offline-docker-158000

helpers_test.go:235: (dbg) docker inspect offline-docker-158000:

-- stdout --

	[

	    {

	        "Name": "offline-docker-158000",

	        "Id": "bb7357dc9d81a522e331461f22a730ed4d4acb336fdf876c7bd87ca1c14d5a41",

	        "Created": "2024-02-29T19:15:19.374155448Z",

	        "Scope": "local",

	        "Driver": "bridge",

	        "EnableIPv6": false,

	        "IPAM": {

	            "Driver": "default",

	            "Options": {},

	            "Config": [

	                {

	                    "Subnet": "192.168.85.0/24",

	                    "Gateway": "192.168.85.1"

	                }

	            ]

	        },

	        "Internal": false,

	        "Attachable": false,

	        "Ingress": false,

	        "ConfigFrom": {

	            "Network": ""

	        },

	        "ConfigOnly": false,

	        "Containers": {},

	        "Options": {

	            "--icc": "",

	            "--ip-masq": "",

	            "com.docker.network.driver.mtu": "65535"

	        },

	        "Labels": {

	            "created_by.minikube.sigs.k8s.io": "true",

	            "name.minikube.sigs.k8s.io": "offline-docker-158000"

	        }

	    }

	]

-- /stdout --

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p offline-docker-158000 -n offline-docker-158000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p offline-docker-158000 -n offline-docker-158000: exit status 7 (112.598292ms)

-- stdout --

	Nonexistent

-- /stdout --

** stderr ** 

	E0229 11:21:24.642898    9403 status.go:249] status error: host: state: unknown state "offline-docker-158000": docker container inspect offline-docker-158000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: offline-docker-158000

** /stderr **

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "offline-docker-158000" host is not running, skipping log retrieval (state="Nonexistent")

helpers_test.go:175: Cleaning up "offline-docker-158000" profile ...

helpers_test.go:178: (dbg) Run:  out/minikube-darwin-amd64 delete -p offline-docker-158000

--- FAIL: TestOffline (754.26s)

=== RUN   TestIngressAddonLegacy/StartLegacyK8sCluster

ingress_addon_legacy_test.go:39: (dbg) Run:  out/minikube-darwin-amd64 start -p ingress-addon-legacy-580000 --kubernetes-version=v1.18.20 --memory=4096 --wait=true --alsologtostderr -v=5 --driver=docker 

E0229 09:54:19.000029    1408 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/18259-932/.minikube/profiles/addons-551000/client.crt: no such file or directory

E0229 09:54:46.685911    1408 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/18259-932/.minikube/profiles/addons-551000/client.crt: no such file or directory

E0229 09:54:50.621485    1408 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/18259-932/.minikube/profiles/functional-081000/client.crt: no such file or directory

E0229 09:54:50.627180    1408 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/18259-932/.minikube/profiles/functional-081000/client.crt: no such file or directory

E0229 09:54:50.637947    1408 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/18259-932/.minikube/profiles/functional-081000/client.crt: no such file or directory

E0229 09:54:50.660218    1408 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/18259-932/.minikube/profiles/functional-081000/client.crt: no such file or directory

E0229 09:54:50.700459    1408 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/18259-932/.minikube/profiles/functional-081000/client.crt: no such file or directory

E0229 09:54:50.780722    1408 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/18259-932/.minikube/profiles/functional-081000/client.crt: no such file or directory

E0229 09:54:50.942372    1408 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/18259-932/.minikube/profiles/functional-081000/client.crt: no such file or directory

E0229 09:54:51.263123    1408 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/18259-932/.minikube/profiles/functional-081000/client.crt: no such file or directory

E0229 09:54:51.905364    1408 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/18259-932/.minikube/profiles/functional-081000/client.crt: no such file or directory

E0229 09:54:53.185540    1408 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/18259-932/.minikube/profiles/functional-081000/client.crt: no such file or directory

E0229 09:54:55.746114    1408 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/18259-932/.minikube/profiles/functional-081000/client.crt: no such file or directory

E0229 09:55:00.867461    1408 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/18259-932/.minikube/profiles/functional-081000/client.crt: no such file or directory

E0229 09:55:11.109538    1408 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/18259-932/.minikube/profiles/functional-081000/client.crt: no such file or directory

E0229 09:55:31.590871    1408 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/18259-932/.minikube/profiles/functional-081000/client.crt: no such file or directory

E0229 09:56:12.550443    1408 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/18259-932/.minikube/profiles/functional-081000/client.crt: no such file or directory

ingress_addon_legacy_test.go:39: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p ingress-addon-legacy-580000 --kubernetes-version=v1.18.20 --memory=4096 --wait=true --alsologtostderr -v=5 --driver=docker : exit status 109 (4m37.40753334s)

-- stdout --

	* [ingress-addon-legacy-580000] minikube v1.32.0 on Darwin 14.3.1

	  - MINIKUBE_LOCATION=18259

	  - KUBECONFIG=/Users/jenkins/minikube-integration/18259-932/kubeconfig

	  - MINIKUBE_BIN=out/minikube-darwin-amd64

	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18259-932/.minikube

	  - MINIKUBE_FORCE_SYSTEMD=

	* Using the docker driver based on user configuration

	* Using Docker Desktop driver with root privileges

	* Starting control plane node ingress-addon-legacy-580000 in cluster ingress-addon-legacy-580000

	* Pulling base image v0.0.42-1708944392-18244 ...

	* Downloading Kubernetes v1.18.20 preload ...

	* Creating docker container (CPUs=2, Memory=4096MB) ...

	* Preparing Kubernetes v1.18.20 on Docker 25.0.3 ...

	  - Generating certificates and keys ...

	  - Booting up control plane ...

	  - Generating certificates and keys ...

	  - Booting up control plane ...

-- /stdout --

** stderr ** 

	I0229 09:52:18.321196    4284 out.go:291] Setting OutFile to fd 1 ...

	I0229 09:52:18.321971    4284 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0229 09:52:18.321980    4284 out.go:304] Setting ErrFile to fd 2...

	I0229 09:52:18.321985    4284 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0229 09:52:18.322553    4284 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18259-932/.minikube/bin

	I0229 09:52:18.324292    4284 out.go:298] Setting JSON to false

	I0229 09:52:18.346898    4284 start.go:129] hostinfo: {"hostname":"MacOS-Agent-1.local","uptime":1308,"bootTime":1709227830,"procs":434,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"b7610dcb-1435-5842-8d5a-b2388403fea3"}

	W0229 09:52:18.346995    4284 start.go:137] gopshost.Virtualization returned error: not implemented yet

	I0229 09:52:18.368946    4284 out.go:177] * [ingress-addon-legacy-580000] minikube v1.32.0 on Darwin 14.3.1

	I0229 09:52:18.411552    4284 out.go:177]   - MINIKUBE_LOCATION=18259

	I0229 09:52:18.411620    4284 notify.go:220] Checking for updates...

	I0229 09:52:18.454446    4284 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/18259-932/kubeconfig

	I0229 09:52:18.497421    4284 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64

	I0229 09:52:18.518475    4284 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I0229 09:52:18.540352    4284 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18259-932/.minikube

	I0229 09:52:18.561474    4284 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=

	I0229 09:52:18.582689    4284 driver.go:392] Setting default libvirt URI to qemu:///system

	I0229 09:52:18.638449    4284 docker.go:122] docker version: linux-25.0.3:Docker Desktop 4.27.2 (137060)

	I0229 09:52:18.638614    4284 cli_runner.go:164] Run: docker system info --format "{{json .}}"

	I0229 09:52:18.744865    4284 info.go:266] docker info: {ID:37b3081a-8cd6-457e-b2a4-79dc82345b06 Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:2 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:59 OomKillDisable:false NGoroutines:108 SystemTime:2024-02-29 17:52:18.734964399 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:26 KernelVersion:6.6.12-linuxkit OperatingSystem:Docker Desktop OSType:linux Architecture:x86_64 IndexServerAddress:

https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:12 MemTotal:6213292032 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy:http.docker.internal:3128 HTTPSProxy:http.docker.internal:3128 NoProxy:hubproxy.docker.internal Name:docker-desktop Labels:[] ExperimentalBuild:false ServerVersion:25.0.3 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:ae07eda36dd25f8a1b98dfbf587313b99c0190bb Expected:ae07eda36dd25f8a1b98dfbf587313b99c0190bb} RuncCommit:{ID:v1.1.12-0-g51d5e94 Expected:v1.1.12-0-g51d5e94} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=seccomp,profile=unconfined name

=cgroupns] ProductLicense: Warnings:[WARNING: daemon is not using the default seccomp profile] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/Users/jenkins/.docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-buildx] ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.12.1-desktop.4] map[Name:compose Path:/Users/jenkins/.docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-compose] ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.24.5-desktop.1] map[Name:debug Path:/Users/jenkins/.docker/cli-plugins/docker-debug SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-debug] ShortDescription:Get a shell into any image or container. Vendor:Docker Inc. Version:0.0.24] map[Name:dev Path:/Users/jenkins/.docker/cli-plugins/docker-dev SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-dev] ShortDescription:Docker D

ev Environments Vendor:Docker Inc. Version:v0.1.0] map[Name:extension Path:/Users/jenkins/.docker/cli-plugins/docker-extension SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-extension] ShortDescription:Manages Docker extensions Vendor:Docker Inc. Version:v0.2.21] map[Name:feedback Path:/Users/jenkins/.docker/cli-plugins/docker-feedback SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-feedback] ShortDescription:Provide feedback, right in your terminal! Vendor:Docker Inc. Version:v1.0.4] map[Name:init Path:/Users/jenkins/.docker/cli-plugins/docker-init SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-init] ShortDescription:Creates Docker-related starter files for your project Vendor:Docker Inc. Version:v1.0.0] map[Name:sbom Path:/Users/jenkins/.docker/cli-plugins/docker-sbom SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-sbom] ShortDescription:View the packaged-based Software Bill Of Materials (SBOM)

for an image URL:https://github.com/docker/sbom-cli-plugin Vendor:Anchore Inc. Version:0.6.0] map[Err:failed to fetch metadata: fork/exec /Users/jenkins/.docker/cli-plugins/docker-scan: no such file or directory Name:scan Path:/Users/jenkins/.docker/cli-plugins/docker-scan] map[Name:scout Path:/Users/jenkins/.docker/cli-plugins/docker-scout SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-scout] ShortDescription:Docker Scout Vendor:Docker Inc. Version:v1.4.1]] Warnings:<nil>}}

	I0229 09:52:18.787176    4284 out.go:177] * Using the docker driver based on user configuration

	I0229 09:52:18.810043    4284 start.go:299] selected driver: docker

	I0229 09:52:18.810072    4284 start.go:903] validating driver "docker" against <nil>

	I0229 09:52:18.810086    4284 start.go:914] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}

	I0229 09:52:18.814529    4284 cli_runner.go:164] Run: docker system info --format "{{json .}}"

	I0229 09:52:18.918657    4284 info.go:266] docker info: {ID:37b3081a-8cd6-457e-b2a4-79dc82345b06 Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:2 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:59 OomKillDisable:false NGoroutines:108 SystemTime:2024-02-29 17:52:18.908892533 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:26 KernelVersion:6.6.12-linuxkit OperatingSystem:Docker Desktop OSType:linux Architecture:x86_64 IndexServerAddress:

https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:12 MemTotal:6213292032 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy:http.docker.internal:3128 HTTPSProxy:http.docker.internal:3128 NoProxy:hubproxy.docker.internal Name:docker-desktop Labels:[] ExperimentalBuild:false ServerVersion:25.0.3 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:ae07eda36dd25f8a1b98dfbf587313b99c0190bb Expected:ae07eda36dd25f8a1b98dfbf587313b99c0190bb} RuncCommit:{ID:v1.1.12-0-g51d5e94 Expected:v1.1.12-0-g51d5e94} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=seccomp,profile=unconfined name

=cgroupns] ProductLicense: Warnings:[WARNING: daemon is not using the default seccomp profile] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/Users/jenkins/.docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-buildx] ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.12.1-desktop.4] map[Name:compose Path:/Users/jenkins/.docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-compose] ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.24.5-desktop.1] map[Name:debug Path:/Users/jenkins/.docker/cli-plugins/docker-debug SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-debug] ShortDescription:Get a shell into any image or container. Vendor:Docker Inc. Version:0.0.24] map[Name:dev Path:/Users/jenkins/.docker/cli-plugins/docker-dev SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-dev] ShortDescription:Docker D

ev Environments Vendor:Docker Inc. Version:v0.1.0] map[Name:extension Path:/Users/jenkins/.docker/cli-plugins/docker-extension SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-extension] ShortDescription:Manages Docker extensions Vendor:Docker Inc. Version:v0.2.21] map[Name:feedback Path:/Users/jenkins/.docker/cli-plugins/docker-feedback SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-feedback] ShortDescription:Provide feedback, right in your terminal! Vendor:Docker Inc. Version:v1.0.4] map[Name:init Path:/Users/jenkins/.docker/cli-plugins/docker-init SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-init] ShortDescription:Creates Docker-related starter files for your project Vendor:Docker Inc. Version:v1.0.0] map[Name:sbom Path:/Users/jenkins/.docker/cli-plugins/docker-sbom SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-sbom] ShortDescription:View the packaged-based Software Bill Of Materials (SBOM)

for an image URL:https://github.com/docker/sbom-cli-plugin Vendor:Anchore Inc. Version:0.6.0] map[Err:failed to fetch metadata: fork/exec /Users/jenkins/.docker/cli-plugins/docker-scan: no such file or directory Name:scan Path:/Users/jenkins/.docker/cli-plugins/docker-scan] map[Name:scout Path:/Users/jenkins/.docker/cli-plugins/docker-scout SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-scout] ShortDescription:Docker Scout Vendor:Docker Inc. Version:v1.4.1]] Warnings:<nil>}}

	I0229 09:52:18.918844    4284 start_flags.go:309] no existing cluster config was found, will generate one from the flags 

	I0229 09:52:18.919020    4284 start_flags.go:931] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]

	I0229 09:52:18.940164    4284 out.go:177] * Using Docker Desktop driver with root privileges

	I0229 09:52:18.962931    4284 cni.go:84] Creating CNI manager for ""

	I0229 09:52:18.962973    4284 cni.go:162] CNI unnecessary in this configuration, recommending no CNI

	I0229 09:52:18.962995    4284 start_flags.go:323] config:

	{Name:ingress-addon-legacy-580000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:4096 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.18.20 ClusterName:ingress-addon-legacy-580000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.lo

cal ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I0229 09:52:18.985034    4284 out.go:177] * Starting control plane node ingress-addon-legacy-580000 in cluster ingress-addon-legacy-580000

	I0229 09:52:19.026912    4284 cache.go:121] Beginning downloading kic base image for docker with docker

	I0229 09:52:19.048194    4284 out.go:177] * Pulling base image v0.0.42-1708944392-18244 ...

	I0229 09:52:19.089989    4284 preload.go:132] Checking if preload exists for k8s version v1.18.20 and runtime docker

	I0229 09:52:19.090047    4284 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 in local docker daemon

	I0229 09:52:19.141107    4284 image.go:83] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 in local docker daemon, skipping pull

	I0229 09:52:19.141134    4284 cache.go:144] gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 exists in daemon, skipping load

	I0229 09:52:19.365234    4284 preload.go:119] Found remote preload: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.18.20/preloaded-images-k8s-v18-v1.18.20-docker-overlay2-amd64.tar.lz4

	I0229 09:52:19.365273    4284 cache.go:56] Caching tarball of preloaded images

	I0229 09:52:19.365717    4284 preload.go:132] Checking if preload exists for k8s version v1.18.20 and runtime docker

	I0229 09:52:19.388128    4284 out.go:177] * Downloading Kubernetes v1.18.20 preload ...

	I0229 09:52:19.429884    4284 preload.go:238] getting checksum for preloaded-images-k8s-v18-v1.18.20-docker-overlay2-amd64.tar.lz4 ...

	I0229 09:52:20.283291    4284 download.go:107] Downloading: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.18.20/preloaded-images-k8s-v18-v1.18.20-docker-overlay2-amd64.tar.lz4?checksum=md5:ff35f06d4f6c0bac9297b8f85d8ebf70 -> /Users/jenkins/minikube-integration/18259-932/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.18.20-docker-overlay2-amd64.tar.lz4

	I0229 09:52:37.533355    4284 preload.go:249] saving checksum for preloaded-images-k8s-v18-v1.18.20-docker-overlay2-amd64.tar.lz4 ...

	I0229 09:52:37.533540    4284 preload.go:256] verifying checksum of /Users/jenkins/minikube-integration/18259-932/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.18.20-docker-overlay2-amd64.tar.lz4 ...

	I0229 09:52:38.122765    4284 cache.go:59] Finished verifying existence of preloaded tar for  v1.18.20 on docker

	I0229 09:52:38.123108    4284 profile.go:148] Saving config to /Users/jenkins/minikube-integration/18259-932/.minikube/profiles/ingress-addon-legacy-580000/config.json ...

	I0229 09:52:38.123134    4284 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/18259-932/.minikube/profiles/ingress-addon-legacy-580000/config.json: {Name:mkb698ace82b02e0cbd37f0f3d203dc7e7239d6d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0229 09:52:38.123457    4284 cache.go:194] Successfully downloaded all kic artifacts

	I0229 09:52:38.123494    4284 start.go:365] acquiring machines lock for ingress-addon-legacy-580000: {Name:mkc47562a5cd3ce238135af49ecddd700caa3fa3 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0229 09:52:38.123583    4284 start.go:369] acquired machines lock for "ingress-addon-legacy-580000" in 81.645µs

	I0229 09:52:38.123604    4284 start.go:93] Provisioning new machine with config: &{Name:ingress-addon-legacy-580000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:4096 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.18.20 ClusterName:ingress-addon-legacy-580000 Namespace:defau

lt APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.18.20 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOp

timizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.18.20 ContainerRuntime:docker ControlPlane:true Worker:true}

	I0229 09:52:38.123647    4284 start.go:125] createHost starting for "" (driver="docker")

	I0229 09:52:38.145015    4284 out.go:204] * Creating docker container (CPUs=2, Memory=4096MB) ...

	I0229 09:52:38.145244    4284 start.go:159] libmachine.API.Create for "ingress-addon-legacy-580000" (driver="docker")

	I0229 09:52:38.145272    4284 client.go:168] LocalClient.Create starting

	I0229 09:52:38.145388    4284 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18259-932/.minikube/certs/ca.pem

	I0229 09:52:38.145443    4284 main.go:141] libmachine: Decoding PEM data...

	I0229 09:52:38.145459    4284 main.go:141] libmachine: Parsing certificate...

	I0229 09:52:38.145515    4284 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18259-932/.minikube/certs/cert.pem

	I0229 09:52:38.145555    4284 main.go:141] libmachine: Decoding PEM data...

	I0229 09:52:38.145562    4284 main.go:141] libmachine: Parsing certificate...

	I0229 09:52:38.166587    4284 cli_runner.go:164] Run: docker network inspect ingress-addon-legacy-580000 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"

	W0229 09:52:38.220101    4284 cli_runner.go:211] docker network inspect ingress-addon-legacy-580000 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1

	I0229 09:52:38.220221    4284 network_create.go:281] running [docker network inspect ingress-addon-legacy-580000] to gather additional debugging logs...

	I0229 09:52:38.220239    4284 cli_runner.go:164] Run: docker network inspect ingress-addon-legacy-580000

	W0229 09:52:38.270439    4284 cli_runner.go:211] docker network inspect ingress-addon-legacy-580000 returned with exit code 1

	I0229 09:52:38.270484    4284 network_create.go:284] error running [docker network inspect ingress-addon-legacy-580000]: docker network inspect ingress-addon-legacy-580000: exit status 1

	stdout:

	[]

	stderr:

	Error response from daemon: network ingress-addon-legacy-580000 not found

	I0229 09:52:38.270500    4284 network_create.go:286] output of [docker network inspect ingress-addon-legacy-580000]: -- stdout --

	[]

	-- /stdout --

	** stderr ** 

	Error response from daemon: network ingress-addon-legacy-580000 not found

	** /stderr **

	I0229 09:52:38.270650    4284 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"

	I0229 09:52:38.322076    4284 network.go:207] using free private subnet 192.168.49.0/24: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc0021b1050}

	I0229 09:52:38.343078    4284 network_create.go:124] attempt to create docker network ingress-addon-legacy-580000 192.168.49.0/24 with gateway 192.168.49.1 and MTU of 65535 ...

	I0229 09:52:38.343265    4284 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.49.0/24 --gateway=192.168.49.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=65535 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=ingress-addon-legacy-580000 ingress-addon-legacy-580000

	I0229 09:52:38.430221    4284 network_create.go:108] docker network ingress-addon-legacy-580000 192.168.49.0/24 created

	I0229 09:52:38.430265    4284 kic.go:121] calculated static IP "192.168.49.2" for the "ingress-addon-legacy-580000" container

	I0229 09:52:38.430396    4284 cli_runner.go:164] Run: docker ps -a --format {{.Names}}

	I0229 09:52:38.481103    4284 cli_runner.go:164] Run: docker volume create ingress-addon-legacy-580000 --label name.minikube.sigs.k8s.io=ingress-addon-legacy-580000 --label created_by.minikube.sigs.k8s.io=true

	I0229 09:52:38.534908    4284 oci.go:103] Successfully created a docker volume ingress-addon-legacy-580000

	I0229 09:52:38.535031    4284 cli_runner.go:164] Run: docker run --rm --name ingress-addon-legacy-580000-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=ingress-addon-legacy-580000 --entrypoint /usr/bin/test -v ingress-addon-legacy-580000:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 -d /var/lib

	I0229 09:52:38.952753    4284 oci.go:107] Successfully prepared a docker volume ingress-addon-legacy-580000

	I0229 09:52:38.952793    4284 preload.go:132] Checking if preload exists for k8s version v1.18.20 and runtime docker

	I0229 09:52:38.952806    4284 kic.go:194] Starting extracting preloaded images to volume ...

	I0229 09:52:38.952913    4284 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v /Users/jenkins/minikube-integration/18259-932/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.18.20-docker-overlay2-amd64.tar.lz4:/preloaded.tar:ro -v ingress-addon-legacy-580000:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 -I lz4 -xf /preloaded.tar -C /extractDir

	I0229 09:52:41.382306    4284 cli_runner.go:217] Completed: docker run --rm --entrypoint /usr/bin/tar -v /Users/jenkins/minikube-integration/18259-932/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.18.20-docker-overlay2-amd64.tar.lz4:/preloaded.tar:ro -v ingress-addon-legacy-580000:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 -I lz4 -xf /preloaded.tar -C /extractDir: (2.429359552s)

	I0229 09:52:41.382337    4284 kic.go:203] duration metric: took 2.429563 seconds to extract preloaded images to volume

	I0229 09:52:41.382465    4284 cli_runner.go:164] Run: docker info --format "'{{json .SecurityOptions}}'"

	I0229 09:52:41.488118    4284 cli_runner.go:164] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname ingress-addon-legacy-580000 --name ingress-addon-legacy-580000 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=ingress-addon-legacy-580000 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=ingress-addon-legacy-580000 --network ingress-addon-legacy-580000 --ip 192.168.49.2 --volume ingress-addon-legacy-580000:/var --security-opt apparmor=unconfined --memory=4096mb --memory-swap=4096mb --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08

	I0229 09:52:41.766132    4284 cli_runner.go:164] Run: docker container inspect ingress-addon-legacy-580000 --format={{.State.Running}}

	I0229 09:52:41.821307    4284 cli_runner.go:164] Run: docker container inspect ingress-addon-legacy-580000 --format={{.State.Status}}

	I0229 09:52:41.880128    4284 cli_runner.go:164] Run: docker exec ingress-addon-legacy-580000 stat /var/lib/dpkg/alternatives/iptables

	I0229 09:52:41.990596    4284 oci.go:144] the created container "ingress-addon-legacy-580000" has a running status.

	I0229 09:52:41.990648    4284 kic.go:225] Creating ssh key for kic: /Users/jenkins/minikube-integration/18259-932/.minikube/machines/ingress-addon-legacy-580000/id_rsa...

	I0229 09:52:42.091938    4284 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/18259-932/.minikube/machines/ingress-addon-legacy-580000/id_rsa.pub -> /home/docker/.ssh/authorized_keys

	I0229 09:52:42.092009    4284 kic_runner.go:191] docker (temp): /Users/jenkins/minikube-integration/18259-932/.minikube/machines/ingress-addon-legacy-580000/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)

	I0229 09:52:42.180266    4284 cli_runner.go:164] Run: docker container inspect ingress-addon-legacy-580000 --format={{.State.Status}}

	I0229 09:52:42.237802    4284 kic_runner.go:93] Run: chown docker:docker /home/docker/.ssh/authorized_keys

	I0229 09:52:42.237829    4284 kic_runner.go:114] Args: [docker exec --privileged ingress-addon-legacy-580000 chown docker:docker /home/docker/.ssh/authorized_keys]

	I0229 09:52:42.396150    4284 cli_runner.go:164] Run: docker container inspect ingress-addon-legacy-580000 --format={{.State.Status}}

	I0229 09:52:42.450228    4284 machine.go:88] provisioning docker machine ...

	I0229 09:52:42.450274    4284 ubuntu.go:169] provisioning hostname "ingress-addon-legacy-580000"

	I0229 09:52:42.450395    4284 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ingress-addon-legacy-580000

	I0229 09:52:42.503024    4284 main.go:141] libmachine: Using SSH client type: native

	I0229 09:52:42.503240    4284 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0xf830920] 0xf833680 <nil>  [] 0s} 127.0.0.1 50583 <nil> <nil>}

	I0229 09:52:42.503255    4284 main.go:141] libmachine: About to run SSH command:

	sudo hostname ingress-addon-legacy-580000 && echo "ingress-addon-legacy-580000" | sudo tee /etc/hostname

	I0229 09:52:42.645999    4284 main.go:141] libmachine: SSH cmd err, output: <nil>: ingress-addon-legacy-580000

	I0229 09:52:42.646091    4284 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ingress-addon-legacy-580000

	I0229 09:52:42.697926    4284 main.go:141] libmachine: Using SSH client type: native

	I0229 09:52:42.698101    4284 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0xf830920] 0xf833680 <nil>  [] 0s} 127.0.0.1 50583 <nil> <nil>}

	I0229 09:52:42.698117    4284 main.go:141] libmachine: About to run SSH command:

			if ! grep -xq '.*\singress-addon-legacy-580000' /etc/hosts; then

				if grep -xq '127.0.1.1\s.*' /etc/hosts; then

					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 ingress-addon-legacy-580000/g' /etc/hosts;

				else 

					echo '127.0.1.1 ingress-addon-legacy-580000' | sudo tee -a /etc/hosts; 

				fi

			fi

	I0229 09:52:42.817487    4284 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I0229 09:52:42.817510    4284 ubuntu.go:175] set auth options {CertDir:/Users/jenkins/minikube-integration/18259-932/.minikube CaCertPath:/Users/jenkins/minikube-integration/18259-932/.minikube/certs/ca.pem CaPrivateKeyPath:/Users/jenkins/minikube-integration/18259-932/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/Users/jenkins/minikube-integration/18259-932/.minikube/machines/server.pem ServerKeyPath:/Users/jenkins/minikube-integration/18259-932/.minikube/machines/server-key.pem ClientKeyPath:/Users/jenkins/minikube-integration/18259-932/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/Users/jenkins/minikube-integration/18259-932/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/Users/jenkins/minikube-integration/18259-932/.minikube}

	I0229 09:52:42.817529    4284 ubuntu.go:177] setting up certificates

	I0229 09:52:42.817539    4284 provision.go:83] configureAuth start

	I0229 09:52:42.817615    4284 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ingress-addon-legacy-580000

	I0229 09:52:42.869323    4284 provision.go:138] copyHostCerts

	I0229 09:52:42.869368    4284 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/18259-932/.minikube/certs/ca.pem -> /Users/jenkins/minikube-integration/18259-932/.minikube/ca.pem

	I0229 09:52:42.869421    4284 exec_runner.go:144] found /Users/jenkins/minikube-integration/18259-932/.minikube/ca.pem, removing ...

	I0229 09:52:42.869439    4284 exec_runner.go:203] rm: /Users/jenkins/minikube-integration/18259-932/.minikube/ca.pem

	I0229 09:52:42.869563    4284 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/18259-932/.minikube/certs/ca.pem --> /Users/jenkins/minikube-integration/18259-932/.minikube/ca.pem (1078 bytes)

	I0229 09:52:42.869763    4284 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/18259-932/.minikube/certs/cert.pem -> /Users/jenkins/minikube-integration/18259-932/.minikube/cert.pem

	I0229 09:52:42.869791    4284 exec_runner.go:144] found /Users/jenkins/minikube-integration/18259-932/.minikube/cert.pem, removing ...

	I0229 09:52:42.869796    4284 exec_runner.go:203] rm: /Users/jenkins/minikube-integration/18259-932/.minikube/cert.pem

	I0229 09:52:42.869906    4284 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/18259-932/.minikube/certs/cert.pem --> /Users/jenkins/minikube-integration/18259-932/.minikube/cert.pem (1123 bytes)

	I0229 09:52:42.870078    4284 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/18259-932/.minikube/certs/key.pem -> /Users/jenkins/minikube-integration/18259-932/.minikube/key.pem

	I0229 09:52:42.870117    4284 exec_runner.go:144] found /Users/jenkins/minikube-integration/18259-932/.minikube/key.pem, removing ...

	I0229 09:52:42.870122    4284 exec_runner.go:203] rm: /Users/jenkins/minikube-integration/18259-932/.minikube/key.pem

	I0229 09:52:42.870199    4284 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/18259-932/.minikube/certs/key.pem --> /Users/jenkins/minikube-integration/18259-932/.minikube/key.pem (1679 bytes)

	I0229 09:52:42.870352    4284 provision.go:112] generating server cert: /Users/jenkins/minikube-integration/18259-932/.minikube/machines/server.pem ca-key=/Users/jenkins/minikube-integration/18259-932/.minikube/certs/ca.pem private-key=/Users/jenkins/minikube-integration/18259-932/.minikube/certs/ca-key.pem org=jenkins.ingress-addon-legacy-580000 san=[192.168.49.2 127.0.0.1 localhost 127.0.0.1 minikube ingress-addon-legacy-580000]

	I0229 09:52:42.990657    4284 provision.go:172] copyRemoteCerts

	I0229 09:52:42.990711    4284 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker

	I0229 09:52:42.990769    4284 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ingress-addon-legacy-580000

	I0229 09:52:43.043906    4284 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:50583 SSHKeyPath:/Users/jenkins/minikube-integration/18259-932/.minikube/machines/ingress-addon-legacy-580000/id_rsa Username:docker}

	I0229 09:52:43.138107    4284 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/18259-932/.minikube/certs/ca.pem -> /etc/docker/ca.pem

	I0229 09:52:43.138179    4284 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/18259-932/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)

	I0229 09:52:43.178036    4284 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/18259-932/.minikube/machines/server.pem -> /etc/docker/server.pem

	I0229 09:52:43.178203    4284 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/18259-932/.minikube/machines/server.pem --> /etc/docker/server.pem (1253 bytes)

	I0229 09:52:43.218061    4284 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/18259-932/.minikube/machines/server-key.pem -> /etc/docker/server-key.pem

	I0229 09:52:43.218191    4284 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/18259-932/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)

	I0229 09:52:43.257283    4284 provision.go:86] duration metric: configureAuth took 439.734658ms

	I0229 09:52:43.257299    4284 ubuntu.go:193] setting minikube options for container-runtime

	I0229 09:52:43.257507    4284 config.go:182] Loaded profile config "ingress-addon-legacy-580000": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.18.20

	I0229 09:52:43.257621    4284 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ingress-addon-legacy-580000

	I0229 09:52:43.310516    4284 main.go:141] libmachine: Using SSH client type: native

	I0229 09:52:43.310726    4284 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0xf830920] 0xf833680 <nil>  [] 0s} 127.0.0.1 50583 <nil> <nil>}

	I0229 09:52:43.310742    4284 main.go:141] libmachine: About to run SSH command:

	df --output=fstype / | tail -n 1

	I0229 09:52:43.430263    4284 main.go:141] libmachine: SSH cmd err, output: <nil>: overlay

	I0229 09:52:43.430278    4284 ubuntu.go:71] root file system type: overlay

	I0229 09:52:43.430370    4284 provision.go:309] Updating docker unit: /lib/systemd/system/docker.service ...

	I0229 09:52:43.430448    4284 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ingress-addon-legacy-580000

	I0229 09:52:43.482064    4284 main.go:141] libmachine: Using SSH client type: native

	I0229 09:52:43.482243    4284 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0xf830920] 0xf833680 <nil>  [] 0s} 127.0.0.1 50583 <nil> <nil>}

	I0229 09:52:43.482291    4284 main.go:141] libmachine: About to run SSH command:

	sudo mkdir -p /lib/systemd/system && printf %s "[Unit]

	Description=Docker Application Container Engine

	Documentation=https://docs.docker.com

	BindsTo=containerd.service

	After=network-online.target firewalld.service containerd.service

	Wants=network-online.target

	Requires=docker.socket

	StartLimitBurst=3

	StartLimitIntervalSec=60

	[Service]

	Type=notify

	Restart=on-failure

	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	# The base configuration already specifies an 'ExecStart=...' command. The first directive

	# here is to clear out that command inherited from the base configuration. Without this,

	# the command from the base configuration and the command specified here are treated as

	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	# will catch this invalid input and refuse to start the service with an error like:

	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	ExecStart=

	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12 

	ExecReload=/bin/kill -s HUP \$MAINPID

	# Having non-zero Limit*s causes performance problems due to accounting overhead

	# in the kernel. We recommend using cgroups to do container-local accounting.

	LimitNOFILE=infinity

	LimitNPROC=infinity

	LimitCORE=infinity

	# Uncomment TasksMax if your systemd version supports it.

	# Only systemd 226 and above support this version.

	TasksMax=infinity

	TimeoutStartSec=0

	# set delegate yes so that systemd does not reset the cgroups of docker containers

	Delegate=yes

	# kill only the docker process, not all processes in the cgroup

	KillMode=process

	[Install]

	WantedBy=multi-user.target

	" | sudo tee /lib/systemd/system/docker.service.new

	I0229 09:52:43.623360    4284 main.go:141] libmachine: SSH cmd err, output: <nil>: [Unit]

	Description=Docker Application Container Engine

	Documentation=https://docs.docker.com

	BindsTo=containerd.service

	After=network-online.target firewalld.service containerd.service

	Wants=network-online.target

	Requires=docker.socket

	StartLimitBurst=3

	StartLimitIntervalSec=60

	[Service]

	Type=notify

	Restart=on-failure

	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	# The base configuration already specifies an 'ExecStart=...' command. The first directive

	# here is to clear out that command inherited from the base configuration. Without this,

	# the command from the base configuration and the command specified here are treated as

	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	# will catch this invalid input and refuse to start the service with an error like:

	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	ExecStart=

	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12 

	ExecReload=/bin/kill -s HUP $MAINPID

	# Having non-zero Limit*s causes performance problems due to accounting overhead

	# in the kernel. We recommend using cgroups to do container-local accounting.

	LimitNOFILE=infinity

	LimitNPROC=infinity

	LimitCORE=infinity

	# Uncomment TasksMax if your systemd version supports it.

	# Only systemd 226 and above support this version.

	TasksMax=infinity

	TimeoutStartSec=0

	# set delegate yes so that systemd does not reset the cgroups of docker containers

	Delegate=yes

	# kill only the docker process, not all processes in the cgroup

	KillMode=process

	[Install]

	WantedBy=multi-user.target

	I0229 09:52:43.623466    4284 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ingress-addon-legacy-580000

	I0229 09:52:43.676067    4284 main.go:141] libmachine: Using SSH client type: native

	I0229 09:52:43.676259    4284 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0xf830920] 0xf833680 <nil>  [] 0s} 127.0.0.1 50583 <nil> <nil>}

	I0229 09:52:43.676274    4284 main.go:141] libmachine: About to run SSH command:

	sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }

	I0229 09:52:44.299803    4284 main.go:141] libmachine: SSH cmd err, output: <nil>: --- /lib/systemd/system/docker.service	2024-02-06 21:12:51.000000000 +0000

	+++ /lib/systemd/system/docker.service.new	2024-02-29 17:52:43.618924679 +0000

	@@ -1,46 +1,49 @@

	 [Unit]

	 Description=Docker Application Container Engine

	 Documentation=https://docs.docker.com

	-After=network-online.target docker.socket firewalld.service containerd.service time-set.target

	-Wants=network-online.target containerd.service

	+BindsTo=containerd.service

	+After=network-online.target firewalld.service containerd.service

	+Wants=network-online.target

	 Requires=docker.socket

	+StartLimitBurst=3

	+StartLimitIntervalSec=60

	 [Service]

	 Type=notify

	-# the default is not to use systemd for cgroups because the delegate issues still

	-# exists and systemd currently does not support the cgroup feature set required

	-# for containers run by docker

	-ExecStart=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock

	-ExecReload=/bin/kill -s HUP $MAINPID

	-TimeoutStartSec=0

	-RestartSec=2

	-Restart=always

	+Restart=on-failure

	-# Note that StartLimit* options were moved from "Service" to "Unit" in systemd 229.

	-# Both the old, and new location are accepted by systemd 229 and up, so using the old location

	-# to make them work for either version of systemd.

	-StartLimitBurst=3

	-# Note that StartLimitInterval was renamed to StartLimitIntervalSec in systemd 230.

	-# Both the old, and new name are accepted by systemd 230 and up, so using the old name to make

	-# this option work for either version of systemd.

	-StartLimitInterval=60s

	+

	+# This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	+# The base configuration already specifies an 'ExecStart=...' command. The first directive

	+# here is to clear out that command inherited from the base configuration. Without this,

	+# the command from the base configuration and the command specified here are treated as

	+# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	+# will catch this invalid input and refuse to start the service with an error like:

	+#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	+

	+# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	+# container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	+ExecStart=

	+ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12 

	+ExecReload=/bin/kill -s HUP $MAINPID

	 # Having non-zero Limit*s causes performance problems due to accounting overhead

	 # in the kernel. We recommend using cgroups to do container-local accounting.

	+LimitNOFILE=infinity

	 LimitNPROC=infinity

	 LimitCORE=infinity

	-# Comment TasksMax if your systemd version does not support it.

	-# Only systemd 226 and above support this option.

	+# Uncomment TasksMax if your systemd version supports it.

	+# Only systemd 226 and above support this version.

	 TasksMax=infinity

	+TimeoutStartSec=0

	 # set delegate yes so that systemd does not reset the cgroups of docker containers

	 Delegate=yes

	 # kill only the docker process, not all processes in the cgroup

	 KillMode=process

	-OOMScoreAdjust=-500

	 [Install]

	 WantedBy=multi-user.target

	Synchronizing state of docker.service with SysV service script with /lib/systemd/systemd-sysv-install.

	Executing: /lib/systemd/systemd-sysv-install enable docker

	I0229 09:52:44.299828    4284 machine.go:91] provisioned docker machine in 1.849601782s

	I0229 09:52:44.299843    4284 client.go:171] LocalClient.Create took 6.154644733s

	I0229 09:52:44.299863    4284 start.go:167] duration metric: libmachine.API.Create for "ingress-addon-legacy-580000" took 6.154705718s

	I0229 09:52:44.299873    4284 start.go:300] post-start starting for "ingress-addon-legacy-580000" (driver="docker")

	I0229 09:52:44.299880    4284 start.go:329] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]

	I0229 09:52:44.300000    4284 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs

	I0229 09:52:44.300052    4284 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ingress-addon-legacy-580000

	I0229 09:52:44.353425    4284 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:50583 SSHKeyPath:/Users/jenkins/minikube-integration/18259-932/.minikube/machines/ingress-addon-legacy-580000/id_rsa Username:docker}

	I0229 09:52:44.448181    4284 ssh_runner.go:195] Run: cat /etc/os-release

	I0229 09:52:44.452208    4284 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found

	I0229 09:52:44.452233    4284 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found

	I0229 09:52:44.452240    4284 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found

	I0229 09:52:44.452245    4284 info.go:137] Remote host: Ubuntu 22.04.3 LTS

	I0229 09:52:44.452255    4284 filesync.go:126] Scanning /Users/jenkins/minikube-integration/18259-932/.minikube/addons for local assets ...

	I0229 09:52:44.452349    4284 filesync.go:126] Scanning /Users/jenkins/minikube-integration/18259-932/.minikube/files for local assets ...

	I0229 09:52:44.452557    4284 filesync.go:149] local asset: /Users/jenkins/minikube-integration/18259-932/.minikube/files/etc/ssl/certs/14082.pem -> 14082.pem in /etc/ssl/certs

	I0229 09:52:44.452563    4284 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/18259-932/.minikube/files/etc/ssl/certs/14082.pem -> /etc/ssl/certs/14082.pem

	I0229 09:52:44.452829    4284 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs

	I0229 09:52:44.467643    4284 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/18259-932/.minikube/files/etc/ssl/certs/14082.pem --> /etc/ssl/certs/14082.pem (1708 bytes)

	I0229 09:52:44.507423    4284 start.go:303] post-start completed in 207.521873ms

	I0229 09:52:44.508176    4284 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ingress-addon-legacy-580000

	I0229 09:52:44.560788    4284 profile.go:148] Saving config to /Users/jenkins/minikube-integration/18259-932/.minikube/profiles/ingress-addon-legacy-580000/config.json ...

	I0229 09:52:44.561246    4284 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0229 09:52:44.561300    4284 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ingress-addon-legacy-580000

	I0229 09:52:44.614265    4284 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:50583 SSHKeyPath:/Users/jenkins/minikube-integration/18259-932/.minikube/machines/ingress-addon-legacy-580000/id_rsa Username:docker}

	I0229 09:52:44.698556    4284 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"

	I0229 09:52:44.703530    4284 start.go:128] duration metric: createHost completed in 6.579963844s

	I0229 09:52:44.703547    4284 start.go:83] releasing machines lock for "ingress-addon-legacy-580000", held for 6.580048541s

	I0229 09:52:44.703634    4284 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ingress-addon-legacy-580000

	I0229 09:52:44.755247    4284 ssh_runner.go:195] Run: cat /version.json

	I0229 09:52:44.755278    4284 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/

	I0229 09:52:44.755323    4284 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ingress-addon-legacy-580000

	I0229 09:52:44.755360    4284 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ingress-addon-legacy-580000

	I0229 09:52:44.812409    4284 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:50583 SSHKeyPath:/Users/jenkins/minikube-integration/18259-932/.minikube/machines/ingress-addon-legacy-580000/id_rsa Username:docker}

	I0229 09:52:44.812409    4284 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:50583 SSHKeyPath:/Users/jenkins/minikube-integration/18259-932/.minikube/machines/ingress-addon-legacy-580000/id_rsa Username:docker}

	I0229 09:52:44.991098    4284 ssh_runner.go:195] Run: systemctl --version

	I0229 09:52:44.995920    4284 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"

	I0229 09:52:45.000998    4284 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "grep -q loopback {} && ( grep -q name {} || sudo sed -i '/"type": "loopback"/i \ \ \ \ "name": "loopback",' {} ) && sudo sed -i 's|"cniVersion": ".*"|"cniVersion": "1.0.0"|g' {}" ;

	I0229 09:52:45.042081    4284 cni.go:230] loopback cni configuration patched: "/etc/cni/net.d/*loopback.conf*" found

	I0229 09:52:45.042183    4284 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *bridge* -not -name *podman* -not -name *.mk_disabled -printf "%p, " -exec sh -c "sudo sed -i -r -e '/"dst": ".*:.*"/d' -e 's|^(.*)"dst": (.*)[,*]$|\1"dst": \2|g' -e '/"subnet": ".*:.*"/d' -e 's|^(.*)"subnet": ".*"(.*)[,*]$|\1"subnet": "10.244.0.0/16"\2|g' {}" ;

	I0229 09:52:45.070951    4284 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *podman* -not -name *.mk_disabled -printf "%p, " -exec sh -c "sudo sed -i -r -e 's|^(.*)"subnet": ".*"(.*)$|\1"subnet": "10.244.0.0/16"\2|g' -e 's|^(.*)"gateway": ".*"(.*)$|\1"gateway": "10.244.0.1"\2|g' {}" ;

	I0229 09:52:45.099623    4284 cni.go:308] configured [/etc/cni/net.d/100-crio-bridge.conf, /etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)

	I0229 09:52:45.099638    4284 start.go:475] detecting cgroup driver to use...

	I0229 09:52:45.099655    4284 detect.go:196] detected "cgroupfs" cgroup driver on host os

	I0229 09:52:45.099808    4284 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///run/containerd/containerd.sock

	" | sudo tee /etc/crictl.yaml"

	I0229 09:52:45.128830    4284 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.2"|' /etc/containerd/config.toml"

	I0229 09:52:45.145070    4284 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"

	I0229 09:52:45.161190    4284 containerd.go:146] configuring containerd to use "cgroupfs" as cgroup driver...

	I0229 09:52:45.161302    4284 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"

	I0229 09:52:45.177605    4284 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"

	I0229 09:52:45.193657    4284 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"

	I0229 09:52:45.209640    4284 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"

	I0229 09:52:45.226119    4284 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"

	I0229 09:52:45.242453    4284 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"

	I0229 09:52:45.259339    4284 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables

	I0229 09:52:45.274164    4284 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"

	I0229 09:52:45.288510    4284 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0229 09:52:45.352585    4284 ssh_runner.go:195] Run: sudo systemctl restart containerd

	I0229 09:52:45.450147    4284 start.go:475] detecting cgroup driver to use...

	I0229 09:52:45.450167    4284 detect.go:196] detected "cgroupfs" cgroup driver on host os

	I0229 09:52:45.450264    4284 ssh_runner.go:195] Run: sudo systemctl cat docker.service

	I0229 09:52:45.478918    4284 cruntime.go:279] skipping containerd shutdown because we are bound to it

	I0229 09:52:45.478993    4284 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio

	I0229 09:52:45.498675    4284 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/dockershim.sock

	" | sudo tee /etc/crictl.yaml"

	I0229 09:52:45.528673    4284 ssh_runner.go:195] Run: which cri-dockerd

	I0229 09:52:45.533316    4284 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/cri-docker.service.d

	I0229 09:52:45.550401    4284 ssh_runner.go:362] scp memory --> /etc/systemd/system/cri-docker.service.d/10-cni.conf (189 bytes)

	I0229 09:52:45.580374    4284 ssh_runner.go:195] Run: sudo systemctl unmask docker.service

	I0229 09:52:45.676639    4284 ssh_runner.go:195] Run: sudo systemctl enable docker.socket

	I0229 09:52:45.745744    4284 docker.go:574] configuring docker to use "cgroupfs" as cgroup driver...

	I0229 09:52:45.745938    4284 ssh_runner.go:362] scp memory --> /etc/docker/daemon.json (130 bytes)

	I0229 09:52:45.775115    4284 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0229 09:52:45.838595    4284 ssh_runner.go:195] Run: sudo systemctl restart docker

	I0229 09:52:46.087335    4284 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}

	I0229 09:52:46.109384    4284 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}

	I0229 09:52:46.176078    4284 out.go:204] * Preparing Kubernetes v1.18.20 on Docker 25.0.3 ...

	I0229 09:52:46.176170    4284 cli_runner.go:164] Run: docker exec -t ingress-addon-legacy-580000 dig +short host.docker.internal

	I0229 09:52:46.290934    4284 network.go:96] got host ip for mount in container by digging dns: 192.168.65.254

	I0229 09:52:46.291041    4284 ssh_runner.go:195] Run: grep 192.168.65.254	host.minikube.internal$ /etc/hosts

	I0229 09:52:46.295568    4284 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.65.254	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0229 09:52:46.314567    4284 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "8443/tcp") 0).HostPort}}'" ingress-addon-legacy-580000

	I0229 09:52:46.367306    4284 preload.go:132] Checking if preload exists for k8s version v1.18.20 and runtime docker

	I0229 09:52:46.367382    4284 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}

	I0229 09:52:46.384611    4284 docker.go:685] Got preloaded images: -- stdout --

	k8s.gcr.io/kube-proxy:v1.18.20

	k8s.gcr.io/kube-apiserver:v1.18.20

	k8s.gcr.io/kube-scheduler:v1.18.20

	k8s.gcr.io/kube-controller-manager:v1.18.20

	gcr.io/k8s-minikube/storage-provisioner:v5

	k8s.gcr.io/pause:3.2

	k8s.gcr.io/coredns:1.6.7

	k8s.gcr.io/etcd:3.4.3-0

	-- /stdout --

	I0229 09:52:46.384626    4284 docker.go:691] registry.k8s.io/kube-apiserver:v1.18.20 wasn't preloaded

	I0229 09:52:46.384686    4284 ssh_runner.go:195] Run: sudo cat /var/lib/docker/image/overlay2/repositories.json

	I0229 09:52:46.399632    4284 ssh_runner.go:195] Run: which lz4

	I0229 09:52:46.404077    4284 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/18259-932/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.18.20-docker-overlay2-amd64.tar.lz4 -> /preloaded.tar.lz4

	I0229 09:52:46.404199    4284 ssh_runner.go:195] Run: stat -c "%s %y" /preloaded.tar.lz4

	I0229 09:52:46.408244    4284 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%s %y" /preloaded.tar.lz4: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/preloaded.tar.lz4': No such file or directory

	I0229 09:52:46.408265    4284 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/18259-932/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.18.20-docker-overlay2-amd64.tar.lz4 --> /preloaded.tar.lz4 (424164442 bytes)

	I0229 09:52:53.250053    4284 docker.go:649] Took 6.846002 seconds to copy over tarball

	I0229 09:52:53.250188    4284 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4

	I0229 09:52:54.966128    4284 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (1.715927175s)

	I0229 09:52:54.966145    4284 ssh_runner.go:146] rm: /preloaded.tar.lz4

	I0229 09:52:55.021717    4284 ssh_runner.go:195] Run: sudo cat /var/lib/docker/image/overlay2/repositories.json

	I0229 09:52:55.038113    4284 ssh_runner.go:362] scp memory --> /var/lib/docker/image/overlay2/repositories.json (2502 bytes)

	I0229 09:52:55.066175    4284 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0229 09:52:55.128518    4284 ssh_runner.go:195] Run: sudo systemctl restart docker

	I0229 09:52:56.123260    4284 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}

	I0229 09:52:56.141728    4284 docker.go:685] Got preloaded images: -- stdout --

	k8s.gcr.io/kube-proxy:v1.18.20

	k8s.gcr.io/kube-apiserver:v1.18.20

	k8s.gcr.io/kube-scheduler:v1.18.20

	k8s.gcr.io/kube-controller-manager:v1.18.20

	gcr.io/k8s-minikube/storage-provisioner:v5

	k8s.gcr.io/pause:3.2

	k8s.gcr.io/coredns:1.6.7

	k8s.gcr.io/etcd:3.4.3-0

	-- /stdout --

	I0229 09:52:56.141741    4284 docker.go:691] registry.k8s.io/kube-apiserver:v1.18.20 wasn't preloaded

	I0229 09:52:56.141756    4284 cache_images.go:88] LoadImages start: [registry.k8s.io/kube-apiserver:v1.18.20 registry.k8s.io/kube-controller-manager:v1.18.20 registry.k8s.io/kube-scheduler:v1.18.20 registry.k8s.io/kube-proxy:v1.18.20 registry.k8s.io/pause:3.2 registry.k8s.io/etcd:3.4.3-0 registry.k8s.io/coredns:1.6.7 gcr.io/k8s-minikube/storage-provisioner:v5]

	I0229 09:52:56.147974    4284 image.go:134] retrieving image: registry.k8s.io/pause:3.2

	I0229 09:52:56.147982    4284 image.go:134] retrieving image: registry.k8s.io/kube-apiserver:v1.18.20

	I0229 09:52:56.148006    4284 image.go:134] retrieving image: registry.k8s.io/coredns:1.6.7

	I0229 09:52:56.148167    4284 image.go:134] retrieving image: registry.k8s.io/kube-controller-manager:v1.18.20

	I0229 09:52:56.148273    4284 image.go:134] retrieving image: registry.k8s.io/etcd:3.4.3-0

	I0229 09:52:56.148719    4284 image.go:134] retrieving image: registry.k8s.io/kube-scheduler:v1.18.20

	I0229 09:52:56.149287    4284 image.go:134] retrieving image: registry.k8s.io/kube-proxy:v1.18.20

	I0229 09:52:56.149568    4284 image.go:134] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v5

	I0229 09:52:56.153031    4284 image.go:177] daemon lookup for registry.k8s.io/pause:3.2: Error response from daemon: No such image: registry.k8s.io/pause:3.2

	I0229 09:52:56.153133    4284 image.go:177] daemon lookup for registry.k8s.io/coredns:1.6.7: Error response from daemon: No such image: registry.k8s.io/coredns:1.6.7

	I0229 09:52:56.154135    4284 image.go:177] daemon lookup for registry.k8s.io/etcd:3.4.3-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.4.3-0

	I0229 09:52:56.154700    4284 image.go:177] daemon lookup for registry.k8s.io/kube-scheduler:v1.18.20: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.18.20

	I0229 09:52:56.154929    4284 image.go:177] daemon lookup for registry.k8s.io/kube-proxy:v1.18.20: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.18.20

	I0229 09:52:56.155258    4284 image.go:177] daemon lookup for registry.k8s.io/kube-apiserver:v1.18.20: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.18.20

	I0229 09:52:56.155360    4284 image.go:177] daemon lookup for gcr.io/k8s-minikube/storage-provisioner:v5: Error response from daemon: No such image: gcr.io/k8s-minikube/storage-provisioner:v5

	I0229 09:52:56.155357    4284 image.go:177] daemon lookup for registry.k8s.io/kube-controller-manager:v1.18.20: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.18.20

	I0229 09:52:58.036267    4284 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/kube-proxy:v1.18.20

	I0229 09:52:58.054263    4284 cache_images.go:116] "registry.k8s.io/kube-proxy:v1.18.20" needs transfer: "registry.k8s.io/kube-proxy:v1.18.20" does not exist at hash "27f8b8d51985f755cfb3ffea424fa34865cc0da63e99378d8202f923c3c5a8ba" in container runtime

	I0229 09:52:58.054308    4284 docker.go:337] Removing image: registry.k8s.io/kube-proxy:v1.18.20

	I0229 09:52:58.054374    4284 ssh_runner.go:195] Run: docker rmi registry.k8s.io/kube-proxy:v1.18.20

	I0229 09:52:58.072245    4284 cache_images.go:286] Loading image from: /Users/jenkins/minikube-integration/18259-932/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.18.20

	I0229 09:52:58.126693    4284 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/etcd:3.4.3-0

	I0229 09:52:58.143545    4284 cache_images.go:116] "registry.k8s.io/etcd:3.4.3-0" needs transfer: "registry.k8s.io/etcd:3.4.3-0" does not exist at hash "303ce5db0e90dab1c5728ec70d21091201a23cdf8aeca70ab54943bbaaf0833f" in container runtime

	I0229 09:52:58.143593    4284 docker.go:337] Removing image: registry.k8s.io/etcd:3.4.3-0

	I0229 09:52:58.143657    4284 ssh_runner.go:195] Run: docker rmi registry.k8s.io/etcd:3.4.3-0

	I0229 09:52:58.159800    4284 cache_images.go:286] Loading image from: /Users/jenkins/minikube-integration/18259-932/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.4.3-0

	I0229 09:52:58.164372    4284 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/kube-scheduler:v1.18.20

	I0229 09:52:58.169454    4284 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/pause:3.2

	I0229 09:52:58.173294    4284 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/kube-apiserver:v1.18.20

	I0229 09:52:58.182680    4284 cache_images.go:116] "registry.k8s.io/kube-scheduler:v1.18.20" needs transfer: "registry.k8s.io/kube-scheduler:v1.18.20" does not exist at hash "a05a1a79adaad058478b7638d2e73cf408b283305081516fbe02706b0e205346" in container runtime

	I0229 09:52:58.182728    4284 docker.go:337] Removing image: registry.k8s.io/kube-scheduler:v1.18.20

	I0229 09:52:58.182808    4284 ssh_runner.go:195] Run: docker rmi registry.k8s.io/kube-scheduler:v1.18.20

	I0229 09:52:58.186926    4284 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/kube-controller-manager:v1.18.20

	I0229 09:52:58.189546    4284 cache_images.go:116] "registry.k8s.io/pause:3.2" needs transfer: "registry.k8s.io/pause:3.2" does not exist at hash "80d28bedfe5dec59da9ebf8e6260224ac9008ab5c11dbbe16ee3ba3e4439ac2c" in container runtime

	I0229 09:52:58.189583    4284 docker.go:337] Removing image: registry.k8s.io/pause:3.2

	I0229 09:52:58.189653    4284 ssh_runner.go:195] Run: docker rmi registry.k8s.io/pause:3.2

	I0229 09:52:58.194737    4284 cache_images.go:116] "registry.k8s.io/kube-apiserver:v1.18.20" needs transfer: "registry.k8s.io/kube-apiserver:v1.18.20" does not exist at hash "7d8d2960de69688eab5698081441539a1662f47e092488973e455a8334955cb1" in container runtime

	I0229 09:52:58.194774    4284 docker.go:337] Removing image: registry.k8s.io/kube-apiserver:v1.18.20

	I0229 09:52:58.194853    4284 ssh_runner.go:195] Run: docker rmi registry.k8s.io/kube-apiserver:v1.18.20

	I0229 09:52:58.195370    4284 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/coredns:1.6.7

	I0229 09:52:58.205179    4284 cache_images.go:286] Loading image from: /Users/jenkins/minikube-integration/18259-932/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.18.20

	I0229 09:52:58.210420    4284 cache_images.go:116] "registry.k8s.io/kube-controller-manager:v1.18.20" needs transfer: "registry.k8s.io/kube-controller-manager:v1.18.20" does not exist at hash "e7c545a60706cf009a893afdc7dba900cc2e342b8042b9c421d607ca41e8b290" in container runtime

	I0229 09:52:58.210455    4284 docker.go:337] Removing image: registry.k8s.io/kube-controller-manager:v1.18.20

	I0229 09:52:58.210537    4284 ssh_runner.go:195] Run: docker rmi registry.k8s.io/kube-controller-manager:v1.18.20

	I0229 09:52:58.213648    4284 cache_images.go:286] Loading image from: /Users/jenkins/minikube-integration/18259-932/.minikube/cache/images/amd64/registry.k8s.io/pause_3.2

	I0229 09:52:58.220113    4284 cache_images.go:286] Loading image from: /Users/jenkins/minikube-integration/18259-932/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.18.20

	I0229 09:52:58.220130    4284 cache_images.go:116] "registry.k8s.io/coredns:1.6.7" needs transfer: "registry.k8s.io/coredns:1.6.7" does not exist at hash "67da37a9a360e600e74464da48437257b00a754c77c40f60c65e4cb327c34bd5" in container runtime

	I0229 09:52:58.220152    4284 docker.go:337] Removing image: registry.k8s.io/coredns:1.6.7

	I0229 09:52:58.220203    4284 ssh_runner.go:195] Run: docker rmi registry.k8s.io/coredns:1.6.7

	I0229 09:52:58.280892    4284 cache_images.go:286] Loading image from: /Users/jenkins/minikube-integration/18259-932/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.18.20

	I0229 09:52:58.286010    4284 cache_images.go:286] Loading image from: /Users/jenkins/minikube-integration/18259-932/.minikube/cache/images/amd64/registry.k8s.io/coredns_1.6.7

	I0229 09:52:59.021128    4284 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} gcr.io/k8s-minikube/storage-provisioner:v5

	I0229 09:52:59.039022    4284 cache_images.go:92] LoadImages completed in 2.89729383s

	W0229 09:52:59.039071    4284 out.go:239] X Unable to load cached images: loading cached images: stat /Users/jenkins/minikube-integration/18259-932/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.18.20: no such file or directory

	X Unable to load cached images: loading cached images: stat /Users/jenkins/minikube-integration/18259-932/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.18.20: no such file or directory

	I0229 09:52:59.039149    4284 ssh_runner.go:195] Run: docker info --format {{.CgroupDriver}}

	I0229 09:52:59.086630    4284 cni.go:84] Creating CNI manager for ""

	I0229 09:52:59.086650    4284 cni.go:162] CNI unnecessary in this configuration, recommending no CNI

	I0229 09:52:59.086660    4284 kubeadm.go:87] Using pod CIDR: 10.244.0.0/16

	I0229 09:52:59.086682    4284 kubeadm.go:176] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.49.2 APIServerPort:8443 KubernetesVersion:v1.18.20 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:ingress-addon-legacy-580000 NodeName:ingress-addon-legacy-580000 DNSDomain:cluster.local CRISocket:/var/run/dockershim.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.49.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.49.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.

crt StaticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}

	I0229 09:52:59.086771    4284 kubeadm.go:181] kubeadm config:

	apiVersion: kubeadm.k8s.io/v1beta2

	kind: InitConfiguration

	localAPIEndpoint:

	  advertiseAddress: 192.168.49.2

	  bindPort: 8443

	bootstrapTokens:

	  - groups:

	      - system:bootstrappers:kubeadm:default-node-token

	    ttl: 24h0m0s

	    usages:

	      - signing

	      - authentication

	nodeRegistration:

	  criSocket: /var/run/dockershim.sock

	  name: "ingress-addon-legacy-580000"

	  kubeletExtraArgs:

	    node-ip: 192.168.49.2

	  taints: []

	---

	apiVersion: kubeadm.k8s.io/v1beta2

	kind: ClusterConfiguration

	apiServer:

	  certSANs: ["127.0.0.1", "localhost", "192.168.49.2"]

	  extraArgs:

	    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"

	controllerManager:

	  extraArgs:

	    allocate-node-cidrs: "true"

	    leader-elect: "false"

	scheduler:

	  extraArgs:

	    leader-elect: "false"

	certificatesDir: /var/lib/minikube/certs

	clusterName: mk

	controlPlaneEndpoint: control-plane.minikube.internal:8443

	dns:

	  type: CoreDNS

	etcd:

	  local:

	    dataDir: /var/lib/minikube/etcd

	    extraArgs:

	      proxy-refresh-interval: "70000"

	kubernetesVersion: v1.18.20

	networking:

	  dnsDomain: cluster.local

	  podSubnet: "10.244.0.0/16"

	  serviceSubnet: 10.96.0.0/12

	---

	apiVersion: kubelet.config.k8s.io/v1beta1

	kind: KubeletConfiguration

	authentication:

	  x509:

	    clientCAFile: /var/lib/minikube/certs/ca.crt

	cgroupDriver: cgroupfs

	hairpinMode: hairpin-veth

	runtimeRequestTimeout: 15m

	clusterDomain: "cluster.local"

	# disable disk resource management by default

	imageGCHighThresholdPercent: 100

	evictionHard:

	  nodefs.available: "0%"

	  nodefs.inodesFree: "0%"

	  imagefs.available: "0%"

	failSwapOn: false

	staticPodPath: /etc/kubernetes/manifests

	---

	apiVersion: kubeproxy.config.k8s.io/v1alpha1

	kind: KubeProxyConfiguration

	clusterCIDR: "10.244.0.0/16"

	metricsBindAddress: 0.0.0.0:10249

	conntrack:

	  maxPerCore: 0

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"

	  tcpEstablishedTimeout: 0s

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"

	  tcpCloseWaitTimeout: 0s

	I0229 09:52:59.086821    4284 kubeadm.go:976] kubelet [Unit]

	Wants=docker.socket

	[Service]

	ExecStart=

	ExecStart=/var/lib/minikube/binaries/v1.18.20/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=docker --hostname-override=ingress-addon-legacy-580000 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.49.2

	[Install]

	 config:

	{KubernetesVersion:v1.18.20 ClusterName:ingress-addon-legacy-580000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:}

	I0229 09:52:59.086887    4284 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.18.20

	I0229 09:52:59.101829    4284 binaries.go:44] Found k8s binaries, skipping transfer

	I0229 09:52:59.101891    4284 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube

	I0229 09:52:59.116561    4284 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (354 bytes)

	I0229 09:52:59.144936    4284 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (353 bytes)

	I0229 09:52:59.173329    4284 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2124 bytes)

	I0229 09:52:59.201924    4284 ssh_runner.go:195] Run: grep 192.168.49.2	control-plane.minikube.internal$ /etc/hosts

	I0229 09:52:59.206355    4284 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.49.2	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0229 09:52:59.224321    4284 certs.go:56] Setting up /Users/jenkins/minikube-integration/18259-932/.minikube/profiles/ingress-addon-legacy-580000 for IP: 192.168.49.2

	I0229 09:52:59.224381    4284 certs.go:190] acquiring lock for shared ca certs: {Name:mkc9f82ec686f18428dac33e4e0986537b4ba8dc Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0229 09:52:59.224629    4284 certs.go:199] skipping minikubeCA CA generation: /Users/jenkins/minikube-integration/18259-932/.minikube/ca.key

	I0229 09:52:59.224715    4284 certs.go:199] skipping proxyClientCA CA generation: /Users/jenkins/minikube-integration/18259-932/.minikube/proxy-client-ca.key

	I0229 09:52:59.224806    4284 certs.go:319] generating minikube-user signed cert: /Users/jenkins/minikube-integration/18259-932/.minikube/profiles/ingress-addon-legacy-580000/client.key

	I0229 09:52:59.224846    4284 crypto.go:68] Generating cert /Users/jenkins/minikube-integration/18259-932/.minikube/profiles/ingress-addon-legacy-580000/client.crt with IP's: []

	I0229 09:52:59.340563    4284 crypto.go:156] Writing cert to /Users/jenkins/minikube-integration/18259-932/.minikube/profiles/ingress-addon-legacy-580000/client.crt ...

	I0229 09:52:59.340575    4284 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/18259-932/.minikube/profiles/ingress-addon-legacy-580000/client.crt: {Name:mk36382e26f18a1e5853f5edd7abc3f79a1d8f09 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0229 09:52:59.340903    4284 crypto.go:164] Writing key to /Users/jenkins/minikube-integration/18259-932/.minikube/profiles/ingress-addon-legacy-580000/client.key ...

	I0229 09:52:59.340912    4284 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/18259-932/.minikube/profiles/ingress-addon-legacy-580000/client.key: {Name:mk8627c4b09b2cd30f327c0b1bc2d642e6f2937e Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0229 09:52:59.341144    4284 certs.go:319] generating minikube signed cert: /Users/jenkins/minikube-integration/18259-932/.minikube/profiles/ingress-addon-legacy-580000/apiserver.key.dd3b5fb2

	I0229 09:52:59.341159    4284 crypto.go:68] Generating cert /Users/jenkins/minikube-integration/18259-932/.minikube/profiles/ingress-addon-legacy-580000/apiserver.crt.dd3b5fb2 with IP's: [192.168.49.2 10.96.0.1 127.0.0.1 10.0.0.1]

	I0229 09:52:59.478875    4284 crypto.go:156] Writing cert to /Users/jenkins/minikube-integration/18259-932/.minikube/profiles/ingress-addon-legacy-580000/apiserver.crt.dd3b5fb2 ...

	I0229 09:52:59.478888    4284 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/18259-932/.minikube/profiles/ingress-addon-legacy-580000/apiserver.crt.dd3b5fb2: {Name:mke46730a9b6d328be1071abfc94c25ecc23ddf3 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0229 09:52:59.479187    4284 crypto.go:164] Writing key to /Users/jenkins/minikube-integration/18259-932/.minikube/profiles/ingress-addon-legacy-580000/apiserver.key.dd3b5fb2 ...

	I0229 09:52:59.479197    4284 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/18259-932/.minikube/profiles/ingress-addon-legacy-580000/apiserver.key.dd3b5fb2: {Name:mk97fcdfb856f27477086a52d38e652dd1258d04 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0229 09:52:59.479418    4284 certs.go:337] copying /Users/jenkins/minikube-integration/18259-932/.minikube/profiles/ingress-addon-legacy-580000/apiserver.crt.dd3b5fb2 -> /Users/jenkins/minikube-integration/18259-932/.minikube/profiles/ingress-addon-legacy-580000/apiserver.crt

	I0229 09:52:59.479619    4284 certs.go:341] copying /Users/jenkins/minikube-integration/18259-932/.minikube/profiles/ingress-addon-legacy-580000/apiserver.key.dd3b5fb2 -> /Users/jenkins/minikube-integration/18259-932/.minikube/profiles/ingress-addon-legacy-580000/apiserver.key

	I0229 09:52:59.479787    4284 certs.go:319] generating aggregator signed cert: /Users/jenkins/minikube-integration/18259-932/.minikube/profiles/ingress-addon-legacy-580000/proxy-client.key

	I0229 09:52:59.479812    4284 crypto.go:68] Generating cert /Users/jenkins/minikube-integration/18259-932/.minikube/profiles/ingress-addon-legacy-580000/proxy-client.crt with IP's: []

	I0229 09:52:59.675296    4284 crypto.go:156] Writing cert to /Users/jenkins/minikube-integration/18259-932/.minikube/profiles/ingress-addon-legacy-580000/proxy-client.crt ...

	I0229 09:52:59.675311    4284 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/18259-932/.minikube/profiles/ingress-addon-legacy-580000/proxy-client.crt: {Name:mkb1364b74da002210639fbd93d534a54288c32a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0229 09:52:59.675624    4284 crypto.go:164] Writing key to /Users/jenkins/minikube-integration/18259-932/.minikube/profiles/ingress-addon-legacy-580000/proxy-client.key ...

	I0229 09:52:59.675636    4284 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/18259-932/.minikube/profiles/ingress-addon-legacy-580000/proxy-client.key: {Name:mk37d2f1edd31692ca4a60b3e8c0d5d3cdfcfed0 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0229 09:52:59.675843    4284 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/18259-932/.minikube/profiles/ingress-addon-legacy-580000/apiserver.crt -> /var/lib/minikube/certs/apiserver.crt

	I0229 09:52:59.675873    4284 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/18259-932/.minikube/profiles/ingress-addon-legacy-580000/apiserver.key -> /var/lib/minikube/certs/apiserver.key

	I0229 09:52:59.675891    4284 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/18259-932/.minikube/profiles/ingress-addon-legacy-580000/proxy-client.crt -> /var/lib/minikube/certs/proxy-client.crt

	I0229 09:52:59.675907    4284 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/18259-932/.minikube/profiles/ingress-addon-legacy-580000/proxy-client.key -> /var/lib/minikube/certs/proxy-client.key

	I0229 09:52:59.675924    4284 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/18259-932/.minikube/ca.crt -> /var/lib/minikube/certs/ca.crt

	I0229 09:52:59.675940    4284 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/18259-932/.minikube/ca.key -> /var/lib/minikube/certs/ca.key

	I0229 09:52:59.675959    4284 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/18259-932/.minikube/proxy-client-ca.crt -> /var/lib/minikube/certs/proxy-client-ca.crt

	I0229 09:52:59.675974    4284 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/18259-932/.minikube/proxy-client-ca.key -> /var/lib/minikube/certs/proxy-client-ca.key

	I0229 09:52:59.676058    4284 certs.go:437] found cert: /Users/jenkins/minikube-integration/18259-932/.minikube/certs/Users/jenkins/minikube-integration/18259-932/.minikube/certs/1408.pem (1338 bytes)

	W0229 09:52:59.676114    4284 certs.go:433] ignoring /Users/jenkins/minikube-integration/18259-932/.minikube/certs/Users/jenkins/minikube-integration/18259-932/.minikube/certs/1408_empty.pem, impossibly tiny 0 bytes

	I0229 09:52:59.676123    4284 certs.go:437] found cert: /Users/jenkins/minikube-integration/18259-932/.minikube/certs/Users/jenkins/minikube-integration/18259-932/.minikube/certs/ca-key.pem (1675 bytes)

	I0229 09:52:59.676159    4284 certs.go:437] found cert: /Users/jenkins/minikube-integration/18259-932/.minikube/certs/Users/jenkins/minikube-integration/18259-932/.minikube/certs/ca.pem (1078 bytes)

	I0229 09:52:59.676191    4284 certs.go:437] found cert: /Users/jenkins/minikube-integration/18259-932/.minikube/certs/Users/jenkins/minikube-integration/18259-932/.minikube/certs/cert.pem (1123 bytes)

	I0229 09:52:59.676217    4284 certs.go:437] found cert: /Users/jenkins/minikube-integration/18259-932/.minikube/certs/Users/jenkins/minikube-integration/18259-932/.minikube/certs/key.pem (1679 bytes)

	I0229 09:52:59.676285    4284 certs.go:437] found cert: /Users/jenkins/minikube-integration/18259-932/.minikube/files/etc/ssl/certs/Users/jenkins/minikube-integration/18259-932/.minikube/files/etc/ssl/certs/14082.pem (1708 bytes)

	I0229 09:52:59.676316    4284 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/18259-932/.minikube/ca.crt -> /usr/share/ca-certificates/minikubeCA.pem

	I0229 09:52:59.676333    4284 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/18259-932/.minikube/certs/1408.pem -> /usr/share/ca-certificates/1408.pem

	I0229 09:52:59.676348    4284 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/18259-932/.minikube/files/etc/ssl/certs/14082.pem -> /usr/share/ca-certificates/14082.pem

	I0229 09:52:59.676795    4284 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/18259-932/.minikube/profiles/ingress-addon-legacy-580000/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1399 bytes)

	I0229 09:52:59.718310    4284 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/18259-932/.minikube/profiles/ingress-addon-legacy-580000/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)

	I0229 09:52:59.758487    4284 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/18259-932/.minikube/profiles/ingress-addon-legacy-580000/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)

	I0229 09:52:59.799915    4284 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/18259-932/.minikube/profiles/ingress-addon-legacy-580000/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)

	I0229 09:52:59.841041    4284 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/18259-932/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)

	I0229 09:52:59.882287    4284 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/18259-932/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)

	I0229 09:52:59.922453    4284 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/18259-932/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)

	I0229 09:52:59.962961    4284 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/18259-932/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)

	I0229 09:53:00.004228    4284 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/18259-932/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)

	I0229 09:53:00.045982    4284 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/18259-932/.minikube/certs/1408.pem --> /usr/share/ca-certificates/1408.pem (1338 bytes)

	I0229 09:53:00.086625    4284 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/18259-932/.minikube/files/etc/ssl/certs/14082.pem --> /usr/share/ca-certificates/14082.pem (1708 bytes)

	I0229 09:53:00.127904    4284 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)

	I0229 09:53:00.158432    4284 ssh_runner.go:195] Run: openssl version

	I0229 09:53:00.164341    4284 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"

	I0229 09:53:00.179971    4284 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem

	I0229 09:53:00.184234    4284 certs.go:480] hashing: -rw-r--r-- 1 root root 1111 Feb 29 17:39 /usr/share/ca-certificates/minikubeCA.pem

	I0229 09:53:00.184285    4284 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem

	I0229 09:53:00.190853    4284 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"

	I0229 09:53:00.206980    4284 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/1408.pem && ln -fs /usr/share/ca-certificates/1408.pem /etc/ssl/certs/1408.pem"

	I0229 09:53:00.222913    4284 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/1408.pem

	I0229 09:53:00.227082    4284 certs.go:480] hashing: -rw-r--r-- 1 root root 1338 Feb 29 17:47 /usr/share/ca-certificates/1408.pem

	I0229 09:53:00.227126    4284 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/1408.pem

	I0229 09:53:00.233728    4284 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/1408.pem /etc/ssl/certs/51391683.0"

	I0229 09:53:00.249033    4284 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/14082.pem && ln -fs /usr/share/ca-certificates/14082.pem /etc/ssl/certs/14082.pem"

	I0229 09:53:00.264826    4284 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/14082.pem

	I0229 09:53:00.269718    4284 certs.go:480] hashing: -rw-r--r-- 1 root root 1708 Feb 29 17:47 /usr/share/ca-certificates/14082.pem

	I0229 09:53:00.269782    4284 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/14082.pem

	I0229 09:53:00.276438    4284 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/14082.pem /etc/ssl/certs/3ec20f2e.0"

	I0229 09:53:00.292077    4284 ssh_runner.go:195] Run: ls /var/lib/minikube/certs/etcd

	I0229 09:53:00.296612    4284 certs.go:353] certs directory doesn't exist, likely first start: ls /var/lib/minikube/certs/etcd: Process exited with status 2

	stdout:

	stderr:

	ls: cannot access '/var/lib/minikube/certs/etcd': No such file or directory

	I0229 09:53:00.296657    4284 kubeadm.go:404] StartCluster: {Name:ingress-addon-legacy-580000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:4096 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.18.20 ClusterName:ingress-addon-legacy-580000 Namespace:default APIServerName:minik

ubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.18.20 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimization

s:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I0229 09:53:00.296757    4284 ssh_runner.go:195] Run: docker ps --filter status=paused --filter=name=k8s_.*_(kube-system)_ --format={{.ID}}

	I0229 09:53:00.313804    4284 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd

	I0229 09:53:00.328786    4284 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml

	I0229 09:53:00.343870    4284 kubeadm.go:226] ignoring SystemVerification for kubeadm because of docker driver

	I0229 09:53:00.343935    4284 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf

	I0229 09:53:00.358290    4284 kubeadm.go:152] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2

	stdout:

	stderr:

	ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory

	I0229 09:53:00.358328    4284 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.18.20:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"

	I0229 09:53:00.419131    4284 kubeadm.go:322] [init] Using Kubernetes version: v1.18.20

	I0229 09:53:00.419241    4284 kubeadm.go:322] [preflight] Running pre-flight checks

	I0229 09:53:00.691514    4284 kubeadm.go:322] [preflight] Pulling images required for setting up a Kubernetes cluster

	I0229 09:53:00.691610    4284 kubeadm.go:322] [preflight] This might take a minute or two, depending on the speed of your internet connection

	I0229 09:53:00.691711    4284 kubeadm.go:322] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'

	I0229 09:53:00.849537    4284 kubeadm.go:322] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"

	I0229 09:53:00.850230    4284 kubeadm.go:322] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"

	I0229 09:53:00.850277    4284 kubeadm.go:322] [kubelet-start] Starting the kubelet

	I0229 09:53:00.924140    4284 kubeadm.go:322] [certs] Using certificateDir folder "/var/lib/minikube/certs"

	I0229 09:53:00.946032    4284 out.go:204]   - Generating certificates and keys ...

	I0229 09:53:00.946114    4284 kubeadm.go:322] [certs] Using existing ca certificate authority

	I0229 09:53:00.946180    4284 kubeadm.go:322] [certs] Using existing apiserver certificate and key on disk

	I0229 09:53:01.224632    4284 kubeadm.go:322] [certs] Generating "apiserver-kubelet-client" certificate and key

	I0229 09:53:01.383990    4284 kubeadm.go:322] [certs] Generating "front-proxy-ca" certificate and key

	I0229 09:53:01.528270    4284 kubeadm.go:322] [certs] Generating "front-proxy-client" certificate and key

	I0229 09:53:01.576626    4284 kubeadm.go:322] [certs] Generating "etcd/ca" certificate and key

	I0229 09:53:01.679419    4284 kubeadm.go:322] [certs] Generating "etcd/server" certificate and key

	I0229 09:53:01.679635    4284 kubeadm.go:322] [certs] etcd/server serving cert is signed for DNS names [ingress-addon-legacy-580000 localhost] and IPs [192.168.49.2 127.0.0.1 ::1]

	I0229 09:53:01.828401    4284 kubeadm.go:322] [certs] Generating "etcd/peer" certificate and key

	I0229 09:53:01.828624    4284 kubeadm.go:322] [certs] etcd/peer serving cert is signed for DNS names [ingress-addon-legacy-580000 localhost] and IPs [192.168.49.2 127.0.0.1 ::1]

	I0229 09:53:01.987581    4284 kubeadm.go:322] [certs] Generating "etcd/healthcheck-client" certificate and key

	I0229 09:53:02.148010    4284 kubeadm.go:322] [certs] Generating "apiserver-etcd-client" certificate and key

	I0229 09:53:02.404069    4284 kubeadm.go:322] [certs] Generating "sa" key and public key

	I0229 09:53:02.404163    4284 kubeadm.go:322] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"

	I0229 09:53:02.521784    4284 kubeadm.go:322] [kubeconfig] Writing "admin.conf" kubeconfig file

	I0229 09:53:02.671056    4284 kubeadm.go:322] [kubeconfig] Writing "kubelet.conf" kubeconfig file

	I0229 09:53:02.971237    4284 kubeadm.go:322] [kubeconfig] Writing "controller-manager.conf" kubeconfig file

	I0229 09:53:03.239898    4284 kubeadm.go:322] [kubeconfig] Writing "scheduler.conf" kubeconfig file

	I0229 09:53:03.240501    4284 kubeadm.go:322] [control-plane] Using manifest folder "/etc/kubernetes/manifests"

	I0229 09:53:03.262271    4284 out.go:204]   - Booting up control plane ...

	I0229 09:53:03.262427    4284 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-apiserver"

	I0229 09:53:03.262542    4284 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-controller-manager"

	I0229 09:53:03.262651    4284 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-scheduler"

	I0229 09:53:03.262792    4284 kubeadm.go:322] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"

	I0229 09:53:03.263035    4284 kubeadm.go:322] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s

	I0229 09:53:43.250395    4284 kubeadm.go:322] [kubelet-check] Initial timeout of 40s passed.

	I0229 09:53:43.250715    4284 kubeadm.go:322] [kubelet-check] It seems like the kubelet isn't running or healthy.

	I0229 09:53:43.250917    4284 kubeadm.go:322] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.

	I0229 09:53:48.252882    4284 kubeadm.go:322] [kubelet-check] It seems like the kubelet isn't running or healthy.

	I0229 09:53:48.253091    4284 kubeadm.go:322] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.

	I0229 09:53:58.255219    4284 kubeadm.go:322] [kubelet-check] It seems like the kubelet isn't running or healthy.

	I0229 09:53:58.255437    4284 kubeadm.go:322] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.

	I0229 09:54:18.256582    4284 kubeadm.go:322] [kubelet-check] It seems like the kubelet isn't running or healthy.

	I0229 09:54:18.256799    4284 kubeadm.go:322] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.

	I0229 09:54:58.258467    4284 kubeadm.go:322] [kubelet-check] It seems like the kubelet isn't running or healthy.

	I0229 09:54:58.258716    4284 kubeadm.go:322] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.

	I0229 09:54:58.258735    4284 kubeadm.go:322] 

	I0229 09:54:58.258782    4284 kubeadm.go:322] 	Unfortunately, an error has occurred:

	I0229 09:54:58.258838    4284 kubeadm.go:322] 		timed out waiting for the condition

	I0229 09:54:58.258845    4284 kubeadm.go:322] 

	I0229 09:54:58.258890    4284 kubeadm.go:322] 	This error is likely caused by:

	I0229 09:54:58.258929    4284 kubeadm.go:322] 		- The kubelet is not running

	I0229 09:54:58.259039    4284 kubeadm.go:322] 		- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)

	I0229 09:54:58.259050    4284 kubeadm.go:322] 

	I0229 09:54:58.259155    4284 kubeadm.go:322] 	If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:

	I0229 09:54:58.259189    4284 kubeadm.go:322] 		- 'systemctl status kubelet'

	I0229 09:54:58.259222    4284 kubeadm.go:322] 		- 'journalctl -xeu kubelet'

	I0229 09:54:58.259230    4284 kubeadm.go:322] 

	I0229 09:54:58.259401    4284 kubeadm.go:322] 	Additionally, a control plane component may have crashed or exited when started by the container runtime.

	I0229 09:54:58.259511    4284 kubeadm.go:322] 	To troubleshoot, list all containers using your preferred container runtimes CLI.

	I0229 09:54:58.259531    4284 kubeadm.go:322] 

	I0229 09:54:58.259628    4284 kubeadm.go:322] 	Here is one example how you may list all Kubernetes containers running in docker:

	I0229 09:54:58.259690    4284 kubeadm.go:322] 		- 'docker ps -a | grep kube | grep -v pause'

	I0229 09:54:58.259766    4284 kubeadm.go:322] 		Once you have found the failing container, you can inspect its logs with:

	I0229 09:54:58.259826    4284 kubeadm.go:322] 		- 'docker logs CONTAINERID'

	I0229 09:54:58.259871    4284 kubeadm.go:322] 

	I0229 09:54:58.263868    4284 kubeadm.go:322] W0229 17:53:00.418487    1761 configset.go:202] WARNING: kubeadm cannot validate component configs for API groups [kubelet.config.k8s.io kubeproxy.config.k8s.io]

	I0229 09:54:58.264014    4284 kubeadm.go:322] 	[WARNING IsDockerSystemdCheck]: detected "cgroupfs" as the Docker cgroup driver. The recommended driver is "systemd". Please follow the guide at https://kubernetes.io/docs/setup/cri/

	I0229 09:54:58.264091    4284 kubeadm.go:322] 	[WARNING Swap]: running with swap on is not supported. Please disable swap

	I0229 09:54:58.264223    4284 kubeadm.go:322] 	[WARNING SystemVerification]: this Docker version is not on the list of validated versions: 25.0.3. Latest validated version: 19.03

	I0229 09:54:58.264309    4284 kubeadm.go:322] 	[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'

	I0229 09:54:58.264413    4284 kubeadm.go:322] W0229 17:53:03.245462    1761 manifests.go:225] the default kube-apiserver authorization-mode is "Node,RBAC"; using "Node,RBAC"

	I0229 09:54:58.264528    4284 kubeadm.go:322] W0229 17:53:03.246257    1761 manifests.go:225] the default kube-apiserver authorization-mode is "Node,RBAC"; using "Node,RBAC"

	I0229 09:54:58.264595    4284 kubeadm.go:322] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster

	I0229 09:54:58.264660    4284 kubeadm.go:322] To see the stack trace of this error execute with --v=5 or higher

	W0229 09:54:58.264745    4284 out.go:239] ! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.18.20:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables": Process exited with status 1

	stdout:

	[init] Using Kubernetes version: v1.18.20

	[preflight] Running pre-flight checks

	[preflight] Pulling images required for setting up a Kubernetes cluster

	[preflight] This might take a minute or two, depending on the speed of your internet connection

	[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'

	[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"

	[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"

	[kubelet-start] Starting the kubelet

	[certs] Using certificateDir folder "/var/lib/minikube/certs"

	[certs] Using existing ca certificate authority

	[certs] Using existing apiserver certificate and key on disk

	[certs] Generating "apiserver-kubelet-client" certificate and key

	[certs] Generating "front-proxy-ca" certificate and key

	[certs] Generating "front-proxy-client" certificate and key

	[certs] Generating "etcd/ca" certificate and key

	[certs] Generating "etcd/server" certificate and key

	[certs] etcd/server serving cert is signed for DNS names [ingress-addon-legacy-580000 localhost] and IPs [192.168.49.2 127.0.0.1 ::1]

	[certs] Generating "etcd/peer" certificate and key

	[certs] etcd/peer serving cert is signed for DNS names [ingress-addon-legacy-580000 localhost] and IPs [192.168.49.2 127.0.0.1 ::1]

	[certs] Generating "etcd/healthcheck-client" certificate and key

	[certs] Generating "apiserver-etcd-client" certificate and key

	[certs] Generating "sa" key and public key

	[kubeconfig] Using kubeconfig folder "/etc/kubernetes"

	[kubeconfig] Writing "admin.conf" kubeconfig file

	[kubeconfig] Writing "kubelet.conf" kubeconfig file

	[kubeconfig] Writing "controller-manager.conf" kubeconfig file

	[kubeconfig] Writing "scheduler.conf" kubeconfig file

	[control-plane] Using manifest folder "/etc/kubernetes/manifests"

	[control-plane] Creating static Pod manifest for "kube-apiserver"

	[control-plane] Creating static Pod manifest for "kube-controller-manager"

	[control-plane] Creating static Pod manifest for "kube-scheduler"

	[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"

	[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s

	[kubelet-check] Initial timeout of 40s passed.

	[kubelet-check] It seems like the kubelet isn't running or healthy.

	[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.

	[kubelet-check] It seems like the kubelet isn't running or healthy.

	[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.

	[kubelet-check] It seems like the kubelet isn't running or healthy.

	[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.

	[kubelet-check] It seems like the kubelet isn't running or healthy.

	[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.

	[kubelet-check] It seems like the kubelet isn't running or healthy.

	[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.

		Unfortunately, an error has occurred:

			timed out waiting for the condition

		This error is likely caused by:

			- The kubelet is not running

			- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)

		If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:

			- 'systemctl status kubelet'

			- 'journalctl -xeu kubelet'

		Additionally, a control plane component may have crashed or exited when started by the container runtime.

		To troubleshoot, list all containers using your preferred container runtimes CLI.

		Here is one example how you may list all Kubernetes containers running in docker:

			- 'docker ps -a | grep kube | grep -v pause'

			Once you have found the failing container, you can inspect its logs with:

			- 'docker logs CONTAINERID'

	stderr:

	W0229 17:53:00.418487    1761 configset.go:202] WARNING: kubeadm cannot validate component configs for API groups [kubelet.config.k8s.io kubeproxy.config.k8s.io]

		[WARNING IsDockerSystemdCheck]: detected "cgroupfs" as the Docker cgroup driver. The recommended driver is "systemd". Please follow the guide at https://kubernetes.io/docs/setup/cri/

		[WARNING Swap]: running with swap on is not supported. Please disable swap

		[WARNING SystemVerification]: this Docker version is not on the list of validated versions: 25.0.3. Latest validated version: 19.03

		[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'

	W0229 17:53:03.245462    1761 manifests.go:225] the default kube-apiserver authorization-mode is "Node,RBAC"; using "Node,RBAC"

	W0229 17:53:03.246257    1761 manifests.go:225] the default kube-apiserver authorization-mode is "Node,RBAC"; using "Node,RBAC"

	error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster

	To see the stack trace of this error execute with --v=5 or higher

	! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.18.20:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables": Process exited with status 1

	stdout:

	[init] Using Kubernetes version: v1.18.20

	[preflight] Running pre-flight checks

	[preflight] Pulling images required for setting up a Kubernetes cluster

	[preflight] This might take a minute or two, depending on the speed of your internet connection

	[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'

	[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"

	[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"

	[kubelet-start] Starting the kubelet

	[certs] Using certificateDir folder "/var/lib/minikube/certs"

	[certs] Using existing ca certificate authority

	[certs] Using existing apiserver certificate and key on disk

	[certs] Generating "apiserver-kubelet-client" certificate and key

	[certs] Generating "front-proxy-ca" certificate and key

	[certs] Generating "front-proxy-client" certificate and key

	[certs] Generating "etcd/ca" certificate and key

	[certs] Generating "etcd/server" certificate and key

	[certs] etcd/server serving cert is signed for DNS names [ingress-addon-legacy-580000 localhost] and IPs [192.168.49.2 127.0.0.1 ::1]

	[certs] Generating "etcd/peer" certificate and key

	[certs] etcd/peer serving cert is signed for DNS names [ingress-addon-legacy-580000 localhost] and IPs [192.168.49.2 127.0.0.1 ::1]

	[certs] Generating "etcd/healthcheck-client" certificate and key

	[certs] Generating "apiserver-etcd-client" certificate and key

	[certs] Generating "sa" key and public key

	[kubeconfig] Using kubeconfig folder "/etc/kubernetes"

	[kubeconfig] Writing "admin.conf" kubeconfig file

	[kubeconfig] Writing "kubelet.conf" kubeconfig file

	[kubeconfig] Writing "controller-manager.conf" kubeconfig file

	[kubeconfig] Writing "scheduler.conf" kubeconfig file

	[control-plane] Using manifest folder "/etc/kubernetes/manifests"

	[control-plane] Creating static Pod manifest for "kube-apiserver"

	[control-plane] Creating static Pod manifest for "kube-controller-manager"

	[control-plane] Creating static Pod manifest for "kube-scheduler"

	[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"

	[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s

	[kubelet-check] Initial timeout of 40s passed.

	[kubelet-check] It seems like the kubelet isn't running or healthy.

	[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.

	[kubelet-check] It seems like the kubelet isn't running or healthy.

	[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.

	[kubelet-check] It seems like the kubelet isn't running or healthy.

	[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.

	[kubelet-check] It seems like the kubelet isn't running or healthy.

	[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.

	[kubelet-check] It seems like the kubelet isn't running or healthy.

	[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.

		Unfortunately, an error has occurred:

			timed out waiting for the condition

		This error is likely caused by:

			- The kubelet is not running

			- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)

		If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:

			- 'systemctl status kubelet'

			- 'journalctl -xeu kubelet'

		Additionally, a control plane component may have crashed or exited when started by the container runtime.

		To troubleshoot, list all containers using your preferred container runtimes CLI.

		Here is one example how you may list all Kubernetes containers running in docker:

			- 'docker ps -a | grep kube | grep -v pause'

			Once you have found the failing container, you can inspect its logs with:

			- 'docker logs CONTAINERID'

	stderr:

	W0229 17:53:00.418487    1761 configset.go:202] WARNING: kubeadm cannot validate component configs for API groups [kubelet.config.k8s.io kubeproxy.config.k8s.io]

		[WARNING IsDockerSystemdCheck]: detected "cgroupfs" as the Docker cgroup driver. The recommended driver is "systemd". Please follow the guide at https://kubernetes.io/docs/setup/cri/

		[WARNING Swap]: running with swap on is not supported. Please disable swap

		[WARNING SystemVerification]: this Docker version is not on the list of validated versions: 25.0.3. Latest validated version: 19.03

		[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'

	W0229 17:53:03.245462    1761 manifests.go:225] the default kube-apiserver authorization-mode is "Node,RBAC"; using "Node,RBAC"

	W0229 17:53:03.246257    1761 manifests.go:225] the default kube-apiserver authorization-mode is "Node,RBAC"; using "Node,RBAC"

	error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster

	To see the stack trace of this error execute with --v=5 or higher

	I0229 09:54:58.264776    4284 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.18.20:$PATH" kubeadm reset --cri-socket /var/run/dockershim.sock --force"

	I0229 09:54:58.689223    4284 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0229 09:54:58.706399    4284 kubeadm.go:226] ignoring SystemVerification for kubeadm because of docker driver

	I0229 09:54:58.706456    4284 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf

	I0229 09:54:58.721389    4284 kubeadm.go:152] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2

	stdout:

	stderr:

	ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory

	I0229 09:54:58.721413    4284 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.18.20:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"

	I0229 09:54:58.777112    4284 kubeadm.go:322] [init] Using Kubernetes version: v1.18.20

	I0229 09:54:58.777173    4284 kubeadm.go:322] [preflight] Running pre-flight checks

	I0229 09:54:59.012270    4284 kubeadm.go:322] [preflight] Pulling images required for setting up a Kubernetes cluster

	I0229 09:54:59.012364    4284 kubeadm.go:322] [preflight] This might take a minute or two, depending on the speed of your internet connection

	I0229 09:54:59.012442    4284 kubeadm.go:322] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'

	I0229 09:54:59.167021    4284 kubeadm.go:322] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"

	I0229 09:54:59.167597    4284 kubeadm.go:322] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"

	I0229 09:54:59.167637    4284 kubeadm.go:322] [kubelet-start] Starting the kubelet

	I0229 09:54:59.230109    4284 kubeadm.go:322] [certs] Using certificateDir folder "/var/lib/minikube/certs"

	I0229 09:54:59.251622    4284 out.go:204]   - Generating certificates and keys ...

	I0229 09:54:59.251692    4284 kubeadm.go:322] [certs] Using existing ca certificate authority

	I0229 09:54:59.251792    4284 kubeadm.go:322] [certs] Using existing apiserver certificate and key on disk

	I0229 09:54:59.251876    4284 kubeadm.go:322] [certs] Using existing apiserver-kubelet-client certificate and key on disk

	I0229 09:54:59.251977    4284 kubeadm.go:322] [certs] Using existing front-proxy-ca certificate authority

	I0229 09:54:59.252103    4284 kubeadm.go:322] [certs] Using existing front-proxy-client certificate and key on disk

	I0229 09:54:59.252156    4284 kubeadm.go:322] [certs] Using existing etcd/ca certificate authority

	I0229 09:54:59.252291    4284 kubeadm.go:322] [certs] Using existing etcd/server certificate and key on disk

	I0229 09:54:59.252404    4284 kubeadm.go:322] [certs] Using existing etcd/peer certificate and key on disk

	I0229 09:54:59.252501    4284 kubeadm.go:322] [certs] Using existing etcd/healthcheck-client certificate and key on disk

	I0229 09:54:59.252595    4284 kubeadm.go:322] [certs] Using existing apiserver-etcd-client certificate and key on disk

	I0229 09:54:59.252656    4284 kubeadm.go:322] [certs] Using the existing "sa" key

	I0229 09:54:59.252713    4284 kubeadm.go:322] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"

	I0229 09:54:59.456060    4284 kubeadm.go:322] [kubeconfig] Writing "admin.conf" kubeconfig file

	I0229 09:54:59.510324    4284 kubeadm.go:322] [kubeconfig] Writing "kubelet.conf" kubeconfig file

	I0229 09:54:59.921660    4284 kubeadm.go:322] [kubeconfig] Writing "controller-manager.conf" kubeconfig file

	I0229 09:55:00.115652    4284 kubeadm.go:322] [kubeconfig] Writing "scheduler.conf" kubeconfig file

	I0229 09:55:00.116357    4284 kubeadm.go:322] [control-plane] Using manifest folder "/etc/kubernetes/manifests"

	I0229 09:55:00.137958    4284 out.go:204]   - Booting up control plane ...

	I0229 09:55:00.138027    4284 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-apiserver"

	I0229 09:55:00.138084    4284 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-controller-manager"

	I0229 09:55:00.138142    4284 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-scheduler"

	I0229 09:55:00.138207    4284 kubeadm.go:322] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"

	I0229 09:55:00.138371    4284 kubeadm.go:322] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s

	I0229 09:55:40.125871    4284 kubeadm.go:322] [kubelet-check] Initial timeout of 40s passed.

	I0229 09:55:40.126679    4284 kubeadm.go:322] [kubelet-check] It seems like the kubelet isn't running or healthy.

	I0229 09:55:40.126888    4284 kubeadm.go:322] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.

	I0229 09:55:45.128193    4284 kubeadm.go:322] [kubelet-check] It seems like the kubelet isn't running or healthy.

	I0229 09:55:45.128453    4284 kubeadm.go:322] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.

	I0229 09:55:55.129853    4284 kubeadm.go:322] [kubelet-check] It seems like the kubelet isn't running or healthy.

	I0229 09:55:55.130021    4284 kubeadm.go:322] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.

	I0229 09:56:15.132685    4284 kubeadm.go:322] [kubelet-check] It seems like the kubelet isn't running or healthy.

	I0229 09:56:15.132944    4284 kubeadm.go:322] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.

	I0229 09:56:55.135187    4284 kubeadm.go:322] [kubelet-check] It seems like the kubelet isn't running or healthy.

	I0229 09:56:55.135395    4284 kubeadm.go:322] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.

	I0229 09:56:55.135404    4284 kubeadm.go:322] 

	I0229 09:56:55.135455    4284 kubeadm.go:322] 	Unfortunately, an error has occurred:

	I0229 09:56:55.135502    4284 kubeadm.go:322] 		timed out waiting for the condition

	I0229 09:56:55.135523    4284 kubeadm.go:322] 

	I0229 09:56:55.135573    4284 kubeadm.go:322] 	This error is likely caused by:

	I0229 09:56:55.135611    4284 kubeadm.go:322] 		- The kubelet is not running

	I0229 09:56:55.135721    4284 kubeadm.go:322] 		- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)

	I0229 09:56:55.135730    4284 kubeadm.go:322] 

	I0229 09:56:55.135855    4284 kubeadm.go:322] 	If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:

	I0229 09:56:55.135896    4284 kubeadm.go:322] 		- 'systemctl status kubelet'

	I0229 09:56:55.135931    4284 kubeadm.go:322] 		- 'journalctl -xeu kubelet'

	I0229 09:56:55.135939    4284 kubeadm.go:322] 

	I0229 09:56:55.136072    4284 kubeadm.go:322] 	Additionally, a control plane component may have crashed or exited when started by the container runtime.

	I0229 09:56:55.136174    4284 kubeadm.go:322] 	To troubleshoot, list all containers using your preferred container runtimes CLI.

	I0229 09:56:55.136191    4284 kubeadm.go:322] 

	I0229 09:56:55.136310    4284 kubeadm.go:322] 	Here is one example how you may list all Kubernetes containers running in docker:

	I0229 09:56:55.136365    4284 kubeadm.go:322] 		- 'docker ps -a | grep kube | grep -v pause'

	I0229 09:56:55.136454    4284 kubeadm.go:322] 		Once you have found the failing container, you can inspect its logs with:

	I0229 09:56:55.136506    4284 kubeadm.go:322] 		- 'docker logs CONTAINERID'

	I0229 09:56:55.136522    4284 kubeadm.go:322] 

	I0229 09:56:55.140609    4284 kubeadm.go:322] W0229 17:54:58.776828    4755 configset.go:202] WARNING: kubeadm cannot validate component configs for API groups [kubelet.config.k8s.io kubeproxy.config.k8s.io]

	I0229 09:56:55.140763    4284 kubeadm.go:322] 	[WARNING IsDockerSystemdCheck]: detected "cgroupfs" as the Docker cgroup driver. The recommended driver is "systemd". Please follow the guide at https://kubernetes.io/docs/setup/cri/

	I0229 09:56:55.140821    4284 kubeadm.go:322] 	[WARNING Swap]: running with swap on is not supported. Please disable swap

	I0229 09:56:55.140925    4284 kubeadm.go:322] 	[WARNING SystemVerification]: this Docker version is not on the list of validated versions: 25.0.3. Latest validated version: 19.03

	I0229 09:56:55.141011    4284 kubeadm.go:322] 	[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'

	I0229 09:56:55.141113    4284 kubeadm.go:322] W0229 17:55:00.121008    4755 manifests.go:225] the default kube-apiserver authorization-mode is "Node,RBAC"; using "Node,RBAC"

	I0229 09:56:55.141213    4284 kubeadm.go:322] W0229 17:55:00.122456    4755 manifests.go:225] the default kube-apiserver authorization-mode is "Node,RBAC"; using "Node,RBAC"

	I0229 09:56:55.141281    4284 kubeadm.go:322] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster

	I0229 09:56:55.141353    4284 kubeadm.go:322] To see the stack trace of this error execute with --v=5 or higher

	I0229 09:56:55.141384    4284 kubeadm.go:406] StartCluster complete in 3m54.848025085s

	I0229 09:56:55.141465    4284 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}

	I0229 09:56:55.157206    4284 logs.go:276] 0 containers: []

	W0229 09:56:55.157219    4284 logs.go:278] No container was found matching "kube-apiserver"

	I0229 09:56:55.157310    4284 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}

	I0229 09:56:55.173427    4284 logs.go:276] 0 containers: []

	W0229 09:56:55.173442    4284 logs.go:278] No container was found matching "etcd"

	I0229 09:56:55.173508    4284 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}

	I0229 09:56:55.190419    4284 logs.go:276] 0 containers: []

	W0229 09:56:55.190435    4284 logs.go:278] No container was found matching "coredns"

	I0229 09:56:55.190503    4284 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}

	I0229 09:56:55.207281    4284 logs.go:276] 0 containers: []

	W0229 09:56:55.207296    4284 logs.go:278] No container was found matching "kube-scheduler"

	I0229 09:56:55.207382    4284 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}

	I0229 09:56:55.224344    4284 logs.go:276] 0 containers: []

	W0229 09:56:55.224359    4284 logs.go:278] No container was found matching "kube-proxy"

	I0229 09:56:55.224423    4284 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}

	I0229 09:56:55.240205    4284 logs.go:276] 0 containers: []

	W0229 09:56:55.240224    4284 logs.go:278] No container was found matching "kube-controller-manager"

	I0229 09:56:55.240309    4284 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}

	I0229 09:56:55.256351    4284 logs.go:276] 0 containers: []

	W0229 09:56:55.256366    4284 logs.go:278] No container was found matching "kindnet"

	I0229 09:56:55.256374    4284 logs.go:123] Gathering logs for kubelet ...

	I0229 09:56:55.256381    4284 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"

	I0229 09:56:55.297606    4284 logs.go:123] Gathering logs for dmesg ...

	I0229 09:56:55.297620    4284 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"

	I0229 09:56:55.317387    4284 logs.go:123] Gathering logs for describe nodes ...

	I0229 09:56:55.317402    4284 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.18.20/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"

	W0229 09:56:55.374414    4284 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.18.20/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.18.20/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	 output: 

	** stderr ** 

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	** /stderr **

	I0229 09:56:55.374428    4284 logs.go:123] Gathering logs for Docker ...

	I0229 09:56:55.374441    4284 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"

	I0229 09:56:55.395620    4284 logs.go:123] Gathering logs for container status ...

	I0229 09:56:55.395635    4284 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"

	W0229 09:56:55.453488    4284 out.go:364] Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.18.20:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables": Process exited with status 1

	stdout:

	[init] Using Kubernetes version: v1.18.20

	[preflight] Running pre-flight checks

	[preflight] Pulling images required for setting up a Kubernetes cluster

	[preflight] This might take a minute or two, depending on the speed of your internet connection

	[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'

	[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"

	[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"

	[kubelet-start] Starting the kubelet

	[certs] Using certificateDir folder "/var/lib/minikube/certs"

	[certs] Using existing ca certificate authority

	[certs] Using existing apiserver certificate and key on disk

	[certs] Using existing apiserver-kubelet-client certificate and key on disk

	[certs] Using existing front-proxy-ca certificate authority

	[certs] Using existing front-proxy-client certificate and key on disk

	[certs] Using existing etcd/ca certificate authority

	[certs] Using existing etcd/server certificate and key on disk

	[certs] Using existing etcd/peer certificate and key on disk

	[certs] Using existing etcd/healthcheck-client certificate and key on disk

	[certs] Using existing apiserver-etcd-client certificate and key on disk

	[certs] Using the existing "sa" key

	[kubeconfig] Using kubeconfig folder "/etc/kubernetes"

	[kubeconfig] Writing "admin.conf" kubeconfig file

	[kubeconfig] Writing "kubelet.conf" kubeconfig file

	[kubeconfig] Writing "controller-manager.conf" kubeconfig file

	[kubeconfig] Writing "scheduler.conf" kubeconfig file

	[control-plane] Using manifest folder "/etc/kubernetes/manifests"

	[control-plane] Creating static Pod manifest for "kube-apiserver"

	[control-plane] Creating static Pod manifest for "kube-controller-manager"

	[control-plane] Creating static Pod manifest for "kube-scheduler"

	[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"

	[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s

	[kubelet-check] Initial timeout of 40s passed.

	[kubelet-check] It seems like the kubelet isn't running or healthy.

	[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.

	[kubelet-check] It seems like the kubelet isn't running or healthy.

	[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.

	[kubelet-check] It seems like the kubelet isn't running or healthy.

	[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.

	[kubelet-check] It seems like the kubelet isn't running or healthy.

	[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.

	[kubelet-check] It seems like the kubelet isn't running or healthy.

	[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.

		Unfortunately, an error has occurred:

			timed out waiting for the condition

		This error is likely caused by:

			- The kubelet is not running

			- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)

		If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:

			- 'systemctl status kubelet'

			- 'journalctl -xeu kubelet'

		Additionally, a control plane component may have crashed or exited when started by the container runtime.

		To troubleshoot, list all containers using your preferred container runtimes CLI.

		Here is one example how you may list all Kubernetes containers running in docker:

			- 'docker ps -a | grep kube | grep -v pause'

			Once you have found the failing container, you can inspect its logs with:

			- 'docker logs CONTAINERID'

	stderr:

	W0229 17:54:58.776828    4755 configset.go:202] WARNING: kubeadm cannot validate component configs for API groups [kubelet.config.k8s.io kubeproxy.config.k8s.io]

		[WARNING IsDockerSystemdCheck]: detected "cgroupfs" as the Docker cgroup driver. The recommended driver is "systemd". Please follow the guide at https://kubernetes.io/docs/setup/cri/

		[WARNING Swap]: running with swap on is not supported. Please disable swap

		[WARNING SystemVerification]: this Docker version is not on the list of validated versions: 25.0.3. Latest validated version: 19.03

		[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'

	W0229 17:55:00.121008    4755 manifests.go:225] the default kube-apiserver authorization-mode is "Node,RBAC"; using "Node,RBAC"

	W0229 17:55:00.122456    4755 manifests.go:225] the default kube-apiserver authorization-mode is "Node,RBAC"; using "Node,RBAC"

	error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster

	To see the stack trace of this error execute with --v=5 or higher

	W0229 09:56:55.453511    4284 out.go:239] * 

	* 

	W0229 09:56:55.453551    4284 out.go:239] X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.18.20:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables": Process exited with status 1

	stdout:

	[init] Using Kubernetes version: v1.18.20

	[preflight] Running pre-flight checks

	[preflight] Pulling images required for setting up a Kubernetes cluster

	[preflight] This might take a minute or two, depending on the speed of your internet connection

	[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'

	[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"

	[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"

	[kubelet-start] Starting the kubelet

	[certs] Using certificateDir folder "/var/lib/minikube/certs"

	[certs] Using existing ca certificate authority

	[certs] Using existing apiserver certificate and key on disk

	[certs] Using existing apiserver-kubelet-client certificate and key on disk

	[certs] Using existing front-proxy-ca certificate authority

	[certs] Using existing front-proxy-client certificate and key on disk

	[certs] Using existing etcd/ca certificate authority

	[certs] Using existing etcd/server certificate and key on disk

	[certs] Using existing etcd/peer certificate and key on disk

	[certs] Using existing etcd/healthcheck-client certificate and key on disk

	[certs] Using existing apiserver-etcd-client certificate and key on disk

	[certs] Using the existing "sa" key

	[kubeconfig] Using kubeconfig folder "/etc/kubernetes"

	[kubeconfig] Writing "admin.conf" kubeconfig file

	[kubeconfig] Writing "kubelet.conf" kubeconfig file

	[kubeconfig] Writing "controller-manager.conf" kubeconfig file

	[kubeconfig] Writing "scheduler.conf" kubeconfig file

	[control-plane] Using manifest folder "/etc/kubernetes/manifests"

	[control-plane] Creating static Pod manifest for "kube-apiserver"

	[control-plane] Creating static Pod manifest for "kube-controller-manager"

	[control-plane] Creating static Pod manifest for "kube-scheduler"

	[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"

	[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s

	[kubelet-check] Initial timeout of 40s passed.

	[kubelet-check] It seems like the kubelet isn't running or healthy.

	[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.

	[kubelet-check] It seems like the kubelet isn't running or healthy.

	[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.

	[kubelet-check] It seems like the kubelet isn't running or healthy.

	[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.

	[kubelet-check] It seems like the kubelet isn't running or healthy.

	[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.

	[kubelet-check] It seems like the kubelet isn't running or healthy.

	[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.

		Unfortunately, an error has occurred:

			timed out waiting for the condition

		This error is likely caused by:

			- The kubelet is not running

			- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)

		If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:

			- 'systemctl status kubelet'

			- 'journalctl -xeu kubelet'

		Additionally, a control plane component may have crashed or exited when started by the container runtime.

		To troubleshoot, list all containers using your preferred container runtimes CLI.

		Here is one example how you may list all Kubernetes containers running in docker:

			- 'docker ps -a | grep kube | grep -v pause'

			Once you have found the failing container, you can inspect its logs with:

			- 'docker logs CONTAINERID'

	stderr:

	W0229 17:54:58.776828    4755 configset.go:202] WARNING: kubeadm cannot validate component configs for API groups [kubelet.config.k8s.io kubeproxy.config.k8s.io]

		[WARNING IsDockerSystemdCheck]: detected "cgroupfs" as the Docker cgroup driver. The recommended driver is "systemd". Please follow the guide at https://kubernetes.io/docs/setup/cri/

		[WARNING Swap]: running with swap on is not supported. Please disable swap

		[WARNING SystemVerification]: this Docker version is not on the list of validated versions: 25.0.3. Latest validated version: 19.03

		[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'

	W0229 17:55:00.121008    4755 manifests.go:225] the default kube-apiserver authorization-mode is "Node,RBAC"; using "Node,RBAC"

	W0229 17:55:00.122456    4755 manifests.go:225] the default kube-apiserver authorization-mode is "Node,RBAC"; using "Node,RBAC"

	error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster

	To see the stack trace of this error execute with --v=5 or higher

	X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.18.20:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables": Process exited with status 1

	stdout:

	[init] Using Kubernetes version: v1.18.20

	[preflight] Running pre-flight checks

	[preflight] Pulling images required for setting up a Kubernetes cluster

	[preflight] This might take a minute or two, depending on the speed of your internet connection

	[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'

	[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"

	[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"

	[kubelet-start] Starting the kubelet

	[certs] Using certificateDir folder "/var/lib/minikube/certs"

	[certs] Using existing ca certificate authority

	[certs] Using existing apiserver certificate and key on disk

	[certs] Using existing apiserver-kubelet-client certificate and key on disk

	[certs] Using existing front-proxy-ca certificate authority

	[certs] Using existing front-proxy-client certificate and key on disk

	[certs] Using existing etcd/ca certificate authority

	[certs] Using existing etcd/server certificate and key on disk

	[certs] Using existing etcd/peer certificate and key on disk

	[certs] Using existing etcd/healthcheck-client certificate and key on disk

	[certs] Using existing apiserver-etcd-client certificate and key on disk

	[certs] Using the existing "sa" key

	[kubeconfig] Using kubeconfig folder "/etc/kubernetes"

	[kubeconfig] Writing "admin.conf" kubeconfig file

	[kubeconfig] Writing "kubelet.conf" kubeconfig file

	[kubeconfig] Writing "controller-manager.conf" kubeconfig file

	[kubeconfig] Writing "scheduler.conf" kubeconfig file

	[control-plane] Using manifest folder "/etc/kubernetes/manifests"

	[control-plane] Creating static Pod manifest for "kube-apiserver"

	[control-plane] Creating static Pod manifest for "kube-controller-manager"

	[control-plane] Creating static Pod manifest for "kube-scheduler"

	[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"

	[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s

	[kubelet-check] Initial timeout of 40s passed.

	[kubelet-check] It seems like the kubelet isn't running or healthy.

	[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.

	[kubelet-check] It seems like the kubelet isn't running or healthy.

	[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.

	[kubelet-check] It seems like the kubelet isn't running or healthy.

	[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.

	[kubelet-check] It seems like the kubelet isn't running or healthy.

	[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.

	[kubelet-check] It seems like the kubelet isn't running or healthy.

	[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.

		Unfortunately, an error has occurred:

			timed out waiting for the condition

		This error is likely caused by:

			- The kubelet is not running

			- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)

		If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:

			- 'systemctl status kubelet'

			- 'journalctl -xeu kubelet'

		Additionally, a control plane component may have crashed or exited when started by the container runtime.

		To troubleshoot, list all containers using your preferred container runtimes CLI.

		Here is one example how you may list all Kubernetes containers running in docker:

			- 'docker ps -a | grep kube | grep -v pause'

			Once you have found the failing container, you can inspect its logs with:

			- 'docker logs CONTAINERID'

	stderr:

	W0229 17:54:58.776828    4755 configset.go:202] WARNING: kubeadm cannot validate component configs for API groups [kubelet.config.k8s.io kubeproxy.config.k8s.io]

		[WARNING IsDockerSystemdCheck]: detected "cgroupfs" as the Docker cgroup driver. The recommended driver is "systemd". Please follow the guide at https://kubernetes.io/docs/setup/cri/

		[WARNING Swap]: running with swap on is not supported. Please disable swap

		[WARNING SystemVerification]: this Docker version is not on the list of validated versions: 25.0.3. Latest validated version: 19.03

		[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'

	W0229 17:55:00.121008    4755 manifests.go:225] the default kube-apiserver authorization-mode is "Node,RBAC"; using "Node,RBAC"

	W0229 17:55:00.122456    4755 manifests.go:225] the default kube-apiserver authorization-mode is "Node,RBAC"; using "Node,RBAC"

	error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster

	To see the stack trace of this error execute with --v=5 or higher

	W0229 09:56:55.453564    4284 out.go:239] * 

	* 

	W0229 09:56:55.454159    4284 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	I0229 09:56:55.518091    4284 out.go:177] 

	W0229 09:56:55.559744    4284 out.go:239] X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.18.20:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables": Process exited with status 1

	stdout:

	[init] Using Kubernetes version: v1.18.20

	[preflight] Running pre-flight checks

	[preflight] Pulling images required for setting up a Kubernetes cluster

	[preflight] This might take a minute or two, depending on the speed of your internet connection

	[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'

	[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"

	[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"

	[kubelet-start] Starting the kubelet

	[certs] Using certificateDir folder "/var/lib/minikube/certs"

	[certs] Using existing ca certificate authority

	[certs] Using existing apiserver certificate and key on disk

	[certs] Using existing apiserver-kubelet-client certificate and key on disk

	[certs] Using existing front-proxy-ca certificate authority

	[certs] Using existing front-proxy-client certificate and key on disk

	[certs] Using existing etcd/ca certificate authority

	[certs] Using existing etcd/server certificate and key on disk

	[certs] Using existing etcd/peer certificate and key on disk

	[certs] Using existing etcd/healthcheck-client certificate and key on disk

	[certs] Using existing apiserver-etcd-client certificate and key on disk

	[certs] Using the existing "sa" key

	[kubeconfig] Using kubeconfig folder "/etc/kubernetes"

	[kubeconfig] Writing "admin.conf" kubeconfig file

	[kubeconfig] Writing "kubelet.conf" kubeconfig file

	[kubeconfig] Writing "controller-manager.conf" kubeconfig file

	[kubeconfig] Writing "scheduler.conf" kubeconfig file

	[control-plane] Using manifest folder "/etc/kubernetes/manifests"

	[control-plane] Creating static Pod manifest for "kube-apiserver"

	[control-plane] Creating static Pod manifest for "kube-controller-manager"

	[control-plane] Creating static Pod manifest for "kube-scheduler"

	[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"

	[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s

	[kubelet-check] Initial timeout of 40s passed.

	[kubelet-check] It seems like the kubelet isn't running or healthy.

	[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.

	[kubelet-check] It seems like the kubelet isn't running or healthy.

	[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.

	[kubelet-check] It seems like the kubelet isn't running or healthy.

	[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.

	[kubelet-check] It seems like the kubelet isn't running or healthy.

	[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.

	[kubelet-check] It seems like the kubelet isn't running or healthy.

	[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.

		Unfortunately, an error has occurred:

			timed out waiting for the condition

		This error is likely caused by:

			- The kubelet is not running

			- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)

		If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:

			- 'systemctl status kubelet'

			- 'journalctl -xeu kubelet'

		Additionally, a control plane component may have crashed or exited when started by the container runtime.

		To troubleshoot, list all containers using your preferred container runtimes CLI.

		Here is one example how you may list all Kubernetes containers running in docker:

			- 'docker ps -a | grep kube | grep -v pause'

			Once you have found the failing container, you can inspect its logs with:

			- 'docker logs CONTAINERID'

	stderr:

	W0229 17:54:58.776828    4755 configset.go:202] WARNING: kubeadm cannot validate component configs for API groups [kubelet.config.k8s.io kubeproxy.config.k8s.io]

		[WARNING IsDockerSystemdCheck]: detected "cgroupfs" as the Docker cgroup driver. The recommended driver is "systemd". Please follow the guide at https://kubernetes.io/docs/setup/cri/

		[WARNING Swap]: running with swap on is not supported. Please disable swap

		[WARNING SystemVerification]: this Docker version is not on the list of validated versions: 25.0.3. Latest validated version: 19.03

		[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'

	W0229 17:55:00.121008    4755 manifests.go:225] the default kube-apiserver authorization-mode is "Node,RBAC"; using "Node,RBAC"

	W0229 17:55:00.122456    4755 manifests.go:225] the default kube-apiserver authorization-mode is "Node,RBAC"; using "Node,RBAC"

	error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster

	To see the stack trace of this error execute with --v=5 or higher

	X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.18.20:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables": Process exited with status 1

	stdout:

	[init] Using Kubernetes version: v1.18.20

	[preflight] Running pre-flight checks

	[preflight] Pulling images required for setting up a Kubernetes cluster

	[preflight] This might take a minute or two, depending on the speed of your internet connection

	[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'

	[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"

	[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"

	[kubelet-start] Starting the kubelet

	[certs] Using certificateDir folder "/var/lib/minikube/certs"

	[certs] Using existing ca certificate authority

	[certs] Using existing apiserver certificate and key on disk

	[certs] Using existing apiserver-kubelet-client certificate and key on disk

	[certs] Using existing front-proxy-ca certificate authority

	[certs] Using existing front-proxy-client certificate and key on disk

	[certs] Using existing etcd/ca certificate authority

	[certs] Using existing etcd/server certificate and key on disk

	[certs] Using existing etcd/peer certificate and key on disk

	[certs] Using existing etcd/healthcheck-client certificate and key on disk

	[certs] Using existing apiserver-etcd-client certificate and key on disk

	[certs] Using the existing "sa" key

	[kubeconfig] Using kubeconfig folder "/etc/kubernetes"

	[kubeconfig] Writing "admin.conf" kubeconfig file

	[kubeconfig] Writing "kubelet.conf" kubeconfig file

	[kubeconfig] Writing "controller-manager.conf" kubeconfig file

	[kubeconfig] Writing "scheduler.conf" kubeconfig file

	[control-plane] Using manifest folder "/etc/kubernetes/manifests"

	[control-plane] Creating static Pod manifest for "kube-apiserver"

	[control-plane] Creating static Pod manifest for "kube-controller-manager"

	[control-plane] Creating static Pod manifest for "kube-scheduler"

	[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"

	[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s

	[kubelet-check] Initial timeout of 40s passed.

	[kubelet-check] It seems like the kubelet isn't running or healthy.

	[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.

	[kubelet-check] It seems like the kubelet isn't running or healthy.

	[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.

	[kubelet-check] It seems like the kubelet isn't running or healthy.

	[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.

	[kubelet-check] It seems like the kubelet isn't running or healthy.

	[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.

	[kubelet-check] It seems like the kubelet isn't running or healthy.

	[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.

		Unfortunately, an error has occurred:

			timed out waiting for the condition

		This error is likely caused by:

			- The kubelet is not running

			- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)

		If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:

			- 'systemctl status kubelet'

			- 'journalctl -xeu kubelet'

		Additionally, a control plane component may have crashed or exited when started by the container runtime.

		To troubleshoot, list all containers using your preferred container runtimes CLI.

		Here is one example how you may list all Kubernetes containers running in docker:

			- 'docker ps -a | grep kube | grep -v pause'

			Once you have found the failing container, you can inspect its logs with:

			- 'docker logs CONTAINERID'

	stderr:

	W0229 17:54:58.776828    4755 configset.go:202] WARNING: kubeadm cannot validate component configs for API groups [kubelet.config.k8s.io kubeproxy.config.k8s.io]

		[WARNING IsDockerSystemdCheck]: detected "cgroupfs" as the Docker cgroup driver. The recommended driver is "systemd". Please follow the guide at https://kubernetes.io/docs/setup/cri/

		[WARNING Swap]: running with swap on is not supported. Please disable swap

		[WARNING SystemVerification]: this Docker version is not on the list of validated versions: 25.0.3. Latest validated version: 19.03

		[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'

	W0229 17:55:00.121008    4755 manifests.go:225] the default kube-apiserver authorization-mode is "Node,RBAC"; using "Node,RBAC"

	W0229 17:55:00.122456    4755 manifests.go:225] the default kube-apiserver authorization-mode is "Node,RBAC"; using "Node,RBAC"

	error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster

	To see the stack trace of this error execute with --v=5 or higher

	W0229 09:56:55.559805    4284 out.go:239] * Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start

	* Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start

	W0229 09:56:55.559825    4284 out.go:239] * Related issue: https://github.com/kubernetes/minikube/issues/4172

	* Related issue: https://github.com/kubernetes/minikube/issues/4172

	I0229 09:56:55.601935    4284 out.go:177] 

** /stderr **

ingress_addon_legacy_test.go:41: failed to start minikube with args: "out/minikube-darwin-amd64 start -p ingress-addon-legacy-580000 --kubernetes-version=v1.18.20 --memory=4096 --wait=true --alsologtostderr -v=5 --driver=docker " : exit status 109

--- FAIL: TestIngressAddonLegacy/StartLegacyK8sCluster (277.45s)

=== RUN   TestIngressAddonLegacy/serial/ValidateIngressAddonActivation

ingress_addon_legacy_test.go:70: (dbg) Run:  out/minikube-darwin-amd64 -p ingress-addon-legacy-580000 addons enable ingress --alsologtostderr -v=5

E0229 09:57:34.469760    1408 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/18259-932/.minikube/profiles/functional-081000/client.crt: no such file or directory

ingress_addon_legacy_test.go:70: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p ingress-addon-legacy-580000 addons enable ingress --alsologtostderr -v=5: exit status 10 (1m59.112860401s)

-- stdout --

	* ingress is an addon maintained by Kubernetes. For any concerns contact minikube on GitHub.

	You can view the list of minikube maintainers at: https://github.com/kubernetes/minikube/blob/master/OWNERS

	* After the addon is enabled, please run "minikube tunnel" and your ingress resources would be available at "127.0.0.1"

	  - Using image registry.k8s.io/ingress-nginx/controller:v0.49.3

	  - Using image docker.io/jettech/kube-webhook-certgen:v1.5.1

	  - Using image docker.io/jettech/kube-webhook-certgen:v1.5.1

	* Verifying ingress addon...

-- /stdout --

** stderr ** 

	I0229 09:56:55.768273    4458 out.go:291] Setting OutFile to fd 1 ...

	I0229 09:56:55.768587    4458 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0229 09:56:55.768593    4458 out.go:304] Setting ErrFile to fd 2...

	I0229 09:56:55.768597    4458 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0229 09:56:55.768785    4458 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18259-932/.minikube/bin

	I0229 09:56:55.769135    4458 mustload.go:65] Loading cluster: ingress-addon-legacy-580000

	I0229 09:56:55.769411    4458 config.go:182] Loaded profile config "ingress-addon-legacy-580000": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.18.20

	I0229 09:56:55.769431    4458 addons.go:597] checking whether the cluster is paused

	I0229 09:56:55.769514    4458 config.go:182] Loaded profile config "ingress-addon-legacy-580000": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.18.20

	I0229 09:56:55.769531    4458 host.go:66] Checking if "ingress-addon-legacy-580000" exists ...

	I0229 09:56:55.769919    4458 cli_runner.go:164] Run: docker container inspect ingress-addon-legacy-580000 --format={{.State.Status}}

	I0229 09:56:55.820006    4458 ssh_runner.go:195] Run: systemctl --version

	I0229 09:56:55.820092    4458 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ingress-addon-legacy-580000

	I0229 09:56:55.869850    4458 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:50583 SSHKeyPath:/Users/jenkins/minikube-integration/18259-932/.minikube/machines/ingress-addon-legacy-580000/id_rsa Username:docker}

	I0229 09:56:55.952218    4458 ssh_runner.go:195] Run: docker ps --filter status=paused --filter=name=k8s_.*_(kube-system)_ --format={{.ID}}

	I0229 09:56:55.990463    4458 out.go:177] * ingress is an addon maintained by Kubernetes. For any concerns contact minikube on GitHub.

	You can view the list of minikube maintainers at: https://github.com/kubernetes/minikube/blob/master/OWNERS

	I0229 09:56:56.011273    4458 config.go:182] Loaded profile config "ingress-addon-legacy-580000": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.18.20

	I0229 09:56:56.011283    4458 addons.go:69] Setting ingress=true in profile "ingress-addon-legacy-580000"

	I0229 09:56:56.011290    4458 addons.go:234] Setting addon ingress=true in "ingress-addon-legacy-580000"

	I0229 09:56:56.011323    4458 host.go:66] Checking if "ingress-addon-legacy-580000" exists ...

	I0229 09:56:56.011630    4458 cli_runner.go:164] Run: docker container inspect ingress-addon-legacy-580000 --format={{.State.Status}}

	I0229 09:56:56.082161    4458 out.go:177] * After the addon is enabled, please run "minikube tunnel" and your ingress resources would be available at "127.0.0.1"

	I0229 09:56:56.103050    4458 out.go:177]   - Using image registry.k8s.io/ingress-nginx/controller:v0.49.3

	I0229 09:56:56.124125    4458 out.go:177]   - Using image docker.io/jettech/kube-webhook-certgen:v1.5.1

	I0229 09:56:56.145146    4458 out.go:177]   - Using image docker.io/jettech/kube-webhook-certgen:v1.5.1

	I0229 09:56:56.166100    4458 addons.go:426] installing /etc/kubernetes/addons/ingress-deploy.yaml

	I0229 09:56:56.166114    4458 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ingress-deploy.yaml (15618 bytes)

	I0229 09:56:56.166193    4458 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ingress-addon-legacy-580000

	I0229 09:56:56.215486    4458 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:50583 SSHKeyPath:/Users/jenkins/minikube-integration/18259-932/.minikube/machines/ingress-addon-legacy-580000/id_rsa Username:docker}

	I0229 09:56:56.323564    4458 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply -f /etc/kubernetes/addons/ingress-deploy.yaml

	W0229 09:56:56.387292    4458 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply -f /etc/kubernetes/addons/ingress-deploy.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	I0229 09:56:56.387321    4458 retry.go:31] will retry after 275.794279ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply -f /etc/kubernetes/addons/ingress-deploy.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	I0229 09:56:56.663604    4458 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply --force -f /etc/kubernetes/addons/ingress-deploy.yaml

	W0229 09:56:56.721631    4458 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply --force -f /etc/kubernetes/addons/ingress-deploy.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	I0229 09:56:56.721649    4458 retry.go:31] will retry after 486.439395ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply --force -f /etc/kubernetes/addons/ingress-deploy.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	I0229 09:56:57.208478    4458 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply --force -f /etc/kubernetes/addons/ingress-deploy.yaml

	W0229 09:56:57.266661    4458 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply --force -f /etc/kubernetes/addons/ingress-deploy.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	I0229 09:56:57.266679    4458 retry.go:31] will retry after 532.91665ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply --force -f /etc/kubernetes/addons/ingress-deploy.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	I0229 09:56:57.800299    4458 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply --force -f /etc/kubernetes/addons/ingress-deploy.yaml

	W0229 09:56:57.862712    4458 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply --force -f /etc/kubernetes/addons/ingress-deploy.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	I0229 09:56:57.862729    4458 retry.go:31] will retry after 1.046583537s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply --force -f /etc/kubernetes/addons/ingress-deploy.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	I0229 09:56:58.911636    4458 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply --force -f /etc/kubernetes/addons/ingress-deploy.yaml

	W0229 09:56:58.974949    4458 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply --force -f /etc/kubernetes/addons/ingress-deploy.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	I0229 09:56:58.974976    4458 retry.go:31] will retry after 843.822354ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply --force -f /etc/kubernetes/addons/ingress-deploy.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	I0229 09:56:59.820781    4458 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply --force -f /etc/kubernetes/addons/ingress-deploy.yaml

	W0229 09:56:59.879858    4458 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply --force -f /etc/kubernetes/addons/ingress-deploy.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	I0229 09:56:59.879879    4458 retry.go:31] will retry after 1.111401255s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply --force -f /etc/kubernetes/addons/ingress-deploy.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	I0229 09:57:00.991821    4458 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply --force -f /etc/kubernetes/addons/ingress-deploy.yaml

	W0229 09:57:01.053815    4458 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply --force -f /etc/kubernetes/addons/ingress-deploy.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	I0229 09:57:01.053835    4458 retry.go:31] will retry after 2.248750723s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply --force -f /etc/kubernetes/addons/ingress-deploy.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	I0229 09:57:03.304883    4458 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply --force -f /etc/kubernetes/addons/ingress-deploy.yaml

	W0229 09:57:03.366583    4458 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply --force -f /etc/kubernetes/addons/ingress-deploy.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	I0229 09:57:03.366600    4458 retry.go:31] will retry after 5.945761658s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply --force -f /etc/kubernetes/addons/ingress-deploy.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	I0229 09:57:09.312485    4458 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply --force -f /etc/kubernetes/addons/ingress-deploy.yaml

	W0229 09:57:09.367071    4458 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply --force -f /etc/kubernetes/addons/ingress-deploy.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	I0229 09:57:09.367090    4458 retry.go:31] will retry after 3.614529584s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply --force -f /etc/kubernetes/addons/ingress-deploy.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	I0229 09:57:12.982653    4458 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply --force -f /etc/kubernetes/addons/ingress-deploy.yaml

	W0229 09:57:13.041571    4458 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply --force -f /etc/kubernetes/addons/ingress-deploy.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	I0229 09:57:13.041588    4458 retry.go:31] will retry after 12.017095444s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply --force -f /etc/kubernetes/addons/ingress-deploy.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	I0229 09:57:25.058883    4458 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply --force -f /etc/kubernetes/addons/ingress-deploy.yaml

	W0229 09:57:25.113136    4458 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply --force -f /etc/kubernetes/addons/ingress-deploy.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	I0229 09:57:25.113153    4458 retry.go:31] will retry after 21.220985258s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply --force -f /etc/kubernetes/addons/ingress-deploy.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	I0229 09:57:46.335498    4458 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply --force -f /etc/kubernetes/addons/ingress-deploy.yaml

	W0229 09:57:46.393722    4458 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply --force -f /etc/kubernetes/addons/ingress-deploy.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	I0229 09:57:46.393742    4458 retry.go:31] will retry after 22.057466989s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply --force -f /etc/kubernetes/addons/ingress-deploy.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	I0229 09:58:08.451532    4458 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply --force -f /etc/kubernetes/addons/ingress-deploy.yaml

	W0229 09:58:08.507725    4458 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply --force -f /etc/kubernetes/addons/ingress-deploy.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	I0229 09:58:08.507744    4458 retry.go:31] will retry after 46.112210627s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply --force -f /etc/kubernetes/addons/ingress-deploy.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	I0229 09:58:54.619432    4458 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply --force -f /etc/kubernetes/addons/ingress-deploy.yaml

	W0229 09:58:54.679890    4458 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply --force -f /etc/kubernetes/addons/ingress-deploy.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	I0229 09:58:54.679919    4458 addons.go:470] Verifying addon ingress=true in "ingress-addon-legacy-580000"

	I0229 09:58:54.701658    4458 out.go:177] * Verifying ingress addon...

	I0229 09:58:54.745284    4458 out.go:177] 

	W0229 09:58:54.766570    4458 out.go:239] X Exiting due to MK_ADDON_ENABLE: enable failed: run callbacks: running callbacks: [sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply --force -f /etc/kubernetes/addons/ingress-deploy.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	 get kube-client to validate ingress addon: client config: context "ingress-addon-legacy-580000" does not exist: client config: context "ingress-addon-legacy-580000" does not exist]

	X Exiting due to MK_ADDON_ENABLE: enable failed: run callbacks: running callbacks: [sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply --force -f /etc/kubernetes/addons/ingress-deploy.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	 get kube-client to validate ingress addon: client config: context "ingress-addon-legacy-580000" does not exist: client config: context "ingress-addon-legacy-580000" does not exist]

	W0229 09:58:54.766610    4458 out.go:239] * 

	* 

	W0229 09:58:54.770178    4458 out.go:239] ╭───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                                                           │

	│    * If the above advice does not help, please let us know:                                                               │

	│      https://github.com/kubernetes/minikube/issues/new/choose                                                             │

	│                                                                                                                           │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                  │

	│    * Please also attach the following file to the GitHub issue:                                                           │

	│    * - /var/folders/52/zh_qmlrn1f36yr6lgs7nxtym0000gp/T/minikube_addons_ecab7b1157b569c129811d3c2b680fbca2a6f3d2_0.log    │

	│                                                                                                                           │

	╰───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯

	╭───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                                                           │

	│    * If the above advice does not help, please let us know:                                                               │

	│      https://github.com/kubernetes/minikube/issues/new/choose                                                             │

	│                                                                                                                           │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                  │

	│    * Please also attach the following file to the GitHub issue:                                                           │

	│    * - /var/folders/52/zh_qmlrn1f36yr6lgs7nxtym0000gp/T/minikube_addons_ecab7b1157b569c129811d3c2b680fbca2a6f3d2_0.log    │

	│                                                                                                                           │

	╰───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯

	I0229 09:58:54.791539    4458 out.go:177] 

** /stderr **

ingress_addon_legacy_test.go:71: failed to enable ingress addon: exit status 10

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:230: ======>  post-mortem[TestIngressAddonLegacy/serial/ValidateIngressAddonActivation]: docker inspect <======

helpers_test.go:231: (dbg) Run:  docker inspect ingress-addon-legacy-580000

helpers_test.go:235: (dbg) docker inspect ingress-addon-legacy-580000:

-- stdout --

	[

	    {

	        "Id": "f832b0f68af23cb1e06ad3bd638807b1bb6f9bf9df72de6cd9049fb37cee4125",

	        "Created": "2024-02-29T17:52:41.540717298Z",

	        "Path": "/usr/local/bin/entrypoint",

	        "Args": [

	            "/sbin/init"

	        ],

	        "State": {

	            "Status": "running",

	            "Running": true,

	            "Paused": false,

	            "Restarting": false,

	            "OOMKilled": false,

	            "Dead": false,

	            "Pid": 50257,

	            "ExitCode": 0,

	            "Error": "",

	            "StartedAt": "2024-02-29T17:52:41.758558303Z",

	            "FinishedAt": "0001-01-01T00:00:00Z"

	        },

	        "Image": "sha256:a5b872dc86053f77fb58d93168e89c4b0fa5961a7ed628d630f6cd6decd7bca0",

	        "ResolvConfPath": "/var/lib/docker/containers/f832b0f68af23cb1e06ad3bd638807b1bb6f9bf9df72de6cd9049fb37cee4125/resolv.conf",

	        "HostnamePath": "/var/lib/docker/containers/f832b0f68af23cb1e06ad3bd638807b1bb6f9bf9df72de6cd9049fb37cee4125/hostname",

	        "HostsPath": "/var/lib/docker/containers/f832b0f68af23cb1e06ad3bd638807b1bb6f9bf9df72de6cd9049fb37cee4125/hosts",

	        "LogPath": "/var/lib/docker/containers/f832b0f68af23cb1e06ad3bd638807b1bb6f9bf9df72de6cd9049fb37cee4125/f832b0f68af23cb1e06ad3bd638807b1bb6f9bf9df72de6cd9049fb37cee4125-json.log",

	        "Name": "/ingress-addon-legacy-580000",

	        "RestartCount": 0,

	        "Driver": "overlay2",

	        "Platform": "linux",

	        "MountLabel": "",

	        "ProcessLabel": "",

	        "AppArmorProfile": "",

	        "ExecIDs": null,

	        "HostConfig": {

	            "Binds": [

	                "/lib/modules:/lib/modules:ro",

	                "ingress-addon-legacy-580000:/var"

	            ],

	            "ContainerIDFile": "",

	            "LogConfig": {

	                "Type": "json-file",

	                "Config": {}

	            },

	            "NetworkMode": "ingress-addon-legacy-580000",

	            "PortBindings": {

	                "22/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "0"

	                    }

	                ],

	                "2376/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "0"

	                    }

	                ],

	                "32443/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "0"

	                    }

	                ],

	                "5000/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "0"

	                    }

	                ],

	                "8443/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "0"

	                    }

	                ]

	            },

	            "RestartPolicy": {

	                "Name": "no",

	                "MaximumRetryCount": 0

	            },

	            "AutoRemove": false,

	            "VolumeDriver": "",

	            "VolumesFrom": null,

	            "ConsoleSize": [

	                0,

	                0

	            ],

	            "CapAdd": null,

	            "CapDrop": null,

	            "CgroupnsMode": "private",

	            "Dns": [],

	            "DnsOptions": [],

	            "DnsSearch": [],

	            "ExtraHosts": null,

	            "GroupAdd": null,

	            "IpcMode": "private",

	            "Cgroup": "",

	            "Links": null,

	            "OomScoreAdj": 0,

	            "PidMode": "",

	            "Privileged": true,

	            "PublishAllPorts": false,

	            "ReadonlyRootfs": false,

	            "SecurityOpt": [

	                "seccomp=unconfined",

	                "apparmor=unconfined",

	                "label=disable"

	            ],

	            "Tmpfs": {

	                "/run": "",

	                "/tmp": ""

	            },

	            "UTSMode": "",

	            "UsernsMode": "",

	            "ShmSize": 67108864,

	            "Runtime": "runc",

	            "Isolation": "",

	            "CpuShares": 0,

	            "Memory": 4294967296,

	            "NanoCpus": 2000000000,

	            "CgroupParent": "",

	            "BlkioWeight": 0,

	            "BlkioWeightDevice": [],

	            "BlkioDeviceReadBps": [],

	            "BlkioDeviceWriteBps": [],

	            "BlkioDeviceReadIOps": [],

	            "BlkioDeviceWriteIOps": [],

	            "CpuPeriod": 0,

	            "CpuQuota": 0,

	            "CpuRealtimePeriod": 0,

	            "CpuRealtimeRuntime": 0,

	            "CpusetCpus": "",

	            "CpusetMems": "",

	            "Devices": [],

	            "DeviceCgroupRules": null,

	            "DeviceRequests": null,

	            "MemoryReservation": 0,

	            "MemorySwap": 4294967296,

	            "MemorySwappiness": null,

	            "OomKillDisable": null,

	            "PidsLimit": null,

	            "Ulimits": [],

	            "CpuCount": 0,

	            "CpuPercent": 0,

	            "IOMaximumIOps": 0,

	            "IOMaximumBandwidth": 0,

	            "MaskedPaths": null,

	            "ReadonlyPaths": null

	        },

	        "GraphDriver": {

	            "Data": {

	                "LowerDir": "/var/lib/docker/overlay2/5ab44aa2297df4f970e3b122558b75d3b3af5410dce7ea1efa8bb6b3cbf5b143-init/diff:/var/lib/docker/overlay2/27fbcff5021de980a082cd343434b8923388c3122a97247e81bdc445b5997307/diff",

	                "MergedDir": "/var/lib/docker/overlay2/5ab44aa2297df4f970e3b122558b75d3b3af5410dce7ea1efa8bb6b3cbf5b143/merged",

	                "UpperDir": "/var/lib/docker/overlay2/5ab44aa2297df4f970e3b122558b75d3b3af5410dce7ea1efa8bb6b3cbf5b143/diff",

	                "WorkDir": "/var/lib/docker/overlay2/5ab44aa2297df4f970e3b122558b75d3b3af5410dce7ea1efa8bb6b3cbf5b143/work"

	            },

	            "Name": "overlay2"

	        },

	        "Mounts": [

	            {

	                "Type": "bind",

	                "Source": "/lib/modules",

	                "Destination": "/lib/modules",

	                "Mode": "ro",

	                "RW": false,

	                "Propagation": "rprivate"

	            },

	            {

	                "Type": "volume",

	                "Name": "ingress-addon-legacy-580000",

	                "Source": "/var/lib/docker/volumes/ingress-addon-legacy-580000/_data",

	                "Destination": "/var",

	                "Driver": "local",

	                "Mode": "z",

	                "RW": true,

	                "Propagation": ""

	            }

	        ],

	        "Config": {

	            "Hostname": "ingress-addon-legacy-580000",

	            "Domainname": "",

	            "User": "",

	            "AttachStdin": false,

	            "AttachStdout": false,

	            "AttachStderr": false,

	            "ExposedPorts": {

	                "22/tcp": {},

	                "2376/tcp": {},

	                "32443/tcp": {},

	                "5000/tcp": {},

	                "8443/tcp": {}

	            },

	            "Tty": true,

	            "OpenStdin": false,

	            "StdinOnce": false,

	            "Env": [

	                "container=docker",

	                "PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"

	            ],

	            "Cmd": null,

	            "Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08",

	            "Volumes": null,

	            "WorkingDir": "/",

	            "Entrypoint": [

	                "/usr/local/bin/entrypoint",

	                "/sbin/init"

	            ],

	            "OnBuild": null,

	            "Labels": {

	                "created_by.minikube.sigs.k8s.io": "true",

	                "mode.minikube.sigs.k8s.io": "ingress-addon-legacy-580000",

	                "name.minikube.sigs.k8s.io": "ingress-addon-legacy-580000",

	                "role.minikube.sigs.k8s.io": ""

	            },

	            "StopSignal": "SIGRTMIN+3"

	        },

	        "NetworkSettings": {

	            "Bridge": "",

	            "SandboxID": "0ca97d968d3a768af6d651933bd226e78bb31eb624d6172b6311c128d57e1b3a",

	            "SandboxKey": "/var/run/docker/netns/0ca97d968d3a",

	            "Ports": {

	                "22/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "50583"

	                    }

	                ],

	                "2376/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "50584"

	                    }

	                ],

	                "32443/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "50585"

	                    }

	                ],

	                "5000/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "50581"

	                    }

	                ],

	                "8443/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "50582"

	                    }

	                ]

	            },

	            "HairpinMode": false,

	            "LinkLocalIPv6Address": "",

	            "LinkLocalIPv6PrefixLen": 0,

	            "SecondaryIPAddresses": null,

	            "SecondaryIPv6Addresses": null,

	            "EndpointID": "",

	            "Gateway": "",

	            "GlobalIPv6Address": "",

	            "GlobalIPv6PrefixLen": 0,

	            "IPAddress": "",

	            "IPPrefixLen": 0,

	            "IPv6Gateway": "",

	            "MacAddress": "",

	            "Networks": {

	                "ingress-addon-legacy-580000": {

	                    "IPAMConfig": {

	                        "IPv4Address": "192.168.49.2"

	                    },

	                    "Links": null,

	                    "Aliases": [

	                        "f832b0f68af2",

	                        "ingress-addon-legacy-580000"

	                    ],

	                    "MacAddress": "02:42:c0:a8:31:02",

	                    "NetworkID": "36d76060fb93f6b69f3df4154e14861fe2c46871f04e9dc11292fa5a8173909b",

	                    "EndpointID": "5ba69d5117ccc6f1901124e4bbaf5639369178a25edeec006e8483e772fdf010",

	                    "Gateway": "192.168.49.1",

	                    "IPAddress": "192.168.49.2",

	                    "IPPrefixLen": 24,

	                    "IPv6Gateway": "",

	                    "GlobalIPv6Address": "",

	                    "GlobalIPv6PrefixLen": 0,

	                    "DriverOpts": null,

	                    "DNSNames": [

	                        "ingress-addon-legacy-580000",

	                        "f832b0f68af2"

	                    ]

	                }

	            }

	        }

	    }

	]

-- /stdout --

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p ingress-addon-legacy-580000 -n ingress-addon-legacy-580000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p ingress-addon-legacy-580000 -n ingress-addon-legacy-580000: exit status 6 (385.365734ms)

-- stdout --

	Running

	WARNING: Your kubectl is pointing to stale minikube-vm.

	To fix the kubectl context, run `minikube update-context`

-- /stdout --

** stderr ** 

	E0229 09:58:55.238766    4483 status.go:415] kubeconfig endpoint: extract IP: "ingress-addon-legacy-580000" does not appear in /Users/jenkins/minikube-integration/18259-932/kubeconfig

** /stderr **

helpers_test.go:239: status error: exit status 6 (may be ok)

helpers_test.go:241: "ingress-addon-legacy-580000" host is not running, skipping log retrieval (state="Running\nWARNING: Your kubectl is pointing to stale minikube-vm.\nTo fix the kubectl context, run `minikube update-context`")

--- FAIL: TestIngressAddonLegacy/serial/ValidateIngressAddonActivation (119.55s)

=== RUN   TestIngressAddonLegacy/serial/ValidateIngressDNSAddonActivation

ingress_addon_legacy_test.go:79: (dbg) Run:  out/minikube-darwin-amd64 -p ingress-addon-legacy-580000 addons enable ingress-dns --alsologtostderr -v=5

E0229 09:59:18.995534    1408 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/18259-932/.minikube/profiles/addons-551000/client.crt: no such file or directory

E0229 09:59:50.616199    1408 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/18259-932/.minikube/profiles/functional-081000/client.crt: no such file or directory

E0229 10:00:18.308345    1408 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/18259-932/.minikube/profiles/functional-081000/client.crt: no such file or directory

ingress_addon_legacy_test.go:79: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p ingress-addon-legacy-580000 addons enable ingress-dns --alsologtostderr -v=5: exit status 10 (1m56.960526436s)

-- stdout --

	* ingress-dns is an addon maintained by minikube. For any concerns contact minikube on GitHub.

	You can view the list of minikube maintainers at: https://github.com/kubernetes/minikube/blob/master/OWNERS

	* After the addon is enabled, please run "minikube tunnel" and your ingress resources would be available at "127.0.0.1"

	  - Using image cryptexlabs/minikube-ingress-dns:0.3.0

-- /stdout --

** stderr ** 

	I0229 09:58:55.320805    4493 out.go:291] Setting OutFile to fd 1 ...

	I0229 09:58:55.321668    4493 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0229 09:58:55.321678    4493 out.go:304] Setting ErrFile to fd 2...

	I0229 09:58:55.321685    4493 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0229 09:58:55.322264    4493 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18259-932/.minikube/bin

	I0229 09:58:55.322625    4493 mustload.go:65] Loading cluster: ingress-addon-legacy-580000

	I0229 09:58:55.322890    4493 config.go:182] Loaded profile config "ingress-addon-legacy-580000": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.18.20

	I0229 09:58:55.322909    4493 addons.go:597] checking whether the cluster is paused

	I0229 09:58:55.322988    4493 config.go:182] Loaded profile config "ingress-addon-legacy-580000": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.18.20

	I0229 09:58:55.323005    4493 host.go:66] Checking if "ingress-addon-legacy-580000" exists ...

	I0229 09:58:55.323358    4493 cli_runner.go:164] Run: docker container inspect ingress-addon-legacy-580000 --format={{.State.Status}}

	I0229 09:58:55.378933    4493 ssh_runner.go:195] Run: systemctl --version

	I0229 09:58:55.379011    4493 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ingress-addon-legacy-580000

	I0229 09:58:55.430754    4493 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:50583 SSHKeyPath:/Users/jenkins/minikube-integration/18259-932/.minikube/machines/ingress-addon-legacy-580000/id_rsa Username:docker}

	I0229 09:58:55.516341    4493 ssh_runner.go:195] Run: docker ps --filter status=paused --filter=name=k8s_.*_(kube-system)_ --format={{.ID}}

	I0229 09:58:55.554229    4493 out.go:177] * ingress-dns is an addon maintained by minikube. For any concerns contact minikube on GitHub.

	You can view the list of minikube maintainers at: https://github.com/kubernetes/minikube/blob/master/OWNERS

	I0229 09:58:55.576278    4493 config.go:182] Loaded profile config "ingress-addon-legacy-580000": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.18.20

	I0229 09:58:55.576303    4493 addons.go:69] Setting ingress-dns=true in profile "ingress-addon-legacy-580000"

	I0229 09:58:55.576315    4493 addons.go:234] Setting addon ingress-dns=true in "ingress-addon-legacy-580000"

	I0229 09:58:55.576370    4493 host.go:66] Checking if "ingress-addon-legacy-580000" exists ...

	I0229 09:58:55.576969    4493 cli_runner.go:164] Run: docker container inspect ingress-addon-legacy-580000 --format={{.State.Status}}

	I0229 09:58:55.648742    4493 out.go:177] * After the addon is enabled, please run "minikube tunnel" and your ingress resources would be available at "127.0.0.1"

	I0229 09:58:55.670157    4493 out.go:177]   - Using image cryptexlabs/minikube-ingress-dns:0.3.0

	I0229 09:58:55.692169    4493 addons.go:426] installing /etc/kubernetes/addons/ingress-dns-pod.yaml

	I0229 09:58:55.692204    4493 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ingress-dns-pod.yaml (2434 bytes)

	I0229 09:58:55.692356    4493 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ingress-addon-legacy-580000

	I0229 09:58:55.743563    4493 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:50583 SSHKeyPath:/Users/jenkins/minikube-integration/18259-932/.minikube/machines/ingress-addon-legacy-580000/id_rsa Username:docker}

	I0229 09:58:55.851229    4493 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply -f /etc/kubernetes/addons/ingress-dns-pod.yaml

	W0229 09:58:55.906993    4493 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply -f /etc/kubernetes/addons/ingress-dns-pod.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	I0229 09:58:55.907019    4493 retry.go:31] will retry after 301.93632ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply -f /etc/kubernetes/addons/ingress-dns-pod.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	I0229 09:58:56.209111    4493 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply --force -f /etc/kubernetes/addons/ingress-dns-pod.yaml

	W0229 09:58:56.265271    4493 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply --force -f /etc/kubernetes/addons/ingress-dns-pod.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	I0229 09:58:56.265291    4493 retry.go:31] will retry after 445.906652ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply --force -f /etc/kubernetes/addons/ingress-dns-pod.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	I0229 09:58:56.712004    4493 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply --force -f /etc/kubernetes/addons/ingress-dns-pod.yaml

	W0229 09:58:56.770595    4493 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply --force -f /etc/kubernetes/addons/ingress-dns-pod.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	I0229 09:58:56.770621    4493 retry.go:31] will retry after 590.707048ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply --force -f /etc/kubernetes/addons/ingress-dns-pod.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	I0229 09:58:57.361891    4493 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply --force -f /etc/kubernetes/addons/ingress-dns-pod.yaml

	W0229 09:58:57.418889    4493 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply --force -f /etc/kubernetes/addons/ingress-dns-pod.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	I0229 09:58:57.418911    4493 retry.go:31] will retry after 917.321791ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply --force -f /etc/kubernetes/addons/ingress-dns-pod.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	I0229 09:58:58.337746    4493 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply --force -f /etc/kubernetes/addons/ingress-dns-pod.yaml

	W0229 09:58:58.390859    4493 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply --force -f /etc/kubernetes/addons/ingress-dns-pod.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	I0229 09:58:58.390876    4493 retry.go:31] will retry after 1.232850832s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply --force -f /etc/kubernetes/addons/ingress-dns-pod.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	I0229 09:58:59.623874    4493 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply --force -f /etc/kubernetes/addons/ingress-dns-pod.yaml

	W0229 09:58:59.680582    4493 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply --force -f /etc/kubernetes/addons/ingress-dns-pod.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	I0229 09:58:59.680601    4493 retry.go:31] will retry after 2.806898372s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply --force -f /etc/kubernetes/addons/ingress-dns-pod.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	I0229 09:59:02.487908    4493 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply --force -f /etc/kubernetes/addons/ingress-dns-pod.yaml

	W0229 09:59:02.549524    4493 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply --force -f /etc/kubernetes/addons/ingress-dns-pod.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	I0229 09:59:02.549541    4493 retry.go:31] will retry after 3.295412902s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply --force -f /etc/kubernetes/addons/ingress-dns-pod.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	I0229 09:59:05.846565    4493 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply --force -f /etc/kubernetes/addons/ingress-dns-pod.yaml

	W0229 09:59:05.903868    4493 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply --force -f /etc/kubernetes/addons/ingress-dns-pod.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	I0229 09:59:05.903887    4493 retry.go:31] will retry after 2.209631191s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply --force -f /etc/kubernetes/addons/ingress-dns-pod.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	I0229 09:59:08.114931    4493 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply --force -f /etc/kubernetes/addons/ingress-dns-pod.yaml

	W0229 09:59:08.223628    4493 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply --force -f /etc/kubernetes/addons/ingress-dns-pod.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	I0229 09:59:08.223646    4493 retry.go:31] will retry after 7.683898493s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply --force -f /etc/kubernetes/addons/ingress-dns-pod.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	I0229 09:59:15.907643    4493 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply --force -f /etc/kubernetes/addons/ingress-dns-pod.yaml

	W0229 09:59:15.966586    4493 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply --force -f /etc/kubernetes/addons/ingress-dns-pod.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	I0229 09:59:15.966606    4493 retry.go:31] will retry after 11.446764527s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply --force -f /etc/kubernetes/addons/ingress-dns-pod.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	I0229 09:59:27.413682    4493 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply --force -f /etc/kubernetes/addons/ingress-dns-pod.yaml

	W0229 09:59:27.472765    4493 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply --force -f /etc/kubernetes/addons/ingress-dns-pod.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	I0229 09:59:27.472785    4493 retry.go:31] will retry after 20.642636055s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply --force -f /etc/kubernetes/addons/ingress-dns-pod.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	I0229 09:59:48.115277    4493 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply --force -f /etc/kubernetes/addons/ingress-dns-pod.yaml

	W0229 09:59:48.172132    4493 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply --force -f /etc/kubernetes/addons/ingress-dns-pod.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	I0229 09:59:48.172148    4493 retry.go:31] will retry after 31.032524082s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply --force -f /etc/kubernetes/addons/ingress-dns-pod.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	I0229 10:00:19.204447    4493 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply --force -f /etc/kubernetes/addons/ingress-dns-pod.yaml

	W0229 10:00:19.262174    4493 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply --force -f /etc/kubernetes/addons/ingress-dns-pod.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	I0229 10:00:19.262204    4493 retry.go:31] will retry after 32.789727738s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply --force -f /etc/kubernetes/addons/ingress-dns-pod.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	I0229 10:00:52.052037    4493 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply --force -f /etc/kubernetes/addons/ingress-dns-pod.yaml

	W0229 10:00:52.121033    4493 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply --force -f /etc/kubernetes/addons/ingress-dns-pod.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	I0229 10:00:52.143121    4493 out.go:177] 

	W0229 10:00:52.165158    4493 out.go:239] X Exiting due to MK_ADDON_ENABLE: enable failed: run callbacks: running callbacks: [sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply --force -f /etc/kubernetes/addons/ingress-dns-pod.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	]

	X Exiting due to MK_ADDON_ENABLE: enable failed: run callbacks: running callbacks: [sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply --force -f /etc/kubernetes/addons/ingress-dns-pod.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	]

	W0229 10:00:52.165191    4493 out.go:239] * 

	* 

	W0229 10:00:52.168846    4493 out.go:239] ╭───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                                                           │

	│    * If the above advice does not help, please let us know:                                                               │

	│      https://github.com/kubernetes/minikube/issues/new/choose                                                             │

	│                                                                                                                           │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                  │

	│    * Please also attach the following file to the GitHub issue:                                                           │

	│    * - /var/folders/52/zh_qmlrn1f36yr6lgs7nxtym0000gp/T/minikube_addons_26091442b04c5e26589fdfa18b5031c2ff11dd6b_0.log    │

	│                                                                                                                           │

	╰───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯

	╭───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                                                           │

	│    * If the above advice does not help, please let us know:                                                               │

	│      https://github.com/kubernetes/minikube/issues/new/choose                                                             │

	│                                                                                                                           │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                  │

	│    * Please also attach the following file to the GitHub issue:                                                           │

	│    * - /var/folders/52/zh_qmlrn1f36yr6lgs7nxtym0000gp/T/minikube_addons_26091442b04c5e26589fdfa18b5031c2ff11dd6b_0.log    │

	│                                                                                                                           │

	╰───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯

	I0229 10:00:52.190945    4493 out.go:177] 

** /stderr **

ingress_addon_legacy_test.go:80: failed to enable ingress-dns addon: exit status 10

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:230: ======>  post-mortem[TestIngressAddonLegacy/serial/ValidateIngressDNSAddonActivation]: docker inspect <======

helpers_test.go:231: (dbg) Run:  docker inspect ingress-addon-legacy-580000

helpers_test.go:235: (dbg) docker inspect ingress-addon-legacy-580000:

-- stdout --

	[

	    {

	        "Id": "f832b0f68af23cb1e06ad3bd638807b1bb6f9bf9df72de6cd9049fb37cee4125",

	        "Created": "2024-02-29T17:52:41.540717298Z",

	        "Path": "/usr/local/bin/entrypoint",

	        "Args": [

	            "/sbin/init"

	        ],

	        "State": {

	            "Status": "running",

	            "Running": true,

	            "Paused": false,

	            "Restarting": false,

	            "OOMKilled": false,

	            "Dead": false,

	            "Pid": 50257,

	            "ExitCode": 0,

	            "Error": "",

	            "StartedAt": "2024-02-29T17:52:41.758558303Z",

	            "FinishedAt": "0001-01-01T00:00:00Z"

	        },

	        "Image": "sha256:a5b872dc86053f77fb58d93168e89c4b0fa5961a7ed628d630f6cd6decd7bca0",

	        "ResolvConfPath": "/var/lib/docker/containers/f832b0f68af23cb1e06ad3bd638807b1bb6f9bf9df72de6cd9049fb37cee4125/resolv.conf",

	        "HostnamePath": "/var/lib/docker/containers/f832b0f68af23cb1e06ad3bd638807b1bb6f9bf9df72de6cd9049fb37cee4125/hostname",

	        "HostsPath": "/var/lib/docker/containers/f832b0f68af23cb1e06ad3bd638807b1bb6f9bf9df72de6cd9049fb37cee4125/hosts",

	        "LogPath": "/var/lib/docker/containers/f832b0f68af23cb1e06ad3bd638807b1bb6f9bf9df72de6cd9049fb37cee4125/f832b0f68af23cb1e06ad3bd638807b1bb6f9bf9df72de6cd9049fb37cee4125-json.log",

	        "Name": "/ingress-addon-legacy-580000",

	        "RestartCount": 0,

	        "Driver": "overlay2",

	        "Platform": "linux",

	        "MountLabel": "",

	        "ProcessLabel": "",

	        "AppArmorProfile": "",

	        "ExecIDs": null,

	        "HostConfig": {

	            "Binds": [

	                "/lib/modules:/lib/modules:ro",

	                "ingress-addon-legacy-580000:/var"

	            ],

	            "ContainerIDFile": "",

	            "LogConfig": {

	                "Type": "json-file",

	                "Config": {}

	            },

	            "NetworkMode": "ingress-addon-legacy-580000",

	            "PortBindings": {

	                "22/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "0"

	                    }

	                ],

	                "2376/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "0"

	                    }

	                ],

	                "32443/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "0"

	                    }

	                ],

	                "5000/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "0"

	                    }

	                ],

	                "8443/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "0"

	                    }

	                ]

	            },

	            "RestartPolicy": {

	                "Name": "no",

	                "MaximumRetryCount": 0

	            },

	            "AutoRemove": false,

	            "VolumeDriver": "",

	            "VolumesFrom": null,

	            "ConsoleSize": [

	                0,

	                0

	            ],

	            "CapAdd": null,

	            "CapDrop": null,

	            "CgroupnsMode": "private",

	            "Dns": [],

	            "DnsOptions": [],

	            "DnsSearch": [],

	            "ExtraHosts": null,

	            "GroupAdd": null,

	            "IpcMode": "private",

	            "Cgroup": "",

	            "Links": null,

	            "OomScoreAdj": 0,

	            "PidMode": "",

	            "Privileged": true,

	            "PublishAllPorts": false,

	            "ReadonlyRootfs": false,

	            "SecurityOpt": [

	                "seccomp=unconfined",

	                "apparmor=unconfined",

	                "label=disable"

	            ],

	            "Tmpfs": {

	                "/run": "",

	                "/tmp": ""

	            },

	            "UTSMode": "",

	            "UsernsMode": "",

	            "ShmSize": 67108864,

	            "Runtime": "runc",

	            "Isolation": "",

	            "CpuShares": 0,

	            "Memory": 4294967296,

	            "NanoCpus": 2000000000,

	            "CgroupParent": "",

	            "BlkioWeight": 0,

	            "BlkioWeightDevice": [],

	            "BlkioDeviceReadBps": [],

	            "BlkioDeviceWriteBps": [],

	            "BlkioDeviceReadIOps": [],

	            "BlkioDeviceWriteIOps": [],

	            "CpuPeriod": 0,

	            "CpuQuota": 0,

	            "CpuRealtimePeriod": 0,

	            "CpuRealtimeRuntime": 0,

	            "CpusetCpus": "",

	            "CpusetMems": "",

	            "Devices": [],

	            "DeviceCgroupRules": null,

	            "DeviceRequests": null,

	            "MemoryReservation": 0,

	            "MemorySwap": 4294967296,

	            "MemorySwappiness": null,

	            "OomKillDisable": null,

	            "PidsLimit": null,

	            "Ulimits": [],

	            "CpuCount": 0,

	            "CpuPercent": 0,

	            "IOMaximumIOps": 0,

	            "IOMaximumBandwidth": 0,

	            "MaskedPaths": null,

	            "ReadonlyPaths": null

	        },

	        "GraphDriver": {

	            "Data": {

	                "LowerDir": "/var/lib/docker/overlay2/5ab44aa2297df4f970e3b122558b75d3b3af5410dce7ea1efa8bb6b3cbf5b143-init/diff:/var/lib/docker/overlay2/27fbcff5021de980a082cd343434b8923388c3122a97247e81bdc445b5997307/diff",

	                "MergedDir": "/var/lib/docker/overlay2/5ab44aa2297df4f970e3b122558b75d3b3af5410dce7ea1efa8bb6b3cbf5b143/merged",

	                "UpperDir": "/var/lib/docker/overlay2/5ab44aa2297df4f970e3b122558b75d3b3af5410dce7ea1efa8bb6b3cbf5b143/diff",

	                "WorkDir": "/var/lib/docker/overlay2/5ab44aa2297df4f970e3b122558b75d3b3af5410dce7ea1efa8bb6b3cbf5b143/work"

	            },

	            "Name": "overlay2"

	        },

	        "Mounts": [

	            {

	                "Type": "bind",

	                "Source": "/lib/modules",

	                "Destination": "/lib/modules",

	                "Mode": "ro",

	                "RW": false,

	                "Propagation": "rprivate"

	            },

	            {

	                "Type": "volume",

	                "Name": "ingress-addon-legacy-580000",

	                "Source": "/var/lib/docker/volumes/ingress-addon-legacy-580000/_data",

	                "Destination": "/var",

	                "Driver": "local",

	                "Mode": "z",

	                "RW": true,

	                "Propagation": ""

	            }

	        ],

	        "Config": {

	            "Hostname": "ingress-addon-legacy-580000",

	            "Domainname": "",

	            "User": "",

	            "AttachStdin": false,

	            "AttachStdout": false,

	            "AttachStderr": false,

	            "ExposedPorts": {

	                "22/tcp": {},

	                "2376/tcp": {},

	                "32443/tcp": {},

	                "5000/tcp": {},

	                "8443/tcp": {}

	            },

	            "Tty": true,

	            "OpenStdin": false,

	            "StdinOnce": false,

	            "Env": [

	                "container=docker",

	                "PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"

	            ],

	            "Cmd": null,

	            "Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08",

	            "Volumes": null,

	            "WorkingDir": "/",

	            "Entrypoint": [

	                "/usr/local/bin/entrypoint",

	                "/sbin/init"

	            ],

	            "OnBuild": null,

	            "Labels": {

	                "created_by.minikube.sigs.k8s.io": "true",

	                "mode.minikube.sigs.k8s.io": "ingress-addon-legacy-580000",

	                "name.minikube.sigs.k8s.io": "ingress-addon-legacy-580000",

	                "role.minikube.sigs.k8s.io": ""

	            },

	            "StopSignal": "SIGRTMIN+3"

	        },

	        "NetworkSettings": {

	            "Bridge": "",

	            "SandboxID": "0ca97d968d3a768af6d651933bd226e78bb31eb624d6172b6311c128d57e1b3a",

	            "SandboxKey": "/var/run/docker/netns/0ca97d968d3a",

	            "Ports": {

	                "22/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "50583"

	                    }

	                ],

	                "2376/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "50584"

	                    }

	                ],

	                "32443/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "50585"

	                    }

	                ],

	                "5000/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "50581"

	                    }

	                ],

	                "8443/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "50582"

	                    }

	                ]

	            },

	            "HairpinMode": false,

	            "LinkLocalIPv6Address": "",

	            "LinkLocalIPv6PrefixLen": 0,

	            "SecondaryIPAddresses": null,

	            "SecondaryIPv6Addresses": null,

	            "EndpointID": "",

	            "Gateway": "",

	            "GlobalIPv6Address": "",

	            "GlobalIPv6PrefixLen": 0,

	            "IPAddress": "",

	            "IPPrefixLen": 0,

	            "IPv6Gateway": "",

	            "MacAddress": "",

	            "Networks": {

	                "ingress-addon-legacy-580000": {

	                    "IPAMConfig": {

	                        "IPv4Address": "192.168.49.2"

	                    },

	                    "Links": null,

	                    "Aliases": [

	                        "f832b0f68af2",

	                        "ingress-addon-legacy-580000"

	                    ],

	                    "MacAddress": "02:42:c0:a8:31:02",

	                    "NetworkID": "36d76060fb93f6b69f3df4154e14861fe2c46871f04e9dc11292fa5a8173909b",

	                    "EndpointID": "5ba69d5117ccc6f1901124e4bbaf5639369178a25edeec006e8483e772fdf010",

	                    "Gateway": "192.168.49.1",

	                    "IPAddress": "192.168.49.2",

	                    "IPPrefixLen": 24,

	                    "IPv6Gateway": "",

	                    "GlobalIPv6Address": "",

	                    "GlobalIPv6PrefixLen": 0,

	                    "DriverOpts": null,

	                    "DNSNames": [

	                        "ingress-addon-legacy-580000",

	                        "f832b0f68af2"

	                    ]

	                }

	            }

	        }

	    }

	]

-- /stdout --

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p ingress-addon-legacy-580000 -n ingress-addon-legacy-580000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p ingress-addon-legacy-580000 -n ingress-addon-legacy-580000: exit status 6 (394.113476ms)

-- stdout --

	Running

	WARNING: Your kubectl is pointing to stale minikube-vm.

	To fix the kubectl context, run `minikube update-context`

-- /stdout --

** stderr ** 

	E0229 10:00:52.645191    4534 status.go:415] kubeconfig endpoint: extract IP: "ingress-addon-legacy-580000" does not appear in /Users/jenkins/minikube-integration/18259-932/kubeconfig

** /stderr **

helpers_test.go:239: status error: exit status 6 (may be ok)

helpers_test.go:241: "ingress-addon-legacy-580000" host is not running, skipping log retrieval (state="Running\nWARNING: Your kubectl is pointing to stale minikube-vm.\nTo fix the kubectl context, run `minikube update-context`")

--- FAIL: TestIngressAddonLegacy/serial/ValidateIngressDNSAddonActivation (117.41s)

=== RUN   TestIngressAddonLegacy/serial/ValidateIngressAddons

addons_test.go:201: failed to get Kubernetes client: <nil>

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:230: ======>  post-mortem[TestIngressAddonLegacy/serial/ValidateIngressAddons]: docker inspect <======

helpers_test.go:231: (dbg) Run:  docker inspect ingress-addon-legacy-580000

helpers_test.go:235: (dbg) docker inspect ingress-addon-legacy-580000:

-- stdout --

	[

	    {

	        "Id": "f832b0f68af23cb1e06ad3bd638807b1bb6f9bf9df72de6cd9049fb37cee4125",

	        "Created": "2024-02-29T17:52:41.540717298Z",

	        "Path": "/usr/local/bin/entrypoint",

	        "Args": [

	            "/sbin/init"

	        ],

	        "State": {

	            "Status": "running",

	            "Running": true,

	            "Paused": false,

	            "Restarting": false,

	            "OOMKilled": false,

	            "Dead": false,

	            "Pid": 50257,

	            "ExitCode": 0,

	            "Error": "",

	            "StartedAt": "2024-02-29T17:52:41.758558303Z",

	            "FinishedAt": "0001-01-01T00:00:00Z"

	        },

	        "Image": "sha256:a5b872dc86053f77fb58d93168e89c4b0fa5961a7ed628d630f6cd6decd7bca0",

	        "ResolvConfPath": "/var/lib/docker/containers/f832b0f68af23cb1e06ad3bd638807b1bb6f9bf9df72de6cd9049fb37cee4125/resolv.conf",

	        "HostnamePath": "/var/lib/docker/containers/f832b0f68af23cb1e06ad3bd638807b1bb6f9bf9df72de6cd9049fb37cee4125/hostname",

	        "HostsPath": "/var/lib/docker/containers/f832b0f68af23cb1e06ad3bd638807b1bb6f9bf9df72de6cd9049fb37cee4125/hosts",

	        "LogPath": "/var/lib/docker/containers/f832b0f68af23cb1e06ad3bd638807b1bb6f9bf9df72de6cd9049fb37cee4125/f832b0f68af23cb1e06ad3bd638807b1bb6f9bf9df72de6cd9049fb37cee4125-json.log",

	        "Name": "/ingress-addon-legacy-580000",

	        "RestartCount": 0,

	        "Driver": "overlay2",

	        "Platform": "linux",

	        "MountLabel": "",

	        "ProcessLabel": "",

	        "AppArmorProfile": "",

	        "ExecIDs": null,

	        "HostConfig": {

	            "Binds": [

	                "/lib/modules:/lib/modules:ro",

	                "ingress-addon-legacy-580000:/var"

	            ],

	            "ContainerIDFile": "",

	            "LogConfig": {

	                "Type": "json-file",

	                "Config": {}

	            },

	            "NetworkMode": "ingress-addon-legacy-580000",

	            "PortBindings": {

	                "22/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "0"

	                    }

	                ],

	                "2376/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "0"

	                    }

	                ],

	                "32443/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "0"

	                    }

	                ],

	                "5000/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "0"

	                    }

	                ],

	                "8443/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "0"

	                    }

	                ]

	            },

	            "RestartPolicy": {

	                "Name": "no",

	                "MaximumRetryCount": 0

	            },

	            "AutoRemove": false,

	            "VolumeDriver": "",

	            "VolumesFrom": null,

	            "ConsoleSize": [

	                0,

	                0

	            ],

	            "CapAdd": null,

	            "CapDrop": null,

	            "CgroupnsMode": "private",

	            "Dns": [],

	            "DnsOptions": [],

	            "DnsSearch": [],

	            "ExtraHosts": null,

	            "GroupAdd": null,

	            "IpcMode": "private",

	            "Cgroup": "",

	            "Links": null,

	            "OomScoreAdj": 0,

	            "PidMode": "",

	            "Privileged": true,

	            "PublishAllPorts": false,

	            "ReadonlyRootfs": false,

	            "SecurityOpt": [

	                "seccomp=unconfined",

	                "apparmor=unconfined",

	                "label=disable"

	            ],

	            "Tmpfs": {

	                "/run": "",

	                "/tmp": ""

	            },

	            "UTSMode": "",

	            "UsernsMode": "",

	            "ShmSize": 67108864,

	            "Runtime": "runc",

	            "Isolation": "",

	            "CpuShares": 0,

	            "Memory": 4294967296,

	            "NanoCpus": 2000000000,

	            "CgroupParent": "",

	            "BlkioWeight": 0,

	            "BlkioWeightDevice": [],

	            "BlkioDeviceReadBps": [],

	            "BlkioDeviceWriteBps": [],

	            "BlkioDeviceReadIOps": [],

	            "BlkioDeviceWriteIOps": [],

	            "CpuPeriod": 0,

	            "CpuQuota": 0,

	            "CpuRealtimePeriod": 0,

	            "CpuRealtimeRuntime": 0,

	            "CpusetCpus": "",

	            "CpusetMems": "",

	            "Devices": [],

	            "DeviceCgroupRules": null,

	            "DeviceRequests": null,

	            "MemoryReservation": 0,

	            "MemorySwap": 4294967296,

	            "MemorySwappiness": null,

	            "OomKillDisable": null,

	            "PidsLimit": null,

	            "Ulimits": [],

	            "CpuCount": 0,

	            "CpuPercent": 0,

	            "IOMaximumIOps": 0,

	            "IOMaximumBandwidth": 0,

	            "MaskedPaths": null,

	            "ReadonlyPaths": null

	        },

	        "GraphDriver": {

	            "Data": {

	                "LowerDir": "/var/lib/docker/overlay2/5ab44aa2297df4f970e3b122558b75d3b3af5410dce7ea1efa8bb6b3cbf5b143-init/diff:/var/lib/docker/overlay2/27fbcff5021de980a082cd343434b8923388c3122a97247e81bdc445b5997307/diff",

	                "MergedDir": "/var/lib/docker/overlay2/5ab44aa2297df4f970e3b122558b75d3b3af5410dce7ea1efa8bb6b3cbf5b143/merged",

	                "UpperDir": "/var/lib/docker/overlay2/5ab44aa2297df4f970e3b122558b75d3b3af5410dce7ea1efa8bb6b3cbf5b143/diff",

	                "WorkDir": "/var/lib/docker/overlay2/5ab44aa2297df4f970e3b122558b75d3b3af5410dce7ea1efa8bb6b3cbf5b143/work"

	            },

	            "Name": "overlay2"

	        },

	        "Mounts": [

	            {

	                "Type": "bind",

	                "Source": "/lib/modules",

	                "Destination": "/lib/modules",

	                "Mode": "ro",

	                "RW": false,

	                "Propagation": "rprivate"

	            },

	            {

	                "Type": "volume",

	                "Name": "ingress-addon-legacy-580000",

	                "Source": "/var/lib/docker/volumes/ingress-addon-legacy-580000/_data",

	                "Destination": "/var",

	                "Driver": "local",

	                "Mode": "z",

	                "RW": true,

	                "Propagation": ""

	            }

	        ],

	        "Config": {

	            "Hostname": "ingress-addon-legacy-580000",

	            "Domainname": "",

	            "User": "",

	            "AttachStdin": false,

	            "AttachStdout": false,

	            "AttachStderr": false,

	            "ExposedPorts": {

	                "22/tcp": {},

	                "2376/tcp": {},

	                "32443/tcp": {},

	                "5000/tcp": {},

	                "8443/tcp": {}

	            },

	            "Tty": true,

	            "OpenStdin": false,

	            "StdinOnce": false,

	            "Env": [

	                "container=docker",

	                "PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"

	            ],

	            "Cmd": null,

	            "Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08",

	            "Volumes": null,

	            "WorkingDir": "/",

	            "Entrypoint": [

	                "/usr/local/bin/entrypoint",

	                "/sbin/init"

	            ],

	            "OnBuild": null,

	            "Labels": {

	                "created_by.minikube.sigs.k8s.io": "true",

	                "mode.minikube.sigs.k8s.io": "ingress-addon-legacy-580000",

	                "name.minikube.sigs.k8s.io": "ingress-addon-legacy-580000",

	                "role.minikube.sigs.k8s.io": ""

	            },

	            "StopSignal": "SIGRTMIN+3"

	        },

	        "NetworkSettings": {

	            "Bridge": "",

	            "SandboxID": "0ca97d968d3a768af6d651933bd226e78bb31eb624d6172b6311c128d57e1b3a",

	            "SandboxKey": "/var/run/docker/netns/0ca97d968d3a",

	            "Ports": {

	                "22/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "50583"

	                    }

	                ],

	                "2376/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "50584"

	                    }

	                ],

	                "32443/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "50585"

	                    }

	                ],

	                "5000/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "50581"

	                    }

	                ],

	                "8443/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "50582"

	                    }

	                ]

	            },

	            "HairpinMode": false,

	            "LinkLocalIPv6Address": "",

	            "LinkLocalIPv6PrefixLen": 0,

	            "SecondaryIPAddresses": null,

	            "SecondaryIPv6Addresses": null,

	            "EndpointID": "",

	            "Gateway": "",

	            "GlobalIPv6Address": "",

	            "GlobalIPv6PrefixLen": 0,

	            "IPAddress": "",

	            "IPPrefixLen": 0,

	            "IPv6Gateway": "",

	            "MacAddress": "",

	            "Networks": {

	                "ingress-addon-legacy-580000": {

	                    "IPAMConfig": {

	                        "IPv4Address": "192.168.49.2"

	                    },

	                    "Links": null,

	                    "Aliases": [

	                        "f832b0f68af2",

	                        "ingress-addon-legacy-580000"

	                    ],

	                    "MacAddress": "02:42:c0:a8:31:02",

	                    "NetworkID": "36d76060fb93f6b69f3df4154e14861fe2c46871f04e9dc11292fa5a8173909b",

	                    "EndpointID": "5ba69d5117ccc6f1901124e4bbaf5639369178a25edeec006e8483e772fdf010",

	                    "Gateway": "192.168.49.1",

	                    "IPAddress": "192.168.49.2",

	                    "IPPrefixLen": 24,

	                    "IPv6Gateway": "",

	                    "GlobalIPv6Address": "",

	                    "GlobalIPv6PrefixLen": 0,

	                    "DriverOpts": null,

	                    "DNSNames": [

	                        "ingress-addon-legacy-580000",

	                        "f832b0f68af2"

	                    ]

	                }

	            }

	        }

	    }

	]

-- /stdout --

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p ingress-addon-legacy-580000 -n ingress-addon-legacy-580000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p ingress-addon-legacy-580000 -n ingress-addon-legacy-580000: exit status 6 (393.375821ms)

-- stdout --

	Running

	WARNING: Your kubectl is pointing to stale minikube-vm.

	To fix the kubectl context, run `minikube update-context`

-- /stdout --

** stderr ** 

	E0229 10:00:53.089362    4546 status.go:415] kubeconfig endpoint: extract IP: "ingress-addon-legacy-580000" does not appear in /Users/jenkins/minikube-integration/18259-932/kubeconfig

** /stderr **

helpers_test.go:239: status error: exit status 6 (may be ok)

helpers_test.go:241: "ingress-addon-legacy-580000" host is not running, skipping log retrieval (state="Running\nWARNING: Your kubectl is pointing to stale minikube-vm.\nTo fix the kubectl context, run `minikube update-context`")

--- FAIL: TestIngressAddonLegacy/serial/ValidateIngressAddons (0.44s)

=== RUN   TestMountStart/serial/VerifyMountPostStop

mount_start_test.go:114: (dbg) Run:  out/minikube-darwin-amd64 -p mount-start-2-409000 ssh -- ls /minikube-host

E0229 10:05:42.038287    1408 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/18259-932/.minikube/profiles/addons-551000/client.crt: no such file or directory

E0229 10:09:18.986866    1408 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/18259-932/.minikube/profiles/addons-551000/client.crt: no such file or directory

E0229 10:09:50.607990    1408 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/18259-932/.minikube/profiles/functional-081000/client.crt: no such file or directory

E0229 10:11:13.659654    1408 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/18259-932/.minikube/profiles/functional-081000/client.crt: no such file or directory

E0229 10:14:19.017022    1408 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/18259-932/.minikube/profiles/addons-551000/client.crt: no such file or directory

E0229 10:14:50.638205    1408 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/18259-932/.minikube/profiles/functional-081000/client.crt: no such file or directory

E0229 10:19:19.013941    1408 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/18259-932/.minikube/profiles/addons-551000/client.crt: no such file or directory

E0229 10:19:50.633596    1408 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/18259-932/.minikube/profiles/functional-081000/client.crt: no such file or directory

mount_start_test.go:114: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p mount-start-2-409000 ssh -- ls /minikube-host: signal: killed (14m30.293259617s)

mount_start_test.go:116: mount failed: "out/minikube-darwin-amd64 -p mount-start-2-409000 ssh -- ls /minikube-host" : signal: killed

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:230: ======>  post-mortem[TestMountStart/serial/VerifyMountPostStop]: docker inspect <======

helpers_test.go:231: (dbg) Run:  docker inspect mount-start-2-409000

helpers_test.go:235: (dbg) docker inspect mount-start-2-409000:

-- stdout --

	[

	    {

	        "Id": "24082ce86eacf23f8366662a8e381d2290ea22e5fa9e7e53ecbd20776e8efea9",

	        "Created": "2024-02-29T18:05:03.248613049Z",

	        "Path": "/usr/local/bin/entrypoint",

	        "Args": [

	            "/sbin/init"

	        ],

	        "State": {

	            "Status": "running",

	            "Running": true,

	            "Paused": false,

	            "Restarting": false,

	            "OOMKilled": false,

	            "Dead": false,

	            "Pid": 106444,

	            "ExitCode": 0,

	            "Error": "",

	            "StartedAt": "2024-02-29T18:05:15.075312917Z",

	            "FinishedAt": "2024-02-29T18:05:12.302056262Z"

	        },

	        "Image": "sha256:a5b872dc86053f77fb58d93168e89c4b0fa5961a7ed628d630f6cd6decd7bca0",

	        "ResolvConfPath": "/var/lib/docker/containers/24082ce86eacf23f8366662a8e381d2290ea22e5fa9e7e53ecbd20776e8efea9/resolv.conf",

	        "HostnamePath": "/var/lib/docker/containers/24082ce86eacf23f8366662a8e381d2290ea22e5fa9e7e53ecbd20776e8efea9/hostname",

	        "HostsPath": "/var/lib/docker/containers/24082ce86eacf23f8366662a8e381d2290ea22e5fa9e7e53ecbd20776e8efea9/hosts",

	        "LogPath": "/var/lib/docker/containers/24082ce86eacf23f8366662a8e381d2290ea22e5fa9e7e53ecbd20776e8efea9/24082ce86eacf23f8366662a8e381d2290ea22e5fa9e7e53ecbd20776e8efea9-json.log",

	        "Name": "/mount-start-2-409000",

	        "RestartCount": 0,

	        "Driver": "overlay2",

	        "Platform": "linux",

	        "MountLabel": "",

	        "ProcessLabel": "",

	        "AppArmorProfile": "",

	        "ExecIDs": null,

	        "HostConfig": {

	            "Binds": [

	                "/lib/modules:/lib/modules:ro",

	                "mount-start-2-409000:/var",

	                "/host_mnt/Users:/minikube-host"

	            ],

	            "ContainerIDFile": "",

	            "LogConfig": {

	                "Type": "json-file",

	                "Config": {}

	            },

	            "NetworkMode": "mount-start-2-409000",

	            "PortBindings": {

	                "22/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "0"

	                    }

	                ],

	                "2376/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "0"

	                    }

	                ],

	                "32443/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "0"

	                    }

	                ],

	                "5000/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "0"

	                    }

	                ],

	                "8443/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "0"

	                    }

	                ]

	            },

	            "RestartPolicy": {

	                "Name": "no",

	                "MaximumRetryCount": 0

	            },

	            "AutoRemove": false,

	            "VolumeDriver": "",

	            "VolumesFrom": null,

	            "ConsoleSize": [

	                0,

	                0

	            ],

	            "CapAdd": null,

	            "CapDrop": null,

	            "CgroupnsMode": "private",

	            "Dns": [],

	            "DnsOptions": [],

	            "DnsSearch": [],

	            "ExtraHosts": null,

	            "GroupAdd": null,

	            "IpcMode": "private",

	            "Cgroup": "",

	            "Links": null,

	            "OomScoreAdj": 0,

	            "PidMode": "",

	            "Privileged": true,

	            "PublishAllPorts": false,

	            "ReadonlyRootfs": false,

	            "SecurityOpt": [

	                "seccomp=unconfined",

	                "apparmor=unconfined",

	                "label=disable"

	            ],

	            "Tmpfs": {

	                "/run": "",

	                "/tmp": ""

	            },

	            "UTSMode": "",

	            "UsernsMode": "",

	            "ShmSize": 67108864,

	            "Runtime": "runc",

	            "Isolation": "",

	            "CpuShares": 0,

	            "Memory": 2147483648,

	            "NanoCpus": 2000000000,

	            "CgroupParent": "",

	            "BlkioWeight": 0,

	            "BlkioWeightDevice": [],

	            "BlkioDeviceReadBps": [],

	            "BlkioDeviceWriteBps": [],

	            "BlkioDeviceReadIOps": [],

	            "BlkioDeviceWriteIOps": [],

	            "CpuPeriod": 0,

	            "CpuQuota": 0,

	            "CpuRealtimePeriod": 0,

	            "CpuRealtimeRuntime": 0,

	            "CpusetCpus": "",

	            "CpusetMems": "",

	            "Devices": [],

	            "DeviceCgroupRules": null,

	            "DeviceRequests": null,

	            "MemoryReservation": 0,

	            "MemorySwap": 2147483648,

	            "MemorySwappiness": null,

	            "OomKillDisable": null,

	            "PidsLimit": null,

	            "Ulimits": [],

	            "CpuCount": 0,

	            "CpuPercent": 0,

	            "IOMaximumIOps": 0,

	            "IOMaximumBandwidth": 0,

	            "MaskedPaths": null,

	            "ReadonlyPaths": null

	        },

	        "GraphDriver": {

	            "Data": {

	                "LowerDir": "/var/lib/docker/overlay2/d4501273d30cb452e6d131765a4315ecdf65174ae6e9dc8912af831da83b8586-init/diff:/var/lib/docker/overlay2/27fbcff5021de980a082cd343434b8923388c3122a97247e81bdc445b5997307/diff",

	                "MergedDir": "/var/lib/docker/overlay2/d4501273d30cb452e6d131765a4315ecdf65174ae6e9dc8912af831da83b8586/merged",

	                "UpperDir": "/var/lib/docker/overlay2/d4501273d30cb452e6d131765a4315ecdf65174ae6e9dc8912af831da83b8586/diff",

	                "WorkDir": "/var/lib/docker/overlay2/d4501273d30cb452e6d131765a4315ecdf65174ae6e9dc8912af831da83b8586/work"

	            },

	            "Name": "overlay2"

	        },

	        "Mounts": [

	            {

	                "Type": "bind",

	                "Source": "/lib/modules",

	                "Destination": "/lib/modules",

	                "Mode": "ro",

	                "RW": false,

	                "Propagation": "rprivate"

	            },

	            {

	                "Type": "volume",

	                "Name": "mount-start-2-409000",

	                "Source": "/var/lib/docker/volumes/mount-start-2-409000/_data",

	                "Destination": "/var",

	                "Driver": "local",

	                "Mode": "z",

	                "RW": true,

	                "Propagation": ""

	            },

	            {

	                "Type": "bind",

	                "Source": "/host_mnt/Users",

	                "Destination": "/minikube-host",

	                "Mode": "",

	                "RW": true,

	                "Propagation": "rprivate"

	            }

	        ],

	        "Config": {

	            "Hostname": "mount-start-2-409000",

	            "Domainname": "",

	            "User": "",

	            "AttachStdin": false,

	            "AttachStdout": false,

	            "AttachStderr": false,

	            "ExposedPorts": {

	                "22/tcp": {},

	                "2376/tcp": {},

	                "32443/tcp": {},

	                "5000/tcp": {},

	                "8443/tcp": {}

	            },

	            "Tty": true,

	            "OpenStdin": false,

	            "StdinOnce": false,

	            "Env": [

	                "container=docker",

	                "PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"

	            ],

	            "Cmd": null,

	            "Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08",

	            "Volumes": null,

	            "WorkingDir": "/",

	            "Entrypoint": [

	                "/usr/local/bin/entrypoint",

	                "/sbin/init"

	            ],

	            "OnBuild": null,

	            "Labels": {

	                "created_by.minikube.sigs.k8s.io": "true",

	                "mode.minikube.sigs.k8s.io": "mount-start-2-409000",

	                "name.minikube.sigs.k8s.io": "mount-start-2-409000",

	                "role.minikube.sigs.k8s.io": ""

	            },

	            "StopSignal": "SIGRTMIN+3"

	        },

	        "NetworkSettings": {

	            "Bridge": "",

	            "SandboxID": "ecd3e8176454dce27e122ea392f63649459742e5317dce50831b695806569f5d",

	            "SandboxKey": "/var/run/docker/netns/ecd3e8176454",

	            "Ports": {

	                "22/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "50930"

	                    }

	                ],

	                "2376/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "50926"

	                    }

	                ],

	                "32443/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "50927"

	                    }

	                ],

	                "5000/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "50928"

	                    }

	                ],

	                "8443/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "50929"

	                    }

	                ]

	            },

	            "HairpinMode": false,

	            "LinkLocalIPv6Address": "",

	            "LinkLocalIPv6PrefixLen": 0,

	            "SecondaryIPAddresses": null,

	            "SecondaryIPv6Addresses": null,

	            "EndpointID": "",

	            "Gateway": "",

	            "GlobalIPv6Address": "",

	            "GlobalIPv6PrefixLen": 0,

	            "IPAddress": "",

	            "IPPrefixLen": 0,

	            "IPv6Gateway": "",

	            "MacAddress": "",

	            "Networks": {

	                "mount-start-2-409000": {

	                    "IPAMConfig": {

	                        "IPv4Address": "192.168.67.2"

	                    },

	                    "Links": null,

	                    "Aliases": [

	                        "24082ce86eac",

	                        "mount-start-2-409000"

	                    ],

	                    "MacAddress": "02:42:c0:a8:43:02",

	                    "NetworkID": "8bd5bb226166634b2077d833be4648e91ee352f9a02dcd5e834ada30c2f88b36",

	                    "EndpointID": "9ea8dac2f2a86a888e331948e204857af7f7c6302c3162f641f55077399cb48e",

	                    "Gateway": "192.168.67.1",

	                    "IPAddress": "192.168.67.2",

	                    "IPPrefixLen": 24,

	                    "IPv6Gateway": "",

	                    "GlobalIPv6Address": "",

	                    "GlobalIPv6PrefixLen": 0,

	                    "DriverOpts": null,

	                    "DNSNames": [

	                        "mount-start-2-409000",

	                        "24082ce86eac"

	                    ]

	                }

	            }

	        }

	    }

	]

-- /stdout --

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p mount-start-2-409000 -n mount-start-2-409000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p mount-start-2-409000 -n mount-start-2-409000: exit status 6 (388.247263ms)

-- stdout --

	Running

	WARNING: Your kubectl is pointing to stale minikube-vm.

	To fix the kubectl context, run `minikube update-context`

-- /stdout --

** stderr ** 

	E0229 10:19:53.292747    6473 status.go:415] kubeconfig endpoint: extract IP: "mount-start-2-409000" does not appear in /Users/jenkins/minikube-integration/18259-932/kubeconfig

** /stderr **

helpers_test.go:239: status error: exit status 6 (may be ok)

helpers_test.go:241: "mount-start-2-409000" host is not running, skipping log retrieval (state="Running\nWARNING: Your kubectl is pointing to stale minikube-vm.\nTo fix the kubectl context, run `minikube update-context`")

--- FAIL: TestMountStart/serial/VerifyMountPostStop (870.74s)

=== RUN   TestMultiNode/serial/FreshStart2Nodes

multinode_test.go:86: (dbg) Run:  out/minikube-darwin-amd64 start -p multinode-636000 --wait=true --memory=2200 --nodes=2 -v=8 --alsologtostderr --driver=docker 

E0229 10:22:22.059737    1408 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/18259-932/.minikube/profiles/addons-551000/client.crt: no such file or directory

E0229 10:24:19.009762    1408 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/18259-932/.minikube/profiles/addons-551000/client.crt: no such file or directory

E0229 10:24:50.630546    1408 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/18259-932/.minikube/profiles/functional-081000/client.crt: no such file or directory

E0229 10:27:53.680142    1408 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/18259-932/.minikube/profiles/functional-081000/client.crt: no such file or directory

E0229 10:29:19.004895    1408 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/18259-932/.minikube/profiles/addons-551000/client.crt: no such file or directory

E0229 10:29:50.626432    1408 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/18259-932/.minikube/profiles/functional-081000/client.crt: no such file or directory

multinode_test.go:86: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p multinode-636000 --wait=true --memory=2200 --nodes=2 -v=8 --alsologtostderr --driver=docker : exit status 52 (12m30.528811522s)

-- stdout --

	* [multinode-636000] minikube v1.32.0 on Darwin 14.3.1

	  - MINIKUBE_LOCATION=18259

	  - KUBECONFIG=/Users/jenkins/minikube-integration/18259-932/kubeconfig

	  - MINIKUBE_BIN=out/minikube-darwin-amd64

	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18259-932/.minikube

	  - MINIKUBE_FORCE_SYSTEMD=

	* Using the docker driver based on user configuration

	* Using Docker Desktop driver with root privileges

	* Starting control plane node multinode-636000 in cluster multinode-636000

	* Pulling base image v0.0.42-1708944392-18244 ...

	* Creating docker container (CPUs=2, Memory=2200MB) ...

	* docker "multinode-636000" container is missing, will recreate.

	* Creating docker container (CPUs=2, Memory=2200MB) ...

-- /stdout --

** stderr ** 

	I0229 10:21:02.357475    6570 out.go:291] Setting OutFile to fd 1 ...

	I0229 10:21:02.358068    6570 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0229 10:21:02.358080    6570 out.go:304] Setting ErrFile to fd 2...

	I0229 10:21:02.358086    6570 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0229 10:21:02.358399    6570 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18259-932/.minikube/bin

	I0229 10:21:02.379594    6570 out.go:298] Setting JSON to false

	I0229 10:21:02.402038    6570 start.go:129] hostinfo: {"hostname":"MacOS-Agent-1.local","uptime":3032,"bootTime":1709227830,"procs":477,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"b7610dcb-1435-5842-8d5a-b2388403fea3"}

	W0229 10:21:02.402141    6570 start.go:137] gopshost.Virtualization returned error: not implemented yet

	I0229 10:21:02.423228    6570 out.go:177] * [multinode-636000] minikube v1.32.0 on Darwin 14.3.1

	I0229 10:21:02.465617    6570 out.go:177]   - MINIKUBE_LOCATION=18259

	I0229 10:21:02.465688    6570 notify.go:220] Checking for updates...

	I0229 10:21:02.508429    6570 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/18259-932/kubeconfig

	I0229 10:21:02.550306    6570 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64

	I0229 10:21:02.571372    6570 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I0229 10:21:02.592421    6570 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18259-932/.minikube

	I0229 10:21:02.613180    6570 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=

	I0229 10:21:02.634964    6570 driver.go:392] Setting default libvirt URI to qemu:///system

	I0229 10:21:02.691792    6570 docker.go:122] docker version: linux-25.0.3:Docker Desktop 4.27.2 (137060)

	I0229 10:21:02.691959    6570 cli_runner.go:164] Run: docker system info --format "{{json .}}"

	I0229 10:21:02.792772    6570 info.go:266] docker info: {ID:37b3081a-8cd6-457e-b2a4-79dc82345b06 Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:2 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:81 OomKillDisable:false NGoroutines:115 SystemTime:2024-02-29 18:21:02.782493928 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:26 KernelVersion:6.6.12-linuxkit OperatingSystem:Docker Desktop OSType:linux Architecture:x86_64 IndexServerAddress:

https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:12 MemTotal:6213292032 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy:http.docker.internal:3128 HTTPSProxy:http.docker.internal:3128 NoProxy:hubproxy.docker.internal Name:docker-desktop Labels:[] ExperimentalBuild:false ServerVersion:25.0.3 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:ae07eda36dd25f8a1b98dfbf587313b99c0190bb Expected:ae07eda36dd25f8a1b98dfbf587313b99c0190bb} RuncCommit:{ID:v1.1.12-0-g51d5e94 Expected:v1.1.12-0-g51d5e94} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=seccomp,profile=unconfined name

=cgroupns] ProductLicense: Warnings:[WARNING: daemon is not using the default seccomp profile] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/Users/jenkins/.docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-buildx] ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.12.1-desktop.4] map[Name:compose Path:/Users/jenkins/.docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-compose] ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.24.5-desktop.1] map[Name:debug Path:/Users/jenkins/.docker/cli-plugins/docker-debug SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-debug] ShortDescription:Get a shell into any image or container. Vendor:Docker Inc. Version:0.0.24] map[Name:dev Path:/Users/jenkins/.docker/cli-plugins/docker-dev SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-dev] ShortDescription:Docker D

ev Environments Vendor:Docker Inc. Version:v0.1.0] map[Name:extension Path:/Users/jenkins/.docker/cli-plugins/docker-extension SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-extension] ShortDescription:Manages Docker extensions Vendor:Docker Inc. Version:v0.2.21] map[Name:feedback Path:/Users/jenkins/.docker/cli-plugins/docker-feedback SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-feedback] ShortDescription:Provide feedback, right in your terminal! Vendor:Docker Inc. Version:v1.0.4] map[Name:init Path:/Users/jenkins/.docker/cli-plugins/docker-init SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-init] ShortDescription:Creates Docker-related starter files for your project Vendor:Docker Inc. Version:v1.0.0] map[Name:sbom Path:/Users/jenkins/.docker/cli-plugins/docker-sbom SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-sbom] ShortDescription:View the packaged-based Software Bill Of Materials (SBOM)

for an image URL:https://github.com/docker/sbom-cli-plugin Vendor:Anchore Inc. Version:0.6.0] map[Err:failed to fetch metadata: fork/exec /Users/jenkins/.docker/cli-plugins/docker-scan: no such file or directory Name:scan Path:/Users/jenkins/.docker/cli-plugins/docker-scan] map[Name:scout Path:/Users/jenkins/.docker/cli-plugins/docker-scout SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-scout] ShortDescription:Docker Scout Vendor:Docker Inc. Version:v1.4.1]] Warnings:<nil>}}

	I0229 10:21:02.835541    6570 out.go:177] * Using the docker driver based on user configuration

	I0229 10:21:02.856781    6570 start.go:299] selected driver: docker

	I0229 10:21:02.856809    6570 start.go:903] validating driver "docker" against <nil>

	I0229 10:21:02.856823    6570 start.go:914] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}

	I0229 10:21:02.861259    6570 cli_runner.go:164] Run: docker system info --format "{{json .}}"

	I0229 10:21:02.960588    6570 info.go:266] docker info: {ID:37b3081a-8cd6-457e-b2a4-79dc82345b06 Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:2 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:81 OomKillDisable:false NGoroutines:115 SystemTime:2024-02-29 18:21:02.951049315 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:26 KernelVersion:6.6.12-linuxkit OperatingSystem:Docker Desktop OSType:linux Architecture:x86_64 IndexServerAddress:

https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:12 MemTotal:6213292032 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy:http.docker.internal:3128 HTTPSProxy:http.docker.internal:3128 NoProxy:hubproxy.docker.internal Name:docker-desktop Labels:[] ExperimentalBuild:false ServerVersion:25.0.3 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:ae07eda36dd25f8a1b98dfbf587313b99c0190bb Expected:ae07eda36dd25f8a1b98dfbf587313b99c0190bb} RuncCommit:{ID:v1.1.12-0-g51d5e94 Expected:v1.1.12-0-g51d5e94} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=seccomp,profile=unconfined name

=cgroupns] ProductLicense: Warnings:[WARNING: daemon is not using the default seccomp profile] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/Users/jenkins/.docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-buildx] ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.12.1-desktop.4] map[Name:compose Path:/Users/jenkins/.docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-compose] ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.24.5-desktop.1] map[Name:debug Path:/Users/jenkins/.docker/cli-plugins/docker-debug SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-debug] ShortDescription:Get a shell into any image or container. Vendor:Docker Inc. Version:0.0.24] map[Name:dev Path:/Users/jenkins/.docker/cli-plugins/docker-dev SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-dev] ShortDescription:Docker D

ev Environments Vendor:Docker Inc. Version:v0.1.0] map[Name:extension Path:/Users/jenkins/.docker/cli-plugins/docker-extension SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-extension] ShortDescription:Manages Docker extensions Vendor:Docker Inc. Version:v0.2.21] map[Name:feedback Path:/Users/jenkins/.docker/cli-plugins/docker-feedback SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-feedback] ShortDescription:Provide feedback, right in your terminal! Vendor:Docker Inc. Version:v1.0.4] map[Name:init Path:/Users/jenkins/.docker/cli-plugins/docker-init SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-init] ShortDescription:Creates Docker-related starter files for your project Vendor:Docker Inc. Version:v1.0.0] map[Name:sbom Path:/Users/jenkins/.docker/cli-plugins/docker-sbom SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-sbom] ShortDescription:View the packaged-based Software Bill Of Materials (SBOM)

for an image URL:https://github.com/docker/sbom-cli-plugin Vendor:Anchore Inc. Version:0.6.0] map[Err:failed to fetch metadata: fork/exec /Users/jenkins/.docker/cli-plugins/docker-scan: no such file or directory Name:scan Path:/Users/jenkins/.docker/cli-plugins/docker-scan] map[Name:scout Path:/Users/jenkins/.docker/cli-plugins/docker-scout SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-scout] ShortDescription:Docker Scout Vendor:Docker Inc. Version:v1.4.1]] Warnings:<nil>}}

	I0229 10:21:02.960801    6570 start_flags.go:309] no existing cluster config was found, will generate one from the flags 

	I0229 10:21:02.960977    6570 start_flags.go:931] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]

	I0229 10:21:02.982164    6570 out.go:177] * Using Docker Desktop driver with root privileges

	I0229 10:21:03.003717    6570 cni.go:84] Creating CNI manager for ""

	I0229 10:21:03.003742    6570 cni.go:136] 0 nodes found, recommending kindnet

	I0229 10:21:03.003751    6570 start_flags.go:318] Found "CNI" CNI - setting NetworkPlugin=cni

	I0229 10:21:03.003765    6570 start_flags.go:323] config:

	{Name:multinode-636000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:multinode-636000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:do

cker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I0229 10:21:03.025683    6570 out.go:177] * Starting control plane node multinode-636000 in cluster multinode-636000

	I0229 10:21:03.067566    6570 cache.go:121] Beginning downloading kic base image for docker with docker

	I0229 10:21:03.088837    6570 out.go:177] * Pulling base image v0.0.42-1708944392-18244 ...

	I0229 10:21:03.130772    6570 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker

	I0229 10:21:03.130815    6570 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 in local docker daemon

	I0229 10:21:03.130846    6570 preload.go:148] Found local preload: /Users/jenkins/minikube-integration/18259-932/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4

	I0229 10:21:03.130867    6570 cache.go:56] Caching tarball of preloaded images

	I0229 10:21:03.131109    6570 preload.go:174] Found /Users/jenkins/minikube-integration/18259-932/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4 in cache, skipping download

	I0229 10:21:03.131126    6570 cache.go:59] Finished verifying existence of preloaded tar for  v1.28.4 on docker

	I0229 10:21:03.132406    6570 profile.go:148] Saving config to /Users/jenkins/minikube-integration/18259-932/.minikube/profiles/multinode-636000/config.json ...

	I0229 10:21:03.132496    6570 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/18259-932/.minikube/profiles/multinode-636000/config.json: {Name:mk3a0bbfc816e7dde21d389e00e5258fc618caa7 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0229 10:21:03.180889    6570 image.go:83] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 in local docker daemon, skipping pull

	I0229 10:21:03.180912    6570 cache.go:144] gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 exists in daemon, skipping load

	I0229 10:21:03.180926    6570 cache.go:194] Successfully downloaded all kic artifacts

	I0229 10:21:03.180964    6570 start.go:365] acquiring machines lock for multinode-636000: {Name:mk724cab9aafa05d3a600dc983677a58b42dc1e0 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0229 10:21:03.181107    6570 start.go:369] acquired machines lock for "multinode-636000" in 131.63µs

	I0229 10:21:03.181131    6570 start.go:93] Provisioning new machine with config: &{Name:multinode-636000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:multinode-636000 Namespace:default APIServerName:miniku

beCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false Disa

bleMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}

	I0229 10:21:03.181191    6570 start.go:125] createHost starting for "" (driver="docker")

	I0229 10:21:03.224925    6570 out.go:204] * Creating docker container (CPUs=2, Memory=2200MB) ...

	I0229 10:21:03.225289    6570 start.go:159] libmachine.API.Create for "multinode-636000" (driver="docker")

	I0229 10:21:03.225343    6570 client.go:168] LocalClient.Create starting

	I0229 10:21:03.225522    6570 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18259-932/.minikube/certs/ca.pem

	I0229 10:21:03.225616    6570 main.go:141] libmachine: Decoding PEM data...

	I0229 10:21:03.225642    6570 main.go:141] libmachine: Parsing certificate...

	I0229 10:21:03.225734    6570 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18259-932/.minikube/certs/cert.pem

	I0229 10:21:03.225803    6570 main.go:141] libmachine: Decoding PEM data...

	I0229 10:21:03.225831    6570 main.go:141] libmachine: Parsing certificate...

	I0229 10:21:03.226722    6570 cli_runner.go:164] Run: docker network inspect multinode-636000 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"

	W0229 10:21:03.277029    6570 cli_runner.go:211] docker network inspect multinode-636000 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1

	I0229 10:21:03.277124    6570 network_create.go:281] running [docker network inspect multinode-636000] to gather additional debugging logs...

	I0229 10:21:03.277150    6570 cli_runner.go:164] Run: docker network inspect multinode-636000

	W0229 10:21:03.326394    6570 cli_runner.go:211] docker network inspect multinode-636000 returned with exit code 1

	I0229 10:21:03.326425    6570 network_create.go:284] error running [docker network inspect multinode-636000]: docker network inspect multinode-636000: exit status 1

	stdout:

	[]

	stderr:

	Error response from daemon: network multinode-636000 not found

	I0229 10:21:03.326439    6570 network_create.go:286] output of [docker network inspect multinode-636000]: -- stdout --

	[]

	-- /stdout --

	** stderr ** 

	Error response from daemon: network multinode-636000 not found

	** /stderr **

	I0229 10:21:03.326561    6570 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"

	I0229 10:21:03.377277    6570 network.go:210] skipping subnet 192.168.49.0/24 that is reserved: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:<nil>}

	I0229 10:21:03.377657    6570 network.go:207] using free private subnet 192.168.58.0/24: &{IP:192.168.58.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.58.0/24 Gateway:192.168.58.1 ClientMin:192.168.58.2 ClientMax:192.168.58.254 Broadcast:192.168.58.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc00232d460}

	I0229 10:21:03.377680    6570 network_create.go:124] attempt to create docker network multinode-636000 192.168.58.0/24 with gateway 192.168.58.1 and MTU of 65535 ...

	I0229 10:21:03.377748    6570 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.58.0/24 --gateway=192.168.58.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=65535 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=multinode-636000 multinode-636000

	I0229 10:21:03.462706    6570 network_create.go:108] docker network multinode-636000 192.168.58.0/24 created

	I0229 10:21:03.462744    6570 kic.go:121] calculated static IP "192.168.58.2" for the "multinode-636000" container

	I0229 10:21:03.462859    6570 cli_runner.go:164] Run: docker ps -a --format {{.Names}}

	I0229 10:21:03.512596    6570 cli_runner.go:164] Run: docker volume create multinode-636000 --label name.minikube.sigs.k8s.io=multinode-636000 --label created_by.minikube.sigs.k8s.io=true

	I0229 10:21:03.563064    6570 oci.go:103] Successfully created a docker volume multinode-636000

	I0229 10:21:03.563195    6570 cli_runner.go:164] Run: docker run --rm --name multinode-636000-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=multinode-636000 --entrypoint /usr/bin/test -v multinode-636000:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 -d /var/lib

	I0229 10:21:03.946019    6570 oci.go:107] Successfully prepared a docker volume multinode-636000

	I0229 10:21:03.946078    6570 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker

	I0229 10:21:03.946090    6570 kic.go:194] Starting extracting preloaded images to volume ...

	I0229 10:21:03.946197    6570 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v /Users/jenkins/minikube-integration/18259-932/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4:/preloaded.tar:ro -v multinode-636000:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 -I lz4 -xf /preloaded.tar -C /extractDir

	I0229 10:27:03.223042    6570 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0229 10:27:03.223206    6570 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000

	W0229 10:27:03.274290    6570 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000 returned with exit code 1

	I0229 10:27:03.274396    6570 retry.go:31] will retry after 201.013129ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "multinode-636000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	I0229 10:27:03.477807    6570 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000

	W0229 10:27:03.528026    6570 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000 returned with exit code 1

	I0229 10:27:03.528130    6570 retry.go:31] will retry after 397.520302ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "multinode-636000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	I0229 10:27:03.927015    6570 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000

	W0229 10:27:03.977408    6570 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000 returned with exit code 1

	I0229 10:27:03.977519    6570 retry.go:31] will retry after 663.684727ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "multinode-636000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	I0229 10:27:04.643268    6570 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000

	W0229 10:27:04.693766    6570 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000 returned with exit code 1

	W0229 10:27:04.693877    6570 start.go:275] error running df -h /var: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "multinode-636000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	W0229 10:27:04.693898    6570 start.go:242] error getting percentage of /var that is free: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "multinode-636000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	I0229 10:27:04.693957    6570 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"

	I0229 10:27:04.694011    6570 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000

	W0229 10:27:04.743020    6570 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000 returned with exit code 1

	I0229 10:27:04.743110    6570 retry.go:31] will retry after 137.638805ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "multinode-636000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	I0229 10:27:04.882503    6570 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000

	W0229 10:27:04.932521    6570 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000 returned with exit code 1

	I0229 10:27:04.932625    6570 retry.go:31] will retry after 556.186723ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "multinode-636000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	I0229 10:27:05.490282    6570 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000

	W0229 10:27:05.539663    6570 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000 returned with exit code 1

	I0229 10:27:05.539754    6570 retry.go:31] will retry after 469.01039ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "multinode-636000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	I0229 10:27:06.011273    6570 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000

	W0229 10:27:06.061722    6570 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000 returned with exit code 1

	I0229 10:27:06.061819    6570 retry.go:31] will retry after 557.820327ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "multinode-636000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	I0229 10:27:06.619879    6570 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000

	W0229 10:27:06.668529    6570 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000 returned with exit code 1

	W0229 10:27:06.668627    6570 start.go:290] error running df -BG /var: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "multinode-636000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	W0229 10:27:06.668643    6570 start.go:247] error getting GiB of /var that is available: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "multinode-636000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	I0229 10:27:06.668661    6570 start.go:128] duration metric: createHost completed in 6m3.492583737s

	I0229 10:27:06.668667    6570 start.go:83] releasing machines lock for "multinode-636000", held for 6m3.492677959s

	W0229 10:27:06.668680    6570 start.go:694] error starting host: creating host: create host timed out in 360.000000 seconds

	I0229 10:27:06.669115    6570 cli_runner.go:164] Run: docker container inspect multinode-636000 --format={{.State.Status}}

	W0229 10:27:06.718352    6570 cli_runner.go:211] docker container inspect multinode-636000 --format={{.State.Status}} returned with exit code 1

	I0229 10:27:06.718400    6570 delete.go:82] Unable to get host status for multinode-636000, assuming it has already been deleted: state: unknown state "multinode-636000": docker container inspect multinode-636000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	W0229 10:27:06.718481    6570 out.go:239] ! StartHost failed, but will try again: creating host: create host timed out in 360.000000 seconds

	! StartHost failed, but will try again: creating host: create host timed out in 360.000000 seconds

	I0229 10:27:06.718493    6570 start.go:709] Will try again in 5 seconds ...

	I0229 10:27:11.719710    6570 start.go:365] acquiring machines lock for multinode-636000: {Name:mk724cab9aafa05d3a600dc983677a58b42dc1e0 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0229 10:27:11.719860    6570 start.go:369] acquired machines lock for "multinode-636000" in 115.712µs

	I0229 10:27:11.719889    6570 start.go:96] Skipping create...Using existing machine configuration

	I0229 10:27:11.719901    6570 fix.go:54] fixHost starting: 

	I0229 10:27:11.720199    6570 cli_runner.go:164] Run: docker container inspect multinode-636000 --format={{.State.Status}}

	W0229 10:27:11.769663    6570 cli_runner.go:211] docker container inspect multinode-636000 --format={{.State.Status}} returned with exit code 1

	I0229 10:27:11.769710    6570 fix.go:102] recreateIfNeeded on multinode-636000: state= err=unknown state "multinode-636000": docker container inspect multinode-636000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	I0229 10:27:11.769730    6570 fix.go:107] machineExists: false. err=machine does not exist

	I0229 10:27:11.791494    6570 out.go:177] * docker "multinode-636000" container is missing, will recreate.

	I0229 10:27:11.834112    6570 delete.go:124] DEMOLISHING multinode-636000 ...

	I0229 10:27:11.834225    6570 cli_runner.go:164] Run: docker container inspect multinode-636000 --format={{.State.Status}}

	W0229 10:27:11.884063    6570 cli_runner.go:211] docker container inspect multinode-636000 --format={{.State.Status}} returned with exit code 1

	W0229 10:27:11.884109    6570 stop.go:75] unable to get state: unknown state "multinode-636000": docker container inspect multinode-636000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	I0229 10:27:11.884128    6570 delete.go:128] stophost failed (probably ok): ssh power off: unknown state "multinode-636000": docker container inspect multinode-636000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	I0229 10:27:11.884497    6570 cli_runner.go:164] Run: docker container inspect multinode-636000 --format={{.State.Status}}

	W0229 10:27:11.933526    6570 cli_runner.go:211] docker container inspect multinode-636000 --format={{.State.Status}} returned with exit code 1

	I0229 10:27:11.933574    6570 delete.go:82] Unable to get host status for multinode-636000, assuming it has already been deleted: state: unknown state "multinode-636000": docker container inspect multinode-636000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	I0229 10:27:11.933660    6570 cli_runner.go:164] Run: docker container inspect -f {{.Id}} multinode-636000

	W0229 10:27:11.981949    6570 cli_runner.go:211] docker container inspect -f {{.Id}} multinode-636000 returned with exit code 1

	I0229 10:27:11.981981    6570 kic.go:371] could not find the container multinode-636000 to remove it. will try anyways

	I0229 10:27:11.982051    6570 cli_runner.go:164] Run: docker container inspect multinode-636000 --format={{.State.Status}}

	W0229 10:27:12.031525    6570 cli_runner.go:211] docker container inspect multinode-636000 --format={{.State.Status}} returned with exit code 1

	W0229 10:27:12.031578    6570 oci.go:84] error getting container status, will try to delete anyways: unknown state "multinode-636000": docker container inspect multinode-636000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	I0229 10:27:12.031674    6570 cli_runner.go:164] Run: docker exec --privileged -t multinode-636000 /bin/bash -c "sudo init 0"

	W0229 10:27:12.081155    6570 cli_runner.go:211] docker exec --privileged -t multinode-636000 /bin/bash -c "sudo init 0" returned with exit code 1

	I0229 10:27:12.081194    6570 oci.go:650] error shutdown multinode-636000: docker exec --privileged -t multinode-636000 /bin/bash -c "sudo init 0": exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	I0229 10:27:13.081516    6570 cli_runner.go:164] Run: docker container inspect multinode-636000 --format={{.State.Status}}

	W0229 10:27:13.134170    6570 cli_runner.go:211] docker container inspect multinode-636000 --format={{.State.Status}} returned with exit code 1

	I0229 10:27:13.134215    6570 oci.go:662] temporary error verifying shutdown: unknown state "multinode-636000": docker container inspect multinode-636000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	I0229 10:27:13.134226    6570 oci.go:664] temporary error: container multinode-636000 status is  but expect it to be exited

	I0229 10:27:13.134251    6570 retry.go:31] will retry after 597.541102ms: couldn't verify container is exited. %v: unknown state "multinode-636000": docker container inspect multinode-636000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	I0229 10:27:13.732223    6570 cli_runner.go:164] Run: docker container inspect multinode-636000 --format={{.State.Status}}

	W0229 10:27:13.781761    6570 cli_runner.go:211] docker container inspect multinode-636000 --format={{.State.Status}} returned with exit code 1

	I0229 10:27:13.781804    6570 oci.go:662] temporary error verifying shutdown: unknown state "multinode-636000": docker container inspect multinode-636000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	I0229 10:27:13.781818    6570 oci.go:664] temporary error: container multinode-636000 status is  but expect it to be exited

	I0229 10:27:13.781845    6570 retry.go:31] will retry after 919.837459ms: couldn't verify container is exited. %v: unknown state "multinode-636000": docker container inspect multinode-636000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	I0229 10:27:14.702033    6570 cli_runner.go:164] Run: docker container inspect multinode-636000 --format={{.State.Status}}

	W0229 10:27:14.751162    6570 cli_runner.go:211] docker container inspect multinode-636000 --format={{.State.Status}} returned with exit code 1

	I0229 10:27:14.751206    6570 oci.go:662] temporary error verifying shutdown: unknown state "multinode-636000": docker container inspect multinode-636000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	I0229 10:27:14.751217    6570 oci.go:664] temporary error: container multinode-636000 status is  but expect it to be exited

	I0229 10:27:14.751240    6570 retry.go:31] will retry after 681.526807ms: couldn't verify container is exited. %v: unknown state "multinode-636000": docker container inspect multinode-636000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	I0229 10:27:15.433293    6570 cli_runner.go:164] Run: docker container inspect multinode-636000 --format={{.State.Status}}

	W0229 10:27:15.482988    6570 cli_runner.go:211] docker container inspect multinode-636000 --format={{.State.Status}} returned with exit code 1

	I0229 10:27:15.483031    6570 oci.go:662] temporary error verifying shutdown: unknown state "multinode-636000": docker container inspect multinode-636000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	I0229 10:27:15.483042    6570 oci.go:664] temporary error: container multinode-636000 status is  but expect it to be exited

	I0229 10:27:15.483068    6570 retry.go:31] will retry after 1.820245459s: couldn't verify container is exited. %v: unknown state "multinode-636000": docker container inspect multinode-636000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	I0229 10:27:17.304895    6570 cli_runner.go:164] Run: docker container inspect multinode-636000 --format={{.State.Status}}

	W0229 10:27:17.377636    6570 cli_runner.go:211] docker container inspect multinode-636000 --format={{.State.Status}} returned with exit code 1

	I0229 10:27:17.377676    6570 oci.go:662] temporary error verifying shutdown: unknown state "multinode-636000": docker container inspect multinode-636000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	I0229 10:27:17.377686    6570 oci.go:664] temporary error: container multinode-636000 status is  but expect it to be exited

	I0229 10:27:17.377711    6570 retry.go:31] will retry after 2.412133021s: couldn't verify container is exited. %v: unknown state "multinode-636000": docker container inspect multinode-636000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	I0229 10:27:19.790041    6570 cli_runner.go:164] Run: docker container inspect multinode-636000 --format={{.State.Status}}

	W0229 10:27:19.839595    6570 cli_runner.go:211] docker container inspect multinode-636000 --format={{.State.Status}} returned with exit code 1

	I0229 10:27:19.839640    6570 oci.go:662] temporary error verifying shutdown: unknown state "multinode-636000": docker container inspect multinode-636000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	I0229 10:27:19.839653    6570 oci.go:664] temporary error: container multinode-636000 status is  but expect it to be exited

	I0229 10:27:19.839680    6570 retry.go:31] will retry after 4.905056105s: couldn't verify container is exited. %v: unknown state "multinode-636000": docker container inspect multinode-636000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	I0229 10:27:24.745563    6570 cli_runner.go:164] Run: docker container inspect multinode-636000 --format={{.State.Status}}

	W0229 10:27:24.796387    6570 cli_runner.go:211] docker container inspect multinode-636000 --format={{.State.Status}} returned with exit code 1

	I0229 10:27:24.796430    6570 oci.go:662] temporary error verifying shutdown: unknown state "multinode-636000": docker container inspect multinode-636000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	I0229 10:27:24.796440    6570 oci.go:664] temporary error: container multinode-636000 status is  but expect it to be exited

	I0229 10:27:24.796470    6570 oci.go:88] couldn't shut down multinode-636000 (might be okay): verify shutdown: couldn't verify container is exited. %v: unknown state "multinode-636000": docker container inspect multinode-636000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	I0229 10:27:24.796543    6570 cli_runner.go:164] Run: docker rm -f -v multinode-636000

	I0229 10:27:24.847317    6570 cli_runner.go:164] Run: docker container inspect -f {{.Id}} multinode-636000

	W0229 10:27:24.895954    6570 cli_runner.go:211] docker container inspect -f {{.Id}} multinode-636000 returned with exit code 1

	I0229 10:27:24.896064    6570 cli_runner.go:164] Run: docker network inspect multinode-636000 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"

	I0229 10:27:24.945637    6570 cli_runner.go:164] Run: docker network rm multinode-636000

	I0229 10:27:25.053079    6570 fix.go:114] Sleeping 1 second for extra luck!

	I0229 10:27:26.053227    6570 start.go:125] createHost starting for "" (driver="docker")

	I0229 10:27:26.076304    6570 out.go:204] * Creating docker container (CPUs=2, Memory=2200MB) ...

	I0229 10:27:26.076468    6570 start.go:159] libmachine.API.Create for "multinode-636000" (driver="docker")

	I0229 10:27:26.076517    6570 client.go:168] LocalClient.Create starting

	I0229 10:27:26.076718    6570 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18259-932/.minikube/certs/ca.pem

	I0229 10:27:26.076809    6570 main.go:141] libmachine: Decoding PEM data...

	I0229 10:27:26.076834    6570 main.go:141] libmachine: Parsing certificate...

	I0229 10:27:26.076914    6570 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18259-932/.minikube/certs/cert.pem

	I0229 10:27:26.076983    6570 main.go:141] libmachine: Decoding PEM data...

	I0229 10:27:26.077010    6570 main.go:141] libmachine: Parsing certificate...

	I0229 10:27:26.078025    6570 cli_runner.go:164] Run: docker network inspect multinode-636000 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"

	W0229 10:27:26.127880    6570 cli_runner.go:211] docker network inspect multinode-636000 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1

	I0229 10:27:26.127968    6570 network_create.go:281] running [docker network inspect multinode-636000] to gather additional debugging logs...

	I0229 10:27:26.127985    6570 cli_runner.go:164] Run: docker network inspect multinode-636000

	W0229 10:27:26.183439    6570 cli_runner.go:211] docker network inspect multinode-636000 returned with exit code 1

	I0229 10:27:26.183494    6570 network_create.go:284] error running [docker network inspect multinode-636000]: docker network inspect multinode-636000: exit status 1

	stdout:

	[]

	stderr:

	Error response from daemon: network multinode-636000 not found

	I0229 10:27:26.183513    6570 network_create.go:286] output of [docker network inspect multinode-636000]: -- stdout --

	[]

	-- /stdout --

	** stderr ** 

	Error response from daemon: network multinode-636000 not found

	** /stderr **

	I0229 10:27:26.183751    6570 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"

	I0229 10:27:26.264328    6570 network.go:210] skipping subnet 192.168.49.0/24 that is reserved: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:<nil>}

	I0229 10:27:26.265946    6570 network.go:210] skipping subnet 192.168.58.0/24 that is reserved: &{IP:192.168.58.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.58.0/24 Gateway:192.168.58.1 ClientMin:192.168.58.2 ClientMax:192.168.58.254 Broadcast:192.168.58.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:<nil>}

	I0229 10:27:26.266663    6570 network.go:207] using free private subnet 192.168.67.0/24: &{IP:192.168.67.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.67.0/24 Gateway:192.168.67.1 ClientMin:192.168.67.2 ClientMax:192.168.67.254 Broadcast:192.168.67.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc00232d930}

	I0229 10:27:26.266686    6570 network_create.go:124] attempt to create docker network multinode-636000 192.168.67.0/24 with gateway 192.168.67.1 and MTU of 65535 ...

	I0229 10:27:26.266793    6570 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.67.0/24 --gateway=192.168.67.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=65535 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=multinode-636000 multinode-636000

	W0229 10:27:26.326518    6570 cli_runner.go:211] docker network create --driver=bridge --subnet=192.168.67.0/24 --gateway=192.168.67.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=65535 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=multinode-636000 multinode-636000 returned with exit code 1

	W0229 10:27:26.326552    6570 network_create.go:149] failed to create docker network multinode-636000 192.168.67.0/24 with gateway 192.168.67.1 and mtu of 65535: docker network create --driver=bridge --subnet=192.168.67.0/24 --gateway=192.168.67.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=65535 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=multinode-636000 multinode-636000: exit status 1

	stdout:

	stderr:

	Error response from daemon: Pool overlaps with other one on this address space

	W0229 10:27:26.326574    6570 network_create.go:116] failed to create docker network multinode-636000 192.168.67.0/24, will retry: subnet is taken

	I0229 10:27:26.328003    6570 network.go:210] skipping subnet 192.168.67.0/24 that is reserved: &{IP:192.168.67.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.67.0/24 Gateway:192.168.67.1 ClientMin:192.168.67.2 ClientMax:192.168.67.254 Broadcast:192.168.67.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:<nil>}

	I0229 10:27:26.328462    6570 network.go:207] using free private subnet 192.168.76.0/24: &{IP:192.168.76.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.76.0/24 Gateway:192.168.76.1 ClientMin:192.168.76.2 ClientMax:192.168.76.254 Broadcast:192.168.76.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc0023f01a0}

	I0229 10:27:26.328476    6570 network_create.go:124] attempt to create docker network multinode-636000 192.168.76.0/24 with gateway 192.168.76.1 and MTU of 65535 ...

	I0229 10:27:26.328555    6570 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.76.0/24 --gateway=192.168.76.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=65535 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=multinode-636000 multinode-636000

	I0229 10:27:26.416685    6570 network_create.go:108] docker network multinode-636000 192.168.76.0/24 created

	I0229 10:27:26.416725    6570 kic.go:121] calculated static IP "192.168.76.2" for the "multinode-636000" container

	I0229 10:27:26.416825    6570 cli_runner.go:164] Run: docker ps -a --format {{.Names}}

	I0229 10:27:26.467878    6570 cli_runner.go:164] Run: docker volume create multinode-636000 --label name.minikube.sigs.k8s.io=multinode-636000 --label created_by.minikube.sigs.k8s.io=true

	I0229 10:27:26.518684    6570 oci.go:103] Successfully created a docker volume multinode-636000

	I0229 10:27:26.518801    6570 cli_runner.go:164] Run: docker run --rm --name multinode-636000-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=multinode-636000 --entrypoint /usr/bin/test -v multinode-636000:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 -d /var/lib

	I0229 10:27:26.806554    6570 oci.go:107] Successfully prepared a docker volume multinode-636000

	I0229 10:27:26.806586    6570 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker

	I0229 10:27:26.806599    6570 kic.go:194] Starting extracting preloaded images to volume ...

	I0229 10:27:26.806702    6570 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v /Users/jenkins/minikube-integration/18259-932/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4:/preloaded.tar:ro -v multinode-636000:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 -I lz4 -xf /preloaded.tar -C /extractDir

	I0229 10:33:26.124052    6570 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0229 10:33:26.127036    6570 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000

	W0229 10:33:26.182463    6570 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000 returned with exit code 1

	I0229 10:33:26.182573    6570 retry.go:31] will retry after 279.640689ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "multinode-636000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	I0229 10:33:26.464616    6570 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000

	W0229 10:33:26.516058    6570 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000 returned with exit code 1

	I0229 10:33:26.516170    6570 retry.go:31] will retry after 492.14109ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "multinode-636000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	I0229 10:33:27.009124    6570 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000

	W0229 10:33:27.062341    6570 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000 returned with exit code 1

	I0229 10:33:27.062452    6570 retry.go:31] will retry after 528.986984ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "multinode-636000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	I0229 10:33:27.591972    6570 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000

	W0229 10:33:27.642449    6570 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000 returned with exit code 1

	W0229 10:33:27.642551    6570 start.go:275] error running df -h /var: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "multinode-636000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	W0229 10:33:27.642569    6570 start.go:242] error getting percentage of /var that is free: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "multinode-636000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	I0229 10:33:27.642633    6570 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"

	I0229 10:33:27.642684    6570 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000

	W0229 10:33:27.692233    6570 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000 returned with exit code 1

	I0229 10:33:27.692328    6570 retry.go:31] will retry after 220.508213ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "multinode-636000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	I0229 10:33:27.913323    6570 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000

	W0229 10:33:27.966769    6570 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000 returned with exit code 1

	I0229 10:33:27.966869    6570 retry.go:31] will retry after 200.741567ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "multinode-636000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	I0229 10:33:28.169958    6570 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000

	W0229 10:33:28.220234    6570 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000 returned with exit code 1

	I0229 10:33:28.220330    6570 retry.go:31] will retry after 774.174505ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "multinode-636000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	I0229 10:33:28.996764    6570 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000

	W0229 10:33:29.050123    6570 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000 returned with exit code 1

	W0229 10:33:29.050231    6570 start.go:290] error running df -BG /var: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "multinode-636000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	W0229 10:33:29.050250    6570 start.go:247] error getting GiB of /var that is available: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "multinode-636000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	I0229 10:33:29.050266    6570 start.go:128] duration metric: createHost completed in 6m2.951815076s

	I0229 10:33:29.050331    6570 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0229 10:33:29.050382    6570 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000

	W0229 10:33:29.100956    6570 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000 returned with exit code 1

	I0229 10:33:29.101047    6570 retry.go:31] will retry after 166.397953ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "multinode-636000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	I0229 10:33:29.269861    6570 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000

	W0229 10:33:29.320420    6570 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000 returned with exit code 1

	I0229 10:33:29.320515    6570 retry.go:31] will retry after 520.938837ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "multinode-636000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	I0229 10:33:29.842954    6570 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000

	W0229 10:33:29.899924    6570 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000 returned with exit code 1

	I0229 10:33:29.900019    6570 retry.go:31] will retry after 679.2413ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "multinode-636000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	I0229 10:33:30.579878    6570 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000

	W0229 10:33:30.630109    6570 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000 returned with exit code 1

	W0229 10:33:30.630206    6570 start.go:275] error running df -h /var: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "multinode-636000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	W0229 10:33:30.630238    6570 start.go:242] error getting percentage of /var that is free: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "multinode-636000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	I0229 10:33:30.630293    6570 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"

	I0229 10:33:30.630344    6570 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000

	W0229 10:33:30.679021    6570 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000 returned with exit code 1

	I0229 10:33:30.679123    6570 retry.go:31] will retry after 134.0655ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "multinode-636000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	I0229 10:33:30.813721    6570 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000

	W0229 10:33:30.866164    6570 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000 returned with exit code 1

	I0229 10:33:30.866259    6570 retry.go:31] will retry after 395.98229ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "multinode-636000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	I0229 10:33:31.264404    6570 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000

	W0229 10:33:31.316125    6570 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000 returned with exit code 1

	I0229 10:33:31.316221    6570 retry.go:31] will retry after 757.274841ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "multinode-636000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	I0229 10:33:32.075805    6570 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000

	W0229 10:33:32.125614    6570 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000 returned with exit code 1

	I0229 10:33:32.125715    6570 retry.go:31] will retry after 501.967216ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "multinode-636000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	I0229 10:33:32.628118    6570 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000

	W0229 10:33:32.679461    6570 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000 returned with exit code 1

	W0229 10:33:32.679564    6570 start.go:290] error running df -BG /var: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "multinode-636000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	W0229 10:33:32.679579    6570 start.go:247] error getting GiB of /var that is available: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "multinode-636000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	I0229 10:33:32.679591    6570 fix.go:56] fixHost completed within 6m20.91473436s

	I0229 10:33:32.679598    6570 start.go:83] releasing machines lock for "multinode-636000", held for 6m20.914770478s

	W0229 10:33:32.679677    6570 out.go:239] * Failed to start docker container. Running "minikube delete -p multinode-636000" may fix it: recreate: creating host: create host timed out in 360.000000 seconds

	* Failed to start docker container. Running "minikube delete -p multinode-636000" may fix it: recreate: creating host: create host timed out in 360.000000 seconds

	I0229 10:33:32.722869    6570 out.go:177] 

	W0229 10:33:32.744015    6570 out.go:239] X Exiting due to DRV_CREATE_TIMEOUT: Failed to start host: recreate: creating host: create host timed out in 360.000000 seconds

	X Exiting due to DRV_CREATE_TIMEOUT: Failed to start host: recreate: creating host: create host timed out in 360.000000 seconds

	W0229 10:33:32.744040    6570 out.go:239] * Suggestion: Try 'minikube delete', and disable any conflicting VPN or firewall software

	* Suggestion: Try 'minikube delete', and disable any conflicting VPN or firewall software

	W0229 10:33:32.744053    6570 out.go:239] * Related issue: https://github.com/kubernetes/minikube/issues/7072

	* Related issue: https://github.com/kubernetes/minikube/issues/7072

	I0229 10:33:32.765054    6570 out.go:177] 

** /stderr **

multinode_test.go:88: failed to start cluster. args "out/minikube-darwin-amd64 start -p multinode-636000 --wait=true --memory=2200 --nodes=2 -v=8 --alsologtostderr --driver=docker " : exit status 52

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:230: ======>  post-mortem[TestMultiNode/serial/FreshStart2Nodes]: docker inspect <======

helpers_test.go:231: (dbg) Run:  docker inspect multinode-636000

helpers_test.go:235: (dbg) docker inspect multinode-636000:

-- stdout --

	[

	    {

	        "Name": "multinode-636000",

	        "Id": "00c1996055aa3b2ea80cdc2338072a3b25a3d3a7a9dbbeb8ec64b5100d2e2cd8",

	        "Created": "2024-02-29T18:27:26.377401079Z",

	        "Scope": "local",

	        "Driver": "bridge",

	        "EnableIPv6": false,

	        "IPAM": {

	            "Driver": "default",

	            "Options": {},

	            "Config": [

	                {

	                    "Subnet": "192.168.76.0/24",

	                    "Gateway": "192.168.76.1"

	                }

	            ]

	        },

	        "Internal": false,

	        "Attachable": false,

	        "Ingress": false,

	        "ConfigFrom": {

	            "Network": ""

	        },

	        "ConfigOnly": false,

	        "Containers": {},

	        "Options": {

	            "--icc": "",

	            "--ip-masq": "",

	            "com.docker.network.driver.mtu": "65535"

	        },

	        "Labels": {

	            "created_by.minikube.sigs.k8s.io": "true",

	            "name.minikube.sigs.k8s.io": "multinode-636000"

	        }

	    }

	]

-- /stdout --

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-636000 -n multinode-636000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-636000 -n multinode-636000: exit status 7 (118.154591ms)

-- stdout --

	Nonexistent

-- /stdout --

** stderr ** 

	E0229 10:33:33.010958    6866 status.go:249] status error: host: state: unknown state "multinode-636000": docker container inspect multinode-636000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

** /stderr **

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "multinode-636000" host is not running, skipping log retrieval (state="Nonexistent")

--- FAIL: TestMultiNode/serial/FreshStart2Nodes (750.71s)

=== RUN   TestMultiNode/serial/DeployApp2Nodes

multinode_test.go:509: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p multinode-636000 -- apply -f ./testdata/multinodes/multinode-pod-dns-test.yaml

multinode_test.go:509: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p multinode-636000 -- apply -f ./testdata/multinodes/multinode-pod-dns-test.yaml: exit status 1 (101.464173ms)

** stderr ** 

	error: cluster "multinode-636000" does not exist

** /stderr **

multinode_test.go:511: failed to create busybox deployment to multinode cluster

multinode_test.go:514: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p multinode-636000 -- rollout status deployment/busybox

multinode_test.go:514: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p multinode-636000 -- rollout status deployment/busybox: exit status 1 (99.567383ms)

** stderr ** 

	error: no server found for cluster "multinode-636000"

** /stderr **

multinode_test.go:516: failed to deploy busybox to multinode cluster

multinode_test.go:521: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p multinode-636000 -- get pods -o jsonpath='{.items[*].status.podIP}'

multinode_test.go:521: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p multinode-636000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (99.069356ms)

** stderr ** 

	error: no server found for cluster "multinode-636000"

** /stderr **

multinode_test.go:524: failed to retrieve Pod IPs (may be temporary): exit status 1

multinode_test.go:521: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p multinode-636000 -- get pods -o jsonpath='{.items[*].status.podIP}'

multinode_test.go:521: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p multinode-636000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (99.524776ms)

** stderr ** 

	error: no server found for cluster "multinode-636000"

** /stderr **

multinode_test.go:524: failed to retrieve Pod IPs (may be temporary): exit status 1

multinode_test.go:521: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p multinode-636000 -- get pods -o jsonpath='{.items[*].status.podIP}'

multinode_test.go:521: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p multinode-636000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (103.514699ms)

** stderr ** 

	error: no server found for cluster "multinode-636000"

** /stderr **

multinode_test.go:524: failed to retrieve Pod IPs (may be temporary): exit status 1

multinode_test.go:521: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p multinode-636000 -- get pods -o jsonpath='{.items[*].status.podIP}'

multinode_test.go:521: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p multinode-636000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (105.798949ms)

** stderr ** 

	error: no server found for cluster "multinode-636000"

** /stderr **

multinode_test.go:524: failed to retrieve Pod IPs (may be temporary): exit status 1

multinode_test.go:521: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p multinode-636000 -- get pods -o jsonpath='{.items[*].status.podIP}'

multinode_test.go:521: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p multinode-636000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (105.388999ms)

** stderr ** 

	error: no server found for cluster "multinode-636000"

** /stderr **

multinode_test.go:524: failed to retrieve Pod IPs (may be temporary): exit status 1

multinode_test.go:521: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p multinode-636000 -- get pods -o jsonpath='{.items[*].status.podIP}'

multinode_test.go:521: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p multinode-636000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (100.561376ms)

** stderr ** 

	error: no server found for cluster "multinode-636000"

** /stderr **

multinode_test.go:524: failed to retrieve Pod IPs (may be temporary): exit status 1

multinode_test.go:521: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p multinode-636000 -- get pods -o jsonpath='{.items[*].status.podIP}'

multinode_test.go:521: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p multinode-636000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (100.078399ms)

** stderr ** 

	error: no server found for cluster "multinode-636000"

** /stderr **

multinode_test.go:524: failed to retrieve Pod IPs (may be temporary): exit status 1

multinode_test.go:521: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p multinode-636000 -- get pods -o jsonpath='{.items[*].status.podIP}'

multinode_test.go:521: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p multinode-636000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (100.162487ms)

** stderr ** 

	error: no server found for cluster "multinode-636000"

** /stderr **

multinode_test.go:524: failed to retrieve Pod IPs (may be temporary): exit status 1

E0229 10:34:19.050864    1408 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/18259-932/.minikube/profiles/addons-551000/client.crt: no such file or directory

multinode_test.go:521: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p multinode-636000 -- get pods -o jsonpath='{.items[*].status.podIP}'

multinode_test.go:521: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p multinode-636000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (103.803341ms)

** stderr ** 

	error: no server found for cluster "multinode-636000"

** /stderr **

multinode_test.go:524: failed to retrieve Pod IPs (may be temporary): exit status 1

multinode_test.go:521: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p multinode-636000 -- get pods -o jsonpath='{.items[*].status.podIP}'

multinode_test.go:521: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p multinode-636000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (102.122698ms)

** stderr ** 

	error: no server found for cluster "multinode-636000"

** /stderr **

multinode_test.go:524: failed to retrieve Pod IPs (may be temporary): exit status 1

E0229 10:34:50.671960    1408 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/18259-932/.minikube/profiles/functional-081000/client.crt: no such file or directory

multinode_test.go:521: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p multinode-636000 -- get pods -o jsonpath='{.items[*].status.podIP}'

multinode_test.go:521: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p multinode-636000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (103.067982ms)

** stderr ** 

	error: no server found for cluster "multinode-636000"

** /stderr **

multinode_test.go:524: failed to retrieve Pod IPs (may be temporary): exit status 1

multinode_test.go:540: failed to resolve pod IPs: failed to retrieve Pod IPs (may be temporary): exit status 1

multinode_test.go:544: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p multinode-636000 -- get pods -o jsonpath='{.items[*].metadata.name}'

multinode_test.go:544: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p multinode-636000 -- get pods -o jsonpath='{.items[*].metadata.name}': exit status 1 (99.328074ms)

** stderr ** 

	error: no server found for cluster "multinode-636000"

** /stderr **

multinode_test.go:546: failed get Pod names

multinode_test.go:552: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p multinode-636000 -- exec  -- nslookup kubernetes.io

multinode_test.go:552: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p multinode-636000 -- exec  -- nslookup kubernetes.io: exit status 1 (99.682364ms)

** stderr ** 

	error: no server found for cluster "multinode-636000"

** /stderr **

multinode_test.go:554: Pod  could not resolve 'kubernetes.io': exit status 1

multinode_test.go:562: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p multinode-636000 -- exec  -- nslookup kubernetes.default

multinode_test.go:562: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p multinode-636000 -- exec  -- nslookup kubernetes.default: exit status 1 (99.002289ms)

** stderr ** 

	error: no server found for cluster "multinode-636000"

** /stderr **

multinode_test.go:564: Pod  could not resolve 'kubernetes.default': exit status 1

multinode_test.go:570: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p multinode-636000 -- exec  -- nslookup kubernetes.default.svc.cluster.local

multinode_test.go:570: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p multinode-636000 -- exec  -- nslookup kubernetes.default.svc.cluster.local: exit status 1 (99.124314ms)

** stderr ** 

	error: no server found for cluster "multinode-636000"

** /stderr **

multinode_test.go:572: Pod  could not resolve local service (kubernetes.default.svc.cluster.local): exit status 1

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:230: ======>  post-mortem[TestMultiNode/serial/DeployApp2Nodes]: docker inspect <======

helpers_test.go:231: (dbg) Run:  docker inspect multinode-636000

helpers_test.go:235: (dbg) docker inspect multinode-636000:

-- stdout --

	[

	    {

	        "Name": "multinode-636000",

	        "Id": "00c1996055aa3b2ea80cdc2338072a3b25a3d3a7a9dbbeb8ec64b5100d2e2cd8",

	        "Created": "2024-02-29T18:27:26.377401079Z",

	        "Scope": "local",

	        "Driver": "bridge",

	        "EnableIPv6": false,

	        "IPAM": {

	            "Driver": "default",

	            "Options": {},

	            "Config": [

	                {

	                    "Subnet": "192.168.76.0/24",

	                    "Gateway": "192.168.76.1"

	                }

	            ]

	        },

	        "Internal": false,

	        "Attachable": false,

	        "Ingress": false,

	        "ConfigFrom": {

	            "Network": ""

	        },

	        "ConfigOnly": false,

	        "Containers": {},

	        "Options": {

	            "--icc": "",

	            "--ip-masq": "",

	            "com.docker.network.driver.mtu": "65535"

	        },

	        "Labels": {

	            "created_by.minikube.sigs.k8s.io": "true",

	            "name.minikube.sigs.k8s.io": "multinode-636000"

	        }

	    }

	]

-- /stdout --

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-636000 -n multinode-636000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-636000 -n multinode-636000: exit status 7 (114.460981ms)

-- stdout --

	Nonexistent

-- /stdout --

** stderr ** 

	E0229 10:35:16.273340    6930 status.go:249] status error: host: state: unknown state "multinode-636000": docker container inspect multinode-636000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

** /stderr **

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "multinode-636000" host is not running, skipping log retrieval (state="Nonexistent")

--- FAIL: TestMultiNode/serial/DeployApp2Nodes (103.26s)

=== RUN   TestMultiNode/serial/PingHostFrom2Pods

multinode_test.go:580: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p multinode-636000 -- get pods -o jsonpath='{.items[*].metadata.name}'

multinode_test.go:580: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p multinode-636000 -- get pods -o jsonpath='{.items[*].metadata.name}': exit status 1 (99.270582ms)

** stderr ** 

	error: no server found for cluster "multinode-636000"

** /stderr **

multinode_test.go:582: failed to get Pod names: exit status 1

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:230: ======>  post-mortem[TestMultiNode/serial/PingHostFrom2Pods]: docker inspect <======

helpers_test.go:231: (dbg) Run:  docker inspect multinode-636000

helpers_test.go:235: (dbg) docker inspect multinode-636000:

-- stdout --

	[

	    {

	        "Name": "multinode-636000",

	        "Id": "00c1996055aa3b2ea80cdc2338072a3b25a3d3a7a9dbbeb8ec64b5100d2e2cd8",

	        "Created": "2024-02-29T18:27:26.377401079Z",

	        "Scope": "local",

	        "Driver": "bridge",

	        "EnableIPv6": false,

	        "IPAM": {

	            "Driver": "default",

	            "Options": {},

	            "Config": [

	                {

	                    "Subnet": "192.168.76.0/24",

	                    "Gateway": "192.168.76.1"

	                }

	            ]

	        },

	        "Internal": false,

	        "Attachable": false,

	        "Ingress": false,

	        "ConfigFrom": {

	            "Network": ""

	        },

	        "ConfigOnly": false,

	        "Containers": {},

	        "Options": {

	            "--icc": "",

	            "--ip-masq": "",

	            "com.docker.network.driver.mtu": "65535"

	        },

	        "Labels": {

	            "created_by.minikube.sigs.k8s.io": "true",

	            "name.minikube.sigs.k8s.io": "multinode-636000"

	        }

	    }

	]

-- /stdout --

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-636000 -n multinode-636000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-636000 -n multinode-636000: exit status 7 (115.220738ms)

-- stdout --

	Nonexistent

-- /stdout --

** stderr ** 

	E0229 10:35:16.541936    6939 status.go:249] status error: host: state: unknown state "multinode-636000": docker container inspect multinode-636000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

** /stderr **

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "multinode-636000" host is not running, skipping log retrieval (state="Nonexistent")

--- FAIL: TestMultiNode/serial/PingHostFrom2Pods (0.27s)

=== RUN   TestMultiNode/serial/AddNode

multinode_test.go:111: (dbg) Run:  out/minikube-darwin-amd64 node add -p multinode-636000 -v 3 --alsologtostderr

multinode_test.go:111: (dbg) Non-zero exit: out/minikube-darwin-amd64 node add -p multinode-636000 -v 3 --alsologtostderr: exit status 80 (207.284561ms)

-- stdout --

-- /stdout --

** stderr ** 

	I0229 10:35:16.605360    6943 out.go:291] Setting OutFile to fd 1 ...

	I0229 10:35:16.605622    6943 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0229 10:35:16.605628    6943 out.go:304] Setting ErrFile to fd 2...

	I0229 10:35:16.605631    6943 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0229 10:35:16.605811    6943 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18259-932/.minikube/bin

	I0229 10:35:16.606132    6943 mustload.go:65] Loading cluster: multinode-636000

	I0229 10:35:16.606427    6943 config.go:182] Loaded profile config "multinode-636000": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.28.4

	I0229 10:35:16.606792    6943 cli_runner.go:164] Run: docker container inspect multinode-636000 --format={{.State.Status}}

	W0229 10:35:16.656853    6943 cli_runner.go:211] docker container inspect multinode-636000 --format={{.State.Status}} returned with exit code 1

	I0229 10:35:16.680890    6943 out.go:177] 

	W0229 10:35:16.702477    6943 out.go:239] X Exiting due to GUEST_STATUS: Unable to get machine status: state: unknown state "multinode-636000": docker container inspect multinode-636000 --format=<no value>: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	X Exiting due to GUEST_STATUS: Unable to get machine status: state: unknown state "multinode-636000": docker container inspect multinode-636000 --format=<no value>: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	W0229 10:35:16.702497    6943 out.go:239] * 

	* 

	W0229 10:35:16.705459    6943 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                                                         │

	│    * If the above advice does not help, please let us know:                                                             │

	│      https://github.com/kubernetes/minikube/issues/new/choose                                                           │

	│                                                                                                                         │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                │

	│    * Please also attach the following file to the GitHub issue:                                                         │

	│    * - /var/folders/52/zh_qmlrn1f36yr6lgs7nxtym0000gp/T/minikube_node_040ea7097fd6ed71e65be9a474587f81f0ccd21d_0.log    │

	│                                                                                                                         │

	╰─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯

	╭─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                                                         │

	│    * If the above advice does not help, please let us know:                                                             │

	│      https://github.com/kubernetes/minikube/issues/new/choose                                                           │

	│                                                                                                                         │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                │

	│    * Please also attach the following file to the GitHub issue:                                                         │

	│    * - /var/folders/52/zh_qmlrn1f36yr6lgs7nxtym0000gp/T/minikube_node_040ea7097fd6ed71e65be9a474587f81f0ccd21d_0.log    │

	│                                                                                                                         │

	╰─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯

	I0229 10:35:16.726378    6943 out.go:177] 

** /stderr **

multinode_test.go:113: failed to add node to current cluster. args "out/minikube-darwin-amd64 node add -p multinode-636000 -v 3 --alsologtostderr" : exit status 80

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:230: ======>  post-mortem[TestMultiNode/serial/AddNode]: docker inspect <======

helpers_test.go:231: (dbg) Run:  docker inspect multinode-636000

helpers_test.go:235: (dbg) docker inspect multinode-636000:

-- stdout --

	[

	    {

	        "Name": "multinode-636000",

	        "Id": "00c1996055aa3b2ea80cdc2338072a3b25a3d3a7a9dbbeb8ec64b5100d2e2cd8",

	        "Created": "2024-02-29T18:27:26.377401079Z",

	        "Scope": "local",

	        "Driver": "bridge",

	        "EnableIPv6": false,

	        "IPAM": {

	            "Driver": "default",

	            "Options": {},

	            "Config": [

	                {

	                    "Subnet": "192.168.76.0/24",

	                    "Gateway": "192.168.76.1"

	                }

	            ]

	        },

	        "Internal": false,

	        "Attachable": false,

	        "Ingress": false,

	        "ConfigFrom": {

	            "Network": ""

	        },

	        "ConfigOnly": false,

	        "Containers": {},

	        "Options": {

	            "--icc": "",

	            "--ip-masq": "",

	            "com.docker.network.driver.mtu": "65535"

	        },

	        "Labels": {

	            "created_by.minikube.sigs.k8s.io": "true",

	            "name.minikube.sigs.k8s.io": "multinode-636000"

	        }

	    }

	]

-- /stdout --

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-636000 -n multinode-636000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-636000 -n multinode-636000: exit status 7 (114.080873ms)

-- stdout --

	Nonexistent

-- /stdout --

** stderr ** 

	E0229 10:35:16.918019    6949 status.go:249] status error: host: state: unknown state "multinode-636000": docker container inspect multinode-636000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

** /stderr **

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "multinode-636000" host is not running, skipping log retrieval (state="Nonexistent")

--- FAIL: TestMultiNode/serial/AddNode (0.38s)

=== RUN   TestMultiNode/serial/MultiNodeLabels

multinode_test.go:211: (dbg) Run:  kubectl --context multinode-636000 get nodes -o "jsonpath=[{range .items[*]}{.metadata.labels},{end}]"

multinode_test.go:211: (dbg) Non-zero exit: kubectl --context multinode-636000 get nodes -o "jsonpath=[{range .items[*]}{.metadata.labels},{end}]": exit status 1 (39.295749ms)

** stderr ** 

	Error in configuration: context was not found for specified context: multinode-636000

** /stderr **

multinode_test.go:213: failed to 'kubectl get nodes' with args "kubectl --context multinode-636000 get nodes -o \"jsonpath=[{range .items[*]}{.metadata.labels},{end}]\"": exit status 1

multinode_test.go:220: failed to decode json from label list: args "kubectl --context multinode-636000 get nodes -o \"jsonpath=[{range .items[*]}{.metadata.labels},{end}]\"": unexpected end of JSON input

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:230: ======>  post-mortem[TestMultiNode/serial/MultiNodeLabels]: docker inspect <======

helpers_test.go:231: (dbg) Run:  docker inspect multinode-636000

helpers_test.go:235: (dbg) docker inspect multinode-636000:

-- stdout --

	[

	    {

	        "Name": "multinode-636000",

	        "Id": "00c1996055aa3b2ea80cdc2338072a3b25a3d3a7a9dbbeb8ec64b5100d2e2cd8",

	        "Created": "2024-02-29T18:27:26.377401079Z",

	        "Scope": "local",

	        "Driver": "bridge",

	        "EnableIPv6": false,

	        "IPAM": {

	            "Driver": "default",

	            "Options": {},

	            "Config": [

	                {

	                    "Subnet": "192.168.76.0/24",

	                    "Gateway": "192.168.76.1"

	                }

	            ]

	        },

	        "Internal": false,

	        "Attachable": false,

	        "Ingress": false,

	        "ConfigFrom": {

	            "Network": ""

	        },

	        "ConfigOnly": false,

	        "Containers": {},

	        "Options": {

	            "--icc": "",

	            "--ip-masq": "",

	            "com.docker.network.driver.mtu": "65535"

	        },

	        "Labels": {

	            "created_by.minikube.sigs.k8s.io": "true",

	            "name.minikube.sigs.k8s.io": "multinode-636000"

	        }

	    }

	]

-- /stdout --

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-636000 -n multinode-636000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-636000 -n multinode-636000: exit status 7 (112.859221ms)

-- stdout --

	Nonexistent

-- /stdout --

** stderr ** 

	E0229 10:35:17.124093    6956 status.go:249] status error: host: state: unknown state "multinode-636000": docker container inspect multinode-636000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

** /stderr **

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "multinode-636000" host is not running, skipping log retrieval (state="Nonexistent")

--- FAIL: TestMultiNode/serial/MultiNodeLabels (0.21s)

=== RUN   TestMultiNode/serial/ProfileList

multinode_test.go:133: (dbg) Run:  out/minikube-darwin-amd64 profile list --output json

multinode_test.go:156: expected profile "multinode-636000" in json of 'profile list' include 3 nodes but have 1 nodes. got *"{\"invalid\":[{\"Name\":\"mount-start-2-409000\",\"Status\":\"\",\"Config\":null,\"Active\":false}],\"valid\":[{\"Name\":\"multinode-636000\",\"Status\":\"Unknown\",\"Config\":{\"Name\":\"multinode-636000\",\"KeepContext\":false,\"EmbedCerts\":false,\"MinikubeISO\":\"\",\"KicBaseImage\":\"gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08\",\"Memory\":2200,\"CPUs\":2,\"DiskSize\":20000,\"VMDriver\":\"\",\"Driver\":\"docker\",\"HyperkitVpnKitSock\":\"\",\"HyperkitVSockPorts\":[],\"DockerEnv\":null,\"ContainerVolumeMounts\":null,\"InsecureRegistry\":null,\"RegistryMirror\":[],\"HostOnlyCIDR\":\"192.168.59.1/24\",\"HypervVirtualSwitch\":\"\",\"HypervUseExternalSwitch\":false,\"HypervExternalAdapter\":\"\",\"KVMNetwork\":\"default\",\"KVMQemuURI\":\"qemu:///system\",\"KVMGPU\":false,\"KVMHidden\":false,\"KV

MNUMACount\":1,\"APIServerPort\":0,\"DockerOpt\":null,\"DisableDriverMounts\":false,\"NFSShare\":[],\"NFSSharesRoot\":\"/nfsshares\",\"UUID\":\"\",\"NoVTXCheck\":false,\"DNSProxy\":false,\"HostDNSResolver\":true,\"HostOnlyNicType\":\"virtio\",\"NatNicType\":\"virtio\",\"SSHIPAddress\":\"\",\"SSHUser\":\"root\",\"SSHKey\":\"\",\"SSHPort\":22,\"KubernetesConfig\":{\"KubernetesVersion\":\"v1.28.4\",\"ClusterName\":\"multinode-636000\",\"Namespace\":\"default\",\"APIServerName\":\"minikubeCA\",\"APIServerNames\":null,\"APIServerIPs\":null,\"DNSDomain\":\"cluster.local\",\"ContainerRuntime\":\"docker\",\"CRISocket\":\"\",\"NetworkPlugin\":\"cni\",\"FeatureGates\":\"\",\"ServiceCIDR\":\"10.96.0.0/12\",\"ImageRepository\":\"\",\"LoadBalancerStartIP\":\"\",\"LoadBalancerEndIP\":\"\",\"CustomIngressCert\":\"\",\"RegistryAliases\":\"\",\"ExtraOptions\":null,\"ShouldLoadCachedImages\":true,\"EnableDefaultCNI\":false,\"CNI\":\"\",\"NodeIP\":\"\",\"NodePort\":8443,\"NodeName\":\"\"},\"Nodes\":[{\"Name\":\"\",\"IP\":\"\",\

"Port\":8443,\"KubernetesVersion\":\"v1.28.4\",\"ContainerRuntime\":\"docker\",\"ControlPlane\":true,\"Worker\":true}],\"Addons\":null,\"CustomAddonImages\":null,\"CustomAddonRegistries\":null,\"VerifyComponents\":{\"apiserver\":true,\"apps_running\":true,\"default_sa\":true,\"extra\":true,\"kubelet\":true,\"node_ready\":true,\"system_pods\":true},\"StartHostTimeout\":360000000000,\"ScheduledStop\":null,\"ExposedPorts\":[],\"ListenAddress\":\"\",\"Network\":\"\",\"Subnet\":\"\",\"MultiNodeRequested\":true,\"ExtraDisks\":0,\"CertExpiration\":94608000000000000,\"Mount\":false,\"MountString\":\"/Users:/minikube-host\",\"Mount9PVersion\":\"9p2000.L\",\"MountGID\":\"docker\",\"MountIP\":\"\",\"MountMSize\":262144,\"MountOptions\":[],\"MountPort\":0,\"MountType\":\"9p\",\"MountUID\":\"docker\",\"BinaryMirror\":\"\",\"DisableOptimizations\":false,\"DisableMetrics\":false,\"CustomQemuFirmwarePath\":\"\",\"SocketVMnetClientPath\":\"\",\"SocketVMnetPath\":\"\",\"StaticIP\":\"\",\"SSHAuthSock\":\"\",\"SSHAgentPID\":0,\"

GPUs\":\"\",\"AutoPauseInterval\":60000000000},\"Active\":false}]}"*. args: "out/minikube-darwin-amd64 profile list --output json"

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:230: ======>  post-mortem[TestMultiNode/serial/ProfileList]: docker inspect <======

helpers_test.go:231: (dbg) Run:  docker inspect multinode-636000

helpers_test.go:235: (dbg) docker inspect multinode-636000:

-- stdout --

	[

	    {

	        "Name": "multinode-636000",

	        "Id": "00c1996055aa3b2ea80cdc2338072a3b25a3d3a7a9dbbeb8ec64b5100d2e2cd8",

	        "Created": "2024-02-29T18:27:26.377401079Z",

	        "Scope": "local",

	        "Driver": "bridge",

	        "EnableIPv6": false,

	        "IPAM": {

	            "Driver": "default",

	            "Options": {},

	            "Config": [

	                {

	                    "Subnet": "192.168.76.0/24",

	                    "Gateway": "192.168.76.1"

	                }

	            ]

	        },

	        "Internal": false,

	        "Attachable": false,

	        "Ingress": false,

	        "ConfigFrom": {

	            "Network": ""

	        },

	        "ConfigOnly": false,

	        "Containers": {},

	        "Options": {

	            "--icc": "",

	            "--ip-masq": "",

	            "com.docker.network.driver.mtu": "65535"

	        },

	        "Labels": {

	            "created_by.minikube.sigs.k8s.io": "true",

	            "name.minikube.sigs.k8s.io": "multinode-636000"

	        }

	    }

	]

-- /stdout --

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-636000 -n multinode-636000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-636000 -n multinode-636000: exit status 7 (114.088794ms)

-- stdout --

	Nonexistent

-- /stdout --

** stderr ** 

	E0229 10:35:17.535904    6968 status.go:249] status error: host: state: unknown state "multinode-636000": docker container inspect multinode-636000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

** /stderr **

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "multinode-636000" host is not running, skipping log retrieval (state="Nonexistent")

--- FAIL: TestMultiNode/serial/ProfileList (0.41s)

=== RUN   TestMultiNode/serial/CopyFile

multinode_test.go:174: (dbg) Run:  out/minikube-darwin-amd64 -p multinode-636000 status --output json --alsologtostderr

multinode_test.go:174: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p multinode-636000 status --output json --alsologtostderr: exit status 7 (114.982561ms)

-- stdout --

	{"Name":"multinode-636000","Host":"Nonexistent","Kubelet":"Nonexistent","APIServer":"Nonexistent","Kubeconfig":"Nonexistent","Worker":false}

-- /stdout --

** stderr ** 

	I0229 10:35:17.599159    6972 out.go:291] Setting OutFile to fd 1 ...

	I0229 10:35:17.599352    6972 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0229 10:35:17.599357    6972 out.go:304] Setting ErrFile to fd 2...

	I0229 10:35:17.599361    6972 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0229 10:35:17.599570    6972 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18259-932/.minikube/bin

	I0229 10:35:17.599758    6972 out.go:298] Setting JSON to true

	I0229 10:35:17.599779    6972 mustload.go:65] Loading cluster: multinode-636000

	I0229 10:35:17.599815    6972 notify.go:220] Checking for updates...

	I0229 10:35:17.600056    6972 config.go:182] Loaded profile config "multinode-636000": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.28.4

	I0229 10:35:17.600072    6972 status.go:255] checking status of multinode-636000 ...

	I0229 10:35:17.600438    6972 cli_runner.go:164] Run: docker container inspect multinode-636000 --format={{.State.Status}}

	W0229 10:35:17.651033    6972 cli_runner.go:211] docker container inspect multinode-636000 --format={{.State.Status}} returned with exit code 1

	I0229 10:35:17.651100    6972 status.go:330] multinode-636000 host status = "" (err=state: unknown state "multinode-636000": docker container inspect multinode-636000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	)

	I0229 10:35:17.651124    6972 status.go:257] multinode-636000 status: &{Name:multinode-636000 Host:Nonexistent Kubelet:Nonexistent APIServer:Nonexistent Kubeconfig:Nonexistent Worker:false TimeToStop: DockerEnv: PodManEnv:}

	E0229 10:35:17.651144    6972 status.go:260] status error: host: state: unknown state "multinode-636000": docker container inspect multinode-636000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	E0229 10:35:17.651151    6972 status.go:263] The "multinode-636000" host does not exist!

** /stderr **

multinode_test.go:181: failed to decode json from status: args "out/minikube-darwin-amd64 -p multinode-636000 status --output json --alsologtostderr": json: cannot unmarshal object into Go value of type []cmd.Status

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:230: ======>  post-mortem[TestMultiNode/serial/CopyFile]: docker inspect <======

helpers_test.go:231: (dbg) Run:  docker inspect multinode-636000

helpers_test.go:235: (dbg) docker inspect multinode-636000:

-- stdout --

	[

	    {

	        "Name": "multinode-636000",

	        "Id": "00c1996055aa3b2ea80cdc2338072a3b25a3d3a7a9dbbeb8ec64b5100d2e2cd8",

	        "Created": "2024-02-29T18:27:26.377401079Z",

	        "Scope": "local",

	        "Driver": "bridge",

	        "EnableIPv6": false,

	        "IPAM": {

	            "Driver": "default",

	            "Options": {},

	            "Config": [

	                {

	                    "Subnet": "192.168.76.0/24",

	                    "Gateway": "192.168.76.1"

	                }

	            ]

	        },

	        "Internal": false,

	        "Attachable": false,

	        "Ingress": false,

	        "ConfigFrom": {

	            "Network": ""

	        },

	        "ConfigOnly": false,

	        "Containers": {},

	        "Options": {

	            "--icc": "",

	            "--ip-masq": "",

	            "com.docker.network.driver.mtu": "65535"

	        },

	        "Labels": {

	            "created_by.minikube.sigs.k8s.io": "true",

	            "name.minikube.sigs.k8s.io": "multinode-636000"

	        }

	    }

	]

-- /stdout --

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-636000 -n multinode-636000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-636000 -n multinode-636000: exit status 7 (116.048349ms)

-- stdout --

	Nonexistent

-- /stdout --

** stderr ** 

	E0229 10:35:17.820115    6978 status.go:249] status error: host: state: unknown state "multinode-636000": docker container inspect multinode-636000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

** /stderr **

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "multinode-636000" host is not running, skipping log retrieval (state="Nonexistent")

--- FAIL: TestMultiNode/serial/CopyFile (0.28s)

=== RUN   TestMultiNode/serial/StopNode

multinode_test.go:238: (dbg) Run:  out/minikube-darwin-amd64 -p multinode-636000 node stop m03

multinode_test.go:238: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p multinode-636000 node stop m03: exit status 85 (155.396197ms)

-- stdout --

-- /stdout --

** stderr ** 

	X Exiting due to GUEST_NODE_RETRIEVE: retrieving node: Could not find node m03

	* 

	╭─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                                                         │

	│    * If the above advice does not help, please let us know:                                                             │

	│      https://github.com/kubernetes/minikube/issues/new/choose                                                           │

	│                                                                                                                         │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                │

	│    * Please also attach the following file to the GitHub issue:                                                         │

	│    * - /var/folders/52/zh_qmlrn1f36yr6lgs7nxtym0000gp/T/minikube_node_295f67d8757edd996fe5c1e7ccde72c355ccf4dc_0.log    │

	│                                                                                                                         │

	╰─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯

** /stderr **

multinode_test.go:240: node stop returned an error. args "out/minikube-darwin-amd64 -p multinode-636000 node stop m03": exit status 85

multinode_test.go:244: (dbg) Run:  out/minikube-darwin-amd64 -p multinode-636000 status

multinode_test.go:244: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p multinode-636000 status: exit status 7 (113.713664ms)

-- stdout --

	multinode-636000

	type: Control Plane

	host: Nonexistent

	kubelet: Nonexistent

	apiserver: Nonexistent

	kubeconfig: Nonexistent

-- /stdout --

** stderr ** 

	E0229 10:35:18.089938    6984 status.go:260] status error: host: state: unknown state "multinode-636000": docker container inspect multinode-636000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	E0229 10:35:18.089950    6984 status.go:263] The "multinode-636000" host does not exist!

** /stderr **

multinode_test.go:251: (dbg) Run:  out/minikube-darwin-amd64 -p multinode-636000 status --alsologtostderr

multinode_test.go:251: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p multinode-636000 status --alsologtostderr: exit status 7 (113.553557ms)

-- stdout --

	multinode-636000

	type: Control Plane

	host: Nonexistent

	kubelet: Nonexistent

	apiserver: Nonexistent

	kubeconfig: Nonexistent

-- /stdout --

** stderr ** 

	I0229 10:35:18.152114    6988 out.go:291] Setting OutFile to fd 1 ...

	I0229 10:35:18.152302    6988 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0229 10:35:18.152307    6988 out.go:304] Setting ErrFile to fd 2...

	I0229 10:35:18.152311    6988 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0229 10:35:18.152510    6988 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18259-932/.minikube/bin

	I0229 10:35:18.152692    6988 out.go:298] Setting JSON to false

	I0229 10:35:18.152714    6988 mustload.go:65] Loading cluster: multinode-636000

	I0229 10:35:18.153209    6988 notify.go:220] Checking for updates...

	I0229 10:35:18.153987    6988 config.go:182] Loaded profile config "multinode-636000": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.28.4

	I0229 10:35:18.154010    6988 status.go:255] checking status of multinode-636000 ...

	I0229 10:35:18.154399    6988 cli_runner.go:164] Run: docker container inspect multinode-636000 --format={{.State.Status}}

	W0229 10:35:18.203473    6988 cli_runner.go:211] docker container inspect multinode-636000 --format={{.State.Status}} returned with exit code 1

	I0229 10:35:18.203540    6988 status.go:330] multinode-636000 host status = "" (err=state: unknown state "multinode-636000": docker container inspect multinode-636000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	)

	I0229 10:35:18.203563    6988 status.go:257] multinode-636000 status: &{Name:multinode-636000 Host:Nonexistent Kubelet:Nonexistent APIServer:Nonexistent Kubeconfig:Nonexistent Worker:false TimeToStop: DockerEnv: PodManEnv:}

	E0229 10:35:18.203582    6988 status.go:260] status error: host: state: unknown state "multinode-636000": docker container inspect multinode-636000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	E0229 10:35:18.203593    6988 status.go:263] The "multinode-636000" host does not exist!

** /stderr **

multinode_test.go:257: incorrect number of running kubelets: args "out/minikube-darwin-amd64 -p multinode-636000 status --alsologtostderr": multinode-636000

type: Control Plane

host: Nonexistent

kubelet: Nonexistent

apiserver: Nonexistent

kubeconfig: Nonexistent

multinode_test.go:261: incorrect number of stopped hosts: args "out/minikube-darwin-amd64 -p multinode-636000 status --alsologtostderr": multinode-636000

type: Control Plane

host: Nonexistent

kubelet: Nonexistent

apiserver: Nonexistent

kubeconfig: Nonexistent

multinode_test.go:265: incorrect number of stopped kubelets: args "out/minikube-darwin-amd64 -p multinode-636000 status --alsologtostderr": multinode-636000

type: Control Plane

host: Nonexistent

kubelet: Nonexistent

apiserver: Nonexistent

kubeconfig: Nonexistent

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:230: ======>  post-mortem[TestMultiNode/serial/StopNode]: docker inspect <======

helpers_test.go:231: (dbg) Run:  docker inspect multinode-636000

helpers_test.go:235: (dbg) docker inspect multinode-636000:

-- stdout --

	[

	    {

	        "Name": "multinode-636000",

	        "Id": "00c1996055aa3b2ea80cdc2338072a3b25a3d3a7a9dbbeb8ec64b5100d2e2cd8",

	        "Created": "2024-02-29T18:27:26.377401079Z",

	        "Scope": "local",

	        "Driver": "bridge",

	        "EnableIPv6": false,

	        "IPAM": {

	            "Driver": "default",

	            "Options": {},

	            "Config": [

	                {

	                    "Subnet": "192.168.76.0/24",

	                    "Gateway": "192.168.76.1"

	                }

	            ]

	        },

	        "Internal": false,

	        "Attachable": false,

	        "Ingress": false,

	        "ConfigFrom": {

	            "Network": ""

	        },

	        "ConfigOnly": false,

	        "Containers": {},

	        "Options": {

	            "--icc": "",

	            "--ip-masq": "",

	            "com.docker.network.driver.mtu": "65535"

	        },

	        "Labels": {

	            "created_by.minikube.sigs.k8s.io": "true",

	            "name.minikube.sigs.k8s.io": "multinode-636000"

	        }

	    }

	]

-- /stdout --

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-636000 -n multinode-636000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-636000 -n multinode-636000: exit status 7 (114.572558ms)

-- stdout --

	Nonexistent

-- /stdout --

** stderr ** 

	E0229 10:35:18.370942    6994 status.go:249] status error: host: state: unknown state "multinode-636000": docker container inspect multinode-636000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

** /stderr **

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "multinode-636000" host is not running, skipping log retrieval (state="Nonexistent")

--- FAIL: TestMultiNode/serial/StopNode (0.55s)

=== RUN   TestMultiNode/serial/StartAfterStop

multinode_test.go:272: (dbg) Run:  docker version -f {{.Server.Version}}

multinode_test.go:282: (dbg) Run:  out/minikube-darwin-amd64 -p multinode-636000 node start m03 --alsologtostderr

multinode_test.go:282: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p multinode-636000 node start m03 --alsologtostderr: exit status 85 (154.290638ms)

-- stdout --

-- /stdout --

** stderr ** 

	I0229 10:35:18.488219    7000 out.go:291] Setting OutFile to fd 1 ...

	I0229 10:35:18.488994    7000 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0229 10:35:18.489003    7000 out.go:304] Setting ErrFile to fd 2...

	I0229 10:35:18.489010    7000 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0229 10:35:18.489631    7000 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18259-932/.minikube/bin

	I0229 10:35:18.489962    7000 mustload.go:65] Loading cluster: multinode-636000

	I0229 10:35:18.490215    7000 config.go:182] Loaded profile config "multinode-636000": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.28.4

	I0229 10:35:18.511482    7000 out.go:177] 

	W0229 10:35:18.532407    7000 out.go:239] X Exiting due to GUEST_NODE_RETRIEVE: retrieving node: Could not find node m03

	X Exiting due to GUEST_NODE_RETRIEVE: retrieving node: Could not find node m03

	W0229 10:35:18.532434    7000 out.go:239] * 

	* 

	W0229 10:35:18.536201    7000 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                                                         │

	│    * If the above advice does not help, please let us know:                                                             │

	│      https://github.com/kubernetes/minikube/issues/new/choose                                                           │

	│                                                                                                                         │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                │

	│    * Please also attach the following file to the GitHub issue:                                                         │

	│    * - /var/folders/52/zh_qmlrn1f36yr6lgs7nxtym0000gp/T/minikube_node_1c3a1297795327375b61f3ff5a4ef34c9b2fc69b_0.log    │

	│                                                                                                                         │

	╰─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯

	╭─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                                                         │

	│    * If the above advice does not help, please let us know:                                                             │

	│      https://github.com/kubernetes/minikube/issues/new/choose                                                           │

	│                                                                                                                         │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                │

	│    * Please also attach the following file to the GitHub issue:                                                         │

	│    * - /var/folders/52/zh_qmlrn1f36yr6lgs7nxtym0000gp/T/minikube_node_1c3a1297795327375b61f3ff5a4ef34c9b2fc69b_0.log    │

	│                                                                                                                         │

	╰─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯

	I0229 10:35:18.557269    7000 out.go:177] 

** /stderr **

multinode_test.go:284: I0229 10:35:18.488219    7000 out.go:291] Setting OutFile to fd 1 ...

I0229 10:35:18.488994    7000 out.go:338] TERM=,COLORTERM=, which probably does not support color

I0229 10:35:18.489003    7000 out.go:304] Setting ErrFile to fd 2...

I0229 10:35:18.489010    7000 out.go:338] TERM=,COLORTERM=, which probably does not support color

I0229 10:35:18.489631    7000 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18259-932/.minikube/bin

I0229 10:35:18.489962    7000 mustload.go:65] Loading cluster: multinode-636000

I0229 10:35:18.490215    7000 config.go:182] Loaded profile config "multinode-636000": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.28.4

I0229 10:35:18.511482    7000 out.go:177] 

W0229 10:35:18.532407    7000 out.go:239] X Exiting due to GUEST_NODE_RETRIEVE: retrieving node: Could not find node m03

X Exiting due to GUEST_NODE_RETRIEVE: retrieving node: Could not find node m03

W0229 10:35:18.532434    7000 out.go:239] * 

* 

W0229 10:35:18.536201    7000 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮

│                                                                                                                         │

│    * If the above advice does not help, please let us know:                                                             │

│      https://github.com/kubernetes/minikube/issues/new/choose                                                           │

│                                                                                                                         │

│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                │

│    * Please also attach the following file to the GitHub issue:                                                         │

│    * - /var/folders/52/zh_qmlrn1f36yr6lgs7nxtym0000gp/T/minikube_node_1c3a1297795327375b61f3ff5a4ef34c9b2fc69b_0.log    │

│                                                                                                                         │

╰─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯

╭─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮

│                                                                                                                         │

│    * If the above advice does not help, please let us know:                                                             │

│      https://github.com/kubernetes/minikube/issues/new/choose                                                           │

│                                                                                                                         │

│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                │

│    * Please also attach the following file to the GitHub issue:                                                         │

│    * - /var/folders/52/zh_qmlrn1f36yr6lgs7nxtym0000gp/T/minikube_node_1c3a1297795327375b61f3ff5a4ef34c9b2fc69b_0.log    │

│                                                                                                                         │

╰─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯

I0229 10:35:18.557269    7000 out.go:177] 

multinode_test.go:285: node start returned an error. args "out/minikube-darwin-amd64 -p multinode-636000 node start m03 --alsologtostderr": exit status 85

multinode_test.go:289: (dbg) Run:  out/minikube-darwin-amd64 -p multinode-636000 status

multinode_test.go:289: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p multinode-636000 status: exit status 7 (114.666563ms)

-- stdout --

	multinode-636000

	type: Control Plane

	host: Nonexistent

	kubelet: Nonexistent

	apiserver: Nonexistent

	kubeconfig: Nonexistent

-- /stdout --

** stderr ** 

	E0229 10:35:18.695191    7002 status.go:260] status error: host: state: unknown state "multinode-636000": docker container inspect multinode-636000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	E0229 10:35:18.695202    7002 status.go:263] The "multinode-636000" host does not exist!

** /stderr **

multinode_test.go:291: failed to run minikube status. args "out/minikube-darwin-amd64 -p multinode-636000 status" : exit status 7

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:230: ======>  post-mortem[TestMultiNode/serial/StartAfterStop]: docker inspect <======

helpers_test.go:231: (dbg) Run:  docker inspect multinode-636000

helpers_test.go:235: (dbg) docker inspect multinode-636000:

-- stdout --

	[

	    {

	        "Name": "multinode-636000",

	        "Id": "00c1996055aa3b2ea80cdc2338072a3b25a3d3a7a9dbbeb8ec64b5100d2e2cd8",

	        "Created": "2024-02-29T18:27:26.377401079Z",

	        "Scope": "local",

	        "Driver": "bridge",

	        "EnableIPv6": false,

	        "IPAM": {

	            "Driver": "default",

	            "Options": {},

	            "Config": [

	                {

	                    "Subnet": "192.168.76.0/24",

	                    "Gateway": "192.168.76.1"

	                }

	            ]

	        },

	        "Internal": false,

	        "Attachable": false,

	        "Ingress": false,

	        "ConfigFrom": {

	            "Network": ""

	        },

	        "ConfigOnly": false,

	        "Containers": {},

	        "Options": {

	            "--icc": "",

	            "--ip-masq": "",

	            "com.docker.network.driver.mtu": "65535"

	        },

	        "Labels": {

	            "created_by.minikube.sigs.k8s.io": "true",

	            "name.minikube.sigs.k8s.io": "multinode-636000"

	        }

	    }

	]

-- /stdout --

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-636000 -n multinode-636000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-636000 -n multinode-636000: exit status 7 (113.955475ms)

-- stdout --

	Nonexistent

-- /stdout --

** stderr ** 

	E0229 10:35:18.861556    7008 status.go:249] status error: host: state: unknown state "multinode-636000": docker container inspect multinode-636000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

** /stderr **

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "multinode-636000" host is not running, skipping log retrieval (state="Nonexistent")

--- FAIL: TestMultiNode/serial/StartAfterStop (0.49s)

=== RUN   TestMultiNode/serial/RestartKeepsNodes

multinode_test.go:311: (dbg) Run:  out/minikube-darwin-amd64 node list -p multinode-636000

multinode_test.go:318: (dbg) Run:  out/minikube-darwin-amd64 stop -p multinode-636000

multinode_test.go:318: (dbg) Non-zero exit: out/minikube-darwin-amd64 stop -p multinode-636000: exit status 82 (12.649214381s)

-- stdout --

	* Stopping node "multinode-636000"  ...

	* Stopping node "multinode-636000"  ...

	* Stopping node "multinode-636000"  ...

	* Stopping node "multinode-636000"  ...

	* Stopping node "multinode-636000"  ...

	* Stopping node "multinode-636000"  ...

-- /stdout --

** stderr ** 

	X Exiting due to GUEST_STOP_TIMEOUT: Unable to stop VM: docker container inspect multinode-636000 --format=<no value>: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	* 

	╭─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                                                         │

	│    * If the above advice does not help, please let us know:                                                             │

	│      https://github.com/kubernetes/minikube/issues/new/choose                                                           │

	│                                                                                                                         │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                │

	│    * Please also attach the following file to the GitHub issue:                                                         │

	│    * - /var/folders/52/zh_qmlrn1f36yr6lgs7nxtym0000gp/T/minikube_stop_24ef9d461bcadf056806ccb9bba8d5f9f54754a6_0.log    │

	│                                                                                                                         │

	╰─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯

** /stderr **

multinode_test.go:320: failed to run minikube stop. args "out/minikube-darwin-amd64 node list -p multinode-636000" : exit status 82

multinode_test.go:323: (dbg) Run:  out/minikube-darwin-amd64 start -p multinode-636000 --wait=true -v=8 --alsologtostderr

E0229 10:39:02.098799    1408 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/18259-932/.minikube/profiles/addons-551000/client.crt: no such file or directory

E0229 10:39:19.046718    1408 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/18259-932/.minikube/profiles/addons-551000/client.crt: no such file or directory

E0229 10:39:50.669436    1408 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/18259-932/.minikube/profiles/functional-081000/client.crt: no such file or directory

E0229 10:44:19.042802    1408 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/18259-932/.minikube/profiles/addons-551000/client.crt: no such file or directory

E0229 10:44:33.717937    1408 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/18259-932/.minikube/profiles/functional-081000/client.crt: no such file or directory

E0229 10:44:50.664626    1408 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/18259-932/.minikube/profiles/functional-081000/client.crt: no such file or directory

multinode_test.go:323: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p multinode-636000 --wait=true -v=8 --alsologtostderr: exit status 52 (13m1.875240204s)

-- stdout --

	* [multinode-636000] minikube v1.32.0 on Darwin 14.3.1

	  - MINIKUBE_LOCATION=18259

	  - KUBECONFIG=/Users/jenkins/minikube-integration/18259-932/kubeconfig

	  - MINIKUBE_BIN=out/minikube-darwin-amd64

	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18259-932/.minikube

	  - MINIKUBE_FORCE_SYSTEMD=

	* Using the docker driver based on existing profile

	* Starting control plane node multinode-636000 in cluster multinode-636000

	* Pulling base image v0.0.42-1708944392-18244 ...

	* docker "multinode-636000" container is missing, will recreate.

	* Creating docker container (CPUs=2, Memory=2200MB) ...

	* docker "multinode-636000" container is missing, will recreate.

	* Creating docker container (CPUs=2, Memory=2200MB) ...

-- /stdout --

** stderr ** 

	I0229 10:35:31.639232    7031 out.go:291] Setting OutFile to fd 1 ...

	I0229 10:35:31.639482    7031 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0229 10:35:31.639487    7031 out.go:304] Setting ErrFile to fd 2...

	I0229 10:35:31.639490    7031 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0229 10:35:31.639678    7031 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18259-932/.minikube/bin

	I0229 10:35:31.641099    7031 out.go:298] Setting JSON to false

	I0229 10:35:31.664373    7031 start.go:129] hostinfo: {"hostname":"MacOS-Agent-1.local","uptime":3901,"bootTime":1709227830,"procs":484,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"b7610dcb-1435-5842-8d5a-b2388403fea3"}

	W0229 10:35:31.664463    7031 start.go:137] gopshost.Virtualization returned error: not implemented yet

	I0229 10:35:31.685871    7031 out.go:177] * [multinode-636000] minikube v1.32.0 on Darwin 14.3.1

	I0229 10:35:31.730106    7031 out.go:177]   - MINIKUBE_LOCATION=18259

	I0229 10:35:31.730186    7031 notify.go:220] Checking for updates...

	I0229 10:35:31.753157    7031 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/18259-932/kubeconfig

	I0229 10:35:31.781095    7031 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64

	I0229 10:35:31.801426    7031 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I0229 10:35:31.822694    7031 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18259-932/.minikube

	I0229 10:35:31.843436    7031 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=

	I0229 10:35:31.865348    7031 config.go:182] Loaded profile config "multinode-636000": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.28.4

	I0229 10:35:31.865543    7031 driver.go:392] Setting default libvirt URI to qemu:///system

	I0229 10:35:31.921442    7031 docker.go:122] docker version: linux-25.0.3:Docker Desktop 4.27.2 (137060)

	I0229 10:35:31.921582    7031 cli_runner.go:164] Run: docker system info --format "{{json .}}"

	I0229 10:35:32.020792    7031 info.go:266] docker info: {ID:37b3081a-8cd6-457e-b2a4-79dc82345b06 Containers:3 ContainersRunning:1 ContainersPaused:0 ContainersStopped:2 Images:2 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:78 OomKillDisable:false NGoroutines:135 SystemTime:2024-02-29 18:35:32.01123433 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:26 KernelVersion:6.6.12-linuxkit OperatingSystem:Docker Desktop OSType:linux Architecture:x86_64 IndexServerAddress:h

ttps://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:12 MemTotal:6213292032 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy:http.docker.internal:3128 HTTPSProxy:http.docker.internal:3128 NoProxy:hubproxy.docker.internal Name:docker-desktop Labels:[] ExperimentalBuild:false ServerVersion:25.0.3 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:ae07eda36dd25f8a1b98dfbf587313b99c0190bb Expected:ae07eda36dd25f8a1b98dfbf587313b99c0190bb} RuncCommit:{ID:v1.1.12-0-g51d5e94 Expected:v1.1.12-0-g51d5e94} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=seccomp,profile=unconfined name=

cgroupns] ProductLicense: Warnings:[WARNING: daemon is not using the default seccomp profile] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/Users/jenkins/.docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-buildx] ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.12.1-desktop.4] map[Name:compose Path:/Users/jenkins/.docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-compose] ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.24.5-desktop.1] map[Name:debug Path:/Users/jenkins/.docker/cli-plugins/docker-debug SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-debug] ShortDescription:Get a shell into any image or container. Vendor:Docker Inc. Version:0.0.24] map[Name:dev Path:/Users/jenkins/.docker/cli-plugins/docker-dev SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-dev] ShortDescription:Docker De

v Environments Vendor:Docker Inc. Version:v0.1.0] map[Name:extension Path:/Users/jenkins/.docker/cli-plugins/docker-extension SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-extension] ShortDescription:Manages Docker extensions Vendor:Docker Inc. Version:v0.2.21] map[Name:feedback Path:/Users/jenkins/.docker/cli-plugins/docker-feedback SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-feedback] ShortDescription:Provide feedback, right in your terminal! Vendor:Docker Inc. Version:v1.0.4] map[Name:init Path:/Users/jenkins/.docker/cli-plugins/docker-init SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-init] ShortDescription:Creates Docker-related starter files for your project Vendor:Docker Inc. Version:v1.0.0] map[Name:sbom Path:/Users/jenkins/.docker/cli-plugins/docker-sbom SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-sbom] ShortDescription:View the packaged-based Software Bill Of Materials (SBOM) f

or an image URL:https://github.com/docker/sbom-cli-plugin Vendor:Anchore Inc. Version:0.6.0] map[Err:failed to fetch metadata: fork/exec /Users/jenkins/.docker/cli-plugins/docker-scan: no such file or directory Name:scan Path:/Users/jenkins/.docker/cli-plugins/docker-scan] map[Name:scout Path:/Users/jenkins/.docker/cli-plugins/docker-scout SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-scout] ShortDescription:Docker Scout Vendor:Docker Inc. Version:v1.4.1]] Warnings:<nil>}}

	I0229 10:35:32.043114    7031 out.go:177] * Using the docker driver based on existing profile

	I0229 10:35:32.066460    7031 start.go:299] selected driver: docker

	I0229 10:35:32.066477    7031 start.go:903] validating driver "docker" against &{Name:multinode-636000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:multinode-636000 Namespace:default APIServerName:minikube

CA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false Disabl

eMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I0229 10:35:32.066559    7031 start.go:914] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}

	I0229 10:35:32.066725    7031 cli_runner.go:164] Run: docker system info --format "{{json .}}"

	I0229 10:35:32.169669    7031 info.go:266] docker info: {ID:37b3081a-8cd6-457e-b2a4-79dc82345b06 Containers:3 ContainersRunning:1 ContainersPaused:0 ContainersStopped:2 Images:2 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:78 OomKillDisable:false NGoroutines:135 SystemTime:2024-02-29 18:35:32.159488741 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:26 KernelVersion:6.6.12-linuxkit OperatingSystem:Docker Desktop OSType:linux Architecture:x86_64 IndexServerAddress:

https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:12 MemTotal:6213292032 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy:http.docker.internal:3128 HTTPSProxy:http.docker.internal:3128 NoProxy:hubproxy.docker.internal Name:docker-desktop Labels:[] ExperimentalBuild:false ServerVersion:25.0.3 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:ae07eda36dd25f8a1b98dfbf587313b99c0190bb Expected:ae07eda36dd25f8a1b98dfbf587313b99c0190bb} RuncCommit:{ID:v1.1.12-0-g51d5e94 Expected:v1.1.12-0-g51d5e94} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=seccomp,profile=unconfined name

=cgroupns] ProductLicense: Warnings:[WARNING: daemon is not using the default seccomp profile] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/Users/jenkins/.docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-buildx] ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.12.1-desktop.4] map[Name:compose Path:/Users/jenkins/.docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-compose] ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.24.5-desktop.1] map[Name:debug Path:/Users/jenkins/.docker/cli-plugins/docker-debug SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-debug] ShortDescription:Get a shell into any image or container. Vendor:Docker Inc. Version:0.0.24] map[Name:dev Path:/Users/jenkins/.docker/cli-plugins/docker-dev SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-dev] ShortDescription:Docker D

ev Environments Vendor:Docker Inc. Version:v0.1.0] map[Name:extension Path:/Users/jenkins/.docker/cli-plugins/docker-extension SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-extension] ShortDescription:Manages Docker extensions Vendor:Docker Inc. Version:v0.2.21] map[Name:feedback Path:/Users/jenkins/.docker/cli-plugins/docker-feedback SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-feedback] ShortDescription:Provide feedback, right in your terminal! Vendor:Docker Inc. Version:v1.0.4] map[Name:init Path:/Users/jenkins/.docker/cli-plugins/docker-init SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-init] ShortDescription:Creates Docker-related starter files for your project Vendor:Docker Inc. Version:v1.0.0] map[Name:sbom Path:/Users/jenkins/.docker/cli-plugins/docker-sbom SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-sbom] ShortDescription:View the packaged-based Software Bill Of Materials (SBOM)

for an image URL:https://github.com/docker/sbom-cli-plugin Vendor:Anchore Inc. Version:0.6.0] map[Err:failed to fetch metadata: fork/exec /Users/jenkins/.docker/cli-plugins/docker-scan: no such file or directory Name:scan Path:/Users/jenkins/.docker/cli-plugins/docker-scan] map[Name:scout Path:/Users/jenkins/.docker/cli-plugins/docker-scout SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-scout] ShortDescription:Docker Scout Vendor:Docker Inc. Version:v1.4.1]] Warnings:<nil>}}

	I0229 10:35:32.173036    7031 start_flags.go:931] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]

	I0229 10:35:32.173108    7031 cni.go:84] Creating CNI manager for ""

	I0229 10:35:32.173117    7031 cni.go:136] 1 nodes found, recommending kindnet

	I0229 10:35:32.173127    7031 start_flags.go:323] config:

	{Name:multinode-636000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:multinode-636000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:do

cker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: S

taticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I0229 10:35:32.194830    7031 out.go:177] * Starting control plane node multinode-636000 in cluster multinode-636000

	I0229 10:35:32.217651    7031 cache.go:121] Beginning downloading kic base image for docker with docker

	I0229 10:35:32.238380    7031 out.go:177] * Pulling base image v0.0.42-1708944392-18244 ...

	I0229 10:35:32.281670    7031 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker

	I0229 10:35:32.281746    7031 preload.go:148] Found local preload: /Users/jenkins/minikube-integration/18259-932/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4

	I0229 10:35:32.281734    7031 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 in local docker daemon

	I0229 10:35:32.281770    7031 cache.go:56] Caching tarball of preloaded images

	I0229 10:35:32.282007    7031 preload.go:174] Found /Users/jenkins/minikube-integration/18259-932/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4 in cache, skipping download

	I0229 10:35:32.282030    7031 cache.go:59] Finished verifying existence of preloaded tar for  v1.28.4 on docker

	I0229 10:35:32.282887    7031 profile.go:148] Saving config to /Users/jenkins/minikube-integration/18259-932/.minikube/profiles/multinode-636000/config.json ...

	I0229 10:35:32.332495    7031 image.go:83] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 in local docker daemon, skipping pull

	I0229 10:35:32.332517    7031 cache.go:144] gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 exists in daemon, skipping load

	I0229 10:35:32.332538    7031 cache.go:194] Successfully downloaded all kic artifacts

	I0229 10:35:32.332584    7031 start.go:365] acquiring machines lock for multinode-636000: {Name:mk724cab9aafa05d3a600dc983677a58b42dc1e0 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0229 10:35:32.332673    7031 start.go:369] acquired machines lock for "multinode-636000" in 70.695µs

	I0229 10:35:32.332695    7031 start.go:96] Skipping create...Using existing machine configuration

	I0229 10:35:32.332705    7031 fix.go:54] fixHost starting: 

	I0229 10:35:32.332934    7031 cli_runner.go:164] Run: docker container inspect multinode-636000 --format={{.State.Status}}

	W0229 10:35:32.383473    7031 cli_runner.go:211] docker container inspect multinode-636000 --format={{.State.Status}} returned with exit code 1

	I0229 10:35:32.383524    7031 fix.go:102] recreateIfNeeded on multinode-636000: state= err=unknown state "multinode-636000": docker container inspect multinode-636000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	I0229 10:35:32.383545    7031 fix.go:107] machineExists: false. err=machine does not exist

	I0229 10:35:32.405617    7031 out.go:177] * docker "multinode-636000" container is missing, will recreate.

	I0229 10:35:32.447238    7031 delete.go:124] DEMOLISHING multinode-636000 ...

	I0229 10:35:32.447423    7031 cli_runner.go:164] Run: docker container inspect multinode-636000 --format={{.State.Status}}

	W0229 10:35:32.498151    7031 cli_runner.go:211] docker container inspect multinode-636000 --format={{.State.Status}} returned with exit code 1

	W0229 10:35:32.498200    7031 stop.go:75] unable to get state: unknown state "multinode-636000": docker container inspect multinode-636000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	I0229 10:35:32.498220    7031 delete.go:128] stophost failed (probably ok): ssh power off: unknown state "multinode-636000": docker container inspect multinode-636000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	I0229 10:35:32.498578    7031 cli_runner.go:164] Run: docker container inspect multinode-636000 --format={{.State.Status}}

	W0229 10:35:32.547515    7031 cli_runner.go:211] docker container inspect multinode-636000 --format={{.State.Status}} returned with exit code 1

	I0229 10:35:32.547568    7031 delete.go:82] Unable to get host status for multinode-636000, assuming it has already been deleted: state: unknown state "multinode-636000": docker container inspect multinode-636000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	I0229 10:35:32.547654    7031 cli_runner.go:164] Run: docker container inspect -f {{.Id}} multinode-636000

	W0229 10:35:32.597057    7031 cli_runner.go:211] docker container inspect -f {{.Id}} multinode-636000 returned with exit code 1

	I0229 10:35:32.597090    7031 kic.go:371] could not find the container multinode-636000 to remove it. will try anyways

	I0229 10:35:32.597163    7031 cli_runner.go:164] Run: docker container inspect multinode-636000 --format={{.State.Status}}

	W0229 10:35:32.646653    7031 cli_runner.go:211] docker container inspect multinode-636000 --format={{.State.Status}} returned with exit code 1

	W0229 10:35:32.646699    7031 oci.go:84] error getting container status, will try to delete anyways: unknown state "multinode-636000": docker container inspect multinode-636000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	I0229 10:35:32.646790    7031 cli_runner.go:164] Run: docker exec --privileged -t multinode-636000 /bin/bash -c "sudo init 0"

	W0229 10:35:32.695725    7031 cli_runner.go:211] docker exec --privileged -t multinode-636000 /bin/bash -c "sudo init 0" returned with exit code 1

	I0229 10:35:32.695753    7031 oci.go:650] error shutdown multinode-636000: docker exec --privileged -t multinode-636000 /bin/bash -c "sudo init 0": exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	I0229 10:35:33.696253    7031 cli_runner.go:164] Run: docker container inspect multinode-636000 --format={{.State.Status}}

	W0229 10:35:33.749978    7031 cli_runner.go:211] docker container inspect multinode-636000 --format={{.State.Status}} returned with exit code 1

	I0229 10:35:33.750025    7031 oci.go:662] temporary error verifying shutdown: unknown state "multinode-636000": docker container inspect multinode-636000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	I0229 10:35:33.750033    7031 oci.go:664] temporary error: container multinode-636000 status is  but expect it to be exited

	I0229 10:35:33.750074    7031 retry.go:31] will retry after 597.509734ms: couldn't verify container is exited. %v: unknown state "multinode-636000": docker container inspect multinode-636000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	I0229 10:35:34.349565    7031 cli_runner.go:164] Run: docker container inspect multinode-636000 --format={{.State.Status}}

	W0229 10:35:34.402316    7031 cli_runner.go:211] docker container inspect multinode-636000 --format={{.State.Status}} returned with exit code 1

	I0229 10:35:34.402368    7031 oci.go:662] temporary error verifying shutdown: unknown state "multinode-636000": docker container inspect multinode-636000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	I0229 10:35:34.402377    7031 oci.go:664] temporary error: container multinode-636000 status is  but expect it to be exited

	I0229 10:35:34.402402    7031 retry.go:31] will retry after 1.11425808s: couldn't verify container is exited. %v: unknown state "multinode-636000": docker container inspect multinode-636000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	I0229 10:35:35.518186    7031 cli_runner.go:164] Run: docker container inspect multinode-636000 --format={{.State.Status}}

	W0229 10:35:35.571515    7031 cli_runner.go:211] docker container inspect multinode-636000 --format={{.State.Status}} returned with exit code 1

	I0229 10:35:35.571559    7031 oci.go:662] temporary error verifying shutdown: unknown state "multinode-636000": docker container inspect multinode-636000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	I0229 10:35:35.571570    7031 oci.go:664] temporary error: container multinode-636000 status is  but expect it to be exited

	I0229 10:35:35.571595    7031 retry.go:31] will retry after 853.854459ms: couldn't verify container is exited. %v: unknown state "multinode-636000": docker container inspect multinode-636000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	I0229 10:35:36.426164    7031 cli_runner.go:164] Run: docker container inspect multinode-636000 --format={{.State.Status}}

	W0229 10:35:36.479318    7031 cli_runner.go:211] docker container inspect multinode-636000 --format={{.State.Status}} returned with exit code 1

	I0229 10:35:36.479362    7031 oci.go:662] temporary error verifying shutdown: unknown state "multinode-636000": docker container inspect multinode-636000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	I0229 10:35:36.479374    7031 oci.go:664] temporary error: container multinode-636000 status is  but expect it to be exited

	I0229 10:35:36.479400    7031 retry.go:31] will retry after 2.31646784s: couldn't verify container is exited. %v: unknown state "multinode-636000": docker container inspect multinode-636000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	I0229 10:35:38.798165    7031 cli_runner.go:164] Run: docker container inspect multinode-636000 --format={{.State.Status}}

	W0229 10:35:38.851089    7031 cli_runner.go:211] docker container inspect multinode-636000 --format={{.State.Status}} returned with exit code 1

	I0229 10:35:38.851134    7031 oci.go:662] temporary error verifying shutdown: unknown state "multinode-636000": docker container inspect multinode-636000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	I0229 10:35:38.851144    7031 oci.go:664] temporary error: container multinode-636000 status is  but expect it to be exited

	I0229 10:35:38.851170    7031 retry.go:31] will retry after 2.999982507s: couldn't verify container is exited. %v: unknown state "multinode-636000": docker container inspect multinode-636000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	I0229 10:35:41.851351    7031 cli_runner.go:164] Run: docker container inspect multinode-636000 --format={{.State.Status}}

	W0229 10:35:41.903892    7031 cli_runner.go:211] docker container inspect multinode-636000 --format={{.State.Status}} returned with exit code 1

	I0229 10:35:41.903936    7031 oci.go:662] temporary error verifying shutdown: unknown state "multinode-636000": docker container inspect multinode-636000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	I0229 10:35:41.903945    7031 oci.go:664] temporary error: container multinode-636000 status is  but expect it to be exited

	I0229 10:35:41.903974    7031 retry.go:31] will retry after 3.29923301s: couldn't verify container is exited. %v: unknown state "multinode-636000": docker container inspect multinode-636000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	I0229 10:35:45.205300    7031 cli_runner.go:164] Run: docker container inspect multinode-636000 --format={{.State.Status}}

	W0229 10:35:45.254681    7031 cli_runner.go:211] docker container inspect multinode-636000 --format={{.State.Status}} returned with exit code 1

	I0229 10:35:45.254726    7031 oci.go:662] temporary error verifying shutdown: unknown state "multinode-636000": docker container inspect multinode-636000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	I0229 10:35:45.254734    7031 oci.go:664] temporary error: container multinode-636000 status is  but expect it to be exited

	I0229 10:35:45.254759    7031 retry.go:31] will retry after 6.576598252s: couldn't verify container is exited. %v: unknown state "multinode-636000": docker container inspect multinode-636000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	I0229 10:35:51.832953    7031 cli_runner.go:164] Run: docker container inspect multinode-636000 --format={{.State.Status}}

	W0229 10:35:51.887238    7031 cli_runner.go:211] docker container inspect multinode-636000 --format={{.State.Status}} returned with exit code 1

	I0229 10:35:51.887280    7031 oci.go:662] temporary error verifying shutdown: unknown state "multinode-636000": docker container inspect multinode-636000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	I0229 10:35:51.887290    7031 oci.go:664] temporary error: container multinode-636000 status is  but expect it to be exited

	I0229 10:35:51.887319    7031 oci.go:88] couldn't shut down multinode-636000 (might be okay): verify shutdown: couldn't verify container is exited. %v: unknown state "multinode-636000": docker container inspect multinode-636000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	I0229 10:35:51.887393    7031 cli_runner.go:164] Run: docker rm -f -v multinode-636000

	I0229 10:35:51.937073    7031 cli_runner.go:164] Run: docker container inspect -f {{.Id}} multinode-636000

	W0229 10:35:51.986282    7031 cli_runner.go:211] docker container inspect -f {{.Id}} multinode-636000 returned with exit code 1

	I0229 10:35:51.986393    7031 cli_runner.go:164] Run: docker network inspect multinode-636000 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"

	I0229 10:35:52.036067    7031 cli_runner.go:164] Run: docker network rm multinode-636000

	I0229 10:35:52.146486    7031 fix.go:114] Sleeping 1 second for extra luck!

	I0229 10:35:53.148589    7031 start.go:125] createHost starting for "" (driver="docker")

	I0229 10:35:53.170536    7031 out.go:204] * Creating docker container (CPUs=2, Memory=2200MB) ...

	I0229 10:35:53.170730    7031 start.go:159] libmachine.API.Create for "multinode-636000" (driver="docker")

	I0229 10:35:53.170783    7031 client.go:168] LocalClient.Create starting

	I0229 10:35:53.170959    7031 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18259-932/.minikube/certs/ca.pem

	I0229 10:35:53.171048    7031 main.go:141] libmachine: Decoding PEM data...

	I0229 10:35:53.171083    7031 main.go:141] libmachine: Parsing certificate...

	I0229 10:35:53.171183    7031 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18259-932/.minikube/certs/cert.pem

	I0229 10:35:53.171263    7031 main.go:141] libmachine: Decoding PEM data...

	I0229 10:35:53.171279    7031 main.go:141] libmachine: Parsing certificate...

	I0229 10:35:53.193150    7031 cli_runner.go:164] Run: docker network inspect multinode-636000 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"

	W0229 10:35:53.244658    7031 cli_runner.go:211] docker network inspect multinode-636000 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1

	I0229 10:35:53.244745    7031 network_create.go:281] running [docker network inspect multinode-636000] to gather additional debugging logs...

	I0229 10:35:53.244763    7031 cli_runner.go:164] Run: docker network inspect multinode-636000

	W0229 10:35:53.293786    7031 cli_runner.go:211] docker network inspect multinode-636000 returned with exit code 1

	I0229 10:35:53.293816    7031 network_create.go:284] error running [docker network inspect multinode-636000]: docker network inspect multinode-636000: exit status 1

	stdout:

	[]

	stderr:

	Error response from daemon: network multinode-636000 not found

	I0229 10:35:53.293827    7031 network_create.go:286] output of [docker network inspect multinode-636000]: -- stdout --

	[]

	-- /stdout --

	** stderr ** 

	Error response from daemon: network multinode-636000 not found

	** /stderr **

	I0229 10:35:53.293936    7031 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"

	I0229 10:35:53.345426    7031 network.go:210] skipping subnet 192.168.49.0/24 that is reserved: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:<nil>}

	I0229 10:35:53.345801    7031 network.go:207] using free private subnet 192.168.58.0/24: &{IP:192.168.58.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.58.0/24 Gateway:192.168.58.1 ClientMin:192.168.58.2 ClientMax:192.168.58.254 Broadcast:192.168.58.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc0021dff40}

	I0229 10:35:53.345819    7031 network_create.go:124] attempt to create docker network multinode-636000 192.168.58.0/24 with gateway 192.168.58.1 and MTU of 65535 ...

	I0229 10:35:53.345893    7031 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.58.0/24 --gateway=192.168.58.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=65535 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=multinode-636000 multinode-636000

	I0229 10:35:53.431814    7031 network_create.go:108] docker network multinode-636000 192.168.58.0/24 created

	I0229 10:35:53.431856    7031 kic.go:121] calculated static IP "192.168.58.2" for the "multinode-636000" container

	I0229 10:35:53.431981    7031 cli_runner.go:164] Run: docker ps -a --format {{.Names}}

	I0229 10:35:53.481333    7031 cli_runner.go:164] Run: docker volume create multinode-636000 --label name.minikube.sigs.k8s.io=multinode-636000 --label created_by.minikube.sigs.k8s.io=true

	I0229 10:35:53.530364    7031 oci.go:103] Successfully created a docker volume multinode-636000

	I0229 10:35:53.530482    7031 cli_runner.go:164] Run: docker run --rm --name multinode-636000-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=multinode-636000 --entrypoint /usr/bin/test -v multinode-636000:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 -d /var/lib

	I0229 10:35:53.831316    7031 oci.go:107] Successfully prepared a docker volume multinode-636000

	I0229 10:35:53.831356    7031 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker

	I0229 10:35:53.831369    7031 kic.go:194] Starting extracting preloaded images to volume ...

	I0229 10:35:53.831475    7031 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v /Users/jenkins/minikube-integration/18259-932/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4:/preloaded.tar:ro -v multinode-636000:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 -I lz4 -xf /preloaded.tar -C /extractDir

	I0229 10:41:53.167040    7031 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0229 10:41:53.167148    7031 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000

	W0229 10:41:53.217763    7031 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000 returned with exit code 1

	I0229 10:41:53.217885    7031 retry.go:31] will retry after 130.046864ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "multinode-636000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	I0229 10:41:53.349884    7031 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000

	W0229 10:41:53.400589    7031 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000 returned with exit code 1

	I0229 10:41:53.400712    7031 retry.go:31] will retry after 397.881872ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "multinode-636000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	I0229 10:41:53.799083    7031 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000

	W0229 10:41:53.852845    7031 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000 returned with exit code 1

	I0229 10:41:53.852952    7031 retry.go:31] will retry after 752.347489ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "multinode-636000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	I0229 10:41:54.605876    7031 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000

	W0229 10:41:54.659477    7031 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000 returned with exit code 1

	W0229 10:41:54.659599    7031 start.go:275] error running df -h /var: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "multinode-636000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	W0229 10:41:54.659616    7031 start.go:242] error getting percentage of /var that is free: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "multinode-636000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	I0229 10:41:54.659683    7031 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"

	I0229 10:41:54.659735    7031 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000

	W0229 10:41:54.709218    7031 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000 returned with exit code 1

	I0229 10:41:54.709316    7031 retry.go:31] will retry after 251.694828ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "multinode-636000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	I0229 10:41:54.961765    7031 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000

	W0229 10:41:55.011981    7031 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000 returned with exit code 1

	I0229 10:41:55.012080    7031 retry.go:31] will retry after 387.108565ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "multinode-636000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	I0229 10:41:55.401384    7031 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000

	W0229 10:41:55.454308    7031 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000 returned with exit code 1

	I0229 10:41:55.454409    7031 retry.go:31] will retry after 383.628692ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "multinode-636000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	I0229 10:41:55.838790    7031 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000

	W0229 10:41:55.890144    7031 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000 returned with exit code 1

	I0229 10:41:55.890236    7031 retry.go:31] will retry after 588.844529ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "multinode-636000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	I0229 10:41:56.481413    7031 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000

	W0229 10:41:56.532091    7031 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000 returned with exit code 1

	W0229 10:41:56.532198    7031 start.go:290] error running df -BG /var: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "multinode-636000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	W0229 10:41:56.532222    7031 start.go:247] error getting GiB of /var that is available: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "multinode-636000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	I0229 10:41:56.532239    7031 start.go:128] duration metric: createHost completed in 6m3.388194754s

	I0229 10:41:56.532305    7031 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0229 10:41:56.532361    7031 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000

	W0229 10:41:56.581366    7031 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000 returned with exit code 1

	I0229 10:41:56.581456    7031 retry.go:31] will retry after 271.806125ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "multinode-636000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	I0229 10:41:56.854623    7031 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000

	W0229 10:41:56.905476    7031 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000 returned with exit code 1

	I0229 10:41:56.905568    7031 retry.go:31] will retry after 416.153218ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "multinode-636000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	I0229 10:41:57.322484    7031 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000

	W0229 10:41:57.414947    7031 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000 returned with exit code 1

	I0229 10:41:57.415040    7031 retry.go:31] will retry after 692.308552ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "multinode-636000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	I0229 10:41:58.108248    7031 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000

	W0229 10:41:58.159748    7031 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000 returned with exit code 1

	W0229 10:41:58.159850    7031 start.go:275] error running df -h /var: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "multinode-636000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	W0229 10:41:58.159866    7031 start.go:242] error getting percentage of /var that is free: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "multinode-636000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	I0229 10:41:58.159921    7031 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"

	I0229 10:41:58.159971    7031 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000

	W0229 10:41:58.208505    7031 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000 returned with exit code 1

	I0229 10:41:58.208601    7031 retry.go:31] will retry after 337.440902ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "multinode-636000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	I0229 10:41:58.548441    7031 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000

	W0229 10:41:58.600639    7031 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000 returned with exit code 1

	I0229 10:41:58.600729    7031 retry.go:31] will retry after 396.475298ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "multinode-636000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	I0229 10:41:58.998395    7031 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000

	W0229 10:41:59.049866    7031 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000 returned with exit code 1

	I0229 10:41:59.049959    7031 retry.go:31] will retry after 472.622184ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "multinode-636000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	I0229 10:41:59.523046    7031 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000

	W0229 10:41:59.577300    7031 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000 returned with exit code 1

	W0229 10:41:59.577403    7031 start.go:290] error running df -BG /var: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "multinode-636000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	W0229 10:41:59.577421    7031 start.go:247] error getting GiB of /var that is available: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "multinode-636000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	I0229 10:41:59.577438    7031 fix.go:56] fixHost completed within 6m27.249650082s

	I0229 10:41:59.577444    7031 start.go:83] releasing machines lock for "multinode-636000", held for 6m27.24967862s

	W0229 10:41:59.577459    7031 start.go:694] error starting host: recreate: creating host: create host timed out in 360.000000 seconds

	W0229 10:41:59.577525    7031 out.go:239] ! StartHost failed, but will try again: recreate: creating host: create host timed out in 360.000000 seconds

	! StartHost failed, but will try again: recreate: creating host: create host timed out in 360.000000 seconds

	I0229 10:41:59.577531    7031 start.go:709] Will try again in 5 seconds ...

	I0229 10:42:04.578733    7031 start.go:365] acquiring machines lock for multinode-636000: {Name:mk724cab9aafa05d3a600dc983677a58b42dc1e0 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0229 10:42:04.578927    7031 start.go:369] acquired machines lock for "multinode-636000" in 154.687µs

	I0229 10:42:04.578971    7031 start.go:96] Skipping create...Using existing machine configuration

	I0229 10:42:04.578978    7031 fix.go:54] fixHost starting: 

	I0229 10:42:04.579437    7031 cli_runner.go:164] Run: docker container inspect multinode-636000 --format={{.State.Status}}

	W0229 10:42:04.632126    7031 cli_runner.go:211] docker container inspect multinode-636000 --format={{.State.Status}} returned with exit code 1

	I0229 10:42:04.632173    7031 fix.go:102] recreateIfNeeded on multinode-636000: state= err=unknown state "multinode-636000": docker container inspect multinode-636000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	I0229 10:42:04.632188    7031 fix.go:107] machineExists: false. err=machine does not exist

	I0229 10:42:04.654034    7031 out.go:177] * docker "multinode-636000" container is missing, will recreate.

	I0229 10:42:04.696755    7031 delete.go:124] DEMOLISHING multinode-636000 ...

	I0229 10:42:04.696931    7031 cli_runner.go:164] Run: docker container inspect multinode-636000 --format={{.State.Status}}

	W0229 10:42:04.747722    7031 cli_runner.go:211] docker container inspect multinode-636000 --format={{.State.Status}} returned with exit code 1

	W0229 10:42:04.747768    7031 stop.go:75] unable to get state: unknown state "multinode-636000": docker container inspect multinode-636000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	I0229 10:42:04.747787    7031 delete.go:128] stophost failed (probably ok): ssh power off: unknown state "multinode-636000": docker container inspect multinode-636000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	I0229 10:42:04.748140    7031 cli_runner.go:164] Run: docker container inspect multinode-636000 --format={{.State.Status}}

	W0229 10:42:04.797409    7031 cli_runner.go:211] docker container inspect multinode-636000 --format={{.State.Status}} returned with exit code 1

	I0229 10:42:04.797453    7031 delete.go:82] Unable to get host status for multinode-636000, assuming it has already been deleted: state: unknown state "multinode-636000": docker container inspect multinode-636000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	I0229 10:42:04.797525    7031 cli_runner.go:164] Run: docker container inspect -f {{.Id}} multinode-636000

	W0229 10:42:04.846446    7031 cli_runner.go:211] docker container inspect -f {{.Id}} multinode-636000 returned with exit code 1

	I0229 10:42:04.846477    7031 kic.go:371] could not find the container multinode-636000 to remove it. will try anyways

	I0229 10:42:04.846549    7031 cli_runner.go:164] Run: docker container inspect multinode-636000 --format={{.State.Status}}

	W0229 10:42:04.895787    7031 cli_runner.go:211] docker container inspect multinode-636000 --format={{.State.Status}} returned with exit code 1

	W0229 10:42:04.895834    7031 oci.go:84] error getting container status, will try to delete anyways: unknown state "multinode-636000": docker container inspect multinode-636000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	I0229 10:42:04.895919    7031 cli_runner.go:164] Run: docker exec --privileged -t multinode-636000 /bin/bash -c "sudo init 0"

	W0229 10:42:04.945370    7031 cli_runner.go:211] docker exec --privileged -t multinode-636000 /bin/bash -c "sudo init 0" returned with exit code 1

	I0229 10:42:04.945398    7031 oci.go:650] error shutdown multinode-636000: docker exec --privileged -t multinode-636000 /bin/bash -c "sudo init 0": exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	I0229 10:42:05.946066    7031 cli_runner.go:164] Run: docker container inspect multinode-636000 --format={{.State.Status}}

	W0229 10:42:05.997063    7031 cli_runner.go:211] docker container inspect multinode-636000 --format={{.State.Status}} returned with exit code 1

	I0229 10:42:05.997110    7031 oci.go:662] temporary error verifying shutdown: unknown state "multinode-636000": docker container inspect multinode-636000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	I0229 10:42:05.997124    7031 oci.go:664] temporary error: container multinode-636000 status is  but expect it to be exited

	I0229 10:42:05.997151    7031 retry.go:31] will retry after 703.908357ms: couldn't verify container is exited. %v: unknown state "multinode-636000": docker container inspect multinode-636000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	I0229 10:42:06.701890    7031 cli_runner.go:164] Run: docker container inspect multinode-636000 --format={{.State.Status}}

	W0229 10:42:06.753248    7031 cli_runner.go:211] docker container inspect multinode-636000 --format={{.State.Status}} returned with exit code 1

	I0229 10:42:06.753298    7031 oci.go:662] temporary error verifying shutdown: unknown state "multinode-636000": docker container inspect multinode-636000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	I0229 10:42:06.753309    7031 oci.go:664] temporary error: container multinode-636000 status is  but expect it to be exited

	I0229 10:42:06.753341    7031 retry.go:31] will retry after 813.339792ms: couldn't verify container is exited. %v: unknown state "multinode-636000": docker container inspect multinode-636000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	I0229 10:42:07.567171    7031 cli_runner.go:164] Run: docker container inspect multinode-636000 --format={{.State.Status}}

	W0229 10:42:07.617172    7031 cli_runner.go:211] docker container inspect multinode-636000 --format={{.State.Status}} returned with exit code 1

	I0229 10:42:07.617217    7031 oci.go:662] temporary error verifying shutdown: unknown state "multinode-636000": docker container inspect multinode-636000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	I0229 10:42:07.617226    7031 oci.go:664] temporary error: container multinode-636000 status is  but expect it to be exited

	I0229 10:42:07.617247    7031 retry.go:31] will retry after 1.23539337s: couldn't verify container is exited. %v: unknown state "multinode-636000": docker container inspect multinode-636000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	I0229 10:42:08.854988    7031 cli_runner.go:164] Run: docker container inspect multinode-636000 --format={{.State.Status}}

	W0229 10:42:08.907578    7031 cli_runner.go:211] docker container inspect multinode-636000 --format={{.State.Status}} returned with exit code 1

	I0229 10:42:08.907638    7031 oci.go:662] temporary error verifying shutdown: unknown state "multinode-636000": docker container inspect multinode-636000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	I0229 10:42:08.907648    7031 oci.go:664] temporary error: container multinode-636000 status is  but expect it to be exited

	I0229 10:42:08.907674    7031 retry.go:31] will retry after 1.593866189s: couldn't verify container is exited. %v: unknown state "multinode-636000": docker container inspect multinode-636000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	I0229 10:42:10.502972    7031 cli_runner.go:164] Run: docker container inspect multinode-636000 --format={{.State.Status}}

	W0229 10:42:10.556301    7031 cli_runner.go:211] docker container inspect multinode-636000 --format={{.State.Status}} returned with exit code 1

	I0229 10:42:10.556348    7031 oci.go:662] temporary error verifying shutdown: unknown state "multinode-636000": docker container inspect multinode-636000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	I0229 10:42:10.556358    7031 oci.go:664] temporary error: container multinode-636000 status is  but expect it to be exited

	I0229 10:42:10.556384    7031 retry.go:31] will retry after 3.008420144s: couldn't verify container is exited. %v: unknown state "multinode-636000": docker container inspect multinode-636000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	I0229 10:42:13.566311    7031 cli_runner.go:164] Run: docker container inspect multinode-636000 --format={{.State.Status}}

	W0229 10:42:13.615744    7031 cli_runner.go:211] docker container inspect multinode-636000 --format={{.State.Status}} returned with exit code 1

	I0229 10:42:13.615787    7031 oci.go:662] temporary error verifying shutdown: unknown state "multinode-636000": docker container inspect multinode-636000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	I0229 10:42:13.615796    7031 oci.go:664] temporary error: container multinode-636000 status is  but expect it to be exited

	I0229 10:42:13.615821    7031 retry.go:31] will retry after 4.592774707s: couldn't verify container is exited. %v: unknown state "multinode-636000": docker container inspect multinode-636000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	I0229 10:42:18.209945    7031 cli_runner.go:164] Run: docker container inspect multinode-636000 --format={{.State.Status}}

	W0229 10:42:18.260243    7031 cli_runner.go:211] docker container inspect multinode-636000 --format={{.State.Status}} returned with exit code 1

	I0229 10:42:18.260290    7031 oci.go:662] temporary error verifying shutdown: unknown state "multinode-636000": docker container inspect multinode-636000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	I0229 10:42:18.260299    7031 oci.go:664] temporary error: container multinode-636000 status is  but expect it to be exited

	I0229 10:42:18.260320    7031 retry.go:31] will retry after 6.748985199s: couldn't verify container is exited. %v: unknown state "multinode-636000": docker container inspect multinode-636000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	I0229 10:42:25.009529    7031 cli_runner.go:164] Run: docker container inspect multinode-636000 --format={{.State.Status}}

	W0229 10:42:25.061722    7031 cli_runner.go:211] docker container inspect multinode-636000 --format={{.State.Status}} returned with exit code 1

	I0229 10:42:25.061770    7031 oci.go:662] temporary error verifying shutdown: unknown state "multinode-636000": docker container inspect multinode-636000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	I0229 10:42:25.061781    7031 oci.go:664] temporary error: container multinode-636000 status is  but expect it to be exited

	I0229 10:42:25.061808    7031 oci.go:88] couldn't shut down multinode-636000 (might be okay): verify shutdown: couldn't verify container is exited. %v: unknown state "multinode-636000": docker container inspect multinode-636000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	I0229 10:42:25.061880    7031 cli_runner.go:164] Run: docker rm -f -v multinode-636000

	I0229 10:42:25.111528    7031 cli_runner.go:164] Run: docker container inspect -f {{.Id}} multinode-636000

	W0229 10:42:25.160198    7031 cli_runner.go:211] docker container inspect -f {{.Id}} multinode-636000 returned with exit code 1

	I0229 10:42:25.160317    7031 cli_runner.go:164] Run: docker network inspect multinode-636000 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"

	I0229 10:42:25.210177    7031 cli_runner.go:164] Run: docker network rm multinode-636000

	I0229 10:42:25.326204    7031 fix.go:114] Sleeping 1 second for extra luck!

	I0229 10:42:26.326449    7031 start.go:125] createHost starting for "" (driver="docker")

	I0229 10:42:26.349383    7031 out.go:204] * Creating docker container (CPUs=2, Memory=2200MB) ...

	I0229 10:42:26.349554    7031 start.go:159] libmachine.API.Create for "multinode-636000" (driver="docker")

	I0229 10:42:26.349585    7031 client.go:168] LocalClient.Create starting

	I0229 10:42:26.349800    7031 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18259-932/.minikube/certs/ca.pem

	I0229 10:42:26.349902    7031 main.go:141] libmachine: Decoding PEM data...

	I0229 10:42:26.349931    7031 main.go:141] libmachine: Parsing certificate...

	I0229 10:42:26.350013    7031 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18259-932/.minikube/certs/cert.pem

	I0229 10:42:26.350083    7031 main.go:141] libmachine: Decoding PEM data...

	I0229 10:42:26.350099    7031 main.go:141] libmachine: Parsing certificate...

	I0229 10:42:26.350966    7031 cli_runner.go:164] Run: docker network inspect multinode-636000 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"

	W0229 10:42:26.403581    7031 cli_runner.go:211] docker network inspect multinode-636000 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1

	I0229 10:42:26.403667    7031 network_create.go:281] running [docker network inspect multinode-636000] to gather additional debugging logs...

	I0229 10:42:26.403684    7031 cli_runner.go:164] Run: docker network inspect multinode-636000

	W0229 10:42:26.453124    7031 cli_runner.go:211] docker network inspect multinode-636000 returned with exit code 1

	I0229 10:42:26.453147    7031 network_create.go:284] error running [docker network inspect multinode-636000]: docker network inspect multinode-636000: exit status 1

	stdout:

	[]

	stderr:

	Error response from daemon: network multinode-636000 not found

	I0229 10:42:26.453162    7031 network_create.go:286] output of [docker network inspect multinode-636000]: -- stdout --

	[]

	-- /stdout --

	** stderr ** 

	Error response from daemon: network multinode-636000 not found

	** /stderr **

	I0229 10:42:26.453297    7031 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"

	I0229 10:42:26.504306    7031 network.go:210] skipping subnet 192.168.49.0/24 that is reserved: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:<nil>}

	I0229 10:42:26.505886    7031 network.go:210] skipping subnet 192.168.58.0/24 that is reserved: &{IP:192.168.58.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.58.0/24 Gateway:192.168.58.1 ClientMin:192.168.58.2 ClientMax:192.168.58.254 Broadcast:192.168.58.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:<nil>}

	I0229 10:42:26.506246    7031 network.go:207] using free private subnet 192.168.67.0/24: &{IP:192.168.67.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.67.0/24 Gateway:192.168.67.1 ClientMin:192.168.67.2 ClientMax:192.168.67.254 Broadcast:192.168.67.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc000530300}

	I0229 10:42:26.506260    7031 network_create.go:124] attempt to create docker network multinode-636000 192.168.67.0/24 with gateway 192.168.67.1 and MTU of 65535 ...

	I0229 10:42:26.506323    7031 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.67.0/24 --gateway=192.168.67.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=65535 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=multinode-636000 multinode-636000

	W0229 10:42:26.556165    7031 cli_runner.go:211] docker network create --driver=bridge --subnet=192.168.67.0/24 --gateway=192.168.67.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=65535 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=multinode-636000 multinode-636000 returned with exit code 1

	W0229 10:42:26.556215    7031 network_create.go:149] failed to create docker network multinode-636000 192.168.67.0/24 with gateway 192.168.67.1 and mtu of 65535: docker network create --driver=bridge --subnet=192.168.67.0/24 --gateway=192.168.67.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=65535 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=multinode-636000 multinode-636000: exit status 1

	stdout:

	stderr:

	Error response from daemon: Pool overlaps with other one on this address space

	W0229 10:42:26.556232    7031 network_create.go:116] failed to create docker network multinode-636000 192.168.67.0/24, will retry: subnet is taken

	I0229 10:42:26.557664    7031 network.go:210] skipping subnet 192.168.67.0/24 that is reserved: &{IP:192.168.67.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.67.0/24 Gateway:192.168.67.1 ClientMin:192.168.67.2 ClientMax:192.168.67.254 Broadcast:192.168.67.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:<nil>}

	I0229 10:42:26.558055    7031 network.go:207] using free private subnet 192.168.76.0/24: &{IP:192.168.76.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.76.0/24 Gateway:192.168.76.1 ClientMin:192.168.76.2 ClientMax:192.168.76.254 Broadcast:192.168.76.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc000802de0}

	I0229 10:42:26.558068    7031 network_create.go:124] attempt to create docker network multinode-636000 192.168.76.0/24 with gateway 192.168.76.1 and MTU of 65535 ...

	I0229 10:42:26.558131    7031 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.76.0/24 --gateway=192.168.76.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=65535 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=multinode-636000 multinode-636000

	I0229 10:42:26.659387    7031 network_create.go:108] docker network multinode-636000 192.168.76.0/24 created

	I0229 10:42:26.659419    7031 kic.go:121] calculated static IP "192.168.76.2" for the "multinode-636000" container

	I0229 10:42:26.659533    7031 cli_runner.go:164] Run: docker ps -a --format {{.Names}}

	I0229 10:42:26.709287    7031 cli_runner.go:164] Run: docker volume create multinode-636000 --label name.minikube.sigs.k8s.io=multinode-636000 --label created_by.minikube.sigs.k8s.io=true

	I0229 10:42:26.758340    7031 oci.go:103] Successfully created a docker volume multinode-636000

	I0229 10:42:26.758468    7031 cli_runner.go:164] Run: docker run --rm --name multinode-636000-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=multinode-636000 --entrypoint /usr/bin/test -v multinode-636000:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 -d /var/lib

	I0229 10:42:27.062376    7031 oci.go:107] Successfully prepared a docker volume multinode-636000

	I0229 10:42:27.062406    7031 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker

	I0229 10:42:27.062418    7031 kic.go:194] Starting extracting preloaded images to volume ...

	I0229 10:42:27.062520    7031 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v /Users/jenkins/minikube-integration/18259-932/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4:/preloaded.tar:ro -v multinode-636000:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 -I lz4 -xf /preloaded.tar -C /extractDir

	I0229 10:48:26.367422    7031 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0229 10:48:26.367564    7031 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000

	W0229 10:48:26.418720    7031 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000 returned with exit code 1

	I0229 10:48:26.418833    7031 retry.go:31] will retry after 190.058322ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "multinode-636000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	I0229 10:48:26.609635    7031 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000

	W0229 10:48:26.682930    7031 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000 returned with exit code 1

	I0229 10:48:26.683046    7031 retry.go:31] will retry after 299.297406ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "multinode-636000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	I0229 10:48:26.982910    7031 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000

	W0229 10:48:27.037067    7031 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000 returned with exit code 1

	I0229 10:48:27.037184    7031 retry.go:31] will retry after 436.163189ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "multinode-636000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	I0229 10:48:27.474155    7031 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000

	W0229 10:48:27.525152    7031 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000 returned with exit code 1

	I0229 10:48:27.525257    7031 retry.go:31] will retry after 764.507112ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "multinode-636000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	I0229 10:48:28.291552    7031 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000

	W0229 10:48:28.342040    7031 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000 returned with exit code 1

	W0229 10:48:28.342141    7031 start.go:275] error running df -h /var: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "multinode-636000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	W0229 10:48:28.342163    7031 start.go:242] error getting percentage of /var that is free: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "multinode-636000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	I0229 10:48:28.342231    7031 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"

	I0229 10:48:28.342291    7031 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000

	W0229 10:48:28.391463    7031 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000 returned with exit code 1

	I0229 10:48:28.391566    7031 retry.go:31] will retry after 151.689628ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "multinode-636000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	I0229 10:48:28.543557    7031 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000

	W0229 10:48:28.596997    7031 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000 returned with exit code 1

	I0229 10:48:28.597092    7031 retry.go:31] will retry after 531.238797ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "multinode-636000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	I0229 10:48:29.130779    7031 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000

	W0229 10:48:29.181585    7031 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000 returned with exit code 1

	I0229 10:48:29.181695    7031 retry.go:31] will retry after 745.626521ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "multinode-636000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	I0229 10:48:29.929676    7031 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000

	W0229 10:48:29.984195    7031 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000 returned with exit code 1

	W0229 10:48:29.984301    7031 start.go:290] error running df -BG /var: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "multinode-636000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	W0229 10:48:29.984318    7031 start.go:247] error getting GiB of /var that is available: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "multinode-636000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	I0229 10:48:29.984338    7031 start.go:128] duration metric: createHost completed in 6m3.640775732s

	I0229 10:48:29.984403    7031 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0229 10:48:29.984457    7031 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000

	W0229 10:48:30.033444    7031 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000 returned with exit code 1

	I0229 10:48:30.033538    7031 retry.go:31] will retry after 200.782424ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "multinode-636000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	I0229 10:48:30.235525    7031 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000

	W0229 10:48:30.286698    7031 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000 returned with exit code 1

	I0229 10:48:30.286789    7031 retry.go:31] will retry after 200.181981ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "multinode-636000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	I0229 10:48:30.487427    7031 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000

	W0229 10:48:30.538147    7031 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000 returned with exit code 1

	I0229 10:48:30.538242    7031 retry.go:31] will retry after 753.524591ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "multinode-636000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	I0229 10:48:31.292783    7031 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000

	W0229 10:48:31.343722    7031 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000 returned with exit code 1

	I0229 10:48:31.343828    7031 retry.go:31] will retry after 635.917891ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "multinode-636000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	I0229 10:48:31.982198    7031 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000

	W0229 10:48:32.032985    7031 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000 returned with exit code 1

	W0229 10:48:32.033084    7031 start.go:275] error running df -h /var: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "multinode-636000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	W0229 10:48:32.033099    7031 start.go:242] error getting percentage of /var that is free: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "multinode-636000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	I0229 10:48:32.033159    7031 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"

	I0229 10:48:32.033222    7031 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000

	W0229 10:48:32.082232    7031 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000 returned with exit code 1

	I0229 10:48:32.082321    7031 retry.go:31] will retry after 210.99342ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "multinode-636000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	I0229 10:48:32.294417    7031 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000

	W0229 10:48:32.344425    7031 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000 returned with exit code 1

	I0229 10:48:32.344527    7031 retry.go:31] will retry after 357.518416ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "multinode-636000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	I0229 10:48:32.703217    7031 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000

	W0229 10:48:32.757427    7031 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000 returned with exit code 1

	I0229 10:48:32.757522    7031 retry.go:31] will retry after 491.536941ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "multinode-636000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	I0229 10:48:33.251435    7031 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000

	W0229 10:48:33.303396    7031 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000 returned with exit code 1

	W0229 10:48:33.303503    7031 start.go:290] error running df -BG /var: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "multinode-636000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	W0229 10:48:33.303521    7031 start.go:247] error getting GiB of /var that is available: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "multinode-636000": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-636000: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	I0229 10:48:33.303531    7031 fix.go:56] fixHost completed within 6m28.707667991s

	I0229 10:48:33.303537    7031 start.go:83] releasing machines lock for "multinode-636000", held for 6m28.707712768s

	W0229 10:48:33.303616    7031 out.go:239] * Failed to start docker container. Running "minikube delete -p multinode-636000" may fix it: recreate: creating host: create host timed out in 360.000000 seconds

	* Failed to start docker container. Running "minikube delete -p multinode-636000" may fix it: recreate: creating host: create host timed out in 360.000000 seconds

	I0229 10:48:33.347425    7031 out.go:177] 

	W0229 10:48:33.369314    7031 out.go:239] X Exiting due to DRV_CREATE_TIMEOUT: Failed to start host: recreate: creating host: create host timed out in 360.000000 seconds

	X Exiting due to DRV_CREATE_TIMEOUT: Failed to start host: recreate: creating host: create host timed out in 360.000000 seconds

	W0229 10:48:33.369343    7031 out.go:239] * Suggestion: Try 'minikube delete', and disable any conflicting VPN or firewall software

	* Suggestion: Try 'minikube delete', and disable any conflicting VPN or firewall software

	W0229 10:48:33.369360    7031 out.go:239] * Related issue: https://github.com/kubernetes/minikube/issues/7072

	* Related issue: https://github.com/kubernetes/minikube/issues/7072

	I0229 10:48:33.391302    7031 out.go:177] 

** /stderr **

multinode_test.go:325: failed to run minikube start. args "out/minikube-darwin-amd64 node list -p multinode-636000" : exit status 52

multinode_test.go:328: (dbg) Run:  out/minikube-darwin-amd64 node list -p multinode-636000

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:230: ======>  post-mortem[TestMultiNode/serial/RestartKeepsNodes]: docker inspect <======

helpers_test.go:231: (dbg) Run:  docker inspect multinode-636000

helpers_test.go:235: (dbg) docker inspect multinode-636000:

-- stdout --

	[

	    {

	        "Name": "multinode-636000",

	        "Id": "e3c9265bd7780859b87f657507d5d92acea890ea72dc5bc3891264bd0952965c",

	        "Created": "2024-02-29T18:42:26.604786783Z",

	        "Scope": "local",

	        "Driver": "bridge",

	        "EnableIPv6": false,

	        "IPAM": {

	            "Driver": "default",

	            "Options": {},

	            "Config": [

	                {

	                    "Subnet": "192.168.76.0/24",

	                    "Gateway": "192.168.76.1"

	                }

	            ]

	        },

	        "Internal": false,

	        "Attachable": false,

	        "Ingress": false,

	        "ConfigFrom": {

	            "Network": ""

	        },

	        "ConfigOnly": false,

	        "Containers": {},

	        "Options": {

	            "--icc": "",

	            "--ip-masq": "",

	            "com.docker.network.driver.mtu": "65535"

	        },

	        "Labels": {

	            "created_by.minikube.sigs.k8s.io": "true",

	            "name.minikube.sigs.k8s.io": "multinode-636000"

	        }

	    }

	]

-- /stdout --

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-636000 -n multinode-636000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-636000 -n multinode-636000: exit status 7 (116.933252ms)

-- stdout --

	Nonexistent

-- /stdout --

** stderr ** 

	E0229 10:48:33.711304    7472 status.go:249] status error: host: state: unknown state "multinode-636000": docker container inspect multinode-636000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

** /stderr **

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "multinode-636000" host is not running, skipping log retrieval (state="Nonexistent")

--- FAIL: TestMultiNode/serial/RestartKeepsNodes (794.84s)

=== RUN   TestMultiNode/serial/DeleteNode

multinode_test.go:422: (dbg) Run:  out/minikube-darwin-amd64 -p multinode-636000 node delete m03

multinode_test.go:422: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p multinode-636000 node delete m03: exit status 80 (204.188147ms)

-- stdout --

-- /stdout --

** stderr ** 

	X Exiting due to GUEST_STATUS: Unable to get machine status: state: unknown state "multinode-636000": docker container inspect multinode-636000 --format=<no value>: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	* 

	╭─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                                                         │

	│    * If the above advice does not help, please let us know:                                                             │

	│      https://github.com/kubernetes/minikube/issues/new/choose                                                           │

	│                                                                                                                         │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                │

	│    * Please also attach the following file to the GitHub issue:                                                         │

	│    * - /var/folders/52/zh_qmlrn1f36yr6lgs7nxtym0000gp/T/minikube_node_494011a6b05fec7d81170870a2aee2ef446d16a4_0.log    │

	│                                                                                                                         │

	╰─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯

** /stderr **

multinode_test.go:424: node stop returned an error. args "out/minikube-darwin-amd64 -p multinode-636000 node delete m03": exit status 80

multinode_test.go:428: (dbg) Run:  out/minikube-darwin-amd64 -p multinode-636000 status --alsologtostderr

multinode_test.go:428: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p multinode-636000 status --alsologtostderr: exit status 7 (114.681834ms)

-- stdout --

	multinode-636000

	type: Control Plane

	host: Nonexistent

	kubelet: Nonexistent

	apiserver: Nonexistent

	kubeconfig: Nonexistent

-- /stdout --

** stderr ** 

	I0229 10:48:33.978543    7480 out.go:291] Setting OutFile to fd 1 ...

	I0229 10:48:33.978834    7480 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0229 10:48:33.978839    7480 out.go:304] Setting ErrFile to fd 2...

	I0229 10:48:33.978842    7480 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0229 10:48:33.979023    7480 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18259-932/.minikube/bin

	I0229 10:48:33.979750    7480 out.go:298] Setting JSON to false

	I0229 10:48:33.979778    7480 mustload.go:65] Loading cluster: multinode-636000

	I0229 10:48:33.979925    7480 notify.go:220] Checking for updates...

	I0229 10:48:33.980468    7480 config.go:182] Loaded profile config "multinode-636000": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.28.4

	I0229 10:48:33.980494    7480 status.go:255] checking status of multinode-636000 ...

	I0229 10:48:33.980880    7480 cli_runner.go:164] Run: docker container inspect multinode-636000 --format={{.State.Status}}

	W0229 10:48:34.030579    7480 cli_runner.go:211] docker container inspect multinode-636000 --format={{.State.Status}} returned with exit code 1

	I0229 10:48:34.030653    7480 status.go:330] multinode-636000 host status = "" (err=state: unknown state "multinode-636000": docker container inspect multinode-636000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	)

	I0229 10:48:34.030673    7480 status.go:257] multinode-636000 status: &{Name:multinode-636000 Host:Nonexistent Kubelet:Nonexistent APIServer:Nonexistent Kubeconfig:Nonexistent Worker:false TimeToStop: DockerEnv: PodManEnv:}

	E0229 10:48:34.030695    7480 status.go:260] status error: host: state: unknown state "multinode-636000": docker container inspect multinode-636000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	E0229 10:48:34.030705    7480 status.go:263] The "multinode-636000" host does not exist!

** /stderr **

multinode_test.go:430: failed to run minikube status. args "out/minikube-darwin-amd64 -p multinode-636000 status --alsologtostderr" : exit status 7

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:230: ======>  post-mortem[TestMultiNode/serial/DeleteNode]: docker inspect <======

helpers_test.go:231: (dbg) Run:  docker inspect multinode-636000

helpers_test.go:235: (dbg) docker inspect multinode-636000:

-- stdout --

	[

	    {

	        "Name": "multinode-636000",

	        "Id": "e3c9265bd7780859b87f657507d5d92acea890ea72dc5bc3891264bd0952965c",

	        "Created": "2024-02-29T18:42:26.604786783Z",

	        "Scope": "local",

	        "Driver": "bridge",

	        "EnableIPv6": false,

	        "IPAM": {

	            "Driver": "default",

	            "Options": {},

	            "Config": [

	                {

	                    "Subnet": "192.168.76.0/24",

	                    "Gateway": "192.168.76.1"

	                }

	            ]

	        },

	        "Internal": false,

	        "Attachable": false,

	        "Ingress": false,

	        "ConfigFrom": {

	            "Network": ""

	        },

	        "ConfigOnly": false,

	        "Containers": {},

	        "Options": {

	            "--icc": "",

	            "--ip-masq": "",

	            "com.docker.network.driver.mtu": "65535"

	        },

	        "Labels": {

	            "created_by.minikube.sigs.k8s.io": "true",

	            "name.minikube.sigs.k8s.io": "multinode-636000"

	        }

	    }

	]

-- /stdout --

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-636000 -n multinode-636000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-636000 -n multinode-636000: exit status 7 (113.385931ms)

-- stdout --

	Nonexistent

-- /stdout --

** stderr ** 

	E0229 10:48:34.197080    7486 status.go:249] status error: host: state: unknown state "multinode-636000": docker container inspect multinode-636000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

** /stderr **

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "multinode-636000" host is not running, skipping log retrieval (state="Nonexistent")

--- FAIL: TestMultiNode/serial/DeleteNode (0.49s)

=== RUN   TestMultiNode/serial/StopMultiNode

multinode_test.go:342: (dbg) Run:  out/minikube-darwin-amd64 -p multinode-636000 stop

multinode_test.go:342: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p multinode-636000 stop: exit status 82 (16.406156499s)

-- stdout --

	* Stopping node "multinode-636000"  ...

	* Stopping node "multinode-636000"  ...

	* Stopping node "multinode-636000"  ...

	* Stopping node "multinode-636000"  ...

	* Stopping node "multinode-636000"  ...

	* Stopping node "multinode-636000"  ...

-- /stdout --

** stderr ** 

	X Exiting due to GUEST_STOP_TIMEOUT: Unable to stop VM: docker container inspect multinode-636000 --format=<no value>: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	* 

	╭─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                                                         │

	│    * If the above advice does not help, please let us know:                                                             │

	│      https://github.com/kubernetes/minikube/issues/new/choose                                                           │

	│                                                                                                                         │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                │

	│    * Please also attach the following file to the GitHub issue:                                                         │

	│    * - /var/folders/52/zh_qmlrn1f36yr6lgs7nxtym0000gp/T/minikube_stop_24ef9d461bcadf056806ccb9bba8d5f9f54754a6_0.log    │

	│                                                                                                                         │

	╰─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯

** /stderr **

multinode_test.go:344: node stop returned an error. args "out/minikube-darwin-amd64 -p multinode-636000 stop": exit status 82

multinode_test.go:348: (dbg) Run:  out/minikube-darwin-amd64 -p multinode-636000 status

multinode_test.go:348: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p multinode-636000 status: exit status 7 (113.998163ms)

-- stdout --

	multinode-636000

	type: Control Plane

	host: Nonexistent

	kubelet: Nonexistent

	apiserver: Nonexistent

	kubeconfig: Nonexistent

-- /stdout --

** stderr ** 

	E0229 10:48:50.717673    7517 status.go:260] status error: host: state: unknown state "multinode-636000": docker container inspect multinode-636000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	E0229 10:48:50.717685    7517 status.go:263] The "multinode-636000" host does not exist!

** /stderr **

multinode_test.go:355: (dbg) Run:  out/minikube-darwin-amd64 -p multinode-636000 status --alsologtostderr

multinode_test.go:355: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p multinode-636000 status --alsologtostderr: exit status 7 (113.631289ms)

-- stdout --

	multinode-636000

	type: Control Plane

	host: Nonexistent

	kubelet: Nonexistent

	apiserver: Nonexistent

	kubeconfig: Nonexistent

-- /stdout --

** stderr ** 

	I0229 10:48:50.780437    7521 out.go:291] Setting OutFile to fd 1 ...

	I0229 10:48:50.780642    7521 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0229 10:48:50.780648    7521 out.go:304] Setting ErrFile to fd 2...

	I0229 10:48:50.780652    7521 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0229 10:48:50.780837    7521 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18259-932/.minikube/bin

	I0229 10:48:50.781034    7521 out.go:298] Setting JSON to false

	I0229 10:48:50.781056    7521 mustload.go:65] Loading cluster: multinode-636000

	I0229 10:48:50.781098    7521 notify.go:220] Checking for updates...

	I0229 10:48:50.781331    7521 config.go:182] Loaded profile config "multinode-636000": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.28.4

	I0229 10:48:50.781349    7521 status.go:255] checking status of multinode-636000 ...

	I0229 10:48:50.781733    7521 cli_runner.go:164] Run: docker container inspect multinode-636000 --format={{.State.Status}}

	W0229 10:48:50.831225    7521 cli_runner.go:211] docker container inspect multinode-636000 --format={{.State.Status}} returned with exit code 1

	I0229 10:48:50.831322    7521 status.go:330] multinode-636000 host status = "" (err=state: unknown state "multinode-636000": docker container inspect multinode-636000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	)

	I0229 10:48:50.831345    7521 status.go:257] multinode-636000 status: &{Name:multinode-636000 Host:Nonexistent Kubelet:Nonexistent APIServer:Nonexistent Kubeconfig:Nonexistent Worker:false TimeToStop: DockerEnv: PodManEnv:}

	E0229 10:48:50.831369    7521 status.go:260] status error: host: state: unknown state "multinode-636000": docker container inspect multinode-636000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	E0229 10:48:50.831377    7521 status.go:263] The "multinode-636000" host does not exist!

** /stderr **

multinode_test.go:361: incorrect number of stopped hosts: args "out/minikube-darwin-amd64 -p multinode-636000 status --alsologtostderr": multinode-636000

type: Control Plane

host: Nonexistent

kubelet: Nonexistent

apiserver: Nonexistent

kubeconfig: Nonexistent

multinode_test.go:365: incorrect number of stopped kubelets: args "out/minikube-darwin-amd64 -p multinode-636000 status --alsologtostderr": multinode-636000

type: Control Plane

host: Nonexistent

kubelet: Nonexistent

apiserver: Nonexistent

kubeconfig: Nonexistent

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:230: ======>  post-mortem[TestMultiNode/serial/StopMultiNode]: docker inspect <======

helpers_test.go:231: (dbg) Run:  docker inspect multinode-636000

helpers_test.go:235: (dbg) docker inspect multinode-636000:

-- stdout --

	[

	    {

	        "Name": "multinode-636000",

	        "Id": "e3c9265bd7780859b87f657507d5d92acea890ea72dc5bc3891264bd0952965c",

	        "Created": "2024-02-29T18:42:26.604786783Z",

	        "Scope": "local",

	        "Driver": "bridge",

	        "EnableIPv6": false,

	        "IPAM": {

	            "Driver": "default",

	            "Options": {},

	            "Config": [

	                {

	                    "Subnet": "192.168.76.0/24",

	                    "Gateway": "192.168.76.1"

	                }

	            ]

	        },

	        "Internal": false,

	        "Attachable": false,

	        "Ingress": false,

	        "ConfigFrom": {

	            "Network": ""

	        },

	        "ConfigOnly": false,

	        "Containers": {},

	        "Options": {

	            "--icc": "",

	            "--ip-masq": "",

	            "com.docker.network.driver.mtu": "65535"

	        },

	        "Labels": {

	            "created_by.minikube.sigs.k8s.io": "true",

	            "name.minikube.sigs.k8s.io": "multinode-636000"

	        }

	    }

	]

-- /stdout --

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-636000 -n multinode-636000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-636000 -n multinode-636000: exit status 7 (113.147401ms)

-- stdout --

	Nonexistent

-- /stdout --

** stderr ** 

	E0229 10:48:50.997903    7527 status.go:249] status error: host: state: unknown state "multinode-636000": docker container inspect multinode-636000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

** /stderr **

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "multinode-636000" host is not running, skipping log retrieval (state="Nonexistent")

--- FAIL: TestMultiNode/serial/StopMultiNode (16.80s)

=== RUN   TestMultiNode/serial/RestartMultiNode

multinode_test.go:372: (dbg) Run:  docker version -f {{.Server.Version}}

multinode_test.go:382: (dbg) Run:  out/minikube-darwin-amd64 start -p multinode-636000 --wait=true -v=8 --alsologtostderr --driver=docker 

E0229 10:49:19.062042    1408 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/18259-932/.minikube/profiles/addons-551000/client.crt: no such file or directory

E0229 10:49:50.682824    1408 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/18259-932/.minikube/profiles/functional-081000/client.crt: no such file or directory

multinode_test.go:382: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p multinode-636000 --wait=true -v=8 --alsologtostderr --driver=docker : signal: killed (2m11.258735424s)

-- stdout --

	* [multinode-636000] minikube v1.32.0 on Darwin 14.3.1

	  - MINIKUBE_LOCATION=18259

	  - KUBECONFIG=/Users/jenkins/minikube-integration/18259-932/kubeconfig

	  - MINIKUBE_BIN=out/minikube-darwin-amd64

	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18259-932/.minikube

	  - MINIKUBE_FORCE_SYSTEMD=

	* Using the docker driver based on existing profile

	* Starting control plane node multinode-636000 in cluster multinode-636000

	* Pulling base image v0.0.42-1708944392-18244 ...

	* docker "multinode-636000" container is missing, will recreate.

	* Creating docker container (CPUs=2, Memory=2200MB) ...

-- /stdout --

** stderr ** 

	I0229 10:48:51.115543    7533 out.go:291] Setting OutFile to fd 1 ...

	I0229 10:48:51.115802    7533 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0229 10:48:51.115807    7533 out.go:304] Setting ErrFile to fd 2...

	I0229 10:48:51.115811    7533 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0229 10:48:51.115994    7533 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18259-932/.minikube/bin

	I0229 10:48:51.117391    7533 out.go:298] Setting JSON to false

	I0229 10:48:51.140531    7533 start.go:129] hostinfo: {"hostname":"MacOS-Agent-1.local","uptime":4701,"bootTime":1709227830,"procs":491,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"b7610dcb-1435-5842-8d5a-b2388403fea3"}

	W0229 10:48:51.140632    7533 start.go:137] gopshost.Virtualization returned error: not implemented yet

	I0229 10:48:51.162870    7533 out.go:177] * [multinode-636000] minikube v1.32.0 on Darwin 14.3.1

	I0229 10:48:51.204509    7533 out.go:177]   - MINIKUBE_LOCATION=18259

	I0229 10:48:51.204576    7533 notify.go:220] Checking for updates...

	I0229 10:48:51.248536    7533 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/18259-932/kubeconfig

	I0229 10:48:51.269653    7533 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64

	I0229 10:48:51.311505    7533 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I0229 10:48:51.332595    7533 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18259-932/.minikube

	I0229 10:48:51.353592    7533 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=

	I0229 10:48:51.375217    7533 config.go:182] Loaded profile config "multinode-636000": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.28.4

	I0229 10:48:51.375929    7533 driver.go:392] Setting default libvirt URI to qemu:///system

	I0229 10:48:51.431327    7533 docker.go:122] docker version: linux-25.0.3:Docker Desktop 4.27.2 (137060)

	I0229 10:48:51.431484    7533 cli_runner.go:164] Run: docker system info --format "{{json .}}"

	I0229 10:48:51.531925    7533 info.go:266] docker info: {ID:37b3081a-8cd6-457e-b2a4-79dc82345b06 Containers:5 ContainersRunning:1 ContainersPaused:0 ContainersStopped:4 Images:2 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:84 OomKillDisable:false NGoroutines:155 SystemTime:2024-02-29 18:48:51.521120302 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:26 KernelVersion:6.6.12-linuxkit OperatingSystem:Docker Desktop OSType:linux Architecture:x86_64 IndexServerAddress:

https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:12 MemTotal:6213292032 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy:http.docker.internal:3128 HTTPSProxy:http.docker.internal:3128 NoProxy:hubproxy.docker.internal Name:docker-desktop Labels:[] ExperimentalBuild:false ServerVersion:25.0.3 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:ae07eda36dd25f8a1b98dfbf587313b99c0190bb Expected:ae07eda36dd25f8a1b98dfbf587313b99c0190bb} RuncCommit:{ID:v1.1.12-0-g51d5e94 Expected:v1.1.12-0-g51d5e94} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=seccomp,profile=unconfined name

=cgroupns] ProductLicense: Warnings:[WARNING: daemon is not using the default seccomp profile] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/Users/jenkins/.docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-buildx] ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.12.1-desktop.4] map[Name:compose Path:/Users/jenkins/.docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-compose] ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.24.5-desktop.1] map[Name:debug Path:/Users/jenkins/.docker/cli-plugins/docker-debug SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-debug] ShortDescription:Get a shell into any image or container. Vendor:Docker Inc. Version:0.0.24] map[Name:dev Path:/Users/jenkins/.docker/cli-plugins/docker-dev SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-dev] ShortDescription:Docker D

ev Environments Vendor:Docker Inc. Version:v0.1.0] map[Name:extension Path:/Users/jenkins/.docker/cli-plugins/docker-extension SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-extension] ShortDescription:Manages Docker extensions Vendor:Docker Inc. Version:v0.2.21] map[Name:feedback Path:/Users/jenkins/.docker/cli-plugins/docker-feedback SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-feedback] ShortDescription:Provide feedback, right in your terminal! Vendor:Docker Inc. Version:v1.0.4] map[Name:init Path:/Users/jenkins/.docker/cli-plugins/docker-init SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-init] ShortDescription:Creates Docker-related starter files for your project Vendor:Docker Inc. Version:v1.0.0] map[Name:sbom Path:/Users/jenkins/.docker/cli-plugins/docker-sbom SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-sbom] ShortDescription:View the packaged-based Software Bill Of Materials (SBOM)

for an image URL:https://github.com/docker/sbom-cli-plugin Vendor:Anchore Inc. Version:0.6.0] map[Err:failed to fetch metadata: fork/exec /Users/jenkins/.docker/cli-plugins/docker-scan: no such file or directory Name:scan Path:/Users/jenkins/.docker/cli-plugins/docker-scan] map[Name:scout Path:/Users/jenkins/.docker/cli-plugins/docker-scout SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-scout] ShortDescription:Docker Scout Vendor:Docker Inc. Version:v1.4.1]] Warnings:<nil>}}

	I0229 10:48:51.574382    7533 out.go:177] * Using the docker driver based on existing profile

	I0229 10:48:51.595558    7533 start.go:299] selected driver: docker

	I0229 10:48:51.595577    7533 start.go:903] validating driver "docker" against &{Name:multinode-636000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:multinode-636000 Namespace:default APIServerName:minikube

CA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false Disabl

eMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I0229 10:48:51.595665    7533 start.go:914] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}

	I0229 10:48:51.595841    7533 cli_runner.go:164] Run: docker system info --format "{{json .}}"

	I0229 10:48:51.696463    7533 info.go:266] docker info: {ID:37b3081a-8cd6-457e-b2a4-79dc82345b06 Containers:5 ContainersRunning:1 ContainersPaused:0 ContainersStopped:4 Images:2 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:84 OomKillDisable:false NGoroutines:155 SystemTime:2024-02-29 18:48:51.686740148 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:26 KernelVersion:6.6.12-linuxkit OperatingSystem:Docker Desktop OSType:linux Architecture:x86_64 IndexServerAddress:

https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:12 MemTotal:6213292032 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy:http.docker.internal:3128 HTTPSProxy:http.docker.internal:3128 NoProxy:hubproxy.docker.internal Name:docker-desktop Labels:[] ExperimentalBuild:false ServerVersion:25.0.3 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:ae07eda36dd25f8a1b98dfbf587313b99c0190bb Expected:ae07eda36dd25f8a1b98dfbf587313b99c0190bb} RuncCommit:{ID:v1.1.12-0-g51d5e94 Expected:v1.1.12-0-g51d5e94} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=seccomp,profile=unconfined name

=cgroupns] ProductLicense: Warnings:[WARNING: daemon is not using the default seccomp profile] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/Users/jenkins/.docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-buildx] ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.12.1-desktop.4] map[Name:compose Path:/Users/jenkins/.docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-compose] ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.24.5-desktop.1] map[Name:debug Path:/Users/jenkins/.docker/cli-plugins/docker-debug SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-debug] ShortDescription:Get a shell into any image or container. Vendor:Docker Inc. Version:0.0.24] map[Name:dev Path:/Users/jenkins/.docker/cli-plugins/docker-dev SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-dev] ShortDescription:Docker D

ev Environments Vendor:Docker Inc. Version:v0.1.0] map[Name:extension Path:/Users/jenkins/.docker/cli-plugins/docker-extension SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-extension] ShortDescription:Manages Docker extensions Vendor:Docker Inc. Version:v0.2.21] map[Name:feedback Path:/Users/jenkins/.docker/cli-plugins/docker-feedback SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-feedback] ShortDescription:Provide feedback, right in your terminal! Vendor:Docker Inc. Version:v1.0.4] map[Name:init Path:/Users/jenkins/.docker/cli-plugins/docker-init SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-init] ShortDescription:Creates Docker-related starter files for your project Vendor:Docker Inc. Version:v1.0.0] map[Name:sbom Path:/Users/jenkins/.docker/cli-plugins/docker-sbom SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-sbom] ShortDescription:View the packaged-based Software Bill Of Materials (SBOM)

for an image URL:https://github.com/docker/sbom-cli-plugin Vendor:Anchore Inc. Version:0.6.0] map[Err:failed to fetch metadata: fork/exec /Users/jenkins/.docker/cli-plugins/docker-scan: no such file or directory Name:scan Path:/Users/jenkins/.docker/cli-plugins/docker-scan] map[Name:scout Path:/Users/jenkins/.docker/cli-plugins/docker-scout SchemaVersion:0.1.0 ShadowedPaths:[/usr/local/lib/docker/cli-plugins/docker-scout] ShortDescription:Docker Scout Vendor:Docker Inc. Version:v1.4.1]] Warnings:<nil>}}

	I0229 10:48:51.699720    7533 start_flags.go:931] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]

	I0229 10:48:51.699785    7533 cni.go:84] Creating CNI manager for ""

	I0229 10:48:51.699794    7533 cni.go:136] 1 nodes found, recommending kindnet

	I0229 10:48:51.699808    7533 start_flags.go:323] config:

	{Name:multinode-636000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:multinode-636000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:do

cker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: S

taticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I0229 10:48:51.743432    7533 out.go:177] * Starting control plane node multinode-636000 in cluster multinode-636000

	I0229 10:48:51.764514    7533 cache.go:121] Beginning downloading kic base image for docker with docker

	I0229 10:48:51.786377    7533 out.go:177] * Pulling base image v0.0.42-1708944392-18244 ...

	I0229 10:48:51.828447    7533 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker

	I0229 10:48:51.828528    7533 preload.go:148] Found local preload: /Users/jenkins/minikube-integration/18259-932/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4

	I0229 10:48:51.828549    7533 cache.go:56] Caching tarball of preloaded images

	I0229 10:48:51.828553    7533 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 in local docker daemon

	I0229 10:48:51.828778    7533 preload.go:174] Found /Users/jenkins/minikube-integration/18259-932/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4 in cache, skipping download

	I0229 10:48:51.828812    7533 cache.go:59] Finished verifying existence of preloaded tar for  v1.28.4 on docker

	I0229 10:48:51.829613    7533 profile.go:148] Saving config to /Users/jenkins/minikube-integration/18259-932/.minikube/profiles/multinode-636000/config.json ...

	I0229 10:48:51.879253    7533 image.go:83] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 in local docker daemon, skipping pull

	I0229 10:48:51.879268    7533 cache.go:144] gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 exists in daemon, skipping load

	I0229 10:48:51.879294    7533 cache.go:194] Successfully downloaded all kic artifacts

	I0229 10:48:51.879334    7533 start.go:365] acquiring machines lock for multinode-636000: {Name:mk724cab9aafa05d3a600dc983677a58b42dc1e0 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0229 10:48:51.879416    7533 start.go:369] acquired machines lock for "multinode-636000" in 62.861µs

	I0229 10:48:51.879444    7533 start.go:96] Skipping create...Using existing machine configuration

	I0229 10:48:51.879454    7533 fix.go:54] fixHost starting: 

	I0229 10:48:51.879674    7533 cli_runner.go:164] Run: docker container inspect multinode-636000 --format={{.State.Status}}

	W0229 10:48:51.928875    7533 cli_runner.go:211] docker container inspect multinode-636000 --format={{.State.Status}} returned with exit code 1

	I0229 10:48:51.928947    7533 fix.go:102] recreateIfNeeded on multinode-636000: state= err=unknown state "multinode-636000": docker container inspect multinode-636000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	I0229 10:48:51.928968    7533 fix.go:107] machineExists: false. err=machine does not exist

	I0229 10:48:51.950706    7533 out.go:177] * docker "multinode-636000" container is missing, will recreate.

	I0229 10:48:51.972457    7533 delete.go:124] DEMOLISHING multinode-636000 ...

	I0229 10:48:51.972576    7533 cli_runner.go:164] Run: docker container inspect multinode-636000 --format={{.State.Status}}

	W0229 10:48:52.022234    7533 cli_runner.go:211] docker container inspect multinode-636000 --format={{.State.Status}} returned with exit code 1

	W0229 10:48:52.022278    7533 stop.go:75] unable to get state: unknown state "multinode-636000": docker container inspect multinode-636000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	I0229 10:48:52.022298    7533 delete.go:128] stophost failed (probably ok): ssh power off: unknown state "multinode-636000": docker container inspect multinode-636000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	I0229 10:48:52.022644    7533 cli_runner.go:164] Run: docker container inspect multinode-636000 --format={{.State.Status}}

	W0229 10:48:52.071789    7533 cli_runner.go:211] docker container inspect multinode-636000 --format={{.State.Status}} returned with exit code 1

	I0229 10:48:52.071838    7533 delete.go:82] Unable to get host status for multinode-636000, assuming it has already been deleted: state: unknown state "multinode-636000": docker container inspect multinode-636000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	I0229 10:48:52.071923    7533 cli_runner.go:164] Run: docker container inspect -f {{.Id}} multinode-636000

	W0229 10:48:52.120610    7533 cli_runner.go:211] docker container inspect -f {{.Id}} multinode-636000 returned with exit code 1

	I0229 10:48:52.120645    7533 kic.go:371] could not find the container multinode-636000 to remove it. will try anyways

	I0229 10:48:52.120712    7533 cli_runner.go:164] Run: docker container inspect multinode-636000 --format={{.State.Status}}

	W0229 10:48:52.169726    7533 cli_runner.go:211] docker container inspect multinode-636000 --format={{.State.Status}} returned with exit code 1

	W0229 10:48:52.169780    7533 oci.go:84] error getting container status, will try to delete anyways: unknown state "multinode-636000": docker container inspect multinode-636000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	I0229 10:48:52.169864    7533 cli_runner.go:164] Run: docker exec --privileged -t multinode-636000 /bin/bash -c "sudo init 0"

	W0229 10:48:52.218953    7533 cli_runner.go:211] docker exec --privileged -t multinode-636000 /bin/bash -c "sudo init 0" returned with exit code 1

	I0229 10:48:52.218981    7533 oci.go:650] error shutdown multinode-636000: docker exec --privileged -t multinode-636000 /bin/bash -c "sudo init 0": exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	I0229 10:48:53.219834    7533 cli_runner.go:164] Run: docker container inspect multinode-636000 --format={{.State.Status}}

	W0229 10:48:53.272521    7533 cli_runner.go:211] docker container inspect multinode-636000 --format={{.State.Status}} returned with exit code 1

	I0229 10:48:53.272569    7533 oci.go:662] temporary error verifying shutdown: unknown state "multinode-636000": docker container inspect multinode-636000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	I0229 10:48:53.272590    7533 oci.go:664] temporary error: container multinode-636000 status is  but expect it to be exited

	I0229 10:48:53.272626    7533 retry.go:31] will retry after 314.873131ms: couldn't verify container is exited. %v: unknown state "multinode-636000": docker container inspect multinode-636000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	I0229 10:48:53.587839    7533 cli_runner.go:164] Run: docker container inspect multinode-636000 --format={{.State.Status}}

	W0229 10:48:53.640285    7533 cli_runner.go:211] docker container inspect multinode-636000 --format={{.State.Status}} returned with exit code 1

	I0229 10:48:53.640329    7533 oci.go:662] temporary error verifying shutdown: unknown state "multinode-636000": docker container inspect multinode-636000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	I0229 10:48:53.640339    7533 oci.go:664] temporary error: container multinode-636000 status is  but expect it to be exited

	I0229 10:48:53.640365    7533 retry.go:31] will retry after 738.780973ms: couldn't verify container is exited. %v: unknown state "multinode-636000": docker container inspect multinode-636000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	I0229 10:48:54.380253    7533 cli_runner.go:164] Run: docker container inspect multinode-636000 --format={{.State.Status}}

	W0229 10:48:54.430830    7533 cli_runner.go:211] docker container inspect multinode-636000 --format={{.State.Status}} returned with exit code 1

	I0229 10:48:54.430872    7533 oci.go:662] temporary error verifying shutdown: unknown state "multinode-636000": docker container inspect multinode-636000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	I0229 10:48:54.430883    7533 oci.go:664] temporary error: container multinode-636000 status is  but expect it to be exited

	I0229 10:48:54.430914    7533 retry.go:31] will retry after 1.579687573s: couldn't verify container is exited. %v: unknown state "multinode-636000": docker container inspect multinode-636000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	I0229 10:48:56.010825    7533 cli_runner.go:164] Run: docker container inspect multinode-636000 --format={{.State.Status}}

	W0229 10:48:56.061374    7533 cli_runner.go:211] docker container inspect multinode-636000 --format={{.State.Status}} returned with exit code 1

	I0229 10:48:56.061422    7533 oci.go:662] temporary error verifying shutdown: unknown state "multinode-636000": docker container inspect multinode-636000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	I0229 10:48:56.061433    7533 oci.go:664] temporary error: container multinode-636000 status is  but expect it to be exited

	I0229 10:48:56.061458    7533 retry.go:31] will retry after 1.158279998s: couldn't verify container is exited. %v: unknown state "multinode-636000": docker container inspect multinode-636000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	I0229 10:48:57.220657    7533 cli_runner.go:164] Run: docker container inspect multinode-636000 --format={{.State.Status}}

	W0229 10:48:57.272966    7533 cli_runner.go:211] docker container inspect multinode-636000 --format={{.State.Status}} returned with exit code 1

	I0229 10:48:57.273009    7533 oci.go:662] temporary error verifying shutdown: unknown state "multinode-636000": docker container inspect multinode-636000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	I0229 10:48:57.273017    7533 oci.go:664] temporary error: container multinode-636000 status is  but expect it to be exited

	I0229 10:48:57.273042    7533 retry.go:31] will retry after 2.809473981s: couldn't verify container is exited. %v: unknown state "multinode-636000": docker container inspect multinode-636000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	I0229 10:49:00.084867    7533 cli_runner.go:164] Run: docker container inspect multinode-636000 --format={{.State.Status}}

	W0229 10:49:00.136996    7533 cli_runner.go:211] docker container inspect multinode-636000 --format={{.State.Status}} returned with exit code 1

	I0229 10:49:00.137044    7533 oci.go:662] temporary error verifying shutdown: unknown state "multinode-636000": docker container inspect multinode-636000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	I0229 10:49:00.137056    7533 oci.go:664] temporary error: container multinode-636000 status is  but expect it to be exited

	I0229 10:49:00.137086    7533 retry.go:31] will retry after 4.59485115s: couldn't verify container is exited. %v: unknown state "multinode-636000": docker container inspect multinode-636000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	I0229 10:49:04.732339    7533 cli_runner.go:164] Run: docker container inspect multinode-636000 --format={{.State.Status}}

	W0229 10:49:04.785957    7533 cli_runner.go:211] docker container inspect multinode-636000 --format={{.State.Status}} returned with exit code 1

	I0229 10:49:04.786010    7533 oci.go:662] temporary error verifying shutdown: unknown state "multinode-636000": docker container inspect multinode-636000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	I0229 10:49:04.786021    7533 oci.go:664] temporary error: container multinode-636000 status is  but expect it to be exited

	I0229 10:49:04.786039    7533 retry.go:31] will retry after 6.588404854s: couldn't verify container is exited. %v: unknown state "multinode-636000": docker container inspect multinode-636000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	I0229 10:49:11.375064    7533 cli_runner.go:164] Run: docker container inspect multinode-636000 --format={{.State.Status}}

	W0229 10:49:11.425955    7533 cli_runner.go:211] docker container inspect multinode-636000 --format={{.State.Status}} returned with exit code 1

	I0229 10:49:11.425998    7533 oci.go:662] temporary error verifying shutdown: unknown state "multinode-636000": docker container inspect multinode-636000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	I0229 10:49:11.426027    7533 oci.go:664] temporary error: container multinode-636000 status is  but expect it to be exited

	I0229 10:49:11.426057    7533 oci.go:88] couldn't shut down multinode-636000 (might be okay): verify shutdown: couldn't verify container is exited. %v: unknown state "multinode-636000": docker container inspect multinode-636000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

	I0229 10:49:11.426125    7533 cli_runner.go:164] Run: docker rm -f -v multinode-636000

	I0229 10:49:11.475778    7533 cli_runner.go:164] Run: docker container inspect -f {{.Id}} multinode-636000

	W0229 10:49:11.525144    7533 cli_runner.go:211] docker container inspect -f {{.Id}} multinode-636000 returned with exit code 1

	I0229 10:49:11.525244    7533 cli_runner.go:164] Run: docker network inspect multinode-636000 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"

	I0229 10:49:11.574336    7533 cli_runner.go:164] Run: docker network rm multinode-636000

	I0229 10:49:11.695033    7533 fix.go:114] Sleeping 1 second for extra luck!

	I0229 10:49:12.696110    7533 start.go:125] createHost starting for "" (driver="docker")

	I0229 10:49:12.720223    7533 out.go:204] * Creating docker container (CPUs=2, Memory=2200MB) ...

	I0229 10:49:12.720385    7533 start.go:159] libmachine.API.Create for "multinode-636000" (driver="docker")

	I0229 10:49:12.720448    7533 client.go:168] LocalClient.Create starting

	I0229 10:49:12.720634    7533 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18259-932/.minikube/certs/ca.pem

	I0229 10:49:12.720732    7533 main.go:141] libmachine: Decoding PEM data...

	I0229 10:49:12.720762    7533 main.go:141] libmachine: Parsing certificate...

	I0229 10:49:12.720867    7533 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18259-932/.minikube/certs/cert.pem

	I0229 10:49:12.720940    7533 main.go:141] libmachine: Decoding PEM data...

	I0229 10:49:12.720957    7533 main.go:141] libmachine: Parsing certificate...

	I0229 10:49:12.741693    7533 cli_runner.go:164] Run: docker network inspect multinode-636000 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"

	W0229 10:49:12.794981    7533 cli_runner.go:211] docker network inspect multinode-636000 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1

	I0229 10:49:12.795066    7533 network_create.go:281] running [docker network inspect multinode-636000] to gather additional debugging logs...

	I0229 10:49:12.795084    7533 cli_runner.go:164] Run: docker network inspect multinode-636000

	W0229 10:49:12.844676    7533 cli_runner.go:211] docker network inspect multinode-636000 returned with exit code 1

	I0229 10:49:12.844703    7533 network_create.go:284] error running [docker network inspect multinode-636000]: docker network inspect multinode-636000: exit status 1

	stdout:

	[]

	stderr:

	Error response from daemon: network multinode-636000 not found

	I0229 10:49:12.844715    7533 network_create.go:286] output of [docker network inspect multinode-636000]: -- stdout --

	[]

	-- /stdout --

	** stderr ** 

	Error response from daemon: network multinode-636000 not found

	** /stderr **

	I0229 10:49:12.844845    7533 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"

	I0229 10:49:12.895819    7533 network.go:210] skipping subnet 192.168.49.0/24 that is reserved: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:<nil>}

	I0229 10:49:12.896204    7533 network.go:207] using free private subnet 192.168.58.0/24: &{IP:192.168.58.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.58.0/24 Gateway:192.168.58.1 ClientMin:192.168.58.2 ClientMax:192.168.58.254 Broadcast:192.168.58.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc00217f9a0}

	I0229 10:49:12.896226    7533 network_create.go:124] attempt to create docker network multinode-636000 192.168.58.0/24 with gateway 192.168.58.1 and MTU of 65535 ...

	I0229 10:49:12.896294    7533 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.58.0/24 --gateway=192.168.58.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=65535 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=multinode-636000 multinode-636000

	I0229 10:49:12.982403    7533 network_create.go:108] docker network multinode-636000 192.168.58.0/24 created

	I0229 10:49:12.982437    7533 kic.go:121] calculated static IP "192.168.58.2" for the "multinode-636000" container

	I0229 10:49:12.982551    7533 cli_runner.go:164] Run: docker ps -a --format {{.Names}}

	I0229 10:49:13.033279    7533 cli_runner.go:164] Run: docker volume create multinode-636000 --label name.minikube.sigs.k8s.io=multinode-636000 --label created_by.minikube.sigs.k8s.io=true

	I0229 10:49:13.082990    7533 oci.go:103] Successfully created a docker volume multinode-636000

	I0229 10:49:13.083107    7533 cli_runner.go:164] Run: docker run --rm --name multinode-636000-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=multinode-636000 --entrypoint /usr/bin/test -v multinode-636000:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 -d /var/lib

	I0229 10:49:13.383777    7533 oci.go:107] Successfully prepared a docker volume multinode-636000

	I0229 10:49:13.383818    7533 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker

	I0229 10:49:13.383830    7533 kic.go:194] Starting extracting preloaded images to volume ...

	I0229 10:49:13.383921    7533 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v /Users/jenkins/minikube-integration/18259-932/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4:/preloaded.tar:ro -v multinode-636000:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 -I lz4 -xf /preloaded.tar -C /extractDir

** /stderr **

multinode_test.go:384: failed to start cluster. args "out/minikube-darwin-amd64 start -p multinode-636000 --wait=true -v=8 --alsologtostderr --driver=docker " : signal: killed

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:230: ======>  post-mortem[TestMultiNode/serial/RestartMultiNode]: docker inspect <======

helpers_test.go:231: (dbg) Run:  docker inspect multinode-636000

helpers_test.go:235: (dbg) docker inspect multinode-636000:

-- stdout --

	[

	    {

	        "Name": "multinode-636000",

	        "Id": "de2efc1ce6d5203e5951535ab9af06bfe8c5a51e38a38277ffd1be84d78ed90e",

	        "Created": "2024-02-29T18:49:12.943190955Z",

	        "Scope": "local",

	        "Driver": "bridge",

	        "EnableIPv6": false,

	        "IPAM": {

	            "Driver": "default",

	            "Options": {},

	            "Config": [

	                {

	                    "Subnet": "192.168.58.0/24",

	                    "Gateway": "192.168.58.1"

	                }

	            ]

	        },

	        "Internal": false,

	        "Attachable": false,

	        "Ingress": false,

	        "ConfigFrom": {

	            "Network": ""

	        },

	        "ConfigOnly": false,

	        "Containers": {},

	        "Options": {

	            "--icc": "",

	            "--ip-masq": "",

	            "com.docker.network.driver.mtu": "65535"

	        },

	        "Labels": {

	            "created_by.minikube.sigs.k8s.io": "true",

	            "name.minikube.sigs.k8s.io": "multinode-636000"

	        }

	    }

	]

-- /stdout --

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-636000 -n multinode-636000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-636000 -n multinode-636000: exit status 7 (113.788922ms)

-- stdout --

	Nonexistent

-- /stdout --

** stderr ** 

	E0229 10:51:02.542835    7710 status.go:249] status error: host: state: unknown state "multinode-636000": docker container inspect multinode-636000 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: multinode-636000

** /stderr **

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "multinode-636000" host is not running, skipping log retrieval (state="Nonexistent")

--- FAIL: TestMultiNode/serial/RestartMultiNode (131.55s)