=== RUN   TestErrorSpam/setup

error_spam_test.go:81: (dbg) Run:  out/minikube-windows-amd64.exe start -p nospam-783100 -n=1 --memory=3072 --wait=false --log_dir=C:\Users\jenkins.minikube4\AppData\Local\Temp\nospam-783100 --driver=docker

error_spam_test.go:81: (dbg) Done: out/minikube-windows-amd64.exe start -p nospam-783100 -n=1 --memory=3072 --wait=false --log_dir=C:\Users\jenkins.minikube4\AppData\Local\Temp\nospam-783100 --driver=docker: (50.6326063s)

error_spam_test.go:96: unexpected stderr: "! Failing to connect to https://registry.k8s.io/ from inside the minikube container"

error_spam_test.go:96: unexpected stderr: "* To pull new external images, you may need to configure a proxy: https://minikube.sigs.k8s.io/docs/reference/networking/proxy/"

error_spam_test.go:110: minikube stdout:

* [nospam-783100] minikube v1.37.0 on Microsoft Windows 10 Enterprise N 10.0.19045.6456 Build 19045.6456

- KUBECONFIG=C:\Users\jenkins.minikube4\minikube-integration\kubeconfig

- MINIKUBE_FORCE_SYSTEMD=

- MINIKUBE_HOME=C:\Users\jenkins.minikube4\minikube-integration\.minikube

- MINIKUBE_LOCATION=21139

- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

* Using the docker driver based on user configuration

* Using Docker Desktop driver with root privileges

* Starting "nospam-783100" primary control-plane node in "nospam-783100" cluster

* Pulling base image v0.0.48-1761985721-21837 ...

* Configuring bridge CNI (Container Networking Interface) ...

* Verifying Kubernetes components...

- Using image gcr.io/k8s-minikube/storage-provisioner:v5

* Enabled addons: storage-provisioner, default-storageclass

* Done! kubectl is now configured to use "nospam-783100" cluster and "default" namespace by default

error_spam_test.go:111: minikube stderr:

! Failing to connect to https://registry.k8s.io/ from inside the minikube container

* To pull new external images, you may need to configure a proxy: https://minikube.sigs.k8s.io/docs/reference/networking/proxy/

--- FAIL: TestErrorSpam/setup (50.63s)

=== RUN   TestMissingContainerUpgrade

=== PAUSE TestMissingContainerUpgrade

=== CONT  TestMissingContainerUpgrade

version_upgrade_test.go:309: (dbg) Run:  C:\Users\jenkins.minikube4\AppData\Local\Temp\minikube-v1.32.0.1212062662.exe start -p missing-upgrade-184300 --memory=3072 --driver=docker

E1109 14:28:12.170137   10336 cert_rotation.go:172] "Loading client cert failed" err="open C:\\Users\\jenkins.minikube4\\minikube-integration\\.minikube\\profiles\\functional-605600\\client.crt: The system cannot find the path specified." logger="tls-transport-cache.UnhandledError" key="key"

version_upgrade_test.go:309: (dbg) Done: C:\Users\jenkins.minikube4\AppData\Local\Temp\minikube-v1.32.0.1212062662.exe start -p missing-upgrade-184300 --memory=3072 --driver=docker: (2m14.369053s)

version_upgrade_test.go:318: (dbg) Run:  docker stop missing-upgrade-184300

version_upgrade_test.go:318: (dbg) Done: docker stop missing-upgrade-184300: (2.6316222s)

version_upgrade_test.go:323: (dbg) Run:  docker rm missing-upgrade-184300

version_upgrade_test.go:329: (dbg) Run:  out/minikube-windows-amd64.exe start -p missing-upgrade-184300 --memory=3072 --alsologtostderr -v=1 --driver=docker

version_upgrade_test.go:329: (dbg) Non-zero exit: out/minikube-windows-amd64.exe start -p missing-upgrade-184300 --memory=3072 --alsologtostderr -v=1 --driver=docker: exit status 109 (15m50.8279585s)

-- stdout --

	* [missing-upgrade-184300] minikube v1.37.0 on Microsoft Windows 10 Enterprise N 10.0.19045.6456 Build 19045.6456

	  - KUBECONFIG=C:\Users\jenkins.minikube4\minikube-integration\kubeconfig

	  - MINIKUBE_FORCE_SYSTEMD=

	  - MINIKUBE_HOME=C:\Users\jenkins.minikube4\minikube-integration\.minikube

	  - MINIKUBE_LOCATION=21139

	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	* Kubernetes 1.34.1 is now available. If you would like to upgrade, specify: --kubernetes-version=v1.34.1

	* Using the docker driver based on existing profile

	* Starting "missing-upgrade-184300" primary control-plane node in "missing-upgrade-184300" cluster

	* Pulling base image v0.0.48-1761985721-21837 ...

	* docker "missing-upgrade-184300" container is missing, will recreate.

-- /stdout --

** stderr ** 

	I1109 14:30:14.241367    1604 out.go:360] Setting OutFile to fd 1640 ...

	I1109 14:30:14.303531    1604 out.go:408] TERM=,COLORTERM=, which probably does not support color

	I1109 14:30:14.303531    1604 out.go:374] Setting ErrFile to fd 2012...

	I1109 14:30:14.304519    1604 out.go:408] TERM=,COLORTERM=, which probably does not support color

	I1109 14:30:14.319521    1604 out.go:368] Setting JSON to false

	I1109 14:30:14.323517    1604 start.go:133] hostinfo: {"hostname":"minikube4","uptime":4564,"bootTime":1762694050,"procs":197,"os":"windows","platform":"Microsoft Windows 10 Enterprise N","platformFamily":"Standalone Workstation","platformVersion":"10.0.19045.6456 Build 19045.6456","kernelVersion":"10.0.19045.6456 Build 19045.6456","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"df6bfb5f-73f2-4acb-9365-df7854ecbb28"}

	W1109 14:30:14.323517    1604 start.go:141] gopshost.Virtualization returned error: not implemented yet

	I1109 14:30:14.326520    1604 out.go:179] * [missing-upgrade-184300] minikube v1.37.0 on Microsoft Windows 10 Enterprise N 10.0.19045.6456 Build 19045.6456

	I1109 14:30:14.331510    1604 notify.go:221] Checking for updates...

	I1109 14:30:14.371970    1604 out.go:179]   - KUBECONFIG=C:\Users\jenkins.minikube4\minikube-integration\kubeconfig

	I1109 14:30:14.376610    1604 out.go:179]   - MINIKUBE_FORCE_SYSTEMD=

	I1109 14:30:14.379966    1604 out.go:179]   - MINIKUBE_HOME=C:\Users\jenkins.minikube4\minikube-integration\.minikube

	I1109 14:30:14.394211    1604 out.go:179]   - MINIKUBE_LOCATION=21139

	I1109 14:30:14.399168    1604 out.go:179]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I1109 14:30:14.402153    1604 config.go:182] Loaded profile config "missing-upgrade-184300": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.28.3

	I1109 14:30:14.404160    1604 out.go:179] * Kubernetes 1.34.1 is now available. If you would like to upgrade, specify: --kubernetes-version=v1.34.1

	I1109 14:30:14.406158    1604 driver.go:422] Setting default libvirt URI to qemu:///system

	I1109 14:30:14.559154    1604 docker.go:124] docker version: linux-27.4.0:Docker Desktop 4.37.1 (178610)

	I1109 14:30:14.568147    1604 cli_runner.go:164] Run: docker system info --format "{{json .}}"

	I1109 14:30:14.849122    1604 info.go:266] docker info: {ID:a15b78d1-f772-48f7-bbf5-f8fe086f3f87 Containers:3 ContainersRunning:3 ContainersPaused:0 ContainersStopped:0 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:94 OomKillDisable:true NGoroutines:95 SystemTime:2025-11-09 14:30:14.824948872 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:14 KernelVersion:5.15.153.1-microsoft-standard-WSL2 OperatingSystem:Docker Desktop OSType:linux Architecture:x86_64 Ind

exServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:16 MemTotal:33657536512 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy:http.docker.internal:3128 HTTPSProxy:http.docker.internal:3128 NoProxy:hubproxy.docker.internal Name:docker-desktop Labels:[com.docker.desktop.address=npipe://\\.\pipe\docker_cli] ExperimentalBuild:false ServerVersion:27.4.0 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:472731909fa34bd7bc9c087e4c27943f9835f111 Expected:472731909fa34bd7bc9c087e4c27943f9835f111} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0

Expected:de40ad0} SecurityOptions:[name=seccomp,profile=unconfined] ProductLicense: Warnings:[WARNING: No blkio throttle.read_bps_device support WARNING: No blkio throttle.write_bps_device support WARNING: No blkio throttle.read_iops_device support WARNING: No blkio throttle.write_iops_device support WARNING: daemon is not using the default seccomp profile] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:ai Path:C:\Program Files\Docker\cli-plugins\docker-ai.exe SchemaVersion:0.1.0 ShortDescription:Ask Gordon - Docker Agent Vendor:Docker Inc. Version:v0.5.1] map[Name:buildx Path:C:\Program Files\Docker\cli-plugins\docker-buildx.exe SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.19.2-desktop.1] map[Name:compose Path:C:\Program Files\Docker\cli-plugins\docker-compose.exe SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.31.0-desktop.2] map[Name:debug Path:C:\Program Files\Docker\cli-plugins\docker-debug.exe SchemaVersion:0.1.0 ShortDescr

iption:Get a shell into any image or container Vendor:Docker Inc. Version:0.0.37] map[Name:desktop Path:C:\Program Files\Docker\cli-plugins\docker-desktop.exe SchemaVersion:0.1.0 ShortDescription:Docker Desktop commands (Beta) Vendor:Docker Inc. Version:v0.1.0] map[Name:dev Path:C:\Program Files\Docker\cli-plugins\docker-dev.exe SchemaVersion:0.1.0 ShortDescription:Docker Dev Environments Vendor:Docker Inc. Version:v0.1.2] map[Name:extension Path:C:\Program Files\Docker\cli-plugins\docker-extension.exe SchemaVersion:0.1.0 ShortDescription:Manages Docker extensions Vendor:Docker Inc. Version:v0.2.27] map[Name:feedback Path:C:\Program Files\Docker\cli-plugins\docker-feedback.exe SchemaVersion:0.1.0 ShortDescription:Provide feedback, right in your terminal! Vendor:Docker Inc. Version:v1.0.5] map[Name:init Path:C:\Program Files\Docker\cli-plugins\docker-init.exe SchemaVersion:0.1.0 ShortDescription:Creates Docker-related starter files for your project Vendor:Docker Inc. Version:v1.4.0] map[Name:sbom Path:C:\Progr

am Files\Docker\cli-plugins\docker-sbom.exe SchemaVersion:0.1.0 ShortDescription:View the packaged-based Software Bill Of Materials (SBOM) for an image URL:https://github.com/docker/sbom-cli-plugin Vendor:Anchore Inc. Version:0.6.0] map[Name:scout Path:C:\Program Files\Docker\cli-plugins\docker-scout.exe SchemaVersion:0.1.0 ShortDescription:Docker Scout Vendor:Docker Inc. Version:v1.15.1]] Warnings:<nil>}}

	I1109 14:30:14.852122    1604 out.go:179] * Using the docker driver based on existing profile

	I1109 14:30:14.854122    1604 start.go:309] selected driver: docker

	I1109 14:30:14.854122    1604 start.go:930] validating driver "docker" against &{Name:missing-upgrade-184300 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.42@sha256:d35ac07dfda971cabee05e0deca8aeac772f885a5348e1a0c0b0a36db20fcfc0 Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.3 ClusterName:missing-upgrade-184300 Namespace:default APIServerHAVIP: APIServerName:minikubeCA API

ServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.103.2 Port:8443 KubernetesVersion:v1.28.3 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s MountString:C:\Users\jenkins.minikube4:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false C

ustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I1109 14:30:14.854122    1604 start.go:941] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}

	I1109 14:30:14.924242    1604 cli_runner.go:164] Run: docker system info --format "{{json .}}"

	I1109 14:30:15.229473    1604 info.go:266] docker info: {ID:a15b78d1-f772-48f7-bbf5-f8fe086f3f87 Containers:3 ContainersRunning:3 ContainersPaused:0 ContainersStopped:0 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:94 OomKillDisable:true NGoroutines:95 SystemTime:2025-11-09 14:30:15.207013972 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:14 KernelVersion:5.15.153.1-microsoft-standard-WSL2 OperatingSystem:Docker Desktop OSType:linux Architecture:x86_64 Ind

exServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:16 MemTotal:33657536512 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy:http.docker.internal:3128 HTTPSProxy:http.docker.internal:3128 NoProxy:hubproxy.docker.internal Name:docker-desktop Labels:[com.docker.desktop.address=npipe://\\.\pipe\docker_cli] ExperimentalBuild:false ServerVersion:27.4.0 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:472731909fa34bd7bc9c087e4c27943f9835f111 Expected:472731909fa34bd7bc9c087e4c27943f9835f111} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0

Expected:de40ad0} SecurityOptions:[name=seccomp,profile=unconfined] ProductLicense: Warnings:[WARNING: No blkio throttle.read_bps_device support WARNING: No blkio throttle.write_bps_device support WARNING: No blkio throttle.read_iops_device support WARNING: No blkio throttle.write_iops_device support WARNING: daemon is not using the default seccomp profile] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:ai Path:C:\Program Files\Docker\cli-plugins\docker-ai.exe SchemaVersion:0.1.0 ShortDescription:Ask Gordon - Docker Agent Vendor:Docker Inc. Version:v0.5.1] map[Name:buildx Path:C:\Program Files\Docker\cli-plugins\docker-buildx.exe SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.19.2-desktop.1] map[Name:compose Path:C:\Program Files\Docker\cli-plugins\docker-compose.exe SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.31.0-desktop.2] map[Name:debug Path:C:\Program Files\Docker\cli-plugins\docker-debug.exe SchemaVersion:0.1.0 ShortDescr

iption:Get a shell into any image or container Vendor:Docker Inc. Version:0.0.37] map[Name:desktop Path:C:\Program Files\Docker\cli-plugins\docker-desktop.exe SchemaVersion:0.1.0 ShortDescription:Docker Desktop commands (Beta) Vendor:Docker Inc. Version:v0.1.0] map[Name:dev Path:C:\Program Files\Docker\cli-plugins\docker-dev.exe SchemaVersion:0.1.0 ShortDescription:Docker Dev Environments Vendor:Docker Inc. Version:v0.1.2] map[Name:extension Path:C:\Program Files\Docker\cli-plugins\docker-extension.exe SchemaVersion:0.1.0 ShortDescription:Manages Docker extensions Vendor:Docker Inc. Version:v0.2.27] map[Name:feedback Path:C:\Program Files\Docker\cli-plugins\docker-feedback.exe SchemaVersion:0.1.0 ShortDescription:Provide feedback, right in your terminal! Vendor:Docker Inc. Version:v1.0.5] map[Name:init Path:C:\Program Files\Docker\cli-plugins\docker-init.exe SchemaVersion:0.1.0 ShortDescription:Creates Docker-related starter files for your project Vendor:Docker Inc. Version:v1.4.0] map[Name:sbom Path:C:\Progr

am Files\Docker\cli-plugins\docker-sbom.exe SchemaVersion:0.1.0 ShortDescription:View the packaged-based Software Bill Of Materials (SBOM) for an image URL:https://github.com/docker/sbom-cli-plugin Vendor:Anchore Inc. Version:0.6.0] map[Name:scout Path:C:\Program Files\Docker\cli-plugins\docker-scout.exe SchemaVersion:0.1.0 ShortDescription:Docker Scout Vendor:Docker Inc. Version:v1.15.1]] Warnings:<nil>}}

	I1109 14:30:15.229473    1604 cni.go:84] Creating CNI manager for ""

	I1109 14:30:15.230472    1604 cni.go:158] "docker" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge

	I1109 14:30:15.230472    1604 start.go:353] cluster config:

	{Name:missing-upgrade-184300 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.42@sha256:d35ac07dfda971cabee05e0deca8aeac772f885a5348e1a0c0b0a36db20fcfc0 Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.3 ClusterName:missing-upgrade-184300 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker C

RISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.103.2 Port:8443 KubernetesVersion:v1.28.3 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s MountString:C:\Users\jenkins.minikube4:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuth

Sock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I1109 14:30:15.233481    1604 out.go:179] * Starting "missing-upgrade-184300" primary control-plane node in "missing-upgrade-184300" cluster

	I1109 14:30:15.235472    1604 cache.go:134] Beginning downloading kic base image for docker with docker

	I1109 14:30:15.238473    1604 out.go:179] * Pulling base image v0.0.48-1761985721-21837 ...

	I1109 14:30:15.241472    1604 preload.go:188] Checking if preload exists for k8s version v1.28.3 and runtime docker

	I1109 14:30:15.241472    1604 image.go:81] Checking for gcr.io/k8s-minikube/kicbase:v0.0.42@sha256:d35ac07dfda971cabee05e0deca8aeac772f885a5348e1a0c0b0a36db20fcfc0 in local docker daemon

	I1109 14:30:15.241472    1604 preload.go:203] Found local preload: C:\Users\jenkins.minikube4\minikube-integration\.minikube\cache\preloaded-tarball\preloaded-images-k8s-v18-v1.28.3-docker-overlay2-amd64.tar.lz4

	I1109 14:30:15.241472    1604 cache.go:65] Caching tarball of preloaded images

	I1109 14:30:15.242481    1604 preload.go:238] Found C:\Users\jenkins.minikube4\minikube-integration\.minikube\cache\preloaded-tarball\preloaded-images-k8s-v18-v1.28.3-docker-overlay2-amd64.tar.lz4 in cache, skipping download

	I1109 14:30:15.242481    1604 cache.go:68] Finished verifying existence of preloaded tar for v1.28.3 on docker

	I1109 14:30:15.242481    1604 profile.go:143] Saving config to C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\missing-upgrade-184300\config.json ...

	I1109 14:30:15.329761    1604 image.go:100] Found gcr.io/k8s-minikube/kicbase:v0.0.42@sha256:d35ac07dfda971cabee05e0deca8aeac772f885a5348e1a0c0b0a36db20fcfc0 in local docker daemon, skipping pull

	I1109 14:30:15.329761    1604 cache.go:158] gcr.io/k8s-minikube/kicbase:v0.0.42@sha256:d35ac07dfda971cabee05e0deca8aeac772f885a5348e1a0c0b0a36db20fcfc0 exists in daemon, skipping load

	I1109 14:30:15.329761    1604 cache.go:243] Successfully downloaded all kic artifacts

	I1109 14:30:15.329761    1604 start.go:360] acquireMachinesLock for missing-upgrade-184300: {Name:mk1c95ff21e738a254f41e9850dcd0d598434226 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I1109 14:30:15.329761    1604 start.go:364] duration metric: took 0s to acquireMachinesLock for "missing-upgrade-184300"

	I1109 14:30:15.329761    1604 start.go:96] Skipping create...Using existing machine configuration

	I1109 14:30:15.329761    1604 fix.go:54] fixHost starting: 

	I1109 14:30:15.348164    1604 cli_runner.go:164] Run: docker container inspect missing-upgrade-184300 --format={{.State.Status}}

	W1109 14:30:15.408664    1604 cli_runner.go:211] docker container inspect missing-upgrade-184300 --format={{.State.Status}} returned with exit code 1

	I1109 14:30:15.408664    1604 fix.go:112] recreateIfNeeded on missing-upgrade-184300: state= err=unknown state "missing-upgrade-184300": docker container inspect missing-upgrade-184300 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: missing-upgrade-184300

	I1109 14:30:15.408664    1604 fix.go:117] machineExists: false. err=machine does not exist

	I1109 14:30:15.412658    1604 out.go:179] * docker "missing-upgrade-184300" container is missing, will recreate.

	I1109 14:30:15.414667    1604 delete.go:124] DEMOLISHING missing-upgrade-184300 ...

	I1109 14:30:15.426654    1604 cli_runner.go:164] Run: docker container inspect missing-upgrade-184300 --format={{.State.Status}}

	W1109 14:30:15.480665    1604 cli_runner.go:211] docker container inspect missing-upgrade-184300 --format={{.State.Status}} returned with exit code 1

	W1109 14:30:15.480665    1604 stop.go:83] unable to get state: unknown state "missing-upgrade-184300": docker container inspect missing-upgrade-184300 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: missing-upgrade-184300

	I1109 14:30:15.480665    1604 delete.go:128] stophost failed (probably ok): ssh power off: unknown state "missing-upgrade-184300": docker container inspect missing-upgrade-184300 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: missing-upgrade-184300

	I1109 14:30:15.497658    1604 cli_runner.go:164] Run: docker container inspect missing-upgrade-184300 --format={{.State.Status}}

	W1109 14:30:15.555656    1604 cli_runner.go:211] docker container inspect missing-upgrade-184300 --format={{.State.Status}} returned with exit code 1

	I1109 14:30:15.555656    1604 delete.go:82] Unable to get host status for missing-upgrade-184300, assuming it has already been deleted: state: unknown state "missing-upgrade-184300": docker container inspect missing-upgrade-184300 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: missing-upgrade-184300

	I1109 14:30:15.564655    1604 cli_runner.go:164] Run: docker container inspect -f {{.Id}} missing-upgrade-184300

	W1109 14:30:15.623668    1604 cli_runner.go:211] docker container inspect -f {{.Id}} missing-upgrade-184300 returned with exit code 1

	I1109 14:30:15.623668    1604 kic.go:371] could not find the container missing-upgrade-184300 to remove it. will try anyways

	I1109 14:30:15.629670    1604 cli_runner.go:164] Run: docker container inspect missing-upgrade-184300 --format={{.State.Status}}

	W1109 14:30:15.688107    1604 cli_runner.go:211] docker container inspect missing-upgrade-184300 --format={{.State.Status}} returned with exit code 1

	W1109 14:30:15.688107    1604 oci.go:84] error getting container status, will try to delete anyways: unknown state "missing-upgrade-184300": docker container inspect missing-upgrade-184300 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: missing-upgrade-184300

	I1109 14:30:15.695104    1604 cli_runner.go:164] Run: docker exec --privileged -t missing-upgrade-184300 /bin/bash -c "sudo init 0"

	W1109 14:30:15.751103    1604 cli_runner.go:211] docker exec --privileged -t missing-upgrade-184300 /bin/bash -c "sudo init 0" returned with exit code 1

	I1109 14:30:15.751103    1604 oci.go:659] error shutdown missing-upgrade-184300: docker exec --privileged -t missing-upgrade-184300 /bin/bash -c "sudo init 0": exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: missing-upgrade-184300

	I1109 14:30:16.757693    1604 cli_runner.go:164] Run: docker container inspect missing-upgrade-184300 --format={{.State.Status}}

	W1109 14:30:16.811373    1604 cli_runner.go:211] docker container inspect missing-upgrade-184300 --format={{.State.Status}} returned with exit code 1

	I1109 14:30:16.812373    1604 oci.go:671] temporary error verifying shutdown: unknown state "missing-upgrade-184300": docker container inspect missing-upgrade-184300 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: missing-upgrade-184300

	I1109 14:30:16.812373    1604 oci.go:673] temporary error: container missing-upgrade-184300 status is  but expect it to be exited

	I1109 14:30:16.812373    1604 retry.go:31] will retry after 727.654787ms: couldn't verify container is exited. %v: unknown state "missing-upgrade-184300": docker container inspect missing-upgrade-184300 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: missing-upgrade-184300

	I1109 14:30:17.547085    1604 cli_runner.go:164] Run: docker container inspect missing-upgrade-184300 --format={{.State.Status}}

	W1109 14:30:17.597254    1604 cli_runner.go:211] docker container inspect missing-upgrade-184300 --format={{.State.Status}} returned with exit code 1

	I1109 14:30:17.597254    1604 oci.go:671] temporary error verifying shutdown: unknown state "missing-upgrade-184300": docker container inspect missing-upgrade-184300 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: missing-upgrade-184300

	I1109 14:30:17.597254    1604 oci.go:673] temporary error: container missing-upgrade-184300 status is  but expect it to be exited

	I1109 14:30:17.597254    1604 retry.go:31] will retry after 398.828297ms: couldn't verify container is exited. %v: unknown state "missing-upgrade-184300": docker container inspect missing-upgrade-184300 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: missing-upgrade-184300

	I1109 14:30:18.001899    1604 cli_runner.go:164] Run: docker container inspect missing-upgrade-184300 --format={{.State.Status}}

	W1109 14:30:18.050285    1604 cli_runner.go:211] docker container inspect missing-upgrade-184300 --format={{.State.Status}} returned with exit code 1

	I1109 14:30:18.050285    1604 oci.go:671] temporary error verifying shutdown: unknown state "missing-upgrade-184300": docker container inspect missing-upgrade-184300 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: missing-upgrade-184300

	I1109 14:30:18.050285    1604 oci.go:673] temporary error: container missing-upgrade-184300 status is  but expect it to be exited

	I1109 14:30:18.050285    1604 retry.go:31] will retry after 642.519638ms: couldn't verify container is exited. %v: unknown state "missing-upgrade-184300": docker container inspect missing-upgrade-184300 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: missing-upgrade-184300

	I1109 14:30:18.699359    1604 cli_runner.go:164] Run: docker container inspect missing-upgrade-184300 --format={{.State.Status}}

	W1109 14:30:18.745360    1604 cli_runner.go:211] docker container inspect missing-upgrade-184300 --format={{.State.Status}} returned with exit code 1

	I1109 14:30:18.745360    1604 oci.go:671] temporary error verifying shutdown: unknown state "missing-upgrade-184300": docker container inspect missing-upgrade-184300 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: missing-upgrade-184300

	I1109 14:30:18.745360    1604 oci.go:673] temporary error: container missing-upgrade-184300 status is  but expect it to be exited

	I1109 14:30:18.745360    1604 retry.go:31] will retry after 1.440797248s: couldn't verify container is exited. %v: unknown state "missing-upgrade-184300": docker container inspect missing-upgrade-184300 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: missing-upgrade-184300

	I1109 14:30:20.193798    1604 cli_runner.go:164] Run: docker container inspect missing-upgrade-184300 --format={{.State.Status}}

	W1109 14:30:20.245975    1604 cli_runner.go:211] docker container inspect missing-upgrade-184300 --format={{.State.Status}} returned with exit code 1

	I1109 14:30:20.245975    1604 oci.go:671] temporary error verifying shutdown: unknown state "missing-upgrade-184300": docker container inspect missing-upgrade-184300 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: missing-upgrade-184300

	I1109 14:30:20.245975    1604 oci.go:673] temporary error: container missing-upgrade-184300 status is  but expect it to be exited

	I1109 14:30:20.245975    1604 retry.go:31] will retry after 2.774575097s: couldn't verify container is exited. %v: unknown state "missing-upgrade-184300": docker container inspect missing-upgrade-184300 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: missing-upgrade-184300

	I1109 14:30:23.028148    1604 cli_runner.go:164] Run: docker container inspect missing-upgrade-184300 --format={{.State.Status}}

	W1109 14:30:23.088942    1604 cli_runner.go:211] docker container inspect missing-upgrade-184300 --format={{.State.Status}} returned with exit code 1

	I1109 14:30:23.088942    1604 oci.go:671] temporary error verifying shutdown: unknown state "missing-upgrade-184300": docker container inspect missing-upgrade-184300 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: missing-upgrade-184300

	I1109 14:30:23.088942    1604 oci.go:673] temporary error: container missing-upgrade-184300 status is  but expect it to be exited

	I1109 14:30:23.088942    1604 retry.go:31] will retry after 4.240507195s: couldn't verify container is exited. %v: unknown state "missing-upgrade-184300": docker container inspect missing-upgrade-184300 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: missing-upgrade-184300

	I1109 14:30:27.338244    1604 cli_runner.go:164] Run: docker container inspect missing-upgrade-184300 --format={{.State.Status}}

	W1109 14:30:27.387071    1604 cli_runner.go:211] docker container inspect missing-upgrade-184300 --format={{.State.Status}} returned with exit code 1

	I1109 14:30:27.387071    1604 oci.go:671] temporary error verifying shutdown: unknown state "missing-upgrade-184300": docker container inspect missing-upgrade-184300 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: missing-upgrade-184300

	I1109 14:30:27.387071    1604 oci.go:673] temporary error: container missing-upgrade-184300 status is  but expect it to be exited

	I1109 14:30:27.387071    1604 retry.go:31] will retry after 6.892236651s: couldn't verify container is exited. %v: unknown state "missing-upgrade-184300": docker container inspect missing-upgrade-184300 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: missing-upgrade-184300

	I1109 14:30:34.285684    1604 cli_runner.go:164] Run: docker container inspect missing-upgrade-184300 --format={{.State.Status}}

	W1109 14:30:34.336685    1604 cli_runner.go:211] docker container inspect missing-upgrade-184300 --format={{.State.Status}} returned with exit code 1

	I1109 14:30:34.337701    1604 oci.go:671] temporary error verifying shutdown: unknown state "missing-upgrade-184300": docker container inspect missing-upgrade-184300 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: missing-upgrade-184300

	I1109 14:30:34.337701    1604 oci.go:673] temporary error: container missing-upgrade-184300 status is  but expect it to be exited

	I1109 14:30:34.337701    1604 oci.go:88] couldn't shut down missing-upgrade-184300 (might be okay): verify shutdown: couldn't verify container is exited. %v: unknown state "missing-upgrade-184300": docker container inspect missing-upgrade-184300 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: No such container: missing-upgrade-184300

	I1109 14:30:34.343689    1604 cli_runner.go:164] Run: docker rm -f -v missing-upgrade-184300

	I1109 14:30:34.408704    1604 cli_runner.go:164] Run: docker container inspect -f {{.Id}} missing-upgrade-184300

	W1109 14:30:34.474863    1604 cli_runner.go:211] docker container inspect -f {{.Id}} missing-upgrade-184300 returned with exit code 1

	I1109 14:30:34.480861    1604 cli_runner.go:164] Run: docker network inspect missing-upgrade-184300 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"

	I1109 14:30:34.551430    1604 cli_runner.go:164] Run: docker network rm missing-upgrade-184300

	I1109 14:30:34.927962    1604 fix.go:124] Sleeping 1 second for extra luck!

	I1109 14:30:35.928335    1604 start.go:125] createHost starting for "" (driver="docker")

	I1109 14:30:35.930827    1604 out.go:252] * Creating docker container (CPUs=2, Memory=3072MB) ...

	I1109 14:30:35.931482    1604 start.go:159] libmachine.API.Create for "missing-upgrade-184300" (driver="docker")

	I1109 14:30:35.931482    1604 client.go:173] LocalClient.Create starting

	I1109 14:30:35.932119    1604 main.go:143] libmachine: Reading certificate data from C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\ca.pem

	I1109 14:30:35.932559    1604 main.go:143] libmachine: Decoding PEM data...

	I1109 14:30:35.932647    1604 main.go:143] libmachine: Parsing certificate...

	I1109 14:30:35.932874    1604 main.go:143] libmachine: Reading certificate data from C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\cert.pem

	I1109 14:30:35.932874    1604 main.go:143] libmachine: Decoding PEM data...

	I1109 14:30:35.932874    1604 main.go:143] libmachine: Parsing certificate...

	I1109 14:30:35.944153    1604 cli_runner.go:164] Run: docker network inspect missing-upgrade-184300 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"

	W1109 14:30:35.999731    1604 cli_runner.go:211] docker network inspect missing-upgrade-184300 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1

	I1109 14:30:36.006738    1604 network_create.go:284] running [docker network inspect missing-upgrade-184300] to gather additional debugging logs...

	I1109 14:30:36.006738    1604 cli_runner.go:164] Run: docker network inspect missing-upgrade-184300

	W1109 14:30:36.062717    1604 cli_runner.go:211] docker network inspect missing-upgrade-184300 returned with exit code 1

	I1109 14:30:36.062717    1604 network_create.go:287] error running [docker network inspect missing-upgrade-184300]: docker network inspect missing-upgrade-184300: exit status 1

	stdout:

	[]

	stderr:

	Error response from daemon: network missing-upgrade-184300 not found

	I1109 14:30:36.062717    1604 network_create.go:289] output of [docker network inspect missing-upgrade-184300]: -- stdout --

	[]

	-- /stdout --

	** stderr ** 

	Error response from daemon: network missing-upgrade-184300 not found

	** /stderr **

	I1109 14:30:36.071725    1604 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"

	I1109 14:30:36.169252    1604 network.go:209] skipping subnet 192.168.49.0/24 that is reserved: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:<nil>}

	I1109 14:30:36.200410    1604 network.go:209] skipping subnet 192.168.58.0/24 that is reserved: &{IP:192.168.58.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.58.0/24 Gateway:192.168.58.1 ClientMin:192.168.58.2 ClientMax:192.168.58.254 Broadcast:192.168.58.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:<nil>}

	I1109 14:30:36.231255    1604 network.go:209] skipping subnet 192.168.67.0/24 that is reserved: &{IP:192.168.67.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.67.0/24 Gateway:192.168.67.1 ClientMin:192.168.67.2 ClientMax:192.168.67.254 Broadcast:192.168.67.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:<nil>}

	I1109 14:30:36.245705    1604 network.go:206] using free private subnet 192.168.76.0/24: &{IP:192.168.76.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.76.0/24 Gateway:192.168.76.1 ClientMin:192.168.76.2 ClientMax:192.168.76.254 Broadcast:192.168.76.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc001b53740}

	I1109 14:30:36.245705    1604 network_create.go:124] attempt to create docker network missing-upgrade-184300 192.168.76.0/24 with gateway 192.168.76.1 and MTU of 1500 ...

	I1109 14:30:36.251708    1604 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.76.0/24 --gateway=192.168.76.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=missing-upgrade-184300 missing-upgrade-184300

	W1109 14:30:36.301717    1604 cli_runner.go:211] docker network create --driver=bridge --subnet=192.168.76.0/24 --gateway=192.168.76.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=missing-upgrade-184300 missing-upgrade-184300 returned with exit code 1

	W1109 14:30:36.301717    1604 network_create.go:149] failed to create docker network missing-upgrade-184300 192.168.76.0/24 with gateway 192.168.76.1 and mtu of 1500: docker network create --driver=bridge --subnet=192.168.76.0/24 --gateway=192.168.76.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=missing-upgrade-184300 missing-upgrade-184300: exit status 1

	stdout:

	stderr:

	Error response from daemon: invalid pool request: Pool overlaps with other one on this address space

	W1109 14:30:36.301717    1604 network_create.go:116] failed to create docker network missing-upgrade-184300 192.168.76.0/24, will retry: subnet is taken

	I1109 14:30:36.325720    1604 network.go:209] skipping subnet 192.168.76.0/24 that is reserved: &{IP:192.168.76.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.76.0/24 Gateway:192.168.76.1 ClientMin:192.168.76.2 ClientMax:192.168.76.254 Broadcast:192.168.76.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:<nil>}

	I1109 14:30:36.356506    1604 network.go:209] skipping subnet 192.168.85.0/24 that is reserved: &{IP:192.168.85.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.85.0/24 Gateway:192.168.85.1 ClientMin:192.168.85.2 ClientMax:192.168.85.254 Broadcast:192.168.85.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:<nil>}

	I1109 14:30:36.372064    1604 network.go:209] skipping subnet 192.168.94.0/24 that is reserved: &{IP:192.168.94.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.94.0/24 Gateway:192.168.94.1 ClientMin:192.168.94.2 ClientMax:192.168.94.254 Broadcast:192.168.94.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:<nil>}

	I1109 14:30:36.387961    1604 network.go:209] skipping subnet 192.168.103.0/24 that is reserved: &{IP:192.168.103.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.103.0/24 Gateway:192.168.103.1 ClientMin:192.168.103.2 ClientMax:192.168.103.254 Broadcast:192.168.103.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:<nil>}

	I1109 14:30:36.403313    1604 network.go:209] skipping subnet 192.168.112.0/24 that is reserved: &{IP:192.168.112.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.112.0/24 Gateway:192.168.112.1 ClientMin:192.168.112.2 ClientMax:192.168.112.254 Broadcast:192.168.112.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:<nil>}

	I1109 14:30:36.416783    1604 network.go:206] using free private subnet 192.168.121.0/24: &{IP:192.168.121.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.121.0/24 Gateway:192.168.121.1 ClientMin:192.168.121.2 ClientMax:192.168.121.254 Broadcast:192.168.121.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc001ccc4e0}

	I1109 14:30:36.416783    1604 network_create.go:124] attempt to create docker network missing-upgrade-184300 192.168.121.0/24 with gateway 192.168.121.1 and MTU of 1500 ...

	I1109 14:30:36.422329    1604 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.121.0/24 --gateway=192.168.121.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=missing-upgrade-184300 missing-upgrade-184300

	I1109 14:30:36.570706    1604 network_create.go:108] docker network missing-upgrade-184300 192.168.121.0/24 created

	I1109 14:30:36.570706    1604 kic.go:121] calculated static IP "192.168.121.2" for the "missing-upgrade-184300" container

	I1109 14:30:36.593320    1604 cli_runner.go:164] Run: docker ps -a --format {{.Names}}

	I1109 14:30:36.659991    1604 cli_runner.go:164] Run: docker volume create missing-upgrade-184300 --label name.minikube.sigs.k8s.io=missing-upgrade-184300 --label created_by.minikube.sigs.k8s.io=true

	I1109 14:30:36.706998    1604 oci.go:103] Successfully created a docker volume missing-upgrade-184300

	I1109 14:30:36.712989    1604 cli_runner.go:164] Run: docker run --rm --name missing-upgrade-184300-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=missing-upgrade-184300 --entrypoint /usr/bin/test -v missing-upgrade-184300:/var gcr.io/k8s-minikube/kicbase:v0.0.42@sha256:d35ac07dfda971cabee05e0deca8aeac772f885a5348e1a0c0b0a36db20fcfc0 -d /var/lib

	I1109 14:30:37.826399    1604 cli_runner.go:217] Completed: docker run --rm --name missing-upgrade-184300-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=missing-upgrade-184300 --entrypoint /usr/bin/test -v missing-upgrade-184300:/var gcr.io/k8s-minikube/kicbase:v0.0.42@sha256:d35ac07dfda971cabee05e0deca8aeac772f885a5348e1a0c0b0a36db20fcfc0 -d /var/lib: (1.1133968s)

	I1109 14:30:37.826399    1604 oci.go:107] Successfully prepared a docker volume missing-upgrade-184300

	I1109 14:30:37.826399    1604 preload.go:188] Checking if preload exists for k8s version v1.28.3 and runtime docker

	I1109 14:30:37.826399    1604 kic.go:194] Starting extracting preloaded images to volume ...

	I1109 14:30:37.834650    1604 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v C:\Users\jenkins.minikube4\minikube-integration\.minikube\cache\preloaded-tarball\preloaded-images-k8s-v18-v1.28.3-docker-overlay2-amd64.tar.lz4:/preloaded.tar:ro -v missing-upgrade-184300:/extractDir gcr.io/k8s-minikube/kicbase:v0.0.42@sha256:d35ac07dfda971cabee05e0deca8aeac772f885a5348e1a0c0b0a36db20fcfc0 -I lz4 -xf /preloaded.tar -C /extractDir

	I1109 14:30:52.077032    1604 cli_runner.go:217] Completed: docker run --rm --entrypoint /usr/bin/tar -v C:\Users\jenkins.minikube4\minikube-integration\.minikube\cache\preloaded-tarball\preloaded-images-k8s-v18-v1.28.3-docker-overlay2-amd64.tar.lz4:/preloaded.tar:ro -v missing-upgrade-184300:/extractDir gcr.io/k8s-minikube/kicbase:v0.0.42@sha256:d35ac07dfda971cabee05e0deca8aeac772f885a5348e1a0c0b0a36db20fcfc0 -I lz4 -xf /preloaded.tar -C /extractDir: (14.2421817s)

	I1109 14:30:52.077032    1604 kic.go:203] duration metric: took 14.2504732s to extract preloaded images to volume ...

	I1109 14:30:52.088040    1604 cli_runner.go:164] Run: docker system info --format "{{json .}}"

	I1109 14:30:52.365759    1604 info.go:266] docker info: {ID:a15b78d1-f772-48f7-bbf5-f8fe086f3f87 Containers:3 ContainersRunning:1 ContainersPaused:0 ContainersStopped:2 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:63 OomKillDisable:true NGoroutines:85 SystemTime:2025-11-09 14:30:52.346940382 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:14 KernelVersion:5.15.153.1-microsoft-standard-WSL2 OperatingSystem:Docker Desktop OSType:linux Architecture:x86_64 Ind

exServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:16 MemTotal:33657536512 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy:http.docker.internal:3128 HTTPSProxy:http.docker.internal:3128 NoProxy:hubproxy.docker.internal Name:docker-desktop Labels:[com.docker.desktop.address=npipe://\\.\pipe\docker_cli] ExperimentalBuild:false ServerVersion:27.4.0 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:472731909fa34bd7bc9c087e4c27943f9835f111 Expected:472731909fa34bd7bc9c087e4c27943f9835f111} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0

Expected:de40ad0} SecurityOptions:[name=seccomp,profile=unconfined] ProductLicense: Warnings:[WARNING: No blkio throttle.read_bps_device support WARNING: No blkio throttle.write_bps_device support WARNING: No blkio throttle.read_iops_device support WARNING: No blkio throttle.write_iops_device support WARNING: daemon is not using the default seccomp profile] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:ai Path:C:\Program Files\Docker\cli-plugins\docker-ai.exe SchemaVersion:0.1.0 ShortDescription:Ask Gordon - Docker Agent Vendor:Docker Inc. Version:v0.5.1] map[Name:buildx Path:C:\Program Files\Docker\cli-plugins\docker-buildx.exe SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.19.2-desktop.1] map[Name:compose Path:C:\Program Files\Docker\cli-plugins\docker-compose.exe SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.31.0-desktop.2] map[Name:debug Path:C:\Program Files\Docker\cli-plugins\docker-debug.exe SchemaVersion:0.1.0 ShortDescr

iption:Get a shell into any image or container Vendor:Docker Inc. Version:0.0.37] map[Name:desktop Path:C:\Program Files\Docker\cli-plugins\docker-desktop.exe SchemaVersion:0.1.0 ShortDescription:Docker Desktop commands (Beta) Vendor:Docker Inc. Version:v0.1.0] map[Name:dev Path:C:\Program Files\Docker\cli-plugins\docker-dev.exe SchemaVersion:0.1.0 ShortDescription:Docker Dev Environments Vendor:Docker Inc. Version:v0.1.2] map[Name:extension Path:C:\Program Files\Docker\cli-plugins\docker-extension.exe SchemaVersion:0.1.0 ShortDescription:Manages Docker extensions Vendor:Docker Inc. Version:v0.2.27] map[Name:feedback Path:C:\Program Files\Docker\cli-plugins\docker-feedback.exe SchemaVersion:0.1.0 ShortDescription:Provide feedback, right in your terminal! Vendor:Docker Inc. Version:v1.0.5] map[Name:init Path:C:\Program Files\Docker\cli-plugins\docker-init.exe SchemaVersion:0.1.0 ShortDescription:Creates Docker-related starter files for your project Vendor:Docker Inc. Version:v1.4.0] map[Name:sbom Path:C:\Progr

am Files\Docker\cli-plugins\docker-sbom.exe SchemaVersion:0.1.0 ShortDescription:View the packaged-based Software Bill Of Materials (SBOM) for an image URL:https://github.com/docker/sbom-cli-plugin Vendor:Anchore Inc. Version:0.6.0] map[Name:scout Path:C:\Program Files\Docker\cli-plugins\docker-scout.exe SchemaVersion:0.1.0 ShortDescription:Docker Scout Vendor:Docker Inc. Version:v1.15.1]] Warnings:<nil>}}

	I1109 14:30:52.371750    1604 cli_runner.go:164] Run: docker info --format "'{{json .SecurityOptions}}'"

	I1109 14:30:52.692841    1604 cli_runner.go:164] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname missing-upgrade-184300 --name missing-upgrade-184300 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=missing-upgrade-184300 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=missing-upgrade-184300 --network missing-upgrade-184300 --ip 192.168.121.2 --volume missing-upgrade-184300:/var --security-opt apparmor=unconfined --memory=3072mb --memory-swap=3072mb --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase:v0.0.42@sha256:d35ac07dfda971cabee05e0deca8aeac772f885a5348e1a0c0b0a36db20fcfc0

	I1109 14:30:53.783167    1604 cli_runner.go:217] Completed: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname missing-upgrade-184300 --name missing-upgrade-184300 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=missing-upgrade-184300 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=missing-upgrade-184300 --network missing-upgrade-184300 --ip 192.168.121.2 --volume missing-upgrade-184300:/var --security-opt apparmor=unconfined --memory=3072mb --memory-swap=3072mb --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase:v0.0.42@sha256:d35ac07dfda971cabee05e0deca8aeac772f885a5348e1a0c0b0a36db20fcfc0: (1.090314s)

	I1109 14:30:53.792516    1604 cli_runner.go:164] Run: docker container inspect missing-upgrade-184300 --format={{.State.Running}}

	I1109 14:30:53.859508    1604 cli_runner.go:164] Run: docker container inspect missing-upgrade-184300 --format={{.State.Status}}

	I1109 14:30:53.927527    1604 cli_runner.go:164] Run: docker exec missing-upgrade-184300 stat /var/lib/dpkg/alternatives/iptables

	I1109 14:30:54.051512    1604 oci.go:144] the created container "missing-upgrade-184300" has a running status.

	I1109 14:30:54.051512    1604 kic.go:225] Creating ssh key for kic: C:\Users\jenkins.minikube4\minikube-integration\.minikube\machines\missing-upgrade-184300\id_rsa...

	I1109 14:30:54.313162    1604 kic_runner.go:191] docker (temp): C:\Users\jenkins.minikube4\minikube-integration\.minikube\machines\missing-upgrade-184300\id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)

	I1109 14:30:54.414166    1604 cli_runner.go:164] Run: docker container inspect missing-upgrade-184300 --format={{.State.Status}}

	I1109 14:30:54.492158    1604 kic_runner.go:93] Run: chown docker:docker /home/docker/.ssh/authorized_keys

	I1109 14:30:54.492158    1604 kic_runner.go:114] Args: [docker exec --privileged missing-upgrade-184300 chown docker:docker /home/docker/.ssh/authorized_keys]

	I1109 14:30:54.657872    1604 kic.go:265] ensuring only current user has permissions to key file located at : C:\Users\jenkins.minikube4\minikube-integration\.minikube\machines\missing-upgrade-184300\id_rsa...

	I1109 14:30:56.997073    1604 cli_runner.go:164] Run: docker container inspect missing-upgrade-184300 --format={{.State.Status}}

	I1109 14:30:57.055217    1604 machine.go:94] provisionDockerMachine start ...

	I1109 14:30:57.061734    1604 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" missing-upgrade-184300

	I1109 14:30:57.133118    1604 main.go:143] libmachine: Using SSH client type: native

	I1109 14:30:57.133118    1604 main.go:143] libmachine: &{{{<nil> 0 [] [] []} docker [0x11319e0] 0x1134500 <nil>  [] 0s} 127.0.0.1 51764 <nil> <nil>}

	I1109 14:30:57.133118    1604 main.go:143] libmachine: About to run SSH command:

	hostname

	I1109 14:30:57.307086    1604 main.go:143] libmachine: SSH cmd err, output: <nil>: missing-upgrade-184300

	I1109 14:30:57.307159    1604 ubuntu.go:182] provisioning hostname "missing-upgrade-184300"

	I1109 14:30:57.313512    1604 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" missing-upgrade-184300

	I1109 14:30:57.375146    1604 main.go:143] libmachine: Using SSH client type: native

	I1109 14:30:57.376145    1604 main.go:143] libmachine: &{{{<nil> 0 [] [] []} docker [0x11319e0] 0x1134500 <nil>  [] 0s} 127.0.0.1 51764 <nil> <nil>}

	I1109 14:30:57.376145    1604 main.go:143] libmachine: About to run SSH command:

	sudo hostname missing-upgrade-184300 && echo "missing-upgrade-184300" | sudo tee /etc/hostname

	I1109 14:30:57.549129    1604 main.go:143] libmachine: SSH cmd err, output: <nil>: missing-upgrade-184300

	I1109 14:30:57.558613    1604 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" missing-upgrade-184300

	I1109 14:30:57.613523    1604 main.go:143] libmachine: Using SSH client type: native

	I1109 14:30:57.614515    1604 main.go:143] libmachine: &{{{<nil> 0 [] [] []} docker [0x11319e0] 0x1134500 <nil>  [] 0s} 127.0.0.1 51764 <nil> <nil>}

	I1109 14:30:57.614515    1604 main.go:143] libmachine: About to run SSH command:

			if ! grep -xq '.*\smissing-upgrade-184300' /etc/hosts; then

				if grep -xq '127.0.1.1\s.*' /etc/hosts; then

					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 missing-upgrade-184300/g' /etc/hosts;

				else 

					echo '127.0.1.1 missing-upgrade-184300' | sudo tee -a /etc/hosts; 

				fi

			fi

	I1109 14:30:57.777413    1604 main.go:143] libmachine: SSH cmd err, output: <nil>: 

	I1109 14:30:57.777413    1604 ubuntu.go:188] set auth options {CertDir:C:\Users\jenkins.minikube4\minikube-integration\.minikube CaCertPath:C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\ca.pem CaPrivateKeyPath:C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:C:\Users\jenkins.minikube4\minikube-integration\.minikube\machines\server.pem ServerKeyPath:C:\Users\jenkins.minikube4\minikube-integration\.minikube\machines\server-key.pem ClientKeyPath:C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\cert.pem ServerCertSANs:[] StorePath:C:\Users\jenkins.minikube4\minikube-integration\.minikube}

	I1109 14:30:57.777413    1604 ubuntu.go:190] setting up certificates

	I1109 14:30:57.777413    1604 provision.go:84] configureAuth start

	I1109 14:30:57.784414    1604 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" missing-upgrade-184300

	I1109 14:30:57.844320    1604 provision.go:143] copyHostCerts

	I1109 14:30:57.844320    1604 exec_runner.go:144] found C:\Users\jenkins.minikube4\minikube-integration\.minikube/ca.pem, removing ...

	I1109 14:30:57.844320    1604 exec_runner.go:203] rm: C:\Users\jenkins.minikube4\minikube-integration\.minikube\ca.pem

	I1109 14:30:57.845115    1604 exec_runner.go:151] cp: C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\ca.pem --> C:\Users\jenkins.minikube4\minikube-integration\.minikube/ca.pem (1082 bytes)

	I1109 14:30:57.846049    1604 exec_runner.go:144] found C:\Users\jenkins.minikube4\minikube-integration\.minikube/cert.pem, removing ...

	I1109 14:30:57.846091    1604 exec_runner.go:203] rm: C:\Users\jenkins.minikube4\minikube-integration\.minikube\cert.pem

	I1109 14:30:57.846362    1604 exec_runner.go:151] cp: C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\cert.pem --> C:\Users\jenkins.minikube4\minikube-integration\.minikube/cert.pem (1123 bytes)

	I1109 14:30:57.847185    1604 exec_runner.go:144] found C:\Users\jenkins.minikube4\minikube-integration\.minikube/key.pem, removing ...

	I1109 14:30:57.847268    1604 exec_runner.go:203] rm: C:\Users\jenkins.minikube4\minikube-integration\.minikube\key.pem

	I1109 14:30:57.847565    1604 exec_runner.go:151] cp: C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\key.pem --> C:\Users\jenkins.minikube4\minikube-integration\.minikube/key.pem (1679 bytes)

	I1109 14:30:57.848248    1604 provision.go:117] generating server cert: C:\Users\jenkins.minikube4\minikube-integration\.minikube\machines\server.pem ca-key=C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\ca.pem private-key=C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\ca-key.pem org=jenkins.missing-upgrade-184300 san=[127.0.0.1 192.168.121.2 localhost minikube missing-upgrade-184300]

	I1109 14:30:58.246543    1604 provision.go:177] copyRemoteCerts

	I1109 14:30:58.254535    1604 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker

	I1109 14:30:58.260528    1604 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" missing-upgrade-184300

	I1109 14:30:58.316532    1604 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:51764 SSHKeyPath:C:\Users\jenkins.minikube4\minikube-integration\.minikube\machines\missing-upgrade-184300\id_rsa Username:docker}

	I1109 14:30:58.453967    1604 ssh_runner.go:362] scp C:\Users\jenkins.minikube4\minikube-integration\.minikube\machines\server-key.pem --> /etc/docker/server-key.pem (1679 bytes)

	I1109 14:30:58.509171    1604 ssh_runner.go:362] scp C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\ca.pem --> /etc/docker/ca.pem (1082 bytes)

	I1109 14:30:58.566202    1604 ssh_runner.go:362] scp C:\Users\jenkins.minikube4\minikube-integration\.minikube\machines\server.pem --> /etc/docker/server.pem (1233 bytes)

	I1109 14:30:58.598203    1604 provision.go:87] duration metric: took 820.7803ms to configureAuth

	I1109 14:30:58.599208    1604 ubuntu.go:206] setting minikube options for container-runtime

	I1109 14:30:58.599208    1604 config.go:182] Loaded profile config "missing-upgrade-184300": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.28.3

	I1109 14:30:58.605200    1604 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" missing-upgrade-184300

	I1109 14:30:58.661245    1604 main.go:143] libmachine: Using SSH client type: native

	I1109 14:30:58.662025    1604 main.go:143] libmachine: &{{{<nil> 0 [] [] []} docker [0x11319e0] 0x1134500 <nil>  [] 0s} 127.0.0.1 51764 <nil> <nil>}

	I1109 14:30:58.662062    1604 main.go:143] libmachine: About to run SSH command:

	df --output=fstype / | tail -n 1

	I1109 14:30:58.817301    1604 main.go:143] libmachine: SSH cmd err, output: <nil>: overlay

	I1109 14:30:58.817301    1604 ubuntu.go:71] root file system type: overlay

	I1109 14:30:58.817301    1604 provision.go:314] Updating docker unit: /lib/systemd/system/docker.service ...

	I1109 14:30:58.823304    1604 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" missing-upgrade-184300

	I1109 14:30:58.884424    1604 main.go:143] libmachine: Using SSH client type: native

	I1109 14:30:58.884878    1604 main.go:143] libmachine: &{{{<nil> 0 [] [] []} docker [0x11319e0] 0x1134500 <nil>  [] 0s} 127.0.0.1 51764 <nil> <nil>}

	I1109 14:30:58.884978    1604 main.go:143] libmachine: About to run SSH command:

	sudo mkdir -p /lib/systemd/system && printf %s "[Unit]

	Description=Docker Application Container Engine

	Documentation=https://docs.docker.com

	After=network-online.target nss-lookup.target docker.socket firewalld.service containerd.service time-set.target

	Wants=network-online.target containerd.service

	Requires=docker.socket

	StartLimitBurst=3

	StartLimitIntervalSec=60

	[Service]

	Type=notify

	Restart=always

	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	# The base configuration already specifies an 'ExecStart=...' command. The first directive

	# here is to clear out that command inherited from the base configuration. Without this,

	# the command from the base configuration and the command specified here are treated as

	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	# will catch this invalid input and refuse to start the service with an error like:

	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	ExecStart=

	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 \

		-H fd:// --containerd=/run/containerd/containerd.sock \

		-H unix:///var/run/docker.sock \

		--default-ulimit=nofile=1048576:1048576 \

		--tlsverify \

		--tlscacert /etc/docker/ca.pem \

		--tlscert /etc/docker/server.pem \

		--tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12 

	ExecReload=/bin/kill -s HUP \$MAINPID

	# Having non-zero Limit*s causes performance problems due to accounting overhead

	# in the kernel. We recommend using cgroups to do container-local accounting.

	LimitNOFILE=infinity

	LimitNPROC=infinity

	LimitCORE=infinity

	# Uncomment TasksMax if your systemd version supports it.

	# Only systemd 226 and above support this version.

	TasksMax=infinity

	TimeoutStartSec=0

	# set delegate yes so that systemd does not reset the cgroups of docker containers

	Delegate=yes

	# kill only the docker process, not all processes in the cgroup

	KillMode=process

	OOMScoreAdjust=-500

	[Install]

	WantedBy=multi-user.target

	" | sudo tee /lib/systemd/system/docker.service.new

	I1109 14:30:59.069110    1604 main.go:143] libmachine: SSH cmd err, output: <nil>: [Unit]

	Description=Docker Application Container Engine

	Documentation=https://docs.docker.com

	After=network-online.target nss-lookup.target docker.socket firewalld.service containerd.service time-set.target

	Wants=network-online.target containerd.service

	Requires=docker.socket

	StartLimitBurst=3

	StartLimitIntervalSec=60

	[Service]

	Type=notify

	Restart=always

	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	# The base configuration already specifies an 'ExecStart=...' command. The first directive

	# here is to clear out that command inherited from the base configuration. Without this,

	# the command from the base configuration and the command specified here are treated as

	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	# will catch this invalid input and refuse to start the service with an error like:

	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	ExecStart=

	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 	-H fd:// --containerd=/run/containerd/containerd.sock 	-H unix:///var/run/docker.sock 	--default-ulimit=nofile=1048576:1048576 	--tlsverify 	--tlscacert /etc/docker/ca.pem 	--tlscert /etc/docker/server.pem 	--tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12 

	ExecReload=/bin/kill -s HUP $MAINPID

	# Having non-zero Limit*s causes performance problems due to accounting overhead

	# in the kernel. We recommend using cgroups to do container-local accounting.

	LimitNOFILE=infinity

	LimitNPROC=infinity

	LimitCORE=infinity

	# Uncomment TasksMax if your systemd version supports it.

	# Only systemd 226 and above support this version.

	TasksMax=infinity

	TimeoutStartSec=0

	# set delegate yes so that systemd does not reset the cgroups of docker containers

	Delegate=yes

	# kill only the docker process, not all processes in the cgroup

	KillMode=process

	OOMScoreAdjust=-500

	[Install]

	WantedBy=multi-user.target

	I1109 14:30:59.076576    1604 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" missing-upgrade-184300

	I1109 14:30:59.142324    1604 main.go:143] libmachine: Using SSH client type: native

	I1109 14:30:59.142324    1604 main.go:143] libmachine: &{{{<nil> 0 [] [] []} docker [0x11319e0] 0x1134500 <nil>  [] 0s} 127.0.0.1 51764 <nil> <nil>}

	I1109 14:30:59.142324    1604 main.go:143] libmachine: About to run SSH command:

	sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }

	I1109 14:30:59.934480    1604 main.go:143] libmachine: SSH cmd err, output: Process exited with status 1: --- /lib/systemd/system/docker.service	2023-10-26 09:06:22.000000000 +0000

	+++ /lib/systemd/system/docker.service.new	2025-11-09 14:30:59.056093801 +0000

	@@ -1,30 +1,31 @@

	 [Unit]

	 Description=Docker Application Container Engine

	 Documentation=https://docs.docker.com

	-After=network-online.target docker.socket firewalld.service containerd.service time-set.target

	+After=network-online.target nss-lookup.target docker.socket firewalld.service containerd.service time-set.target

	 Wants=network-online.target containerd.service

	 Requires=docker.socket

	+StartLimitBurst=3

	+StartLimitIntervalSec=60

	 [Service]

	 Type=notify

	-# the default is not to use systemd for cgroups because the delegate issues still

	-# exists and systemd currently does not support the cgroup feature set required

	-# for containers run by docker

	-ExecStart=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock

	-ExecReload=/bin/kill -s HUP $MAINPID

	-TimeoutStartSec=0

	-RestartSec=2

	 Restart=always

	-# Note that StartLimit* options were moved from "Service" to "Unit" in systemd 229.

	-# Both the old, and new location are accepted by systemd 229 and up, so using the old location

	-# to make them work for either version of systemd.

	-StartLimitBurst=3

	-# Note that StartLimitInterval was renamed to StartLimitIntervalSec in systemd 230.

	-# Both the old, and new name are accepted by systemd 230 and up, so using the old name to make

	-# this option work for either version of systemd.

	-StartLimitInterval=60s

	+

	+# This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	+# The base configuration already specifies an 'ExecStart=...' command. The first directive

	+# here is to clear out that command inherited from the base configuration. Without this,

	+# the command from the base configuration and the command specified here are treated as

	+# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	+# will catch this invalid input and refuse to start the service with an error like:

	+#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	+

	+# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	+# container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	+ExecStart=

	+ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 	-H fd:// --containerd=/run/containerd/containerd.sock 	-H unix:///var/run/docker.sock 	--default-ulimit=nofile=1048576:1048576 	--tlsverify 	--tlscacert /etc/docker/ca.pem 	--tlscert /etc/docker/server.pem 	--tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12 

	+ExecReload=/bin/kill -s HUP $MAINPID

	 # Having non-zero Limit*s causes performance problems due to accounting overhead

	 # in the kernel. We recommend using cgroups to do container-local accounting.

	@@ -32,9 +33,10 @@

	 LimitNPROC=infinity

	 LimitCORE=infinity

	-# Comment TasksMax if your systemd version does not support it.

	-# Only systemd 226 and above support this option.

	+# Uncomment TasksMax if your systemd version supports it.

	+# Only systemd 226 and above support this version.

	 TasksMax=infinity

	+TimeoutStartSec=0

	 # set delegate yes so that systemd does not reset the cgroups of docker containers

	 Delegate=yes

	Synchronizing state of docker.service with SysV service script with /lib/systemd/systemd-sysv-install.

	Executing: /lib/systemd/systemd-sysv-install enable docker

	Job for docker.service failed because the control process exited with error code.

	See "systemctl status docker.service" and "journalctl -xeu docker.service" for details.

	I1109 14:30:59.934524    1604 ubuntu.go:208] Error setting container-runtime options during provisioning ssh command error:

	command : sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }

	err     : Process exited with status 1

	output  : --- /lib/systemd/system/docker.service	2023-10-26 09:06:22.000000000 +0000

	+++ /lib/systemd/system/docker.service.new	2025-11-09 14:30:59.056093801 +0000

	@@ -1,30 +1,31 @@

	 [Unit]

	 Description=Docker Application Container Engine

	 Documentation=https://docs.docker.com

	-After=network-online.target docker.socket firewalld.service containerd.service time-set.target

	+After=network-online.target nss-lookup.target docker.socket firewalld.service containerd.service time-set.target

	 Wants=network-online.target containerd.service

	 Requires=docker.socket

	+StartLimitBurst=3

	+StartLimitIntervalSec=60

	 [Service]

	 Type=notify

	-# the default is not to use systemd for cgroups because the delegate issues still

	-# exists and systemd currently does not support the cgroup feature set required

	-# for containers run by docker

	-ExecStart=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock

	-ExecReload=/bin/kill -s HUP $MAINPID

	-TimeoutStartSec=0

	-RestartSec=2

	 Restart=always

	-# Note that StartLimit* options were moved from "Service" to "Unit" in systemd 229.

	-# Both the old, and new location are accepted by systemd 229 and up, so using the old location

	-# to make them work for either version of systemd.

	-StartLimitBurst=3

	-# Note that StartLimitInterval was renamed to StartLimitIntervalSec in systemd 230.

	-# Both the old, and new name are accepted by systemd 230 and up, so using the old name to make

	-# this option work for either version of systemd.

	-StartLimitInterval=60s

	+

	+# This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	+# The base configuration already specifies an 'ExecStart=...' command. The first directive

	+# here is to clear out that command inherited from the base configuration. Without this,

	+# the command from the base configuration and the command specified here are treated as

	+# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	+# will catch this invalid input and refuse to start the service with an error like:

	+#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	+

	+# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	+# container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	+ExecStart=

	+ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 	-H fd:// --containerd=/run/containerd/containerd.sock 	-H unix:///var/run/docker.sock 	--default-ulimit=nofile=1048576:1048576 	--tlsverify 	--tlscacert /etc/docker/ca.pem 	--tlscert /etc/docker/server.pem 	--tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12 

	+ExecReload=/bin/kill -s HUP $MAINPID

	 # Having non-zero Limit*s causes performance problems due to accounting overhead

	 # in the kernel. We recommend using cgroups to do container-local accounting.

	@@ -32,9 +33,10 @@

	 LimitNPROC=infinity

	 LimitCORE=infinity

	-# Comment TasksMax if your systemd version does not support it.

	-# Only systemd 226 and above support this option.

	+# Uncomment TasksMax if your systemd version supports it.

	+# Only systemd 226 and above support this version.

	 TasksMax=infinity

	+TimeoutStartSec=0

	 # set delegate yes so that systemd does not reset the cgroups of docker containers

	 Delegate=yes

	Synchronizing state of docker.service with SysV service script with /lib/systemd/systemd-sysv-install.

	Executing: /lib/systemd/systemd-sysv-install enable docker

	Job for docker.service failed because the control process exited with error code.

	See "systemctl status docker.service" and "journalctl -xeu docker.service" for details.

	I1109 14:30:59.934853    1604 machine.go:97] duration metric: took 2.8795588s to provisionDockerMachine

	I1109 14:30:59.934907    1604 client.go:176] duration metric: took 24.0031559s to LocalClient.Create

	I1109 14:31:01.941966    1604 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I1109 14:31:01.947982    1604 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" missing-upgrade-184300

	I1109 14:31:02.011520    1604 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:51764 SSHKeyPath:C:\Users\jenkins.minikube4\minikube-integration\.minikube\machines\missing-upgrade-184300\id_rsa Username:docker}

	I1109 14:31:02.138317    1604 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"

	I1109 14:31:02.146884    1604 start.go:128] duration metric: took 26.2181429s to createHost

	I1109 14:31:02.154968    1604 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I1109 14:31:02.160893    1604 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" missing-upgrade-184300

	I1109 14:31:02.222871    1604 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:51764 SSHKeyPath:C:\Users\jenkins.minikube4\minikube-integration\.minikube\machines\missing-upgrade-184300\id_rsa Username:docker}

	I1109 14:31:02.336874    1604 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"

	I1109 14:31:02.346867    1604 fix.go:56] duration metric: took 47.0165789s for fixHost

	I1109 14:31:02.346867    1604 start.go:83] releasing machines lock for "missing-upgrade-184300", held for 47.0165789s

	W1109 14:31:02.346867    1604 start.go:715] error starting host: recreate: creating host: create: provisioning: ssh command error:

	command : sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }

	err     : Process exited with status 1

	output  : --- /lib/systemd/system/docker.service	2023-10-26 09:06:22.000000000 +0000

	+++ /lib/systemd/system/docker.service.new	2025-11-09 14:30:59.056093801 +0000

	@@ -1,30 +1,31 @@

	 [Unit]

	 Description=Docker Application Container Engine

	 Documentation=https://docs.docker.com

	-After=network-online.target docker.socket firewalld.service containerd.service time-set.target

	+After=network-online.target nss-lookup.target docker.socket firewalld.service containerd.service time-set.target

	 Wants=network-online.target containerd.service

	 Requires=docker.socket

	+StartLimitBurst=3

	+StartLimitIntervalSec=60

	 [Service]

	 Type=notify

	-# the default is not to use systemd for cgroups because the delegate issues still

	-# exists and systemd currently does not support the cgroup feature set required

	-# for containers run by docker

	-ExecStart=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock

	-ExecReload=/bin/kill -s HUP $MAINPID

	-TimeoutStartSec=0

	-RestartSec=2

	 Restart=always

	-# Note that StartLimit* options were moved from "Service" to "Unit" in systemd 229.

	-# Both the old, and new location are accepted by systemd 229 and up, so using the old location

	-# to make them work for either version of systemd.

	-StartLimitBurst=3

	-# Note that StartLimitInterval was renamed to StartLimitIntervalSec in systemd 230.

	-# Both the old, and new name are accepted by systemd 230 and up, so using the old name to make

	-# this option work for either version of systemd.

	-StartLimitInterval=60s

	+

	+# This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	+# The base configuration already specifies an 'ExecStart=...' command. The first directive

	+# here is to clear out that command inherited from the base configuration. Without this,

	+# the command from the base configuration and the command specified here are treated as

	+# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	+# will catch this invalid input and refuse to start the service with an error like:

	+#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	+

	+# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	+# container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	+ExecStart=

	+ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 	-H fd:// --containerd=/run/containerd/containerd.sock 	-H unix:///var/run/docker.sock 	--default-ulimit=nofile=1048576:1048576 	--tlsverify 	--tlscacert /etc/docker/ca.pem 	--tlscert /etc/docker/server.pem 	--tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12 

	+ExecReload=/bin/kill -s HUP $MAINPID

	 # Having non-zero Limit*s causes performance problems due to accounting overhead

	 # in the kernel. We recommend using cgroups to do container-local accounting.

	@@ -32,9 +33,10 @@

	 LimitNPROC=infinity

	 LimitCORE=infinity

	-# Comment TasksMax if your systemd version does not support it.

	-# Only systemd 226 and above support this option.

	+# Uncomment TasksMax if your systemd version supports it.

	+# Only systemd 226 and above support this version.

	 TasksMax=infinity

	+TimeoutStartSec=0

	 # set delegate yes so that systemd does not reset the cgroups of docker containers

	 Delegate=yes

	Synchronizing state of docker.service with SysV service script with /lib/systemd/systemd-sysv-install.

	Executing: /lib/systemd/systemd-sysv-install enable docker

	Job for docker.service failed because the control process exited with error code.

	See "systemctl status docker.service" and "journalctl -xeu docker.service" for details.

	W1109 14:31:02.347868    1604 out.go:285] ! StartHost failed, but will try again: recreate: creating host: create: provisioning: ssh command error:

	command : sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }

	err     : Process exited with status 1

	output  : --- /lib/systemd/system/docker.service	2023-10-26 09:06:22.000000000 +0000

	+++ /lib/systemd/system/docker.service.new	2025-11-09 14:30:59.056093801 +0000

	@@ -1,30 +1,31 @@

	 [Unit]

	 Description=Docker Application Container Engine

	 Documentation=https://docs.docker.com

	-After=network-online.target docker.socket firewalld.service containerd.service time-set.target

	+After=network-online.target nss-lookup.target docker.socket firewalld.service containerd.service time-set.target

	 Wants=network-online.target containerd.service

	 Requires=docker.socket

	+StartLimitBurst=3

	+StartLimitIntervalSec=60

	 [Service]

	 Type=notify

	-# the default is not to use systemd for cgroups because the delegate issues still

	-# exists and systemd currently does not support the cgroup feature set required

	-# for containers run by docker

	-ExecStart=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock

	-ExecReload=/bin/kill -s HUP $MAINPID

	-TimeoutStartSec=0

	-RestartSec=2

	 Restart=always

	-# Note that StartLimit* options were moved from "Service" to "Unit" in systemd 229.

	-# Both the old, and new location are accepted by systemd 229 and up, so using the old location

	-# to make them work for either version of systemd.

	-StartLimitBurst=3

	-# Note that StartLimitInterval was renamed to StartLimitIntervalSec in systemd 230.

	-# Both the old, and new name are accepted by systemd 230 and up, so using the old name to make

	-# this option work for either version of systemd.

	-StartLimitInterval=60s

	+

	+# This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	+# The base configuration already specifies an 'ExecStart=...' command. The first directive

	+# here is to clear out that command inherited from the base configuration. Without this,

	+# the command from the base configuration and the command specified here are treated as

	+# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	+# will catch this invalid input and refuse to start the service with an error like:

	+#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	+

	+# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	+# container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	+ExecStart=

	+ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 	-H fd:// --containerd=/run/containerd/containerd.sock 	-H unix:///var/run/docker.sock 	--default-ulimit=nofile=1048576:1048576 	--tlsverify 	--tlscacert /etc/docker/ca.pem 	--tlscert /etc/docker/server.pem 	--tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12 

	+ExecReload=/bin/kill -s HUP $MAINPID

	 # Having non-zero Limit*s causes performance problems due to accounting overhead

	 # in the kernel. We recommend using cgroups to do container-local accounting.

	@@ -32,9 +33,10 @@

	 LimitNPROC=infinity

	 LimitCORE=infinity

	-# Comment TasksMax if your systemd version does not support it.

	-# Only systemd 226 and above support this option.

	+# Uncomment TasksMax if your systemd version supports it.

	+# Only systemd 226 and above support this version.

	 TasksMax=infinity

	+TimeoutStartSec=0

	 # set delegate yes so that systemd does not reset the cgroups of docker containers

	 Delegate=yes

	Synchronizing state of docker.service with SysV service script with /lib/systemd/systemd-sysv-install.

	Executing: /lib/systemd/systemd-sysv-install enable docker

	Job for docker.service failed because the control process exited with error code.

	See "systemctl status docker.service" and "journalctl -xeu docker.service" for details.

	! StartHost failed, but will try again: recreate: creating host: create: provisioning: ssh command error:

	command : sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }

	err     : Process exited with status 1

	output  : --- /lib/systemd/system/docker.service	2023-10-26 09:06:22.000000000 +0000

	+++ /lib/systemd/system/docker.service.new	2025-11-09 14:30:59.056093801 +0000

	@@ -1,30 +1,31 @@

	 [Unit]

	 Description=Docker Application Container Engine

	 Documentation=https://docs.docker.com

	-After=network-online.target docker.socket firewalld.service containerd.service time-set.target

	+After=network-online.target nss-lookup.target docker.socket firewalld.service containerd.service time-set.target

	 Wants=network-online.target containerd.service

	 Requires=docker.socket

	+StartLimitBurst=3

	+StartLimitIntervalSec=60

	 [Service]

	 Type=notify

	-# the default is not to use systemd for cgroups because the delegate issues still

	-# exists and systemd currently does not support the cgroup feature set required

	-# for containers run by docker

	-ExecStart=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock

	-ExecReload=/bin/kill -s HUP $MAINPID

	-TimeoutStartSec=0

	-RestartSec=2

	 Restart=always

	-# Note that StartLimit* options were moved from "Service" to "Unit" in systemd 229.

	-# Both the old, and new location are accepted by systemd 229 and up, so using the old location

	-# to make them work for either version of systemd.

	-StartLimitBurst=3

	-# Note that StartLimitInterval was renamed to StartLimitIntervalSec in systemd 230.

	-# Both the old, and new name are accepted by systemd 230 and up, so using the old name to make

	-# this option work for either version of systemd.

	-StartLimitInterval=60s

	+

	+# This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	+# The base configuration already specifies an 'ExecStart=...' command. The first directive

	+# here is to clear out that command inherited from the base configuration. Without this,

	+# the command from the base configuration and the command specified here are treated as

	+# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	+# will catch this invalid input and refuse to start the service with an error like:

	+#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	+

	+# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	+# container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	+ExecStart=

	+ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 	-H fd:// --containerd=/run/containerd/containerd.sock 	-H unix:///var/run/docker.sock 	--default-ulimit=nofile=1048576:1048576 	--tlsverify 	--tlscacert /etc/docker/ca.pem 	--tlscert /etc/docker/server.pem 	--tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12 

	+ExecReload=/bin/kill -s HUP $MAINPID

	 # Having non-zero Limit*s causes performance problems due to accounting overhead

	 # in the kernel. We recommend using cgroups to do container-local accounting.

	@@ -32,9 +33,10 @@

	 LimitNPROC=infinity

	 LimitCORE=infinity

	-# Comment TasksMax if your systemd version does not support it.

	-# Only systemd 226 and above support this option.

	+# Uncomment TasksMax if your systemd version supports it.

	+# Only systemd 226 and above support this version.

	 TasksMax=infinity

	+TimeoutStartSec=0

	 # set delegate yes so that systemd does not reset the cgroups of docker containers

	 Delegate=yes

	Synchronizing state of docker.service with SysV service script with /lib/systemd/systemd-sysv-install.

	Executing: /lib/systemd/systemd-sysv-install enable docker

	Job for docker.service failed because the control process exited with error code.

	See "systemctl status docker.service" and "journalctl -xeu docker.service" for details.

	I1109 14:31:02.347868    1604 start.go:730] Will try again in 5 seconds ...

	I1109 14:31:07.348311    1604 start.go:360] acquireMachinesLock for missing-upgrade-184300: {Name:mk1c95ff21e738a254f41e9850dcd0d598434226 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I1109 14:31:07.348311    1604 start.go:364] duration metric: took 0s to acquireMachinesLock for "missing-upgrade-184300"

	I1109 14:31:07.348311    1604 start.go:96] Skipping create...Using existing machine configuration

	I1109 14:31:07.348311    1604 fix.go:54] fixHost starting: 

	I1109 14:31:07.367296    1604 cli_runner.go:164] Run: docker container inspect missing-upgrade-184300 --format={{.State.Status}}

	I1109 14:31:07.432286    1604 fix.go:112] recreateIfNeeded on missing-upgrade-184300: state=Running err=<nil>

	W1109 14:31:07.432286    1604 fix.go:138] unexpected machine state, will restart: <nil>

	I1109 14:31:07.436319    1604 out.go:252] * Updating the running docker "missing-upgrade-184300" container ...

	I1109 14:31:07.436319    1604 machine.go:94] provisionDockerMachine start ...

	I1109 14:31:07.444304    1604 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" missing-upgrade-184300

	I1109 14:31:07.519308    1604 main.go:143] libmachine: Using SSH client type: native

	I1109 14:31:07.520288    1604 main.go:143] libmachine: &{{{<nil> 0 [] [] []} docker [0x11319e0] 0x1134500 <nil>  [] 0s} 127.0.0.1 51764 <nil> <nil>}

	I1109 14:31:07.520288    1604 main.go:143] libmachine: About to run SSH command:

	hostname

	I1109 14:31:07.710311    1604 main.go:143] libmachine: SSH cmd err, output: <nil>: missing-upgrade-184300

	I1109 14:31:07.710311    1604 ubuntu.go:182] provisioning hostname "missing-upgrade-184300"

	I1109 14:31:07.717302    1604 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" missing-upgrade-184300

	I1109 14:31:07.785285    1604 main.go:143] libmachine: Using SSH client type: native

	I1109 14:31:07.785285    1604 main.go:143] libmachine: &{{{<nil> 0 [] [] []} docker [0x11319e0] 0x1134500 <nil>  [] 0s} 127.0.0.1 51764 <nil> <nil>}

	I1109 14:31:07.785285    1604 main.go:143] libmachine: About to run SSH command:

	sudo hostname missing-upgrade-184300 && echo "missing-upgrade-184300" | sudo tee /etc/hostname

	I1109 14:31:07.963930    1604 main.go:143] libmachine: SSH cmd err, output: <nil>: missing-upgrade-184300

	I1109 14:31:07.970500    1604 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" missing-upgrade-184300

	I1109 14:31:08.033794    1604 main.go:143] libmachine: Using SSH client type: native

	I1109 14:31:08.034796    1604 main.go:143] libmachine: &{{{<nil> 0 [] [] []} docker [0x11319e0] 0x1134500 <nil>  [] 0s} 127.0.0.1 51764 <nil> <nil>}

	I1109 14:31:08.034796    1604 main.go:143] libmachine: About to run SSH command:

			if ! grep -xq '.*\smissing-upgrade-184300' /etc/hosts; then

				if grep -xq '127.0.1.1\s.*' /etc/hosts; then

					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 missing-upgrade-184300/g' /etc/hosts;

				else 

					echo '127.0.1.1 missing-upgrade-184300' | sudo tee -a /etc/hosts; 

				fi

			fi

	I1109 14:31:08.208732    1604 main.go:143] libmachine: SSH cmd err, output: <nil>: 

	I1109 14:31:08.208732    1604 ubuntu.go:188] set auth options {CertDir:C:\Users\jenkins.minikube4\minikube-integration\.minikube CaCertPath:C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\ca.pem CaPrivateKeyPath:C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:C:\Users\jenkins.minikube4\minikube-integration\.minikube\machines\server.pem ServerKeyPath:C:\Users\jenkins.minikube4\minikube-integration\.minikube\machines\server-key.pem ClientKeyPath:C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\cert.pem ServerCertSANs:[] StorePath:C:\Users\jenkins.minikube4\minikube-integration\.minikube}

	I1109 14:31:08.208732    1604 ubuntu.go:190] setting up certificates

	I1109 14:31:08.208732    1604 provision.go:84] configureAuth start

	I1109 14:31:08.214727    1604 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" missing-upgrade-184300

	I1109 14:31:08.278548    1604 provision.go:143] copyHostCerts

	I1109 14:31:08.278548    1604 exec_runner.go:144] found C:\Users\jenkins.minikube4\minikube-integration\.minikube/ca.pem, removing ...

	I1109 14:31:08.278548    1604 exec_runner.go:203] rm: C:\Users\jenkins.minikube4\minikube-integration\.minikube\ca.pem

	I1109 14:31:08.279269    1604 exec_runner.go:151] cp: C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\ca.pem --> C:\Users\jenkins.minikube4\minikube-integration\.minikube/ca.pem (1082 bytes)

	I1109 14:31:08.280011    1604 exec_runner.go:144] found C:\Users\jenkins.minikube4\minikube-integration\.minikube/cert.pem, removing ...

	I1109 14:31:08.280011    1604 exec_runner.go:203] rm: C:\Users\jenkins.minikube4\minikube-integration\.minikube\cert.pem

	I1109 14:31:08.280011    1604 exec_runner.go:151] cp: C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\cert.pem --> C:\Users\jenkins.minikube4\minikube-integration\.minikube/cert.pem (1123 bytes)

	I1109 14:31:08.281159    1604 exec_runner.go:144] found C:\Users\jenkins.minikube4\minikube-integration\.minikube/key.pem, removing ...

	I1109 14:31:08.281159    1604 exec_runner.go:203] rm: C:\Users\jenkins.minikube4\minikube-integration\.minikube\key.pem

	I1109 14:31:08.281159    1604 exec_runner.go:151] cp: C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\key.pem --> C:\Users\jenkins.minikube4\minikube-integration\.minikube/key.pem (1679 bytes)

	I1109 14:31:08.282019    1604 provision.go:117] generating server cert: C:\Users\jenkins.minikube4\minikube-integration\.minikube\machines\server.pem ca-key=C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\ca.pem private-key=C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\ca-key.pem org=jenkins.missing-upgrade-184300 san=[127.0.0.1 192.168.121.2 localhost minikube missing-upgrade-184300]

	I1109 14:31:08.780051    1604 provision.go:177] copyRemoteCerts

	I1109 14:31:08.789054    1604 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker

	I1109 14:31:08.795332    1604 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" missing-upgrade-184300

	I1109 14:31:08.852525    1604 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:51764 SSHKeyPath:C:\Users\jenkins.minikube4\minikube-integration\.minikube\machines\missing-upgrade-184300\id_rsa Username:docker}

	I1109 14:31:08.966378    1604 ssh_runner.go:362] scp C:\Users\jenkins.minikube4\minikube-integration\.minikube\machines\server-key.pem --> /etc/docker/server-key.pem (1675 bytes)

	I1109 14:31:09.005403    1604 ssh_runner.go:362] scp C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\ca.pem --> /etc/docker/ca.pem (1082 bytes)

	I1109 14:31:09.045759    1604 ssh_runner.go:362] scp C:\Users\jenkins.minikube4\minikube-integration\.minikube\machines\server.pem --> /etc/docker/server.pem (1233 bytes)

	I1109 14:31:09.096383    1604 provision.go:87] duration metric: took 887.6409ms to configureAuth

	I1109 14:31:09.096383    1604 ubuntu.go:206] setting minikube options for container-runtime

	I1109 14:31:09.097387    1604 config.go:182] Loaded profile config "missing-upgrade-184300": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.28.3

	I1109 14:31:09.106780    1604 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" missing-upgrade-184300

	I1109 14:31:09.161940    1604 main.go:143] libmachine: Using SSH client type: native

	I1109 14:31:09.161940    1604 main.go:143] libmachine: &{{{<nil> 0 [] [] []} docker [0x11319e0] 0x1134500 <nil>  [] 0s} 127.0.0.1 51764 <nil> <nil>}

	I1109 14:31:09.161940    1604 main.go:143] libmachine: About to run SSH command:

	df --output=fstype / | tail -n 1

	I1109 14:31:09.321177    1604 main.go:143] libmachine: SSH cmd err, output: <nil>: overlay

	I1109 14:31:09.321177    1604 ubuntu.go:71] root file system type: overlay

	I1109 14:31:09.321177    1604 provision.go:314] Updating docker unit: /lib/systemd/system/docker.service ...

	I1109 14:31:09.327344    1604 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" missing-upgrade-184300

	I1109 14:31:09.392762    1604 main.go:143] libmachine: Using SSH client type: native

	I1109 14:31:09.392952    1604 main.go:143] libmachine: &{{{<nil> 0 [] [] []} docker [0x11319e0] 0x1134500 <nil>  [] 0s} 127.0.0.1 51764 <nil> <nil>}

	I1109 14:31:09.393531    1604 main.go:143] libmachine: About to run SSH command:

	sudo mkdir -p /lib/systemd/system && printf %s "[Unit]

	Description=Docker Application Container Engine

	Documentation=https://docs.docker.com

	After=network-online.target nss-lookup.target docker.socket firewalld.service containerd.service time-set.target

	Wants=network-online.target containerd.service

	Requires=docker.socket

	StartLimitBurst=3

	StartLimitIntervalSec=60

	[Service]

	Type=notify

	Restart=always

	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	# The base configuration already specifies an 'ExecStart=...' command. The first directive

	# here is to clear out that command inherited from the base configuration. Without this,

	# the command from the base configuration and the command specified here are treated as

	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	# will catch this invalid input and refuse to start the service with an error like:

	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	ExecStart=

	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 \

		-H fd:// --containerd=/run/containerd/containerd.sock \

		-H unix:///var/run/docker.sock \

		--default-ulimit=nofile=1048576:1048576 \

		--tlsverify \

		--tlscacert /etc/docker/ca.pem \

		--tlscert /etc/docker/server.pem \

		--tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12 

	ExecReload=/bin/kill -s HUP \$MAINPID

	# Having non-zero Limit*s causes performance problems due to accounting overhead

	# in the kernel. We recommend using cgroups to do container-local accounting.

	LimitNOFILE=infinity

	LimitNPROC=infinity

	LimitCORE=infinity

	# Uncomment TasksMax if your systemd version supports it.

	# Only systemd 226 and above support this version.

	TasksMax=infinity

	TimeoutStartSec=0

	# set delegate yes so that systemd does not reset the cgroups of docker containers

	Delegate=yes

	# kill only the docker process, not all processes in the cgroup

	KillMode=process

	OOMScoreAdjust=-500

	[Install]

	WantedBy=multi-user.target

	" | sudo tee /lib/systemd/system/docker.service.new

	I1109 14:31:09.566749    1604 main.go:143] libmachine: SSH cmd err, output: <nil>: [Unit]

	Description=Docker Application Container Engine

	Documentation=https://docs.docker.com

	After=network-online.target nss-lookup.target docker.socket firewalld.service containerd.service time-set.target

	Wants=network-online.target containerd.service

	Requires=docker.socket

	StartLimitBurst=3

	StartLimitIntervalSec=60

	[Service]

	Type=notify

	Restart=always

	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	# The base configuration already specifies an 'ExecStart=...' command. The first directive

	# here is to clear out that command inherited from the base configuration. Without this,

	# the command from the base configuration and the command specified here are treated as

	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	# will catch this invalid input and refuse to start the service with an error like:

	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	ExecStart=

	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 	-H fd:// --containerd=/run/containerd/containerd.sock 	-H unix:///var/run/docker.sock 	--default-ulimit=nofile=1048576:1048576 	--tlsverify 	--tlscacert /etc/docker/ca.pem 	--tlscert /etc/docker/server.pem 	--tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12 

	ExecReload=/bin/kill -s HUP $MAINPID

	# Having non-zero Limit*s causes performance problems due to accounting overhead

	# in the kernel. We recommend using cgroups to do container-local accounting.

	LimitNOFILE=infinity

	LimitNPROC=infinity

	LimitCORE=infinity

	# Uncomment TasksMax if your systemd version supports it.

	# Only systemd 226 and above support this version.

	TasksMax=infinity

	TimeoutStartSec=0

	# set delegate yes so that systemd does not reset the cgroups of docker containers

	Delegate=yes

	# kill only the docker process, not all processes in the cgroup

	KillMode=process

	OOMScoreAdjust=-500

	[Install]

	WantedBy=multi-user.target

	I1109 14:31:09.575344    1604 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" missing-upgrade-184300

	I1109 14:31:09.633664    1604 main.go:143] libmachine: Using SSH client type: native

	I1109 14:31:09.633664    1604 main.go:143] libmachine: &{{{<nil> 0 [] [] []} docker [0x11319e0] 0x1134500 <nil>  [] 0s} 127.0.0.1 51764 <nil> <nil>}

	I1109 14:31:09.634672    1604 main.go:143] libmachine: About to run SSH command:

	sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }

	I1109 14:31:09.796597    1604 main.go:143] libmachine: SSH cmd err, output: <nil>: 

	I1109 14:31:09.796649    1604 machine.go:97] duration metric: took 2.3603038s to provisionDockerMachine

	I1109 14:31:09.796649    1604 start.go:293] postStartSetup for "missing-upgrade-184300" (driver="docker")

	I1109 14:31:09.796695    1604 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]

	I1109 14:31:09.804144    1604 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs

	I1109 14:31:09.809747    1604 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" missing-upgrade-184300

	I1109 14:31:09.873417    1604 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:51764 SSHKeyPath:C:\Users\jenkins.minikube4\minikube-integration\.minikube\machines\missing-upgrade-184300\id_rsa Username:docker}

	I1109 14:31:09.991967    1604 ssh_runner.go:195] Run: cat /etc/os-release

	I1109 14:31:10.002954    1604 main.go:143] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found

	I1109 14:31:10.002954    1604 main.go:143] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found

	I1109 14:31:10.002954    1604 main.go:143] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found

	I1109 14:31:10.002954    1604 info.go:137] Remote host: Ubuntu 22.04.3 LTS

	I1109 14:31:10.002954    1604 filesync.go:126] Scanning C:\Users\jenkins.minikube4\minikube-integration\.minikube\addons for local assets ...

	I1109 14:31:10.002954    1604 filesync.go:126] Scanning C:\Users\jenkins.minikube4\minikube-integration\.minikube\files for local assets ...

	I1109 14:31:10.003946    1604 filesync.go:149] local asset: C:\Users\jenkins.minikube4\minikube-integration\.minikube\files\etc\ssl\certs\103362.pem -> 103362.pem in /etc/ssl/certs

	I1109 14:31:10.010948    1604 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs

	I1109 14:31:10.024945    1604 ssh_runner.go:362] scp C:\Users\jenkins.minikube4\minikube-integration\.minikube\files\etc\ssl\certs\103362.pem --> /etc/ssl/certs/103362.pem (1708 bytes)

	I1109 14:31:10.061542    1604 start.go:296] duration metric: took 264.8895ms for postStartSetup

	I1109 14:31:10.070534    1604 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I1109 14:31:10.078814    1604 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" missing-upgrade-184300

	I1109 14:31:10.143625    1604 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:51764 SSHKeyPath:C:\Users\jenkins.minikube4\minikube-integration\.minikube\machines\missing-upgrade-184300\id_rsa Username:docker}

	I1109 14:31:10.258245    1604 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"

	I1109 14:31:10.273209    1604 fix.go:56] duration metric: took 2.9248117s for fixHost

	I1109 14:31:10.273209    1604 start.go:83] releasing machines lock for "missing-upgrade-184300", held for 2.924865s

	I1109 14:31:10.278616    1604 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" missing-upgrade-184300

	I1109 14:31:10.332617    1604 ssh_runner.go:195] Run: curl.exe -sS -m 2 https://registry.k8s.io/

	I1109 14:31:10.339624    1604 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" missing-upgrade-184300

	I1109 14:31:10.339624    1604 ssh_runner.go:195] Run: cat /version.json

	I1109 14:31:10.346613    1604 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" missing-upgrade-184300

	I1109 14:31:10.402610    1604 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:51764 SSHKeyPath:C:\Users\jenkins.minikube4\minikube-integration\.minikube\machines\missing-upgrade-184300\id_rsa Username:docker}

	I1109 14:31:10.403616    1604 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:51764 SSHKeyPath:C:\Users\jenkins.minikube4\minikube-integration\.minikube\machines\missing-upgrade-184300\id_rsa Username:docker}

	W1109 14:31:10.506524    1604 start.go:869] [curl.exe -sS -m 2 https://registry.k8s.io/] failed: curl.exe -sS -m 2 https://registry.k8s.io/: Process exited with status 127

	stdout:

	stderr:

	bash: line 1: curl.exe: command not found

	W1109 14:31:10.516986    1604 out.go:285] ! Image was not built for the current minikube version. To resolve this you can delete and recreate your minikube cluster using the latest images. Expected minikube version: v1.32.0 -> Actual minikube version: v1.37.0

	! Image was not built for the current minikube version. To resolve this you can delete and recreate your minikube cluster using the latest images. Expected minikube version: v1.32.0 -> Actual minikube version: v1.37.0

	I1109 14:31:10.526344    1604 ssh_runner.go:195] Run: systemctl --version

	I1109 14:31:10.544275    1604 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"

	I1109 14:31:10.562278    1604 ssh_runner.go:195] Run: sudo find \etc\cni\net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "grep -q loopback {} && ( grep -q name {} || sudo sed -i '/"type": "loopback"/i \ \ \ \ "name": "loopback",' {} ) && sudo sed -i 's|"cniVersion": ".*"|"cniVersion": "1.0.0"|g' {}" ;

	W1109 14:31:10.576613    1604 start.go:440] unable to name loopback interface in configureRuntimes: unable to patch loopback cni config "/etc/cni/net.d/*loopback.conf*": sudo find \etc\cni\net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "grep -q loopback {} && ( grep -q name {} || sudo sed -i '/"type": "loopback"/i \ \ \ \ "name": "loopback",' {} ) && sudo sed -i 's|"cniVersion": ".*"|"cniVersion": "1.0.0"|g' {}" ;: Process exited with status 1

	stdout:

	stderr:

	find: '\\etc\\cni\\net.d': No such file or directory

	I1109 14:31:10.587979    1604 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;

	W1109 14:31:10.617839    1604 out.go:285] ! Failing to connect to https://registry.k8s.io/ from inside the minikube container

	! Failing to connect to https://registry.k8s.io/ from inside the minikube container

	W1109 14:31:10.617839    1604 out.go:285] * To pull new external images, you may need to configure a proxy: https://minikube.sigs.k8s.io/docs/reference/networking/proxy/

	* To pull new external images, you may need to configure a proxy: https://minikube.sigs.k8s.io/docs/reference/networking/proxy/

	I1109 14:31:21.084937    1604 ssh_runner.go:235] Completed: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;: (10.4967742s)

	I1109 14:31:21.084984    1604 cni.go:262] disabled [/etc/cni/net.d/100-crio-bridge.conf, /etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)

	I1109 14:31:21.084984    1604 start.go:496] detecting cgroup driver to use...

	I1109 14:31:21.085056    1604 detect.go:187] detected "cgroupfs" cgroup driver on host os

	I1109 14:31:21.085221    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///run/containerd/containerd.sock

	" | sudo tee /etc/crictl.yaml"

	I1109 14:31:21.118198    1604 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.9"|' /etc/containerd/config.toml"

	I1109 14:31:21.144881    1604 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"

	I1109 14:31:21.165468    1604 containerd.go:146] configuring containerd to use "cgroupfs" as cgroup driver...

	I1109 14:31:21.175535    1604 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"

	I1109 14:31:21.197976    1604 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"

	I1109 14:31:21.220693    1604 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"

	I1109 14:31:21.271151    1604 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"

	I1109 14:31:21.296764    1604 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"

	I1109 14:31:21.492844    1604 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"

	I1109 14:31:21.519701    1604 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *enable_unprivileged_ports = .*/d' /etc/containerd/config.toml"

	I1109 14:31:21.544372    1604 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)\[plugins."io.containerd.grpc.v1.cri"\]|&\n\1  enable_unprivileged_ports = true|' /etc/containerd/config.toml"

	I1109 14:31:21.580294    1604 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables

	I1109 14:31:21.604225    1604 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"

	I1109 14:31:21.626431    1604 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I1109 14:31:21.772745    1604 ssh_runner.go:195] Run: sudo systemctl restart containerd

	I1109 14:31:21.928773    1604 start.go:496] detecting cgroup driver to use...

	I1109 14:31:21.928773    1604 detect.go:187] detected "cgroupfs" cgroup driver on host os

	I1109 14:31:21.937760    1604 ssh_runner.go:195] Run: sudo systemctl cat docker.service

	I1109 14:31:21.963763    1604 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I1109 14:31:21.988758    1604 ssh_runner.go:195] Run: sudo systemctl stop -f containerd

	I1109 14:31:22.068225    1604 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I1109 14:31:22.099468    1604 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio

	I1109 14:31:22.117441    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/cri-dockerd.sock

	" | sudo tee /etc/crictl.yaml"

	I1109 14:31:22.156758    1604 ssh_runner.go:195] Run: which cri-dockerd

	I1109 14:31:22.175773    1604 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/cri-docker.service.d

	I1109 14:31:22.190747    1604 ssh_runner.go:362] scp memory --> /etc/systemd/system/cri-docker.service.d/10-cni.conf (189 bytes)

	I1109 14:31:22.222754    1604 ssh_runner.go:195] Run: sudo systemctl unmask docker.service

	I1109 14:31:22.372459    1604 ssh_runner.go:195] Run: sudo systemctl enable docker.socket

	I1109 14:31:22.500138    1604 docker.go:575] configuring docker to use "cgroupfs" as cgroup driver...

	I1109 14:31:22.500138    1604 ssh_runner.go:362] scp memory --> /etc/docker/daemon.json (130 bytes)

	I1109 14:31:22.535129    1604 ssh_runner.go:195] Run: sudo systemctl reset-failed docker

	I1109 14:31:22.567711    1604 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I1109 14:31:22.750712    1604 ssh_runner.go:195] Run: sudo systemctl restart docker

	I1109 14:31:23.595781    1604 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker

	I1109 14:31:23.626983    1604 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service cri-docker.socket

	I1109 14:31:23.675504    1604 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service cri-docker.service

	I1109 14:31:23.704279    1604 ssh_runner.go:195] Run: sudo systemctl unmask cri-docker.socket

	I1109 14:31:23.847741    1604 ssh_runner.go:195] Run: sudo systemctl enable cri-docker.socket

	I1109 14:31:23.998240    1604 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I1109 14:31:24.141337    1604 ssh_runner.go:195] Run: sudo systemctl restart cri-docker.socket

	I1109 14:31:24.176905    1604 ssh_runner.go:195] Run: sudo systemctl reset-failed cri-docker.service

	I1109 14:31:24.202735    1604 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I1109 14:31:24.342960    1604 ssh_runner.go:195] Run: sudo systemctl restart cri-docker.service

	I1109 14:31:24.625358    1604 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service cri-docker.service

	I1109 14:31:24.643357    1604 start.go:543] Will wait 60s for socket path /var/run/cri-dockerd.sock

	I1109 14:31:24.653368    1604 ssh_runner.go:195] Run: stat /var/run/cri-dockerd.sock

	I1109 14:31:24.661357    1604 start.go:564] Will wait 60s for crictl version

	I1109 14:31:24.669375    1604 ssh_runner.go:195] Run: which crictl

	I1109 14:31:24.684378    1604 ssh_runner.go:195] Run: sudo /usr/bin/crictl version

	I1109 14:31:24.773351    1604 start.go:580] Version:  0.1.0

	RuntimeName:  docker

	RuntimeVersion:  24.0.7

	RuntimeApiVersion:  v1

	I1109 14:31:24.779352    1604 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}

	I1109 14:31:24.825351    1604 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}

	I1109 14:31:24.872352    1604 out.go:252] * Preparing Kubernetes v1.28.3 on Docker 24.0.7 ...

	I1109 14:31:24.878351    1604 cli_runner.go:164] Run: docker exec -t missing-upgrade-184300 dig +short host.docker.internal

	I1109 14:31:25.013367    1604 network.go:96] got host ip for mount in container by digging dns: 192.168.65.254

	I1109 14:31:25.023360    1604 ssh_runner.go:195] Run: grep 192.168.65.254	host.minikube.internal$ /etc/hosts

	I1109 14:31:25.031371    1604 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.65.254	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I1109 14:31:25.063362    1604 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "8443/tcp") 0).HostPort}}'" missing-upgrade-184300

	I1109 14:31:25.123356    1604 kubeadm.go:884] updating cluster {Name:missing-upgrade-184300 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.42@sha256:d35ac07dfda971cabee05e0deca8aeac772f885a5348e1a0c0b0a36db20fcfc0 Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.3 ClusterName:missing-upgrade-184300 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] AP

IServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.103.2 Port:8443 KubernetesVersion:v1.28.3 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s MountString:C:\Users\jenkins.minikube4:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmware

Path: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...

	I1109 14:31:25.123356    1604 preload.go:188] Checking if preload exists for k8s version v1.28.3 and runtime docker

	I1109 14:31:25.130368    1604 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}

	I1109 14:31:25.178358    1604 docker.go:691] Got preloaded images: -- stdout --

	registry.k8s.io/kube-apiserver:v1.28.3

	registry.k8s.io/kube-controller-manager:v1.28.3

	registry.k8s.io/kube-scheduler:v1.28.3

	registry.k8s.io/kube-proxy:v1.28.3

	registry.k8s.io/etcd:3.5.9-0

	registry.k8s.io/coredns/coredns:v1.10.1

	registry.k8s.io/pause:3.9

	gcr.io/k8s-minikube/storage-provisioner:v5

	-- /stdout --

	I1109 14:31:25.178358    1604 docker.go:621] Images already preloaded, skipping extraction

	I1109 14:31:25.183356    1604 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}

	I1109 14:31:25.213358    1604 docker.go:691] Got preloaded images: -- stdout --

	registry.k8s.io/kube-apiserver:v1.28.3

	registry.k8s.io/kube-controller-manager:v1.28.3

	registry.k8s.io/kube-scheduler:v1.28.3

	registry.k8s.io/kube-proxy:v1.28.3

	registry.k8s.io/etcd:3.5.9-0

	registry.k8s.io/coredns/coredns:v1.10.1

	registry.k8s.io/pause:3.9

	gcr.io/k8s-minikube/storage-provisioner:v5

	-- /stdout --

	I1109 14:31:25.213358    1604 cache_images.go:86] Images are preloaded, skipping loading

	I1109 14:31:25.213358    1604 kubeadm.go:935] updating node { 192.168.103.2 8443 v1.28.3 docker true true} ...

	I1109 14:31:25.213358    1604 kubeadm.go:947] kubelet [Unit]

	Wants=docker.socket

	[Service]

	ExecStart=

	ExecStart=/var/lib/minikube/binaries/v1.28.3/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=missing-upgrade-184300 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.103.2

	[Install]

	 config:

	{KubernetesVersion:v1.28.3 ClusterName:missing-upgrade-184300 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}

	I1109 14:31:25.219361    1604 ssh_runner.go:195] Run: docker info --format {{.CgroupDriver}}

	I1109 14:31:25.313363    1604 cni.go:84] Creating CNI manager for ""

	I1109 14:31:25.313363    1604 cni.go:158] "docker" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge

	I1109 14:31:25.313363    1604 kubeadm.go:85] Using pod CIDR: 10.244.0.0/16

	I1109 14:31:25.313363    1604 kubeadm.go:190] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.103.2 APIServerPort:8443 KubernetesVersion:v1.28.3 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:missing-upgrade-184300 NodeName:missing-upgrade-184300 DNSDomain:cluster.local CRISocket:/var/run/cri-dockerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.103.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.103.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt Sta

ticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///var/run/cri-dockerd.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}

	I1109 14:31:25.313363    1604 kubeadm.go:196] kubeadm config:

	apiVersion: kubeadm.k8s.io/v1beta3

	kind: InitConfiguration

	localAPIEndpoint:

	  advertiseAddress: 192.168.103.2

	  bindPort: 8443

	bootstrapTokens:

	  - groups:

	      - system:bootstrappers:kubeadm:default-node-token

	    ttl: 24h0m0s

	    usages:

	      - signing

	      - authentication

	nodeRegistration:

	  criSocket: unix:///var/run/cri-dockerd.sock

	  name: "missing-upgrade-184300"

	  kubeletExtraArgs:

	    node-ip: 192.168.103.2

	  taints: []

	---

	apiVersion: kubeadm.k8s.io/v1beta3

	kind: ClusterConfiguration

	apiServer:

	  certSANs: ["127.0.0.1", "localhost", "192.168.103.2"]

	  extraArgs:

	    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"

	controllerManager:

	  extraArgs:

	    allocate-node-cidrs: "true"

	    leader-elect: "false"

	scheduler:

	  extraArgs:

	    leader-elect: "false"

	certificatesDir: /var/lib/minikube/certs

	clusterName: mk

	controlPlaneEndpoint: control-plane.minikube.internal:8443

	etcd:

	  local:

	    dataDir: /var/lib/minikube/etcd

	    extraArgs:

	      proxy-refresh-interval: "70000"

	kubernetesVersion: v1.28.3

	networking:

	  dnsDomain: cluster.local

	  podSubnet: "10.244.0.0/16"

	  serviceSubnet: 10.96.0.0/12

	---

	apiVersion: kubelet.config.k8s.io/v1beta1

	kind: KubeletConfiguration

	authentication:

	  x509:

	    clientCAFile: /var/lib/minikube/certs/ca.crt

	cgroupDriver: cgroupfs

	containerRuntimeEndpoint: unix:///var/run/cri-dockerd.sock

	hairpinMode: hairpin-veth

	runtimeRequestTimeout: 15m

	clusterDomain: "cluster.local"

	# disable disk resource management by default

	imageGCHighThresholdPercent: 100

	evictionHard:

	  nodefs.available: "0%"

	  nodefs.inodesFree: "0%"

	  imagefs.available: "0%"

	failSwapOn: false

	staticPodPath: /etc/kubernetes/manifests

	---

	apiVersion: kubeproxy.config.k8s.io/v1alpha1

	kind: KubeProxyConfiguration

	clusterCIDR: "10.244.0.0/16"

	metricsBindAddress: 0.0.0.0:10249

	conntrack:

	  maxPerCore: 0

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"

	  tcpEstablishedTimeout: 0s

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"

	  tcpCloseWaitTimeout: 0s

	I1109 14:31:25.321357    1604 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.28.3

	I1109 14:31:25.336378    1604 binaries.go:51] Found k8s binaries, skipping transfer

	I1109 14:31:25.344376    1604 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube

	I1109 14:31:25.362377    1604 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (322 bytes)

	I1109 14:31:25.512837    1604 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)

	I1109 14:31:25.543127    1604 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2167 bytes)

	I1109 14:31:25.575126    1604 ssh_runner.go:195] Run: grep 192.168.103.2	control-plane.minikube.internal$ /etc/hosts

	I1109 14:31:25.582430    1604 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.103.2	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I1109 14:31:25.610162    1604 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I1109 14:31:25.737498    1604 ssh_runner.go:195] Run: sudo systemctl start kubelet

	I1109 14:31:25.757508    1604 certs.go:69] Setting up C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\missing-upgrade-184300 for IP: 192.168.103.2

	I1109 14:31:25.757508    1604 certs.go:195] generating shared ca certs ...

	I1109 14:31:25.758509    1604 certs.go:227] acquiring lock for ca certs: {Name:mk92285f7546e1a5b3c3b23dab6135aa5a99cd14 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1109 14:31:25.758509    1604 certs.go:236] skipping valid "minikubeCA" ca cert: C:\Users\jenkins.minikube4\minikube-integration\.minikube\ca.key

	I1109 14:31:25.758509    1604 certs.go:236] skipping valid "proxyClientCA" ca cert: C:\Users\jenkins.minikube4\minikube-integration\.minikube\proxy-client-ca.key

	I1109 14:31:25.758509    1604 certs.go:257] generating profile certs ...

	I1109 14:31:25.759501    1604 certs.go:360] skipping valid signed profile cert regeneration for "minikube-user": C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\missing-upgrade-184300\client.key

	I1109 14:31:25.759501    1604 certs.go:364] generating signed profile cert for "minikube": C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\missing-upgrade-184300\apiserver.key.fdb2592e

	I1109 14:31:25.759501    1604 crypto.go:68] Generating cert C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\missing-upgrade-184300\apiserver.crt.fdb2592e with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.103.2]

	I1109 14:31:25.926372    1604 crypto.go:156] Writing cert to C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\missing-upgrade-184300\apiserver.crt.fdb2592e ...

	I1109 14:31:25.926372    1604 lock.go:35] WriteFile acquiring C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\missing-upgrade-184300\apiserver.crt.fdb2592e: {Name:mk458ae50fbcd921fa223c0b069124d505ffe9d9 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1109 14:31:25.927251    1604 crypto.go:164] Writing key to C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\missing-upgrade-184300\apiserver.key.fdb2592e ...

	I1109 14:31:25.927251    1604 lock.go:35] WriteFile acquiring C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\missing-upgrade-184300\apiserver.key.fdb2592e: {Name:mk133cb75a6b83bdee4dd9e23bfcba5ad80c93c7 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1109 14:31:25.929111    1604 certs.go:382] copying C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\missing-upgrade-184300\apiserver.crt.fdb2592e -> C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\missing-upgrade-184300\apiserver.crt

	I1109 14:31:25.947869    1604 certs.go:386] copying C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\missing-upgrade-184300\apiserver.key.fdb2592e -> C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\missing-upgrade-184300\apiserver.key

	I1109 14:31:25.948982    1604 certs.go:360] skipping valid signed profile cert regeneration for "aggregator": C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\missing-upgrade-184300\proxy-client.key

	I1109 14:31:25.950705    1604 certs.go:484] found cert: C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\10336.pem (1338 bytes)

	W1109 14:31:25.950865    1604 certs.go:480] ignoring C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\10336_empty.pem, impossibly tiny 0 bytes

	I1109 14:31:25.950865    1604 certs.go:484] found cert: C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\ca-key.pem (1675 bytes)

	I1109 14:31:25.950865    1604 certs.go:484] found cert: C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\ca.pem (1082 bytes)

	I1109 14:31:25.951402    1604 certs.go:484] found cert: C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\cert.pem (1123 bytes)

	I1109 14:31:25.951580    1604 certs.go:484] found cert: C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\key.pem (1679 bytes)

	I1109 14:31:25.952021    1604 certs.go:484] found cert: C:\Users\jenkins.minikube4\minikube-integration\.minikube\files\etc\ssl\certs\103362.pem (1708 bytes)

	I1109 14:31:25.953404    1604 ssh_runner.go:362] scp C:\Users\jenkins.minikube4\minikube-integration\.minikube\ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)

	I1109 14:31:25.996673    1604 ssh_runner.go:362] scp C:\Users\jenkins.minikube4\minikube-integration\.minikube\ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)

	I1109 14:31:26.036716    1604 ssh_runner.go:362] scp C:\Users\jenkins.minikube4\minikube-integration\.minikube\proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)

	I1109 14:31:26.081613    1604 ssh_runner.go:362] scp C:\Users\jenkins.minikube4\minikube-integration\.minikube\proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)

	I1109 14:31:26.114615    1604 ssh_runner.go:362] scp C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\missing-upgrade-184300\apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)

	I1109 14:31:26.147776    1604 ssh_runner.go:362] scp C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\missing-upgrade-184300\apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)

	I1109 14:31:26.190792    1604 ssh_runner.go:362] scp C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\missing-upgrade-184300\proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)

	I1109 14:31:26.226776    1604 ssh_runner.go:362] scp C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\missing-upgrade-184300\proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)

	I1109 14:31:26.274820    1604 ssh_runner.go:362] scp C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\10336.pem --> /usr/share/ca-certificates/10336.pem (1338 bytes)

	I1109 14:31:26.314717    1604 ssh_runner.go:362] scp C:\Users\jenkins.minikube4\minikube-integration\.minikube\files\etc\ssl\certs\103362.pem --> /usr/share/ca-certificates/103362.pem (1708 bytes)

	I1109 14:31:26.353895    1604 ssh_runner.go:362] scp C:\Users\jenkins.minikube4\minikube-integration\.minikube\ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)

	I1109 14:31:26.399812    1604 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)

	I1109 14:31:26.450640    1604 ssh_runner.go:195] Run: openssl version

	I1109 14:31:26.468639    1604 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/103362.pem && ln -fs /usr/share/ca-certificates/103362.pem /etc/ssl/certs/103362.pem"

	I1109 14:31:26.492640    1604 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/103362.pem

	I1109 14:31:26.502863    1604 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Nov  9 13:39 /usr/share/ca-certificates/103362.pem

	I1109 14:31:26.510553    1604 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/103362.pem

	I1109 14:31:26.539576    1604 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/103362.pem /etc/ssl/certs/3ec20f2e.0"

	I1109 14:31:26.564862    1604 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"

	I1109 14:31:26.588869    1604 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem

	I1109 14:31:26.597885    1604 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Nov  9 13:31 /usr/share/ca-certificates/minikubeCA.pem

	I1109 14:31:26.608873    1604 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem

	I1109 14:31:26.625863    1604 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"

	I1109 14:31:26.650865    1604 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/10336.pem && ln -fs /usr/share/ca-certificates/10336.pem /etc/ssl/certs/10336.pem"

	I1109 14:31:26.674861    1604 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/10336.pem

	I1109 14:31:26.681862    1604 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Nov  9 13:39 /usr/share/ca-certificates/10336.pem

	I1109 14:31:26.687862    1604 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/10336.pem

	I1109 14:31:26.706260    1604 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/10336.pem /etc/ssl/certs/51391683.0"

	I1109 14:31:26.728549    1604 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt

	I1109 14:31:26.755350    1604 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-etcd-client.crt -checkend 86400

	I1109 14:31:26.776832    1604 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-kubelet-client.crt -checkend 86400

	I1109 14:31:26.800541    1604 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/server.crt -checkend 86400

	I1109 14:31:26.816578    1604 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/healthcheck-client.crt -checkend 86400

	I1109 14:31:26.841429    1604 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/peer.crt -checkend 86400

	I1109 14:31:26.859424    1604 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/front-proxy-client.crt -checkend 86400

	I1109 14:31:26.870425    1604 kubeadm.go:401] StartCluster: {Name:missing-upgrade-184300 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.42@sha256:d35ac07dfda971cabee05e0deca8aeac772f885a5348e1a0c0b0a36db20fcfc0 Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.3 ClusterName:missing-upgrade-184300 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APISe

rverIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.103.2 Port:8443 KubernetesVersion:v1.28.3 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s MountString:C:\Users\jenkins.minikube4:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePat

h: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I1109 14:31:26.875423    1604 ssh_runner.go:195] Run: docker ps --filter status=paused --filter=name=k8s_.*_(kube-system)_ --format={{.ID}}

	I1109 14:31:26.912321    1604 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd

	W1109 14:31:26.925889    1604 kubeadm.go:414] apiserver tunnel failed: apiserver port not set

	I1109 14:31:26.925926    1604 kubeadm.go:417] found existing configuration files, will attempt cluster restart

	I1109 14:31:26.925926    1604 kubeadm.go:598] restartPrimaryControlPlane start ...

	I1109 14:31:26.935064    1604 ssh_runner.go:195] Run: sudo test -d /data/minikube

	I1109 14:31:26.954966    1604 kubeadm.go:131] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1

	stdout:

	stderr:

	I1109 14:31:26.961492    1604 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "8443/tcp") 0).HostPort}}'" missing-upgrade-184300

	I1109 14:31:27.018234    1604 kubeconfig.go:125] found "missing-upgrade-184300" server: "https://127.0.0.1:51542"

	I1109 14:31:27.018287    1604 kubeconfig.go:47] verify endpoint returned: got: 127.0.0.1:51542, want: 127.0.0.1:51763

	I1109 14:31:27.018897    1604 kubeconfig.go:62] C:\Users\jenkins.minikube4\minikube-integration\kubeconfig needs updating (will repair): [kubeconfig needs server address update]

	I1109 14:31:27.020013    1604 lock.go:35] WriteFile acquiring C:\Users\jenkins.minikube4\minikube-integration\kubeconfig: {Name:mk97c09b788e5010ffd4c9dd9525f9245d5edd25 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1109 14:31:27.037540    1604 kapi.go:59] client config for missing-upgrade-184300: &rest.Config{Host:"https://127.0.0.1:51763", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"C:\\Users\\jenkins.minikube4\\minikube-integration\\.minikube\\profiles\\missing-upgrade-184300\\client.crt", KeyFile:"C:\\Users\\jenkins.minikube4\\minikube-integration\\.minikube\\profiles\\missing-upgrade-184300\\client.key", CAFile:"C:\\Users\\jenkins.minikube4\\minikube-integration\\.minikube\\ca.crt", CertData:[]uint8(nil), KeyData:[]

uint8(nil), CAData:[]uint8(nil), NextProtos:[]string(nil)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x30e6080), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), WarningHandlerWithContext:rest.WarningHandlerWithContext(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}

	I1109 14:31:27.038539    1604 envvar.go:172] "Feature gate default state" feature="ClientsAllowCBOR" enabled=false

	I1109 14:31:27.038539    1604 envvar.go:172] "Feature gate default state" feature="ClientsPreferCBOR" enabled=false

	I1109 14:31:27.038539    1604 envvar.go:172] "Feature gate default state" feature="InformerResourceVersion" enabled=false

	I1109 14:31:27.038539    1604 envvar.go:172] "Feature gate default state" feature="InOrderInformers" enabled=true

	I1109 14:31:27.038539    1604 envvar.go:172] "Feature gate default state" feature="WatchListClient" enabled=false

	I1109 14:31:27.045536    1604 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new

	I1109 14:31:27.063157    1604 kubeadm.go:645] detected kubeadm config drift (will reconfigure cluster from new /var/tmp/minikube/kubeadm.yaml):

	-- stdout --

	--- /var/tmp/minikube/kubeadm.yaml	2025-11-09 14:29:44.523872657 +0000

	+++ /var/tmp/minikube/kubeadm.yaml.new	2025-11-09 14:31:25.556093299 +0000

	@@ -50,6 +50,7 @@

	   x509:

	     clientCAFile: /var/lib/minikube/certs/ca.crt

	 cgroupDriver: cgroupfs

	+containerRuntimeEndpoint: unix:///var/run/cri-dockerd.sock

	 hairpinMode: hairpin-veth

	 runtimeRequestTimeout: 15m

	 clusterDomain: "cluster.local"

	-- /stdout --

	I1109 14:31:27.063157    1604 kubeadm.go:1161] stopping kube-system containers ...

	I1109 14:31:27.069301    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_.*_(kube-system)_ --format={{.ID}}

	I1109 14:31:27.102726    1604 docker.go:484] Stopping containers: [dcfa57dcafaf 06bbd18e7eee f5f64b2f8b66 b0b7529d23ff 67f5e9ab21d3 90b3c5d8d946 857f553dedee d608fc01fdeb]

	I1109 14:31:27.111628    1604 ssh_runner.go:195] Run: docker stop dcfa57dcafaf 06bbd18e7eee f5f64b2f8b66 b0b7529d23ff 67f5e9ab21d3 90b3c5d8d946 857f553dedee d608fc01fdeb

	I1109 14:31:27.158177    1604 ssh_runner.go:195] Run: sudo systemctl stop kubelet

	I1109 14:31:27.186990    1604 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf

	I1109 14:31:27.202507    1604 kubeadm.go:156] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2

	stdout:

	stderr:

	ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory

	I1109 14:31:27.202507    1604 kubeadm.go:158] found existing configuration files:

	I1109 14:31:27.209952    1604 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:0 /etc/kubernetes/admin.conf

	I1109 14:31:27.224043    1604 kubeadm.go:164] "https://control-plane.minikube.internal:0" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:0 /etc/kubernetes/admin.conf: Process exited with status 2

	stdout:

	stderr:

	grep: /etc/kubernetes/admin.conf: No such file or directory

	I1109 14:31:27.230043    1604 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf

	I1109 14:31:27.250042    1604 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:0 /etc/kubernetes/kubelet.conf

	I1109 14:31:27.264046    1604 kubeadm.go:164] "https://control-plane.minikube.internal:0" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:0 /etc/kubernetes/kubelet.conf: Process exited with status 2

	stdout:

	stderr:

	grep: /etc/kubernetes/kubelet.conf: No such file or directory

	I1109 14:31:27.270049    1604 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf

	I1109 14:31:27.291043    1604 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:0 /etc/kubernetes/controller-manager.conf

	I1109 14:31:27.305053    1604 kubeadm.go:164] "https://control-plane.minikube.internal:0" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:0 /etc/kubernetes/controller-manager.conf: Process exited with status 2

	stdout:

	stderr:

	grep: /etc/kubernetes/controller-manager.conf: No such file or directory

	I1109 14:31:27.312049    1604 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf

	I1109 14:31:27.334045    1604 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:0 /etc/kubernetes/scheduler.conf

	I1109 14:31:27.348052    1604 kubeadm.go:164] "https://control-plane.minikube.internal:0" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:0 /etc/kubernetes/scheduler.conf: Process exited with status 2

	stdout:

	stderr:

	grep: /etc/kubernetes/scheduler.conf: No such file or directory

	I1109 14:31:27.354049    1604 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf

	I1109 14:31:27.375045    1604 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml

	I1109 14:31:27.396044    1604 ssh_runner.go:195] Run: sudo /bin/bash -c "env PATH="/var/lib/minikube/binaries/v1.28.3:$PATH" kubeadm init phase certs all --config /var/tmp/minikube/kubeadm.yaml"

	I1109 14:31:27.477051    1604 ssh_runner.go:195] Run: sudo /bin/bash -c "env PATH="/var/lib/minikube/binaries/v1.28.3:$PATH" kubeadm init phase kubeconfig all --config /var/tmp/minikube/kubeadm.yaml"

	I1109 14:31:29.232542    1604 ssh_runner.go:235] Completed: sudo /bin/bash -c "env PATH="/var/lib/minikube/binaries/v1.28.3:$PATH" kubeadm init phase kubeconfig all --config /var/tmp/minikube/kubeadm.yaml": (1.7554711s)

	I1109 14:31:29.241535    1604 ssh_runner.go:195] Run: sudo /bin/bash -c "env PATH="/var/lib/minikube/binaries/v1.28.3:$PATH" kubeadm init phase kubelet-start --config /var/tmp/minikube/kubeadm.yaml"

	I1109 14:31:29.496157    1604 ssh_runner.go:195] Run: sudo /bin/bash -c "env PATH="/var/lib/minikube/binaries/v1.28.3:$PATH" kubeadm init phase control-plane all --config /var/tmp/minikube/kubeadm.yaml"

	I1109 14:31:29.603186    1604 ssh_runner.go:195] Run: sudo /bin/bash -c "env PATH="/var/lib/minikube/binaries/v1.28.3:$PATH" kubeadm init phase etcd local --config /var/tmp/minikube/kubeadm.yaml"

	I1109 14:31:29.729974    1604 api_server.go:52] waiting for apiserver process to appear ...

	I1109 14:31:29.741540    1604 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I1109 14:31:30.242716    1604 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I1109 14:31:30.738656    1604 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I1109 14:31:31.237623    1604 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I1109 14:31:31.741354    1604 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I1109 14:31:31.830811    1604 api_server.go:72] duration metric: took 2.1007222s to wait for apiserver process to appear ...

	I1109 14:31:31.830889    1604 api_server.go:88] waiting for apiserver healthz status ...

	I1109 14:31:31.830939    1604 api_server.go:253] Checking apiserver healthz at https://127.0.0.1:51763/healthz ...

	I1109 14:31:31.834255    1604 api_server.go:269] stopped: https://127.0.0.1:51763/healthz: Get "https://127.0.0.1:51763/healthz": EOF

	I1109 14:31:32.331230    1604 api_server.go:253] Checking apiserver healthz at https://127.0.0.1:51763/healthz ...

	I1109 14:31:37.332470    1604 api_server.go:269] stopped: https://127.0.0.1:51763/healthz: Get "https://127.0.0.1:51763/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

	I1109 14:31:37.332470    1604 api_server.go:253] Checking apiserver healthz at https://127.0.0.1:51763/healthz ...

	I1109 14:31:42.332773    1604 api_server.go:269] stopped: https://127.0.0.1:51763/healthz: Get "https://127.0.0.1:51763/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

	I1109 14:31:42.332773    1604 api_server.go:253] Checking apiserver healthz at https://127.0.0.1:51763/healthz ...

	I1109 14:31:47.333890    1604 api_server.go:269] stopped: https://127.0.0.1:51763/healthz: Get "https://127.0.0.1:51763/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

	I1109 14:31:47.333890    1604 api_server.go:253] Checking apiserver healthz at https://127.0.0.1:51763/healthz ...

	I1109 14:31:52.334734    1604 api_server.go:269] stopped: https://127.0.0.1:51763/healthz: Get "https://127.0.0.1:51763/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

	I1109 14:31:52.334734    1604 api_server.go:253] Checking apiserver healthz at https://127.0.0.1:51763/healthz ...

	I1109 14:31:52.953055    1604 api_server.go:269] stopped: https://127.0.0.1:51763/healthz: Get "https://127.0.0.1:51763/healthz": EOF

	I1109 14:31:52.953055    1604 api_server.go:253] Checking apiserver healthz at https://127.0.0.1:51763/healthz ...

	I1109 14:31:52.956595    1604 api_server.go:269] stopped: https://127.0.0.1:51763/healthz: Get "https://127.0.0.1:51763/healthz": EOF

	I1109 14:31:53.332159    1604 api_server.go:253] Checking apiserver healthz at https://127.0.0.1:51763/healthz ...

	I1109 14:31:53.335657    1604 api_server.go:269] stopped: https://127.0.0.1:51763/healthz: Get "https://127.0.0.1:51763/healthz": EOF

	I1109 14:31:53.832085    1604 api_server.go:253] Checking apiserver healthz at https://127.0.0.1:51763/healthz ...

	I1109 14:31:53.836188    1604 api_server.go:269] stopped: https://127.0.0.1:51763/healthz: Get "https://127.0.0.1:51763/healthz": EOF

	I1109 14:31:54.332154    1604 api_server.go:253] Checking apiserver healthz at https://127.0.0.1:51763/healthz ...

	I1109 14:31:54.334687    1604 api_server.go:269] stopped: https://127.0.0.1:51763/healthz: Get "https://127.0.0.1:51763/healthz": EOF

	I1109 14:31:54.831889    1604 api_server.go:253] Checking apiserver healthz at https://127.0.0.1:51763/healthz ...

	I1109 14:31:54.835184    1604 api_server.go:269] stopped: https://127.0.0.1:51763/healthz: Get "https://127.0.0.1:51763/healthz": EOF

	I1109 14:31:55.331973    1604 api_server.go:253] Checking apiserver healthz at https://127.0.0.1:51763/healthz ...

	I1109 14:31:55.334851    1604 api_server.go:269] stopped: https://127.0.0.1:51763/healthz: Get "https://127.0.0.1:51763/healthz": EOF

	I1109 14:31:55.832210    1604 api_server.go:253] Checking apiserver healthz at https://127.0.0.1:51763/healthz ...

	I1109 14:31:55.835414    1604 api_server.go:269] stopped: https://127.0.0.1:51763/healthz: Get "https://127.0.0.1:51763/healthz": EOF

	I1109 14:31:56.331401    1604 api_server.go:253] Checking apiserver healthz at https://127.0.0.1:51763/healthz ...

	I1109 14:31:56.333080    1604 api_server.go:269] stopped: https://127.0.0.1:51763/healthz: Get "https://127.0.0.1:51763/healthz": EOF

	I1109 14:31:56.832762    1604 api_server.go:253] Checking apiserver healthz at https://127.0.0.1:51763/healthz ...

	I1109 14:31:56.836298    1604 api_server.go:269] stopped: https://127.0.0.1:51763/healthz: Get "https://127.0.0.1:51763/healthz": EOF

	I1109 14:31:57.332235    1604 api_server.go:253] Checking apiserver healthz at https://127.0.0.1:51763/healthz ...

	I1109 14:31:57.334251    1604 api_server.go:269] stopped: https://127.0.0.1:51763/healthz: Get "https://127.0.0.1:51763/healthz": EOF

	I1109 14:31:57.832117    1604 api_server.go:253] Checking apiserver healthz at https://127.0.0.1:51763/healthz ...

	I1109 14:31:57.834603    1604 api_server.go:269] stopped: https://127.0.0.1:51763/healthz: Get "https://127.0.0.1:51763/healthz": EOF

	I1109 14:31:58.331988    1604 api_server.go:253] Checking apiserver healthz at https://127.0.0.1:51763/healthz ...

	I1109 14:31:58.334984    1604 api_server.go:269] stopped: https://127.0.0.1:51763/healthz: Get "https://127.0.0.1:51763/healthz": EOF

	I1109 14:31:58.832340    1604 api_server.go:253] Checking apiserver healthz at https://127.0.0.1:51763/healthz ...

	I1109 14:31:58.835323    1604 api_server.go:269] stopped: https://127.0.0.1:51763/healthz: Get "https://127.0.0.1:51763/healthz": EOF

	I1109 14:31:59.331925    1604 api_server.go:253] Checking apiserver healthz at https://127.0.0.1:51763/healthz ...

	I1109 14:31:59.333936    1604 api_server.go:269] stopped: https://127.0.0.1:51763/healthz: Get "https://127.0.0.1:51763/healthz": EOF

	I1109 14:31:59.832640    1604 api_server.go:253] Checking apiserver healthz at https://127.0.0.1:51763/healthz ...

	I1109 14:31:59.834629    1604 api_server.go:269] stopped: https://127.0.0.1:51763/healthz: Get "https://127.0.0.1:51763/healthz": EOF

	I1109 14:32:00.332982    1604 api_server.go:253] Checking apiserver healthz at https://127.0.0.1:51763/healthz ...

	I1109 14:32:00.335473    1604 api_server.go:269] stopped: https://127.0.0.1:51763/healthz: Get "https://127.0.0.1:51763/healthz": EOF

	I1109 14:32:00.832085    1604 api_server.go:253] Checking apiserver healthz at https://127.0.0.1:51763/healthz ...

	I1109 14:32:00.834091    1604 api_server.go:269] stopped: https://127.0.0.1:51763/healthz: Get "https://127.0.0.1:51763/healthz": EOF

	I1109 14:32:01.332414    1604 api_server.go:253] Checking apiserver healthz at https://127.0.0.1:51763/healthz ...

	I1109 14:32:01.334421    1604 api_server.go:269] stopped: https://127.0.0.1:51763/healthz: Get "https://127.0.0.1:51763/healthz": EOF

	I1109 14:32:01.832135    1604 api_server.go:253] Checking apiserver healthz at https://127.0.0.1:51763/healthz ...

	I1109 14:32:01.834142    1604 api_server.go:269] stopped: https://127.0.0.1:51763/healthz: Get "https://127.0.0.1:51763/healthz": EOF

	I1109 14:32:02.332307    1604 api_server.go:253] Checking apiserver healthz at https://127.0.0.1:51763/healthz ...

	I1109 14:32:02.336048    1604 api_server.go:269] stopped: https://127.0.0.1:51763/healthz: Get "https://127.0.0.1:51763/healthz": EOF

	I1109 14:32:02.831505    1604 api_server.go:253] Checking apiserver healthz at https://127.0.0.1:51763/healthz ...

	I1109 14:32:02.833521    1604 api_server.go:269] stopped: https://127.0.0.1:51763/healthz: Get "https://127.0.0.1:51763/healthz": EOF

	I1109 14:32:03.331962    1604 api_server.go:253] Checking apiserver healthz at https://127.0.0.1:51763/healthz ...

	I1109 14:32:03.333944    1604 api_server.go:269] stopped: https://127.0.0.1:51763/healthz: Get "https://127.0.0.1:51763/healthz": EOF

	I1109 14:32:03.831903    1604 api_server.go:253] Checking apiserver healthz at https://127.0.0.1:51763/healthz ...

	I1109 14:32:03.834073    1604 api_server.go:269] stopped: https://127.0.0.1:51763/healthz: Get "https://127.0.0.1:51763/healthz": EOF

	I1109 14:32:04.331665    1604 api_server.go:253] Checking apiserver healthz at https://127.0.0.1:51763/healthz ...

	I1109 14:32:09.331926    1604 api_server.go:269] stopped: https://127.0.0.1:51763/healthz: Get "https://127.0.0.1:51763/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

	I1109 14:32:09.332030    1604 api_server.go:253] Checking apiserver healthz at https://127.0.0.1:51763/healthz ...

	I1109 14:32:14.333618    1604 api_server.go:269] stopped: https://127.0.0.1:51763/healthz: Get "https://127.0.0.1:51763/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

	I1109 14:32:14.333618    1604 api_server.go:253] Checking apiserver healthz at https://127.0.0.1:51763/healthz ...

	I1109 14:32:19.334119    1604 api_server.go:269] stopped: https://127.0.0.1:51763/healthz: Get "https://127.0.0.1:51763/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

	I1109 14:32:19.334119    1604 api_server.go:253] Checking apiserver healthz at https://127.0.0.1:51763/healthz ...

	I1109 14:32:24.100869    1604 api_server.go:269] stopped: https://127.0.0.1:51763/healthz: Get "https://127.0.0.1:51763/healthz": EOF

	I1109 14:32:24.100869    1604 api_server.go:253] Checking apiserver healthz at https://127.0.0.1:51763/healthz ...

	I1109 14:32:24.104811    1604 api_server.go:269] stopped: https://127.0.0.1:51763/healthz: Get "https://127.0.0.1:51763/healthz": EOF

	I1109 14:32:24.332367    1604 api_server.go:253] Checking apiserver healthz at https://127.0.0.1:51763/healthz ...

	I1109 14:32:24.335760    1604 api_server.go:269] stopped: https://127.0.0.1:51763/healthz: Get "https://127.0.0.1:51763/healthz": EOF

	I1109 14:32:24.831845    1604 api_server.go:253] Checking apiserver healthz at https://127.0.0.1:51763/healthz ...

	I1109 14:32:24.836226    1604 api_server.go:269] stopped: https://127.0.0.1:51763/healthz: Get "https://127.0.0.1:51763/healthz": EOF

	I1109 14:32:25.332221    1604 api_server.go:253] Checking apiserver healthz at https://127.0.0.1:51763/healthz ...

	I1109 14:32:25.335653    1604 api_server.go:269] stopped: https://127.0.0.1:51763/healthz: Get "https://127.0.0.1:51763/healthz": EOF

	I1109 14:32:25.832346    1604 api_server.go:253] Checking apiserver healthz at https://127.0.0.1:51763/healthz ...

	I1109 14:32:25.834921    1604 api_server.go:269] stopped: https://127.0.0.1:51763/healthz: Get "https://127.0.0.1:51763/healthz": EOF

	I1109 14:32:26.332208    1604 api_server.go:253] Checking apiserver healthz at https://127.0.0.1:51763/healthz ...

	I1109 14:32:26.336176    1604 api_server.go:269] stopped: https://127.0.0.1:51763/healthz: Get "https://127.0.0.1:51763/healthz": EOF

	I1109 14:32:26.832498    1604 api_server.go:253] Checking apiserver healthz at https://127.0.0.1:51763/healthz ...

	I1109 14:32:26.835708    1604 api_server.go:269] stopped: https://127.0.0.1:51763/healthz: Get "https://127.0.0.1:51763/healthz": EOF

	I1109 14:32:27.332535    1604 api_server.go:253] Checking apiserver healthz at https://127.0.0.1:51763/healthz ...

	I1109 14:32:27.336765    1604 api_server.go:269] stopped: https://127.0.0.1:51763/healthz: Get "https://127.0.0.1:51763/healthz": EOF

	I1109 14:32:27.831995    1604 api_server.go:253] Checking apiserver healthz at https://127.0.0.1:51763/healthz ...

	I1109 14:32:27.835327    1604 api_server.go:269] stopped: https://127.0.0.1:51763/healthz: Get "https://127.0.0.1:51763/healthz": EOF

	I1109 14:32:28.331736    1604 api_server.go:253] Checking apiserver healthz at https://127.0.0.1:51763/healthz ...

	I1109 14:32:28.334981    1604 api_server.go:269] stopped: https://127.0.0.1:51763/healthz: Get "https://127.0.0.1:51763/healthz": EOF

	I1109 14:32:28.832842    1604 api_server.go:253] Checking apiserver healthz at https://127.0.0.1:51763/healthz ...

	I1109 14:32:28.836449    1604 api_server.go:269] stopped: https://127.0.0.1:51763/healthz: Get "https://127.0.0.1:51763/healthz": EOF

	I1109 14:32:29.332043    1604 api_server.go:253] Checking apiserver healthz at https://127.0.0.1:51763/healthz ...

	I1109 14:32:29.335057    1604 api_server.go:269] stopped: https://127.0.0.1:51763/healthz: Get "https://127.0.0.1:51763/healthz": EOF

	I1109 14:32:29.831982    1604 api_server.go:253] Checking apiserver healthz at https://127.0.0.1:51763/healthz ...

	I1109 14:32:29.834773    1604 api_server.go:269] stopped: https://127.0.0.1:51763/healthz: Get "https://127.0.0.1:51763/healthz": EOF

	I1109 14:32:30.332401    1604 api_server.go:253] Checking apiserver healthz at https://127.0.0.1:51763/healthz ...

	I1109 14:32:30.336278    1604 api_server.go:269] stopped: https://127.0.0.1:51763/healthz: Get "https://127.0.0.1:51763/healthz": EOF

	I1109 14:32:30.831723    1604 api_server.go:253] Checking apiserver healthz at https://127.0.0.1:51763/healthz ...

	I1109 14:32:30.835318    1604 api_server.go:269] stopped: https://127.0.0.1:51763/healthz: Get "https://127.0.0.1:51763/healthz": EOF

	I1109 14:32:31.331766    1604 api_server.go:253] Checking apiserver healthz at https://127.0.0.1:51763/healthz ...

	I1109 14:32:31.335358    1604 api_server.go:269] stopped: https://127.0.0.1:51763/healthz: Get "https://127.0.0.1:51763/healthz": EOF

	I1109 14:32:31.841052    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}

	I1109 14:32:31.881498    1604 logs.go:282] 1 containers: [3b408642cd69]

	I1109 14:32:31.889309    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}

	I1109 14:32:31.920648    1604 logs.go:282] 1 containers: [348147c99d77]

	I1109 14:32:31.927708    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}

	I1109 14:32:31.959150    1604 logs.go:282] 0 containers: []

	W1109 14:32:31.959150    1604 logs.go:284] No container was found matching "coredns"

	I1109 14:32:31.966063    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}

	I1109 14:32:31.997469    1604 logs.go:282] 2 containers: [c1fa8e945752 dcfa57dcafaf]

	I1109 14:32:32.004053    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}

	I1109 14:32:32.047237    1604 logs.go:282] 0 containers: []

	W1109 14:32:32.047237    1604 logs.go:284] No container was found matching "kube-proxy"

	I1109 14:32:32.055564    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}

	I1109 14:32:32.088418    1604 logs.go:282] 2 containers: [25752fe0c294 b0b7529d23ff]

	I1109 14:32:32.094186    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}

	I1109 14:32:32.126237    1604 logs.go:282] 0 containers: []

	W1109 14:32:32.126237    1604 logs.go:284] No container was found matching "kindnet"

	I1109 14:32:32.133165    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}

	I1109 14:32:32.163341    1604 logs.go:282] 0 containers: []

	W1109 14:32:32.163393    1604 logs.go:284] No container was found matching "storage-provisioner"

	I1109 14:32:32.163393    1604 logs.go:123] Gathering logs for kube-apiserver [3b408642cd69] ...

	I1109 14:32:32.163487    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 3b408642cd69"

	I1109 14:32:32.205463    1604 logs.go:123] Gathering logs for kube-controller-manager [25752fe0c294] ...

	I1109 14:32:32.205504    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 25752fe0c294"

	I1109 14:32:32.237196    1604 logs.go:123] Gathering logs for container status ...

	I1109 14:32:32.237276    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"

	I1109 14:32:32.319575    1604 logs.go:123] Gathering logs for etcd [348147c99d77] ...

	I1109 14:32:32.319652    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 348147c99d77"

	I1109 14:32:32.357516    1604 logs.go:123] Gathering logs for kube-scheduler [c1fa8e945752] ...

	I1109 14:32:32.357516    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c1fa8e945752"

	I1109 14:32:32.391465    1604 logs.go:123] Gathering logs for kube-scheduler [dcfa57dcafaf] ...

	I1109 14:32:32.391465    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 dcfa57dcafaf"

	I1109 14:32:32.432189    1604 logs.go:123] Gathering logs for kube-controller-manager [b0b7529d23ff] ...

	I1109 14:32:32.432189    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b0b7529d23ff"

	I1109 14:32:32.471578    1604 logs.go:123] Gathering logs for Docker ...

	I1109 14:32:32.471659    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"

	I1109 14:32:32.501652    1604 logs.go:123] Gathering logs for kubelet ...

	I1109 14:32:32.501652    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"

	I1109 14:32:32.568630    1604 logs.go:123] Gathering logs for dmesg ...

	I1109 14:32:32.568630    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"

	I1109 14:32:32.597337    1604 logs.go:123] Gathering logs for describe nodes ...

	I1109 14:32:32.597337    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"

	W1109 14:32:32.686932    1604 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1

	stdout:

	stderr:

	E1109 14:32:32.678335    3148 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:32:32.679202    3148 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:32:32.681890    3148 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:32:32.683146    3148 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:32:32.684774    3148 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	 output: 

	** stderr ** 

	E1109 14:32:32.678335    3148 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:32:32.679202    3148 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:32:32.681890    3148 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:32:32.683146    3148 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:32:32.684774    3148 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	** /stderr **

	I1109 14:32:35.187285    1604 api_server.go:253] Checking apiserver healthz at https://127.0.0.1:51763/healthz ...

	I1109 14:32:35.191311    1604 api_server.go:269] stopped: https://127.0.0.1:51763/healthz: Get "https://127.0.0.1:51763/healthz": EOF

	I1109 14:32:35.197913    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}

	I1109 14:32:35.229756    1604 logs.go:282] 1 containers: [3b408642cd69]

	I1109 14:32:35.236039    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}

	I1109 14:32:35.267534    1604 logs.go:282] 1 containers: [348147c99d77]

	I1109 14:32:35.274108    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}

	I1109 14:32:35.305960    1604 logs.go:282] 0 containers: []

	W1109 14:32:35.305960    1604 logs.go:284] No container was found matching "coredns"

	I1109 14:32:35.312314    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}

	I1109 14:32:35.343933    1604 logs.go:282] 2 containers: [c1fa8e945752 dcfa57dcafaf]

	I1109 14:32:35.350745    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}

	I1109 14:32:35.388915    1604 logs.go:282] 0 containers: []

	W1109 14:32:35.388915    1604 logs.go:284] No container was found matching "kube-proxy"

	I1109 14:32:35.394907    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}

	I1109 14:32:35.426910    1604 logs.go:282] 2 containers: [25752fe0c294 b0b7529d23ff]

	I1109 14:32:35.431916    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}

	I1109 14:32:35.460904    1604 logs.go:282] 0 containers: []

	W1109 14:32:35.460904    1604 logs.go:284] No container was found matching "kindnet"

	I1109 14:32:35.466910    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}

	I1109 14:32:35.496022    1604 logs.go:282] 0 containers: []

	W1109 14:32:35.496022    1604 logs.go:284] No container was found matching "storage-provisioner"

	I1109 14:32:35.496022    1604 logs.go:123] Gathering logs for dmesg ...

	I1109 14:32:35.496022    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"

	I1109 14:32:35.521026    1604 logs.go:123] Gathering logs for describe nodes ...

	I1109 14:32:35.521026    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"

	W1109 14:32:35.625801    1604 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1

	stdout:

	stderr:

	E1109 14:32:35.606851    3247 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:32:35.608736    3247 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:32:35.610417    3247 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:32:35.612254    3247 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:32:35.613741    3247 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	 output: 

	** stderr ** 

	E1109 14:32:35.606851    3247 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:32:35.608736    3247 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:32:35.610417    3247 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:32:35.612254    3247 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:32:35.613741    3247 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	** /stderr **

	I1109 14:32:35.625801    1604 logs.go:123] Gathering logs for etcd [348147c99d77] ...

	I1109 14:32:35.625801    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 348147c99d77"

	I1109 14:32:35.670230    1604 logs.go:123] Gathering logs for kube-scheduler [c1fa8e945752] ...

	I1109 14:32:35.670230    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c1fa8e945752"

	I1109 14:32:35.709159    1604 logs.go:123] Gathering logs for kube-scheduler [dcfa57dcafaf] ...

	I1109 14:32:35.709159    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 dcfa57dcafaf"

	I1109 14:32:35.757970    1604 logs.go:123] Gathering logs for Docker ...

	I1109 14:32:35.757970    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"

	I1109 14:32:35.790280    1604 logs.go:123] Gathering logs for kubelet ...

	I1109 14:32:35.790316    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"

	I1109 14:32:35.860504    1604 logs.go:123] Gathering logs for kube-apiserver [3b408642cd69] ...

	I1109 14:32:35.860504    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 3b408642cd69"

	I1109 14:32:35.914233    1604 logs.go:123] Gathering logs for kube-controller-manager [25752fe0c294] ...

	I1109 14:32:35.914233    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 25752fe0c294"

	I1109 14:32:35.955902    1604 logs.go:123] Gathering logs for kube-controller-manager [b0b7529d23ff] ...

	I1109 14:32:35.955902    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b0b7529d23ff"

	I1109 14:32:35.994901    1604 logs.go:123] Gathering logs for container status ...

	I1109 14:32:35.994901    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"

	I1109 14:32:38.588821    1604 api_server.go:253] Checking apiserver healthz at https://127.0.0.1:51763/healthz ...

	I1109 14:32:38.592098    1604 api_server.go:269] stopped: https://127.0.0.1:51763/healthz: Get "https://127.0.0.1:51763/healthz": EOF

	I1109 14:32:38.598518    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}

	I1109 14:32:38.631033    1604 logs.go:282] 1 containers: [3b408642cd69]

	I1109 14:32:38.639643    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}

	I1109 14:32:38.677462    1604 logs.go:282] 1 containers: [348147c99d77]

	I1109 14:32:38.683698    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}

	I1109 14:32:38.712859    1604 logs.go:282] 0 containers: []

	W1109 14:32:38.712859    1604 logs.go:284] No container was found matching "coredns"

	I1109 14:32:38.720677    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}

	I1109 14:32:38.753687    1604 logs.go:282] 2 containers: [c1fa8e945752 dcfa57dcafaf]

	I1109 14:32:38.763063    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}

	I1109 14:32:38.792728    1604 logs.go:282] 0 containers: []

	W1109 14:32:38.792728    1604 logs.go:284] No container was found matching "kube-proxy"

	I1109 14:32:38.803398    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}

	I1109 14:32:38.836913    1604 logs.go:282] 2 containers: [25752fe0c294 b0b7529d23ff]

	I1109 14:32:38.844588    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}

	I1109 14:32:38.878946    1604 logs.go:282] 0 containers: []

	W1109 14:32:38.878946    1604 logs.go:284] No container was found matching "kindnet"

	I1109 14:32:38.884933    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}

	I1109 14:32:38.913225    1604 logs.go:282] 0 containers: []

	W1109 14:32:38.913225    1604 logs.go:284] No container was found matching "storage-provisioner"

	I1109 14:32:38.913225    1604 logs.go:123] Gathering logs for kube-scheduler [dcfa57dcafaf] ...

	I1109 14:32:38.913225    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 dcfa57dcafaf"

	I1109 14:32:38.959992    1604 logs.go:123] Gathering logs for container status ...

	I1109 14:32:38.959992    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"

	I1109 14:32:39.046279    1604 logs.go:123] Gathering logs for describe nodes ...

	I1109 14:32:39.046279    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"

	W1109 14:32:39.136674    1604 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1

	stdout:

	stderr:

	E1109 14:32:39.122856    3446 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:32:39.123731    3446 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:32:39.126188    3446 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:32:39.127000    3446 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:32:39.128509    3446 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	 output: 

	** stderr ** 

	E1109 14:32:39.122856    3446 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:32:39.123731    3446 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:32:39.126188    3446 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:32:39.127000    3446 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:32:39.128509    3446 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	** /stderr **

	I1109 14:32:39.136674    1604 logs.go:123] Gathering logs for kube-apiserver [3b408642cd69] ...

	I1109 14:32:39.136674    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 3b408642cd69"

	I1109 14:32:39.173658    1604 logs.go:123] Gathering logs for etcd [348147c99d77] ...

	I1109 14:32:39.173658    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 348147c99d77"

	I1109 14:32:39.206061    1604 logs.go:123] Gathering logs for kube-scheduler [c1fa8e945752] ...

	I1109 14:32:39.206061    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c1fa8e945752"

	I1109 14:32:39.241072    1604 logs.go:123] Gathering logs for kube-controller-manager [25752fe0c294] ...

	I1109 14:32:39.241107    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 25752fe0c294"

	I1109 14:32:39.277778    1604 logs.go:123] Gathering logs for kube-controller-manager [b0b7529d23ff] ...

	I1109 14:32:39.277778    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b0b7529d23ff"

	I1109 14:32:39.322704    1604 logs.go:123] Gathering logs for Docker ...

	I1109 14:32:39.322704    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"

	I1109 14:32:39.351645    1604 logs.go:123] Gathering logs for kubelet ...

	I1109 14:32:39.351645    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"

	I1109 14:32:39.412646    1604 logs.go:123] Gathering logs for dmesg ...

	I1109 14:32:39.412646    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"

	I1109 14:32:41.936759    1604 api_server.go:253] Checking apiserver healthz at https://127.0.0.1:51763/healthz ...

	I1109 14:32:41.939748    1604 api_server.go:269] stopped: https://127.0.0.1:51763/healthz: Get "https://127.0.0.1:51763/healthz": EOF

	I1109 14:32:41.950298    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}

	I1109 14:32:41.988339    1604 logs.go:282] 1 containers: [3b408642cd69]

	I1109 14:32:41.994331    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}

	I1109 14:32:42.023011    1604 logs.go:282] 1 containers: [348147c99d77]

	I1109 14:32:42.031973    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}

	I1109 14:32:42.068813    1604 logs.go:282] 0 containers: []

	W1109 14:32:42.068813    1604 logs.go:284] No container was found matching "coredns"

	I1109 14:32:42.074807    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}

	I1109 14:32:42.109807    1604 logs.go:282] 2 containers: [c1fa8e945752 dcfa57dcafaf]

	I1109 14:32:42.115821    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}

	I1109 14:32:42.146812    1604 logs.go:282] 0 containers: []

	W1109 14:32:42.146812    1604 logs.go:284] No container was found matching "kube-proxy"

	I1109 14:32:42.154836    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}

	I1109 14:32:42.192813    1604 logs.go:282] 2 containers: [25752fe0c294 b0b7529d23ff]

	I1109 14:32:42.199818    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}

	I1109 14:32:42.232001    1604 logs.go:282] 0 containers: []

	W1109 14:32:42.232001    1604 logs.go:284] No container was found matching "kindnet"

	I1109 14:32:42.237988    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}

	I1109 14:32:42.266988    1604 logs.go:282] 0 containers: []

	W1109 14:32:42.266988    1604 logs.go:284] No container was found matching "storage-provisioner"

	I1109 14:32:42.266988    1604 logs.go:123] Gathering logs for describe nodes ...

	I1109 14:32:42.266988    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"

	W1109 14:32:42.354762    1604 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1

	stdout:

	stderr:

	E1109 14:32:42.337644    3586 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:32:42.341811    3586 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:32:42.343696    3586 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:32:42.344601    3586 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:32:42.346670    3586 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	 output: 

	** stderr ** 

	E1109 14:32:42.337644    3586 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:32:42.341811    3586 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:32:42.343696    3586 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:32:42.344601    3586 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:32:42.346670    3586 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	** /stderr **

	I1109 14:32:42.354762    1604 logs.go:123] Gathering logs for etcd [348147c99d77] ...

	I1109 14:32:42.354762    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 348147c99d77"

	I1109 14:32:42.388521    1604 logs.go:123] Gathering logs for kube-scheduler [c1fa8e945752] ...

	I1109 14:32:42.388598    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c1fa8e945752"

	I1109 14:32:42.424446    1604 logs.go:123] Gathering logs for kube-scheduler [dcfa57dcafaf] ...

	I1109 14:32:42.425447    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 dcfa57dcafaf"

	I1109 14:32:42.466437    1604 logs.go:123] Gathering logs for kube-controller-manager [25752fe0c294] ...

	I1109 14:32:42.466437    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 25752fe0c294"

	I1109 14:32:42.505415    1604 logs.go:123] Gathering logs for container status ...

	I1109 14:32:42.505481    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"

	I1109 14:32:42.607192    1604 logs.go:123] Gathering logs for kubelet ...

	I1109 14:32:42.607295    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"

	I1109 14:32:42.671263    1604 logs.go:123] Gathering logs for dmesg ...

	I1109 14:32:42.672269    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"

	I1109 14:32:42.696754    1604 logs.go:123] Gathering logs for kube-apiserver [3b408642cd69] ...

	I1109 14:32:42.696830    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 3b408642cd69"

	I1109 14:32:42.743262    1604 logs.go:123] Gathering logs for kube-controller-manager [b0b7529d23ff] ...

	I1109 14:32:42.743352    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b0b7529d23ff"

	I1109 14:32:42.779668    1604 logs.go:123] Gathering logs for Docker ...

	I1109 14:32:42.779668    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"

	I1109 14:32:45.309885    1604 api_server.go:253] Checking apiserver healthz at https://127.0.0.1:51763/healthz ...

	I1109 14:32:45.312773    1604 api_server.go:269] stopped: https://127.0.0.1:51763/healthz: Get "https://127.0.0.1:51763/healthz": EOF

	I1109 14:32:45.318890    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}

	I1109 14:32:45.351014    1604 logs.go:282] 1 containers: [3b408642cd69]

	I1109 14:32:45.357669    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}

	I1109 14:32:45.393267    1604 logs.go:282] 1 containers: [348147c99d77]

	I1109 14:32:45.399982    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}

	I1109 14:32:45.431596    1604 logs.go:282] 0 containers: []

	W1109 14:32:45.431596    1604 logs.go:284] No container was found matching "coredns"

	I1109 14:32:45.438402    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}

	I1109 14:32:45.474950    1604 logs.go:282] 2 containers: [c1fa8e945752 dcfa57dcafaf]

	I1109 14:32:45.481811    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}

	I1109 14:32:45.518013    1604 logs.go:282] 0 containers: []

	W1109 14:32:45.518013    1604 logs.go:284] No container was found matching "kube-proxy"

	I1109 14:32:45.524026    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}

	I1109 14:32:45.556713    1604 logs.go:282] 2 containers: [25752fe0c294 b0b7529d23ff]

	I1109 14:32:45.562718    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}

	I1109 14:32:45.593479    1604 logs.go:282] 0 containers: []

	W1109 14:32:45.593479    1604 logs.go:284] No container was found matching "kindnet"

	I1109 14:32:45.600891    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}

	I1109 14:32:45.634005    1604 logs.go:282] 0 containers: []

	W1109 14:32:45.634005    1604 logs.go:284] No container was found matching "storage-provisioner"

	I1109 14:32:45.634005    1604 logs.go:123] Gathering logs for kubelet ...

	I1109 14:32:45.634005    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"

	I1109 14:32:45.700995    1604 logs.go:123] Gathering logs for dmesg ...

	I1109 14:32:45.700995    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"

	I1109 14:32:45.725002    1604 logs.go:123] Gathering logs for kube-apiserver [3b408642cd69] ...

	I1109 14:32:45.725002    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 3b408642cd69"

	I1109 14:32:45.764993    1604 logs.go:123] Gathering logs for etcd [348147c99d77] ...

	I1109 14:32:45.764993    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 348147c99d77"

	I1109 14:32:45.801015    1604 logs.go:123] Gathering logs for kube-scheduler [c1fa8e945752] ...

	I1109 14:32:45.801091    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c1fa8e945752"

	I1109 14:32:45.839780    1604 logs.go:123] Gathering logs for kube-scheduler [dcfa57dcafaf] ...

	I1109 14:32:45.839871    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 dcfa57dcafaf"

	I1109 14:32:45.886962    1604 logs.go:123] Gathering logs for kube-controller-manager [b0b7529d23ff] ...

	I1109 14:32:45.886962    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b0b7529d23ff"

	I1109 14:32:45.929302    1604 logs.go:123] Gathering logs for container status ...

	I1109 14:32:45.929302    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"

	I1109 14:32:46.017174    1604 logs.go:123] Gathering logs for describe nodes ...

	I1109 14:32:46.017174    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"

	W1109 14:32:46.117419    1604 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1

	stdout:

	stderr:

	E1109 14:32:46.101238    3836 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:32:46.101986    3836 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:32:46.106482    3836 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:32:46.107665    3836 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:32:46.108422    3836 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	 output: 

	** stderr ** 

	E1109 14:32:46.101238    3836 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:32:46.101986    3836 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:32:46.106482    3836 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:32:46.107665    3836 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:32:46.108422    3836 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	** /stderr **

	I1109 14:32:46.117483    1604 logs.go:123] Gathering logs for kube-controller-manager [25752fe0c294] ...

	I1109 14:32:46.117483    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 25752fe0c294"

	I1109 14:32:46.156994    1604 logs.go:123] Gathering logs for Docker ...

	I1109 14:32:46.156994    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"

	I1109 14:32:48.687155    1604 api_server.go:253] Checking apiserver healthz at https://127.0.0.1:51763/healthz ...

	I1109 14:32:53.687604    1604 api_server.go:269] stopped: https://127.0.0.1:51763/healthz: Get "https://127.0.0.1:51763/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

	I1109 14:32:53.695039    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}

	I1109 14:32:53.729721    1604 logs.go:282] 2 containers: [1d7002c13770 3b408642cd69]

	I1109 14:32:53.735950    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}

	I1109 14:32:53.768049    1604 logs.go:282] 1 containers: [c23c494c3744]

	I1109 14:32:53.774222    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}

	I1109 14:32:53.804062    1604 logs.go:282] 0 containers: []

	W1109 14:32:53.804062    1604 logs.go:284] No container was found matching "coredns"

	I1109 14:32:53.809810    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}

	I1109 14:32:53.841128    1604 logs.go:282] 2 containers: [c1fa8e945752 dcfa57dcafaf]

	I1109 14:32:53.847649    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}

	I1109 14:32:53.876039    1604 logs.go:282] 0 containers: []

	W1109 14:32:53.876039    1604 logs.go:284] No container was found matching "kube-proxy"

	I1109 14:32:53.882853    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}

	I1109 14:32:53.911549    1604 logs.go:282] 2 containers: [25752fe0c294 b0b7529d23ff]

	I1109 14:32:53.917425    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}

	I1109 14:32:53.956082    1604 logs.go:282] 0 containers: []

	W1109 14:32:53.956137    1604 logs.go:284] No container was found matching "kindnet"

	I1109 14:32:53.962920    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}

	I1109 14:32:54.001634    1604 logs.go:282] 0 containers: []

	W1109 14:32:54.001634    1604 logs.go:284] No container was found matching "storage-provisioner"

	I1109 14:32:54.001634    1604 logs.go:123] Gathering logs for kube-apiserver [3b408642cd69] ...

	I1109 14:32:54.001634    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 3b408642cd69"

	I1109 14:32:54.050382    1604 logs.go:123] Gathering logs for etcd [c23c494c3744] ...

	I1109 14:32:54.050382    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c23c494c3744"

	I1109 14:32:54.088417    1604 logs.go:123] Gathering logs for dmesg ...

	I1109 14:32:54.088417    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"

	I1109 14:32:54.111291    1604 logs.go:123] Gathering logs for kube-scheduler [c1fa8e945752] ...

	I1109 14:32:54.111401    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c1fa8e945752"

	I1109 14:32:54.144482    1604 logs.go:123] Gathering logs for kube-scheduler [dcfa57dcafaf] ...

	I1109 14:32:54.144482    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 dcfa57dcafaf"

	I1109 14:32:54.187187    1604 logs.go:123] Gathering logs for kube-controller-manager [25752fe0c294] ...

	I1109 14:32:54.187187    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 25752fe0c294"

	I1109 14:32:54.220159    1604 logs.go:123] Gathering logs for kube-controller-manager [b0b7529d23ff] ...

	I1109 14:32:54.220239    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b0b7529d23ff"

	I1109 14:32:54.264380    1604 logs.go:123] Gathering logs for Docker ...

	I1109 14:32:54.264380    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"

	I1109 14:32:54.294913    1604 logs.go:123] Gathering logs for container status ...

	I1109 14:32:54.294963    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"

	I1109 14:32:54.373169    1604 logs.go:123] Gathering logs for kubelet ...

	I1109 14:32:54.373169    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"

	I1109 14:32:54.437954    1604 logs.go:123] Gathering logs for describe nodes ...

	I1109 14:32:54.437954    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"

	I1109 14:33:08.467820    1604 ssh_runner.go:235] Completed: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": (14.0297047s)

	W1109 14:33:08.467820    1604 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1

	stdout:

	stderr:

	E1109 14:33:04.528448    4215 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": net/http: TLS handshake timeout

	E1109 14:33:08.455196    4215 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused - error from a previous attempt: read tcp [::1]:35462->[::1]:8443: read: connection reset by peer

	E1109 14:33:08.456101    4215 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:33:08.459106    4215 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:33:08.460319    4215 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	 output: 

	** stderr ** 

	E1109 14:33:04.528448    4215 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": net/http: TLS handshake timeout

	E1109 14:33:08.455196    4215 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused - error from a previous attempt: read tcp [::1]:35462->[::1]:8443: read: connection reset by peer

	E1109 14:33:08.456101    4215 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:33:08.459106    4215 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:33:08.460319    4215 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	** /stderr **

	I1109 14:33:08.467820    1604 logs.go:123] Gathering logs for kube-apiserver [1d7002c13770] ...

	I1109 14:33:08.467820    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 1d7002c13770"

	I1109 14:33:13.336962    1604 ssh_runner.go:235] Completed: /bin/bash -c "docker logs --tail 400 1d7002c13770": (4.8690399s)

	I1109 14:33:15.841756    1604 api_server.go:253] Checking apiserver healthz at https://127.0.0.1:51763/healthz ...

	I1109 14:33:15.844753    1604 api_server.go:269] stopped: https://127.0.0.1:51763/healthz: Get "https://127.0.0.1:51763/healthz": EOF

	I1109 14:33:15.854748    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}

	I1109 14:33:15.892960    1604 logs.go:282] 1 containers: [1d7002c13770]

	I1109 14:33:15.901951    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}

	I1109 14:33:15.937511    1604 logs.go:282] 1 containers: [c23c494c3744]

	I1109 14:33:15.946509    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}

	I1109 14:33:15.982510    1604 logs.go:282] 0 containers: []

	W1109 14:33:15.982510    1604 logs.go:284] No container was found matching "coredns"

	I1109 14:33:15.989512    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}

	I1109 14:33:16.044797    1604 logs.go:282] 2 containers: [c1fa8e945752 dcfa57dcafaf]

	I1109 14:33:16.051384    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}

	I1109 14:33:16.086977    1604 logs.go:282] 0 containers: []

	W1109 14:33:16.086977    1604 logs.go:284] No container was found matching "kube-proxy"

	I1109 14:33:16.093974    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}

	I1109 14:33:16.151994    1604 logs.go:282] 2 containers: [f91f678ad8d3 25752fe0c294]

	I1109 14:33:16.161993    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}

	I1109 14:33:16.219704    1604 logs.go:282] 0 containers: []

	W1109 14:33:16.219704    1604 logs.go:284] No container was found matching "kindnet"

	I1109 14:33:16.225696    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}

	I1109 14:33:16.259270    1604 logs.go:282] 0 containers: []

	W1109 14:33:16.259329    1604 logs.go:284] No container was found matching "storage-provisioner"

	I1109 14:33:16.259329    1604 logs.go:123] Gathering logs for kubelet ...

	I1109 14:33:16.259375    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"

	I1109 14:33:16.352157    1604 logs.go:123] Gathering logs for dmesg ...

	I1109 14:33:16.352157    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"

	I1109 14:33:16.374667    1604 logs.go:123] Gathering logs for kube-apiserver [1d7002c13770] ...

	I1109 14:33:16.374667    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 1d7002c13770"

	I1109 14:33:16.421176    1604 logs.go:123] Gathering logs for etcd [c23c494c3744] ...

	I1109 14:33:16.421176    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c23c494c3744"

	I1109 14:33:16.467698    1604 logs.go:123] Gathering logs for kube-scheduler [c1fa8e945752] ...

	I1109 14:33:16.467698    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c1fa8e945752"

	I1109 14:33:16.527693    1604 logs.go:123] Gathering logs for kube-controller-manager [f91f678ad8d3] ...

	I1109 14:33:16.527693    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f91f678ad8d3"

	I1109 14:33:16.572704    1604 logs.go:123] Gathering logs for kube-controller-manager [25752fe0c294] ...

	I1109 14:33:16.572704    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 25752fe0c294"

	I1109 14:33:16.633308    1604 logs.go:123] Gathering logs for describe nodes ...

	I1109 14:33:16.633883    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"

	W1109 14:33:16.745172    1604 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1

	stdout:

	stderr:

	E1109 14:33:16.737076    4559 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:33:16.738205    4559 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:33:16.739403    4559 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:33:16.740381    4559 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:33:16.742755    4559 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	 output: 

	** stderr ** 

	E1109 14:33:16.737076    4559 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:33:16.738205    4559 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:33:16.739403    4559 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:33:16.740381    4559 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:33:16.742755    4559 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	** /stderr **

	I1109 14:33:16.745172    1604 logs.go:123] Gathering logs for kube-scheduler [dcfa57dcafaf] ...

	I1109 14:33:16.745172    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 dcfa57dcafaf"

	I1109 14:33:16.797853    1604 logs.go:123] Gathering logs for Docker ...

	I1109 14:33:16.797853    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"

	I1109 14:33:16.843791    1604 logs.go:123] Gathering logs for container status ...

	I1109 14:33:16.843791    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"

	I1109 14:33:19.446100    1604 api_server.go:253] Checking apiserver healthz at https://127.0.0.1:51763/healthz ...

	I1109 14:33:19.449532    1604 api_server.go:269] stopped: https://127.0.0.1:51763/healthz: Get "https://127.0.0.1:51763/healthz": EOF

	I1109 14:33:19.457240    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}

	I1109 14:33:19.494782    1604 logs.go:282] 1 containers: [1d7002c13770]

	I1109 14:33:19.501649    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}

	I1109 14:33:19.538988    1604 logs.go:282] 1 containers: [c23c494c3744]

	I1109 14:33:19.545161    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}

	I1109 14:33:19.579725    1604 logs.go:282] 0 containers: []

	W1109 14:33:19.579810    1604 logs.go:284] No container was found matching "coredns"

	I1109 14:33:19.586257    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}

	I1109 14:33:19.618757    1604 logs.go:282] 2 containers: [c1fa8e945752 dcfa57dcafaf]

	I1109 14:33:19.624425    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}

	I1109 14:33:19.656186    1604 logs.go:282] 0 containers: []

	W1109 14:33:19.656186    1604 logs.go:284] No container was found matching "kube-proxy"

	I1109 14:33:19.665316    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}

	I1109 14:33:19.702581    1604 logs.go:282] 2 containers: [f91f678ad8d3 25752fe0c294]

	I1109 14:33:19.710416    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}

	I1109 14:33:19.743793    1604 logs.go:282] 0 containers: []

	W1109 14:33:19.743793    1604 logs.go:284] No container was found matching "kindnet"

	I1109 14:33:19.751239    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}

	I1109 14:33:19.783856    1604 logs.go:282] 0 containers: []

	W1109 14:33:19.783856    1604 logs.go:284] No container was found matching "storage-provisioner"

	I1109 14:33:19.783856    1604 logs.go:123] Gathering logs for kube-controller-manager [f91f678ad8d3] ...

	I1109 14:33:19.783856    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f91f678ad8d3"

	I1109 14:33:19.823925    1604 logs.go:123] Gathering logs for kube-controller-manager [25752fe0c294] ...

	I1109 14:33:19.823925    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 25752fe0c294"

	I1109 14:33:19.860987    1604 logs.go:123] Gathering logs for Docker ...

	I1109 14:33:19.861074    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"

	I1109 14:33:19.892335    1604 logs.go:123] Gathering logs for dmesg ...

	I1109 14:33:19.892335    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"

	I1109 14:33:19.913832    1604 logs.go:123] Gathering logs for etcd [c23c494c3744] ...

	I1109 14:33:19.913866    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c23c494c3744"

	I1109 14:33:19.950688    1604 logs.go:123] Gathering logs for kube-scheduler [dcfa57dcafaf] ...

	I1109 14:33:19.950688    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 dcfa57dcafaf"

	I1109 14:33:19.995647    1604 logs.go:123] Gathering logs for container status ...

	I1109 14:33:19.995647    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"

	I1109 14:33:20.079954    1604 logs.go:123] Gathering logs for kubelet ...

	I1109 14:33:20.080007    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"

	I1109 14:33:20.160889    1604 logs.go:123] Gathering logs for describe nodes ...

	I1109 14:33:20.160889    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"

	W1109 14:33:20.253154    1604 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1

	stdout:

	stderr:

	E1109 14:33:20.243164    4771 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:33:20.244639    4771 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:33:20.245661    4771 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:33:20.247253    4771 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:33:20.248119    4771 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	 output: 

	** stderr ** 

	E1109 14:33:20.243164    4771 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:33:20.244639    4771 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:33:20.245661    4771 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:33:20.247253    4771 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:33:20.248119    4771 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	** /stderr **

	I1109 14:33:20.253154    1604 logs.go:123] Gathering logs for kube-apiserver [1d7002c13770] ...

	I1109 14:33:20.253154    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 1d7002c13770"

	I1109 14:33:20.295220    1604 logs.go:123] Gathering logs for kube-scheduler [c1fa8e945752] ...

	I1109 14:33:20.295875    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c1fa8e945752"

	I1109 14:33:22.841755    1604 api_server.go:253] Checking apiserver healthz at https://127.0.0.1:51763/healthz ...

	I1109 14:33:22.844656    1604 api_server.go:269] stopped: https://127.0.0.1:51763/healthz: Get "https://127.0.0.1:51763/healthz": EOF

	I1109 14:33:22.850872    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}

	I1109 14:33:22.882912    1604 logs.go:282] 1 containers: [1d7002c13770]

	I1109 14:33:22.890833    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}

	I1109 14:33:22.922804    1604 logs.go:282] 1 containers: [c23c494c3744]

	I1109 14:33:22.929079    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}

	I1109 14:33:22.959378    1604 logs.go:282] 0 containers: []

	W1109 14:33:22.959378    1604 logs.go:284] No container was found matching "coredns"

	I1109 14:33:22.966040    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}

	I1109 14:33:22.998042    1604 logs.go:282] 2 containers: [c1fa8e945752 dcfa57dcafaf]

	I1109 14:33:23.005125    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}

	I1109 14:33:23.034860    1604 logs.go:282] 0 containers: []

	W1109 14:33:23.034860    1604 logs.go:284] No container was found matching "kube-proxy"

	I1109 14:33:23.041660    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}

	I1109 14:33:23.075727    1604 logs.go:282] 2 containers: [f91f678ad8d3 25752fe0c294]

	I1109 14:33:23.081666    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}

	I1109 14:33:23.114780    1604 logs.go:282] 0 containers: []

	W1109 14:33:23.115774    1604 logs.go:284] No container was found matching "kindnet"

	I1109 14:33:23.121370    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}

	I1109 14:33:23.150721    1604 logs.go:282] 0 containers: []

	W1109 14:33:23.150721    1604 logs.go:284] No container was found matching "storage-provisioner"

	I1109 14:33:23.150721    1604 logs.go:123] Gathering logs for Docker ...

	I1109 14:33:23.150721    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"

	I1109 14:33:23.180759    1604 logs.go:123] Gathering logs for dmesg ...

	I1109 14:33:23.180759    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"

	I1109 14:33:23.208938    1604 logs.go:123] Gathering logs for describe nodes ...

	I1109 14:33:23.209040    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"

	W1109 14:33:23.298512    1604 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1

	stdout:

	stderr:

	E1109 14:33:23.289496    4873 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:33:23.290424    4873 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:33:23.292482    4873 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:33:23.293604    4873 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:33:23.294355    4873 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	 output: 

	** stderr ** 

	E1109 14:33:23.289496    4873 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:33:23.290424    4873 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:33:23.292482    4873 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:33:23.293604    4873 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:33:23.294355    4873 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	** /stderr **

	I1109 14:33:23.298612    1604 logs.go:123] Gathering logs for etcd [c23c494c3744] ...

	I1109 14:33:23.298672    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c23c494c3744"

	I1109 14:33:23.333026    1604 logs.go:123] Gathering logs for kube-scheduler [c1fa8e945752] ...

	I1109 14:33:23.333026    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c1fa8e945752"

	I1109 14:33:23.375041    1604 logs.go:123] Gathering logs for kube-scheduler [dcfa57dcafaf] ...

	I1109 14:33:23.375041    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 dcfa57dcafaf"

	I1109 14:33:23.422628    1604 logs.go:123] Gathering logs for kube-controller-manager [f91f678ad8d3] ...

	I1109 14:33:23.422628    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f91f678ad8d3"

	I1109 14:33:23.459560    1604 logs.go:123] Gathering logs for container status ...

	I1109 14:33:23.459560    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"

	I1109 14:33:23.552247    1604 logs.go:123] Gathering logs for kubelet ...

	I1109 14:33:23.552247    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"

	I1109 14:33:23.627662    1604 logs.go:123] Gathering logs for kube-apiserver [1d7002c13770] ...

	I1109 14:33:23.627662    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 1d7002c13770"

	I1109 14:33:23.666228    1604 logs.go:123] Gathering logs for kube-controller-manager [25752fe0c294] ...

	I1109 14:33:23.666330    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 25752fe0c294"

	I1109 14:33:26.201812    1604 api_server.go:253] Checking apiserver healthz at https://127.0.0.1:51763/healthz ...

	I1109 14:33:26.204222    1604 api_server.go:269] stopped: https://127.0.0.1:51763/healthz: Get "https://127.0.0.1:51763/healthz": EOF

	I1109 14:33:26.210821    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}

	I1109 14:33:26.242136    1604 logs.go:282] 1 containers: [1d7002c13770]

	I1109 14:33:26.248797    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}

	I1109 14:33:26.279726    1604 logs.go:282] 1 containers: [c23c494c3744]

	I1109 14:33:26.285645    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}

	I1109 14:33:26.316576    1604 logs.go:282] 0 containers: []

	W1109 14:33:26.316576    1604 logs.go:284] No container was found matching "coredns"

	I1109 14:33:26.322543    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}

	I1109 14:33:26.353482    1604 logs.go:282] 2 containers: [c1fa8e945752 dcfa57dcafaf]

	I1109 14:33:26.359660    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}

	I1109 14:33:26.389838    1604 logs.go:282] 0 containers: []

	W1109 14:33:26.389838    1604 logs.go:284] No container was found matching "kube-proxy"

	I1109 14:33:26.396500    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}

	I1109 14:33:26.431915    1604 logs.go:282] 2 containers: [f91f678ad8d3 25752fe0c294]

	I1109 14:33:26.438124    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}

	I1109 14:33:26.466694    1604 logs.go:282] 0 containers: []

	W1109 14:33:26.467711    1604 logs.go:284] No container was found matching "kindnet"

	I1109 14:33:26.472691    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}

	I1109 14:33:26.502710    1604 logs.go:282] 0 containers: []

	W1109 14:33:26.502710    1604 logs.go:284] No container was found matching "storage-provisioner"

	I1109 14:33:26.502710    1604 logs.go:123] Gathering logs for container status ...

	I1109 14:33:26.502710    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"

	I1109 14:33:26.589570    1604 logs.go:123] Gathering logs for kubelet ...

	I1109 14:33:26.590577    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"

	I1109 14:33:26.671596    1604 logs.go:123] Gathering logs for describe nodes ...

	I1109 14:33:26.671596    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"

	W1109 14:33:26.766679    1604 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1

	stdout:

	stderr:

	E1109 14:33:26.755427    5079 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:33:26.756829    5079 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:33:26.757735    5079 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:33:26.759399    5079 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:33:26.760231    5079 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	 output: 

	** stderr ** 

	E1109 14:33:26.755427    5079 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:33:26.756829    5079 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:33:26.757735    5079 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:33:26.759399    5079 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:33:26.760231    5079 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	** /stderr **

	I1109 14:33:26.766679    1604 logs.go:123] Gathering logs for kube-scheduler [c1fa8e945752] ...

	I1109 14:33:26.766679    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c1fa8e945752"

	I1109 14:33:26.822067    1604 logs.go:123] Gathering logs for kube-controller-manager [f91f678ad8d3] ...

	I1109 14:33:26.822067    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f91f678ad8d3"

	I1109 14:33:26.860735    1604 logs.go:123] Gathering logs for dmesg ...

	I1109 14:33:26.861308    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"

	I1109 14:33:26.883469    1604 logs.go:123] Gathering logs for kube-apiserver [1d7002c13770] ...

	I1109 14:33:26.883513    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 1d7002c13770"

	I1109 14:33:26.927369    1604 logs.go:123] Gathering logs for etcd [c23c494c3744] ...

	I1109 14:33:26.927369    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c23c494c3744"

	I1109 14:33:26.959372    1604 logs.go:123] Gathering logs for kube-scheduler [dcfa57dcafaf] ...

	I1109 14:33:26.959372    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 dcfa57dcafaf"

	I1109 14:33:27.007793    1604 logs.go:123] Gathering logs for kube-controller-manager [25752fe0c294] ...

	I1109 14:33:27.008314    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 25752fe0c294"

	I1109 14:33:27.044573    1604 logs.go:123] Gathering logs for Docker ...

	I1109 14:33:27.044573    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"

	I1109 14:33:29.571203    1604 api_server.go:253] Checking apiserver healthz at https://127.0.0.1:51763/healthz ...

	I1109 14:33:29.573203    1604 api_server.go:269] stopped: https://127.0.0.1:51763/healthz: Get "https://127.0.0.1:51763/healthz": EOF

	I1109 14:33:29.579203    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}

	I1109 14:33:29.614227    1604 logs.go:282] 1 containers: [1d7002c13770]

	I1109 14:33:29.622194    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}

	I1109 14:33:29.653503    1604 logs.go:282] 1 containers: [c23c494c3744]

	I1109 14:33:29.659505    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}

	I1109 14:33:29.691055    1604 logs.go:282] 0 containers: []

	W1109 14:33:29.691055    1604 logs.go:284] No container was found matching "coredns"

	I1109 14:33:29.697069    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}

	I1109 14:33:29.730643    1604 logs.go:282] 2 containers: [c1fa8e945752 dcfa57dcafaf]

	I1109 14:33:29.740266    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}

	I1109 14:33:29.774755    1604 logs.go:282] 0 containers: []

	W1109 14:33:29.774755    1604 logs.go:284] No container was found matching "kube-proxy"

	I1109 14:33:29.780754    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}

	I1109 14:33:29.811300    1604 logs.go:282] 2 containers: [f91f678ad8d3 25752fe0c294]

	I1109 14:33:29.818034    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}

	I1109 14:33:29.848530    1604 logs.go:282] 0 containers: []

	W1109 14:33:29.848530    1604 logs.go:284] No container was found matching "kindnet"

	I1109 14:33:29.855166    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}

	I1109 14:33:29.885782    1604 logs.go:282] 0 containers: []

	W1109 14:33:29.885782    1604 logs.go:284] No container was found matching "storage-provisioner"

	I1109 14:33:29.885782    1604 logs.go:123] Gathering logs for dmesg ...

	I1109 14:33:29.885782    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"

	I1109 14:33:29.909498    1604 logs.go:123] Gathering logs for describe nodes ...

	I1109 14:33:29.909572    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"

	W1109 14:33:29.999729    1604 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1

	stdout:

	stderr:

	E1109 14:33:29.988090    5235 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:33:29.989271    5235 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:33:29.990634    5235 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:33:29.991589    5235 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:33:29.995958    5235 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	 output: 

	** stderr ** 

	E1109 14:33:29.988090    5235 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:33:29.989271    5235 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:33:29.990634    5235 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:33:29.991589    5235 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:33:29.995958    5235 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	** /stderr **

	I1109 14:33:29.999729    1604 logs.go:123] Gathering logs for etcd [c23c494c3744] ...

	I1109 14:33:29.999729    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c23c494c3744"

	I1109 14:33:30.035219    1604 logs.go:123] Gathering logs for kube-scheduler [c1fa8e945752] ...

	I1109 14:33:30.035288    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c1fa8e945752"

	I1109 14:33:30.092445    1604 logs.go:123] Gathering logs for kube-scheduler [dcfa57dcafaf] ...

	I1109 14:33:30.092445    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 dcfa57dcafaf"

	I1109 14:33:30.139646    1604 logs.go:123] Gathering logs for kube-controller-manager [f91f678ad8d3] ...

	I1109 14:33:30.139646    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f91f678ad8d3"

	I1109 14:33:30.175652    1604 logs.go:123] Gathering logs for kube-controller-manager [25752fe0c294] ...

	I1109 14:33:30.175652    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 25752fe0c294"

	I1109 14:33:30.214636    1604 logs.go:123] Gathering logs for kubelet ...

	I1109 14:33:30.214711    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"

	I1109 14:33:30.294798    1604 logs.go:123] Gathering logs for kube-apiserver [1d7002c13770] ...

	I1109 14:33:30.294798    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 1d7002c13770"

	I1109 14:33:30.341943    1604 logs.go:123] Gathering logs for Docker ...

	I1109 14:33:30.342041    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"

	I1109 14:33:30.375217    1604 logs.go:123] Gathering logs for container status ...

	I1109 14:33:30.375217    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"

	I1109 14:33:32.960088    1604 api_server.go:253] Checking apiserver healthz at https://127.0.0.1:51763/healthz ...

	I1109 14:33:32.963022    1604 api_server.go:269] stopped: https://127.0.0.1:51763/healthz: Get "https://127.0.0.1:51763/healthz": EOF

	I1109 14:33:32.969242    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}

	I1109 14:33:32.999166    1604 logs.go:282] 1 containers: [1d7002c13770]

	I1109 14:33:33.004956    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}

	I1109 14:33:33.035918    1604 logs.go:282] 1 containers: [c23c494c3744]

	I1109 14:33:33.041808    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}

	I1109 14:33:33.072238    1604 logs.go:282] 0 containers: []

	W1109 14:33:33.072238    1604 logs.go:284] No container was found matching "coredns"

	I1109 14:33:33.078807    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}

	I1109 14:33:33.110062    1604 logs.go:282] 2 containers: [c1fa8e945752 dcfa57dcafaf]

	I1109 14:33:33.115916    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}

	I1109 14:33:33.145316    1604 logs.go:282] 0 containers: []

	W1109 14:33:33.145399    1604 logs.go:284] No container was found matching "kube-proxy"

	I1109 14:33:33.151516    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}

	I1109 14:33:33.179113    1604 logs.go:282] 2 containers: [f91f678ad8d3 25752fe0c294]

	I1109 14:33:33.184924    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}

	I1109 14:33:33.216283    1604 logs.go:282] 0 containers: []

	W1109 14:33:33.216283    1604 logs.go:284] No container was found matching "kindnet"

	I1109 14:33:33.222441    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}

	I1109 14:33:33.251509    1604 logs.go:282] 0 containers: []

	W1109 14:33:33.251509    1604 logs.go:284] No container was found matching "storage-provisioner"

	I1109 14:33:33.251509    1604 logs.go:123] Gathering logs for kube-controller-manager [f91f678ad8d3] ...

	I1109 14:33:33.251509    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f91f678ad8d3"

	I1109 14:33:33.286055    1604 logs.go:123] Gathering logs for Docker ...

	I1109 14:33:33.286055    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"

	I1109 14:33:33.316499    1604 logs.go:123] Gathering logs for container status ...

	I1109 14:33:33.316499    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"

	I1109 14:33:33.399037    1604 logs.go:123] Gathering logs for kubelet ...

	I1109 14:33:33.399037    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"

	I1109 14:33:33.480538    1604 logs.go:123] Gathering logs for dmesg ...

	I1109 14:33:33.480538    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"

	I1109 14:33:33.505368    1604 logs.go:123] Gathering logs for describe nodes ...

	I1109 14:33:33.505368    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"

	W1109 14:33:33.594714    1604 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1

	stdout:

	stderr:

	E1109 14:33:33.583629    5447 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:33:33.585212    5447 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:33:33.586444    5447 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:33:33.588418    5447 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:33:33.590237    5447 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	 output: 

	** stderr ** 

	E1109 14:33:33.583629    5447 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:33:33.585212    5447 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:33:33.586444    5447 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:33:33.588418    5447 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:33:33.590237    5447 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	** /stderr **

	I1109 14:33:33.594789    1604 logs.go:123] Gathering logs for kube-apiserver [1d7002c13770] ...

	I1109 14:33:33.594825    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 1d7002c13770"

	I1109 14:33:33.634137    1604 logs.go:123] Gathering logs for etcd [c23c494c3744] ...

	I1109 14:33:33.634197    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c23c494c3744"

	I1109 14:33:33.668491    1604 logs.go:123] Gathering logs for kube-scheduler [dcfa57dcafaf] ...

	I1109 14:33:33.668570    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 dcfa57dcafaf"

	I1109 14:33:33.717872    1604 logs.go:123] Gathering logs for kube-controller-manager [25752fe0c294] ...

	I1109 14:33:33.717872    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 25752fe0c294"

	I1109 14:33:33.760743    1604 logs.go:123] Gathering logs for kube-scheduler [c1fa8e945752] ...

	I1109 14:33:33.760743    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c1fa8e945752"

	I1109 14:33:36.310422    1604 api_server.go:253] Checking apiserver healthz at https://127.0.0.1:51763/healthz ...

	I1109 14:33:36.313027    1604 api_server.go:269] stopped: https://127.0.0.1:51763/healthz: Get "https://127.0.0.1:51763/healthz": EOF

	I1109 14:33:36.320621    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}

	I1109 14:33:36.353928    1604 logs.go:282] 1 containers: [1d7002c13770]

	I1109 14:33:36.363882    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}

	I1109 14:33:36.398091    1604 logs.go:282] 1 containers: [c23c494c3744]

	I1109 14:33:36.403512    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}

	I1109 14:33:36.436324    1604 logs.go:282] 0 containers: []

	W1109 14:33:36.436324    1604 logs.go:284] No container was found matching "coredns"

	I1109 14:33:36.446352    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}

	I1109 14:33:36.481149    1604 logs.go:282] 2 containers: [c1fa8e945752 dcfa57dcafaf]

	I1109 14:33:36.487601    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}

	I1109 14:33:36.517015    1604 logs.go:282] 0 containers: []

	W1109 14:33:36.517015    1604 logs.go:284] No container was found matching "kube-proxy"

	I1109 14:33:36.526275    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}

	I1109 14:33:36.561929    1604 logs.go:282] 2 containers: [f91f678ad8d3 25752fe0c294]

	I1109 14:33:36.568334    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}

	I1109 14:33:36.596849    1604 logs.go:282] 0 containers: []

	W1109 14:33:36.596908    1604 logs.go:284] No container was found matching "kindnet"

	I1109 14:33:36.602821    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}

	I1109 14:33:36.632322    1604 logs.go:282] 0 containers: []

	W1109 14:33:36.632322    1604 logs.go:284] No container was found matching "storage-provisioner"

	I1109 14:33:36.632322    1604 logs.go:123] Gathering logs for kube-controller-manager [f91f678ad8d3] ...

	I1109 14:33:36.632322    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f91f678ad8d3"

	I1109 14:33:36.670962    1604 logs.go:123] Gathering logs for kube-apiserver [1d7002c13770] ...

	I1109 14:33:36.670962    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 1d7002c13770"

	I1109 14:33:36.708556    1604 logs.go:123] Gathering logs for kube-scheduler [dcfa57dcafaf] ...

	I1109 14:33:36.708556    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 dcfa57dcafaf"

	I1109 14:33:36.760093    1604 logs.go:123] Gathering logs for kube-controller-manager [25752fe0c294] ...

	I1109 14:33:36.760093    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 25752fe0c294"

	I1109 14:33:36.793097    1604 logs.go:123] Gathering logs for Docker ...

	I1109 14:33:36.793097    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"

	I1109 14:33:36.820094    1604 logs.go:123] Gathering logs for container status ...

	I1109 14:33:36.820094    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"

	I1109 14:33:36.905548    1604 logs.go:123] Gathering logs for kubelet ...

	I1109 14:33:36.905548    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"

	I1109 14:33:36.997336    1604 logs.go:123] Gathering logs for dmesg ...

	I1109 14:33:36.997336    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"

	I1109 14:33:37.019340    1604 logs.go:123] Gathering logs for describe nodes ...

	I1109 14:33:37.019340    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"

	W1109 14:33:37.126272    1604 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1

	stdout:

	stderr:

	E1109 14:33:37.113481    5649 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:33:37.115902    5649 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:33:37.117020    5649 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:33:37.118241    5649 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:33:37.119169    5649 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	 output: 

	** stderr ** 

	E1109 14:33:37.113481    5649 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:33:37.115902    5649 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:33:37.117020    5649 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:33:37.118241    5649 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:33:37.119169    5649 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	** /stderr **

	I1109 14:33:37.126272    1604 logs.go:123] Gathering logs for etcd [c23c494c3744] ...

	I1109 14:33:37.126272    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c23c494c3744"

	I1109 14:33:37.166269    1604 logs.go:123] Gathering logs for kube-scheduler [c1fa8e945752] ...

	I1109 14:33:37.166269    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c1fa8e945752"

	I1109 14:33:39.723487    1604 api_server.go:253] Checking apiserver healthz at https://127.0.0.1:51763/healthz ...

	I1109 14:33:39.727167    1604 api_server.go:269] stopped: https://127.0.0.1:51763/healthz: Get "https://127.0.0.1:51763/healthz": EOF

	I1109 14:33:39.733551    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}

	I1109 14:33:39.766807    1604 logs.go:282] 1 containers: [1d7002c13770]

	I1109 14:33:39.773962    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}

	I1109 14:33:39.804638    1604 logs.go:282] 1 containers: [c23c494c3744]

	I1109 14:33:39.810817    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}

	I1109 14:33:39.839780    1604 logs.go:282] 0 containers: []

	W1109 14:33:39.839780    1604 logs.go:284] No container was found matching "coredns"

	I1109 14:33:39.847178    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}

	I1109 14:33:39.879379    1604 logs.go:282] 2 containers: [c1fa8e945752 dcfa57dcafaf]

	I1109 14:33:39.885515    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}

	I1109 14:33:39.916996    1604 logs.go:282] 0 containers: []

	W1109 14:33:39.916996    1604 logs.go:284] No container was found matching "kube-proxy"

	I1109 14:33:39.923136    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}

	I1109 14:33:39.954730    1604 logs.go:282] 2 containers: [f91f678ad8d3 25752fe0c294]

	I1109 14:33:39.961727    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}

	I1109 14:33:39.992895    1604 logs.go:282] 0 containers: []

	W1109 14:33:39.992895    1604 logs.go:284] No container was found matching "kindnet"

	I1109 14:33:40.000087    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}

	I1109 14:33:40.031195    1604 logs.go:282] 0 containers: []

	W1109 14:33:40.031195    1604 logs.go:284] No container was found matching "storage-provisioner"

	I1109 14:33:40.031195    1604 logs.go:123] Gathering logs for kubelet ...

	I1109 14:33:40.031195    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"

	I1109 14:33:40.117212    1604 logs.go:123] Gathering logs for dmesg ...

	I1109 14:33:40.117212    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"

	I1109 14:33:40.139196    1604 logs.go:123] Gathering logs for describe nodes ...

	I1109 14:33:40.139196    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"

	W1109 14:33:40.230055    1604 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1

	stdout:

	stderr:

	E1109 14:33:40.216652    5750 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:33:40.217487    5750 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:33:40.222906    5750 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:33:40.224143    5750 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:33:40.225172    5750 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	 output: 

	** stderr ** 

	E1109 14:33:40.216652    5750 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:33:40.217487    5750 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:33:40.222906    5750 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:33:40.224143    5750 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:33:40.225172    5750 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	** /stderr **

	I1109 14:33:40.230055    1604 logs.go:123] Gathering logs for kube-apiserver [1d7002c13770] ...

	I1109 14:33:40.230055    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 1d7002c13770"

	I1109 14:33:40.273037    1604 logs.go:123] Gathering logs for kube-scheduler [c1fa8e945752] ...

	I1109 14:33:40.273070    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c1fa8e945752"

	I1109 14:33:40.324051    1604 logs.go:123] Gathering logs for kube-controller-manager [f91f678ad8d3] ...

	I1109 14:33:40.324051    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f91f678ad8d3"

	I1109 14:33:40.360365    1604 logs.go:123] Gathering logs for Docker ...

	I1109 14:33:40.360365    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"

	I1109 14:33:40.388371    1604 logs.go:123] Gathering logs for container status ...

	I1109 14:33:40.388371    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"

	I1109 14:33:40.474158    1604 logs.go:123] Gathering logs for etcd [c23c494c3744] ...

	I1109 14:33:40.474158    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c23c494c3744"

	I1109 14:33:40.511765    1604 logs.go:123] Gathering logs for kube-scheduler [dcfa57dcafaf] ...

	I1109 14:33:40.511850    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 dcfa57dcafaf"

	I1109 14:33:40.554974    1604 logs.go:123] Gathering logs for kube-controller-manager [25752fe0c294] ...

	I1109 14:33:40.554974    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 25752fe0c294"

	I1109 14:33:43.092899    1604 api_server.go:253] Checking apiserver healthz at https://127.0.0.1:51763/healthz ...

	I1109 14:33:43.095240    1604 api_server.go:269] stopped: https://127.0.0.1:51763/healthz: Get "https://127.0.0.1:51763/healthz": EOF

	I1109 14:33:43.101709    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}

	I1109 14:33:43.143710    1604 logs.go:282] 1 containers: [1d7002c13770]

	I1109 14:33:43.151426    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}

	I1109 14:33:43.186259    1604 logs.go:282] 1 containers: [c23c494c3744]

	I1109 14:33:43.192084    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}

	I1109 14:33:43.229894    1604 logs.go:282] 0 containers: []

	W1109 14:33:43.229894    1604 logs.go:284] No container was found matching "coredns"

	I1109 14:33:43.237400    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}

	I1109 14:33:43.272163    1604 logs.go:282] 2 containers: [c1fa8e945752 dcfa57dcafaf]

	I1109 14:33:43.278316    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}

	I1109 14:33:43.307399    1604 logs.go:282] 0 containers: []

	W1109 14:33:43.307399    1604 logs.go:284] No container was found matching "kube-proxy"

	I1109 14:33:43.317070    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}

	I1109 14:33:43.358240    1604 logs.go:282] 2 containers: [f91f678ad8d3 25752fe0c294]

	I1109 14:33:43.364376    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}

	I1109 14:33:43.393198    1604 logs.go:282] 0 containers: []

	W1109 14:33:43.393198    1604 logs.go:284] No container was found matching "kindnet"

	I1109 14:33:43.403737    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}

	I1109 14:33:43.437777    1604 logs.go:282] 0 containers: []

	W1109 14:33:43.437777    1604 logs.go:284] No container was found matching "storage-provisioner"

	I1109 14:33:43.437777    1604 logs.go:123] Gathering logs for kubelet ...

	I1109 14:33:43.437777    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"

	I1109 14:33:43.521928    1604 logs.go:123] Gathering logs for etcd [c23c494c3744] ...

	I1109 14:33:43.521928    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c23c494c3744"

	I1109 14:33:43.571274    1604 logs.go:123] Gathering logs for kube-scheduler [c1fa8e945752] ...

	I1109 14:33:43.571311    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c1fa8e945752"

	I1109 14:33:43.627864    1604 logs.go:123] Gathering logs for kube-scheduler [dcfa57dcafaf] ...

	I1109 14:33:43.627864    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 dcfa57dcafaf"

	I1109 14:33:43.677165    1604 logs.go:123] Gathering logs for kube-controller-manager [25752fe0c294] ...

	I1109 14:33:43.677165    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 25752fe0c294"

	I1109 14:33:43.712862    1604 logs.go:123] Gathering logs for container status ...

	I1109 14:33:43.712862    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"

	I1109 14:33:43.804080    1604 logs.go:123] Gathering logs for dmesg ...

	I1109 14:33:43.804145    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"

	I1109 14:33:43.830253    1604 logs.go:123] Gathering logs for describe nodes ...

	I1109 14:33:43.830253    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"

	W1109 14:33:43.927649    1604 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1

	stdout:

	stderr:

	E1109 14:33:43.911248    5996 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:33:43.913737    5996 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:33:43.915389    5996 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:33:43.919119    5996 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:33:43.921176    5996 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	 output: 

	** stderr ** 

	E1109 14:33:43.911248    5996 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:33:43.913737    5996 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:33:43.915389    5996 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:33:43.919119    5996 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:33:43.921176    5996 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	** /stderr **

	I1109 14:33:43.927649    1604 logs.go:123] Gathering logs for kube-apiserver [1d7002c13770] ...

	I1109 14:33:43.927649    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 1d7002c13770"

	I1109 14:33:43.976066    1604 logs.go:123] Gathering logs for kube-controller-manager [f91f678ad8d3] ...

	I1109 14:33:43.976066    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f91f678ad8d3"

	I1109 14:33:44.009419    1604 logs.go:123] Gathering logs for Docker ...

	I1109 14:33:44.010326    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"

	I1109 14:33:46.545738    1604 api_server.go:253] Checking apiserver healthz at https://127.0.0.1:51763/healthz ...

	I1109 14:33:46.550363    1604 api_server.go:269] stopped: https://127.0.0.1:51763/healthz: Get "https://127.0.0.1:51763/healthz": EOF

	I1109 14:33:46.556798    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}

	I1109 14:33:46.591906    1604 logs.go:282] 1 containers: [1d7002c13770]

	I1109 14:33:46.598320    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}

	I1109 14:33:46.630324    1604 logs.go:282] 1 containers: [c23c494c3744]

	I1109 14:33:46.637448    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}

	I1109 14:33:46.670372    1604 logs.go:282] 0 containers: []

	W1109 14:33:46.670491    1604 logs.go:284] No container was found matching "coredns"

	I1109 14:33:46.677443    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}

	I1109 14:33:46.709167    1604 logs.go:282] 2 containers: [c1fa8e945752 dcfa57dcafaf]

	I1109 14:33:46.716739    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}

	I1109 14:33:46.749065    1604 logs.go:282] 0 containers: []

	W1109 14:33:46.749109    1604 logs.go:284] No container was found matching "kube-proxy"

	I1109 14:33:46.755677    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}

	I1109 14:33:46.786471    1604 logs.go:282] 2 containers: [f91f678ad8d3 25752fe0c294]

	I1109 14:33:46.794038    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}

	I1109 14:33:46.822810    1604 logs.go:282] 0 containers: []

	W1109 14:33:46.822810    1604 logs.go:284] No container was found matching "kindnet"

	I1109 14:33:46.830360    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}

	I1109 14:33:46.867043    1604 logs.go:282] 0 containers: []

	W1109 14:33:46.867086    1604 logs.go:284] No container was found matching "storage-provisioner"

	I1109 14:33:46.867086    1604 logs.go:123] Gathering logs for etcd [c23c494c3744] ...

	I1109 14:33:46.867086    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c23c494c3744"

	I1109 14:33:46.902386    1604 logs.go:123] Gathering logs for kube-scheduler [dcfa57dcafaf] ...

	I1109 14:33:46.902421    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 dcfa57dcafaf"

	I1109 14:33:46.949387    1604 logs.go:123] Gathering logs for kube-controller-manager [f91f678ad8d3] ...

	I1109 14:33:46.949387    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f91f678ad8d3"

	I1109 14:33:46.988346    1604 logs.go:123] Gathering logs for kube-controller-manager [25752fe0c294] ...

	I1109 14:33:46.988346    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 25752fe0c294"

	I1109 14:33:47.023795    1604 logs.go:123] Gathering logs for container status ...

	I1109 14:33:47.023829    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"

	I1109 14:33:47.109682    1604 logs.go:123] Gathering logs for kubelet ...

	I1109 14:33:47.109682    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"

	I1109 14:33:47.192622    1604 logs.go:123] Gathering logs for dmesg ...

	I1109 14:33:47.192622    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"

	I1109 14:33:47.218856    1604 logs.go:123] Gathering logs for kube-apiserver [1d7002c13770] ...

	I1109 14:33:47.218856    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 1d7002c13770"

	I1109 14:33:47.262064    1604 logs.go:123] Gathering logs for kube-scheduler [c1fa8e945752] ...

	I1109 14:33:47.262064    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c1fa8e945752"

	I1109 14:33:47.316379    1604 logs.go:123] Gathering logs for Docker ...

	I1109 14:33:47.316379    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"

	I1109 14:33:47.350656    1604 logs.go:123] Gathering logs for describe nodes ...

	I1109 14:33:47.350656    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"

	W1109 14:33:47.446361    1604 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1

	stdout:

	stderr:

	E1109 14:33:47.432880    6187 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:33:47.434645    6187 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:33:47.438035    6187 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:33:47.441246    6187 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:33:47.442237    6187 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	 output: 

	** stderr ** 

	E1109 14:33:47.432880    6187 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:33:47.434645    6187 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:33:47.438035    6187 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:33:47.441246    6187 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:33:47.442237    6187 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	** /stderr **

	I1109 14:33:49.946881    1604 api_server.go:253] Checking apiserver healthz at https://127.0.0.1:51763/healthz ...

	I1109 14:33:49.955913    1604 api_server.go:269] stopped: https://127.0.0.1:51763/healthz: Get "https://127.0.0.1:51763/healthz": EOF

	I1109 14:33:49.964964    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}

	I1109 14:33:50.005382    1604 logs.go:282] 1 containers: [1d7002c13770]

	I1109 14:33:50.011381    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}

	I1109 14:33:50.045385    1604 logs.go:282] 1 containers: [c23c494c3744]

	I1109 14:33:50.051383    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}

	I1109 14:33:50.084760    1604 logs.go:282] 0 containers: []

	W1109 14:33:50.084823    1604 logs.go:284] No container was found matching "coredns"

	I1109 14:33:50.093870    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}

	I1109 14:33:50.126181    1604 logs.go:282] 2 containers: [c1fa8e945752 dcfa57dcafaf]

	I1109 14:33:50.136826    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}

	I1109 14:33:50.184413    1604 logs.go:282] 0 containers: []

	W1109 14:33:50.184458    1604 logs.go:284] No container was found matching "kube-proxy"

	I1109 14:33:50.190767    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}

	I1109 14:33:50.225350    1604 logs.go:282] 2 containers: [f91f678ad8d3 25752fe0c294]

	I1109 14:33:50.232354    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}

	I1109 14:33:50.270925    1604 logs.go:282] 0 containers: []

	W1109 14:33:50.270925    1604 logs.go:284] No container was found matching "kindnet"

	I1109 14:33:50.280171    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}

	I1109 14:33:50.317006    1604 logs.go:282] 0 containers: []

	W1109 14:33:50.317006    1604 logs.go:284] No container was found matching "storage-provisioner"

	I1109 14:33:50.317006    1604 logs.go:123] Gathering logs for kubelet ...

	I1109 14:33:50.317006    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"

	I1109 14:33:50.411680    1604 logs.go:123] Gathering logs for describe nodes ...

	I1109 14:33:50.411680    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"

	W1109 14:33:50.505333    1604 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1

	stdout:

	stderr:

	E1109 14:33:50.493056    6285 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:33:50.494051    6285 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:33:50.500367    6285 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:33:50.501661    6285 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:33:50.502644    6285 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	 output: 

	** stderr ** 

	E1109 14:33:50.493056    6285 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:33:50.494051    6285 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:33:50.500367    6285 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:33:50.501661    6285 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:33:50.502644    6285 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	** /stderr **

	I1109 14:33:50.505333    1604 logs.go:123] Gathering logs for kube-apiserver [1d7002c13770] ...

	I1109 14:33:50.505333    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 1d7002c13770"

	I1109 14:33:50.553901    1604 logs.go:123] Gathering logs for kube-controller-manager [f91f678ad8d3] ...

	I1109 14:33:50.553901    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f91f678ad8d3"

	I1109 14:33:50.596855    1604 logs.go:123] Gathering logs for Docker ...

	I1109 14:33:50.596894    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"

	I1109 14:33:50.633760    1604 logs.go:123] Gathering logs for dmesg ...

	I1109 14:33:50.633760    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"

	I1109 14:33:50.665827    1604 logs.go:123] Gathering logs for etcd [c23c494c3744] ...

	I1109 14:33:50.665865    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c23c494c3744"

	I1109 14:33:50.699860    1604 logs.go:123] Gathering logs for kube-scheduler [c1fa8e945752] ...

	I1109 14:33:50.699949    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c1fa8e945752"

	I1109 14:33:50.756792    1604 logs.go:123] Gathering logs for kube-scheduler [dcfa57dcafaf] ...

	I1109 14:33:50.756792    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 dcfa57dcafaf"

	I1109 14:33:50.804871    1604 logs.go:123] Gathering logs for kube-controller-manager [25752fe0c294] ...

	I1109 14:33:50.804871    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 25752fe0c294"

	I1109 14:33:50.840340    1604 logs.go:123] Gathering logs for container status ...

	I1109 14:33:50.840886    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"

	I1109 14:33:53.441872    1604 api_server.go:253] Checking apiserver healthz at https://127.0.0.1:51763/healthz ...

	I1109 14:33:53.443865    1604 api_server.go:269] stopped: https://127.0.0.1:51763/healthz: Get "https://127.0.0.1:51763/healthz": EOF

	I1109 14:33:53.454286    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}

	I1109 14:33:53.483981    1604 logs.go:282] 1 containers: [1d7002c13770]

	I1109 14:33:53.489137    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}

	I1109 14:33:53.524219    1604 logs.go:282] 1 containers: [c23c494c3744]

	I1109 14:33:53.531266    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}

	I1109 14:33:53.562544    1604 logs.go:282] 0 containers: []

	W1109 14:33:53.562544    1604 logs.go:284] No container was found matching "coredns"

	I1109 14:33:53.567806    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}

	I1109 14:33:53.601733    1604 logs.go:282] 2 containers: [c1fa8e945752 dcfa57dcafaf]

	I1109 14:33:53.608615    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}

	I1109 14:33:53.641871    1604 logs.go:282] 0 containers: []

	W1109 14:33:53.641871    1604 logs.go:284] No container was found matching "kube-proxy"

	I1109 14:33:53.647871    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}

	I1109 14:33:53.679217    1604 logs.go:282] 2 containers: [f91f678ad8d3 25752fe0c294]

	I1109 14:33:53.685240    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}

	I1109 14:33:53.717142    1604 logs.go:282] 0 containers: []

	W1109 14:33:53.717142    1604 logs.go:284] No container was found matching "kindnet"

	I1109 14:33:53.726639    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}

	I1109 14:33:53.763271    1604 logs.go:282] 0 containers: []

	W1109 14:33:53.763271    1604 logs.go:284] No container was found matching "storage-provisioner"

	I1109 14:33:53.763271    1604 logs.go:123] Gathering logs for kube-scheduler [dcfa57dcafaf] ...

	I1109 14:33:53.763271    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 dcfa57dcafaf"

	I1109 14:33:53.809382    1604 logs.go:123] Gathering logs for kube-controller-manager [f91f678ad8d3] ...

	I1109 14:33:53.809382    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f91f678ad8d3"

	I1109 14:33:53.849372    1604 logs.go:123] Gathering logs for kube-controller-manager [25752fe0c294] ...

	I1109 14:33:53.849372    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 25752fe0c294"

	I1109 14:33:53.885372    1604 logs.go:123] Gathering logs for Docker ...

	I1109 14:33:53.885372    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"

	I1109 14:33:53.919874    1604 logs.go:123] Gathering logs for kubelet ...

	I1109 14:33:53.919874    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"

	I1109 14:33:54.008346    1604 logs.go:123] Gathering logs for kube-apiserver [1d7002c13770] ...

	I1109 14:33:54.008346    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 1d7002c13770"

	I1109 14:33:54.058528    1604 logs.go:123] Gathering logs for container status ...

	I1109 14:33:54.058528    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"

	I1109 14:33:54.156042    1604 logs.go:123] Gathering logs for dmesg ...

	I1109 14:33:54.156080    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"

	I1109 14:33:54.178530    1604 logs.go:123] Gathering logs for describe nodes ...

	I1109 14:33:54.178530    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"

	W1109 14:33:54.260091    1604 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1

	stdout:

	stderr:

	E1109 14:33:54.253740    6517 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:33:54.254708    6517 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:33:54.256085    6517 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:33:54.257020    6517 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:33:54.258297    6517 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	 output: 

	** stderr ** 

	E1109 14:33:54.253740    6517 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:33:54.254708    6517 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:33:54.256085    6517 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:33:54.257020    6517 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:33:54.258297    6517 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	** /stderr **

	I1109 14:33:54.260091    1604 logs.go:123] Gathering logs for etcd [c23c494c3744] ...

	I1109 14:33:54.261095    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c23c494c3744"

	I1109 14:33:54.297703    1604 logs.go:123] Gathering logs for kube-scheduler [c1fa8e945752] ...

	I1109 14:33:54.297703    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c1fa8e945752"

	I1109 14:33:56.861090    1604 api_server.go:253] Checking apiserver healthz at https://127.0.0.1:51763/healthz ...

	I1109 14:33:56.863953    1604 api_server.go:269] stopped: https://127.0.0.1:51763/healthz: Get "https://127.0.0.1:51763/healthz": EOF

	I1109 14:33:56.870722    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}

	I1109 14:33:56.902838    1604 logs.go:282] 2 containers: [578d9ee8b5ed 1d7002c13770]

	I1109 14:33:56.910020    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}

	I1109 14:33:56.943599    1604 logs.go:282] 1 containers: [c23c494c3744]

	I1109 14:33:56.950729    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}

	I1109 14:33:56.981727    1604 logs.go:282] 0 containers: []

	W1109 14:33:56.981727    1604 logs.go:284] No container was found matching "coredns"

	I1109 14:33:56.986732    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}

	I1109 14:33:57.040762    1604 logs.go:282] 2 containers: [c1fa8e945752 dcfa57dcafaf]

	I1109 14:33:57.046834    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}

	I1109 14:33:57.085111    1604 logs.go:282] 0 containers: []

	W1109 14:33:57.085196    1604 logs.go:284] No container was found matching "kube-proxy"

	I1109 14:33:57.091148    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}

	I1109 14:33:57.134903    1604 logs.go:282] 2 containers: [f91f678ad8d3 25752fe0c294]

	I1109 14:33:57.140900    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}

	I1109 14:33:57.176614    1604 logs.go:282] 0 containers: []

	W1109 14:33:57.176614    1604 logs.go:284] No container was found matching "kindnet"

	I1109 14:33:57.182603    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}

	I1109 14:33:57.231235    1604 logs.go:282] 0 containers: []

	W1109 14:33:57.231235    1604 logs.go:284] No container was found matching "storage-provisioner"

	I1109 14:33:57.231235    1604 logs.go:123] Gathering logs for Docker ...

	I1109 14:33:57.231235    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"

	I1109 14:33:57.258444    1604 logs.go:123] Gathering logs for container status ...

	I1109 14:33:57.258444    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"

	I1109 14:33:57.355691    1604 logs.go:123] Gathering logs for kubelet ...

	I1109 14:33:57.355691    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"

	I1109 14:33:57.443643    1604 logs.go:123] Gathering logs for dmesg ...

	I1109 14:33:57.443643    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"

	I1109 14:33:57.469093    1604 logs.go:123] Gathering logs for describe nodes ...

	I1109 14:33:57.469208    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"

	I1109 14:34:18.864555    1604 ssh_runner.go:235] Completed: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": (21.3951009s)

	W1109 14:34:18.864555    1604 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1

	stdout:

	stderr:

	E1109 14:34:07.553384    6731 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": net/http: TLS handshake timeout

	E1109 14:34:17.556263    6731 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": net/http: TLS handshake timeout

	E1109 14:34:18.856725    6731 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused - error from a previous attempt: read tcp [::1]:57360->[::1]:8443: read: connection reset by peer

	E1109 14:34:18.858238    6731 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:34:18.859227    6731 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	 output: 

	** stderr ** 

	E1109 14:34:07.553384    6731 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": net/http: TLS handshake timeout

	E1109 14:34:17.556263    6731 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": net/http: TLS handshake timeout

	E1109 14:34:18.856725    6731 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused - error from a previous attempt: read tcp [::1]:57360->[::1]:8443: read: connection reset by peer

	E1109 14:34:18.858238    6731 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:34:18.859227    6731 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	** /stderr **

	I1109 14:34:18.864555    1604 logs.go:123] Gathering logs for kube-apiserver [578d9ee8b5ed] ...

	I1109 14:34:18.864555    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 578d9ee8b5ed"

	I1109 14:34:18.913520    1604 logs.go:123] Gathering logs for etcd [c23c494c3744] ...

	I1109 14:34:18.913520    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c23c494c3744"

	I1109 14:34:18.953761    1604 logs.go:123] Gathering logs for kube-scheduler [c1fa8e945752] ...

	I1109 14:34:18.953761    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c1fa8e945752"

	I1109 14:34:19.009752    1604 logs.go:123] Gathering logs for kube-scheduler [dcfa57dcafaf] ...

	I1109 14:34:19.009752    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 dcfa57dcafaf"

	I1109 14:34:19.059771    1604 logs.go:123] Gathering logs for kube-controller-manager [f91f678ad8d3] ...

	I1109 14:34:19.059771    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f91f678ad8d3"

	I1109 14:34:19.128448    1604 logs.go:123] Gathering logs for kube-apiserver [1d7002c13770] ...

	I1109 14:34:19.128518    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 1d7002c13770"

	W1109 14:34:19.166421    1604 logs.go:130] failed kube-apiserver [1d7002c13770]: command: /bin/bash -c "docker logs --tail 400 1d7002c13770" /bin/bash -c "docker logs --tail 400 1d7002c13770": Process exited with status 1

	stdout:

	stderr:

	Error response from daemon: No such container: 1d7002c13770

	 output: 

	** stderr ** 

	Error response from daemon: No such container: 1d7002c13770

	** /stderr **

	I1109 14:34:19.166473    1604 logs.go:123] Gathering logs for kube-controller-manager [25752fe0c294] ...

	I1109 14:34:19.166473    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 25752fe0c294"

	I1109 14:34:21.710452    1604 api_server.go:253] Checking apiserver healthz at https://127.0.0.1:51763/healthz ...

	I1109 14:34:21.713835    1604 api_server.go:269] stopped: https://127.0.0.1:51763/healthz: Get "https://127.0.0.1:51763/healthz": EOF

	I1109 14:34:21.722688    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}

	I1109 14:34:21.758808    1604 logs.go:282] 1 containers: [578d9ee8b5ed]

	I1109 14:34:21.765308    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}

	I1109 14:34:21.795108    1604 logs.go:282] 1 containers: [c23c494c3744]

	I1109 14:34:21.804354    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}

	I1109 14:34:21.833579    1604 logs.go:282] 0 containers: []

	W1109 14:34:21.833579    1604 logs.go:284] No container was found matching "coredns"

	I1109 14:34:21.841245    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}

	I1109 14:34:21.878183    1604 logs.go:282] 2 containers: [c1fa8e945752 dcfa57dcafaf]

	I1109 14:34:21.884697    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}

	I1109 14:34:21.918718    1604 logs.go:282] 0 containers: []

	W1109 14:34:21.918718    1604 logs.go:284] No container was found matching "kube-proxy"

	I1109 14:34:21.925576    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}

	I1109 14:34:21.965332    1604 logs.go:282] 2 containers: [f91f678ad8d3 25752fe0c294]

	I1109 14:34:21.971925    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}

	I1109 14:34:22.005246    1604 logs.go:282] 0 containers: []

	W1109 14:34:22.005292    1604 logs.go:284] No container was found matching "kindnet"

	I1109 14:34:22.011838    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}

	I1109 14:34:22.043083    1604 logs.go:282] 0 containers: []

	W1109 14:34:22.043083    1604 logs.go:284] No container was found matching "storage-provisioner"

	I1109 14:34:22.043083    1604 logs.go:123] Gathering logs for dmesg ...

	I1109 14:34:22.043083    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"

	I1109 14:34:22.073713    1604 logs.go:123] Gathering logs for describe nodes ...

	I1109 14:34:22.073775    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"

	W1109 14:34:22.207401    1604 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1

	stdout:

	stderr:

	E1109 14:34:22.197031    6992 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:34:22.197969    6992 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:34:22.199756    6992 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:34:22.201604    6992 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:34:22.203110    6992 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	 output: 

	** stderr ** 

	E1109 14:34:22.197031    6992 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:34:22.197969    6992 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:34:22.199756    6992 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:34:22.201604    6992 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:34:22.203110    6992 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	** /stderr **

	I1109 14:34:22.207401    1604 logs.go:123] Gathering logs for kube-apiserver [578d9ee8b5ed] ...

	I1109 14:34:22.207401    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 578d9ee8b5ed"

	I1109 14:34:22.249381    1604 logs.go:123] Gathering logs for kube-scheduler [c1fa8e945752] ...

	I1109 14:34:22.249381    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c1fa8e945752"

	I1109 14:34:22.310157    1604 logs.go:123] Gathering logs for kube-controller-manager [f91f678ad8d3] ...

	I1109 14:34:22.310157    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f91f678ad8d3"

	I1109 14:34:22.356599    1604 logs.go:123] Gathering logs for kube-controller-manager [25752fe0c294] ...

	I1109 14:34:22.356599    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 25752fe0c294"

	I1109 14:34:22.395604    1604 logs.go:123] Gathering logs for container status ...

	I1109 14:34:22.395604    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"

	I1109 14:34:22.478729    1604 logs.go:123] Gathering logs for etcd [c23c494c3744] ...

	I1109 14:34:22.478729    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c23c494c3744"

	I1109 14:34:22.520866    1604 logs.go:123] Gathering logs for kube-scheduler [dcfa57dcafaf] ...

	I1109 14:34:22.520866    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 dcfa57dcafaf"

	I1109 14:34:22.572775    1604 logs.go:123] Gathering logs for Docker ...

	I1109 14:34:22.572775    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"

	I1109 14:34:22.605444    1604 logs.go:123] Gathering logs for kubelet ...

	I1109 14:34:22.605444    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"

	I1109 14:34:25.201868    1604 api_server.go:253] Checking apiserver healthz at https://127.0.0.1:51763/healthz ...

	I1109 14:34:25.204927    1604 api_server.go:269] stopped: https://127.0.0.1:51763/healthz: Get "https://127.0.0.1:51763/healthz": EOF

	I1109 14:34:25.212169    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}

	I1109 14:34:25.248999    1604 logs.go:282] 1 containers: [578d9ee8b5ed]

	I1109 14:34:25.255715    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}

	I1109 14:34:25.287375    1604 logs.go:282] 1 containers: [ee441d6c799c]

	I1109 14:34:25.294571    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}

	I1109 14:34:25.323437    1604 logs.go:282] 0 containers: []

	W1109 14:34:25.323437    1604 logs.go:284] No container was found matching "coredns"

	I1109 14:34:25.330082    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}

	I1109 14:34:25.362101    1604 logs.go:282] 2 containers: [c1fa8e945752 dcfa57dcafaf]

	I1109 14:34:25.368203    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}

	I1109 14:34:25.397324    1604 logs.go:282] 0 containers: []

	W1109 14:34:25.397324    1604 logs.go:284] No container was found matching "kube-proxy"

	I1109 14:34:25.403325    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}

	I1109 14:34:25.434037    1604 logs.go:282] 2 containers: [f91f678ad8d3 25752fe0c294]

	I1109 14:34:25.440099    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}

	I1109 14:34:25.469946    1604 logs.go:282] 0 containers: []

	W1109 14:34:25.469946    1604 logs.go:284] No container was found matching "kindnet"

	I1109 14:34:25.476749    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}

	I1109 14:34:25.508022    1604 logs.go:282] 0 containers: []

	W1109 14:34:25.508022    1604 logs.go:284] No container was found matching "storage-provisioner"

	I1109 14:34:25.508022    1604 logs.go:123] Gathering logs for container status ...

	I1109 14:34:25.508022    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"

	I1109 14:34:25.592489    1604 logs.go:123] Gathering logs for kubelet ...

	I1109 14:34:25.592489    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"

	I1109 14:34:25.685843    1604 logs.go:123] Gathering logs for dmesg ...

	I1109 14:34:25.685843    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"

	I1109 14:34:25.710741    1604 logs.go:123] Gathering logs for etcd [ee441d6c799c] ...

	I1109 14:34:25.710741    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ee441d6c799c"

	I1109 14:34:25.747816    1604 logs.go:123] Gathering logs for kube-scheduler [c1fa8e945752] ...

	I1109 14:34:25.747816    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c1fa8e945752"

	I1109 14:34:25.810458    1604 logs.go:123] Gathering logs for kube-scheduler [dcfa57dcafaf] ...

	I1109 14:34:25.810458    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 dcfa57dcafaf"

	I1109 14:34:25.853224    1604 logs.go:123] Gathering logs for kube-controller-manager [f91f678ad8d3] ...

	I1109 14:34:25.853224    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f91f678ad8d3"

	I1109 14:34:25.889842    1604 logs.go:123] Gathering logs for Docker ...

	I1109 14:34:25.889842    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"

	I1109 14:34:25.921248    1604 logs.go:123] Gathering logs for describe nodes ...

	I1109 14:34:25.921248    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"

	W1109 14:34:26.008625    1604 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1

	stdout:

	stderr:

	E1109 14:34:25.998620    7322 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:34:25.999509    7322 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:34:26.001602    7322 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:34:26.002490    7322 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:34:26.005120    7322 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	 output: 

	** stderr ** 

	E1109 14:34:25.998620    7322 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:34:25.999509    7322 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:34:26.001602    7322 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:34:26.002490    7322 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:34:26.005120    7322 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	** /stderr **

	I1109 14:34:26.008625    1604 logs.go:123] Gathering logs for kube-apiserver [578d9ee8b5ed] ...

	I1109 14:34:26.008625    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 578d9ee8b5ed"

	I1109 14:34:26.053911    1604 logs.go:123] Gathering logs for kube-controller-manager [25752fe0c294] ...

	I1109 14:34:26.053911    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 25752fe0c294"

	I1109 14:34:28.590186    1604 api_server.go:253] Checking apiserver healthz at https://127.0.0.1:51763/healthz ...

	I1109 14:34:28.592743    1604 api_server.go:269] stopped: https://127.0.0.1:51763/healthz: Get "https://127.0.0.1:51763/healthz": EOF

	I1109 14:34:28.598845    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}

	I1109 14:34:28.630993    1604 logs.go:282] 1 containers: [578d9ee8b5ed]

	I1109 14:34:28.637100    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}

	I1109 14:34:28.667725    1604 logs.go:282] 1 containers: [ee441d6c799c]

	I1109 14:34:28.673498    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}

	I1109 14:34:28.706753    1604 logs.go:282] 0 containers: []

	W1109 14:34:28.706753    1604 logs.go:284] No container was found matching "coredns"

	I1109 14:34:28.712933    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}

	I1109 14:34:28.743281    1604 logs.go:282] 2 containers: [c1fa8e945752 dcfa57dcafaf]

	I1109 14:34:28.748961    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}

	I1109 14:34:28.784914    1604 logs.go:282] 0 containers: []

	W1109 14:34:28.784914    1604 logs.go:284] No container was found matching "kube-proxy"

	I1109 14:34:28.791530    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}

	I1109 14:34:28.821194    1604 logs.go:282] 2 containers: [f91f678ad8d3 25752fe0c294]

	I1109 14:34:28.827428    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}

	I1109 14:34:28.858766    1604 logs.go:282] 0 containers: []

	W1109 14:34:28.858766    1604 logs.go:284] No container was found matching "kindnet"

	I1109 14:34:28.867469    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}

	I1109 14:34:28.897804    1604 logs.go:282] 0 containers: []

	W1109 14:34:28.897804    1604 logs.go:284] No container was found matching "storage-provisioner"

	I1109 14:34:28.897804    1604 logs.go:123] Gathering logs for Docker ...

	I1109 14:34:28.897804    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"

	I1109 14:34:28.927766    1604 logs.go:123] Gathering logs for container status ...

	I1109 14:34:28.927766    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"

	I1109 14:34:29.007120    1604 logs.go:123] Gathering logs for describe nodes ...

	I1109 14:34:29.007640    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"

	W1109 14:34:29.098114    1604 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1

	stdout:

	stderr:

	E1109 14:34:29.089754    7453 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:34:29.091204    7453 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:34:29.092161    7453 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:34:29.093347    7453 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:34:29.095190    7453 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	 output: 

	** stderr ** 

	E1109 14:34:29.089754    7453 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:34:29.091204    7453 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:34:29.092161    7453 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:34:29.093347    7453 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:34:29.095190    7453 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	** /stderr **

	I1109 14:34:29.098114    1604 logs.go:123] Gathering logs for etcd [ee441d6c799c] ...

	I1109 14:34:29.098114    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ee441d6c799c"

	I1109 14:34:29.132704    1604 logs.go:123] Gathering logs for kube-controller-manager [f91f678ad8d3] ...

	I1109 14:34:29.132704    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f91f678ad8d3"

	I1109 14:34:29.171199    1604 logs.go:123] Gathering logs for kubelet ...

	I1109 14:34:29.171199    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"

	I1109 14:34:29.265562    1604 logs.go:123] Gathering logs for dmesg ...

	I1109 14:34:29.266560    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"

	I1109 14:34:29.290825    1604 logs.go:123] Gathering logs for kube-apiserver [578d9ee8b5ed] ...

	I1109 14:34:29.290825    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 578d9ee8b5ed"

	I1109 14:34:29.331576    1604 logs.go:123] Gathering logs for kube-scheduler [c1fa8e945752] ...

	I1109 14:34:29.331576    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c1fa8e945752"

	I1109 14:34:29.394807    1604 logs.go:123] Gathering logs for kube-scheduler [dcfa57dcafaf] ...

	I1109 14:34:29.395803    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 dcfa57dcafaf"

	I1109 14:34:29.444461    1604 logs.go:123] Gathering logs for kube-controller-manager [25752fe0c294] ...

	I1109 14:34:29.444461    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 25752fe0c294"

	I1109 14:34:31.981617    1604 api_server.go:253] Checking apiserver healthz at https://127.0.0.1:51763/healthz ...

	I1109 14:34:31.984436    1604 api_server.go:269] stopped: https://127.0.0.1:51763/healthz: Get "https://127.0.0.1:51763/healthz": EOF

	I1109 14:34:31.990760    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}

	I1109 14:34:32.026471    1604 logs.go:282] 1 containers: [578d9ee8b5ed]

	I1109 14:34:32.038695    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}

	I1109 14:34:32.072141    1604 logs.go:282] 1 containers: [ee441d6c799c]

	I1109 14:34:32.080790    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}

	I1109 14:34:32.111004    1604 logs.go:282] 0 containers: []

	W1109 14:34:32.111004    1604 logs.go:284] No container was found matching "coredns"

	I1109 14:34:32.117196    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}

	I1109 14:34:32.150370    1604 logs.go:282] 2 containers: [c1fa8e945752 dcfa57dcafaf]

	I1109 14:34:32.156942    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}

	I1109 14:34:32.188544    1604 logs.go:282] 0 containers: []

	W1109 14:34:32.188544    1604 logs.go:284] No container was found matching "kube-proxy"

	I1109 14:34:32.195022    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}

	I1109 14:34:32.228524    1604 logs.go:282] 2 containers: [f91f678ad8d3 25752fe0c294]

	I1109 14:34:32.238683    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}

	I1109 14:34:32.270513    1604 logs.go:282] 0 containers: []

	W1109 14:34:32.270513    1604 logs.go:284] No container was found matching "kindnet"

	I1109 14:34:32.276651    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}

	I1109 14:34:32.307178    1604 logs.go:282] 0 containers: []

	W1109 14:34:32.307178    1604 logs.go:284] No container was found matching "storage-provisioner"

	I1109 14:34:32.307178    1604 logs.go:123] Gathering logs for kubelet ...

	I1109 14:34:32.307178    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"

	I1109 14:34:32.399640    1604 logs.go:123] Gathering logs for dmesg ...

	I1109 14:34:32.399640    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"

	I1109 14:34:32.424837    1604 logs.go:123] Gathering logs for describe nodes ...

	I1109 14:34:32.424892    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"

	W1109 14:34:32.511238    1604 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1

	stdout:

	stderr:

	E1109 14:34:32.502759    7614 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:34:32.503620    7614 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:34:32.504740    7614 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:34:32.505526    7614 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:34:32.507912    7614 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	 output: 

	** stderr ** 

	E1109 14:34:32.502759    7614 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:34:32.503620    7614 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:34:32.504740    7614 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:34:32.505526    7614 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:34:32.507912    7614 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	** /stderr **

	I1109 14:34:32.511238    1604 logs.go:123] Gathering logs for kube-apiserver [578d9ee8b5ed] ...

	I1109 14:34:32.511238    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 578d9ee8b5ed"

	I1109 14:34:32.549551    1604 logs.go:123] Gathering logs for etcd [ee441d6c799c] ...

	I1109 14:34:32.549601    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ee441d6c799c"

	I1109 14:34:32.583850    1604 logs.go:123] Gathering logs for kube-controller-manager [f91f678ad8d3] ...

	I1109 14:34:32.583850    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f91f678ad8d3"

	I1109 14:34:32.616826    1604 logs.go:123] Gathering logs for container status ...

	I1109 14:34:32.616826    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"

	I1109 14:34:32.696116    1604 logs.go:123] Gathering logs for kube-scheduler [c1fa8e945752] ...

	I1109 14:34:32.696116    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c1fa8e945752"

	I1109 14:34:32.762800    1604 logs.go:123] Gathering logs for kube-scheduler [dcfa57dcafaf] ...

	I1109 14:34:32.762800    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 dcfa57dcafaf"

	I1109 14:34:32.809522    1604 logs.go:123] Gathering logs for kube-controller-manager [25752fe0c294] ...

	I1109 14:34:32.809522    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 25752fe0c294"

	I1109 14:34:32.846881    1604 logs.go:123] Gathering logs for Docker ...

	I1109 14:34:32.846942    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"

	I1109 14:34:35.376439    1604 api_server.go:253] Checking apiserver healthz at https://127.0.0.1:51763/healthz ...

	I1109 14:34:35.379303    1604 api_server.go:269] stopped: https://127.0.0.1:51763/healthz: Get "https://127.0.0.1:51763/healthz": EOF

	I1109 14:34:35.384928    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}

	I1109 14:34:35.416008    1604 logs.go:282] 1 containers: [578d9ee8b5ed]

	I1109 14:34:35.422164    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}

	I1109 14:34:35.452764    1604 logs.go:282] 1 containers: [ee441d6c799c]

	I1109 14:34:35.458711    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}

	I1109 14:34:35.488167    1604 logs.go:282] 0 containers: []

	W1109 14:34:35.488204    1604 logs.go:284] No container was found matching "coredns"

	I1109 14:34:35.494313    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}

	I1109 14:34:35.529173    1604 logs.go:282] 2 containers: [c1fa8e945752 dcfa57dcafaf]

	I1109 14:34:35.535221    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}

	I1109 14:34:35.564725    1604 logs.go:282] 0 containers: []

	W1109 14:34:35.564813    1604 logs.go:284] No container was found matching "kube-proxy"

	I1109 14:34:35.570445    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}

	I1109 14:34:35.602808    1604 logs.go:282] 2 containers: [f91f678ad8d3 25752fe0c294]

	I1109 14:34:35.608794    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}

	I1109 14:34:35.639427    1604 logs.go:282] 0 containers: []

	W1109 14:34:35.639458    1604 logs.go:284] No container was found matching "kindnet"

	I1109 14:34:35.645364    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}

	I1109 14:34:35.676424    1604 logs.go:282] 0 containers: []

	W1109 14:34:35.676520    1604 logs.go:284] No container was found matching "storage-provisioner"

	I1109 14:34:35.676552    1604 logs.go:123] Gathering logs for Docker ...

	I1109 14:34:35.676552    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"

	I1109 14:34:35.710407    1604 logs.go:123] Gathering logs for kubelet ...

	I1109 14:34:35.710407    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"

	I1109 14:34:35.806084    1604 logs.go:123] Gathering logs for kube-apiserver [578d9ee8b5ed] ...

	I1109 14:34:35.806084    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 578d9ee8b5ed"

	I1109 14:34:35.848128    1604 logs.go:123] Gathering logs for kube-scheduler [c1fa8e945752] ...

	I1109 14:34:35.848165    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c1fa8e945752"

	I1109 14:34:36.106794    1604 logs.go:123] Gathering logs for kube-controller-manager [25752fe0c294] ...

	I1109 14:34:36.106794    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 25752fe0c294"

	I1109 14:34:36.143663    1604 logs.go:123] Gathering logs for container status ...

	I1109 14:34:36.143663    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"

	I1109 14:34:36.227755    1604 logs.go:123] Gathering logs for dmesg ...

	I1109 14:34:36.227755    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"

	I1109 14:34:36.249452    1604 logs.go:123] Gathering logs for describe nodes ...

	I1109 14:34:36.249984    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"

	W1109 14:34:36.335584    1604 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1

	stdout:

	stderr:

	E1109 14:34:36.323372    7850 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:34:36.324299    7850 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:34:36.327373    7850 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:34:36.328709    7850 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:34:36.329829    7850 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	 output: 

	** stderr ** 

	E1109 14:34:36.323372    7850 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:34:36.324299    7850 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:34:36.327373    7850 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:34:36.328709    7850 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:34:36.329829    7850 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	** /stderr **

	I1109 14:34:36.335584    1604 logs.go:123] Gathering logs for etcd [ee441d6c799c] ...

	I1109 14:34:36.335584    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ee441d6c799c"

	I1109 14:34:36.372527    1604 logs.go:123] Gathering logs for kube-scheduler [dcfa57dcafaf] ...

	I1109 14:34:36.372606    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 dcfa57dcafaf"

	I1109 14:34:36.418191    1604 logs.go:123] Gathering logs for kube-controller-manager [f91f678ad8d3] ...

	I1109 14:34:36.418191    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f91f678ad8d3"

	I1109 14:34:38.954614    1604 api_server.go:253] Checking apiserver healthz at https://127.0.0.1:51763/healthz ...

	I1109 14:34:38.957315    1604 api_server.go:269] stopped: https://127.0.0.1:51763/healthz: Get "https://127.0.0.1:51763/healthz": EOF

	I1109 14:34:38.963331    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}

	I1109 14:34:38.993017    1604 logs.go:282] 1 containers: [578d9ee8b5ed]

	I1109 14:34:38.998817    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}

	I1109 14:34:39.029813    1604 logs.go:282] 1 containers: [ee441d6c799c]

	I1109 14:34:39.035916    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}

	I1109 14:34:39.065932    1604 logs.go:282] 0 containers: []

	W1109 14:34:39.065932    1604 logs.go:284] No container was found matching "coredns"

	I1109 14:34:39.073731    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}

	I1109 14:34:39.108532    1604 logs.go:282] 2 containers: [c1fa8e945752 dcfa57dcafaf]

	I1109 14:34:39.115272    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}

	I1109 14:34:39.148075    1604 logs.go:282] 0 containers: []

	W1109 14:34:39.148075    1604 logs.go:284] No container was found matching "kube-proxy"

	I1109 14:34:39.155086    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}

	I1109 14:34:39.185131    1604 logs.go:282] 2 containers: [f91f678ad8d3 25752fe0c294]

	I1109 14:34:39.191269    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}

	I1109 14:34:39.226671    1604 logs.go:282] 0 containers: []

	W1109 14:34:39.226671    1604 logs.go:284] No container was found matching "kindnet"

	I1109 14:34:39.234589    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}

	I1109 14:34:39.267719    1604 logs.go:282] 0 containers: []

	W1109 14:34:39.267719    1604 logs.go:284] No container was found matching "storage-provisioner"

	I1109 14:34:39.267719    1604 logs.go:123] Gathering logs for etcd [ee441d6c799c] ...

	I1109 14:34:39.267719    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ee441d6c799c"

	I1109 14:34:39.304467    1604 logs.go:123] Gathering logs for kube-scheduler [dcfa57dcafaf] ...

	I1109 14:34:39.304569    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 dcfa57dcafaf"

	I1109 14:34:39.353955    1604 logs.go:123] Gathering logs for Docker ...

	I1109 14:34:39.353955    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"

	I1109 14:34:39.383323    1604 logs.go:123] Gathering logs for container status ...

	I1109 14:34:39.383323    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"

	I1109 14:34:39.463049    1604 logs.go:123] Gathering logs for dmesg ...

	I1109 14:34:39.463049    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"

	I1109 14:34:39.486133    1604 logs.go:123] Gathering logs for describe nodes ...

	I1109 14:34:39.486186    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"

	W1109 14:34:39.571418    1604 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1

	stdout:

	stderr:

	E1109 14:34:39.560366    8018 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:34:39.561486    8018 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:34:39.564723    8018 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:34:39.565274    8018 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:34:39.567592    8018 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	 output: 

	** stderr ** 

	E1109 14:34:39.560366    8018 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:34:39.561486    8018 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:34:39.564723    8018 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:34:39.565274    8018 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:34:39.567592    8018 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	** /stderr **

	I1109 14:34:39.571418    1604 logs.go:123] Gathering logs for kube-scheduler [c1fa8e945752] ...

	I1109 14:34:39.571418    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c1fa8e945752"

	I1109 14:34:39.636337    1604 logs.go:123] Gathering logs for kube-controller-manager [f91f678ad8d3] ...

	I1109 14:34:39.636337    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f91f678ad8d3"

	I1109 14:34:39.822130    1604 logs.go:123] Gathering logs for kube-controller-manager [25752fe0c294] ...

	I1109 14:34:39.822213    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 25752fe0c294"

	I1109 14:34:39.873450    1604 logs.go:123] Gathering logs for kubelet ...

	I1109 14:34:39.873450    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"

	I1109 14:34:40.006864    1604 logs.go:123] Gathering logs for kube-apiserver [578d9ee8b5ed] ...

	I1109 14:34:40.006864    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 578d9ee8b5ed"

	I1109 14:34:42.555174    1604 api_server.go:253] Checking apiserver healthz at https://127.0.0.1:51763/healthz ...

	I1109 14:34:42.558873    1604 api_server.go:269] stopped: https://127.0.0.1:51763/healthz: Get "https://127.0.0.1:51763/healthz": EOF

	I1109 14:34:42.564683    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}

	I1109 14:34:42.598191    1604 logs.go:282] 1 containers: [578d9ee8b5ed]

	I1109 14:34:42.604518    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}

	I1109 14:34:42.635816    1604 logs.go:282] 1 containers: [ee441d6c799c]

	I1109 14:34:42.643810    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}

	I1109 14:34:42.676862    1604 logs.go:282] 0 containers: []

	W1109 14:34:42.676862    1604 logs.go:284] No container was found matching "coredns"

	I1109 14:34:42.684670    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}

	I1109 14:34:42.716466    1604 logs.go:282] 2 containers: [c1fa8e945752 dcfa57dcafaf]

	I1109 14:34:42.722458    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}

	I1109 14:34:42.754629    1604 logs.go:282] 0 containers: []

	W1109 14:34:42.754629    1604 logs.go:284] No container was found matching "kube-proxy"

	I1109 14:34:42.763140    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}

	I1109 14:34:42.797156    1604 logs.go:282] 1 containers: [f91f678ad8d3]

	I1109 14:34:42.807203    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}

	I1109 14:34:42.838709    1604 logs.go:282] 0 containers: []

	W1109 14:34:42.838709    1604 logs.go:284] No container was found matching "kindnet"

	I1109 14:34:42.844706    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}

	I1109 14:34:42.879654    1604 logs.go:282] 0 containers: []

	W1109 14:34:42.879654    1604 logs.go:284] No container was found matching "storage-provisioner"

	I1109 14:34:42.879654    1604 logs.go:123] Gathering logs for dmesg ...

	I1109 14:34:42.879654    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"

	I1109 14:34:42.903161    1604 logs.go:123] Gathering logs for kube-apiserver [578d9ee8b5ed] ...

	I1109 14:34:42.903232    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 578d9ee8b5ed"

	I1109 14:34:42.942671    1604 logs.go:123] Gathering logs for kube-scheduler [c1fa8e945752] ...

	I1109 14:34:42.942782    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c1fa8e945752"

	I1109 14:34:43.016597    1604 logs.go:123] Gathering logs for kube-scheduler [dcfa57dcafaf] ...

	I1109 14:34:43.016597    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 dcfa57dcafaf"

	I1109 14:34:43.065476    1604 logs.go:123] Gathering logs for kube-controller-manager [f91f678ad8d3] ...

	I1109 14:34:43.065476    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f91f678ad8d3"

	I1109 14:34:43.097435    1604 logs.go:123] Gathering logs for Docker ...

	I1109 14:34:43.097435    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"

	I1109 14:34:43.132122    1604 logs.go:123] Gathering logs for kubelet ...

	I1109 14:34:43.132122    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"

	I1109 14:34:43.262108    1604 logs.go:123] Gathering logs for describe nodes ...

	I1109 14:34:43.263108    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"

	W1109 14:34:43.361799    1604 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1

	stdout:

	stderr:

	E1109 14:34:43.349828    8204 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:34:43.350817    8204 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:34:43.353111    8204 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:34:43.354156    8204 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:34:43.356773    8204 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	 output: 

	** stderr ** 

	E1109 14:34:43.349828    8204 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:34:43.350817    8204 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:34:43.353111    8204 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:34:43.354156    8204 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:34:43.356773    8204 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	** /stderr **

	I1109 14:34:43.361799    1604 logs.go:123] Gathering logs for etcd [ee441d6c799c] ...

	I1109 14:34:43.361799    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ee441d6c799c"

	I1109 14:34:43.398019    1604 logs.go:123] Gathering logs for container status ...

	I1109 14:34:43.398019    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"

	I1109 14:34:45.994726    1604 api_server.go:253] Checking apiserver healthz at https://127.0.0.1:51763/healthz ...

	I1109 14:34:45.997162    1604 api_server.go:269] stopped: https://127.0.0.1:51763/healthz: Get "https://127.0.0.1:51763/healthz": EOF

	I1109 14:34:46.003865    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}

	I1109 14:34:46.045151    1604 logs.go:282] 1 containers: [578d9ee8b5ed]

	I1109 14:34:46.053998    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}

	I1109 14:34:46.097357    1604 logs.go:282] 1 containers: [ee441d6c799c]

	I1109 14:34:46.105322    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}

	I1109 14:34:46.136167    1604 logs.go:282] 0 containers: []

	W1109 14:34:46.136167    1604 logs.go:284] No container was found matching "coredns"

	I1109 14:34:46.141643    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}

	I1109 14:34:46.173490    1604 logs.go:282] 2 containers: [c1fa8e945752 dcfa57dcafaf]

	I1109 14:34:46.181549    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}

	I1109 14:34:46.210124    1604 logs.go:282] 0 containers: []

	W1109 14:34:46.210206    1604 logs.go:284] No container was found matching "kube-proxy"

	I1109 14:34:46.216530    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}

	I1109 14:34:46.251349    1604 logs.go:282] 1 containers: [f91f678ad8d3]

	I1109 14:34:46.259251    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}

	I1109 14:34:46.293251    1604 logs.go:282] 0 containers: []

	W1109 14:34:46.293302    1604 logs.go:284] No container was found matching "kindnet"

	I1109 14:34:46.300185    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}

	I1109 14:34:46.338130    1604 logs.go:282] 0 containers: []

	W1109 14:34:46.338130    1604 logs.go:284] No container was found matching "storage-provisioner"

	I1109 14:34:46.338191    1604 logs.go:123] Gathering logs for describe nodes ...

	I1109 14:34:46.338191    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"

	W1109 14:34:46.440432    1604 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1

	stdout:

	stderr:

	E1109 14:34:46.429783    8337 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:34:46.430768    8337 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:34:46.431969    8337 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:34:46.433941    8337 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:34:46.436022    8337 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	 output: 

	** stderr ** 

	E1109 14:34:46.429783    8337 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:34:46.430768    8337 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:34:46.431969    8337 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:34:46.433941    8337 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:34:46.436022    8337 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	** /stderr **

	I1109 14:34:46.440432    1604 logs.go:123] Gathering logs for kube-apiserver [578d9ee8b5ed] ...

	I1109 14:34:46.440432    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 578d9ee8b5ed"

	I1109 14:34:46.480108    1604 logs.go:123] Gathering logs for etcd [ee441d6c799c] ...

	I1109 14:34:46.480184    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ee441d6c799c"

	I1109 14:34:46.519515    1604 logs.go:123] Gathering logs for kube-scheduler [c1fa8e945752] ...

	I1109 14:34:46.519608    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c1fa8e945752"

	I1109 14:34:46.587971    1604 logs.go:123] Gathering logs for kubelet ...

	I1109 14:34:46.587971    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"

	I1109 14:34:46.689642    1604 logs.go:123] Gathering logs for kube-scheduler [dcfa57dcafaf] ...

	I1109 14:34:46.689642    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 dcfa57dcafaf"

	I1109 14:34:46.735530    1604 logs.go:123] Gathering logs for kube-controller-manager [f91f678ad8d3] ...

	I1109 14:34:46.735530    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f91f678ad8d3"

	I1109 14:34:46.773957    1604 logs.go:123] Gathering logs for Docker ...

	I1109 14:34:46.774026    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"

	I1109 14:34:46.803267    1604 logs.go:123] Gathering logs for container status ...

	I1109 14:34:46.803267    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"

	I1109 14:34:46.884264    1604 logs.go:123] Gathering logs for dmesg ...

	I1109 14:34:46.884293    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"

	I1109 14:34:49.410318    1604 api_server.go:253] Checking apiserver healthz at https://127.0.0.1:51763/healthz ...

	I1109 14:34:49.413818    1604 api_server.go:269] stopped: https://127.0.0.1:51763/healthz: Get "https://127.0.0.1:51763/healthz": EOF

	I1109 14:34:49.420237    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}

	I1109 14:34:49.452216    1604 logs.go:282] 1 containers: [578d9ee8b5ed]

	I1109 14:34:49.458731    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}

	I1109 14:34:49.491788    1604 logs.go:282] 1 containers: [ee441d6c799c]

	I1109 14:34:49.498238    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}

	I1109 14:34:49.529271    1604 logs.go:282] 0 containers: []

	W1109 14:34:49.529271    1604 logs.go:284] No container was found matching "coredns"

	I1109 14:34:49.535231    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}

	I1109 14:34:49.573458    1604 logs.go:282] 2 containers: [c1fa8e945752 dcfa57dcafaf]

	I1109 14:34:49.579819    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}

	I1109 14:34:49.616669    1604 logs.go:282] 0 containers: []

	W1109 14:34:49.616717    1604 logs.go:284] No container was found matching "kube-proxy"

	I1109 14:34:49.623069    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}

	I1109 14:34:49.654333    1604 logs.go:282] 1 containers: [f91f678ad8d3]

	I1109 14:34:49.660380    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}

	I1109 14:34:49.690183    1604 logs.go:282] 0 containers: []

	W1109 14:34:49.690183    1604 logs.go:284] No container was found matching "kindnet"

	I1109 14:34:49.699139    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}

	I1109 14:34:49.731916    1604 logs.go:282] 0 containers: []

	W1109 14:34:49.731916    1604 logs.go:284] No container was found matching "storage-provisioner"

	I1109 14:34:49.731916    1604 logs.go:123] Gathering logs for describe nodes ...

	I1109 14:34:49.731916    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"

	W1109 14:34:49.835056    1604 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1

	stdout:

	stderr:

	E1109 14:34:49.823751    8497 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:34:49.824833    8497 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:34:49.825691    8497 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:34:49.828532    8497 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:34:49.829304    8497 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	 output: 

	** stderr ** 

	E1109 14:34:49.823751    8497 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:34:49.824833    8497 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:34:49.825691    8497 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:34:49.828532    8497 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:34:49.829304    8497 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	** /stderr **

	I1109 14:34:49.835056    1604 logs.go:123] Gathering logs for kube-apiserver [578d9ee8b5ed] ...

	I1109 14:34:49.835056    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 578d9ee8b5ed"

	I1109 14:34:49.880766    1604 logs.go:123] Gathering logs for kube-scheduler [c1fa8e945752] ...

	I1109 14:34:49.880823    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c1fa8e945752"

	I1109 14:34:49.944755    1604 logs.go:123] Gathering logs for kube-scheduler [dcfa57dcafaf] ...

	I1109 14:34:49.944755    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 dcfa57dcafaf"

	I1109 14:34:49.992117    1604 logs.go:123] Gathering logs for kube-controller-manager [f91f678ad8d3] ...

	I1109 14:34:49.992117    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f91f678ad8d3"

	I1109 14:34:50.034710    1604 logs.go:123] Gathering logs for dmesg ...

	I1109 14:34:50.034766    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"

	I1109 14:34:50.060166    1604 logs.go:123] Gathering logs for etcd [ee441d6c799c] ...

	I1109 14:34:50.060202    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ee441d6c799c"

	I1109 14:34:50.097371    1604 logs.go:123] Gathering logs for Docker ...

	I1109 14:34:50.097476    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"

	I1109 14:34:50.126843    1604 logs.go:123] Gathering logs for container status ...

	I1109 14:34:50.126843    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"

	I1109 14:34:50.210229    1604 logs.go:123] Gathering logs for kubelet ...

	I1109 14:34:50.210275    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"

	I1109 14:34:52.805910    1604 api_server.go:253] Checking apiserver healthz at https://127.0.0.1:51763/healthz ...

	I1109 14:34:52.808773    1604 api_server.go:269] stopped: https://127.0.0.1:51763/healthz: Get "https://127.0.0.1:51763/healthz": EOF

	I1109 14:34:52.815160    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}

	I1109 14:34:52.847911    1604 logs.go:282] 1 containers: [578d9ee8b5ed]

	I1109 14:34:52.853781    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}

	I1109 14:34:52.887978    1604 logs.go:282] 1 containers: [ee441d6c799c]

	I1109 14:34:52.894184    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}

	I1109 14:34:52.923965    1604 logs.go:282] 0 containers: []

	W1109 14:34:52.923965    1604 logs.go:284] No container was found matching "coredns"

	I1109 14:34:52.931883    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}

	I1109 14:34:52.964950    1604 logs.go:282] 2 containers: [c1fa8e945752 dcfa57dcafaf]

	I1109 14:34:52.971321    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}

	I1109 14:34:53.000095    1604 logs.go:282] 0 containers: []

	W1109 14:34:53.000143    1604 logs.go:284] No container was found matching "kube-proxy"

	I1109 14:34:53.006773    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}

	I1109 14:34:53.036566    1604 logs.go:282] 1 containers: [f91f678ad8d3]

	I1109 14:34:53.043016    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}

	I1109 14:34:53.072956    1604 logs.go:282] 0 containers: []

	W1109 14:34:53.072956    1604 logs.go:284] No container was found matching "kindnet"

	I1109 14:34:53.077960    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}

	I1109 14:34:53.107059    1604 logs.go:282] 0 containers: []

	W1109 14:34:53.107097    1604 logs.go:284] No container was found matching "storage-provisioner"

	I1109 14:34:53.107124    1604 logs.go:123] Gathering logs for container status ...

	I1109 14:34:53.107124    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"

	I1109 14:34:53.184627    1604 logs.go:123] Gathering logs for kube-apiserver [578d9ee8b5ed] ...

	I1109 14:34:53.184627    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 578d9ee8b5ed"

	I1109 14:34:53.221626    1604 logs.go:123] Gathering logs for etcd [ee441d6c799c] ...

	I1109 14:34:53.221626    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ee441d6c799c"

	I1109 14:34:53.253850    1604 logs.go:123] Gathering logs for kube-scheduler [c1fa8e945752] ...

	I1109 14:34:53.253921    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c1fa8e945752"

	I1109 14:34:53.321871    1604 logs.go:123] Gathering logs for Docker ...

	I1109 14:34:53.321871    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"

	I1109 14:34:53.354543    1604 logs.go:123] Gathering logs for kubelet ...

	I1109 14:34:53.354543    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"

	I1109 14:34:53.455318    1604 logs.go:123] Gathering logs for dmesg ...

	I1109 14:34:53.455318    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"

	I1109 14:34:53.479776    1604 logs.go:123] Gathering logs for describe nodes ...

	I1109 14:34:53.479811    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"

	W1109 14:34:53.570103    1604 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1

	stdout:

	stderr:

	E1109 14:34:53.559764    8726 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:34:53.561058    8726 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:34:53.562518    8726 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:34:53.563953    8726 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:34:53.565273    8726 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	 output: 

	** stderr ** 

	E1109 14:34:53.559764    8726 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:34:53.561058    8726 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:34:53.562518    8726 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:34:53.563953    8726 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:34:53.565273    8726 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	** /stderr **

	I1109 14:34:53.570103    1604 logs.go:123] Gathering logs for kube-scheduler [dcfa57dcafaf] ...

	I1109 14:34:53.570103    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 dcfa57dcafaf"

	I1109 14:34:53.614580    1604 logs.go:123] Gathering logs for kube-controller-manager [f91f678ad8d3] ...

	I1109 14:34:53.614580    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f91f678ad8d3"

	I1109 14:34:56.147485    1604 api_server.go:253] Checking apiserver healthz at https://127.0.0.1:51763/healthz ...

	I1109 14:34:56.150497    1604 api_server.go:269] stopped: https://127.0.0.1:51763/healthz: Get "https://127.0.0.1:51763/healthz": EOF

	I1109 14:34:56.157079    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}

	I1109 14:34:56.185827    1604 logs.go:282] 1 containers: [578d9ee8b5ed]

	I1109 14:34:56.191823    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}

	I1109 14:34:56.221316    1604 logs.go:282] 1 containers: [ee441d6c799c]

	I1109 14:34:56.227046    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}

	I1109 14:34:56.258695    1604 logs.go:282] 0 containers: []

	W1109 14:34:56.258695    1604 logs.go:284] No container was found matching "coredns"

	I1109 14:34:56.263684    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}

	I1109 14:34:56.294062    1604 logs.go:282] 2 containers: [c1fa8e945752 dcfa57dcafaf]

	I1109 14:34:56.300163    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}

	I1109 14:34:56.330085    1604 logs.go:282] 0 containers: []

	W1109 14:34:56.330085    1604 logs.go:284] No container was found matching "kube-proxy"

	I1109 14:34:56.336560    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}

	I1109 14:34:56.369608    1604 logs.go:282] 1 containers: [f91f678ad8d3]

	I1109 14:34:56.376619    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}

	I1109 14:34:56.405604    1604 logs.go:282] 0 containers: []

	W1109 14:34:56.405604    1604 logs.go:284] No container was found matching "kindnet"

	I1109 14:34:56.410611    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}

	I1109 14:34:56.443602    1604 logs.go:282] 0 containers: []

	W1109 14:34:56.443602    1604 logs.go:284] No container was found matching "storage-provisioner"

	I1109 14:34:56.443602    1604 logs.go:123] Gathering logs for kubelet ...

	I1109 14:34:56.443602    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"

	I1109 14:34:56.545266    1604 logs.go:123] Gathering logs for dmesg ...

	I1109 14:34:56.545266    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"

	I1109 14:34:56.569282    1604 logs.go:123] Gathering logs for describe nodes ...

	I1109 14:34:56.570275    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"

	W1109 14:34:56.658932    1604 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1

	stdout:

	stderr:

	E1109 14:34:56.651160    8840 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:34:56.652300    8840 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:34:56.653504    8840 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:34:56.654406    8840 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:34:56.656548    8840 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	 output: 

	** stderr ** 

	E1109 14:34:56.651160    8840 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:34:56.652300    8840 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:34:56.653504    8840 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:34:56.654406    8840 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:34:56.656548    8840 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	** /stderr **

	I1109 14:34:56.658932    1604 logs.go:123] Gathering logs for container status ...

	I1109 14:34:56.658932    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"

	I1109 14:34:56.735928    1604 logs.go:123] Gathering logs for kube-apiserver [578d9ee8b5ed] ...

	I1109 14:34:56.735928    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 578d9ee8b5ed"

	I1109 14:34:56.773434    1604 logs.go:123] Gathering logs for etcd [ee441d6c799c] ...

	I1109 14:34:56.773434    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ee441d6c799c"

	I1109 14:34:56.810189    1604 logs.go:123] Gathering logs for kube-scheduler [c1fa8e945752] ...

	I1109 14:34:56.810302    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c1fa8e945752"

	I1109 14:34:56.876201    1604 logs.go:123] Gathering logs for kube-scheduler [dcfa57dcafaf] ...

	I1109 14:34:56.876201    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 dcfa57dcafaf"

	I1109 14:34:56.920130    1604 logs.go:123] Gathering logs for kube-controller-manager [f91f678ad8d3] ...

	I1109 14:34:56.920130    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f91f678ad8d3"

	I1109 14:34:56.955439    1604 logs.go:123] Gathering logs for Docker ...

	I1109 14:34:56.955479    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"

	I1109 14:34:59.487171    1604 api_server.go:253] Checking apiserver healthz at https://127.0.0.1:51763/healthz ...

	I1109 14:34:59.490408    1604 api_server.go:269] stopped: https://127.0.0.1:51763/healthz: Get "https://127.0.0.1:51763/healthz": EOF

	I1109 14:34:59.496738    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}

	I1109 14:34:59.527822    1604 logs.go:282] 1 containers: [578d9ee8b5ed]

	I1109 14:34:59.534751    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}

	I1109 14:34:59.566740    1604 logs.go:282] 1 containers: [ee441d6c799c]

	I1109 14:34:59.572744    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}

	I1109 14:34:59.605511    1604 logs.go:282] 0 containers: []

	W1109 14:34:59.605548    1604 logs.go:284] No container was found matching "coredns"

	I1109 14:34:59.611640    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}

	I1109 14:34:59.643373    1604 logs.go:282] 2 containers: [c1fa8e945752 dcfa57dcafaf]

	I1109 14:34:59.649491    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}

	I1109 14:34:59.679040    1604 logs.go:282] 0 containers: []

	W1109 14:34:59.679040    1604 logs.go:284] No container was found matching "kube-proxy"

	I1109 14:34:59.684968    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}

	I1109 14:34:59.716009    1604 logs.go:282] 1 containers: [f91f678ad8d3]

	I1109 14:34:59.722958    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}

	I1109 14:34:59.757122    1604 logs.go:282] 0 containers: []

	W1109 14:34:59.757122    1604 logs.go:284] No container was found matching "kindnet"

	I1109 14:34:59.764010    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}

	I1109 14:34:59.797362    1604 logs.go:282] 0 containers: []

	W1109 14:34:59.797362    1604 logs.go:284] No container was found matching "storage-provisioner"

	I1109 14:34:59.797362    1604 logs.go:123] Gathering logs for kube-apiserver [578d9ee8b5ed] ...

	I1109 14:34:59.797362    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 578d9ee8b5ed"

	I1109 14:34:59.840864    1604 logs.go:123] Gathering logs for kube-scheduler [c1fa8e945752] ...

	I1109 14:34:59.840864    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c1fa8e945752"

	I1109 14:34:59.909582    1604 logs.go:123] Gathering logs for kube-scheduler [dcfa57dcafaf] ...

	I1109 14:34:59.909582    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 dcfa57dcafaf"

	I1109 14:34:59.957724    1604 logs.go:123] Gathering logs for kube-controller-manager [f91f678ad8d3] ...

	I1109 14:34:59.957724    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f91f678ad8d3"

	I1109 14:34:59.996232    1604 logs.go:123] Gathering logs for kubelet ...

	I1109 14:34:59.996284    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"

	I1109 14:35:00.095242    1604 logs.go:123] Gathering logs for describe nodes ...

	I1109 14:35:00.095242    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"

	W1109 14:35:00.185283    1604 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1

	stdout:

	stderr:

	E1109 14:35:00.174699    9031 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:35:00.176329    9031 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:35:00.178476    9031 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:35:00.180313    9031 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:35:00.182464    9031 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	 output: 

	** stderr ** 

	E1109 14:35:00.174699    9031 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:35:00.176329    9031 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:35:00.178476    9031 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:35:00.180313    9031 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:35:00.182464    9031 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	** /stderr **

	I1109 14:35:00.185283    1604 logs.go:123] Gathering logs for etcd [ee441d6c799c] ...

	I1109 14:35:00.185283    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ee441d6c799c"

	I1109 14:35:00.219296    1604 logs.go:123] Gathering logs for Docker ...

	I1109 14:35:00.219368    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"

	I1109 14:35:00.252618    1604 logs.go:123] Gathering logs for container status ...

	I1109 14:35:00.252618    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"

	I1109 14:35:00.342626    1604 logs.go:123] Gathering logs for dmesg ...

	I1109 14:35:00.342626    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"

	I1109 14:35:02.866695    1604 api_server.go:253] Checking apiserver healthz at https://127.0.0.1:51763/healthz ...

	I1109 14:35:02.870111    1604 api_server.go:269] stopped: https://127.0.0.1:51763/healthz: Get "https://127.0.0.1:51763/healthz": EOF

	I1109 14:35:02.876414    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}

	I1109 14:35:02.909592    1604 logs.go:282] 1 containers: [578d9ee8b5ed]

	I1109 14:35:02.915808    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}

	I1109 14:35:02.946560    1604 logs.go:282] 1 containers: [ee441d6c799c]

	I1109 14:35:02.953352    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}

	I1109 14:35:02.988812    1604 logs.go:282] 0 containers: []

	W1109 14:35:02.988812    1604 logs.go:284] No container was found matching "coredns"

	I1109 14:35:02.997811    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}

	I1109 14:35:03.027798    1604 logs.go:282] 2 containers: [c1fa8e945752 dcfa57dcafaf]

	I1109 14:35:03.033791    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}

	I1109 14:35:03.068408    1604 logs.go:282] 0 containers: []

	W1109 14:35:03.069421    1604 logs.go:284] No container was found matching "kube-proxy"

	I1109 14:35:03.074409    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}

	I1109 14:35:03.121424    1604 logs.go:282] 2 containers: [bbba73f9daf6 f91f678ad8d3]

	I1109 14:35:03.128418    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}

	I1109 14:35:03.160146    1604 logs.go:282] 0 containers: []

	W1109 14:35:03.160146    1604 logs.go:284] No container was found matching "kindnet"

	I1109 14:35:03.167638    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}

	I1109 14:35:03.219839    1604 logs.go:282] 0 containers: []

	W1109 14:35:03.219839    1604 logs.go:284] No container was found matching "storage-provisioner"

	I1109 14:35:03.219839    1604 logs.go:123] Gathering logs for kubelet ...

	I1109 14:35:03.219839    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"

	I1109 14:35:03.325398    1604 logs.go:123] Gathering logs for dmesg ...

	I1109 14:35:03.326391    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"

	I1109 14:35:03.354368    1604 logs.go:123] Gathering logs for kube-scheduler [dcfa57dcafaf] ...

	I1109 14:35:03.354392    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 dcfa57dcafaf"

	I1109 14:35:03.408860    1604 logs.go:123] Gathering logs for kube-controller-manager [f91f678ad8d3] ...

	I1109 14:35:03.409023    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f91f678ad8d3"

	I1109 14:35:03.453457    1604 logs.go:123] Gathering logs for container status ...

	I1109 14:35:03.453457    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"

	I1109 14:35:03.566010    1604 logs.go:123] Gathering logs for describe nodes ...

	I1109 14:35:03.566010    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"

	W1109 14:35:03.685528    1604 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1

	stdout:

	stderr:

	E1109 14:35:03.677293    9285 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:35:03.679174    9285 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:35:03.680343    9285 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:35:03.681274    9285 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:35:03.682335    9285 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	 output: 

	** stderr ** 

	E1109 14:35:03.677293    9285 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:35:03.679174    9285 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:35:03.680343    9285 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:35:03.681274    9285 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:35:03.682335    9285 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	** /stderr **

	I1109 14:35:03.685624    1604 logs.go:123] Gathering logs for kube-apiserver [578d9ee8b5ed] ...

	I1109 14:35:03.685624    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 578d9ee8b5ed"

	I1109 14:35:03.739796    1604 logs.go:123] Gathering logs for etcd [ee441d6c799c] ...

	I1109 14:35:03.739796    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ee441d6c799c"

	I1109 14:35:03.775681    1604 logs.go:123] Gathering logs for kube-scheduler [c1fa8e945752] ...

	I1109 14:35:03.775681    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c1fa8e945752"

	I1109 14:35:03.863689    1604 logs.go:123] Gathering logs for kube-controller-manager [bbba73f9daf6] ...

	I1109 14:35:03.863689    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 bbba73f9daf6"

	I1109 14:35:03.897795    1604 logs.go:123] Gathering logs for Docker ...

	I1109 14:35:03.897880    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"

	I1109 14:35:06.430464    1604 api_server.go:253] Checking apiserver healthz at https://127.0.0.1:51763/healthz ...

	I1109 14:35:06.433439    1604 api_server.go:269] stopped: https://127.0.0.1:51763/healthz: Get "https://127.0.0.1:51763/healthz": EOF

	I1109 14:35:06.440286    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}

	I1109 14:35:06.476602    1604 logs.go:282] 1 containers: [578d9ee8b5ed]

	I1109 14:35:06.483007    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}

	I1109 14:35:06.514380    1604 logs.go:282] 1 containers: [ee441d6c799c]

	I1109 14:35:06.523506    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}

	I1109 14:35:06.556829    1604 logs.go:282] 0 containers: []

	W1109 14:35:06.556829    1604 logs.go:284] No container was found matching "coredns"

	I1109 14:35:06.562793    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}

	I1109 14:35:06.594633    1604 logs.go:282] 2 containers: [c1fa8e945752 dcfa57dcafaf]

	I1109 14:35:06.600411    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}

	I1109 14:35:06.632341    1604 logs.go:282] 0 containers: []

	W1109 14:35:06.632341    1604 logs.go:284] No container was found matching "kube-proxy"

	I1109 14:35:06.637979    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}

	I1109 14:35:06.667466    1604 logs.go:282] 2 containers: [bbba73f9daf6 f91f678ad8d3]

	I1109 14:35:06.673663    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}

	I1109 14:35:06.701987    1604 logs.go:282] 0 containers: []

	W1109 14:35:06.701987    1604 logs.go:284] No container was found matching "kindnet"

	I1109 14:35:06.710979    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}

	I1109 14:35:06.740020    1604 logs.go:282] 0 containers: []

	W1109 14:35:06.740020    1604 logs.go:284] No container was found matching "storage-provisioner"

	I1109 14:35:06.740020    1604 logs.go:123] Gathering logs for dmesg ...

	I1109 14:35:06.740020    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"

	I1109 14:35:06.764209    1604 logs.go:123] Gathering logs for describe nodes ...

	I1109 14:35:06.764209    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"

	W1109 14:35:06.848848    1604 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1

	stdout:

	stderr:

	E1109 14:35:06.837753    9419 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:35:06.838952    9419 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:35:06.840616    9419 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:35:06.841848    9419 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:35:06.843016    9419 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	 output: 

	** stderr ** 

	E1109 14:35:06.837753    9419 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:35:06.838952    9419 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:35:06.840616    9419 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:35:06.841848    9419 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:35:06.843016    9419 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	** /stderr **

	I1109 14:35:06.848848    1604 logs.go:123] Gathering logs for kube-apiserver [578d9ee8b5ed] ...

	I1109 14:35:06.848848    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 578d9ee8b5ed"

	I1109 14:35:06.886847    1604 logs.go:123] Gathering logs for kube-scheduler [dcfa57dcafaf] ...

	I1109 14:35:06.887381    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 dcfa57dcafaf"

	I1109 14:35:06.938937    1604 logs.go:123] Gathering logs for kube-controller-manager [bbba73f9daf6] ...

	I1109 14:35:06.938937    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 bbba73f9daf6"

	I1109 14:35:06.976613    1604 logs.go:123] Gathering logs for Docker ...

	I1109 14:35:06.976790    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"

	I1109 14:35:07.009845    1604 logs.go:123] Gathering logs for container status ...

	I1109 14:35:07.009845    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"

	I1109 14:35:07.096956    1604 logs.go:123] Gathering logs for kubelet ...

	I1109 14:35:07.097016    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"

	I1109 14:35:07.196896    1604 logs.go:123] Gathering logs for etcd [ee441d6c799c] ...

	I1109 14:35:07.196896    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ee441d6c799c"

	I1109 14:35:07.242920    1604 logs.go:123] Gathering logs for kube-scheduler [c1fa8e945752] ...

	I1109 14:35:07.242984    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c1fa8e945752"

	I1109 14:35:07.318165    1604 logs.go:123] Gathering logs for kube-controller-manager [f91f678ad8d3] ...

	I1109 14:35:07.318165    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f91f678ad8d3"

	I1109 14:35:09.855283    1604 api_server.go:253] Checking apiserver healthz at https://127.0.0.1:51763/healthz ...

	I1109 14:35:09.858428    1604 api_server.go:269] stopped: https://127.0.0.1:51763/healthz: Get "https://127.0.0.1:51763/healthz": EOF

	I1109 14:35:09.864628    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}

	I1109 14:35:09.893983    1604 logs.go:282] 1 containers: [578d9ee8b5ed]

	I1109 14:35:09.900408    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}

	I1109 14:35:09.933299    1604 logs.go:282] 1 containers: [ee441d6c799c]

	I1109 14:35:09.939572    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}

	I1109 14:35:09.969368    1604 logs.go:282] 0 containers: []

	W1109 14:35:09.969368    1604 logs.go:284] No container was found matching "coredns"

	I1109 14:35:09.976721    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}

	I1109 14:35:10.010139    1604 logs.go:282] 2 containers: [c1fa8e945752 dcfa57dcafaf]

	I1109 14:35:10.016573    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}

	I1109 14:35:10.045524    1604 logs.go:282] 0 containers: []

	W1109 14:35:10.045524    1604 logs.go:284] No container was found matching "kube-proxy"

	I1109 14:35:10.050885    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}

	I1109 14:35:10.082211    1604 logs.go:282] 2 containers: [bbba73f9daf6 f91f678ad8d3]

	I1109 14:35:10.088636    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}

	I1109 14:35:10.119082    1604 logs.go:282] 0 containers: []

	W1109 14:35:10.119131    1604 logs.go:284] No container was found matching "kindnet"

	I1109 14:35:10.125614    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}

	I1109 14:35:10.155468    1604 logs.go:282] 0 containers: []

	W1109 14:35:10.155468    1604 logs.go:284] No container was found matching "storage-provisioner"

	I1109 14:35:10.155468    1604 logs.go:123] Gathering logs for kube-scheduler [c1fa8e945752] ...

	I1109 14:35:10.155468    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c1fa8e945752"

	I1109 14:35:10.249670    1604 logs.go:123] Gathering logs for Docker ...

	I1109 14:35:10.249670    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"

	I1109 14:35:10.284174    1604 logs.go:123] Gathering logs for kubelet ...

	I1109 14:35:10.284174    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"

	I1109 14:35:10.387780    1604 logs.go:123] Gathering logs for dmesg ...

	I1109 14:35:10.387780    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"

	I1109 14:35:10.415289    1604 logs.go:123] Gathering logs for kube-scheduler [dcfa57dcafaf] ...

	I1109 14:35:10.415343    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 dcfa57dcafaf"

	I1109 14:35:10.469807    1604 logs.go:123] Gathering logs for kube-controller-manager [bbba73f9daf6] ...

	I1109 14:35:10.469807    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 bbba73f9daf6"

	I1109 14:35:10.505556    1604 logs.go:123] Gathering logs for kube-controller-manager [f91f678ad8d3] ...

	I1109 14:35:10.506078    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f91f678ad8d3"

	I1109 14:35:10.546815    1604 logs.go:123] Gathering logs for container status ...

	I1109 14:35:10.546815    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"

	I1109 14:35:10.632808    1604 logs.go:123] Gathering logs for describe nodes ...

	I1109 14:35:10.632808    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"

	W1109 14:35:10.725302    1604 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1

	stdout:

	stderr:

	E1109 14:35:10.710614    9673 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:35:10.711487    9673 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:35:10.714080    9673 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:35:10.715108    9673 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:35:10.715895    9673 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	 output: 

	** stderr ** 

	E1109 14:35:10.710614    9673 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:35:10.711487    9673 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:35:10.714080    9673 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:35:10.715108    9673 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:35:10.715895    9673 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	** /stderr **

	I1109 14:35:10.725302    1604 logs.go:123] Gathering logs for kube-apiserver [578d9ee8b5ed] ...

	I1109 14:35:10.725302    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 578d9ee8b5ed"

	I1109 14:35:10.769361    1604 logs.go:123] Gathering logs for etcd [ee441d6c799c] ...

	I1109 14:35:10.769361    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ee441d6c799c"

	I1109 14:35:13.306976    1604 api_server.go:253] Checking apiserver healthz at https://127.0.0.1:51763/healthz ...

	I1109 14:35:13.310447    1604 api_server.go:269] stopped: https://127.0.0.1:51763/healthz: Get "https://127.0.0.1:51763/healthz": EOF

	I1109 14:35:13.316883    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}

	I1109 14:35:13.352683    1604 logs.go:282] 1 containers: [578d9ee8b5ed]

	I1109 14:35:13.360312    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}

	I1109 14:35:13.402506    1604 logs.go:282] 1 containers: [ee441d6c799c]

	I1109 14:35:13.408507    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}

	I1109 14:35:13.443993    1604 logs.go:282] 0 containers: []

	W1109 14:35:13.444996    1604 logs.go:284] No container was found matching "coredns"

	I1109 14:35:13.451000    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}

	I1109 14:35:13.481996    1604 logs.go:282] 2 containers: [c1fa8e945752 dcfa57dcafaf]

	I1109 14:35:13.487989    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}

	I1109 14:35:13.519990    1604 logs.go:282] 0 containers: []

	W1109 14:35:13.519990    1604 logs.go:284] No container was found matching "kube-proxy"

	I1109 14:35:13.528997    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}

	I1109 14:35:13.564999    1604 logs.go:282] 2 containers: [bbba73f9daf6 f91f678ad8d3]

	I1109 14:35:13.572000    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}

	I1109 14:35:13.601998    1604 logs.go:282] 0 containers: []

	W1109 14:35:13.601998    1604 logs.go:284] No container was found matching "kindnet"

	I1109 14:35:13.607992    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}

	I1109 14:35:13.638021    1604 logs.go:282] 0 containers: []

	W1109 14:35:13.638021    1604 logs.go:284] No container was found matching "storage-provisioner"

	I1109 14:35:13.638021    1604 logs.go:123] Gathering logs for kube-scheduler [dcfa57dcafaf] ...

	I1109 14:35:13.638021    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 dcfa57dcafaf"

	I1109 14:35:13.684993    1604 logs.go:123] Gathering logs for kube-controller-manager [f91f678ad8d3] ...

	I1109 14:35:13.684993    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f91f678ad8d3"

	I1109 14:35:13.717994    1604 logs.go:123] Gathering logs for kube-controller-manager [bbba73f9daf6] ...

	I1109 14:35:13.717994    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 bbba73f9daf6"

	I1109 14:35:13.752993    1604 logs.go:123] Gathering logs for Docker ...

	I1109 14:35:13.752993    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"

	I1109 14:35:13.782995    1604 logs.go:123] Gathering logs for container status ...

	I1109 14:35:13.782995    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"

	I1109 14:35:13.869053    1604 logs.go:123] Gathering logs for kubelet ...

	I1109 14:35:13.869103    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"

	I1109 14:35:13.972150    1604 logs.go:123] Gathering logs for dmesg ...

	I1109 14:35:13.972150    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"

	I1109 14:35:14.001667    1604 logs.go:123] Gathering logs for describe nodes ...

	I1109 14:35:14.001667    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"

	W1109 14:35:14.101390    1604 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1

	stdout:

	stderr:

	E1109 14:35:14.089730    9832 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:35:14.090715    9832 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:35:14.092570    9832 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:35:14.094015    9832 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:35:14.095065    9832 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	 output: 

	** stderr ** 

	E1109 14:35:14.089730    9832 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:35:14.090715    9832 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:35:14.092570    9832 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:35:14.094015    9832 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:35:14.095065    9832 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	** /stderr **

	I1109 14:35:14.101390    1604 logs.go:123] Gathering logs for kube-apiserver [578d9ee8b5ed] ...

	I1109 14:35:14.101390    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 578d9ee8b5ed"

	I1109 14:35:14.146229    1604 logs.go:123] Gathering logs for etcd [ee441d6c799c] ...

	I1109 14:35:14.146229    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ee441d6c799c"

	I1109 14:35:14.181220    1604 logs.go:123] Gathering logs for kube-scheduler [c1fa8e945752] ...

	I1109 14:35:14.181220    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c1fa8e945752"

	I1109 14:35:16.753864    1604 api_server.go:253] Checking apiserver healthz at https://127.0.0.1:51763/healthz ...

	I1109 14:35:16.756950    1604 api_server.go:269] stopped: https://127.0.0.1:51763/healthz: Get "https://127.0.0.1:51763/healthz": EOF

	I1109 14:35:16.762993    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}

	I1109 14:35:16.795632    1604 logs.go:282] 1 containers: [578d9ee8b5ed]

	I1109 14:35:16.801945    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}

	I1109 14:35:16.831132    1604 logs.go:282] 1 containers: [ee441d6c799c]

	I1109 14:35:16.837122    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}

	I1109 14:35:16.866865    1604 logs.go:282] 0 containers: []

	W1109 14:35:16.866865    1604 logs.go:284] No container was found matching "coredns"

	I1109 14:35:16.873068    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}

	I1109 14:35:16.905512    1604 logs.go:282] 2 containers: [c1fa8e945752 dcfa57dcafaf]

	I1109 14:35:16.912327    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}

	I1109 14:35:16.940254    1604 logs.go:282] 0 containers: []

	W1109 14:35:16.940254    1604 logs.go:284] No container was found matching "kube-proxy"

	I1109 14:35:16.947427    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}

	I1109 14:35:16.976236    1604 logs.go:282] 2 containers: [bbba73f9daf6 f91f678ad8d3]

	I1109 14:35:16.982430    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}

	I1109 14:35:17.011133    1604 logs.go:282] 0 containers: []

	W1109 14:35:17.011133    1604 logs.go:284] No container was found matching "kindnet"

	I1109 14:35:17.018691    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}

	I1109 14:35:17.047721    1604 logs.go:282] 0 containers: []

	W1109 14:35:17.047721    1604 logs.go:284] No container was found matching "storage-provisioner"

	I1109 14:35:17.047721    1604 logs.go:123] Gathering logs for dmesg ...

	I1109 14:35:17.047721    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"

	I1109 14:35:17.068715    1604 logs.go:123] Gathering logs for describe nodes ...

	I1109 14:35:17.068715    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"

	W1109 14:35:17.152721    1604 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1

	stdout:

	stderr:

	E1109 14:35:17.142282    9947 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:35:17.143252    9947 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:35:17.146014    9947 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:35:17.147489    9947 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:35:17.148491    9947 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	 output: 

	** stderr ** 

	E1109 14:35:17.142282    9947 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:35:17.143252    9947 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:35:17.146014    9947 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:35:17.147489    9947 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:35:17.148491    9947 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	** /stderr **

	I1109 14:35:17.152721    1604 logs.go:123] Gathering logs for kube-apiserver [578d9ee8b5ed] ...

	I1109 14:35:17.152721    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 578d9ee8b5ed"

	I1109 14:35:17.190716    1604 logs.go:123] Gathering logs for kube-scheduler [c1fa8e945752] ...

	I1109 14:35:17.190716    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c1fa8e945752"

	I1109 14:35:17.264056    1604 logs.go:123] Gathering logs for container status ...

	I1109 14:35:17.264056    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"

	I1109 14:35:17.499877    1604 logs.go:123] Gathering logs for kubelet ...

	I1109 14:35:17.499877    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"

	I1109 14:35:17.604110    1604 logs.go:123] Gathering logs for etcd [ee441d6c799c] ...

	I1109 14:35:17.604110    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ee441d6c799c"

	I1109 14:35:17.649130    1604 logs.go:123] Gathering logs for kube-scheduler [dcfa57dcafaf] ...

	I1109 14:35:17.649130    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 dcfa57dcafaf"

	I1109 14:35:17.690132    1604 logs.go:123] Gathering logs for kube-controller-manager [bbba73f9daf6] ...

	I1109 14:35:17.690132    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 bbba73f9daf6"

	I1109 14:35:17.723136    1604 logs.go:123] Gathering logs for kube-controller-manager [f91f678ad8d3] ...

	I1109 14:35:17.723136    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f91f678ad8d3"

	I1109 14:35:17.757295    1604 logs.go:123] Gathering logs for Docker ...

	I1109 14:35:17.757365    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"

	I1109 14:35:20.294336    1604 api_server.go:253] Checking apiserver healthz at https://127.0.0.1:51763/healthz ...

	I1109 14:35:20.297587    1604 api_server.go:269] stopped: https://127.0.0.1:51763/healthz: Get "https://127.0.0.1:51763/healthz": EOF

	I1109 14:35:20.306205    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}

	I1109 14:35:20.340733    1604 logs.go:282] 1 containers: [578d9ee8b5ed]

	I1109 14:35:20.346830    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}

	I1109 14:35:20.380334    1604 logs.go:282] 1 containers: [ee441d6c799c]

	I1109 14:35:20.386624    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}

	I1109 14:35:20.424238    1604 logs.go:282] 0 containers: []

	W1109 14:35:20.424238    1604 logs.go:284] No container was found matching "coredns"

	I1109 14:35:20.431178    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}

	I1109 14:35:20.466903    1604 logs.go:282] 2 containers: [c1fa8e945752 dcfa57dcafaf]

	I1109 14:35:20.472658    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}

	I1109 14:35:20.503146    1604 logs.go:282] 0 containers: []

	W1109 14:35:20.503146    1604 logs.go:284] No container was found matching "kube-proxy"

	I1109 14:35:20.509540    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}

	I1109 14:35:20.539755    1604 logs.go:282] 2 containers: [bbba73f9daf6 f91f678ad8d3]

	I1109 14:35:20.546043    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}

	I1109 14:35:20.574839    1604 logs.go:282] 0 containers: []

	W1109 14:35:20.574866    1604 logs.go:284] No container was found matching "kindnet"

	I1109 14:35:20.580952    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}

	I1109 14:35:20.611623    1604 logs.go:282] 0 containers: []

	W1109 14:35:20.611623    1604 logs.go:284] No container was found matching "storage-provisioner"

	I1109 14:35:20.611623    1604 logs.go:123] Gathering logs for kube-apiserver [578d9ee8b5ed] ...

	I1109 14:35:20.611623    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 578d9ee8b5ed"

	I1109 14:35:20.653305    1604 logs.go:123] Gathering logs for etcd [ee441d6c799c] ...

	I1109 14:35:20.653305    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ee441d6c799c"

	I1109 14:35:20.688035    1604 logs.go:123] Gathering logs for kube-scheduler [c1fa8e945752] ...

	I1109 14:35:20.688035    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c1fa8e945752"

	I1109 14:35:20.762155    1604 logs.go:123] Gathering logs for kube-scheduler [dcfa57dcafaf] ...

	I1109 14:35:20.762155    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 dcfa57dcafaf"

	I1109 14:35:20.823804    1604 logs.go:123] Gathering logs for kube-controller-manager [bbba73f9daf6] ...

	I1109 14:35:20.823804    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 bbba73f9daf6"

	I1109 14:35:20.860640    1604 logs.go:123] Gathering logs for container status ...

	I1109 14:35:20.860640    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"

	I1109 14:35:20.946403    1604 logs.go:123] Gathering logs for dmesg ...

	I1109 14:35:20.946478    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"

	I1109 14:35:20.968460    1604 logs.go:123] Gathering logs for kube-controller-manager [f91f678ad8d3] ...

	I1109 14:35:20.968460    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f91f678ad8d3"

	I1109 14:35:21.010622    1604 logs.go:123] Gathering logs for Docker ...

	I1109 14:35:21.010622    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"

	I1109 14:35:21.039420    1604 logs.go:123] Gathering logs for kubelet ...

	I1109 14:35:21.039420    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"

	I1109 14:35:21.142054    1604 logs.go:123] Gathering logs for describe nodes ...

	I1109 14:35:21.142054    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"

	W1109 14:35:21.232357    1604 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1

	stdout:

	stderr:

	E1109 14:35:21.221307   10220 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:35:21.222386   10220 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:35:21.224494   10220 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:35:21.225695   10220 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:35:21.226539   10220 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	 output: 

	** stderr ** 

	E1109 14:35:21.221307   10220 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:35:21.222386   10220 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:35:21.224494   10220 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:35:21.225695   10220 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:35:21.226539   10220 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	** /stderr **

	I1109 14:35:23.732811    1604 api_server.go:253] Checking apiserver healthz at https://127.0.0.1:51763/healthz ...

	I1109 14:35:23.735803    1604 api_server.go:269] stopped: https://127.0.0.1:51763/healthz: Get "https://127.0.0.1:51763/healthz": EOF

	I1109 14:35:23.747192    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}

	I1109 14:35:23.780750    1604 logs.go:282] 1 containers: [578d9ee8b5ed]

	I1109 14:35:23.787523    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}

	I1109 14:35:23.818714    1604 logs.go:282] 1 containers: [ee441d6c799c]

	I1109 14:35:23.826466    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}

	I1109 14:35:23.860716    1604 logs.go:282] 0 containers: []

	W1109 14:35:23.860716    1604 logs.go:284] No container was found matching "coredns"

	I1109 14:35:23.867133    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}

	I1109 14:35:23.897311    1604 logs.go:282] 2 containers: [c1fa8e945752 dcfa57dcafaf]

	I1109 14:35:23.903572    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}

	I1109 14:35:23.932446    1604 logs.go:282] 0 containers: []

	W1109 14:35:23.932446    1604 logs.go:284] No container was found matching "kube-proxy"

	I1109 14:35:23.939112    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}

	I1109 14:35:23.969897    1604 logs.go:282] 2 containers: [bbba73f9daf6 f91f678ad8d3]

	I1109 14:35:23.976203    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}

	I1109 14:35:24.005776    1604 logs.go:282] 0 containers: []

	W1109 14:35:24.005776    1604 logs.go:284] No container was found matching "kindnet"

	I1109 14:35:24.010770    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}

	I1109 14:35:24.043823    1604 logs.go:282] 0 containers: []

	W1109 14:35:24.043823    1604 logs.go:284] No container was found matching "storage-provisioner"

	I1109 14:35:24.043823    1604 logs.go:123] Gathering logs for container status ...

	I1109 14:35:24.043823    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"

	I1109 14:35:24.128440    1604 logs.go:123] Gathering logs for kubelet ...

	I1109 14:35:24.128980    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"

	I1109 14:35:24.228960    1604 logs.go:123] Gathering logs for dmesg ...

	I1109 14:35:24.229022    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"

	I1109 14:35:24.251145    1604 logs.go:123] Gathering logs for describe nodes ...

	I1109 14:35:24.251145    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"

	W1109 14:35:24.340492    1604 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1

	stdout:

	stderr:

	E1109 14:35:24.328489   10331 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:35:24.329171   10331 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:35:24.331939   10331 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:35:24.334095   10331 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:35:24.335022   10331 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	 output: 

	** stderr ** 

	E1109 14:35:24.328489   10331 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:35:24.329171   10331 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:35:24.331939   10331 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:35:24.334095   10331 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:35:24.335022   10331 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	** /stderr **

	I1109 14:35:24.340492    1604 logs.go:123] Gathering logs for kube-scheduler [c1fa8e945752] ...

	I1109 14:35:24.340492    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c1fa8e945752"

	I1109 14:35:24.417518    1604 logs.go:123] Gathering logs for kube-controller-manager [bbba73f9daf6] ...

	I1109 14:35:24.417518    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 bbba73f9daf6"

	I1109 14:35:24.451177    1604 logs.go:123] Gathering logs for kube-controller-manager [f91f678ad8d3] ...

	I1109 14:35:24.451177    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f91f678ad8d3"

	I1109 14:35:24.485971    1604 logs.go:123] Gathering logs for Docker ...

	I1109 14:35:24.485971    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"

	I1109 14:35:24.517348    1604 logs.go:123] Gathering logs for kube-apiserver [578d9ee8b5ed] ...

	I1109 14:35:24.517348    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 578d9ee8b5ed"

	I1109 14:35:24.556253    1604 logs.go:123] Gathering logs for etcd [ee441d6c799c] ...

	I1109 14:35:24.556328    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ee441d6c799c"

	I1109 14:35:24.594355    1604 logs.go:123] Gathering logs for kube-scheduler [dcfa57dcafaf] ...

	I1109 14:35:24.594410    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 dcfa57dcafaf"

	I1109 14:35:27.138563    1604 api_server.go:253] Checking apiserver healthz at https://127.0.0.1:51763/healthz ...

	I1109 14:35:27.140999    1604 api_server.go:269] stopped: https://127.0.0.1:51763/healthz: Get "https://127.0.0.1:51763/healthz": EOF

	I1109 14:35:27.146967    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}

	I1109 14:35:27.176710    1604 logs.go:282] 1 containers: [578d9ee8b5ed]

	I1109 14:35:27.184437    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}

	I1109 14:35:27.216534    1604 logs.go:282] 1 containers: [ee441d6c799c]

	I1109 14:35:27.224042    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}

	I1109 14:35:27.254406    1604 logs.go:282] 0 containers: []

	W1109 14:35:27.254406    1604 logs.go:284] No container was found matching "coredns"

	I1109 14:35:27.261459    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}

	I1109 14:35:27.293455    1604 logs.go:282] 2 containers: [c1fa8e945752 dcfa57dcafaf]

	I1109 14:35:27.301973    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}

	I1109 14:35:27.337795    1604 logs.go:282] 0 containers: []

	W1109 14:35:27.337870    1604 logs.go:284] No container was found matching "kube-proxy"

	I1109 14:35:27.345540    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}

	I1109 14:35:27.379702    1604 logs.go:282] 2 containers: [bbba73f9daf6 f91f678ad8d3]

	I1109 14:35:27.386005    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}

	I1109 14:35:27.418295    1604 logs.go:282] 0 containers: []

	W1109 14:35:27.418355    1604 logs.go:284] No container was found matching "kindnet"

	I1109 14:35:27.425637    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}

	I1109 14:35:27.455575    1604 logs.go:282] 0 containers: []

	W1109 14:35:27.455575    1604 logs.go:284] No container was found matching "storage-provisioner"

	I1109 14:35:27.455648    1604 logs.go:123] Gathering logs for kubelet ...

	I1109 14:35:27.455648    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"

	I1109 14:35:27.547039    1604 logs.go:123] Gathering logs for dmesg ...

	I1109 14:35:27.547039    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"

	I1109 14:35:27.571493    1604 logs.go:123] Gathering logs for etcd [ee441d6c799c] ...

	I1109 14:35:27.571566    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ee441d6c799c"

	I1109 14:35:27.607653    1604 logs.go:123] Gathering logs for kube-scheduler [c1fa8e945752] ...

	I1109 14:35:27.607653    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c1fa8e945752"

	I1109 14:35:27.685528    1604 logs.go:123] Gathering logs for kube-scheduler [dcfa57dcafaf] ...

	I1109 14:35:27.685528    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 dcfa57dcafaf"

	I1109 14:35:27.731327    1604 logs.go:123] Gathering logs for kube-controller-manager [bbba73f9daf6] ...

	I1109 14:35:27.731899    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 bbba73f9daf6"

	I1109 14:35:27.771264    1604 logs.go:123] Gathering logs for kube-controller-manager [f91f678ad8d3] ...

	I1109 14:35:27.771264    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f91f678ad8d3"

	I1109 14:35:27.806641    1604 logs.go:123] Gathering logs for Docker ...

	I1109 14:35:27.806641    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"

	I1109 14:35:27.837167    1604 logs.go:123] Gathering logs for describe nodes ...

	I1109 14:35:27.837212    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"

	W1109 14:35:27.927930    1604 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1

	stdout:

	stderr:

	E1109 14:35:27.915909   10520 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:35:27.916952   10520 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:35:27.917896   10520 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:35:27.921692   10520 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:35:27.922513   10520 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	 output: 

	** stderr ** 

	E1109 14:35:27.915909   10520 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:35:27.916952   10520 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:35:27.917896   10520 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:35:27.921692   10520 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:35:27.922513   10520 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	** /stderr **

	I1109 14:35:27.927930    1604 logs.go:123] Gathering logs for kube-apiserver [578d9ee8b5ed] ...

	I1109 14:35:27.927930    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 578d9ee8b5ed"

	I1109 14:35:27.969339    1604 logs.go:123] Gathering logs for container status ...

	I1109 14:35:27.969411    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"

	I1109 14:35:30.553483    1604 api_server.go:253] Checking apiserver healthz at https://127.0.0.1:51763/healthz ...

	I1109 14:35:30.556400    1604 api_server.go:269] stopped: https://127.0.0.1:51763/healthz: Get "https://127.0.0.1:51763/healthz": EOF

	I1109 14:35:30.562909    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}

	I1109 14:35:30.605235    1604 logs.go:282] 1 containers: [578d9ee8b5ed]

	I1109 14:35:30.611544    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}

	I1109 14:35:30.642324    1604 logs.go:282] 1 containers: [ee441d6c799c]

	I1109 14:35:30.648942    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}

	I1109 14:35:30.680769    1604 logs.go:282] 0 containers: []

	W1109 14:35:30.680816    1604 logs.go:284] No container was found matching "coredns"

	I1109 14:35:30.687429    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}

	I1109 14:35:30.719792    1604 logs.go:282] 2 containers: [c1fa8e945752 dcfa57dcafaf]

	I1109 14:35:30.725769    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}

	I1109 14:35:30.754039    1604 logs.go:282] 0 containers: []

	W1109 14:35:30.754073    1604 logs.go:284] No container was found matching "kube-proxy"

	I1109 14:35:30.760279    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}

	I1109 14:35:30.790873    1604 logs.go:282] 2 containers: [bbba73f9daf6 f91f678ad8d3]

	I1109 14:35:30.799103    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}

	I1109 14:35:30.831449    1604 logs.go:282] 0 containers: []

	W1109 14:35:30.831449    1604 logs.go:284] No container was found matching "kindnet"

	I1109 14:35:30.838202    1604 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}

	I1109 14:35:30.871045    1604 logs.go:282] 0 containers: []

	W1109 14:35:30.871045    1604 logs.go:284] No container was found matching "storage-provisioner"

	I1109 14:35:30.871045    1604 logs.go:123] Gathering logs for describe nodes ...

	I1109 14:35:30.871045    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"

	W1109 14:35:30.962674    1604 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1

	stdout:

	stderr:

	E1109 14:35:30.951368   10657 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:35:30.952126   10657 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:35:30.955887   10657 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:35:30.957247   10657 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:35:30.958309   10657 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	 output: 

	** stderr ** 

	E1109 14:35:30.951368   10657 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:35:30.952126   10657 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:35:30.955887   10657 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:35:30.957247   10657 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:35:30.958309   10657 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	** /stderr **

	I1109 14:35:30.962674    1604 logs.go:123] Gathering logs for etcd [ee441d6c799c] ...

	I1109 14:35:30.962725    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ee441d6c799c"

	I1109 14:35:30.998026    1604 logs.go:123] Gathering logs for kube-controller-manager [f91f678ad8d3] ...

	I1109 14:35:30.998587    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f91f678ad8d3"

	I1109 14:35:31.034672    1604 logs.go:123] Gathering logs for Docker ...

	I1109 14:35:31.034672    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"

	I1109 14:35:31.064528    1604 logs.go:123] Gathering logs for kubelet ...

	I1109 14:35:31.064528    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"

	I1109 14:35:31.159709    1604 logs.go:123] Gathering logs for kube-apiserver [578d9ee8b5ed] ...

	I1109 14:35:31.159709    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 578d9ee8b5ed"

	I1109 14:35:31.200556    1604 logs.go:123] Gathering logs for kube-scheduler [c1fa8e945752] ...

	I1109 14:35:31.200556    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c1fa8e945752"

	I1109 14:35:31.275841    1604 logs.go:123] Gathering logs for kube-scheduler [dcfa57dcafaf] ...

	I1109 14:35:31.275841    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 dcfa57dcafaf"

	I1109 14:35:31.321911    1604 logs.go:123] Gathering logs for kube-controller-manager [bbba73f9daf6] ...

	I1109 14:35:31.321911    1604 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 bbba73f9daf6"

	I1109 14:35:31.356111    1604 logs.go:123] Gathering logs for container status ...

	I1109 14:35:31.356111    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"

	I1109 14:35:31.459103    1604 logs.go:123] Gathering logs for dmesg ...

	I1109 14:35:31.459103    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"

	I1109 14:35:33.980160    1604 api_server.go:253] Checking apiserver healthz at https://127.0.0.1:51763/healthz ...

	I1109 14:35:33.983172    1604 api_server.go:269] stopped: https://127.0.0.1:51763/healthz: Get "https://127.0.0.1:51763/healthz": EOF

	I1109 14:35:33.983172    1604 kubeadm.go:602] duration metric: took 4m7.0544135s to restartPrimaryControlPlane

	W1109 14:35:33.983172    1604 out.go:285] ! Unable to restart control-plane node(s), will reset cluster: <no value>

	! Unable to restart control-plane node(s), will reset cluster: <no value>

	I1109 14:35:33.990450    1604 ssh_runner.go:195] Run: sudo /bin/bash -c "env PATH="/var/lib/minikube/binaries/v1.28.3:$PATH" kubeadm reset --cri-socket /var/run/cri-dockerd.sock --force"

	I1109 14:36:21.723036    1604 ssh_runner.go:235] Completed: sudo /bin/bash -c "env PATH="/var/lib/minikube/binaries/v1.28.3:$PATH" kubeadm reset --cri-socket /var/run/cri-dockerd.sock --force": (47.7320305s)

	I1109 14:36:21.730100    1604 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I1109 14:36:21.758893    1604 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml

	I1109 14:36:21.774929    1604 kubeadm.go:215] ignoring SystemVerification for kubeadm because of docker driver

	I1109 14:36:21.782601    1604 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf

	I1109 14:36:21.798054    1604 kubeadm.go:156] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2

	stdout:

	stderr:

	ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory

	I1109 14:36:21.798054    1604 kubeadm.go:158] found existing configuration files:

	I1109 14:36:21.806582    1604 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:0 /etc/kubernetes/admin.conf

	I1109 14:36:21.820492    1604 kubeadm.go:164] "https://control-plane.minikube.internal:0" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:0 /etc/kubernetes/admin.conf: Process exited with status 2

	stdout:

	stderr:

	grep: /etc/kubernetes/admin.conf: No such file or directory

	I1109 14:36:21.828791    1604 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf

	I1109 14:36:21.851341    1604 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:0 /etc/kubernetes/kubelet.conf

	I1109 14:36:21.867338    1604 kubeadm.go:164] "https://control-plane.minikube.internal:0" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:0 /etc/kubernetes/kubelet.conf: Process exited with status 2

	stdout:

	stderr:

	grep: /etc/kubernetes/kubelet.conf: No such file or directory

	I1109 14:36:21.874335    1604 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf

	I1109 14:36:21.897533    1604 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:0 /etc/kubernetes/controller-manager.conf

	I1109 14:36:21.911524    1604 kubeadm.go:164] "https://control-plane.minikube.internal:0" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:0 /etc/kubernetes/controller-manager.conf: Process exited with status 2

	stdout:

	stderr:

	grep: /etc/kubernetes/controller-manager.conf: No such file or directory

	I1109 14:36:21.918011    1604 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf

	I1109 14:36:21.944573    1604 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:0 /etc/kubernetes/scheduler.conf

	I1109 14:36:21.961357    1604 kubeadm.go:164] "https://control-plane.minikube.internal:0" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:0 /etc/kubernetes/scheduler.conf: Process exited with status 2

	stdout:

	stderr:

	grep: /etc/kubernetes/scheduler.conf: No such file or directory

	I1109 14:36:21.968841    1604 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf

	I1109 14:36:21.997266    1604 ssh_runner.go:286] Start: sudo /bin/bash -c "env PATH="/var/lib/minikube/binaries/v1.28.3:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"

	I1109 14:36:22.141932    1604 kubeadm.go:319] 	[WARNING Swap]: swap is enabled; production deployments should disable swap unless testing the NodeSwap feature gate of the kubelet

	I1109 14:36:22.275596    1604 kubeadm.go:319] 	[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'

	I1109 14:40:52.960787    1604 kubeadm.go:319] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster

	I1109 14:40:52.961312    1604 kubeadm.go:319] To see the stack trace of this error execute with --v=5 or higher

	I1109 14:40:52.966318    1604 kubeadm.go:319] [init] Using Kubernetes version: v1.28.3

	I1109 14:40:52.966492    1604 kubeadm.go:319] [preflight] Running pre-flight checks

	I1109 14:40:52.966539    1604 kubeadm.go:319] [preflight] Pulling images required for setting up a Kubernetes cluster

	I1109 14:40:52.966539    1604 kubeadm.go:319] [preflight] This might take a minute or two, depending on the speed of your internet connection

	I1109 14:40:52.966539    1604 kubeadm.go:319] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'

	I1109 14:40:52.967085    1604 kubeadm.go:319] [certs] Using certificateDir folder "/var/lib/minikube/certs"

	I1109 14:40:52.970282    1604 out.go:252]   - Generating certificates and keys ...

	I1109 14:40:52.970282    1604 kubeadm.go:319] [certs] Using existing ca certificate authority

	I1109 14:40:52.970282    1604 kubeadm.go:319] [certs] Using existing apiserver certificate and key on disk

	I1109 14:40:52.970852    1604 kubeadm.go:319] [certs] Using existing apiserver-kubelet-client certificate and key on disk

	I1109 14:40:52.970852    1604 kubeadm.go:319] [certs] Using existing front-proxy-ca certificate authority

	I1109 14:40:52.970852    1604 kubeadm.go:319] [certs] Using existing front-proxy-client certificate and key on disk

	I1109 14:40:52.970852    1604 kubeadm.go:319] [certs] Using existing etcd/ca certificate authority

	I1109 14:40:52.970852    1604 kubeadm.go:319] [certs] Using existing etcd/server certificate and key on disk

	I1109 14:40:52.971486    1604 kubeadm.go:319] [certs] Using existing etcd/peer certificate and key on disk

	I1109 14:40:52.971486    1604 kubeadm.go:319] [certs] Using existing etcd/healthcheck-client certificate and key on disk

	I1109 14:40:52.971486    1604 kubeadm.go:319] [certs] Using existing apiserver-etcd-client certificate and key on disk

	I1109 14:40:52.971486    1604 kubeadm.go:319] [certs] Using the existing "sa" key

	I1109 14:40:52.971486    1604 kubeadm.go:319] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"

	I1109 14:40:52.972135    1604 kubeadm.go:319] [kubeconfig] Writing "admin.conf" kubeconfig file

	I1109 14:40:52.972274    1604 kubeadm.go:319] [kubeconfig] Writing "kubelet.conf" kubeconfig file

	I1109 14:40:52.972345    1604 kubeadm.go:319] [kubeconfig] Writing "controller-manager.conf" kubeconfig file

	I1109 14:40:52.972345    1604 kubeadm.go:319] [kubeconfig] Writing "scheduler.conf" kubeconfig file

	I1109 14:40:52.972345    1604 kubeadm.go:319] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"

	I1109 14:40:52.972345    1604 kubeadm.go:319] [control-plane] Using manifest folder "/etc/kubernetes/manifests"

	I1109 14:40:52.974187    1604 out.go:252]   - Booting up control plane ...

	I1109 14:40:52.974781    1604 kubeadm.go:319] [control-plane] Creating static Pod manifest for "kube-apiserver"

	I1109 14:40:52.974781    1604 kubeadm.go:319] [control-plane] Creating static Pod manifest for "kube-controller-manager"

	I1109 14:40:52.974781    1604 kubeadm.go:319] [control-plane] Creating static Pod manifest for "kube-scheduler"

	I1109 14:40:52.974781    1604 kubeadm.go:319] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"

	I1109 14:40:52.975351    1604 kubeadm.go:319] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"

	I1109 14:40:52.975351    1604 kubeadm.go:319] [kubelet-start] Starting the kubelet

	I1109 14:40:52.975880    1604 kubeadm.go:319] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s

	I1109 14:40:52.975976    1604 kubeadm.go:319] [kubelet-check] Initial timeout of 40s passed.

	I1109 14:40:52.975976    1604 kubeadm.go:319] 

	I1109 14:40:52.975976    1604 kubeadm.go:319] Unfortunately, an error has occurred:

	I1109 14:40:52.975976    1604 kubeadm.go:319] 	timed out waiting for the condition

	I1109 14:40:52.975976    1604 kubeadm.go:319] 

	I1109 14:40:52.975976    1604 kubeadm.go:319] This error is likely caused by:

	I1109 14:40:52.975976    1604 kubeadm.go:319] 	- The kubelet is not running

	I1109 14:40:52.976500    1604 kubeadm.go:319] 	- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)

	I1109 14:40:52.976537    1604 kubeadm.go:319] 

	I1109 14:40:52.976627    1604 kubeadm.go:319] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:

	I1109 14:40:52.976627    1604 kubeadm.go:319] 	- 'systemctl status kubelet'

	I1109 14:40:52.976627    1604 kubeadm.go:319] 	- 'journalctl -xeu kubelet'

	I1109 14:40:52.976627    1604 kubeadm.go:319] 

	I1109 14:40:52.977183    1604 kubeadm.go:319] Additionally, a control plane component may have crashed or exited when started by the container runtime.

	I1109 14:40:52.977263    1604 kubeadm.go:319] To troubleshoot, list all containers using your preferred container runtimes CLI.

	I1109 14:40:52.977263    1604 kubeadm.go:319] Here is one example how you may list all running Kubernetes containers by using crictl:

	I1109 14:40:52.977263    1604 kubeadm.go:319] 	- 'crictl --runtime-endpoint unix:///var/run/cri-dockerd.sock ps -a | grep kube | grep -v pause'

	I1109 14:40:52.977835    1604 kubeadm.go:319] 	Once you have found the failing container, you can inspect its logs with:

	I1109 14:40:52.977835    1604 kubeadm.go:319] 	- 'crictl --runtime-endpoint unix:///var/run/cri-dockerd.sock logs CONTAINERID'

	W1109 14:40:52.977835    1604 out.go:285] ! initialization failed, will try again: wait: sudo /bin/bash -c "env PATH="/var/lib/minikube/binaries/v1.28.3:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables": Process exited with status 1

	stdout:

	[init] Using Kubernetes version: v1.28.3

	[preflight] Running pre-flight checks

	[preflight] Pulling images required for setting up a Kubernetes cluster

	[preflight] This might take a minute or two, depending on the speed of your internet connection

	[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'

	[certs] Using certificateDir folder "/var/lib/minikube/certs"

	[certs] Using existing ca certificate authority

	[certs] Using existing apiserver certificate and key on disk

	[certs] Using existing apiserver-kubelet-client certificate and key on disk

	[certs] Using existing front-proxy-ca certificate authority

	[certs] Using existing front-proxy-client certificate and key on disk

	[certs] Using existing etcd/ca certificate authority

	[certs] Using existing etcd/server certificate and key on disk

	[certs] Using existing etcd/peer certificate and key on disk

	[certs] Using existing etcd/healthcheck-client certificate and key on disk

	[certs] Using existing apiserver-etcd-client certificate and key on disk

	[certs] Using the existing "sa" key

	[kubeconfig] Using kubeconfig folder "/etc/kubernetes"

	[kubeconfig] Writing "admin.conf" kubeconfig file

	[kubeconfig] Writing "kubelet.conf" kubeconfig file

	[kubeconfig] Writing "controller-manager.conf" kubeconfig file

	[kubeconfig] Writing "scheduler.conf" kubeconfig file

	[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"

	[control-plane] Using manifest folder "/etc/kubernetes/manifests"

	[control-plane] Creating static Pod manifest for "kube-apiserver"

	[control-plane] Creating static Pod manifest for "kube-controller-manager"

	[control-plane] Creating static Pod manifest for "kube-scheduler"

	[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"

	[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"

	[kubelet-start] Starting the kubelet

	[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s

	[kubelet-check] Initial timeout of 40s passed.

	Unfortunately, an error has occurred:

		timed out waiting for the condition

	This error is likely caused by:

		- The kubelet is not running

		- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)

	If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:

		- 'systemctl status kubelet'

		- 'journalctl -xeu kubelet'

	Additionally, a control plane component may have crashed or exited when started by the container runtime.

	To troubleshoot, list all containers using your preferred container runtimes CLI.

	Here is one example how you may list all running Kubernetes containers by using crictl:

		- 'crictl --runtime-endpoint unix:///var/run/cri-dockerd.sock ps -a | grep kube | grep -v pause'

		Once you have found the failing container, you can inspect its logs with:

		- 'crictl --runtime-endpoint unix:///var/run/cri-dockerd.sock logs CONTAINERID'

	stderr:

		[WARNING Swap]: swap is enabled; production deployments should disable swap unless testing the NodeSwap feature gate of the kubelet

		[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'

	error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster

	To see the stack trace of this error execute with --v=5 or higher

	! initialization failed, will try again: wait: sudo /bin/bash -c "env PATH="/var/lib/minikube/binaries/v1.28.3:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables": Process exited with status 1

	stdout:

	[init] Using Kubernetes version: v1.28.3

	[preflight] Running pre-flight checks

	[preflight] Pulling images required for setting up a Kubernetes cluster

	[preflight] This might take a minute or two, depending on the speed of your internet connection

	[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'

	[certs] Using certificateDir folder "/var/lib/minikube/certs"

	[certs] Using existing ca certificate authority

	[certs] Using existing apiserver certificate and key on disk

	[certs] Using existing apiserver-kubelet-client certificate and key on disk

	[certs] Using existing front-proxy-ca certificate authority

	[certs] Using existing front-proxy-client certificate and key on disk

	[certs] Using existing etcd/ca certificate authority

	[certs] Using existing etcd/server certificate and key on disk

	[certs] Using existing etcd/peer certificate and key on disk

	[certs] Using existing etcd/healthcheck-client certificate and key on disk

	[certs] Using existing apiserver-etcd-client certificate and key on disk

	[certs] Using the existing "sa" key

	[kubeconfig] Using kubeconfig folder "/etc/kubernetes"

	[kubeconfig] Writing "admin.conf" kubeconfig file

	[kubeconfig] Writing "kubelet.conf" kubeconfig file

	[kubeconfig] Writing "controller-manager.conf" kubeconfig file

	[kubeconfig] Writing "scheduler.conf" kubeconfig file

	[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"

	[control-plane] Using manifest folder "/etc/kubernetes/manifests"

	[control-plane] Creating static Pod manifest for "kube-apiserver"

	[control-plane] Creating static Pod manifest for "kube-controller-manager"

	[control-plane] Creating static Pod manifest for "kube-scheduler"

	[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"

	[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"

	[kubelet-start] Starting the kubelet

	[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s

	[kubelet-check] Initial timeout of 40s passed.

	Unfortunately, an error has occurred:

		timed out waiting for the condition

	This error is likely caused by:

		- The kubelet is not running

		- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)

	If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:

		- 'systemctl status kubelet'

		- 'journalctl -xeu kubelet'

	Additionally, a control plane component may have crashed or exited when started by the container runtime.

	To troubleshoot, list all containers using your preferred container runtimes CLI.

	Here is one example how you may list all running Kubernetes containers by using crictl:

		- 'crictl --runtime-endpoint unix:///var/run/cri-dockerd.sock ps -a | grep kube | grep -v pause'

		Once you have found the failing container, you can inspect its logs with:

		- 'crictl --runtime-endpoint unix:///var/run/cri-dockerd.sock logs CONTAINERID'

	stderr:

		[WARNING Swap]: swap is enabled; production deployments should disable swap unless testing the NodeSwap feature gate of the kubelet

		[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'

	error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster

	To see the stack trace of this error execute with --v=5 or higher

	I1109 14:40:52.985713    1604 ssh_runner.go:195] Run: sudo /bin/bash -c "env PATH="/var/lib/minikube/binaries/v1.28.3:$PATH" kubeadm reset --cri-socket /var/run/cri-dockerd.sock --force"

	I1109 14:41:40.351651    1604 ssh_runner.go:235] Completed: sudo /bin/bash -c "env PATH="/var/lib/minikube/binaries/v1.28.3:$PATH" kubeadm reset --cri-socket /var/run/cri-dockerd.sock --force": (47.3653823s)

	I1109 14:41:40.360710    1604 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I1109 14:41:40.379667    1604 kubeadm.go:215] ignoring SystemVerification for kubeadm because of docker driver

	I1109 14:41:40.389313    1604 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf

	I1109 14:41:40.405263    1604 kubeadm.go:156] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2

	stdout:

	stderr:

	ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory

	I1109 14:41:40.405263    1604 kubeadm.go:158] found existing configuration files:

	I1109 14:41:40.415416    1604 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:0 /etc/kubernetes/admin.conf

	I1109 14:41:40.432357    1604 kubeadm.go:164] "https://control-plane.minikube.internal:0" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:0 /etc/kubernetes/admin.conf: Process exited with status 2

	stdout:

	stderr:

	grep: /etc/kubernetes/admin.conf: No such file or directory

	I1109 14:41:40.440507    1604 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf

	I1109 14:41:40.466717    1604 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:0 /etc/kubernetes/kubelet.conf

	I1109 14:41:40.483722    1604 kubeadm.go:164] "https://control-plane.minikube.internal:0" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:0 /etc/kubernetes/kubelet.conf: Process exited with status 2

	stdout:

	stderr:

	grep: /etc/kubernetes/kubelet.conf: No such file or directory

	I1109 14:41:40.494726    1604 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf

	I1109 14:41:40.519577    1604 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:0 /etc/kubernetes/controller-manager.conf

	I1109 14:41:40.533575    1604 kubeadm.go:164] "https://control-plane.minikube.internal:0" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:0 /etc/kubernetes/controller-manager.conf: Process exited with status 2

	stdout:

	stderr:

	grep: /etc/kubernetes/controller-manager.conf: No such file or directory

	I1109 14:41:40.540596    1604 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf

	I1109 14:41:40.562372    1604 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:0 /etc/kubernetes/scheduler.conf

	I1109 14:41:40.577892    1604 kubeadm.go:164] "https://control-plane.minikube.internal:0" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:0 /etc/kubernetes/scheduler.conf: Process exited with status 2

	stdout:

	stderr:

	grep: /etc/kubernetes/scheduler.conf: No such file or directory

	I1109 14:41:40.588072    1604 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf

	I1109 14:41:40.617137    1604 ssh_runner.go:286] Start: sudo /bin/bash -c "env PATH="/var/lib/minikube/binaries/v1.28.3:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"

	I1109 14:41:40.753866    1604 kubeadm.go:319] 	[WARNING Swap]: swap is enabled; production deployments should disable swap unless testing the NodeSwap feature gate of the kubelet

	I1109 14:41:40.872289    1604 kubeadm.go:319] 	[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'

	I1109 14:46:03.134407    1604 kubeadm.go:319] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster

	I1109 14:46:03.134407    1604 kubeadm.go:319] To see the stack trace of this error execute with --v=5 or higher

	I1109 14:46:03.138880    1604 kubeadm.go:319] [init] Using Kubernetes version: v1.28.3

	I1109 14:46:03.138939    1604 kubeadm.go:319] [preflight] Running pre-flight checks

	I1109 14:46:03.139260    1604 kubeadm.go:319] [preflight] Pulling images required for setting up a Kubernetes cluster

	I1109 14:46:03.139535    1604 kubeadm.go:319] [preflight] This might take a minute or two, depending on the speed of your internet connection

	I1109 14:46:03.139857    1604 kubeadm.go:319] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'

	I1109 14:46:03.140080    1604 kubeadm.go:319] [certs] Using certificateDir folder "/var/lib/minikube/certs"

	I1109 14:46:03.142713    1604 out.go:252]   - Generating certificates and keys ...

	I1109 14:46:03.143322    1604 kubeadm.go:319] [certs] Using existing ca certificate authority

	I1109 14:46:03.143568    1604 kubeadm.go:319] [certs] Using existing apiserver certificate and key on disk

	I1109 14:46:03.143755    1604 kubeadm.go:319] [certs] Using existing apiserver-kubelet-client certificate and key on disk

	I1109 14:46:03.143942    1604 kubeadm.go:319] [certs] Using existing front-proxy-ca certificate authority

	I1109 14:46:03.144190    1604 kubeadm.go:319] [certs] Using existing front-proxy-client certificate and key on disk

	I1109 14:46:03.144415    1604 kubeadm.go:319] [certs] Using existing etcd/ca certificate authority

	I1109 14:46:03.144415    1604 kubeadm.go:319] [certs] Using existing etcd/server certificate and key on disk

	I1109 14:46:03.144415    1604 kubeadm.go:319] [certs] Using existing etcd/peer certificate and key on disk

	I1109 14:46:03.144415    1604 kubeadm.go:319] [certs] Using existing etcd/healthcheck-client certificate and key on disk

	I1109 14:46:03.144415    1604 kubeadm.go:319] [certs] Using existing apiserver-etcd-client certificate and key on disk

	I1109 14:46:03.144969    1604 kubeadm.go:319] [certs] Using the existing "sa" key

	I1109 14:46:03.145024    1604 kubeadm.go:319] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"

	I1109 14:46:03.145024    1604 kubeadm.go:319] [kubeconfig] Writing "admin.conf" kubeconfig file

	I1109 14:46:03.145024    1604 kubeadm.go:319] [kubeconfig] Writing "kubelet.conf" kubeconfig file

	I1109 14:46:03.145024    1604 kubeadm.go:319] [kubeconfig] Writing "controller-manager.conf" kubeconfig file

	I1109 14:46:03.145024    1604 kubeadm.go:319] [kubeconfig] Writing "scheduler.conf" kubeconfig file

	I1109 14:46:03.145559    1604 kubeadm.go:319] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"

	I1109 14:46:03.145672    1604 kubeadm.go:319] [control-plane] Using manifest folder "/etc/kubernetes/manifests"

	I1109 14:46:03.148963    1604 out.go:252]   - Booting up control plane ...

	I1109 14:46:03.148963    1604 kubeadm.go:319] [control-plane] Creating static Pod manifest for "kube-apiserver"

	I1109 14:46:03.148963    1604 kubeadm.go:319] [control-plane] Creating static Pod manifest for "kube-controller-manager"

	I1109 14:46:03.148963    1604 kubeadm.go:319] [control-plane] Creating static Pod manifest for "kube-scheduler"

	I1109 14:46:03.149923    1604 kubeadm.go:319] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"

	I1109 14:46:03.149923    1604 kubeadm.go:319] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"

	I1109 14:46:03.149923    1604 kubeadm.go:319] [kubelet-start] Starting the kubelet

	I1109 14:46:03.149923    1604 kubeadm.go:319] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s

	I1109 14:46:03.149923    1604 kubeadm.go:319] [kubelet-check] Initial timeout of 40s passed.

	I1109 14:46:03.149923    1604 kubeadm.go:319] 

	I1109 14:46:03.150930    1604 kubeadm.go:319] Unfortunately, an error has occurred:

	I1109 14:46:03.150930    1604 kubeadm.go:319] 	timed out waiting for the condition

	I1109 14:46:03.150930    1604 kubeadm.go:319] 

	I1109 14:46:03.150930    1604 kubeadm.go:319] This error is likely caused by:

	I1109 14:46:03.150930    1604 kubeadm.go:319] 	- The kubelet is not running

	I1109 14:46:03.150930    1604 kubeadm.go:319] 	- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)

	I1109 14:46:03.150930    1604 kubeadm.go:319] 

	I1109 14:46:03.150930    1604 kubeadm.go:319] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:

	I1109 14:46:03.150930    1604 kubeadm.go:319] 	- 'systemctl status kubelet'

	I1109 14:46:03.150930    1604 kubeadm.go:319] 	- 'journalctl -xeu kubelet'

	I1109 14:46:03.150930    1604 kubeadm.go:319] 

	I1109 14:46:03.151913    1604 kubeadm.go:319] Additionally, a control plane component may have crashed or exited when started by the container runtime.

	I1109 14:46:03.151913    1604 kubeadm.go:319] To troubleshoot, list all containers using your preferred container runtimes CLI.

	I1109 14:46:03.151913    1604 kubeadm.go:319] Here is one example how you may list all running Kubernetes containers by using crictl:

	I1109 14:46:03.151913    1604 kubeadm.go:319] 	- 'crictl --runtime-endpoint unix:///var/run/cri-dockerd.sock ps -a | grep kube | grep -v pause'

	I1109 14:46:03.151913    1604 kubeadm.go:319] 	Once you have found the failing container, you can inspect its logs with:

	I1109 14:46:03.151913    1604 kubeadm.go:319] 	- 'crictl --runtime-endpoint unix:///var/run/cri-dockerd.sock logs CONTAINERID'

	I1109 14:46:03.151913    1604 kubeadm.go:403] duration metric: took 14m36.2712228s to StartCluster

	I1109 14:46:03.152926    1604 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}

	I1109 14:46:03.160077    1604 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver

	I1109 14:46:03.256048    1604 cri.go:89] found id: "f159ce501abc24427240ea30e47c614499580593ebea41b7479437ced5f19334"

	I1109 14:46:03.256048    1604 cri.go:89] found id: ""

	I1109 14:46:03.256048    1604 logs.go:282] 1 containers: [f159ce501abc24427240ea30e47c614499580593ebea41b7479437ced5f19334]

	I1109 14:46:03.266177    1604 ssh_runner.go:195] Run: which crictl

	I1109 14:46:03.274749    1604 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}

	I1109 14:46:03.281747    1604 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd

	I1109 14:46:03.373310    1604 cri.go:89] found id: "6c1d6990ec9a17213a491b9b31dc6b7a0c15a7cd579cd9b12f9b4eb7b925d0fc"

	I1109 14:46:03.373310    1604 cri.go:89] found id: ""

	I1109 14:46:03.373310    1604 logs.go:282] 1 containers: [6c1d6990ec9a17213a491b9b31dc6b7a0c15a7cd579cd9b12f9b4eb7b925d0fc]

	I1109 14:46:03.381575    1604 ssh_runner.go:195] Run: which crictl

	I1109 14:46:03.388574    1604 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}

	I1109 14:46:03.397569    1604 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns

	I1109 14:46:03.483585    1604 cri.go:89] found id: ""

	I1109 14:46:03.483585    1604 logs.go:282] 0 containers: []

	W1109 14:46:03.483585    1604 logs.go:284] No container was found matching "coredns"

	I1109 14:46:03.483585    1604 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}

	I1109 14:46:03.492604    1604 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler

	I1109 14:46:03.582247    1604 cri.go:89] found id: "9916a784d53cc5f2ca77c62d475395dc21acbe3a4cc052be5908741fae99bfee"

	I1109 14:46:03.582247    1604 cri.go:89] found id: ""

	I1109 14:46:03.582247    1604 logs.go:282] 1 containers: [9916a784d53cc5f2ca77c62d475395dc21acbe3a4cc052be5908741fae99bfee]

	I1109 14:46:03.590240    1604 ssh_runner.go:195] Run: which crictl

	I1109 14:46:03.599246    1604 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}

	I1109 14:46:03.607237    1604 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy

	I1109 14:46:03.687234    1604 cri.go:89] found id: ""

	I1109 14:46:03.687234    1604 logs.go:282] 0 containers: []

	W1109 14:46:03.687234    1604 logs.go:284] No container was found matching "kube-proxy"

	I1109 14:46:03.687234    1604 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}

	I1109 14:46:03.694235    1604 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager

	I1109 14:46:03.796939    1604 cri.go:89] found id: "bd1e895dfe296b588d9737b1a5eb36949c0c7eb030142f53536645f3348ee505"

	I1109 14:46:03.796965    1604 cri.go:89] found id: "df0342a399cd6c5cdae1627914dd8cfa5c439d038612bfd86863d8be51c874e9"

	I1109 14:46:03.796965    1604 cri.go:89] found id: ""

	I1109 14:46:03.797011    1604 logs.go:282] 2 containers: [bd1e895dfe296b588d9737b1a5eb36949c0c7eb030142f53536645f3348ee505 df0342a399cd6c5cdae1627914dd8cfa5c439d038612bfd86863d8be51c874e9]

	I1109 14:46:03.805759    1604 ssh_runner.go:195] Run: which crictl

	I1109 14:46:03.820720    1604 ssh_runner.go:195] Run: which crictl

	I1109 14:46:03.826719    1604 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}

	I1109 14:46:03.833719    1604 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet

	I1109 14:46:03.924217    1604 cri.go:89] found id: ""

	I1109 14:46:03.924217    1604 logs.go:282] 0 containers: []

	W1109 14:46:03.924217    1604 logs.go:284] No container was found matching "kindnet"

	I1109 14:46:03.925221    1604 cri.go:54] listing CRI containers in root : {State:all Name:storage-provisioner Namespaces:[]}

	I1109 14:46:03.932233    1604 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner

	I1109 14:46:04.024603    1604 cri.go:89] found id: ""

	I1109 14:46:04.024603    1604 logs.go:282] 0 containers: []

	W1109 14:46:04.024603    1604 logs.go:284] No container was found matching "storage-provisioner"

	I1109 14:46:04.024603    1604 logs.go:123] Gathering logs for kubelet ...

	I1109 14:46:04.024603    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"

	I1109 14:46:04.128605    1604 logs.go:123] Gathering logs for describe nodes ...

	I1109 14:46:04.128605    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"

	W1109 14:46:04.240535    1604 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1

	stdout:

	stderr:

	E1109 14:46:04.232003   22141 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:46:04.233049   22141 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:46:04.234185   22141 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:46:04.234963   22141 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:46:04.237327   22141 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	 output: 

	** stderr ** 

	E1109 14:46:04.232003   22141 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:46:04.233049   22141 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:46:04.234185   22141 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:46:04.234963   22141 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:46:04.237327   22141 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	** /stderr **

	I1109 14:46:04.240535    1604 logs.go:123] Gathering logs for kube-apiserver [f159ce501abc24427240ea30e47c614499580593ebea41b7479437ced5f19334] ...

	I1109 14:46:04.240535    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 f159ce501abc24427240ea30e47c614499580593ebea41b7479437ced5f19334"

	I1109 14:46:04.329115    1604 logs.go:123] Gathering logs for kube-controller-manager [bd1e895dfe296b588d9737b1a5eb36949c0c7eb030142f53536645f3348ee505] ...

	I1109 14:46:04.329115    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 bd1e895dfe296b588d9737b1a5eb36949c0c7eb030142f53536645f3348ee505"

	I1109 14:46:04.403632    1604 logs.go:123] Gathering logs for kube-controller-manager [df0342a399cd6c5cdae1627914dd8cfa5c439d038612bfd86863d8be51c874e9] ...

	I1109 14:46:04.403632    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 df0342a399cd6c5cdae1627914dd8cfa5c439d038612bfd86863d8be51c874e9"

	I1109 14:46:04.474152    1604 logs.go:123] Gathering logs for Docker ...

	I1109 14:46:04.474152    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"

	I1109 14:46:04.554610    1604 logs.go:123] Gathering logs for dmesg ...

	I1109 14:46:04.554610    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"

	I1109 14:46:04.583252    1604 logs.go:123] Gathering logs for etcd [6c1d6990ec9a17213a491b9b31dc6b7a0c15a7cd579cd9b12f9b4eb7b925d0fc] ...

	I1109 14:46:04.583363    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 6c1d6990ec9a17213a491b9b31dc6b7a0c15a7cd579cd9b12f9b4eb7b925d0fc"

	I1109 14:46:04.677842    1604 logs.go:123] Gathering logs for kube-scheduler [9916a784d53cc5f2ca77c62d475395dc21acbe3a4cc052be5908741fae99bfee] ...

	I1109 14:46:04.677981    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 9916a784d53cc5f2ca77c62d475395dc21acbe3a4cc052be5908741fae99bfee"

	I1109 14:46:04.803422    1604 logs.go:123] Gathering logs for container status ...

	I1109 14:46:04.803422    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"

	W1109 14:46:04.912632    1604 out.go:434] Error starting cluster: wait: sudo /bin/bash -c "env PATH="/var/lib/minikube/binaries/v1.28.3:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables": Process exited with status 1

	stdout:

	[init] Using Kubernetes version: v1.28.3

	[preflight] Running pre-flight checks

	[preflight] Pulling images required for setting up a Kubernetes cluster

	[preflight] This might take a minute or two, depending on the speed of your internet connection

	[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'

	[certs] Using certificateDir folder "/var/lib/minikube/certs"

	[certs] Using existing ca certificate authority

	[certs] Using existing apiserver certificate and key on disk

	[certs] Using existing apiserver-kubelet-client certificate and key on disk

	[certs] Using existing front-proxy-ca certificate authority

	[certs] Using existing front-proxy-client certificate and key on disk

	[certs] Using existing etcd/ca certificate authority

	[certs] Using existing etcd/server certificate and key on disk

	[certs] Using existing etcd/peer certificate and key on disk

	[certs] Using existing etcd/healthcheck-client certificate and key on disk

	[certs] Using existing apiserver-etcd-client certificate and key on disk

	[certs] Using the existing "sa" key

	[kubeconfig] Using kubeconfig folder "/etc/kubernetes"

	[kubeconfig] Writing "admin.conf" kubeconfig file

	[kubeconfig] Writing "kubelet.conf" kubeconfig file

	[kubeconfig] Writing "controller-manager.conf" kubeconfig file

	[kubeconfig] Writing "scheduler.conf" kubeconfig file

	[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"

	[control-plane] Using manifest folder "/etc/kubernetes/manifests"

	[control-plane] Creating static Pod manifest for "kube-apiserver"

	[control-plane] Creating static Pod manifest for "kube-controller-manager"

	[control-plane] Creating static Pod manifest for "kube-scheduler"

	[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"

	[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"

	[kubelet-start] Starting the kubelet

	[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s

	[kubelet-check] Initial timeout of 40s passed.

	Unfortunately, an error has occurred:

		timed out waiting for the condition

	This error is likely caused by:

		- The kubelet is not running

		- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)

	If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:

		- 'systemctl status kubelet'

		- 'journalctl -xeu kubelet'

	Additionally, a control plane component may have crashed or exited when started by the container runtime.

	To troubleshoot, list all containers using your preferred container runtimes CLI.

	Here is one example how you may list all running Kubernetes containers by using crictl:

		- 'crictl --runtime-endpoint unix:///var/run/cri-dockerd.sock ps -a | grep kube | grep -v pause'

		Once you have found the failing container, you can inspect its logs with:

		- 'crictl --runtime-endpoint unix:///var/run/cri-dockerd.sock logs CONTAINERID'

	stderr:

		[WARNING Swap]: swap is enabled; production deployments should disable swap unless testing the NodeSwap feature gate of the kubelet

		[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'

	error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster

	To see the stack trace of this error execute with --v=5 or higher

	W1109 14:46:04.912632    1604 out.go:285] * 

	* 

	W1109 14:46:04.912632    1604 out.go:285] X Error starting cluster: wait: sudo /bin/bash -c "env PATH="/var/lib/minikube/binaries/v1.28.3:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables": Process exited with status 1

	stdout:

	[init] Using Kubernetes version: v1.28.3

	[preflight] Running pre-flight checks

	[preflight] Pulling images required for setting up a Kubernetes cluster

	[preflight] This might take a minute or two, depending on the speed of your internet connection

	[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'

	[certs] Using certificateDir folder "/var/lib/minikube/certs"

	[certs] Using existing ca certificate authority

	[certs] Using existing apiserver certificate and key on disk

	[certs] Using existing apiserver-kubelet-client certificate and key on disk

	[certs] Using existing front-proxy-ca certificate authority

	[certs] Using existing front-proxy-client certificate and key on disk

	[certs] Using existing etcd/ca certificate authority

	[certs] Using existing etcd/server certificate and key on disk

	[certs] Using existing etcd/peer certificate and key on disk

	[certs] Using existing etcd/healthcheck-client certificate and key on disk

	[certs] Using existing apiserver-etcd-client certificate and key on disk

	[certs] Using the existing "sa" key

	[kubeconfig] Using kubeconfig folder "/etc/kubernetes"

	[kubeconfig] Writing "admin.conf" kubeconfig file

	[kubeconfig] Writing "kubelet.conf" kubeconfig file

	[kubeconfig] Writing "controller-manager.conf" kubeconfig file

	[kubeconfig] Writing "scheduler.conf" kubeconfig file

	[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"

	[control-plane] Using manifest folder "/etc/kubernetes/manifests"

	[control-plane] Creating static Pod manifest for "kube-apiserver"

	[control-plane] Creating static Pod manifest for "kube-controller-manager"

	[control-plane] Creating static Pod manifest for "kube-scheduler"

	[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"

	[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"

	[kubelet-start] Starting the kubelet

	[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s

	[kubelet-check] Initial timeout of 40s passed.

	Unfortunately, an error has occurred:

		timed out waiting for the condition

	This error is likely caused by:

		- The kubelet is not running

		- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)

	If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:

		- 'systemctl status kubelet'

		- 'journalctl -xeu kubelet'

	Additionally, a control plane component may have crashed or exited when started by the container runtime.

	To troubleshoot, list all containers using your preferred container runtimes CLI.

	Here is one example how you may list all running Kubernetes containers by using crictl:

		- 'crictl --runtime-endpoint unix:///var/run/cri-dockerd.sock ps -a | grep kube | grep -v pause'

		Once you have found the failing container, you can inspect its logs with:

		- 'crictl --runtime-endpoint unix:///var/run/cri-dockerd.sock logs CONTAINERID'

	stderr:

		[WARNING Swap]: swap is enabled; production deployments should disable swap unless testing the NodeSwap feature gate of the kubelet

		[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'

	error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster

	To see the stack trace of this error execute with --v=5 or higher

	X Error starting cluster: wait: sudo /bin/bash -c "env PATH="/var/lib/minikube/binaries/v1.28.3:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables": Process exited with status 1

	stdout:

	[init] Using Kubernetes version: v1.28.3

	[preflight] Running pre-flight checks

	[preflight] Pulling images required for setting up a Kubernetes cluster

	[preflight] This might take a minute or two, depending on the speed of your internet connection

	[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'

	[certs] Using certificateDir folder "/var/lib/minikube/certs"

	[certs] Using existing ca certificate authority

	[certs] Using existing apiserver certificate and key on disk

	[certs] Using existing apiserver-kubelet-client certificate and key on disk

	[certs] Using existing front-proxy-ca certificate authority

	[certs] Using existing front-proxy-client certificate and key on disk

	[certs] Using existing etcd/ca certificate authority

	[certs] Using existing etcd/server certificate and key on disk

	[certs] Using existing etcd/peer certificate and key on disk

	[certs] Using existing etcd/healthcheck-client certificate and key on disk

	[certs] Using existing apiserver-etcd-client certificate and key on disk

	[certs] Using the existing "sa" key

	[kubeconfig] Using kubeconfig folder "/etc/kubernetes"

	[kubeconfig] Writing "admin.conf" kubeconfig file

	[kubeconfig] Writing "kubelet.conf" kubeconfig file

	[kubeconfig] Writing "controller-manager.conf" kubeconfig file

	[kubeconfig] Writing "scheduler.conf" kubeconfig file

	[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"

	[control-plane] Using manifest folder "/etc/kubernetes/manifests"

	[control-plane] Creating static Pod manifest for "kube-apiserver"

	[control-plane] Creating static Pod manifest for "kube-controller-manager"

	[control-plane] Creating static Pod manifest for "kube-scheduler"

	[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"

	[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"

	[kubelet-start] Starting the kubelet

	[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s

	[kubelet-check] Initial timeout of 40s passed.

	Unfortunately, an error has occurred:

		timed out waiting for the condition

	This error is likely caused by:

		- The kubelet is not running

		- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)

	If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:

		- 'systemctl status kubelet'

		- 'journalctl -xeu kubelet'

	Additionally, a control plane component may have crashed or exited when started by the container runtime.

	To troubleshoot, list all containers using your preferred container runtimes CLI.

	Here is one example how you may list all running Kubernetes containers by using crictl:

		- 'crictl --runtime-endpoint unix:///var/run/cri-dockerd.sock ps -a | grep kube | grep -v pause'

		Once you have found the failing container, you can inspect its logs with:

		- 'crictl --runtime-endpoint unix:///var/run/cri-dockerd.sock logs CONTAINERID'

	stderr:

		[WARNING Swap]: swap is enabled; production deployments should disable swap unless testing the NodeSwap feature gate of the kubelet

		[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'

	error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster

	To see the stack trace of this error execute with --v=5 or higher

	W1109 14:46:04.913628    1604 out.go:285] * 

	* 

	W1109 14:46:04.915628    1604 out.go:308] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	I1109 14:46:04.918630    1604 out.go:203] 

	W1109 14:46:04.922623    1604 out.go:285] X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: sudo /bin/bash -c "env PATH="/var/lib/minikube/binaries/v1.28.3:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables": Process exited with status 1

	stdout:

	[init] Using Kubernetes version: v1.28.3

	[preflight] Running pre-flight checks

	[preflight] Pulling images required for setting up a Kubernetes cluster

	[preflight] This might take a minute or two, depending on the speed of your internet connection

	[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'

	[certs] Using certificateDir folder "/var/lib/minikube/certs"

	[certs] Using existing ca certificate authority

	[certs] Using existing apiserver certificate and key on disk

	[certs] Using existing apiserver-kubelet-client certificate and key on disk

	[certs] Using existing front-proxy-ca certificate authority

	[certs] Using existing front-proxy-client certificate and key on disk

	[certs] Using existing etcd/ca certificate authority

	[certs] Using existing etcd/server certificate and key on disk

	[certs] Using existing etcd/peer certificate and key on disk

	[certs] Using existing etcd/healthcheck-client certificate and key on disk

	[certs] Using existing apiserver-etcd-client certificate and key on disk

	[certs] Using the existing "sa" key

	[kubeconfig] Using kubeconfig folder "/etc/kubernetes"

	[kubeconfig] Writing "admin.conf" kubeconfig file

	[kubeconfig] Writing "kubelet.conf" kubeconfig file

	[kubeconfig] Writing "controller-manager.conf" kubeconfig file

	[kubeconfig] Writing "scheduler.conf" kubeconfig file

	[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"

	[control-plane] Using manifest folder "/etc/kubernetes/manifests"

	[control-plane] Creating static Pod manifest for "kube-apiserver"

	[control-plane] Creating static Pod manifest for "kube-controller-manager"

	[control-plane] Creating static Pod manifest for "kube-scheduler"

	[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"

	[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"

	[kubelet-start] Starting the kubelet

	[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s

	[kubelet-check] Initial timeout of 40s passed.

	Unfortunately, an error has occurred:

		timed out waiting for the condition

	This error is likely caused by:

		- The kubelet is not running

		- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)

	If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:

		- 'systemctl status kubelet'

		- 'journalctl -xeu kubelet'

	Additionally, a control plane component may have crashed or exited when started by the container runtime.

	To troubleshoot, list all containers using your preferred container runtimes CLI.

	Here is one example how you may list all running Kubernetes containers by using crictl:

		- 'crictl --runtime-endpoint unix:///var/run/cri-dockerd.sock ps -a | grep kube | grep -v pause'

		Once you have found the failing container, you can inspect its logs with:

		- 'crictl --runtime-endpoint unix:///var/run/cri-dockerd.sock logs CONTAINERID'

	stderr:

		[WARNING Swap]: swap is enabled; production deployments should disable swap unless testing the NodeSwap feature gate of the kubelet

		[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'

	error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster

	To see the stack trace of this error execute with --v=5 or higher

	X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: sudo /bin/bash -c "env PATH="/var/lib/minikube/binaries/v1.28.3:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables": Process exited with status 1

	stdout:

	[init] Using Kubernetes version: v1.28.3

	[preflight] Running pre-flight checks

	[preflight] Pulling images required for setting up a Kubernetes cluster

	[preflight] This might take a minute or two, depending on the speed of your internet connection

	[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'

	[certs] Using certificateDir folder "/var/lib/minikube/certs"

	[certs] Using existing ca certificate authority

	[certs] Using existing apiserver certificate and key on disk

	[certs] Using existing apiserver-kubelet-client certificate and key on disk

	[certs] Using existing front-proxy-ca certificate authority

	[certs] Using existing front-proxy-client certificate and key on disk

	[certs] Using existing etcd/ca certificate authority

	[certs] Using existing etcd/server certificate and key on disk

	[certs] Using existing etcd/peer certificate and key on disk

	[certs] Using existing etcd/healthcheck-client certificate and key on disk

	[certs] Using existing apiserver-etcd-client certificate and key on disk

	[certs] Using the existing "sa" key

	[kubeconfig] Using kubeconfig folder "/etc/kubernetes"

	[kubeconfig] Writing "admin.conf" kubeconfig file

	[kubeconfig] Writing "kubelet.conf" kubeconfig file

	[kubeconfig] Writing "controller-manager.conf" kubeconfig file

	[kubeconfig] Writing "scheduler.conf" kubeconfig file

	[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"

	[control-plane] Using manifest folder "/etc/kubernetes/manifests"

	[control-plane] Creating static Pod manifest for "kube-apiserver"

	[control-plane] Creating static Pod manifest for "kube-controller-manager"

	[control-plane] Creating static Pod manifest for "kube-scheduler"

	[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"

	[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"

	[kubelet-start] Starting the kubelet

	[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s

	[kubelet-check] Initial timeout of 40s passed.

	Unfortunately, an error has occurred:

		timed out waiting for the condition

	This error is likely caused by:

		- The kubelet is not running

		- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)

	If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:

		- 'systemctl status kubelet'

		- 'journalctl -xeu kubelet'

	Additionally, a control plane component may have crashed or exited when started by the container runtime.

	To troubleshoot, list all containers using your preferred container runtimes CLI.

	Here is one example how you may list all running Kubernetes containers by using crictl:

		- 'crictl --runtime-endpoint unix:///var/run/cri-dockerd.sock ps -a | grep kube | grep -v pause'

		Once you have found the failing container, you can inspect its logs with:

		- 'crictl --runtime-endpoint unix:///var/run/cri-dockerd.sock logs CONTAINERID'

	stderr:

		[WARNING Swap]: swap is enabled; production deployments should disable swap unless testing the NodeSwap feature gate of the kubelet

		[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'

	error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster

	To see the stack trace of this error execute with --v=5 or higher

	W1109 14:46:04.922623    1604 out.go:285] * Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start

	* Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start

	W1109 14:46:04.922623    1604 out.go:285] * Related issue: https://github.com/kubernetes/minikube/issues/4172

	* Related issue: https://github.com/kubernetes/minikube/issues/4172

	I1109 14:46:04.925626    1604 out.go:203] 

** /stderr **

version_upgrade_test.go:331: failed missing container upgrade from v1.32.0. args: out/minikube-windows-amd64.exe start -p missing-upgrade-184300 --memory=3072 --alsologtostderr -v=1 --driver=docker : exit status 109

version_upgrade_test.go:333: *** TestMissingContainerUpgrade FAILED at 2025-11-09 14:46:07.4721171 +0000 UTC m=+4617.288552401

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:223: ======>  post-mortem[TestMissingContainerUpgrade]: network settings <======

helpers_test.go:230: HOST ENV snapshots: PROXY env: HTTP_PROXY="<empty>" HTTPS_PROXY="<empty>" NO_PROXY="<empty>"

helpers_test.go:238: ======>  post-mortem[TestMissingContainerUpgrade]: docker inspect <======

helpers_test.go:239: (dbg) Run:  docker inspect missing-upgrade-184300

helpers_test.go:243: (dbg) docker inspect missing-upgrade-184300:

-- stdout --

	[

	    {

	        "Id": "659a1e82b8fc95337e7a1e2eb9b70e9b9bf9f447e50159f3f7a32f8f3f29e0c0",

	        "Created": "2025-11-09T14:30:52.746953276Z",

	        "Path": "/usr/local/bin/entrypoint",

	        "Args": [

	            "/sbin/init"

	        ],

	        "State": {

	            "Status": "running",

	            "Running": true,

	            "Paused": false,

	            "Restarting": false,

	            "OOMKilled": false,

	            "Dead": false,

	            "Pid": 216517,

	            "ExitCode": 0,

	            "Error": "",

	            "StartedAt": "2025-11-09T14:30:53.144838767Z",

	            "FinishedAt": "0001-01-01T00:00:00Z"

	        },

	        "Image": "sha256:dbc648475405a75e8c472743ce721cb0b74db98d9501831a17a27a54e2bd3e47",

	        "ResolvConfPath": "/var/lib/docker/containers/659a1e82b8fc95337e7a1e2eb9b70e9b9bf9f447e50159f3f7a32f8f3f29e0c0/resolv.conf",

	        "HostnamePath": "/var/lib/docker/containers/659a1e82b8fc95337e7a1e2eb9b70e9b9bf9f447e50159f3f7a32f8f3f29e0c0/hostname",

	        "HostsPath": "/var/lib/docker/containers/659a1e82b8fc95337e7a1e2eb9b70e9b9bf9f447e50159f3f7a32f8f3f29e0c0/hosts",

	        "LogPath": "/var/lib/docker/containers/659a1e82b8fc95337e7a1e2eb9b70e9b9bf9f447e50159f3f7a32f8f3f29e0c0/659a1e82b8fc95337e7a1e2eb9b70e9b9bf9f447e50159f3f7a32f8f3f29e0c0-json.log",

	        "Name": "/missing-upgrade-184300",

	        "RestartCount": 0,

	        "Driver": "overlay2",

	        "Platform": "linux",

	        "MountLabel": "",

	        "ProcessLabel": "",

	        "AppArmorProfile": "",

	        "ExecIDs": null,

	        "HostConfig": {

	            "Binds": [

	                "/lib/modules:/lib/modules:ro",

	                "missing-upgrade-184300:/var"

	            ],

	            "ContainerIDFile": "",

	            "LogConfig": {

	                "Type": "json-file",

	                "Config": {}

	            },

	            "NetworkMode": "missing-upgrade-184300",

	            "PortBindings": {

	                "22/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "0"

	                    }

	                ],

	                "2376/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "0"

	                    }

	                ],

	                "32443/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "0"

	                    }

	                ],

	                "5000/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "0"

	                    }

	                ],

	                "8443/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "0"

	                    }

	                ]

	            },

	            "RestartPolicy": {

	                "Name": "no",

	                "MaximumRetryCount": 0

	            },

	            "AutoRemove": false,

	            "VolumeDriver": "",

	            "VolumesFrom": null,

	            "ConsoleSize": [

	                0,

	                0

	            ],

	            "CapAdd": null,

	            "CapDrop": null,

	            "CgroupnsMode": "host",

	            "Dns": [],

	            "DnsOptions": [],

	            "DnsSearch": [],

	            "ExtraHosts": null,

	            "GroupAdd": null,

	            "IpcMode": "private",

	            "Cgroup": "",

	            "Links": null,

	            "OomScoreAdj": 0,

	            "PidMode": "",

	            "Privileged": true,

	            "PublishAllPorts": false,

	            "ReadonlyRootfs": false,

	            "SecurityOpt": [

	                "seccomp=unconfined",

	                "apparmor=unconfined",

	                "label=disable"

	            ],

	            "Tmpfs": {

	                "/run": "",

	                "/tmp": ""

	            },

	            "UTSMode": "",

	            "UsernsMode": "",

	            "ShmSize": 67108864,

	            "Runtime": "runc",

	            "Isolation": "",

	            "CpuShares": 0,

	            "Memory": 3221225472,

	            "NanoCpus": 2000000000,

	            "CgroupParent": "",

	            "BlkioWeight": 0,

	            "BlkioWeightDevice": [],

	            "BlkioDeviceReadBps": [],

	            "BlkioDeviceWriteBps": [],

	            "BlkioDeviceReadIOps": [],

	            "BlkioDeviceWriteIOps": [],

	            "CpuPeriod": 0,

	            "CpuQuota": 0,

	            "CpuRealtimePeriod": 0,

	            "CpuRealtimeRuntime": 0,

	            "CpusetCpus": "",

	            "CpusetMems": "",

	            "Devices": [],

	            "DeviceCgroupRules": null,

	            "DeviceRequests": null,

	            "MemoryReservation": 0,

	            "MemorySwap": 3221225472,

	            "MemorySwappiness": null,

	            "OomKillDisable": false,

	            "PidsLimit": null,

	            "Ulimits": [],

	            "CpuCount": 0,

	            "CpuPercent": 0,

	            "IOMaximumIOps": 0,

	            "IOMaximumBandwidth": 0,

	            "MaskedPaths": null,

	            "ReadonlyPaths": null

	        },

	        "GraphDriver": {

	            "Data": {

	                "LowerDir": "/var/lib/docker/overlay2/10a3c7c30ae88645e96ab7fbf0f410adc2ab1dede765fedf76722ce367ab1213-init/diff:/var/lib/docker/overlay2/55ad083245039cbda63d9302ce4d213654ad22f536902bc2ed5a10b3790ee955/diff",

	                "MergedDir": "/var/lib/docker/overlay2/10a3c7c30ae88645e96ab7fbf0f410adc2ab1dede765fedf76722ce367ab1213/merged",

	                "UpperDir": "/var/lib/docker/overlay2/10a3c7c30ae88645e96ab7fbf0f410adc2ab1dede765fedf76722ce367ab1213/diff",

	                "WorkDir": "/var/lib/docker/overlay2/10a3c7c30ae88645e96ab7fbf0f410adc2ab1dede765fedf76722ce367ab1213/work"

	            },

	            "Name": "overlay2"

	        },

	        "Mounts": [

	            {

	                "Type": "bind",

	                "Source": "/lib/modules",

	                "Destination": "/lib/modules",

	                "Mode": "ro",

	                "RW": false,

	                "Propagation": "rprivate"

	            },

	            {

	                "Type": "volume",

	                "Name": "missing-upgrade-184300",

	                "Source": "/var/lib/docker/volumes/missing-upgrade-184300/_data",

	                "Destination": "/var",

	                "Driver": "local",

	                "Mode": "z",

	                "RW": true,

	                "Propagation": ""

	            }

	        ],

	        "Config": {

	            "Hostname": "missing-upgrade-184300",

	            "Domainname": "",

	            "User": "",

	            "AttachStdin": false,

	            "AttachStdout": false,

	            "AttachStderr": false,

	            "ExposedPorts": {

	                "22/tcp": {},

	                "2376/tcp": {},

	                "32443/tcp": {},

	                "5000/tcp": {},

	                "8443/tcp": {}

	            },

	            "Tty": true,

	            "OpenStdin": false,

	            "StdinOnce": false,

	            "Env": [

	                "container=docker",

	                "PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"

	            ],

	            "Cmd": null,

	            "Image": "gcr.io/k8s-minikube/kicbase:v0.0.42@sha256:d35ac07dfda971cabee05e0deca8aeac772f885a5348e1a0c0b0a36db20fcfc0",

	            "Volumes": null,

	            "WorkingDir": "/",

	            "Entrypoint": [

	                "/usr/local/bin/entrypoint",

	                "/sbin/init"

	            ],

	            "OnBuild": null,

	            "Labels": {

	                "created_by.minikube.sigs.k8s.io": "true",

	                "mode.minikube.sigs.k8s.io": "missing-upgrade-184300",

	                "name.minikube.sigs.k8s.io": "missing-upgrade-184300",

	                "role.minikube.sigs.k8s.io": ""

	            },

	            "StopSignal": "SIGRTMIN+3"

	        },

	        "NetworkSettings": {

	            "Bridge": "",

	            "SandboxID": "186c53fb68a552b2f45c67480df88e8b614ec1bc94935556ece965780c580c8d",

	            "SandboxKey": "/var/run/docker/netns/186c53fb68a5",

	            "Ports": {

	                "22/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "51764"

	                    }

	                ],

	                "2376/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "51760"

	                    }

	                ],

	                "32443/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "51761"

	                    }

	                ],

	                "5000/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "51762"

	                    }

	                ],

	                "8443/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "51763"

	                    }

	                ]

	            },

	            "HairpinMode": false,

	            "LinkLocalIPv6Address": "",

	            "LinkLocalIPv6PrefixLen": 0,

	            "SecondaryIPAddresses": null,

	            "SecondaryIPv6Addresses": null,

	            "EndpointID": "",

	            "Gateway": "",

	            "GlobalIPv6Address": "",

	            "GlobalIPv6PrefixLen": 0,

	            "IPAddress": "",

	            "IPPrefixLen": 0,

	            "IPv6Gateway": "",

	            "MacAddress": "",

	            "Networks": {

	                "missing-upgrade-184300": {

	                    "IPAMConfig": {

	                        "IPv4Address": "192.168.121.2"

	                    },

	                    "Links": null,

	                    "Aliases": null,

	                    "MacAddress": "02:42:c0:a8:79:02",

	                    "DriverOpts": null,

	                    "NetworkID": "b58f83d134bf85cd7031bc684b0ee1bcee8db3807517302e73afa040f155af07",

	                    "EndpointID": "1b2cdb5c2ae972255e704fcdda97168571f42fe3837615c7f9011e613e9e9106",

	                    "Gateway": "192.168.121.1",

	                    "IPAddress": "192.168.121.2",

	                    "IPPrefixLen": 24,

	                    "IPv6Gateway": "",

	                    "GlobalIPv6Address": "",

	                    "GlobalIPv6PrefixLen": 0,

	                    "DNSNames": [

	                        "missing-upgrade-184300",

	                        "659a1e82b8fc"

	                    ]

	                }

	            }

	        }

	    }

	]

-- /stdout --

helpers_test.go:247: (dbg) Run:  out/minikube-windows-amd64.exe status --format={{.Host}} -p missing-upgrade-184300 -n missing-upgrade-184300

helpers_test.go:247: (dbg) Non-zero exit: out/minikube-windows-amd64.exe status --format={{.Host}} -p missing-upgrade-184300 -n missing-upgrade-184300: exit status 2 (673.6208ms)

-- stdout --

	Running

-- /stdout --

helpers_test.go:247: status error: exit status 2 (may be ok)

helpers_test.go:252: <<< TestMissingContainerUpgrade FAILED: start of post-mortem logs <<<

helpers_test.go:253: ======>  post-mortem[TestMissingContainerUpgrade]: minikube logs <======

helpers_test.go:255: (dbg) Run:  out/minikube-windows-amd64.exe -p missing-upgrade-184300 logs -n 25

E1109 14:46:09.405419   10336 cert_rotation.go:172] "Loading client cert failed" err="open C:\\Users\\jenkins.minikube4\\minikube-integration\\.minikube\\profiles\\addons-181600\\client.crt: The system cannot find the path specified." logger="tls-transport-cache.UnhandledError" key="key"

helpers_test.go:255: (dbg) Done: out/minikube-windows-amd64.exe -p missing-upgrade-184300 logs -n 25: (1.9471499s)

helpers_test.go:260: TestMissingContainerUpgrade logs: 

-- stdout --

	==> Audit <==

	┌─────────┬────────────────────────────────────────────────────────────────────────────────┬───────────────┬───────────────────┬─────────┬─────────────────────┬─────────────────────┐

	│ COMMAND │                                      ARGS                                      │    PROFILE    │       USER        │ VERSION │     START TIME      │      END TIME       │

	├─────────┼────────────────────────────────────────────────────────────────────────────────┼───────────────┼───────────────────┼─────────┼─────────────────────┼─────────────────────┤

	│ ssh     │ -p calico-643800 sudo iptables -t nat -L -n -v                                 │ calico-643800 │ minikube4\jenkins │ v1.37.0 │ 09 Nov 25 14:45 UTC │ 09 Nov 25 14:45 UTC │

	│ ssh     │ -p calico-643800 sudo systemctl status kubelet --all --full --no-pager         │ calico-643800 │ minikube4\jenkins │ v1.37.0 │ 09 Nov 25 14:45 UTC │ 09 Nov 25 14:45 UTC │

	│ ssh     │ -p calico-643800 sudo systemctl cat kubelet --no-pager                         │ calico-643800 │ minikube4\jenkins │ v1.37.0 │ 09 Nov 25 14:45 UTC │ 09 Nov 25 14:45 UTC │

	│ ssh     │ -p calico-643800 sudo journalctl -xeu kubelet --all --full --no-pager          │ calico-643800 │ minikube4\jenkins │ v1.37.0 │ 09 Nov 25 14:45 UTC │ 09 Nov 25 14:45 UTC │

	│ ssh     │ -p calico-643800 sudo cat /etc/kubernetes/kubelet.conf                         │ calico-643800 │ minikube4\jenkins │ v1.37.0 │ 09 Nov 25 14:45 UTC │ 09 Nov 25 14:45 UTC │

	│ ssh     │ -p calico-643800 sudo cat /var/lib/kubelet/config.yaml                         │ calico-643800 │ minikube4\jenkins │ v1.37.0 │ 09 Nov 25 14:45 UTC │ 09 Nov 25 14:45 UTC │

	│ ssh     │ -p calico-643800 sudo systemctl status docker --all --full --no-pager          │ calico-643800 │ minikube4\jenkins │ v1.37.0 │ 09 Nov 25 14:45 UTC │ 09 Nov 25 14:45 UTC │

	│ ssh     │ -p calico-643800 sudo systemctl cat docker --no-pager                          │ calico-643800 │ minikube4\jenkins │ v1.37.0 │ 09 Nov 25 14:45 UTC │ 09 Nov 25 14:45 UTC │

	│ ssh     │ -p calico-643800 sudo cat /etc/docker/daemon.json                              │ calico-643800 │ minikube4\jenkins │ v1.37.0 │ 09 Nov 25 14:45 UTC │ 09 Nov 25 14:45 UTC │

	│ ssh     │ -p calico-643800 sudo docker system info                                       │ calico-643800 │ minikube4\jenkins │ v1.37.0 │ 09 Nov 25 14:45 UTC │ 09 Nov 25 14:45 UTC │

	│ ssh     │ -p calico-643800 sudo systemctl status cri-docker --all --full --no-pager      │ calico-643800 │ minikube4\jenkins │ v1.37.0 │ 09 Nov 25 14:45 UTC │ 09 Nov 25 14:45 UTC │

	│ ssh     │ -p calico-643800 sudo systemctl cat cri-docker --no-pager                      │ calico-643800 │ minikube4\jenkins │ v1.37.0 │ 09 Nov 25 14:45 UTC │ 09 Nov 25 14:45 UTC │

	│ ssh     │ -p calico-643800 sudo cat /etc/systemd/system/cri-docker.service.d/10-cni.conf │ calico-643800 │ minikube4\jenkins │ v1.37.0 │ 09 Nov 25 14:45 UTC │ 09 Nov 25 14:45 UTC │

	│ ssh     │ -p calico-643800 sudo cat /usr/lib/systemd/system/cri-docker.service           │ calico-643800 │ minikube4\jenkins │ v1.37.0 │ 09 Nov 25 14:45 UTC │ 09 Nov 25 14:45 UTC │

	│ ssh     │ -p calico-643800 sudo cri-dockerd --version                                    │ calico-643800 │ minikube4\jenkins │ v1.37.0 │ 09 Nov 25 14:45 UTC │ 09 Nov 25 14:46 UTC │

	│ ssh     │ -p calico-643800 sudo systemctl status containerd --all --full --no-pager      │ calico-643800 │ minikube4\jenkins │ v1.37.0 │ 09 Nov 25 14:46 UTC │ 09 Nov 25 14:46 UTC │

	│ ssh     │ -p calico-643800 sudo systemctl cat containerd --no-pager                      │ calico-643800 │ minikube4\jenkins │ v1.37.0 │ 09 Nov 25 14:46 UTC │ 09 Nov 25 14:46 UTC │

	│ ssh     │ -p calico-643800 sudo cat /lib/systemd/system/containerd.service               │ calico-643800 │ minikube4\jenkins │ v1.37.0 │ 09 Nov 25 14:46 UTC │ 09 Nov 25 14:46 UTC │

	│ ssh     │ -p calico-643800 sudo cat /etc/containerd/config.toml                          │ calico-643800 │ minikube4\jenkins │ v1.37.0 │ 09 Nov 25 14:46 UTC │ 09 Nov 25 14:46 UTC │

	│ ssh     │ -p calico-643800 sudo containerd config dump                                   │ calico-643800 │ minikube4\jenkins │ v1.37.0 │ 09 Nov 25 14:46 UTC │ 09 Nov 25 14:46 UTC │

	│ ssh     │ -p calico-643800 sudo systemctl status crio --all --full --no-pager            │ calico-643800 │ minikube4\jenkins │ v1.37.0 │ 09 Nov 25 14:46 UTC │                     │

	│ ssh     │ -p calico-643800 sudo systemctl cat crio --no-pager                            │ calico-643800 │ minikube4\jenkins │ v1.37.0 │ 09 Nov 25 14:46 UTC │ 09 Nov 25 14:46 UTC │

	│ ssh     │ -p calico-643800 sudo find /etc/crio -type f -exec sh -c 'echo {}; cat {}' \;  │ calico-643800 │ minikube4\jenkins │ v1.37.0 │ 09 Nov 25 14:46 UTC │ 09 Nov 25 14:46 UTC │

	│ ssh     │ -p calico-643800 sudo crio config                                              │ calico-643800 │ minikube4\jenkins │ v1.37.0 │ 09 Nov 25 14:46 UTC │ 09 Nov 25 14:46 UTC │

	│ delete  │ -p calico-643800                                                               │ calico-643800 │ minikube4\jenkins │ v1.37.0 │ 09 Nov 25 14:46 UTC │                     │

	└─────────┴────────────────────────────────────────────────────────────────────────────────┴───────────────┴───────────────────┴─────────┴─────────────────────┴─────────────────────┘

	==> Last Start <==

	Log file created at: 2025/11/09 14:45:29

	Running on machine: minikube4

	Binary: Built with gc go1.24.6 for windows/amd64

	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg

	I1109 14:45:28.970626   11408 out.go:360] Setting OutFile to fd 1080 ...

	I1109 14:45:29.019806   11408 out.go:408] TERM=,COLORTERM=, which probably does not support color

	I1109 14:45:29.019806   11408 out.go:374] Setting ErrFile to fd 1508...

	I1109 14:45:29.019806   11408 out.go:408] TERM=,COLORTERM=, which probably does not support color

	I1109 14:45:29.042346   11408 out.go:368] Setting JSON to false

	I1109 14:45:29.047113   11408 start.go:133] hostinfo: {"hostname":"minikube4","uptime":5478,"bootTime":1762694050,"procs":194,"os":"windows","platform":"Microsoft Windows 10 Enterprise N","platformFamily":"Standalone Workstation","platformVersion":"10.0.19045.6456 Build 19045.6456","kernelVersion":"10.0.19045.6456 Build 19045.6456","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"df6bfb5f-73f2-4acb-9365-df7854ecbb28"}

	W1109 14:45:29.047113   11408 start.go:141] gopshost.Virtualization returned error: not implemented yet

	I1109 14:45:29.049508   11408 out.go:179] * [enable-default-cni-643800] minikube v1.37.0 on Microsoft Windows 10 Enterprise N 10.0.19045.6456 Build 19045.6456

	I1109 14:45:29.055576   11408 notify.go:221] Checking for updates...

	I1109 14:45:29.058660   11408 out.go:179]   - KUBECONFIG=C:\Users\jenkins.minikube4\minikube-integration\kubeconfig

	I1109 14:45:29.060624   11408 out.go:179]   - MINIKUBE_FORCE_SYSTEMD=

	I1109 14:45:29.062623   11408 out.go:179]   - MINIKUBE_HOME=C:\Users\jenkins.minikube4\minikube-integration\.minikube

	I1109 14:45:29.064622   11408 out.go:179]   - MINIKUBE_LOCATION=21139

	I1109 14:45:29.067614   11408 out.go:179]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I1109 14:45:29.070616   11408 config.go:182] Loaded profile config "calico-643800": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.34.1

	I1109 14:45:29.070616   11408 config.go:182] Loaded profile config "false-643800": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.34.1

	I1109 14:45:29.071612   11408 config.go:182] Loaded profile config "missing-upgrade-184300": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.28.3

	I1109 14:45:29.071612   11408 driver.go:422] Setting default libvirt URI to qemu:///system

	I1109 14:45:29.209056   11408 docker.go:124] docker version: linux-27.4.0:Docker Desktop 4.37.1 (178610)

	I1109 14:45:29.215048   11408 cli_runner.go:164] Run: docker system info --format "{{json .}}"

	I1109 14:45:29.480547   11408 info.go:266] docker info: {ID:a15b78d1-f772-48f7-bbf5-f8fe086f3f87 Containers:3 ContainersRunning:3 ContainersPaused:0 ContainersStopped:0 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:91 OomKillDisable:true NGoroutines:95 SystemTime:2025-11-09 14:45:29.460482668 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:14 KernelVersion:5.15.153.1-microsoft-standard-WSL2 OperatingSystem:Docker Desktop OSType:linux Architecture:x86_64 Ind

exServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:16 MemTotal:33657536512 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy:http.docker.internal:3128 HTTPSProxy:http.docker.internal:3128 NoProxy:hubproxy.docker.internal Name:docker-desktop Labels:[com.docker.desktop.address=npipe://\\.\pipe\docker_cli] ExperimentalBuild:false ServerVersion:27.4.0 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:472731909fa34bd7bc9c087e4c27943f9835f111 Expected:472731909fa34bd7bc9c087e4c27943f9835f111} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0

Expected:de40ad0} SecurityOptions:[name=seccomp,profile=unconfined] ProductLicense: Warnings:[WARNING: No blkio throttle.read_bps_device support WARNING: No blkio throttle.write_bps_device support WARNING: No blkio throttle.read_iops_device support WARNING: No blkio throttle.write_iops_device support WARNING: daemon is not using the default seccomp profile] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:ai Path:C:\Program Files\Docker\cli-plugins\docker-ai.exe SchemaVersion:0.1.0 ShortDescription:Ask Gordon - Docker Agent Vendor:Docker Inc. Version:v0.5.1] map[Name:buildx Path:C:\Program Files\Docker\cli-plugins\docker-buildx.exe SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.19.2-desktop.1] map[Name:compose Path:C:\Program Files\Docker\cli-plugins\docker-compose.exe SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.31.0-desktop.2] map[Name:debug Path:C:\Program Files\Docker\cli-plugins\docker-debug.exe SchemaVersion:0.1.0 ShortDescr

iption:Get a shell into any image or container Vendor:Docker Inc. Version:0.0.37] map[Name:desktop Path:C:\Program Files\Docker\cli-plugins\docker-desktop.exe SchemaVersion:0.1.0 ShortDescription:Docker Desktop commands (Beta) Vendor:Docker Inc. Version:v0.1.0] map[Name:dev Path:C:\Program Files\Docker\cli-plugins\docker-dev.exe SchemaVersion:0.1.0 ShortDescription:Docker Dev Environments Vendor:Docker Inc. Version:v0.1.2] map[Name:extension Path:C:\Program Files\Docker\cli-plugins\docker-extension.exe SchemaVersion:0.1.0 ShortDescription:Manages Docker extensions Vendor:Docker Inc. Version:v0.2.27] map[Name:feedback Path:C:\Program Files\Docker\cli-plugins\docker-feedback.exe SchemaVersion:0.1.0 ShortDescription:Provide feedback, right in your terminal! Vendor:Docker Inc. Version:v1.0.5] map[Name:init Path:C:\Program Files\Docker\cli-plugins\docker-init.exe SchemaVersion:0.1.0 ShortDescription:Creates Docker-related starter files for your project Vendor:Docker Inc. Version:v1.4.0] map[Name:sbom Path:C:\Progr

am Files\Docker\cli-plugins\docker-sbom.exe SchemaVersion:0.1.0 ShortDescription:View the packaged-based Software Bill Of Materials (SBOM) for an image URL:https://github.com/docker/sbom-cli-plugin Vendor:Anchore Inc. Version:0.6.0] map[Name:scout Path:C:\Program Files\Docker\cli-plugins\docker-scout.exe SchemaVersion:0.1.0 ShortDescription:Docker Scout Vendor:Docker Inc. Version:v1.15.1]] Warnings:<nil>}}

	I1109 14:45:29.483544   11408 out.go:179] * Using the docker driver based on user configuration

	I1109 14:45:29.486535   11408 start.go:309] selected driver: docker

	I1109 14:45:29.486535   11408 start.go:930] validating driver "docker" against <nil>

	I1109 14:45:29.486535   11408 start.go:941] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}

	I1109 14:45:29.533463   11408 cli_runner.go:164] Run: docker system info --format "{{json .}}"

	I1109 14:45:29.788481   11408 info.go:266] docker info: {ID:a15b78d1-f772-48f7-bbf5-f8fe086f3f87 Containers:3 ContainersRunning:3 ContainersPaused:0 ContainersStopped:0 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:91 OomKillDisable:true NGoroutines:95 SystemTime:2025-11-09 14:45:29.76810613 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:14 KernelVersion:5.15.153.1-microsoft-standard-WSL2 OperatingSystem:Docker Desktop OSType:linux Architecture:x86_64 Inde

xServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:16 MemTotal:33657536512 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy:http.docker.internal:3128 HTTPSProxy:http.docker.internal:3128 NoProxy:hubproxy.docker.internal Name:docker-desktop Labels:[com.docker.desktop.address=npipe://\\.\pipe\docker_cli] ExperimentalBuild:false ServerVersion:27.4.0 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:472731909fa34bd7bc9c087e4c27943f9835f111 Expected:472731909fa34bd7bc9c087e4c27943f9835f111} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0 E

xpected:de40ad0} SecurityOptions:[name=seccomp,profile=unconfined] ProductLicense: Warnings:[WARNING: No blkio throttle.read_bps_device support WARNING: No blkio throttle.write_bps_device support WARNING: No blkio throttle.read_iops_device support WARNING: No blkio throttle.write_iops_device support WARNING: daemon is not using the default seccomp profile] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:ai Path:C:\Program Files\Docker\cli-plugins\docker-ai.exe SchemaVersion:0.1.0 ShortDescription:Ask Gordon - Docker Agent Vendor:Docker Inc. Version:v0.5.1] map[Name:buildx Path:C:\Program Files\Docker\cli-plugins\docker-buildx.exe SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.19.2-desktop.1] map[Name:compose Path:C:\Program Files\Docker\cli-plugins\docker-compose.exe SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.31.0-desktop.2] map[Name:debug Path:C:\Program Files\Docker\cli-plugins\docker-debug.exe SchemaVersion:0.1.0 ShortDescri

ption:Get a shell into any image or container Vendor:Docker Inc. Version:0.0.37] map[Name:desktop Path:C:\Program Files\Docker\cli-plugins\docker-desktop.exe SchemaVersion:0.1.0 ShortDescription:Docker Desktop commands (Beta) Vendor:Docker Inc. Version:v0.1.0] map[Name:dev Path:C:\Program Files\Docker\cli-plugins\docker-dev.exe SchemaVersion:0.1.0 ShortDescription:Docker Dev Environments Vendor:Docker Inc. Version:v0.1.2] map[Name:extension Path:C:\Program Files\Docker\cli-plugins\docker-extension.exe SchemaVersion:0.1.0 ShortDescription:Manages Docker extensions Vendor:Docker Inc. Version:v0.2.27] map[Name:feedback Path:C:\Program Files\Docker\cli-plugins\docker-feedback.exe SchemaVersion:0.1.0 ShortDescription:Provide feedback, right in your terminal! Vendor:Docker Inc. Version:v1.0.5] map[Name:init Path:C:\Program Files\Docker\cli-plugins\docker-init.exe SchemaVersion:0.1.0 ShortDescription:Creates Docker-related starter files for your project Vendor:Docker Inc. Version:v1.4.0] map[Name:sbom Path:C:\Progra

m Files\Docker\cli-plugins\docker-sbom.exe SchemaVersion:0.1.0 ShortDescription:View the packaged-based Software Bill Of Materials (SBOM) for an image URL:https://github.com/docker/sbom-cli-plugin Vendor:Anchore Inc. Version:0.6.0] map[Name:scout Path:C:\Program Files\Docker\cli-plugins\docker-scout.exe SchemaVersion:0.1.0 ShortDescription:Docker Scout Vendor:Docker Inc. Version:v1.15.1]] Warnings:<nil>}}

	I1109 14:45:29.789470   11408 start_flags.go:327] no existing cluster config was found, will generate one from the flags 

	E1109 14:45:29.789470   11408 start_flags.go:481] Found deprecated --enable-default-cni flag, setting --cni=bridge

	I1109 14:45:29.789470   11408 start_flags.go:992] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]

	I1109 14:45:29.793470   11408 out.go:179] * Using Docker Desktop driver with root privileges

	I1109 14:45:29.795469   11408 cni.go:84] Creating CNI manager for "bridge"

	I1109 14:45:29.795469   11408 start_flags.go:336] Found "bridge CNI" CNI - setting NetworkPlugin=cni

	I1109 14:45:29.795469   11408 start.go:353] cluster config:

	{Name:enable-default-cni-643800 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1761985721-21837@sha256:a50b37e97dfdea51156e079ca6b45818a801b3d41bbe13d141f35d2e1af6c7d1 Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.1 ClusterName:enable-default-cni-643800 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluste

r.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:bridge} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.34.1 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticI

P: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I1109 14:45:29.800470   11408 out.go:179] * Starting "enable-default-cni-643800" primary control-plane node in "enable-default-cni-643800" cluster

	I1109 14:45:29.802469   11408 cache.go:134] Beginning downloading kic base image for docker with docker

	I1109 14:45:29.806471   11408 out.go:179] * Pulling base image v0.0.48-1761985721-21837 ...

	I1109 14:45:29.808469   11408 preload.go:188] Checking if preload exists for k8s version v1.34.1 and runtime docker

	I1109 14:45:29.808469   11408 image.go:81] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1761985721-21837@sha256:a50b37e97dfdea51156e079ca6b45818a801b3d41bbe13d141f35d2e1af6c7d1 in local docker daemon

	I1109 14:45:29.808469   11408 preload.go:203] Found local preload: C:\Users\jenkins.minikube4\minikube-integration\.minikube\cache\preloaded-tarball\preloaded-images-k8s-v18-v1.34.1-docker-overlay2-amd64.tar.lz4

	I1109 14:45:29.808469   11408 cache.go:65] Caching tarball of preloaded images

	I1109 14:45:29.809469   11408 preload.go:238] Found C:\Users\jenkins.minikube4\minikube-integration\.minikube\cache\preloaded-tarball\preloaded-images-k8s-v18-v1.34.1-docker-overlay2-amd64.tar.lz4 in cache, skipping download

	I1109 14:45:29.809469   11408 cache.go:68] Finished verifying existence of preloaded tar for v1.34.1 on docker

	I1109 14:45:29.809469   11408 profile.go:143] Saving config to C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\enable-default-cni-643800\config.json ...

	I1109 14:45:29.809469   11408 lock.go:35] WriteFile acquiring C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\enable-default-cni-643800\config.json: {Name:mk56b0474ecbe7121ceffe5bb621c1a595d30169 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1109 14:45:29.892733   11408 image.go:100] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1761985721-21837@sha256:a50b37e97dfdea51156e079ca6b45818a801b3d41bbe13d141f35d2e1af6c7d1 in local docker daemon, skipping pull

	I1109 14:45:29.892783   11408 cache.go:158] gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1761985721-21837@sha256:a50b37e97dfdea51156e079ca6b45818a801b3d41bbe13d141f35d2e1af6c7d1 exists in daemon, skipping load

	I1109 14:45:29.892869   11408 cache.go:243] Successfully downloaded all kic artifacts

	I1109 14:45:29.892914   11408 start.go:360] acquireMachinesLock for enable-default-cni-643800: {Name:mk4ac0b9c855ef4ff1a4f22103ba006b7bea0840 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I1109 14:45:29.893043   11408 start.go:364] duration metric: took 88.7µs to acquireMachinesLock for "enable-default-cni-643800"

	I1109 14:45:29.893321   11408 start.go:93] Provisioning new machine with config: &{Name:enable-default-cni-643800 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1761985721-21837@sha256:a50b37e97dfdea51156e079ca6b45818a801b3d41bbe13d141f35d2e1af6c7d1 Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.1 ClusterName:enable-default-cni-643800 Namespace:default APIServer

HAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:bridge} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.34.1 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDN

SLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.34.1 ContainerRuntime:docker ControlPlane:true Worker:true}

	I1109 14:45:29.893461   11408 start.go:125] createHost starting for "" (driver="docker")

	I1109 14:45:27.029343    7796 oci.go:144] the created container "false-643800" has a running status.

	I1109 14:45:27.029343    7796 kic.go:225] Creating ssh key for kic: C:\Users\jenkins.minikube4\minikube-integration\.minikube\machines\false-643800\id_rsa...

	I1109 14:45:27.516849    7796 kic_runner.go:191] docker (temp): C:\Users\jenkins.minikube4\minikube-integration\.minikube\machines\false-643800\id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)

	I1109 14:45:28.179004    7796 cli_runner.go:164] Run: docker container inspect false-643800 --format={{.State.Status}}

	I1109 14:45:28.247819    7796 kic_runner.go:93] Run: chown docker:docker /home/docker/.ssh/authorized_keys

	I1109 14:45:28.247819    7796 kic_runner.go:114] Args: [docker exec --privileged false-643800 chown docker:docker /home/docker/.ssh/authorized_keys]

	I1109 14:45:28.368113    7796 kic.go:265] ensuring only current user has permissions to key file located at : C:\Users\jenkins.minikube4\minikube-integration\.minikube\machines\false-643800\id_rsa...

	I1109 14:45:30.711140    7796 cli_runner.go:164] Run: docker container inspect false-643800 --format={{.State.Status}}

	I1109 14:45:30.766983    7796 machine.go:94] provisionDockerMachine start ...

	I1109 14:45:30.776579    7796 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" false-643800

	I1109 14:45:30.831314    7796 main.go:143] libmachine: Using SSH client type: native

	I1109 14:45:30.846133    7796 main.go:143] libmachine: &{{{<nil> 0 [] [] []} docker [0x11319e0] 0x1134500 <nil>  [] 0s} 127.0.0.1 54027 <nil> <nil>}

	I1109 14:45:30.846210    7796 main.go:143] libmachine: About to run SSH command:

	hostname

	I1109 14:45:31.024698    7796 main.go:143] libmachine: SSH cmd err, output: <nil>: false-643800

	I1109 14:45:31.024782    7796 ubuntu.go:182] provisioning hostname "false-643800"

	I1109 14:45:31.035056    7796 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" false-643800

	I1109 14:45:31.101975    7796 main.go:143] libmachine: Using SSH client type: native

	I1109 14:45:31.102973    7796 main.go:143] libmachine: &{{{<nil> 0 [] [] []} docker [0x11319e0] 0x1134500 <nil>  [] 0s} 127.0.0.1 54027 <nil> <nil>}

	I1109 14:45:31.102973    7796 main.go:143] libmachine: About to run SSH command:

	sudo hostname false-643800 && echo "false-643800" | sudo tee /etc/hostname

	I1109 14:45:31.371942    7796 main.go:143] libmachine: SSH cmd err, output: <nil>: false-643800

	I1109 14:45:31.380055    7796 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" false-643800

	I1109 14:45:31.440966    7796 main.go:143] libmachine: Using SSH client type: native

	I1109 14:45:31.441533    7796 main.go:143] libmachine: &{{{<nil> 0 [] [] []} docker [0x11319e0] 0x1134500 <nil>  [] 0s} 127.0.0.1 54027 <nil> <nil>}

	I1109 14:45:31.441533    7796 main.go:143] libmachine: About to run SSH command:

			if ! grep -xq '.*\sfalse-643800' /etc/hosts; then

				if grep -xq '127.0.1.1\s.*' /etc/hosts; then

					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 false-643800/g' /etc/hosts;

				else 

					echo '127.0.1.1 false-643800' | sudo tee -a /etc/hosts; 

				fi

			fi

	I1109 14:45:31.744790    7796 main.go:143] libmachine: SSH cmd err, output: <nil>: 

	I1109 14:45:31.744790    7796 ubuntu.go:188] set auth options {CertDir:C:\Users\jenkins.minikube4\minikube-integration\.minikube CaCertPath:C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\ca.pem CaPrivateKeyPath:C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:C:\Users\jenkins.minikube4\minikube-integration\.minikube\machines\server.pem ServerKeyPath:C:\Users\jenkins.minikube4\minikube-integration\.minikube\machines\server-key.pem ClientKeyPath:C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\cert.pem ServerCertSANs:[] StorePath:C:\Users\jenkins.minikube4\minikube-integration\.minikube}

	I1109 14:45:31.744790    7796 ubuntu.go:190] setting up certificates

	I1109 14:45:31.744790    7796 provision.go:84] configureAuth start

	I1109 14:45:31.752080    7796 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" false-643800

	I1109 14:45:31.809112    7796 provision.go:143] copyHostCerts

	I1109 14:45:31.809613    7796 exec_runner.go:144] found C:\Users\jenkins.minikube4\minikube-integration\.minikube/key.pem, removing ...

	I1109 14:45:31.809673    7796 exec_runner.go:203] rm: C:\Users\jenkins.minikube4\minikube-integration\.minikube\key.pem

	I1109 14:45:31.809793    7796 exec_runner.go:151] cp: C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\key.pem --> C:\Users\jenkins.minikube4\minikube-integration\.minikube/key.pem (1679 bytes)

	I1109 14:45:31.810899    7796 exec_runner.go:144] found C:\Users\jenkins.minikube4\minikube-integration\.minikube/ca.pem, removing ...

	I1109 14:45:31.810899    7796 exec_runner.go:203] rm: C:\Users\jenkins.minikube4\minikube-integration\.minikube\ca.pem

	I1109 14:45:31.811215    7796 exec_runner.go:151] cp: C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\ca.pem --> C:\Users\jenkins.minikube4\minikube-integration\.minikube/ca.pem (1082 bytes)

	I1109 14:45:31.812308    7796 exec_runner.go:144] found C:\Users\jenkins.minikube4\minikube-integration\.minikube/cert.pem, removing ...

	I1109 14:45:31.812357    7796 exec_runner.go:203] rm: C:\Users\jenkins.minikube4\minikube-integration\.minikube\cert.pem

	I1109 14:45:31.812521    7796 exec_runner.go:151] cp: C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\cert.pem --> C:\Users\jenkins.minikube4\minikube-integration\.minikube/cert.pem (1123 bytes)

	I1109 14:45:31.813643    7796 provision.go:117] generating server cert: C:\Users\jenkins.minikube4\minikube-integration\.minikube\machines\server.pem ca-key=C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\ca.pem private-key=C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\ca-key.pem org=jenkins.false-643800 san=[127.0.0.1 192.168.85.2 false-643800 localhost minikube]

	I1109 14:45:29.897028   11408 out.go:252] * Creating docker container (CPUs=2, Memory=3072MB) ...

	I1109 14:45:29.897028   11408 start.go:159] libmachine.API.Create for "enable-default-cni-643800" (driver="docker")

	I1109 14:45:29.897028   11408 client.go:173] LocalClient.Create starting

	I1109 14:45:29.897733   11408 main.go:143] libmachine: Reading certificate data from C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\ca.pem

	I1109 14:45:29.897938   11408 main.go:143] libmachine: Decoding PEM data...

	I1109 14:45:29.897975   11408 main.go:143] libmachine: Parsing certificate...

	I1109 14:45:29.898102   11408 main.go:143] libmachine: Reading certificate data from C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\cert.pem

	I1109 14:45:29.898266   11408 main.go:143] libmachine: Decoding PEM data...

	I1109 14:45:29.898304   11408 main.go:143] libmachine: Parsing certificate...

	I1109 14:45:29.905948   11408 cli_runner.go:164] Run: docker network inspect enable-default-cni-643800 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"

	W1109 14:45:29.956941   11408 cli_runner.go:211] docker network inspect enable-default-cni-643800 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1

	I1109 14:45:29.961944   11408 network_create.go:284] running [docker network inspect enable-default-cni-643800] to gather additional debugging logs...

	I1109 14:45:29.961944   11408 cli_runner.go:164] Run: docker network inspect enable-default-cni-643800

	W1109 14:45:30.016944   11408 cli_runner.go:211] docker network inspect enable-default-cni-643800 returned with exit code 1

	I1109 14:45:30.016944   11408 network_create.go:287] error running [docker network inspect enable-default-cni-643800]: docker network inspect enable-default-cni-643800: exit status 1

	stdout:

	[]

	stderr:

	Error response from daemon: network enable-default-cni-643800 not found

	I1109 14:45:30.016944   11408 network_create.go:289] output of [docker network inspect enable-default-cni-643800]: -- stdout --

	[]

	-- /stdout --

	** stderr ** 

	Error response from daemon: network enable-default-cni-643800 not found

	** /stderr **

	I1109 14:45:30.025945   11408 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"

	I1109 14:45:30.114949   11408 network.go:209] skipping subnet 192.168.49.0/24 that is reserved: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:<nil>}

	I1109 14:45:30.147173   11408 network.go:209] skipping subnet 192.168.58.0/24 that is reserved: &{IP:192.168.58.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.58.0/24 Gateway:192.168.58.1 ClientMin:192.168.58.2 ClientMax:192.168.58.254 Broadcast:192.168.58.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:<nil>}

	I1109 14:45:30.178668   11408 network.go:209] skipping subnet 192.168.67.0/24 that is reserved: &{IP:192.168.67.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.67.0/24 Gateway:192.168.67.1 ClientMin:192.168.67.2 ClientMax:192.168.67.254 Broadcast:192.168.67.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:<nil>}

	I1109 14:45:30.209370   11408 network.go:209] skipping subnet 192.168.76.0/24 that is reserved: &{IP:192.168.76.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.76.0/24 Gateway:192.168.76.1 ClientMin:192.168.76.2 ClientMax:192.168.76.254 Broadcast:192.168.76.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:<nil>}

	I1109 14:45:30.224550   11408 network.go:209] skipping subnet 192.168.85.0/24 that is reserved: &{IP:192.168.85.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.85.0/24 Gateway:192.168.85.1 ClientMin:192.168.85.2 ClientMax:192.168.85.254 Broadcast:192.168.85.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:<nil>}

	I1109 14:45:30.238240   11408 network.go:206] using free private subnet 192.168.94.0/24: &{IP:192.168.94.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.94.0/24 Gateway:192.168.94.1 ClientMin:192.168.94.2 ClientMax:192.168.94.254 Broadcast:192.168.94.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc001746a50}

	I1109 14:45:30.238240   11408 network_create.go:124] attempt to create docker network enable-default-cni-643800 192.168.94.0/24 with gateway 192.168.94.1 and MTU of 1500 ...

	I1109 14:45:30.243762   11408 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.94.0/24 --gateway=192.168.94.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=enable-default-cni-643800 enable-default-cni-643800

	I1109 14:45:30.390814   11408 network_create.go:108] docker network enable-default-cni-643800 192.168.94.0/24 created

	I1109 14:45:30.390814   11408 kic.go:121] calculated static IP "192.168.94.2" for the "enable-default-cni-643800" container

	I1109 14:45:30.407749   11408 cli_runner.go:164] Run: docker ps -a --format {{.Names}}

	I1109 14:45:30.463755   11408 cli_runner.go:164] Run: docker volume create enable-default-cni-643800 --label name.minikube.sigs.k8s.io=enable-default-cni-643800 --label created_by.minikube.sigs.k8s.io=true

	I1109 14:45:30.519748   11408 oci.go:103] Successfully created a docker volume enable-default-cni-643800

	I1109 14:45:30.525745   11408 cli_runner.go:164] Run: docker run --rm --name enable-default-cni-643800-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=enable-default-cni-643800 --entrypoint /usr/bin/test -v enable-default-cni-643800:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1761985721-21837@sha256:a50b37e97dfdea51156e079ca6b45818a801b3d41bbe13d141f35d2e1af6c7d1 -d /var/lib

	I1109 14:45:31.846378   11408 cli_runner.go:217] Completed: docker run --rm --name enable-default-cni-643800-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=enable-default-cni-643800 --entrypoint /usr/bin/test -v enable-default-cni-643800:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1761985721-21837@sha256:a50b37e97dfdea51156e079ca6b45818a801b3d41bbe13d141f35d2e1af6c7d1 -d /var/lib: (1.3205702s)

	I1109 14:45:31.846418   11408 oci.go:107] Successfully prepared a docker volume enable-default-cni-643800

	I1109 14:45:31.846533   11408 preload.go:188] Checking if preload exists for k8s version v1.34.1 and runtime docker

	I1109 14:45:31.846533   11408 kic.go:194] Starting extracting preloaded images to volume ...

	I1109 14:45:31.851840   11408 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v C:\Users\jenkins.minikube4\minikube-integration\.minikube\cache\preloaded-tarball\preloaded-images-k8s-v18-v1.34.1-docker-overlay2-amd64.tar.lz4:/preloaded.tar:ro -v enable-default-cni-643800:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1761985721-21837@sha256:a50b37e97dfdea51156e079ca6b45818a801b3d41bbe13d141f35d2e1af6c7d1 -I lz4 -xf /preloaded.tar -C /extractDir

	I1109 14:45:32.455384    7796 provision.go:177] copyRemoteCerts

	I1109 14:45:32.467660    7796 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker

	I1109 14:45:32.476856    7796 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" false-643800

	I1109 14:45:32.528857    7796 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:54027 SSHKeyPath:C:\Users\jenkins.minikube4\minikube-integration\.minikube\machines\false-643800\id_rsa Username:docker}

	I1109 14:45:32.649228    7796 ssh_runner.go:362] scp C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\ca.pem --> /etc/docker/ca.pem (1082 bytes)

	I1109 14:45:32.680474    7796 ssh_runner.go:362] scp C:\Users\jenkins.minikube4\minikube-integration\.minikube\machines\server.pem --> /etc/docker/server.pem (1204 bytes)

	I1109 14:45:32.712337    7796 ssh_runner.go:362] scp C:\Users\jenkins.minikube4\minikube-integration\.minikube\machines\server-key.pem --> /etc/docker/server-key.pem (1679 bytes)

	I1109 14:45:32.742200    7796 provision.go:87] duration metric: took 996.4038ms to configureAuth

	I1109 14:45:32.742200    7796 ubuntu.go:206] setting minikube options for container-runtime

	I1109 14:45:32.742841    7796 config.go:182] Loaded profile config "false-643800": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.34.1

	I1109 14:45:32.748935    7796 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" false-643800

	I1109 14:45:32.803982    7796 main.go:143] libmachine: Using SSH client type: native

	I1109 14:45:32.804981    7796 main.go:143] libmachine: &{{{<nil> 0 [] [] []} docker [0x11319e0] 0x1134500 <nil>  [] 0s} 127.0.0.1 54027 <nil> <nil>}

	I1109 14:45:32.804981    7796 main.go:143] libmachine: About to run SSH command:

	df --output=fstype / | tail -n 1

	I1109 14:45:32.966489    7796 main.go:143] libmachine: SSH cmd err, output: <nil>: overlay

	I1109 14:45:32.966489    7796 ubuntu.go:71] root file system type: overlay

	I1109 14:45:32.966489    7796 provision.go:314] Updating docker unit: /lib/systemd/system/docker.service ...

	I1109 14:45:32.972994    7796 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" false-643800

	I1109 14:45:33.035456    7796 main.go:143] libmachine: Using SSH client type: native

	I1109 14:45:33.035456    7796 main.go:143] libmachine: &{{{<nil> 0 [] [] []} docker [0x11319e0] 0x1134500 <nil>  [] 0s} 127.0.0.1 54027 <nil> <nil>}

	I1109 14:45:33.035456    7796 main.go:143] libmachine: About to run SSH command:

	sudo mkdir -p /lib/systemd/system && printf %s "[Unit]

	Description=Docker Application Container Engine

	Documentation=https://docs.docker.com

	After=network-online.target nss-lookup.target docker.socket firewalld.service containerd.service time-set.target

	Wants=network-online.target containerd.service

	Requires=docker.socket

	StartLimitBurst=3

	StartLimitIntervalSec=60

	[Service]

	Type=notify

	Restart=always

	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	# The base configuration already specifies an 'ExecStart=...' command. The first directive

	# here is to clear out that command inherited from the base configuration. Without this,

	# the command from the base configuration and the command specified here are treated as

	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	# will catch this invalid input and refuse to start the service with an error like:

	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	ExecStart=

	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 \

		-H fd:// --containerd=/run/containerd/containerd.sock \

		-H unix:///var/run/docker.sock \

		--default-ulimit=nofile=1048576:1048576 \

		--tlsverify \

		--tlscacert /etc/docker/ca.pem \

		--tlscert /etc/docker/server.pem \

		--tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12 

	ExecReload=/bin/kill -s HUP \$MAINPID

	# Having non-zero Limit*s causes performance problems due to accounting overhead

	# in the kernel. We recommend using cgroups to do container-local accounting.

	LimitNOFILE=infinity

	LimitNPROC=infinity

	LimitCORE=infinity

	# Uncomment TasksMax if your systemd version supports it.

	# Only systemd 226 and above support this version.

	TasksMax=infinity

	TimeoutStartSec=0

	# set delegate yes so that systemd does not reset the cgroups of docker containers

	Delegate=yes

	# kill only the docker process, not all processes in the cgroup

	KillMode=process

	OOMScoreAdjust=-500

	[Install]

	WantedBy=multi-user.target

	" | sudo tee /lib/systemd/system/docker.service.new

	I1109 14:45:33.220015    7796 main.go:143] libmachine: SSH cmd err, output: <nil>: [Unit]

	Description=Docker Application Container Engine

	Documentation=https://docs.docker.com

	After=network-online.target nss-lookup.target docker.socket firewalld.service containerd.service time-set.target

	Wants=network-online.target containerd.service

	Requires=docker.socket

	StartLimitBurst=3

	StartLimitIntervalSec=60

	[Service]

	Type=notify

	Restart=always

	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	# The base configuration already specifies an 'ExecStart=...' command. The first directive

	# here is to clear out that command inherited from the base configuration. Without this,

	# the command from the base configuration and the command specified here are treated as

	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	# will catch this invalid input and refuse to start the service with an error like:

	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	ExecStart=

	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 	-H fd:// --containerd=/run/containerd/containerd.sock 	-H unix:///var/run/docker.sock 	--default-ulimit=nofile=1048576:1048576 	--tlsverify 	--tlscacert /etc/docker/ca.pem 	--tlscert /etc/docker/server.pem 	--tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12 

	ExecReload=/bin/kill -s HUP $MAINPID

	# Having non-zero Limit*s causes performance problems due to accounting overhead

	# in the kernel. We recommend using cgroups to do container-local accounting.

	LimitNOFILE=infinity

	LimitNPROC=infinity

	LimitCORE=infinity

	# Uncomment TasksMax if your systemd version supports it.

	# Only systemd 226 and above support this version.

	TasksMax=infinity

	TimeoutStartSec=0

	# set delegate yes so that systemd does not reset the cgroups of docker containers

	Delegate=yes

	# kill only the docker process, not all processes in the cgroup

	KillMode=process

	OOMScoreAdjust=-500

	[Install]

	WantedBy=multi-user.target

	I1109 14:45:33.226026    7796 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" false-643800

	I1109 14:45:33.280028    7796 main.go:143] libmachine: Using SSH client type: native

	I1109 14:45:33.280028    7796 main.go:143] libmachine: &{{{<nil> 0 [] [] []} docker [0x11319e0] 0x1134500 <nil>  [] 0s} 127.0.0.1 54027 <nil> <nil>}

	I1109 14:45:33.280028    7796 main.go:143] libmachine: About to run SSH command:

	sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }

	I1109 14:45:41.236495    7796 main.go:143] libmachine: SSH cmd err, output: <nil>: --- /lib/systemd/system/docker.service	2025-10-08 12:15:50.000000000 +0000

	+++ /lib/systemd/system/docker.service.new	2025-11-09 14:45:33.213710500 +0000

	@@ -9,23 +9,34 @@

	 [Service]

	 Type=notify

	-# the default is not to use systemd for cgroups because the delegate issues still

	-# exists and systemd currently does not support the cgroup feature set required

	-# for containers run by docker

	-ExecStart=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock

	-ExecReload=/bin/kill -s HUP $MAINPID

	-TimeoutStartSec=0

	-RestartSec=2

	 Restart=always

	+

	+

	+# This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	+# The base configuration already specifies an 'ExecStart=...' command. The first directive

	+# here is to clear out that command inherited from the base configuration. Without this,

	+# the command from the base configuration and the command specified here are treated as

	+# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	+# will catch this invalid input and refuse to start the service with an error like:

	+#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	+

	+# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	+# container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	+ExecStart=

	+ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 	-H fd:// --containerd=/run/containerd/containerd.sock 	-H unix:///var/run/docker.sock 	--default-ulimit=nofile=1048576:1048576 	--tlsverify 	--tlscacert /etc/docker/ca.pem 	--tlscert /etc/docker/server.pem 	--tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12 

	+ExecReload=/bin/kill -s HUP $MAINPID

	+

	 # Having non-zero Limit*s causes performance problems due to accounting overhead

	 # in the kernel. We recommend using cgroups to do container-local accounting.

	+LimitNOFILE=infinity

	 LimitNPROC=infinity

	 LimitCORE=infinity

	-# Comment TasksMax if your systemd version does not support it.

	-# Only systemd 226 and above support this option.

	+# Uncomment TasksMax if your systemd version supports it.

	+# Only systemd 226 and above support this version.

	 TasksMax=infinity

	+TimeoutStartSec=0

	 # set delegate yes so that systemd does not reset the cgroups of docker containers

	 Delegate=yes

	Synchronizing state of docker.service with SysV service script with /lib/systemd/systemd-sysv-install.

	Executing: /lib/systemd/systemd-sysv-install enable docker

	I1109 14:45:41.236495    7796 machine.go:97] duration metric: took 10.4693834s to provisionDockerMachine

	I1109 14:45:41.236495    7796 client.go:176] duration metric: took 33.3127619s to LocalClient.Create

	I1109 14:45:41.236495    7796 start.go:167] duration metric: took 33.3137639s to libmachine.API.Create "false-643800"

	I1109 14:45:41.236495    7796 start.go:293] postStartSetup for "false-643800" (driver="docker")

	I1109 14:45:41.237027    7796 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]

	I1109 14:45:41.246894    7796 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs

	I1109 14:45:41.252001    7796 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" false-643800

	I1109 14:45:41.308013    7796 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:54027 SSHKeyPath:C:\Users\jenkins.minikube4\minikube-integration\.minikube\machines\false-643800\id_rsa Username:docker}

	I1109 14:45:41.435350    7796 ssh_runner.go:195] Run: cat /etc/os-release

	I1109 14:45:41.442352    7796 main.go:143] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found

	I1109 14:45:41.442352    7796 info.go:137] Remote host: Debian GNU/Linux 12 (bookworm)

	I1109 14:45:41.442352    7796 filesync.go:126] Scanning C:\Users\jenkins.minikube4\minikube-integration\.minikube\addons for local assets ...

	I1109 14:45:41.442352    7796 filesync.go:126] Scanning C:\Users\jenkins.minikube4\minikube-integration\.minikube\files for local assets ...

	I1109 14:45:41.443354    7796 filesync.go:149] local asset: C:\Users\jenkins.minikube4\minikube-integration\.minikube\files\etc\ssl\certs\103362.pem -> 103362.pem in /etc/ssl/certs

	I1109 14:45:41.450353    7796 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs

	I1109 14:45:41.463354    7796 ssh_runner.go:362] scp C:\Users\jenkins.minikube4\minikube-integration\.minikube\files\etc\ssl\certs\103362.pem --> /etc/ssl/certs/103362.pem (1708 bytes)

	I1109 14:45:41.491349    7796 start.go:296] duration metric: took 254.3186ms for postStartSetup

	I1109 14:45:41.502347    7796 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" false-643800

	I1109 14:45:41.552357    7796 profile.go:143] Saving config to C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\false-643800\config.json ...

	I1109 14:45:41.563350    7796 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I1109 14:45:41.569357    7796 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" false-643800

	I1109 14:45:41.615356    7796 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:54027 SSHKeyPath:C:\Users\jenkins.minikube4\minikube-integration\.minikube\machines\false-643800\id_rsa Username:docker}

	I1109 14:45:41.748910    7796 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"

	I1109 14:45:41.756908    7796 start.go:128] duration metric: took 33.83717s to createHost

	I1109 14:45:41.756908    7796 start.go:83] releasing machines lock for "false-643800", held for 33.8381616s

	I1109 14:45:41.761900    7796 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" false-643800

	I1109 14:45:41.812891    7796 ssh_runner.go:195] Run: curl.exe -sS -m 2 https://registry.k8s.io/

	I1109 14:45:41.820720    7796 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" false-643800

	I1109 14:45:41.820720    7796 ssh_runner.go:195] Run: cat /version.json

	I1109 14:45:41.826203    7796 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" false-643800

	I1109 14:45:41.876594    7796 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:54027 SSHKeyPath:C:\Users\jenkins.minikube4\minikube-integration\.minikube\machines\false-643800\id_rsa Username:docker}

	I1109 14:45:41.877621    7796 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:54027 SSHKeyPath:C:\Users\jenkins.minikube4\minikube-integration\.minikube\machines\false-643800\id_rsa Username:docker}

	W1109 14:45:42.231665    7796 start.go:869] [curl.exe -sS -m 2 https://registry.k8s.io/] failed: curl.exe -sS -m 2 https://registry.k8s.io/: Process exited with status 127

	stdout:

	stderr:

	bash: line 1: curl.exe: command not found

	I1109 14:45:42.240137    7796 ssh_runner.go:195] Run: systemctl --version

	I1109 14:45:42.271675    7796 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"

	W1109 14:45:42.279684    7796 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found

	I1109 14:45:42.289684    7796 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *bridge* -not -name *podman* -not -name *.mk_disabled -printf "%p, " -exec sh -c "sudo sed -i -r -e '/"dst": ".*:.*"/d' -e 's|^(.*)"dst": (.*)[,*]$|\1"dst": \2|g' -e '/"subnet": ".*:.*"/d' -e 's|^(.*)"subnet": ".*"(.*)[,*]$|\1"subnet": "10.244.0.0/16"\2|g' {}" ;

	W1109 14:45:42.336526    7796 out.go:285] ! Failing to connect to https://registry.k8s.io/ from inside the minikube container

	W1109 14:45:42.336526    7796 out.go:285] * To pull new external images, you may need to configure a proxy: https://minikube.sigs.k8s.io/docs/reference/networking/proxy/

	I1109 14:45:42.582645    7796 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *podman* -not -name *.mk_disabled -printf "%p, " -exec sh -c "sudo sed -i -r -e 's|^(.*)"subnet": ".*"(.*)$|\1"subnet": "10.244.0.0/16"\2|g' -e 's|^(.*)"gateway": ".*"(.*)$|\1"gateway": "10.244.0.1"\2|g' {}" ;

	I1109 14:45:42.609889    7796 cni.go:308] configured [/etc/cni/net.d/10-crio-bridge.conflist.disabled, /etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)

	I1109 14:45:42.609922    7796 start.go:496] detecting cgroup driver to use...

	I1109 14:45:42.609967    7796 detect.go:187] detected "cgroupfs" cgroup driver on host os

	I1109 14:45:42.610166    7796 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///run/containerd/containerd.sock

	" | sudo tee /etc/crictl.yaml"

	I1109 14:45:42.642043    7796 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.10.1"|' /etc/containerd/config.toml"

	I1109 14:45:42.664037    7796 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"

	I1109 14:45:42.679039    7796 containerd.go:146] configuring containerd to use "cgroupfs" as cgroup driver...

	I1109 14:45:42.686043    7796 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"

	I1109 14:45:42.723039    7796 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"

	I1109 14:45:42.750322    7796 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"

	I1109 14:45:42.782439    7796 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"

	I1109 14:45:42.834458    7796 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"

	I1109 14:45:42.863205    7796 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"

	I1109 14:45:42.889110    7796 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *enable_unprivileged_ports = .*/d' /etc/containerd/config.toml"

	I1109 14:45:43.105065    7796 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)\[plugins."io.containerd.grpc.v1.cri"\]|&\n\1  enable_unprivileged_ports = true|' /etc/containerd/config.toml"

	I1109 14:45:43.131117    7796 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables

	I1109 14:45:43.154882    7796 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"

	I1109 14:45:43.175436    7796 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I1109 14:45:43.322906    7796 ssh_runner.go:195] Run: sudo systemctl restart containerd

	I1109 14:45:43.516195    7796 start.go:496] detecting cgroup driver to use...

	I1109 14:45:43.516195    7796 detect.go:187] detected "cgroupfs" cgroup driver on host os

	I1109 14:45:43.525081    7796 ssh_runner.go:195] Run: sudo systemctl cat docker.service

	I1109 14:45:43.557783    7796 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I1109 14:45:43.588290    7796 ssh_runner.go:195] Run: sudo systemctl stop -f containerd

	I1109 14:45:43.890073    7796 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I1109 14:45:43.923936    7796 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio

	I1109 14:45:43.947343    7796 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/cri-dockerd.sock

	" | sudo tee /etc/crictl.yaml"

	I1109 14:45:43.979271    7796 ssh_runner.go:195] Run: which cri-dockerd

	I1109 14:45:43.994497    7796 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/cri-docker.service.d

	I1109 14:45:44.009486    7796 ssh_runner.go:362] scp memory --> /etc/systemd/system/cri-docker.service.d/10-cni.conf (192 bytes)

	I1109 14:45:44.043558    7796 ssh_runner.go:195] Run: sudo systemctl unmask docker.service

	I1109 14:45:44.200184    7796 ssh_runner.go:195] Run: sudo systemctl enable docker.socket

	I1109 14:45:44.345194    7796 docker.go:575] configuring docker to use "cgroupfs" as cgroup driver...

	I1109 14:45:44.345364    7796 ssh_runner.go:362] scp memory --> /etc/docker/daemon.json (130 bytes)

	I1109 14:45:44.374272    7796 ssh_runner.go:195] Run: sudo systemctl reset-failed docker

	I1109 14:45:44.399695    7796 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I1109 14:45:44.561889    7796 ssh_runner.go:195] Run: sudo systemctl restart docker

	I1109 14:45:45.506013    7796 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker

	I1109 14:45:45.532014    7796 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service cri-docker.socket

	I1109 14:45:45.563344    7796 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service cri-docker.service

	I1109 14:45:45.597550    7796 ssh_runner.go:195] Run: sudo systemctl unmask cri-docker.socket

	I1109 14:45:45.798183    7796 ssh_runner.go:195] Run: sudo systemctl enable cri-docker.socket

	I1109 14:45:46.063113    7796 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I1109 14:45:46.243118    7796 ssh_runner.go:195] Run: sudo systemctl restart cri-docker.socket

	I1109 14:45:46.274132    7796 ssh_runner.go:195] Run: sudo systemctl reset-failed cri-docker.service

	I1109 14:45:46.301115    7796 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I1109 14:45:46.503072    7796 ssh_runner.go:195] Run: sudo systemctl restart cri-docker.service

	I1109 14:45:46.676633    7796 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service cri-docker.service

	I1109 14:45:46.703641    7796 start.go:543] Will wait 60s for socket path /var/run/cri-dockerd.sock

	I1109 14:45:46.711638    7796 ssh_runner.go:195] Run: stat /var/run/cri-dockerd.sock

	I1109 14:45:46.719633    7796 start.go:564] Will wait 60s for crictl version

	I1109 14:45:46.727634    7796 ssh_runner.go:195] Run: which crictl

	I1109 14:45:46.741638    7796 ssh_runner.go:195] Run: sudo /usr/local/bin/crictl version

	I1109 14:45:46.791636    7796 start.go:580] Version:  0.1.0

	RuntimeName:  docker

	RuntimeVersion:  28.5.1

	RuntimeApiVersion:  v1

	I1109 14:45:46.799636    7796 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}

	I1109 14:45:46.851632    7796 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}

	I1109 14:45:46.900221    7796 out.go:252] * Preparing Kubernetes v1.34.1 on Docker 28.5.1 ...

	I1109 14:45:46.907867    7796 cli_runner.go:164] Run: docker exec -t false-643800 dig +short host.docker.internal

	I1109 14:45:44.713844   11408 cli_runner.go:217] Completed: docker run --rm --entrypoint /usr/bin/tar -v C:\Users\jenkins.minikube4\minikube-integration\.minikube\cache\preloaded-tarball\preloaded-images-k8s-v18-v1.34.1-docker-overlay2-amd64.tar.lz4:/preloaded.tar:ro -v enable-default-cni-643800:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1761985721-21837@sha256:a50b37e97dfdea51156e079ca6b45818a801b3d41bbe13d141f35d2e1af6c7d1 -I lz4 -xf /preloaded.tar -C /extractDir: (12.8618478s)

	I1109 14:45:44.714864   11408 kic.go:203] duration metric: took 12.8681739s to extract preloaded images to volume ...

	I1109 14:45:44.720842   11408 cli_runner.go:164] Run: docker system info --format "{{json .}}"

	I1109 14:45:44.975725   11408 info.go:266] docker info: {ID:a15b78d1-f772-48f7-bbf5-f8fe086f3f87 Containers:3 ContainersRunning:3 ContainersPaused:0 ContainersStopped:0 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:90 OomKillDisable:true NGoroutines:95 SystemTime:2025-11-09 14:45:44.955105428 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:14 KernelVersion:5.15.153.1-microsoft-standard-WSL2 OperatingSystem:Docker Desktop OSType:linux Architecture:x86_64 Ind

exServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:16 MemTotal:33657536512 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy:http.docker.internal:3128 HTTPSProxy:http.docker.internal:3128 NoProxy:hubproxy.docker.internal Name:docker-desktop Labels:[com.docker.desktop.address=npipe://\\.\pipe\docker_cli] ExperimentalBuild:false ServerVersion:27.4.0 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:472731909fa34bd7bc9c087e4c27943f9835f111 Expected:472731909fa34bd7bc9c087e4c27943f9835f111} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0

Expected:de40ad0} SecurityOptions:[name=seccomp,profile=unconfined] ProductLicense: Warnings:[WARNING: No blkio throttle.read_bps_device support WARNING: No blkio throttle.write_bps_device support WARNING: No blkio throttle.read_iops_device support WARNING: No blkio throttle.write_iops_device support WARNING: daemon is not using the default seccomp profile] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:ai Path:C:\Program Files\Docker\cli-plugins\docker-ai.exe SchemaVersion:0.1.0 ShortDescription:Ask Gordon - Docker Agent Vendor:Docker Inc. Version:v0.5.1] map[Name:buildx Path:C:\Program Files\Docker\cli-plugins\docker-buildx.exe SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.19.2-desktop.1] map[Name:compose Path:C:\Program Files\Docker\cli-plugins\docker-compose.exe SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.31.0-desktop.2] map[Name:debug Path:C:\Program Files\Docker\cli-plugins\docker-debug.exe SchemaVersion:0.1.0 ShortDescr

iption:Get a shell into any image or container Vendor:Docker Inc. Version:0.0.37] map[Name:desktop Path:C:\Program Files\Docker\cli-plugins\docker-desktop.exe SchemaVersion:0.1.0 ShortDescription:Docker Desktop commands (Beta) Vendor:Docker Inc. Version:v0.1.0] map[Name:dev Path:C:\Program Files\Docker\cli-plugins\docker-dev.exe SchemaVersion:0.1.0 ShortDescription:Docker Dev Environments Vendor:Docker Inc. Version:v0.1.2] map[Name:extension Path:C:\Program Files\Docker\cli-plugins\docker-extension.exe SchemaVersion:0.1.0 ShortDescription:Manages Docker extensions Vendor:Docker Inc. Version:v0.2.27] map[Name:feedback Path:C:\Program Files\Docker\cli-plugins\docker-feedback.exe SchemaVersion:0.1.0 ShortDescription:Provide feedback, right in your terminal! Vendor:Docker Inc. Version:v1.0.5] map[Name:init Path:C:\Program Files\Docker\cli-plugins\docker-init.exe SchemaVersion:0.1.0 ShortDescription:Creates Docker-related starter files for your project Vendor:Docker Inc. Version:v1.4.0] map[Name:sbom Path:C:\Progr

am Files\Docker\cli-plugins\docker-sbom.exe SchemaVersion:0.1.0 ShortDescription:View the packaged-based Software Bill Of Materials (SBOM) for an image URL:https://github.com/docker/sbom-cli-plugin Vendor:Anchore Inc. Version:0.6.0] map[Name:scout Path:C:\Program Files\Docker\cli-plugins\docker-scout.exe SchemaVersion:0.1.0 ShortDescription:Docker Scout Vendor:Docker Inc. Version:v1.15.1]] Warnings:<nil>}}

	I1109 14:45:44.981735   11408 cli_runner.go:164] Run: docker info --format "'{{json .SecurityOptions}}'"

	I1109 14:45:45.265115   11408 cli_runner.go:164] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname enable-default-cni-643800 --name enable-default-cni-643800 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=enable-default-cni-643800 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=enable-default-cni-643800 --network enable-default-cni-643800 --ip 192.168.94.2 --volume enable-default-cni-643800:/var --security-opt apparmor=unconfined --memory=3072mb --memory-swap=3072mb --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1761985721-21837@sha256:a50b37e97dfdea51156e079ca6b45818a801b3d41bbe13d141f35d2e1af6c7d1

	I1109 14:45:46.029933   11408 cli_runner.go:164] Run: docker container inspect enable-default-cni-643800 --format={{.State.Running}}

	I1109 14:45:46.098114   11408 cli_runner.go:164] Run: docker container inspect enable-default-cni-643800 --format={{.State.Status}}

	I1109 14:45:46.160115   11408 cli_runner.go:164] Run: docker exec enable-default-cni-643800 stat /var/lib/dpkg/alternatives/iptables

	I1109 14:45:46.277115   11408 oci.go:144] the created container "enable-default-cni-643800" has a running status.

	I1109 14:45:46.277115   11408 kic.go:225] Creating ssh key for kic: C:\Users\jenkins.minikube4\minikube-integration\.minikube\machines\enable-default-cni-643800\id_rsa...

	I1109 14:45:46.395582   11408 kic_runner.go:191] docker (temp): C:\Users\jenkins.minikube4\minikube-integration\.minikube\machines\enable-default-cni-643800\id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)

	I1109 14:45:46.490077   11408 cli_runner.go:164] Run: docker container inspect enable-default-cni-643800 --format={{.State.Status}}

	I1109 14:45:46.574635   11408 kic_runner.go:93] Run: chown docker:docker /home/docker/.ssh/authorized_keys

	I1109 14:45:46.574635   11408 kic_runner.go:114] Args: [docker exec --privileged enable-default-cni-643800 chown docker:docker /home/docker/.ssh/authorized_keys]

	I1109 14:45:46.703641   11408 kic.go:265] ensuring only current user has permissions to key file located at : C:\Users\jenkins.minikube4\minikube-integration\.minikube\machines\enable-default-cni-643800\id_rsa...

	I1109 14:45:47.075993    7796 network.go:96] got host ip for mount in container by digging dns: 192.168.65.254

	I1109 14:45:47.085001    7796 ssh_runner.go:195] Run: grep 192.168.65.254	host.minikube.internal$ /etc/hosts

	I1109 14:45:47.092995    7796 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.65.254	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I1109 14:45:47.118005    7796 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "8443/tcp") 0).HostPort}}'" false-643800

	I1109 14:45:47.181000    7796 kubeadm.go:884] updating cluster {Name:false-643800 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1761985721-21837@sha256:a50b37e97dfdea51156e079ca6b45818a801b3d41bbe13d141f35d2e1af6c7d1 Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.1 ClusterName:false-643800 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerName

s:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:false} Nodes:[{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.34.1 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: So

cketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...

	I1109 14:45:47.181998    7796 preload.go:188] Checking if preload exists for k8s version v1.34.1 and runtime docker

	I1109 14:45:47.190006    7796 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}

	I1109 14:45:47.229018    7796 docker.go:691] Got preloaded images: -- stdout --

	registry.k8s.io/kube-scheduler:v1.34.1

	registry.k8s.io/kube-apiserver:v1.34.1

	registry.k8s.io/kube-controller-manager:v1.34.1

	registry.k8s.io/kube-proxy:v1.34.1

	registry.k8s.io/etcd:3.6.4-0

	registry.k8s.io/pause:3.10.1

	registry.k8s.io/coredns/coredns:v1.12.1

	gcr.io/k8s-minikube/storage-provisioner:v5

	-- /stdout --

	I1109 14:45:47.229018    7796 docker.go:621] Images already preloaded, skipping extraction

	I1109 14:45:47.241002    7796 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}

	I1109 14:45:47.286006    7796 docker.go:691] Got preloaded images: -- stdout --

	registry.k8s.io/kube-controller-manager:v1.34.1

	registry.k8s.io/kube-scheduler:v1.34.1

	registry.k8s.io/kube-apiserver:v1.34.1

	registry.k8s.io/kube-proxy:v1.34.1

	registry.k8s.io/etcd:3.6.4-0

	registry.k8s.io/pause:3.10.1

	registry.k8s.io/coredns/coredns:v1.12.1

	gcr.io/k8s-minikube/storage-provisioner:v5

	-- /stdout --

	I1109 14:45:47.286006    7796 cache_images.go:86] Images are preloaded, skipping loading

	I1109 14:45:47.286006    7796 kubeadm.go:935] updating node { 192.168.85.2 8443 v1.34.1 docker true true} ...

	I1109 14:45:47.286006    7796 kubeadm.go:947] kubelet [Unit]

	Wants=docker.socket

	[Service]

	ExecStart=

	ExecStart=/var/lib/minikube/binaries/v1.34.1/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=false-643800 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.85.2

	[Install]

	 config:

	{KubernetesVersion:v1.34.1 ClusterName:false-643800 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:false}

	I1109 14:45:47.295002    7796 ssh_runner.go:195] Run: docker info --format {{.CgroupDriver}}

	I1109 14:45:47.378002    7796 cni.go:84] Creating CNI manager for "false"

	I1109 14:45:47.378002    7796 kubeadm.go:85] Using pod CIDR: 10.244.0.0/16

	I1109 14:45:47.378002    7796 kubeadm.go:190] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.85.2 APIServerPort:8443 KubernetesVersion:v1.34.1 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:false-643800 NodeName:false-643800 DNSDomain:cluster.local CRISocket:/var/run/cri-dockerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.85.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.85.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/kuberne

tes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///var/run/cri-dockerd.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}

	I1109 14:45:47.378002    7796 kubeadm.go:196] kubeadm config:

	apiVersion: kubeadm.k8s.io/v1beta4

	kind: InitConfiguration

	localAPIEndpoint:

	  advertiseAddress: 192.168.85.2

	  bindPort: 8443

	bootstrapTokens:

	  - groups:

	      - system:bootstrappers:kubeadm:default-node-token

	    ttl: 24h0m0s

	    usages:

	      - signing

	      - authentication

	nodeRegistration:

	  criSocket: unix:///var/run/cri-dockerd.sock

	  name: "false-643800"

	  kubeletExtraArgs:

	    - name: "node-ip"

	      value: "192.168.85.2"

	  taints: []

	---

	apiVersion: kubeadm.k8s.io/v1beta4

	kind: ClusterConfiguration

	apiServer:

	  certSANs: ["127.0.0.1", "localhost", "192.168.85.2"]

	  extraArgs:

	    - name: "enable-admission-plugins"

	      value: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"

	controllerManager:

	  extraArgs:

	    - name: "allocate-node-cidrs"

	      value: "true"

	    - name: "leader-elect"

	      value: "false"

	scheduler:

	  extraArgs:

	    - name: "leader-elect"

	      value: "false"

	certificatesDir: /var/lib/minikube/certs

	clusterName: mk

	controlPlaneEndpoint: control-plane.minikube.internal:8443

	etcd:

	  local:

	    dataDir: /var/lib/minikube/etcd

	kubernetesVersion: v1.34.1

	networking:

	  dnsDomain: cluster.local

	  podSubnet: "10.244.0.0/16"

	  serviceSubnet: 10.96.0.0/12

	---

	apiVersion: kubelet.config.k8s.io/v1beta1

	kind: KubeletConfiguration

	authentication:

	  x509:

	    clientCAFile: /var/lib/minikube/certs/ca.crt

	cgroupDriver: cgroupfs

	containerRuntimeEndpoint: unix:///var/run/cri-dockerd.sock

	hairpinMode: hairpin-veth

	runtimeRequestTimeout: 15m

	clusterDomain: "cluster.local"

	# disable disk resource management by default

	imageGCHighThresholdPercent: 100

	evictionHard:

	  nodefs.available: "0%"

	  nodefs.inodesFree: "0%"

	  imagefs.available: "0%"

	failSwapOn: false

	staticPodPath: /etc/kubernetes/manifests

	---

	apiVersion: kubeproxy.config.k8s.io/v1alpha1

	kind: KubeProxyConfiguration

	clusterCIDR: "10.244.0.0/16"

	metricsBindAddress: 0.0.0.0:10249

	conntrack:

	  maxPerCore: 0

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"

	  tcpEstablishedTimeout: 0s

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"

	  tcpCloseWaitTimeout: 0s

	I1109 14:45:47.386010    7796 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.34.1

	I1109 14:45:47.399001    7796 binaries.go:51] Found k8s binaries, skipping transfer

	I1109 14:45:47.406006    7796 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube

	I1109 14:45:47.422008    7796 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (311 bytes)

	I1109 14:45:47.446997    7796 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)

	I1109 14:45:47.468999    7796 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2213 bytes)

	I1109 14:45:47.500004    7796 ssh_runner.go:195] Run: grep 192.168.85.2	control-plane.minikube.internal$ /etc/hosts

	I1109 14:45:47.508001    7796 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.85.2	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I1109 14:45:47.538004    7796 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I1109 14:45:47.704911    7796 ssh_runner.go:195] Run: sudo systemctl start kubelet

	I1109 14:45:47.736241    7796 certs.go:69] Setting up C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\false-643800 for IP: 192.168.85.2

	I1109 14:45:47.736241    7796 certs.go:195] generating shared ca certs ...

	I1109 14:45:47.736241    7796 certs.go:227] acquiring lock for ca certs: {Name:mk92285f7546e1a5b3c3b23dab6135aa5a99cd14 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1109 14:45:47.737385    7796 certs.go:236] skipping valid "minikubeCA" ca cert: C:\Users\jenkins.minikube4\minikube-integration\.minikube\ca.key

	I1109 14:45:47.737532    7796 certs.go:236] skipping valid "proxyClientCA" ca cert: C:\Users\jenkins.minikube4\minikube-integration\.minikube\proxy-client-ca.key

	I1109 14:45:47.737532    7796 certs.go:257] generating profile certs ...

	I1109 14:45:47.738457    7796 certs.go:364] generating signed profile cert for "minikube-user": C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\false-643800\client.key

	I1109 14:45:47.738547    7796 crypto.go:68] Generating cert C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\false-643800\client.crt with IP's: []

	I1109 14:45:47.837209    7796 crypto.go:156] Writing cert to C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\false-643800\client.crt ...

	I1109 14:45:47.837209    7796 lock.go:35] WriteFile acquiring C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\false-643800\client.crt: {Name:mka917f8febc88303213c555c214928fc9c62486 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1109 14:45:47.838210    7796 crypto.go:164] Writing key to C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\false-643800\client.key ...

	I1109 14:45:47.838210    7796 lock.go:35] WriteFile acquiring C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\false-643800\client.key: {Name:mk120586f0ca83e8a7283cdfc3568151de752e25 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1109 14:45:47.839210    7796 certs.go:364] generating signed profile cert for "minikube": C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\false-643800\apiserver.key.987b1b43

	I1109 14:45:47.839210    7796 crypto.go:68] Generating cert C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\false-643800\apiserver.crt.987b1b43 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.85.2]

	I1109 14:45:47.936876    7796 crypto.go:156] Writing cert to C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\false-643800\apiserver.crt.987b1b43 ...

	I1109 14:45:47.936876    7796 lock.go:35] WriteFile acquiring C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\false-643800\apiserver.crt.987b1b43: {Name:mk27c51ec3c512c9f6517d69c4e42b6d585678ff Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1109 14:45:47.936876    7796 crypto.go:164] Writing key to C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\false-643800\apiserver.key.987b1b43 ...

	I1109 14:45:47.936876    7796 lock.go:35] WriteFile acquiring C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\false-643800\apiserver.key.987b1b43: {Name:mkf90670b67daef79447d175988a1912c70f3d1d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1109 14:45:47.938760    7796 certs.go:382] copying C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\false-643800\apiserver.crt.987b1b43 -> C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\false-643800\apiserver.crt

	I1109 14:45:47.955385    7796 certs.go:386] copying C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\false-643800\apiserver.key.987b1b43 -> C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\false-643800\apiserver.key

	I1109 14:45:47.956403    7796 certs.go:364] generating signed profile cert for "aggregator": C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\false-643800\proxy-client.key

	I1109 14:45:47.956403    7796 crypto.go:68] Generating cert C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\false-643800\proxy-client.crt with IP's: []

	I1109 14:45:48.138341    7796 crypto.go:156] Writing cert to C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\false-643800\proxy-client.crt ...

	I1109 14:45:48.138341    7796 lock.go:35] WriteFile acquiring C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\false-643800\proxy-client.crt: {Name:mkf8ed9ead3ebef7eec385ecde96c52f719438d4 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1109 14:45:48.138926    7796 crypto.go:164] Writing key to C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\false-643800\proxy-client.key ...

	I1109 14:45:48.138926    7796 lock.go:35] WriteFile acquiring C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\false-643800\proxy-client.key: {Name:mk61d62cf349592cfec5207f1006419e28b429c1 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1109 14:45:48.156372    7796 certs.go:484] found cert: C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\10336.pem (1338 bytes)

	W1109 14:45:48.156372    7796 certs.go:480] ignoring C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\10336_empty.pem, impossibly tiny 0 bytes

	I1109 14:45:48.156921    7796 certs.go:484] found cert: C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\ca-key.pem (1675 bytes)

	I1109 14:45:48.157226    7796 certs.go:484] found cert: C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\ca.pem (1082 bytes)

	I1109 14:45:48.157569    7796 certs.go:484] found cert: C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\cert.pem (1123 bytes)

	I1109 14:45:48.157881    7796 certs.go:484] found cert: C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\key.pem (1679 bytes)

	I1109 14:45:48.157912    7796 certs.go:484] found cert: C:\Users\jenkins.minikube4\minikube-integration\.minikube\files\etc\ssl\certs\103362.pem (1708 bytes)

	I1109 14:45:48.159839    7796 ssh_runner.go:362] scp C:\Users\jenkins.minikube4\minikube-integration\.minikube\ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)

	I1109 14:45:48.191449    7796 ssh_runner.go:362] scp C:\Users\jenkins.minikube4\minikube-integration\.minikube\ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)

	I1109 14:45:48.228230    7796 ssh_runner.go:362] scp C:\Users\jenkins.minikube4\minikube-integration\.minikube\proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)

	I1109 14:45:48.266858    7796 ssh_runner.go:362] scp C:\Users\jenkins.minikube4\minikube-integration\.minikube\proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)

	I1109 14:45:48.305377    7796 ssh_runner.go:362] scp C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\false-643800\apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1419 bytes)

	I1109 14:45:48.341389    7796 ssh_runner.go:362] scp C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\false-643800\apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)

	I1109 14:45:48.372394    7796 ssh_runner.go:362] scp C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\false-643800\proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)

	I1109 14:45:48.402381    7796 ssh_runner.go:362] scp C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\false-643800\proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)

	I1109 14:45:48.436381    7796 ssh_runner.go:362] scp C:\Users\jenkins.minikube4\minikube-integration\.minikube\ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)

	I1109 14:45:48.468380    7796 ssh_runner.go:362] scp C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\10336.pem --> /usr/share/ca-certificates/10336.pem (1338 bytes)

	I1109 14:45:48.503388    7796 ssh_runner.go:362] scp C:\Users\jenkins.minikube4\minikube-integration\.minikube\files\etc\ssl\certs\103362.pem --> /usr/share/ca-certificates/103362.pem (1708 bytes)

	I1109 14:45:48.533389    7796 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)

	I1109 14:45:48.576378    7796 ssh_runner.go:195] Run: openssl version

	I1109 14:45:48.601510    7796 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"

	I1109 14:45:48.629553    7796 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem

	I1109 14:45:48.639608    7796 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Nov  9 13:31 /usr/share/ca-certificates/minikubeCA.pem

	I1109 14:45:48.647773    7796 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem

	I1109 14:45:48.716586    7796 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"

	I1109 14:45:48.744588    7796 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/10336.pem && ln -fs /usr/share/ca-certificates/10336.pem /etc/ssl/certs/10336.pem"

	I1109 14:45:48.766588    7796 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/10336.pem

	I1109 14:45:48.773601    7796 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Nov  9 13:39 /usr/share/ca-certificates/10336.pem

	I1109 14:45:48.784599    7796 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/10336.pem

	I1109 14:45:48.840586    7796 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/10336.pem /etc/ssl/certs/51391683.0"

	I1109 14:45:48.867073    7796 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/103362.pem && ln -fs /usr/share/ca-certificates/103362.pem /etc/ssl/certs/103362.pem"

	I1109 14:45:48.896762    7796 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/103362.pem

	I1109 14:45:48.904730    7796 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Nov  9 13:39 /usr/share/ca-certificates/103362.pem

	I1109 14:45:48.911729    7796 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/103362.pem

	I1109 14:45:48.971326    7796 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/103362.pem /etc/ssl/certs/3ec20f2e.0"

	I1109 14:45:48.995334    7796 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt

	I1109 14:45:49.003327    7796 certs.go:400] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory

	I1109 14:45:49.004332    7796 kubeadm.go:401] StartCluster: {Name:false-643800 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1761985721-21837@sha256:a50b37e97dfdea51156e079ca6b45818a801b3d41bbe13d141f35d2e1af6c7d1 Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.1 ClusterName:false-643800 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[

] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:false} Nodes:[{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.34.1 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: Socke

tVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I1109 14:45:49.009340    7796 ssh_runner.go:195] Run: docker ps --filter status=paused --filter=name=k8s_.*_(kube-system)_ --format={{.ID}}

	I1109 14:45:49.047329    7796 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd

	I1109 14:45:49.067328    7796 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml

	I1109 14:45:49.088973    7796 kubeadm.go:215] ignoring SystemVerification for kubeadm because of docker driver

	I1109 14:45:49.100328    7796 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf

	I1109 14:45:49.118504    7796 kubeadm.go:156] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2

	stdout:

	stderr:

	ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory

	I1109 14:45:49.118504    7796 kubeadm.go:158] found existing configuration files:

	I1109 14:45:49.126659    7796 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf

	I1109 14:45:49.139657    7796 kubeadm.go:164] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2

	stdout:

	stderr:

	grep: /etc/kubernetes/admin.conf: No such file or directory

	I1109 14:45:49.146657    7796 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf

	I1109 14:45:49.165665    7796 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf

	I1109 14:45:49.181656    7796 kubeadm.go:164] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2

	stdout:

	stderr:

	grep: /etc/kubernetes/kubelet.conf: No such file or directory

	I1109 14:45:49.189669    7796 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf

	I1109 14:45:49.209660    7796 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf

	I1109 14:45:49.227658    7796 kubeadm.go:164] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2

	stdout:

	stderr:

	grep: /etc/kubernetes/controller-manager.conf: No such file or directory

	I1109 14:45:49.239656    7796 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf

	I1109 14:45:49.267658    7796 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf

	I1109 14:45:49.286658    7796 kubeadm.go:164] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2

	stdout:

	stderr:

	grep: /etc/kubernetes/scheduler.conf: No such file or directory

	I1109 14:45:49.296661    7796 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf

	I1109 14:45:49.325656    7796 ssh_runner.go:286] Start: sudo /bin/bash -c "env PATH="/var/lib/minikube/binaries/v1.34.1:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"

	I1109 14:45:49.453674    7796 kubeadm.go:319] 	[WARNING Swap]: swap is supported for cgroup v2 only. The kubelet must be properly configured to use swap. Please refer to https://kubernetes.io/docs/concepts/architecture/nodes/#swap-memory, or disable swap on the node

	I1109 14:45:49.456662    7796 kubeadm.go:319] 	[WARNING SystemVerification]: cgroups v1 support is in maintenance mode, please migrate to cgroups v2

	I1109 14:45:49.587507    7796 kubeadm.go:319] 	[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'

	I1109 14:45:49.186658   11408 cli_runner.go:164] Run: docker container inspect enable-default-cni-643800 --format={{.State.Status}}

	I1109 14:45:49.249653   11408 machine.go:94] provisionDockerMachine start ...

	I1109 14:45:49.259654   11408 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" enable-default-cni-643800

	I1109 14:45:49.338654   11408 main.go:143] libmachine: Using SSH client type: native

	I1109 14:45:49.356656   11408 main.go:143] libmachine: &{{{<nil> 0 [] [] []} docker [0x11319e0] 0x1134500 <nil>  [] 0s} 127.0.0.1 54091 <nil> <nil>}

	I1109 14:45:49.356656   11408 main.go:143] libmachine: About to run SSH command:

	hostname

	I1109 14:45:49.520513   11408 main.go:143] libmachine: SSH cmd err, output: <nil>: enable-default-cni-643800

	I1109 14:45:49.520513   11408 ubuntu.go:182] provisioning hostname "enable-default-cni-643800"

	I1109 14:45:49.526513   11408 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" enable-default-cni-643800

	I1109 14:45:49.585507   11408 main.go:143] libmachine: Using SSH client type: native

	I1109 14:45:49.585507   11408 main.go:143] libmachine: &{{{<nil> 0 [] [] []} docker [0x11319e0] 0x1134500 <nil>  [] 0s} 127.0.0.1 54091 <nil> <nil>}

	I1109 14:45:49.585507   11408 main.go:143] libmachine: About to run SSH command:

	sudo hostname enable-default-cni-643800 && echo "enable-default-cni-643800" | sudo tee /etc/hostname

	I1109 14:45:49.763877   11408 main.go:143] libmachine: SSH cmd err, output: <nil>: enable-default-cni-643800

	I1109 14:45:49.769895   11408 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" enable-default-cni-643800

	I1109 14:45:49.830888   11408 main.go:143] libmachine: Using SSH client type: native

	I1109 14:45:49.831283   11408 main.go:143] libmachine: &{{{<nil> 0 [] [] []} docker [0x11319e0] 0x1134500 <nil>  [] 0s} 127.0.0.1 54091 <nil> <nil>}

	I1109 14:45:49.831283   11408 main.go:143] libmachine: About to run SSH command:

			if ! grep -xq '.*\senable-default-cni-643800' /etc/hosts; then

				if grep -xq '127.0.1.1\s.*' /etc/hosts; then

					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 enable-default-cni-643800/g' /etc/hosts;

				else 

					echo '127.0.1.1 enable-default-cni-643800' | sudo tee -a /etc/hosts; 

				fi

			fi

	I1109 14:45:50.013965   11408 main.go:143] libmachine: SSH cmd err, output: <nil>: 

	I1109 14:45:50.013965   11408 ubuntu.go:188] set auth options {CertDir:C:\Users\jenkins.minikube4\minikube-integration\.minikube CaCertPath:C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\ca.pem CaPrivateKeyPath:C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:C:\Users\jenkins.minikube4\minikube-integration\.minikube\machines\server.pem ServerKeyPath:C:\Users\jenkins.minikube4\minikube-integration\.minikube\machines\server-key.pem ClientKeyPath:C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\cert.pem ServerCertSANs:[] StorePath:C:\Users\jenkins.minikube4\minikube-integration\.minikube}

	I1109 14:45:50.013965   11408 ubuntu.go:190] setting up certificates

	I1109 14:45:50.013965   11408 provision.go:84] configureAuth start

	I1109 14:45:50.023985   11408 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" enable-default-cni-643800

	I1109 14:45:50.093551   11408 provision.go:143] copyHostCerts

	I1109 14:45:50.093869   11408 exec_runner.go:144] found C:\Users\jenkins.minikube4\minikube-integration\.minikube/ca.pem, removing ...

	I1109 14:45:50.093869   11408 exec_runner.go:203] rm: C:\Users\jenkins.minikube4\minikube-integration\.minikube\ca.pem

	I1109 14:45:50.093869   11408 exec_runner.go:151] cp: C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\ca.pem --> C:\Users\jenkins.minikube4\minikube-integration\.minikube/ca.pem (1082 bytes)

	I1109 14:45:50.095026   11408 exec_runner.go:144] found C:\Users\jenkins.minikube4\minikube-integration\.minikube/cert.pem, removing ...

	I1109 14:45:50.095026   11408 exec_runner.go:203] rm: C:\Users\jenkins.minikube4\minikube-integration\.minikube\cert.pem

	I1109 14:45:50.095026   11408 exec_runner.go:151] cp: C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\cert.pem --> C:\Users\jenkins.minikube4\minikube-integration\.minikube/cert.pem (1123 bytes)

	I1109 14:45:50.096458   11408 exec_runner.go:144] found C:\Users\jenkins.minikube4\minikube-integration\.minikube/key.pem, removing ...

	I1109 14:45:50.096458   11408 exec_runner.go:203] rm: C:\Users\jenkins.minikube4\minikube-integration\.minikube\key.pem

	I1109 14:45:50.096789   11408 exec_runner.go:151] cp: C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\key.pem --> C:\Users\jenkins.minikube4\minikube-integration\.minikube/key.pem (1679 bytes)

	I1109 14:45:50.097246   11408 provision.go:117] generating server cert: C:\Users\jenkins.minikube4\minikube-integration\.minikube\machines\server.pem ca-key=C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\ca.pem private-key=C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\ca-key.pem org=jenkins.enable-default-cni-643800 san=[127.0.0.1 192.168.94.2 enable-default-cni-643800 localhost minikube]

	I1109 14:45:50.121799   11408 provision.go:177] copyRemoteCerts

	I1109 14:45:50.131824   11408 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker

	I1109 14:45:50.138799   11408 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" enable-default-cni-643800

	I1109 14:45:50.200058   11408 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:54091 SSHKeyPath:C:\Users\jenkins.minikube4\minikube-integration\.minikube\machines\enable-default-cni-643800\id_rsa Username:docker}

	I1109 14:45:50.326427   11408 ssh_runner.go:362] scp C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\ca.pem --> /etc/docker/ca.pem (1082 bytes)

	I1109 14:45:50.366807   11408 ssh_runner.go:362] scp C:\Users\jenkins.minikube4\minikube-integration\.minikube\machines\server.pem --> /etc/docker/server.pem (1241 bytes)

	I1109 14:45:50.401032   11408 ssh_runner.go:362] scp C:\Users\jenkins.minikube4\minikube-integration\.minikube\machines\server-key.pem --> /etc/docker/server-key.pem (1675 bytes)

	I1109 14:45:50.439127   11408 provision.go:87] duration metric: took 425.1361ms to configureAuth

	I1109 14:45:50.439168   11408 ubuntu.go:206] setting minikube options for container-runtime

	I1109 14:45:50.439609   11408 config.go:182] Loaded profile config "enable-default-cni-643800": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.34.1

	I1109 14:45:50.448159   11408 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" enable-default-cni-643800

	I1109 14:45:50.512223   11408 main.go:143] libmachine: Using SSH client type: native

	I1109 14:45:50.512223   11408 main.go:143] libmachine: &{{{<nil> 0 [] [] []} docker [0x11319e0] 0x1134500 <nil>  [] 0s} 127.0.0.1 54091 <nil> <nil>}

	I1109 14:45:50.512223   11408 main.go:143] libmachine: About to run SSH command:

	df --output=fstype / | tail -n 1

	I1109 14:45:50.695472   11408 main.go:143] libmachine: SSH cmd err, output: <nil>: overlay

	I1109 14:45:50.696036   11408 ubuntu.go:71] root file system type: overlay

	I1109 14:45:50.696160   11408 provision.go:314] Updating docker unit: /lib/systemd/system/docker.service ...

	I1109 14:45:50.703673   11408 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" enable-default-cni-643800

	I1109 14:45:50.778530   11408 main.go:143] libmachine: Using SSH client type: native

	I1109 14:45:50.779352   11408 main.go:143] libmachine: &{{{<nil> 0 [] [] []} docker [0x11319e0] 0x1134500 <nil>  [] 0s} 127.0.0.1 54091 <nil> <nil>}

	I1109 14:45:50.779441   11408 main.go:143] libmachine: About to run SSH command:

	sudo mkdir -p /lib/systemd/system && printf %s "[Unit]

	Description=Docker Application Container Engine

	Documentation=https://docs.docker.com

	After=network-online.target nss-lookup.target docker.socket firewalld.service containerd.service time-set.target

	Wants=network-online.target containerd.service

	Requires=docker.socket

	StartLimitBurst=3

	StartLimitIntervalSec=60

	[Service]

	Type=notify

	Restart=always

	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	# The base configuration already specifies an 'ExecStart=...' command. The first directive

	# here is to clear out that command inherited from the base configuration. Without this,

	# the command from the base configuration and the command specified here are treated as

	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	# will catch this invalid input and refuse to start the service with an error like:

	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	ExecStart=

	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 \

		-H fd:// --containerd=/run/containerd/containerd.sock \

		-H unix:///var/run/docker.sock \

		--default-ulimit=nofile=1048576:1048576 \

		--tlsverify \

		--tlscacert /etc/docker/ca.pem \

		--tlscert /etc/docker/server.pem \

		--tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12 

	ExecReload=/bin/kill -s HUP \$MAINPID

	# Having non-zero Limit*s causes performance problems due to accounting overhead

	# in the kernel. We recommend using cgroups to do container-local accounting.

	LimitNOFILE=infinity

	LimitNPROC=infinity

	LimitCORE=infinity

	# Uncomment TasksMax if your systemd version supports it.

	# Only systemd 226 and above support this version.

	TasksMax=infinity

	TimeoutStartSec=0

	# set delegate yes so that systemd does not reset the cgroups of docker containers

	Delegate=yes

	# kill only the docker process, not all processes in the cgroup

	KillMode=process

	OOMScoreAdjust=-500

	[Install]

	WantedBy=multi-user.target

	" | sudo tee /lib/systemd/system/docker.service.new

	I1109 14:45:50.984564   11408 main.go:143] libmachine: SSH cmd err, output: <nil>: [Unit]

	Description=Docker Application Container Engine

	Documentation=https://docs.docker.com

	After=network-online.target nss-lookup.target docker.socket firewalld.service containerd.service time-set.target

	Wants=network-online.target containerd.service

	Requires=docker.socket

	StartLimitBurst=3

	StartLimitIntervalSec=60

	[Service]

	Type=notify

	Restart=always

	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	# The base configuration already specifies an 'ExecStart=...' command. The first directive

	# here is to clear out that command inherited from the base configuration. Without this,

	# the command from the base configuration and the command specified here are treated as

	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	# will catch this invalid input and refuse to start the service with an error like:

	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	ExecStart=

	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 	-H fd:// --containerd=/run/containerd/containerd.sock 	-H unix:///var/run/docker.sock 	--default-ulimit=nofile=1048576:1048576 	--tlsverify 	--tlscacert /etc/docker/ca.pem 	--tlscert /etc/docker/server.pem 	--tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12 

	ExecReload=/bin/kill -s HUP $MAINPID

	# Having non-zero Limit*s causes performance problems due to accounting overhead

	# in the kernel. We recommend using cgroups to do container-local accounting.

	LimitNOFILE=infinity

	LimitNPROC=infinity

	LimitCORE=infinity

	# Uncomment TasksMax if your systemd version supports it.

	# Only systemd 226 and above support this version.

	TasksMax=infinity

	TimeoutStartSec=0

	# set delegate yes so that systemd does not reset the cgroups of docker containers

	Delegate=yes

	# kill only the docker process, not all processes in the cgroup

	KillMode=process

	OOMScoreAdjust=-500

	[Install]

	WantedBy=multi-user.target

	I1109 14:45:50.989559   11408 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" enable-default-cni-643800

	I1109 14:45:51.045390   11408 main.go:143] libmachine: Using SSH client type: native

	I1109 14:45:51.045963   11408 main.go:143] libmachine: &{{{<nil> 0 [] [] []} docker [0x11319e0] 0x1134500 <nil>  [] 0s} 127.0.0.1 54091 <nil> <nil>}

	I1109 14:45:51.046083   11408 main.go:143] libmachine: About to run SSH command:

	sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }

	I1109 14:45:52.656307   11408 main.go:143] libmachine: SSH cmd err, output: <nil>: --- /lib/systemd/system/docker.service	2025-10-08 12:15:50.000000000 +0000

	+++ /lib/systemd/system/docker.service.new	2025-11-09 14:45:50.973057714 +0000

	@@ -9,23 +9,34 @@

	 [Service]

	 Type=notify

	-# the default is not to use systemd for cgroups because the delegate issues still

	-# exists and systemd currently does not support the cgroup feature set required

	-# for containers run by docker

	-ExecStart=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock

	-ExecReload=/bin/kill -s HUP $MAINPID

	-TimeoutStartSec=0

	-RestartSec=2

	 Restart=always

	+

	+

	+# This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	+# The base configuration already specifies an 'ExecStart=...' command. The first directive

	+# here is to clear out that command inherited from the base configuration. Without this,

	+# the command from the base configuration and the command specified here are treated as

	+# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	+# will catch this invalid input and refuse to start the service with an error like:

	+#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	+

	+# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	+# container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	+ExecStart=

	+ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 	-H fd:// --containerd=/run/containerd/containerd.sock 	-H unix:///var/run/docker.sock 	--default-ulimit=nofile=1048576:1048576 	--tlsverify 	--tlscacert /etc/docker/ca.pem 	--tlscert /etc/docker/server.pem 	--tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12 

	+ExecReload=/bin/kill -s HUP $MAINPID

	+

	 # Having non-zero Limit*s causes performance problems due to accounting overhead

	 # in the kernel. We recommend using cgroups to do container-local accounting.

	+LimitNOFILE=infinity

	 LimitNPROC=infinity

	 LimitCORE=infinity

	-# Comment TasksMax if your systemd version does not support it.

	-# Only systemd 226 and above support this option.

	+# Uncomment TasksMax if your systemd version supports it.

	+# Only systemd 226 and above support this version.

	 TasksMax=infinity

	+TimeoutStartSec=0

	 # set delegate yes so that systemd does not reset the cgroups of docker containers

	 Delegate=yes

	Synchronizing state of docker.service with SysV service script with /lib/systemd/systemd-sysv-install.

	Executing: /lib/systemd/systemd-sysv-install enable docker

	I1109 14:45:52.656307   11408 machine.go:97] duration metric: took 3.4066121s to provisionDockerMachine

	I1109 14:45:52.656307   11408 client.go:176] duration metric: took 22.7590009s to LocalClient.Create

	I1109 14:45:52.656307   11408 start.go:167] duration metric: took 22.7590009s to libmachine.API.Create "enable-default-cni-643800"

	I1109 14:45:52.656307   11408 start.go:293] postStartSetup for "enable-default-cni-643800" (driver="docker")

	I1109 14:45:52.656307   11408 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]

	I1109 14:45:52.663807   11408 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs

	I1109 14:45:52.673849   11408 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" enable-default-cni-643800

	I1109 14:45:52.735544   11408 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:54091 SSHKeyPath:C:\Users\jenkins.minikube4\minikube-integration\.minikube\machines\enable-default-cni-643800\id_rsa Username:docker}

	I1109 14:45:52.873409   11408 ssh_runner.go:195] Run: cat /etc/os-release

	I1109 14:45:52.881042   11408 main.go:143] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found

	I1109 14:45:52.881042   11408 info.go:137] Remote host: Debian GNU/Linux 12 (bookworm)

	I1109 14:45:52.881042   11408 filesync.go:126] Scanning C:\Users\jenkins.minikube4\minikube-integration\.minikube\addons for local assets ...

	I1109 14:45:52.881042   11408 filesync.go:126] Scanning C:\Users\jenkins.minikube4\minikube-integration\.minikube\files for local assets ...

	I1109 14:45:52.882009   11408 filesync.go:149] local asset: C:\Users\jenkins.minikube4\minikube-integration\.minikube\files\etc\ssl\certs\103362.pem -> 103362.pem in /etc/ssl/certs

	I1109 14:45:52.889865   11408 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs

	I1109 14:45:52.908143   11408 ssh_runner.go:362] scp C:\Users\jenkins.minikube4\minikube-integration\.minikube\files\etc\ssl\certs\103362.pem --> /etc/ssl/certs/103362.pem (1708 bytes)

	I1109 14:45:52.947323   11408 start.go:296] duration metric: took 291.0125ms for postStartSetup

	I1109 14:45:52.956411   11408 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" enable-default-cni-643800

	I1109 14:45:53.022766   11408 profile.go:143] Saving config to C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\enable-default-cni-643800\config.json ...

	I1109 14:45:53.034251   11408 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I1109 14:45:53.040173   11408 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" enable-default-cni-643800

	I1109 14:45:53.097720   11408 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:54091 SSHKeyPath:C:\Users\jenkins.minikube4\minikube-integration\.minikube\machines\enable-default-cni-643800\id_rsa Username:docker}

	I1109 14:45:53.227194   11408 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"

	I1109 14:45:53.244525   11408 start.go:128] duration metric: took 23.3507798s to createHost

	I1109 14:45:53.244525   11408 start.go:83] releasing machines lock for "enable-default-cni-643800", held for 23.3511093s

	I1109 14:45:53.251947   11408 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" enable-default-cni-643800

	I1109 14:45:53.304937   11408 ssh_runner.go:195] Run: curl.exe -sS -m 2 https://registry.k8s.io/

	I1109 14:45:53.311936   11408 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" enable-default-cni-643800

	I1109 14:45:53.311936   11408 ssh_runner.go:195] Run: cat /version.json

	I1109 14:45:53.320782   11408 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" enable-default-cni-643800

	I1109 14:45:53.381560   11408 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:54091 SSHKeyPath:C:\Users\jenkins.minikube4\minikube-integration\.minikube\machines\enable-default-cni-643800\id_rsa Username:docker}

	I1109 14:45:53.382569   11408 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:54091 SSHKeyPath:C:\Users\jenkins.minikube4\minikube-integration\.minikube\machines\enable-default-cni-643800\id_rsa Username:docker}

	W1109 14:45:53.493533   11408 start.go:869] [curl.exe -sS -m 2 https://registry.k8s.io/] failed: curl.exe -sS -m 2 https://registry.k8s.io/: Process exited with status 127

	stdout:

	stderr:

	bash: line 1: curl.exe: command not found

	I1109 14:45:53.500659   11408 ssh_runner.go:195] Run: systemctl --version

	I1109 14:45:53.520827   11408 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"

	W1109 14:45:53.529338   11408 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found

	I1109 14:45:53.537834   11408 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;

	W1109 14:45:53.598798   11408 out.go:285] ! Failing to connect to https://registry.k8s.io/ from inside the minikube container

	W1109 14:45:53.598885   11408 out.go:285] * To pull new external images, you may need to configure a proxy: https://minikube.sigs.k8s.io/docs/reference/networking/proxy/

	I1109 14:45:53.605568   11408 cni.go:262] disabled [/etc/cni/net.d/10-crio-bridge.conflist.disabled, /etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)

	I1109 14:45:53.605635   11408 start.go:496] detecting cgroup driver to use...

	I1109 14:45:53.605679   11408 detect.go:187] detected "cgroupfs" cgroup driver on host os

	I1109 14:45:53.605824   11408 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///run/containerd/containerd.sock

	" | sudo tee /etc/crictl.yaml"

	I1109 14:45:53.644083   11408 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.10.1"|' /etc/containerd/config.toml"

	I1109 14:45:53.670466   11408 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"

	I1109 14:45:53.686422   11408 containerd.go:146] configuring containerd to use "cgroupfs" as cgroup driver...

	I1109 14:45:53.695980   11408 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"

	I1109 14:45:53.726872   11408 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"

	I1109 14:45:53.751866   11408 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"

	I1109 14:45:53.780495   11408 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"

	I1109 14:45:53.808360   11408 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"

	I1109 14:45:53.841350   11408 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"

	I1109 14:45:53.864364   11408 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *enable_unprivileged_ports = .*/d' /etc/containerd/config.toml"

	I1109 14:45:53.892413   11408 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)\[plugins."io.containerd.grpc.v1.cri"\]|&\n\1  enable_unprivileged_ports = true|' /etc/containerd/config.toml"

	I1109 14:45:53.927095   11408 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables

	I1109 14:45:53.957390   11408 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"

	I1109 14:45:53.979325   11408 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I1109 14:45:54.151708   11408 ssh_runner.go:195] Run: sudo systemctl restart containerd

	I1109 14:45:54.329018   11408 start.go:496] detecting cgroup driver to use...

	I1109 14:45:54.329128   11408 detect.go:187] detected "cgroupfs" cgroup driver on host os

	I1109 14:45:54.337793   11408 ssh_runner.go:195] Run: sudo systemctl cat docker.service

	I1109 14:45:54.375853   11408 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I1109 14:45:54.416738   11408 ssh_runner.go:195] Run: sudo systemctl stop -f containerd

	I1109 14:45:54.446747   11408 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I1109 14:45:54.477693   11408 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio

	I1109 14:45:54.499559   11408 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/cri-dockerd.sock

	" | sudo tee /etc/crictl.yaml"

	I1109 14:45:54.537074   11408 ssh_runner.go:195] Run: which cri-dockerd

	I1109 14:45:54.556435   11408 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/cri-docker.service.d

	I1109 14:45:54.571448   11408 ssh_runner.go:362] scp memory --> /etc/systemd/system/cri-docker.service.d/10-cni.conf (192 bytes)

	I1109 14:45:54.598441   11408 ssh_runner.go:195] Run: sudo systemctl unmask docker.service

	I1109 14:45:54.777576   11408 ssh_runner.go:195] Run: sudo systemctl enable docker.socket

	I1109 14:45:54.889901   11408 docker.go:575] configuring docker to use "cgroupfs" as cgroup driver...

	I1109 14:45:54.889901   11408 ssh_runner.go:362] scp memory --> /etc/docker/daemon.json (130 bytes)

	I1109 14:45:54.919043   11408 ssh_runner.go:195] Run: sudo systemctl reset-failed docker

	I1109 14:45:54.946083   11408 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I1109 14:45:55.124509   11408 ssh_runner.go:195] Run: sudo systemctl restart docker

	I1109 14:45:56.053557   11408 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker

	I1109 14:45:56.096296   11408 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service cri-docker.socket

	I1109 14:45:56.181110   11408 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service cri-docker.service

	I1109 14:45:56.213017   11408 ssh_runner.go:195] Run: sudo systemctl unmask cri-docker.socket

	I1109 14:45:56.377255   11408 ssh_runner.go:195] Run: sudo systemctl enable cri-docker.socket

	I1109 14:45:56.538269   11408 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I1109 14:45:56.732541   11408 ssh_runner.go:195] Run: sudo systemctl restart cri-docker.socket

	I1109 14:45:56.764546   11408 ssh_runner.go:195] Run: sudo systemctl reset-failed cri-docker.service

	I1109 14:45:56.793705   11408 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I1109 14:45:56.946863   11408 ssh_runner.go:195] Run: sudo systemctl restart cri-docker.service

	I1109 14:45:57.086253   11408 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service cri-docker.service

	I1109 14:45:57.117379   11408 start.go:543] Will wait 60s for socket path /var/run/cri-dockerd.sock

	I1109 14:45:57.124563   11408 ssh_runner.go:195] Run: stat /var/run/cri-dockerd.sock

	I1109 14:45:57.132521   11408 start.go:564] Will wait 60s for crictl version

	I1109 14:45:57.139522   11408 ssh_runner.go:195] Run: which crictl

	I1109 14:45:57.154530   11408 ssh_runner.go:195] Run: sudo /usr/local/bin/crictl version

	I1109 14:45:57.205531   11408 start.go:580] Version:  0.1.0

	RuntimeName:  docker

	RuntimeVersion:  28.5.1

	RuntimeApiVersion:  v1

	I1109 14:45:57.211526   11408 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}

	I1109 14:45:57.281637   11408 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}

	I1109 14:45:57.324634   11408 out.go:252] * Preparing Kubernetes v1.34.1 on Docker 28.5.1 ...

	I1109 14:45:57.330631   11408 cli_runner.go:164] Run: docker exec -t enable-default-cni-643800 dig +short host.docker.internal

	I1109 14:45:57.478234   11408 network.go:96] got host ip for mount in container by digging dns: 192.168.65.254

	I1109 14:45:57.487250   11408 ssh_runner.go:195] Run: grep 192.168.65.254	host.minikube.internal$ /etc/hosts

	I1109 14:45:57.495235   11408 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.65.254	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I1109 14:45:57.516235   11408 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "8443/tcp") 0).HostPort}}'" enable-default-cni-643800

	I1109 14:45:57.578880   11408 kubeadm.go:884] updating cluster {Name:enable-default-cni-643800 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1761985721-21837@sha256:a50b37e97dfdea51156e079ca6b45818a801b3d41bbe13d141f35d2e1af6c7d1 Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.1 ClusterName:enable-default-cni-643800 Namespace:default APIServerHAVIP: APIServerNam

e:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:bridge} Nodes:[{Name: IP:192.168.94.2 Port:8443 KubernetesVersion:v1.34.1 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:fa

lse CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...

	I1109 14:45:57.578880   11408 preload.go:188] Checking if preload exists for k8s version v1.34.1 and runtime docker

	I1109 14:45:57.586079   11408 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}

	I1109 14:45:57.626549   11408 docker.go:691] Got preloaded images: -- stdout --

	registry.k8s.io/kube-controller-manager:v1.34.1

	registry.k8s.io/kube-scheduler:v1.34.1

	registry.k8s.io/kube-apiserver:v1.34.1

	registry.k8s.io/kube-proxy:v1.34.1

	registry.k8s.io/etcd:3.6.4-0

	registry.k8s.io/pause:3.10.1

	registry.k8s.io/coredns/coredns:v1.12.1

	gcr.io/k8s-minikube/storage-provisioner:v5

	-- /stdout --

	I1109 14:45:57.626549   11408 docker.go:621] Images already preloaded, skipping extraction

	I1109 14:45:57.632544   11408 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}

	I1109 14:45:57.667162   11408 docker.go:691] Got preloaded images: -- stdout --

	registry.k8s.io/kube-scheduler:v1.34.1

	registry.k8s.io/kube-apiserver:v1.34.1

	registry.k8s.io/kube-controller-manager:v1.34.1

	registry.k8s.io/kube-proxy:v1.34.1

	registry.k8s.io/etcd:3.6.4-0

	registry.k8s.io/pause:3.10.1

	registry.k8s.io/coredns/coredns:v1.12.1

	gcr.io/k8s-minikube/storage-provisioner:v5

	-- /stdout --

	I1109 14:45:57.667162   11408 cache_images.go:86] Images are preloaded, skipping loading

	I1109 14:45:57.667162   11408 kubeadm.go:935] updating node { 192.168.94.2 8443 v1.34.1 docker true true} ...

	I1109 14:45:57.667162   11408 kubeadm.go:947] kubelet [Unit]

	Wants=docker.socket

	[Service]

	ExecStart=

	ExecStart=/var/lib/minikube/binaries/v1.34.1/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=enable-default-cni-643800 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.94.2

	[Install]

	 config:

	{KubernetesVersion:v1.34.1 ClusterName:enable-default-cni-643800 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:bridge}

	I1109 14:45:57.678189   11408 ssh_runner.go:195] Run: docker info --format {{.CgroupDriver}}

	I1109 14:45:57.767132   11408 cni.go:84] Creating CNI manager for "bridge"

	I1109 14:45:57.767132   11408 kubeadm.go:85] Using pod CIDR: 10.244.0.0/16

	I1109 14:45:57.767132   11408 kubeadm.go:190] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.94.2 APIServerPort:8443 KubernetesVersion:v1.34.1 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:enable-default-cni-643800 NodeName:enable-default-cni-643800 DNSDomain:cluster.local CRISocket:/var/run/cri-dockerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.94.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.94.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt

StaticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///var/run/cri-dockerd.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}

	I1109 14:45:57.767811   11408 kubeadm.go:196] kubeadm config:

	apiVersion: kubeadm.k8s.io/v1beta4

	kind: InitConfiguration

	localAPIEndpoint:

	  advertiseAddress: 192.168.94.2

	  bindPort: 8443

	bootstrapTokens:

	  - groups:

	      - system:bootstrappers:kubeadm:default-node-token

	    ttl: 24h0m0s

	    usages:

	      - signing

	      - authentication

	nodeRegistration:

	  criSocket: unix:///var/run/cri-dockerd.sock

	  name: "enable-default-cni-643800"

	  kubeletExtraArgs:

	    - name: "node-ip"

	      value: "192.168.94.2"

	  taints: []

	---

	apiVersion: kubeadm.k8s.io/v1beta4

	kind: ClusterConfiguration

	apiServer:

	  certSANs: ["127.0.0.1", "localhost", "192.168.94.2"]

	  extraArgs:

	    - name: "enable-admission-plugins"

	      value: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"

	controllerManager:

	  extraArgs:

	    - name: "allocate-node-cidrs"

	      value: "true"

	    - name: "leader-elect"

	      value: "false"

	scheduler:

	  extraArgs:

	    - name: "leader-elect"

	      value: "false"

	certificatesDir: /var/lib/minikube/certs

	clusterName: mk

	controlPlaneEndpoint: control-plane.minikube.internal:8443

	etcd:

	  local:

	    dataDir: /var/lib/minikube/etcd

	kubernetesVersion: v1.34.1

	networking:

	  dnsDomain: cluster.local

	  podSubnet: "10.244.0.0/16"

	  serviceSubnet: 10.96.0.0/12

	---

	apiVersion: kubelet.config.k8s.io/v1beta1

	kind: KubeletConfiguration

	authentication:

	  x509:

	    clientCAFile: /var/lib/minikube/certs/ca.crt

	cgroupDriver: cgroupfs

	containerRuntimeEndpoint: unix:///var/run/cri-dockerd.sock

	hairpinMode: hairpin-veth

	runtimeRequestTimeout: 15m

	clusterDomain: "cluster.local"

	# disable disk resource management by default

	imageGCHighThresholdPercent: 100

	evictionHard:

	  nodefs.available: "0%"

	  nodefs.inodesFree: "0%"

	  imagefs.available: "0%"

	failSwapOn: false

	staticPodPath: /etc/kubernetes/manifests

	---

	apiVersion: kubeproxy.config.k8s.io/v1alpha1

	kind: KubeProxyConfiguration

	clusterCIDR: "10.244.0.0/16"

	metricsBindAddress: 0.0.0.0:10249

	conntrack:

	  maxPerCore: 0

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"

	  tcpEstablishedTimeout: 0s

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"

	  tcpCloseWaitTimeout: 0s

	I1109 14:45:57.775443   11408 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.34.1

	I1109 14:45:57.794747   11408 binaries.go:51] Found k8s binaries, skipping transfer

	I1109 14:45:57.806679   11408 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube

	I1109 14:45:57.821675   11408 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (324 bytes)

	I1109 14:45:57.842679   11408 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)

	I1109 14:45:57.864681   11408 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2226 bytes)

	I1109 14:45:57.894671   11408 ssh_runner.go:195] Run: grep 192.168.94.2	control-plane.minikube.internal$ /etc/hosts

	I1109 14:45:57.902671   11408 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.94.2	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I1109 14:45:57.930657   11408 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I1109 14:45:58.079896   11408 ssh_runner.go:195] Run: sudo systemctl start kubelet

	I1109 14:45:58.110619   11408 certs.go:69] Setting up C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\enable-default-cni-643800 for IP: 192.168.94.2

	I1109 14:45:58.110619   11408 certs.go:195] generating shared ca certs ...

	I1109 14:45:58.111633   11408 certs.go:227] acquiring lock for ca certs: {Name:mk92285f7546e1a5b3c3b23dab6135aa5a99cd14 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1109 14:45:58.111633   11408 certs.go:236] skipping valid "minikubeCA" ca cert: C:\Users\jenkins.minikube4\minikube-integration\.minikube\ca.key

	I1109 14:45:58.112388   11408 certs.go:236] skipping valid "proxyClientCA" ca cert: C:\Users\jenkins.minikube4\minikube-integration\.minikube\proxy-client-ca.key

	I1109 14:45:58.112515   11408 certs.go:257] generating profile certs ...

	I1109 14:45:58.113024   11408 certs.go:364] generating signed profile cert for "minikube-user": C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\enable-default-cni-643800\client.key

	I1109 14:45:58.113024   11408 crypto.go:68] Generating cert C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\enable-default-cni-643800\client.crt with IP's: []

	I1109 14:45:58.407347   11408 crypto.go:156] Writing cert to C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\enable-default-cni-643800\client.crt ...

	I1109 14:45:58.407347   11408 lock.go:35] WriteFile acquiring C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\enable-default-cni-643800\client.crt: {Name:mk646ecc4870dc3e3c1170cbcfc1d9f46573374a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1109 14:45:58.408348   11408 crypto.go:164] Writing key to C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\enable-default-cni-643800\client.key ...

	I1109 14:45:58.408348   11408 lock.go:35] WriteFile acquiring C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\enable-default-cni-643800\client.key: {Name:mk162bb690ebec5035ef9f1ccda0da52e46bbe68 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1109 14:45:58.409347   11408 certs.go:364] generating signed profile cert for "minikube": C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\enable-default-cni-643800\apiserver.key.66482264

	I1109 14:45:58.409347   11408 crypto.go:68] Generating cert C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\enable-default-cni-643800\apiserver.crt.66482264 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.94.2]

	I1109 14:45:58.913565   11408 crypto.go:156] Writing cert to C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\enable-default-cni-643800\apiserver.crt.66482264 ...

	I1109 14:45:58.913633   11408 lock.go:35] WriteFile acquiring C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\enable-default-cni-643800\apiserver.crt.66482264: {Name:mk967fa8ffc680c89080db30ee1a48890c9cd905 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1109 14:45:58.914308   11408 crypto.go:164] Writing key to C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\enable-default-cni-643800\apiserver.key.66482264 ...

	I1109 14:45:58.914308   11408 lock.go:35] WriteFile acquiring C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\enable-default-cni-643800\apiserver.key.66482264: {Name:mk29696c576cd7e10a36da9e76b31558543fc5a6 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1109 14:45:58.914967   11408 certs.go:382] copying C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\enable-default-cni-643800\apiserver.crt.66482264 -> C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\enable-default-cni-643800\apiserver.crt

	I1109 14:45:58.930031   11408 certs.go:386] copying C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\enable-default-cni-643800\apiserver.key.66482264 -> C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\enable-default-cni-643800\apiserver.key

	I1109 14:45:58.931372   11408 certs.go:364] generating signed profile cert for "aggregator": C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\enable-default-cni-643800\proxy-client.key

	I1109 14:45:58.931565   11408 crypto.go:68] Generating cert C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\enable-default-cni-643800\proxy-client.crt with IP's: []

	I1109 14:46:03.134407    1604 kubeadm.go:319] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster

	I1109 14:46:03.134407    1604 kubeadm.go:319] To see the stack trace of this error execute with --v=5 or higher

	I1109 14:46:03.138880    1604 kubeadm.go:319] [init] Using Kubernetes version: v1.28.3

	I1109 14:46:03.138939    1604 kubeadm.go:319] [preflight] Running pre-flight checks

	I1109 14:46:03.139260    1604 kubeadm.go:319] [preflight] Pulling images required for setting up a Kubernetes cluster

	I1109 14:46:03.139535    1604 kubeadm.go:319] [preflight] This might take a minute or two, depending on the speed of your internet connection

	I1109 14:46:03.139857    1604 kubeadm.go:319] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'

	I1109 14:46:03.140080    1604 kubeadm.go:319] [certs] Using certificateDir folder "/var/lib/minikube/certs"

	I1109 14:46:03.142713    1604 out.go:252]   - Generating certificates and keys ...

	I1109 14:46:03.143322    1604 kubeadm.go:319] [certs] Using existing ca certificate authority

	I1109 14:46:03.143568    1604 kubeadm.go:319] [certs] Using existing apiserver certificate and key on disk

	I1109 14:46:03.143755    1604 kubeadm.go:319] [certs] Using existing apiserver-kubelet-client certificate and key on disk

	I1109 14:46:03.143942    1604 kubeadm.go:319] [certs] Using existing front-proxy-ca certificate authority

	I1109 14:46:03.144190    1604 kubeadm.go:319] [certs] Using existing front-proxy-client certificate and key on disk

	I1109 14:46:03.144415    1604 kubeadm.go:319] [certs] Using existing etcd/ca certificate authority

	I1109 14:46:03.144415    1604 kubeadm.go:319] [certs] Using existing etcd/server certificate and key on disk

	I1109 14:46:03.144415    1604 kubeadm.go:319] [certs] Using existing etcd/peer certificate and key on disk

	I1109 14:46:03.144415    1604 kubeadm.go:319] [certs] Using existing etcd/healthcheck-client certificate and key on disk

	I1109 14:46:03.144415    1604 kubeadm.go:319] [certs] Using existing apiserver-etcd-client certificate and key on disk

	I1109 14:46:03.144969    1604 kubeadm.go:319] [certs] Using the existing "sa" key

	I1109 14:46:03.145024    1604 kubeadm.go:319] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"

	I1109 14:46:03.145024    1604 kubeadm.go:319] [kubeconfig] Writing "admin.conf" kubeconfig file

	I1109 14:46:03.145024    1604 kubeadm.go:319] [kubeconfig] Writing "kubelet.conf" kubeconfig file

	I1109 14:46:03.145024    1604 kubeadm.go:319] [kubeconfig] Writing "controller-manager.conf" kubeconfig file

	I1109 14:46:03.145024    1604 kubeadm.go:319] [kubeconfig] Writing "scheduler.conf" kubeconfig file

	I1109 14:46:03.145559    1604 kubeadm.go:319] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"

	I1109 14:46:03.145672    1604 kubeadm.go:319] [control-plane] Using manifest folder "/etc/kubernetes/manifests"

	I1109 14:45:59.586046   11408 crypto.go:156] Writing cert to C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\enable-default-cni-643800\proxy-client.crt ...

	I1109 14:45:59.586046   11408 lock.go:35] WriteFile acquiring C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\enable-default-cni-643800\proxy-client.crt: {Name:mkb6a6f1e3e2bf14ccef5f286fe334aedb902e74 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1109 14:45:59.587286   11408 crypto.go:164] Writing key to C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\enable-default-cni-643800\proxy-client.key ...

	I1109 14:45:59.587286   11408 lock.go:35] WriteFile acquiring C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\enable-default-cni-643800\proxy-client.key: {Name:mkd87deef998e0a63e96ef61479803f7d084e3ec Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1109 14:45:59.604879   11408 certs.go:484] found cert: C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\10336.pem (1338 bytes)

	W1109 14:45:59.604879   11408 certs.go:480] ignoring C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\10336_empty.pem, impossibly tiny 0 bytes

	I1109 14:45:59.604879   11408 certs.go:484] found cert: C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\ca-key.pem (1675 bytes)

	I1109 14:45:59.605419   11408 certs.go:484] found cert: C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\ca.pem (1082 bytes)

	I1109 14:45:59.605626   11408 certs.go:484] found cert: C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\cert.pem (1123 bytes)

	I1109 14:45:59.605836   11408 certs.go:484] found cert: C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\key.pem (1679 bytes)

	I1109 14:45:59.606403   11408 certs.go:484] found cert: C:\Users\jenkins.minikube4\minikube-integration\.minikube\files\etc\ssl\certs\103362.pem (1708 bytes)

	I1109 14:45:59.608181   11408 ssh_runner.go:362] scp C:\Users\jenkins.minikube4\minikube-integration\.minikube\ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)

	I1109 14:45:59.646117   11408 ssh_runner.go:362] scp C:\Users\jenkins.minikube4\minikube-integration\.minikube\ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)

	I1109 14:45:59.689882   11408 ssh_runner.go:362] scp C:\Users\jenkins.minikube4\minikube-integration\.minikube\proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)

	I1109 14:45:59.718873   11408 ssh_runner.go:362] scp C:\Users\jenkins.minikube4\minikube-integration\.minikube\proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)

	I1109 14:45:59.757818   11408 ssh_runner.go:362] scp C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\enable-default-cni-643800\apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1436 bytes)

	I1109 14:45:59.796219   11408 ssh_runner.go:362] scp C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\enable-default-cni-643800\apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)

	I1109 14:45:59.823223   11408 ssh_runner.go:362] scp C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\enable-default-cni-643800\proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)

	I1109 14:45:59.850227   11408 ssh_runner.go:362] scp C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\enable-default-cni-643800\proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)

	I1109 14:45:59.881225   11408 ssh_runner.go:362] scp C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\10336.pem --> /usr/share/ca-certificates/10336.pem (1338 bytes)

	I1109 14:45:59.912225   11408 ssh_runner.go:362] scp C:\Users\jenkins.minikube4\minikube-integration\.minikube\files\etc\ssl\certs\103362.pem --> /usr/share/ca-certificates/103362.pem (1708 bytes)

	I1109 14:45:59.939230   11408 ssh_runner.go:362] scp C:\Users\jenkins.minikube4\minikube-integration\.minikube\ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)

	I1109 14:45:59.972718   11408 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)

	I1109 14:46:00.005167   11408 ssh_runner.go:195] Run: openssl version

	I1109 14:46:00.024869   11408 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/10336.pem && ln -fs /usr/share/ca-certificates/10336.pem /etc/ssl/certs/10336.pem"

	I1109 14:46:00.050396   11408 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/10336.pem

	I1109 14:46:00.061476   11408 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Nov  9 13:39 /usr/share/ca-certificates/10336.pem

	I1109 14:46:00.074389   11408 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/10336.pem

	I1109 14:46:00.133625   11408 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/10336.pem /etc/ssl/certs/51391683.0"

	I1109 14:46:00.154627   11408 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/103362.pem && ln -fs /usr/share/ca-certificates/103362.pem /etc/ssl/certs/103362.pem"

	I1109 14:46:00.176636   11408 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/103362.pem

	I1109 14:46:00.184633   11408 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Nov  9 13:39 /usr/share/ca-certificates/103362.pem

	I1109 14:46:00.191627   11408 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/103362.pem

	I1109 14:46:00.266853   11408 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/103362.pem /etc/ssl/certs/3ec20f2e.0"

	I1109 14:46:00.288851   11408 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"

	I1109 14:46:00.322297   11408 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem

	I1109 14:46:00.334612   11408 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Nov  9 13:31 /usr/share/ca-certificates/minikubeCA.pem

	I1109 14:46:00.342505   11408 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem

	I1109 14:46:00.411787   11408 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"

	I1109 14:46:00.433805   11408 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt

	I1109 14:46:00.447513   11408 certs.go:400] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory

	I1109 14:46:00.448305   11408 kubeadm.go:401] StartCluster: {Name:enable-default-cni-643800 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1761985721-21837@sha256:a50b37e97dfdea51156e079ca6b45818a801b3d41bbe13d141f35d2e1af6c7d1 Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.1 ClusterName:enable-default-cni-643800 Namespace:default APIServerHAVIP: APIServerName:m

inikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:bridge} Nodes:[{Name: IP:192.168.94.2 Port:8443 KubernetesVersion:v1.34.1 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false

CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I1109 14:46:00.457134   11408 ssh_runner.go:195] Run: docker ps --filter status=paused --filter=name=k8s_.*_(kube-system)_ --format={{.ID}}

	I1109 14:46:00.509273   11408 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd

	I1109 14:46:00.531285   11408 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml

	I1109 14:46:00.554287   11408 kubeadm.go:215] ignoring SystemVerification for kubeadm because of docker driver

	I1109 14:46:00.566291   11408 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf

	I1109 14:46:00.580279   11408 kubeadm.go:156] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2

	stdout:

	stderr:

	ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory

	I1109 14:46:00.580279   11408 kubeadm.go:158] found existing configuration files:

	I1109 14:46:00.587272   11408 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf

	I1109 14:46:00.600273   11408 kubeadm.go:164] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2

	stdout:

	stderr:

	grep: /etc/kubernetes/admin.conf: No such file or directory

	I1109 14:46:00.607277   11408 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf

	I1109 14:46:00.627273   11408 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf

	I1109 14:46:00.640279   11408 kubeadm.go:164] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2

	stdout:

	stderr:

	grep: /etc/kubernetes/kubelet.conf: No such file or directory

	I1109 14:46:00.646282   11408 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf

	I1109 14:46:00.673654   11408 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf

	I1109 14:46:00.690160   11408 kubeadm.go:164] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2

	stdout:

	stderr:

	grep: /etc/kubernetes/controller-manager.conf: No such file or directory

	I1109 14:46:00.697448   11408 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf

	I1109 14:46:00.718551   11408 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf

	I1109 14:46:00.730555   11408 kubeadm.go:164] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2

	stdout:

	stderr:

	grep: /etc/kubernetes/scheduler.conf: No such file or directory

	I1109 14:46:00.737550   11408 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf

	I1109 14:46:00.761383   11408 ssh_runner.go:286] Start: sudo /bin/bash -c "env PATH="/var/lib/minikube/binaries/v1.34.1:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"

	I1109 14:46:00.901595   11408 kubeadm.go:319] 	[WARNING Swap]: swap is supported for cgroup v2 only. The kubelet must be properly configured to use swap. Please refer to https://kubernetes.io/docs/concepts/architecture/nodes/#swap-memory, or disable swap on the node

	I1109 14:46:00.907745   11408 kubeadm.go:319] 	[WARNING SystemVerification]: cgroups v1 support is in maintenance mode, please migrate to cgroups v2

	I1109 14:46:01.038156   11408 kubeadm.go:319] 	[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'

	I1109 14:46:03.148963    1604 out.go:252]   - Booting up control plane ...

	I1109 14:46:03.148963    1604 kubeadm.go:319] [control-plane] Creating static Pod manifest for "kube-apiserver"

	I1109 14:46:03.148963    1604 kubeadm.go:319] [control-plane] Creating static Pod manifest for "kube-controller-manager"

	I1109 14:46:03.148963    1604 kubeadm.go:319] [control-plane] Creating static Pod manifest for "kube-scheduler"

	I1109 14:46:03.149923    1604 kubeadm.go:319] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"

	I1109 14:46:03.149923    1604 kubeadm.go:319] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"

	I1109 14:46:03.149923    1604 kubeadm.go:319] [kubelet-start] Starting the kubelet

	I1109 14:46:03.149923    1604 kubeadm.go:319] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s

	I1109 14:46:03.149923    1604 kubeadm.go:319] [kubelet-check] Initial timeout of 40s passed.

	I1109 14:46:03.149923    1604 kubeadm.go:319] 

	I1109 14:46:03.150930    1604 kubeadm.go:319] Unfortunately, an error has occurred:

	I1109 14:46:03.150930    1604 kubeadm.go:319] 	timed out waiting for the condition

	I1109 14:46:03.150930    1604 kubeadm.go:319] 

	I1109 14:46:03.150930    1604 kubeadm.go:319] This error is likely caused by:

	I1109 14:46:03.150930    1604 kubeadm.go:319] 	- The kubelet is not running

	I1109 14:46:03.150930    1604 kubeadm.go:319] 	- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)

	I1109 14:46:03.150930    1604 kubeadm.go:319] 

	I1109 14:46:03.150930    1604 kubeadm.go:319] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:

	I1109 14:46:03.150930    1604 kubeadm.go:319] 	- 'systemctl status kubelet'

	I1109 14:46:03.150930    1604 kubeadm.go:319] 	- 'journalctl -xeu kubelet'

	I1109 14:46:03.150930    1604 kubeadm.go:319] 

	I1109 14:46:03.151913    1604 kubeadm.go:319] Additionally, a control plane component may have crashed or exited when started by the container runtime.

	I1109 14:46:03.151913    1604 kubeadm.go:319] To troubleshoot, list all containers using your preferred container runtimes CLI.

	I1109 14:46:03.151913    1604 kubeadm.go:319] Here is one example how you may list all running Kubernetes containers by using crictl:

	I1109 14:46:03.151913    1604 kubeadm.go:319] 	- 'crictl --runtime-endpoint unix:///var/run/cri-dockerd.sock ps -a | grep kube | grep -v pause'

	I1109 14:46:03.151913    1604 kubeadm.go:319] 	Once you have found the failing container, you can inspect its logs with:

	I1109 14:46:03.151913    1604 kubeadm.go:319] 	- 'crictl --runtime-endpoint unix:///var/run/cri-dockerd.sock logs CONTAINERID'

	I1109 14:46:03.151913    1604 kubeadm.go:403] duration metric: took 14m36.2712228s to StartCluster

	I1109 14:46:03.152926    1604 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}

	I1109 14:46:03.160077    1604 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver

	I1109 14:46:03.256048    1604 cri.go:89] found id: "f159ce501abc24427240ea30e47c614499580593ebea41b7479437ced5f19334"

	I1109 14:46:03.256048    1604 cri.go:89] found id: ""

	I1109 14:46:03.256048    1604 logs.go:282] 1 containers: [f159ce501abc24427240ea30e47c614499580593ebea41b7479437ced5f19334]

	I1109 14:46:03.266177    1604 ssh_runner.go:195] Run: which crictl

	I1109 14:46:03.274749    1604 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}

	I1109 14:46:03.281747    1604 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd

	I1109 14:46:03.373310    1604 cri.go:89] found id: "6c1d6990ec9a17213a491b9b31dc6b7a0c15a7cd579cd9b12f9b4eb7b925d0fc"

	I1109 14:46:03.373310    1604 cri.go:89] found id: ""

	I1109 14:46:03.373310    1604 logs.go:282] 1 containers: [6c1d6990ec9a17213a491b9b31dc6b7a0c15a7cd579cd9b12f9b4eb7b925d0fc]

	I1109 14:46:03.381575    1604 ssh_runner.go:195] Run: which crictl

	I1109 14:46:03.388574    1604 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}

	I1109 14:46:03.397569    1604 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns

	I1109 14:46:03.483585    1604 cri.go:89] found id: ""

	I1109 14:46:03.483585    1604 logs.go:282] 0 containers: []

	W1109 14:46:03.483585    1604 logs.go:284] No container was found matching "coredns"

	I1109 14:46:03.483585    1604 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}

	I1109 14:46:03.492604    1604 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler

	I1109 14:46:03.582247    1604 cri.go:89] found id: "9916a784d53cc5f2ca77c62d475395dc21acbe3a4cc052be5908741fae99bfee"

	I1109 14:46:03.582247    1604 cri.go:89] found id: ""

	I1109 14:46:03.582247    1604 logs.go:282] 1 containers: [9916a784d53cc5f2ca77c62d475395dc21acbe3a4cc052be5908741fae99bfee]

	I1109 14:46:03.590240    1604 ssh_runner.go:195] Run: which crictl

	I1109 14:46:03.599246    1604 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}

	I1109 14:46:03.607237    1604 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy

	I1109 14:46:03.687234    1604 cri.go:89] found id: ""

	I1109 14:46:03.687234    1604 logs.go:282] 0 containers: []

	W1109 14:46:03.687234    1604 logs.go:284] No container was found matching "kube-proxy"

	I1109 14:46:03.687234    1604 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}

	I1109 14:46:03.694235    1604 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager

	I1109 14:46:03.796939    1604 cri.go:89] found id: "bd1e895dfe296b588d9737b1a5eb36949c0c7eb030142f53536645f3348ee505"

	I1109 14:46:03.796965    1604 cri.go:89] found id: "df0342a399cd6c5cdae1627914dd8cfa5c439d038612bfd86863d8be51c874e9"

	I1109 14:46:03.796965    1604 cri.go:89] found id: ""

	I1109 14:46:03.797011    1604 logs.go:282] 2 containers: [bd1e895dfe296b588d9737b1a5eb36949c0c7eb030142f53536645f3348ee505 df0342a399cd6c5cdae1627914dd8cfa5c439d038612bfd86863d8be51c874e9]

	I1109 14:46:03.805759    1604 ssh_runner.go:195] Run: which crictl

	I1109 14:46:03.820720    1604 ssh_runner.go:195] Run: which crictl

	I1109 14:46:03.826719    1604 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}

	I1109 14:46:03.833719    1604 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet

	I1109 14:46:03.924217    1604 cri.go:89] found id: ""

	I1109 14:46:03.924217    1604 logs.go:282] 0 containers: []

	W1109 14:46:03.924217    1604 logs.go:284] No container was found matching "kindnet"

	I1109 14:46:03.925221    1604 cri.go:54] listing CRI containers in root : {State:all Name:storage-provisioner Namespaces:[]}

	I1109 14:46:03.932233    1604 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner

	I1109 14:46:04.024603    1604 cri.go:89] found id: ""

	I1109 14:46:04.024603    1604 logs.go:282] 0 containers: []

	W1109 14:46:04.024603    1604 logs.go:284] No container was found matching "storage-provisioner"

	I1109 14:46:04.024603    1604 logs.go:123] Gathering logs for kubelet ...

	I1109 14:46:04.024603    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"

	I1109 14:46:04.128605    1604 logs.go:123] Gathering logs for describe nodes ...

	I1109 14:46:04.128605    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"

	W1109 14:46:04.240535    1604 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1

	stdout:

	stderr:

	E1109 14:46:04.232003   22141 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:46:04.233049   22141 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:46:04.234185   22141 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:46:04.234963   22141 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:46:04.237327   22141 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	 output: 

	** stderr ** 

	E1109 14:46:04.232003   22141 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:46:04.233049   22141 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:46:04.234185   22141 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:46:04.234963   22141 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:46:04.237327   22141 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	** /stderr **

	I1109 14:46:04.240535    1604 logs.go:123] Gathering logs for kube-apiserver [f159ce501abc24427240ea30e47c614499580593ebea41b7479437ced5f19334] ...

	I1109 14:46:04.240535    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 f159ce501abc24427240ea30e47c614499580593ebea41b7479437ced5f19334"

	I1109 14:46:04.329115    1604 logs.go:123] Gathering logs for kube-controller-manager [bd1e895dfe296b588d9737b1a5eb36949c0c7eb030142f53536645f3348ee505] ...

	I1109 14:46:04.329115    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 bd1e895dfe296b588d9737b1a5eb36949c0c7eb030142f53536645f3348ee505"

	I1109 14:46:04.403632    1604 logs.go:123] Gathering logs for kube-controller-manager [df0342a399cd6c5cdae1627914dd8cfa5c439d038612bfd86863d8be51c874e9] ...

	I1109 14:46:04.403632    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 df0342a399cd6c5cdae1627914dd8cfa5c439d038612bfd86863d8be51c874e9"

	I1109 14:46:04.474152    1604 logs.go:123] Gathering logs for Docker ...

	I1109 14:46:04.474152    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"

	I1109 14:46:04.554610    1604 logs.go:123] Gathering logs for dmesg ...

	I1109 14:46:04.554610    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"

	I1109 14:46:04.583252    1604 logs.go:123] Gathering logs for etcd [6c1d6990ec9a17213a491b9b31dc6b7a0c15a7cd579cd9b12f9b4eb7b925d0fc] ...

	I1109 14:46:04.583363    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 6c1d6990ec9a17213a491b9b31dc6b7a0c15a7cd579cd9b12f9b4eb7b925d0fc"

	I1109 14:46:04.677842    1604 logs.go:123] Gathering logs for kube-scheduler [9916a784d53cc5f2ca77c62d475395dc21acbe3a4cc052be5908741fae99bfee] ...

	I1109 14:46:04.677981    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 9916a784d53cc5f2ca77c62d475395dc21acbe3a4cc052be5908741fae99bfee"

	I1109 14:46:04.803422    1604 logs.go:123] Gathering logs for container status ...

	I1109 14:46:04.803422    1604 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"

	W1109 14:46:04.912632    1604 out.go:434] Error starting cluster: wait: sudo /bin/bash -c "env PATH="/var/lib/minikube/binaries/v1.28.3:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables": Process exited with status 1

	stdout:

	[init] Using Kubernetes version: v1.28.3

	[preflight] Running pre-flight checks

	[preflight] Pulling images required for setting up a Kubernetes cluster

	[preflight] This might take a minute or two, depending on the speed of your internet connection

	[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'

	[certs] Using certificateDir folder "/var/lib/minikube/certs"

	[certs] Using existing ca certificate authority

	[certs] Using existing apiserver certificate and key on disk

	[certs] Using existing apiserver-kubelet-client certificate and key on disk

	[certs] Using existing front-proxy-ca certificate authority

	[certs] Using existing front-proxy-client certificate and key on disk

	[certs] Using existing etcd/ca certificate authority

	[certs] Using existing etcd/server certificate and key on disk

	[certs] Using existing etcd/peer certificate and key on disk

	[certs] Using existing etcd/healthcheck-client certificate and key on disk

	[certs] Using existing apiserver-etcd-client certificate and key on disk

	[certs] Using the existing "sa" key

	[kubeconfig] Using kubeconfig folder "/etc/kubernetes"

	[kubeconfig] Writing "admin.conf" kubeconfig file

	[kubeconfig] Writing "kubelet.conf" kubeconfig file

	[kubeconfig] Writing "controller-manager.conf" kubeconfig file

	[kubeconfig] Writing "scheduler.conf" kubeconfig file

	[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"

	[control-plane] Using manifest folder "/etc/kubernetes/manifests"

	[control-plane] Creating static Pod manifest for "kube-apiserver"

	[control-plane] Creating static Pod manifest for "kube-controller-manager"

	[control-plane] Creating static Pod manifest for "kube-scheduler"

	[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"

	[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"

	[kubelet-start] Starting the kubelet

	[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s

	[kubelet-check] Initial timeout of 40s passed.

	Unfortunately, an error has occurred:

		timed out waiting for the condition

	This error is likely caused by:

		- The kubelet is not running

		- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)

	If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:

		- 'systemctl status kubelet'

		- 'journalctl -xeu kubelet'

	Additionally, a control plane component may have crashed or exited when started by the container runtime.

	To troubleshoot, list all containers using your preferred container runtimes CLI.

	Here is one example how you may list all running Kubernetes containers by using crictl:

		- 'crictl --runtime-endpoint unix:///var/run/cri-dockerd.sock ps -a | grep kube | grep -v pause'

		Once you have found the failing container, you can inspect its logs with:

		- 'crictl --runtime-endpoint unix:///var/run/cri-dockerd.sock logs CONTAINERID'

	stderr:

		[WARNING Swap]: swap is enabled; production deployments should disable swap unless testing the NodeSwap feature gate of the kubelet

		[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'

	error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster

	To see the stack trace of this error execute with --v=5 or higher

	W1109 14:46:04.912632    1604 out.go:285] * 

	W1109 14:46:04.912632    1604 out.go:285] X Error starting cluster: wait: sudo /bin/bash -c "env PATH="/var/lib/minikube/binaries/v1.28.3:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables": Process exited with status 1

	stdout:

	[init] Using Kubernetes version: v1.28.3

	[preflight] Running pre-flight checks

	[preflight] Pulling images required for setting up a Kubernetes cluster

	[preflight] This might take a minute or two, depending on the speed of your internet connection

	[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'

	[certs] Using certificateDir folder "/var/lib/minikube/certs"

	[certs] Using existing ca certificate authority

	[certs] Using existing apiserver certificate and key on disk

	[certs] Using existing apiserver-kubelet-client certificate and key on disk

	[certs] Using existing front-proxy-ca certificate authority

	[certs] Using existing front-proxy-client certificate and key on disk

	[certs] Using existing etcd/ca certificate authority

	[certs] Using existing etcd/server certificate and key on disk

	[certs] Using existing etcd/peer certificate and key on disk

	[certs] Using existing etcd/healthcheck-client certificate and key on disk

	[certs] Using existing apiserver-etcd-client certificate and key on disk

	[certs] Using the existing "sa" key

	[kubeconfig] Using kubeconfig folder "/etc/kubernetes"

	[kubeconfig] Writing "admin.conf" kubeconfig file

	[kubeconfig] Writing "kubelet.conf" kubeconfig file

	[kubeconfig] Writing "controller-manager.conf" kubeconfig file

	[kubeconfig] Writing "scheduler.conf" kubeconfig file

	[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"

	[control-plane] Using manifest folder "/etc/kubernetes/manifests"

	[control-plane] Creating static Pod manifest for "kube-apiserver"

	[control-plane] Creating static Pod manifest for "kube-controller-manager"

	[control-plane] Creating static Pod manifest for "kube-scheduler"

	[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"

	[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"

	[kubelet-start] Starting the kubelet

	[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s

	[kubelet-check] Initial timeout of 40s passed.

	Unfortunately, an error has occurred:

		timed out waiting for the condition

	This error is likely caused by:

		- The kubelet is not running

		- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)

	If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:

		- 'systemctl status kubelet'

		- 'journalctl -xeu kubelet'

	Additionally, a control plane component may have crashed or exited when started by the container runtime.

	To troubleshoot, list all containers using your preferred container runtimes CLI.

	Here is one example how you may list all running Kubernetes containers by using crictl:

		- 'crictl --runtime-endpoint unix:///var/run/cri-dockerd.sock ps -a | grep kube | grep -v pause'

		Once you have found the failing container, you can inspect its logs with:

		- 'crictl --runtime-endpoint unix:///var/run/cri-dockerd.sock logs CONTAINERID'

	stderr:

		[WARNING Swap]: swap is enabled; production deployments should disable swap unless testing the NodeSwap feature gate of the kubelet

		[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'

	error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster

	To see the stack trace of this error execute with --v=5 or higher

	W1109 14:46:04.913628    1604 out.go:285] * 

	W1109 14:46:04.915628    1604 out.go:308] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	I1109 14:46:04.918630    1604 out.go:203] 

	W1109 14:46:04.922623    1604 out.go:285] X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: sudo /bin/bash -c "env PATH="/var/lib/minikube/binaries/v1.28.3:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables": Process exited with status 1

	stdout:

	[init] Using Kubernetes version: v1.28.3

	[preflight] Running pre-flight checks

	[preflight] Pulling images required for setting up a Kubernetes cluster

	[preflight] This might take a minute or two, depending on the speed of your internet connection

	[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'

	[certs] Using certificateDir folder "/var/lib/minikube/certs"

	[certs] Using existing ca certificate authority

	[certs] Using existing apiserver certificate and key on disk

	[certs] Using existing apiserver-kubelet-client certificate and key on disk

	[certs] Using existing front-proxy-ca certificate authority

	[certs] Using existing front-proxy-client certificate and key on disk

	[certs] Using existing etcd/ca certificate authority

	[certs] Using existing etcd/server certificate and key on disk

	[certs] Using existing etcd/peer certificate and key on disk

	[certs] Using existing etcd/healthcheck-client certificate and key on disk

	[certs] Using existing apiserver-etcd-client certificate and key on disk

	[certs] Using the existing "sa" key

	[kubeconfig] Using kubeconfig folder "/etc/kubernetes"

	[kubeconfig] Writing "admin.conf" kubeconfig file

	[kubeconfig] Writing "kubelet.conf" kubeconfig file

	[kubeconfig] Writing "controller-manager.conf" kubeconfig file

	[kubeconfig] Writing "scheduler.conf" kubeconfig file

	[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"

	[control-plane] Using manifest folder "/etc/kubernetes/manifests"

	[control-plane] Creating static Pod manifest for "kube-apiserver"

	[control-plane] Creating static Pod manifest for "kube-controller-manager"

	[control-plane] Creating static Pod manifest for "kube-scheduler"

	[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"

	[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"

	[kubelet-start] Starting the kubelet

	[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s

	[kubelet-check] Initial timeout of 40s passed.

	Unfortunately, an error has occurred:

		timed out waiting for the condition

	This error is likely caused by:

		- The kubelet is not running

		- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)

	If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:

		- 'systemctl status kubelet'

		- 'journalctl -xeu kubelet'

	Additionally, a control plane component may have crashed or exited when started by the container runtime.

	To troubleshoot, list all containers using your preferred container runtimes CLI.

	Here is one example how you may list all running Kubernetes containers by using crictl:

		- 'crictl --runtime-endpoint unix:///var/run/cri-dockerd.sock ps -a | grep kube | grep -v pause'

		Once you have found the failing container, you can inspect its logs with:

		- 'crictl --runtime-endpoint unix:///var/run/cri-dockerd.sock logs CONTAINERID'

	stderr:

		[WARNING Swap]: swap is enabled; production deployments should disable swap unless testing the NodeSwap feature gate of the kubelet

		[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'

	error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster

	To see the stack trace of this error execute with --v=5 or higher

	W1109 14:46:04.922623    1604 out.go:285] * Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start

	W1109 14:46:04.922623    1604 out.go:285] * Related issue: https://github.com/kubernetes/minikube/issues/4172

	I1109 14:46:04.925626    1604 out.go:203] 

	I1109 14:46:05.277644    7796 kubeadm.go:319] [init] Using Kubernetes version: v1.34.1

	I1109 14:46:05.277644    7796 kubeadm.go:319] [preflight] Running pre-flight checks

	I1109 14:46:05.278655    7796 kubeadm.go:319] [preflight] Pulling images required for setting up a Kubernetes cluster

	I1109 14:46:05.278655    7796 kubeadm.go:319] [preflight] This might take a minute or two, depending on the speed of your internet connection

	I1109 14:46:05.278655    7796 kubeadm.go:319] [preflight] You can also perform this action beforehand using 'kubeadm config images pull'

	I1109 14:46:05.278655    7796 kubeadm.go:319] [certs] Using certificateDir folder "/var/lib/minikube/certs"

	I1109 14:46:05.282643    7796 out.go:252]   - Generating certificates and keys ...

	I1109 14:46:05.282643    7796 kubeadm.go:319] [certs] Using existing ca certificate authority

	I1109 14:46:05.282643    7796 kubeadm.go:319] [certs] Using existing apiserver certificate and key on disk

	I1109 14:46:05.283661    7796 kubeadm.go:319] [certs] Generating "apiserver-kubelet-client" certificate and key

	I1109 14:46:05.283661    7796 kubeadm.go:319] [certs] Generating "front-proxy-ca" certificate and key

	I1109 14:46:05.283661    7796 kubeadm.go:319] [certs] Generating "front-proxy-client" certificate and key

	I1109 14:46:05.283661    7796 kubeadm.go:319] [certs] Generating "etcd/ca" certificate and key

	I1109 14:46:05.283661    7796 kubeadm.go:319] [certs] Generating "etcd/server" certificate and key

	I1109 14:46:05.283661    7796 kubeadm.go:319] [certs] etcd/server serving cert is signed for DNS names [false-643800 localhost] and IPs [192.168.85.2 127.0.0.1 ::1]

	I1109 14:46:05.283661    7796 kubeadm.go:319] [certs] Generating "etcd/peer" certificate and key

	I1109 14:46:05.284652    7796 kubeadm.go:319] [certs] etcd/peer serving cert is signed for DNS names [false-643800 localhost] and IPs [192.168.85.2 127.0.0.1 ::1]

	I1109 14:46:05.284652    7796 kubeadm.go:319] [certs] Generating "etcd/healthcheck-client" certificate and key

	I1109 14:46:05.284652    7796 kubeadm.go:319] [certs] Generating "apiserver-etcd-client" certificate and key

	I1109 14:46:05.284652    7796 kubeadm.go:319] [certs] Generating "sa" key and public key

	I1109 14:46:05.284652    7796 kubeadm.go:319] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"

	I1109 14:46:05.285655    7796 kubeadm.go:319] [kubeconfig] Writing "admin.conf" kubeconfig file

	I1109 14:46:05.285655    7796 kubeadm.go:319] [kubeconfig] Writing "super-admin.conf" kubeconfig file

	I1109 14:46:05.285655    7796 kubeadm.go:319] [kubeconfig] Writing "kubelet.conf" kubeconfig file

	I1109 14:46:05.285655    7796 kubeadm.go:319] [kubeconfig] Writing "controller-manager.conf" kubeconfig file

	I1109 14:46:05.285655    7796 kubeadm.go:319] [kubeconfig] Writing "scheduler.conf" kubeconfig file

	I1109 14:46:05.285655    7796 kubeadm.go:319] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"

	I1109 14:46:05.286669    7796 kubeadm.go:319] [control-plane] Using manifest folder "/etc/kubernetes/manifests"

	I1109 14:46:05.288645    7796 out.go:252]   - Booting up control plane ...

	I1109 14:46:05.288645    7796 kubeadm.go:319] [control-plane] Creating static Pod manifest for "kube-apiserver"

	I1109 14:46:05.289644    7796 kubeadm.go:319] [control-plane] Creating static Pod manifest for "kube-controller-manager"

	I1109 14:46:05.289644    7796 kubeadm.go:319] [control-plane] Creating static Pod manifest for "kube-scheduler"

	I1109 14:46:05.289644    7796 kubeadm.go:319] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"

	I1109 14:46:05.289644    7796 kubeadm.go:319] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/instance-config.yaml"

	I1109 14:46:05.290653    7796 kubeadm.go:319] [patches] Applied patch of type "application/strategic-merge-patch+json" to target "kubeletconfiguration"

	I1109 14:46:05.290653    7796 kubeadm.go:319] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"

	I1109 14:46:05.290653    7796 kubeadm.go:319] [kubelet-start] Starting the kubelet

	I1109 14:46:05.290653    7796 kubeadm.go:319] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests"

	I1109 14:46:05.291661    7796 kubeadm.go:319] [kubelet-check] Waiting for a healthy kubelet at http://127.0.0.1:10248/healthz. This can take up to 4m0s

	I1109 14:46:05.291661    7796 kubeadm.go:319] [kubelet-check] The kubelet is healthy after 501.533654ms

	I1109 14:46:05.291661    7796 kubeadm.go:319] [control-plane-check] Waiting for healthy control plane components. This can take up to 4m0s

	I1109 14:46:05.291661    7796 kubeadm.go:319] [control-plane-check] Checking kube-apiserver at https://192.168.85.2:8443/livez

	I1109 14:46:05.291661    7796 kubeadm.go:319] [control-plane-check] Checking kube-controller-manager at https://127.0.0.1:10257/healthz

	I1109 14:46:05.291661    7796 kubeadm.go:319] [control-plane-check] Checking kube-scheduler at https://127.0.0.1:10259/livez

	I1109 14:46:05.292653    7796 kubeadm.go:319] [control-plane-check] kube-controller-manager is healthy after 4.989090123s

	I1109 14:46:05.292653    7796 kubeadm.go:319] [control-plane-check] kube-scheduler is healthy after 5.871204189s

	I1109 14:46:05.292653    7796 kubeadm.go:319] [control-plane-check] kube-apiserver is healthy after 8.503121032s

	I1109 14:46:05.292653    7796 kubeadm.go:319] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace

	I1109 14:46:05.292653    7796 kubeadm.go:319] [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster

	I1109 14:46:05.293660    7796 kubeadm.go:319] [upload-certs] Skipping phase. Please see --upload-certs

	I1109 14:46:05.293660    7796 kubeadm.go:319] [mark-control-plane] Marking the node false-643800 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]

	I1109 14:46:05.293660    7796 kubeadm.go:319] [bootstrap-token] Using token: xp31p4.camip6q89795tf2s

	I1109 14:46:05.296645    7796 out.go:252]   - Configuring RBAC rules ...

	I1109 14:46:05.296645    7796 kubeadm.go:319] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles

	I1109 14:46:05.296645    7796 kubeadm.go:319] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes

	I1109 14:46:05.296645    7796 kubeadm.go:319] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials

	I1109 14:46:05.297646    7796 kubeadm.go:319] [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token

	I1109 14:46:05.297646    7796 kubeadm.go:319] [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster

	I1109 14:46:05.297646    7796 kubeadm.go:319] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace

	I1109 14:46:05.297646    7796 kubeadm.go:319] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key

	I1109 14:46:05.298649    7796 kubeadm.go:319] [addons] Applied essential addon: CoreDNS

	I1109 14:46:05.298649    7796 kubeadm.go:319] [addons] Applied essential addon: kube-proxy

	I1109 14:46:05.298649    7796 kubeadm.go:319] 

	I1109 14:46:05.298649    7796 kubeadm.go:319] Your Kubernetes control-plane has initialized successfully!

	I1109 14:46:05.298649    7796 kubeadm.go:319] 

	I1109 14:46:05.298649    7796 kubeadm.go:319] To start using your cluster, you need to run the following as a regular user:

	I1109 14:46:05.298649    7796 kubeadm.go:319] 

	I1109 14:46:05.298649    7796 kubeadm.go:319]   mkdir -p $HOME/.kube

	I1109 14:46:05.298649    7796 kubeadm.go:319]   sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config

	I1109 14:46:05.298649    7796 kubeadm.go:319]   sudo chown $(id -u):$(id -g) $HOME/.kube/config

	I1109 14:46:05.298649    7796 kubeadm.go:319] 

	I1109 14:46:05.298649    7796 kubeadm.go:319] Alternatively, if you are the root user, you can run:

	I1109 14:46:05.299655    7796 kubeadm.go:319] 

	I1109 14:46:05.299655    7796 kubeadm.go:319]   export KUBECONFIG=/etc/kubernetes/admin.conf

	I1109 14:46:05.299655    7796 kubeadm.go:319] 

	I1109 14:46:05.299655    7796 kubeadm.go:319] You should now deploy a pod network to the cluster.

	I1109 14:46:05.299655    7796 kubeadm.go:319] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:

	I1109 14:46:05.299655    7796 kubeadm.go:319]   https://kubernetes.io/docs/concepts/cluster-administration/addons/

	I1109 14:46:05.299655    7796 kubeadm.go:319] 

	I1109 14:46:05.299655    7796 kubeadm.go:319] You can now join any number of control-plane nodes by copying certificate authorities

	I1109 14:46:05.299655    7796 kubeadm.go:319] and service account keys on each node and then running the following as root:

	I1109 14:46:05.300649    7796 kubeadm.go:319] 

	I1109 14:46:05.300649    7796 kubeadm.go:319]   kubeadm join control-plane.minikube.internal:8443 --token xp31p4.camip6q89795tf2s \

	I1109 14:46:05.300649    7796 kubeadm.go:319] 	--discovery-token-ca-cert-hash sha256:b30bf296f8ba4330d46a1aea8c13c780c9c73ecf70f88e144a6185b969bbb8f0 \

	I1109 14:46:05.300649    7796 kubeadm.go:319] 	--control-plane 

	I1109 14:46:05.300649    7796 kubeadm.go:319] 

	I1109 14:46:05.300649    7796 kubeadm.go:319] Then you can join any number of worker nodes by running the following on each as root:

	I1109 14:46:05.300649    7796 kubeadm.go:319] 

	I1109 14:46:05.300649    7796 kubeadm.go:319] kubeadm join control-plane.minikube.internal:8443 --token xp31p4.camip6q89795tf2s \

	I1109 14:46:05.301651    7796 kubeadm.go:319] 	--discovery-token-ca-cert-hash sha256:b30bf296f8ba4330d46a1aea8c13c780c9c73ecf70f88e144a6185b969bbb8f0 

	I1109 14:46:05.301651    7796 cni.go:84] Creating CNI manager for "false"

	I1109 14:46:05.301651    7796 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"

	I1109 14:46:05.313647    7796 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.1/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig

	I1109 14:46:05.313647    7796 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes false-643800 minikube.k8s.io/updated_at=2025_11_09T14_46_05_0700 minikube.k8s.io/version=v1.37.0 minikube.k8s.io/commit=70e94ed289d7418ac27e2778f9cf44be27a4ecda minikube.k8s.io/name=false-643800 minikube.k8s.io/primary=true

	I1109 14:46:05.372649    7796 ops.go:34] apiserver oom_adj: -16

	I1109 14:46:05.603658    7796 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1109 14:46:06.104202    7796 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1109 14:46:06.601099    7796 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	==> Docker <==

	Nov 09 14:41:38 missing-upgrade-184300 cri-dockerd[1353]: time="2025-11-09T14:41:38Z" level=error msg="Failed to delete corrupt checkpoint for sandbox URL=\"unix:///var/run/cri-dockerd.sock\": invalid key: \"URL=\\\"unix:///var/run/cri-dockerd.sock\\\"\""

	Nov 09 14:41:38 missing-upgrade-184300 dockerd[1140]: time="2025-11-09T14:41:38.771667345Z" level=info msg="ignoring event" container=f921044bc4010d5fe16edc35ef66be141dc2293f65c608e6514e5acd3f0b8527 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Nov 09 14:41:38 missing-upgrade-184300 dockerd[1140]: time="2025-11-09T14:41:38.949469531Z" level=info msg="ignoring event" container=6b2fd824fc88a31873f7cd3e89ce48c037090f6de1ff0345c3cc16dafae87e79 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Nov 09 14:41:39 missing-upgrade-184300 dockerd[1140]: time="2025-11-09T14:41:39.163411167Z" level=info msg="ignoring event" container=1e78b95e06ed73fbf0d0d707eae246bbde954b4345003f339d3f8b7c1750aa10 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Nov 09 14:41:39 missing-upgrade-184300 dockerd[1140]: time="2025-11-09T14:41:39.459691305Z" level=info msg="ignoring event" container=0476bfacf6cdc5d2baf993c73e32c9a3e7db783f8517fd032df776132bbf84af module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Nov 09 14:41:39 missing-upgrade-184300 dockerd[1140]: time="2025-11-09T14:41:39.717092748Z" level=info msg="ignoring event" container=d5ca9e6c80af12d82c437a93c4bd31f11c3469c8950210f69ae83bed858bf14f module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Nov 09 14:41:39 missing-upgrade-184300 dockerd[1140]: time="2025-11-09T14:41:39.915965128Z" level=info msg="ignoring event" container=89e8f2b5d716a421cd62e65b95aa282b8f84dfb8844cfe4207df478605a0da09 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Nov 09 14:41:40 missing-upgrade-184300 dockerd[1140]: time="2025-11-09T14:41:40.152486094Z" level=info msg="ignoring event" container=d79455747d8a19dc6da0626ee30f2dcf932d63a0acdb08b2fe965b913cf96776 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Nov 09 14:41:44 missing-upgrade-184300 cri-dockerd[1353]: time="2025-11-09T14:41:44Z" level=info msg="Will attempt to re-write config file /var/lib/docker/containers/d8d25543ddd9d0aa9e987975d90f6de9cd30980c9056e97e4b056f9dec43013c/resolv.conf as [nameserver 192.168.65.254 options ndots:0]"

	Nov 09 14:41:44 missing-upgrade-184300 cri-dockerd[1353]: time="2025-11-09T14:41:44Z" level=info msg="Will attempt to re-write config file /var/lib/docker/containers/a1867156088b23b7bbe0f82c7b80c04eac8afae67857bc48201177c805072946/resolv.conf as [nameserver 192.168.65.254 options ndots:0]"

	Nov 09 14:41:44 missing-upgrade-184300 cri-dockerd[1353]: time="2025-11-09T14:41:44Z" level=info msg="Will attempt to re-write config file /var/lib/docker/containers/a96bdc6b42e9bbf3b66b865218a9c1a1d2dae542344613604b0de9fa3f92ffb3/resolv.conf as [nameserver 192.168.65.254 options ndots:0]"

	Nov 09 14:41:44 missing-upgrade-184300 cri-dockerd[1353]: time="2025-11-09T14:41:44Z" level=info msg="Will attempt to re-write config file /var/lib/docker/containers/e4a11dc8e78ec2a2bdb41920e55b3605740b2148a40c7fb67854adf06be1cc0b/resolv.conf as [nameserver 192.168.65.254 options ndots:0]"

	Nov 09 14:41:45 missing-upgrade-184300 dockerd[1140]: time="2025-11-09T14:41:45.107943896Z" level=info msg="ignoring event" container=1dc6fce7f9f507638a3b690b8c58a7600570a6a4814846de1548ce095788aa60 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Nov 09 14:41:46 missing-upgrade-184300 dockerd[1140]: time="2025-11-09T14:41:46.494158291Z" level=info msg="ignoring event" container=2dfc8dd95bca3885829c0c09ae55deddd9c7f21f4bbd241f0709c0438fa56b56 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Nov 09 14:42:06 missing-upgrade-184300 dockerd[1140]: time="2025-11-09T14:42:06.414534232Z" level=info msg="ignoring event" container=1ebe6fb9d6d3f7fbd5c4b1b55ea82cc08ae90fa9efa2e720b80f0f8972c032c4 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Nov 09 14:42:09 missing-upgrade-184300 dockerd[1140]: time="2025-11-09T14:42:09.591632197Z" level=info msg="ignoring event" container=d92aecfb5f8005415daff876285531b10a4fa74249a7da4fc4f9837220269fb0 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Nov 09 14:42:27 missing-upgrade-184300 dockerd[1140]: time="2025-11-09T14:42:27.969440856Z" level=info msg="ignoring event" container=2976784a85cfb383a2f8aa69479fb911034bba68efce5c1e3b5d3da75a8a9f50 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Nov 09 14:42:30 missing-upgrade-184300 dockerd[1140]: time="2025-11-09T14:42:30.411044334Z" level=info msg="ignoring event" container=dc2d7a7e48210f29796d42d8431933c48173027f7803e74ecea64b67c835482c module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Nov 09 14:43:09 missing-upgrade-184300 dockerd[1140]: time="2025-11-09T14:43:09.294705767Z" level=info msg="ignoring event" container=7b2d56b7c84d0320467d94ba4b42ebb12bae060f3b7812d3439b32235d06395b module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Nov 09 14:43:16 missing-upgrade-184300 dockerd[1140]: time="2025-11-09T14:43:16.916196993Z" level=info msg="ignoring event" container=5f98a31873550dd1da7adb63661e37a78c16b8cbe7ef8728979c0a02b282d7e8 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Nov 09 14:43:21 missing-upgrade-184300 dockerd[1140]: time="2025-11-09T14:43:21.226086907Z" level=info msg="ignoring event" container=48a7544676173e4947f9eedd92fb989a060985bfb1c5698d9f6a8cfb45261ab1 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Nov 09 14:44:01 missing-upgrade-184300 dockerd[1140]: time="2025-11-09T14:44:01.295171552Z" level=info msg="ignoring event" container=511037d1617cb967088aa3cf086fb99d90ae8ef3a41dc8ebee98cbdba48ce3e6 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Nov 09 14:44:42 missing-upgrade-184300 dockerd[1140]: time="2025-11-09T14:44:42.667589938Z" level=info msg="ignoring event" container=df0342a399cd6c5cdae1627914dd8cfa5c439d038612bfd86863d8be51c874e9 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Nov 09 14:44:49 missing-upgrade-184300 dockerd[1140]: time="2025-11-09T14:44:49.461678649Z" level=info msg="ignoring event" container=6c1d6990ec9a17213a491b9b31dc6b7a0c15a7cd579cd9b12f9b4eb7b925d0fc module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Nov 09 14:45:03 missing-upgrade-184300 dockerd[1140]: time="2025-11-09T14:45:03.833101996Z" level=info msg="ignoring event" container=f159ce501abc24427240ea30e47c614499580593ebea41b7479437ced5f19334 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	==> container status <==

	CONTAINER           IMAGE               CREATED              STATE               NAME                      ATTEMPT             POD ID              POD

	bd1e895dfe296       10baa1ca17068       About a minute ago   Running             kube-controller-manager   2                   a96bdc6b42e9b       kube-controller-manager-missing-upgrade-184300

	6c1d6990ec9a1       73deb9a3f7025       About a minute ago   Exited              etcd                      5                   a1867156088b2       etcd-missing-upgrade-184300

	f159ce501abc2       5374347291230       About a minute ago   Exited              kube-apiserver            4                   e4a11dc8e78ec       kube-apiserver-missing-upgrade-184300

	df0342a399cd6       10baa1ca17068       2 minutes ago        Exited              kube-controller-manager   1                   a96bdc6b42e9b       kube-controller-manager-missing-upgrade-184300

	9916a784d53cc       6d1b4fd1b182d       4 minutes ago        Running             kube-scheduler            0                   d8d25543ddd9d       kube-scheduler-missing-upgrade-184300

	==> describe nodes <==

	command /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" failed with error: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1

	stdout:

	stderr:

	E1109 14:46:09.686811   22414 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:46:09.687905   22414 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:46:09.689296   22414 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:46:09.690336   22414 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	E1109 14:46:09.690960   22414 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp [::1]:8443: connect: connection refused

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	==> dmesg <==

	[  +4.336134] tmpfs: Unknown parameter 'noswap'

	[  +4.379121] tmpfs: Unknown parameter 'noswap'

	[Nov 9 14:39] tmpfs: Unknown parameter 'noswap'

	[ +11.186367] tmpfs: Unknown parameter 'noswap'

	[Nov 9 14:40] tmpfs: Unknown parameter 'noswap'

	[  +9.212943] tmpfs: Unknown parameter 'noswap'

	[  +0.314873] tmpfs: Unknown parameter 'noswap'

	[Nov 9 14:41] tmpfs: Unknown parameter 'noswap'

	[ +20.758128] tmpfs: Unknown parameter 'noswap'

	[ +13.064022] tmpfs: Unknown parameter 'noswap'

	[ +12.755825] tmpfs: Unknown parameter 'noswap'

	[  +5.840615] tmpfs: Unknown parameter 'noswap'

	[  +3.084438] tmpfs: Unknown parameter 'noswap'

	[Nov 9 14:42] tmpfs: Unknown parameter 'noswap'

	[ +17.931690] tmpfs: Unknown parameter 'noswap'

	[ +24.532962] tmpfs: Unknown parameter 'noswap'

	[Nov 9 14:43] tmpfs: Unknown parameter 'noswap'

	[ +11.168491] tmpfs: Unknown parameter 'noswap'

	[ +17.839289] tmpfs: Unknown parameter 'noswap'

	[  +9.257633] tmpfs: Unknown parameter 'noswap'

	[  +2.228696] tmpfs: Unknown parameter 'noswap'

	[Nov 9 14:44] tmpfs: Unknown parameter 'noswap'

	[Nov 9 14:45] tmpfs: Unknown parameter 'noswap'

	[Nov 9 14:46] tmpfs: Unknown parameter 'noswap'

	[  +3.023154] tmpfs: Unknown parameter 'noswap'

	==> etcd [6c1d6990ec9a] <==

	{"level":"warn","ts":"2025-11-09T14:44:49.444674Z","caller":"embed/config.go:673","msg":"Running http and grpc server on single port. This is not recommended for production."}

	{"level":"info","ts":"2025-11-09T14:44:49.444837Z","caller":"etcdmain/etcd.go:73","msg":"Running: ","args":["etcd","--advertise-client-urls=https://192.168.103.2:2379","--cert-file=/var/lib/minikube/certs/etcd/server.crt","--client-cert-auth=true","--data-dir=/var/lib/minikube/etcd","--experimental-initial-corrupt-check=true","--experimental-watch-progress-notify-interval=5s","--initial-advertise-peer-urls=https://192.168.103.2:2380","--initial-cluster=missing-upgrade-184300=https://192.168.103.2:2380","--key-file=/var/lib/minikube/certs/etcd/server.key","--listen-client-urls=https://127.0.0.1:2379,https://192.168.103.2:2379","--listen-metrics-urls=http://127.0.0.1:2381","--listen-peer-urls=https://192.168.103.2:2380","--name=missing-upgrade-184300","--peer-cert-file=/var/lib/minikube/certs/etcd/peer.crt","--peer-client-cert-auth=true","--peer-key-file=/var/lib/minikube/certs/etcd/peer.key","--peer-trusted-ca-file=/var/lib/minikube/certs/etcd/ca.crt","--proxy-refresh-interval=70000","--snapshot-count

=10000","--trusted-ca-file=/var/lib/minikube/certs/etcd/ca.crt"]}

	{"level":"warn","ts":"2025-11-09T14:44:49.4449Z","caller":"embed/config.go:673","msg":"Running http and grpc server on single port. This is not recommended for production."}

	{"level":"info","ts":"2025-11-09T14:44:49.44491Z","caller":"embed/etcd.go:127","msg":"configuring peer listeners","listen-peer-urls":["https://192.168.103.2:2380"]}

	{"level":"info","ts":"2025-11-09T14:44:49.444948Z","caller":"embed/etcd.go:495","msg":"starting with peer TLS","tls-info":"cert = /var/lib/minikube/certs/etcd/peer.crt, key = /var/lib/minikube/certs/etcd/peer.key, client-cert=, client-key=, trusted-ca = /var/lib/minikube/certs/etcd/ca.crt, client-cert-auth = true, crl-file = ","cipher-suites":[]}

	{"level":"info","ts":"2025-11-09T14:44:49.445105Z","caller":"embed/etcd.go:376","msg":"closing etcd server","name":"missing-upgrade-184300","data-dir":"/var/lib/minikube/etcd","advertise-peer-urls":["https://192.168.103.2:2380"],"advertise-client-urls":["https://192.168.103.2:2379"]}

	{"level":"info","ts":"2025-11-09T14:44:49.445187Z","caller":"embed/etcd.go:378","msg":"closed etcd server","name":"missing-upgrade-184300","data-dir":"/var/lib/minikube/etcd","advertise-peer-urls":["https://192.168.103.2:2380"],"advertise-client-urls":["https://192.168.103.2:2379"]}

	{"level":"warn","ts":"2025-11-09T14:44:49.445204Z","caller":"etcdmain/etcd.go:146","msg":"failed to start etcd","error":"listen tcp 192.168.103.2:2380: bind: cannot assign requested address"}

	{"level":"fatal","ts":"2025-11-09T14:44:49.445224Z","caller":"etcdmain/etcd.go:204","msg":"discovery failed","error":"listen tcp 192.168.103.2:2380: bind: cannot assign requested address","stacktrace":"go.etcd.io/etcd/server/v3/etcdmain.startEtcdOrProxyV2\n\tgo.etcd.io/etcd/server/v3/etcdmain/etcd.go:204\ngo.etcd.io/etcd/server/v3/etcdmain.Main\n\tgo.etcd.io/etcd/server/v3/etcdmain/main.go:40\nmain.main\n\tgo.etcd.io/etcd/server/v3/main.go:31\nruntime.main\n\truntime/proc.go:250"}

	==> kernel <==

	 14:46:09 up  1:31,  0 users,  load average: 7.31, 6.40, 4.69

	Linux missing-upgrade-184300 5.15.153.1-microsoft-standard-WSL2 #1 SMP Fri Mar 29 23:14:13 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux

	PRETTY_NAME="Ubuntu 22.04.3 LTS"

	==> kube-apiserver [f159ce501abc] <==

	W1109 14:44:58.464345       1 logging.go:59] [core] [Channel #2 SubChannel #4] grpc: addrConn.createTransport failed to connect to {

	  "Addr": "127.0.0.1:2379",

	  "ServerName": "127.0.0.1",

	  "Attributes": null,

	  "BalancerAttributes": null,

	  "Type": 0,

	  "Metadata": null

	}. Err: connection error: desc = "transport: Error while dialing: dial tcp 127.0.0.1:2379: connect: connection refused"

	W1109 14:44:59.130395       1 logging.go:59] [core] [Channel #5 SubChannel #6] grpc: addrConn.createTransport failed to connect to {

	  "Addr": "127.0.0.1:2379",

	  "ServerName": "127.0.0.1",

	  "Attributes": null,

	  "BalancerAttributes": null,

	  "Type": 0,

	  "Metadata": null

	}. Err: connection error: desc = "transport: Error while dialing: dial tcp 127.0.0.1:2379: connect: connection refused"

	W1109 14:45:01.601014       1 logging.go:59] [core] [Channel #1 SubChannel #3] grpc: addrConn.createTransport failed to connect to {

	  "Addr": "127.0.0.1:2379",

	  "ServerName": "127.0.0.1",

	  "Attributes": null,

	  "BalancerAttributes": null,

	  "Type": 0,

	  "Metadata": null

	}. Err: connection error: desc = "transport: Error while dialing: dial tcp 127.0.0.1:2379: connect: connection refused"

	F1109 14:45:03.809945       1 instance.go:291] Error creating leases: error creating storage factory: context deadline exceeded

	==> kube-controller-manager [bd1e895dfe29] <==

	I1109 14:45:05.620000       1 serving.go:348] Generated self-signed cert in-memory

	I1109 14:45:05.924434       1 controllermanager.go:189] "Starting" version="v1.28.3"

	I1109 14:45:05.925083       1 controllermanager.go:191] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""

	I1109 14:45:05.928186       1 dynamic_cafile_content.go:157] "Starting controller" name="request-header::/var/lib/minikube/certs/front-proxy-ca.crt"

	I1109 14:45:05.928533       1 dynamic_cafile_content.go:157] "Starting controller" name="client-ca-bundle::/var/lib/minikube/certs/ca.crt"

	I1109 14:45:05.929163       1 secure_serving.go:213] Serving securely on 127.0.0.1:10257

	I1109 14:45:05.929376       1 tlsconfig.go:240] "Starting DynamicServingCertificateController"

	==> kube-controller-manager [df0342a399cd] <==

	I1109 14:43:11.332470       1 serving.go:348] Generated self-signed cert in-memory

	I1109 14:43:11.591792       1 controllermanager.go:189] "Starting" version="v1.28.3"

	I1109 14:43:11.591872       1 controllermanager.go:191] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""

	I1109 14:43:11.593517       1 dynamic_cafile_content.go:157] "Starting controller" name="request-header::/var/lib/minikube/certs/front-proxy-ca.crt"

	I1109 14:43:11.593716       1 dynamic_cafile_content.go:157] "Starting controller" name="client-ca-bundle::/var/lib/minikube/certs/ca.crt"

	I1109 14:43:11.594301       1 secure_serving.go:213] Serving securely on 127.0.0.1:10257

	I1109 14:43:11.594521       1 tlsconfig.go:240] "Starting DynamicServingCertificateController"

	E1109 14:44:42.591859       1 controllermanager.go:235] "Error building controller context" err="failed to wait for apiserver being healthy: timed out waiting for the condition: failed to get apiserver /healthz status: Get \"https://192.168.103.2:8443/healthz\": dial tcp 192.168.103.2:8443: i/o timeout"

	==> kube-scheduler [9916a784d53c] <==

	W1109 14:45:29.325787       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Service: Get "https://192.168.103.2:8443/api/v1/services?limit=500&resourceVersion=0": dial tcp 192.168.103.2:8443: i/o timeout

	I1109 14:45:29.325969       1 trace.go:236] Trace[1904761224]: "Reflector ListAndWatch" name:vendor/k8s.io/client-go/informers/factory.go:150 (09-Nov-2025 14:44:59.325) (total time: 30001ms):

	Trace[1904761224]: ---"Objects listed" error:Get "https://192.168.103.2:8443/api/v1/services?limit=500&resourceVersion=0": dial tcp 192.168.103.2:8443: i/o timeout 30001ms (14:45:29.325)

	Trace[1904761224]: [30.00147196s] [30.00147196s] END

	E1109 14:45:29.325996       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Service: failed to list *v1.Service: Get "https://192.168.103.2:8443/api/v1/services?limit=500&resourceVersion=0": dial tcp 192.168.103.2:8443: i/o timeout

	W1109 14:45:30.147196       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.StorageClass: Get "https://192.168.103.2:8443/apis/storage.k8s.io/v1/storageclasses?limit=500&resourceVersion=0": dial tcp 192.168.103.2:8443: i/o timeout

	I1109 14:45:30.147324       1 trace.go:236] Trace[767725962]: "Reflector ListAndWatch" name:vendor/k8s.io/client-go/informers/factory.go:150 (09-Nov-2025 14:45:00.146) (total time: 30002ms):

	Trace[767725962]: ---"Objects listed" error:Get "https://192.168.103.2:8443/apis/storage.k8s.io/v1/storageclasses?limit=500&resourceVersion=0": dial tcp 192.168.103.2:8443: i/o timeout 30002ms (14:45:30.147)

	Trace[767725962]: [30.002152182s] [30.002152182s] END

	E1109 14:45:30.147344       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: Get "https://192.168.103.2:8443/apis/storage.k8s.io/v1/storageclasses?limit=500&resourceVersion=0": dial tcp 192.168.103.2:8443: i/o timeout

	W1109 14:45:30.819838       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.CSIDriver: Get "https://192.168.103.2:8443/apis/storage.k8s.io/v1/csidrivers?limit=500&resourceVersion=0": dial tcp 192.168.103.2:8443: i/o timeout

	I1109 14:45:30.819939       1 trace.go:236] Trace[494100178]: "Reflector ListAndWatch" name:vendor/k8s.io/client-go/informers/factory.go:150 (09-Nov-2025 14:45:00.820) (total time: 30000ms):

	Trace[494100178]: ---"Objects listed" error:Get "https://192.168.103.2:8443/apis/storage.k8s.io/v1/csidrivers?limit=500&resourceVersion=0": dial tcp 192.168.103.2:8443: i/o timeout 30000ms (14:45:30.819)

	Trace[494100178]: [30.000775598s] [30.000775598s] END

	E1109 14:45:30.819958       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: Get "https://192.168.103.2:8443/apis/storage.k8s.io/v1/csidrivers?limit=500&resourceVersion=0": dial tcp 192.168.103.2:8443: i/o timeout

	W1109 14:46:06.529642       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Namespace: Get "https://192.168.103.2:8443/api/v1/namespaces?limit=500&resourceVersion=0": dial tcp 192.168.103.2:8443: i/o timeout

	I1109 14:46:06.529758       1 trace.go:236] Trace[1195742103]: "Reflector ListAndWatch" name:vendor/k8s.io/client-go/informers/factory.go:150 (09-Nov-2025 14:45:36.530) (total time: 30001ms):

	Trace[1195742103]: ---"Objects listed" error:Get "https://192.168.103.2:8443/api/v1/namespaces?limit=500&resourceVersion=0": dial tcp 192.168.103.2:8443: i/o timeout 30001ms (14:46:06.529)

	Trace[1195742103]: [30.001154593s] [30.001154593s] END

	E1109 14:46:06.529809       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Namespace: failed to list *v1.Namespace: Get "https://192.168.103.2:8443/api/v1/namespaces?limit=500&resourceVersion=0": dial tcp 192.168.103.2:8443: i/o timeout

	W1109 14:46:09.698695       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.PodDisruptionBudget: Get "https://192.168.103.2:8443/apis/policy/v1/poddisruptionbudgets?limit=500&resourceVersion=0": dial tcp 192.168.103.2:8443: i/o timeout

	I1109 14:46:09.698864       1 trace.go:236] Trace[850138191]: "Reflector ListAndWatch" name:vendor/k8s.io/client-go/informers/factory.go:150 (09-Nov-2025 14:45:39.699) (total time: 30001ms):

	Trace[850138191]: ---"Objects listed" error:Get "https://192.168.103.2:8443/apis/policy/v1/poddisruptionbudgets?limit=500&resourceVersion=0": dial tcp 192.168.103.2:8443: i/o timeout 30001ms (14:46:09.698)

	Trace[850138191]: [30.001166504s] [30.001166504s] END

	E1109 14:46:09.699131       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.PodDisruptionBudget: failed to list *v1.PodDisruptionBudget: Get "https://192.168.103.2:8443/apis/policy/v1/poddisruptionbudgets?limit=500&resourceVersion=0": dial tcp 192.168.103.2:8443: i/o timeout

	==> kubelet <==

	Nov 09 14:45:43 missing-upgrade-184300 kubelet[19241]: E1109 14:45:43.305414   19241 eviction_manager.go:258] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"missing-upgrade-184300\" not found"

	Nov 09 14:45:47 missing-upgrade-184300 kubelet[19241]: E1109 14:45:47.102804   19241 kubelet_node_status.go:701] "Failed to set some node status fields" err="failed to validate nodeIP: node IP: \"192.168.103.2\" not found in the host's network interfaces" node="missing-upgrade-184300"

	Nov 09 14:45:47 missing-upgrade-184300 kubelet[19241]: I1109 14:45:47.116769   19241 scope.go:117] "RemoveContainer" containerID="6c1d6990ec9a17213a491b9b31dc6b7a0c15a7cd579cd9b12f9b4eb7b925d0fc"

	Nov 09 14:45:47 missing-upgrade-184300 kubelet[19241]: E1109 14:45:47.117588   19241 pod_workers.go:1300] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"etcd\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=etcd pod=etcd-missing-upgrade-184300_kube-system(abab79edb87c1fccd3ab8e9e9b238817)\"" pod="kube-system/etcd-missing-upgrade-184300" podUID="abab79edb87c1fccd3ab8e9e9b238817"

	Nov 09 14:45:53 missing-upgrade-184300 kubelet[19241]: E1109 14:45:53.305717   19241 eviction_manager.go:258] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"missing-upgrade-184300\" not found"

	Nov 09 14:45:54 missing-upgrade-184300 kubelet[19241]: E1109 14:45:54.080847   19241 kubelet_node_status.go:92] "Unable to register node with API server" err="Post \"https://control-plane.minikube.internal:8443/api/v1/nodes\": dial tcp 192.168.103.2:8443: i/o timeout" node="missing-upgrade-184300"

	Nov 09 14:45:55 missing-upgrade-184300 kubelet[19241]: E1109 14:45:55.103357   19241 kubelet_node_status.go:701] "Failed to set some node status fields" err="failed to validate nodeIP: node IP: \"192.168.103.2\" not found in the host's network interfaces" node="missing-upgrade-184300"

	Nov 09 14:45:55 missing-upgrade-184300 kubelet[19241]: I1109 14:45:55.115074   19241 scope.go:117] "RemoveContainer" containerID="f159ce501abc24427240ea30e47c614499580593ebea41b7479437ced5f19334"

	Nov 09 14:45:55 missing-upgrade-184300 kubelet[19241]: E1109 14:45:55.115976   19241 pod_workers.go:1300] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-apiserver\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=kube-apiserver pod=kube-apiserver-missing-upgrade-184300_kube-system(37e4e85aab00465017c31e2a0d667cdc)\"" pod="kube-system/kube-apiserver-missing-upgrade-184300" podUID="37e4e85aab00465017c31e2a0d667cdc"

	Nov 09 14:45:55 missing-upgrade-184300 kubelet[19241]: E1109 14:45:55.710075   19241 controller.go:146] "Failed to ensure lease exists, will retry" err="Get \"https://control-plane.minikube.internal:8443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/missing-upgrade-184300?timeout=10s\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" interval="7s"

	Nov 09 14:46:01 missing-upgrade-184300 kubelet[19241]: E1109 14:46:01.081770   19241 kubelet_node_status.go:701] "Failed to set some node status fields" err="failed to validate nodeIP: node IP: \"192.168.103.2\" not found in the host's network interfaces" node="missing-upgrade-184300"

	Nov 09 14:46:01 missing-upgrade-184300 kubelet[19241]: I1109 14:46:01.095771   19241 kubelet_node_status.go:70] "Attempting to register node" node="missing-upgrade-184300"

	Nov 09 14:46:01 missing-upgrade-184300 kubelet[19241]: E1109 14:46:01.102958   19241 kubelet_node_status.go:701] "Failed to set some node status fields" err="failed to validate nodeIP: node IP: \"192.168.103.2\" not found in the host's network interfaces" node="missing-upgrade-184300"

	Nov 09 14:46:01 missing-upgrade-184300 kubelet[19241]: I1109 14:46:01.114736   19241 scope.go:117] "RemoveContainer" containerID="6c1d6990ec9a17213a491b9b31dc6b7a0c15a7cd579cd9b12f9b4eb7b925d0fc"

	Nov 09 14:46:01 missing-upgrade-184300 kubelet[19241]: E1109 14:46:01.115257   19241 pod_workers.go:1300] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"etcd\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=etcd pod=etcd-missing-upgrade-184300_kube-system(abab79edb87c1fccd3ab8e9e9b238817)\"" pod="kube-system/etcd-missing-upgrade-184300" podUID="abab79edb87c1fccd3ab8e9e9b238817"

	Nov 09 14:46:03 missing-upgrade-184300 kubelet[19241]: E1109 14:46:03.306457   19241 eviction_manager.go:258] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"missing-upgrade-184300\" not found"

	Nov 09 14:46:07 missing-upgrade-184300 kubelet[19241]: E1109 14:46:07.101839   19241 kubelet_node_status.go:701] "Failed to set some node status fields" err="failed to validate nodeIP: node IP: \"192.168.103.2\" not found in the host's network interfaces" node="missing-upgrade-184300"

	Nov 09 14:46:07 missing-upgrade-184300 kubelet[19241]: I1109 14:46:07.125981   19241 scope.go:117] "RemoveContainer" containerID="f159ce501abc24427240ea30e47c614499580593ebea41b7479437ced5f19334"

	Nov 09 14:46:07 missing-upgrade-184300 kubelet[19241]: E1109 14:46:07.126669   19241 pod_workers.go:1300] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-apiserver\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=kube-apiserver pod=kube-apiserver-missing-upgrade-184300_kube-system(37e4e85aab00465017c31e2a0d667cdc)\"" pod="kube-system/kube-apiserver-missing-upgrade-184300" podUID="37e4e85aab00465017c31e2a0d667cdc"

	Nov 09 14:46:07 missing-upgrade-184300 kubelet[19241]: W1109 14:46:07.134752   19241 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Node: Get "https://control-plane.minikube.internal:8443/api/v1/nodes?fieldSelector=metadata.name%3Dmissing-upgrade-184300&limit=500&resourceVersion=0": dial tcp 192.168.103.2:8443: i/o timeout

	Nov 09 14:46:07 missing-upgrade-184300 kubelet[19241]: I1109 14:46:07.134895   19241 trace.go:236] Trace[1665289309]: "Reflector ListAndWatch" name:vendor/k8s.io/client-go/informers/factory.go:150 (09-Nov-2025 14:45:37.135) (total time: 30001ms):

	Nov 09 14:46:07 missing-upgrade-184300 kubelet[19241]: Trace[1665289309]: ---"Objects listed" error:Get "https://control-plane.minikube.internal:8443/api/v1/nodes?fieldSelector=metadata.name%3Dmissing-upgrade-184300&limit=500&resourceVersion=0": dial tcp 192.168.103.2:8443: i/o timeout 30001ms (14:46:07.134)

	Nov 09 14:46:07 missing-upgrade-184300 kubelet[19241]: Trace[1665289309]: [30.001345257s] [30.001345257s] END

	Nov 09 14:46:07 missing-upgrade-184300 kubelet[19241]: E1109 14:46:07.134913   19241 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Node: failed to list *v1.Node: Get "https://control-plane.minikube.internal:8443/api/v1/nodes?fieldSelector=metadata.name%3Dmissing-upgrade-184300&limit=500&resourceVersion=0": dial tcp 192.168.103.2:8443: i/o timeout

	Nov 09 14:46:09 missing-upgrade-184300 kubelet[19241]: E1109 14:46:09.223721   19241 certificate_manager.go:562] kubernetes.io/kube-apiserver-client-kubelet: Failed while requesting a signed certificate from the control plane: cannot create certificate signing request: Post "https://control-plane.minikube.internal:8443/apis/certificates.k8s.io/v1/certificatesigningrequests": dial tcp 192.168.103.2:8443: i/o timeout

-- /stdout --

helpers_test.go:262: (dbg) Run:  out/minikube-windows-amd64.exe status --format={{.APIServer}} -p missing-upgrade-184300 -n missing-upgrade-184300

helpers_test.go:262: (dbg) Non-zero exit: out/minikube-windows-amd64.exe status --format={{.APIServer}} -p missing-upgrade-184300 -n missing-upgrade-184300: exit status 2 (694.5805ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:262: status error: exit status 2 (may be ok)

helpers_test.go:264: "missing-upgrade-184300" apiserver is not running, skipping kubectl commands (state="Stopped")

helpers_test.go:175: Cleaning up "missing-upgrade-184300" profile ...

helpers_test.go:178: (dbg) Run:  out/minikube-windows-amd64.exe delete -p missing-upgrade-184300

helpers_test.go:178: (dbg) Done: out/minikube-windows-amd64.exe delete -p missing-upgrade-184300: (3.4352734s)

--- FAIL: TestMissingContainerUpgrade (1098.54s)