=== RUN   TestErrorSpam/setup

error_spam_test.go:81: (dbg) Run:  out/minikube-windows-amd64.exe start -p nospam-148100 -n=1 --memory=2250 --wait=false --log_dir=C:\Users\jenkins.minikube4\AppData\Local\Temp\nospam-148100 --driver=docker

error_spam_test.go:81: (dbg) Done: out/minikube-windows-amd64.exe start -p nospam-148100 -n=1 --memory=2250 --wait=false --log_dir=C:\Users\jenkins.minikube4\AppData\Local\Temp\nospam-148100 --driver=docker: (1m6.358029s)

error_spam_test.go:96: unexpected stderr: "! Failing to connect to https://registry.k8s.io/ from inside the minikube container"

error_spam_test.go:96: unexpected stderr: "* To pull new external images, you may need to configure a proxy: https://minikube.sigs.k8s.io/docs/reference/networking/proxy/"

error_spam_test.go:110: minikube stdout:

* [nospam-148100] minikube v1.34.0 on Microsoft Windows 10 Enterprise N 10.0.19045.5198 Build 19045.5198

- KUBECONFIG=C:\Users\jenkins.minikube4\minikube-integration\kubeconfig

- MINIKUBE_FORCE_SYSTEMD=

- MINIKUBE_HOME=C:\Users\jenkins.minikube4\minikube-integration\.minikube

- MINIKUBE_LOCATION=20107

- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

* Using the docker driver based on user configuration

* Using Docker Desktop driver with root privileges

* Starting "nospam-148100" primary control-plane node in "nospam-148100" cluster

* Pulling base image v0.0.45-1733912881-20083 ...

* Creating docker container (CPUs=2, Memory=2250MB) ...

* Preparing Kubernetes v1.31.2 on Docker 27.4.0 ...

- Generating certificates and keys ...

- Booting up control plane ...

- Configuring RBAC rules ...

* Configuring bridge CNI (Container Networking Interface) ...

* Verifying Kubernetes components...

- Using image gcr.io/k8s-minikube/storage-provisioner:v5

* Enabled addons: default-storageclass, storage-provisioner

* Done! kubectl is now configured to use "nospam-148100" cluster and "default" namespace by default

error_spam_test.go:111: minikube stderr:

! Failing to connect to https://registry.k8s.io/ from inside the minikube container

* To pull new external images, you may need to configure a proxy: https://minikube.sigs.k8s.io/docs/reference/networking/proxy/

--- FAIL: TestErrorSpam/setup (66.36s)

=== RUN   TestStartStop/group/old-k8s-version/serial/SecondStart

start_stop_delete_test.go:254: (dbg) Run:  out/minikube-windows-amd64.exe start -p old-k8s-version-501600 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --kubernetes-version=v1.20.0

start_stop_delete_test.go:254: (dbg) Non-zero exit: out/minikube-windows-amd64.exe start -p old-k8s-version-501600 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --kubernetes-version=v1.20.0: exit status 102 (6m41.3973172s)

-- stdout --

	* [old-k8s-version-501600] minikube v1.34.0 on Microsoft Windows 10 Enterprise N 10.0.19045.5198 Build 19045.5198

	  - KUBECONFIG=C:\Users\jenkins.minikube4\minikube-integration\kubeconfig

	  - MINIKUBE_FORCE_SYSTEMD=

	  - MINIKUBE_HOME=C:\Users\jenkins.minikube4\minikube-integration\.minikube

	  - MINIKUBE_LOCATION=20107

	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	* Kubernetes 1.31.2 is now available. If you would like to upgrade, specify: --kubernetes-version=v1.31.2

	* Using the docker driver based on existing profile

	* Starting "old-k8s-version-501600" primary control-plane node in "old-k8s-version-501600" cluster

	* Pulling base image v0.0.45-1733912881-20083 ...

	* Restarting existing docker container for "old-k8s-version-501600" ...

	* Preparing Kubernetes v1.20.0 on Docker 27.4.0 ...

	* Verifying Kubernetes components...

	  - Using image gcr.io/k8s-minikube/storage-provisioner:v5

	  - Using image fake.domain/registry.k8s.io/echoserver:1.4

	  - Using image docker.io/kubernetesui/dashboard:v2.7.0

	  - Using image registry.k8s.io/echoserver:1.4

	* Some dashboard features require the metrics-server addon. To enable all features please run:

		minikube -p old-k8s-version-501600 addons enable metrics-server

	* Enabled addons: metrics-server, storage-provisioner, dashboard, default-storageclass

-- /stdout --

** stderr ** 

	I1216 11:39:38.389986   10008 out.go:345] Setting OutFile to fd 1748 ...

	I1216 11:39:38.501993   10008 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I1216 11:39:38.501993   10008 out.go:358] Setting ErrFile to fd 1560...

	I1216 11:39:38.501993   10008 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I1216 11:39:38.594034   10008 out.go:352] Setting JSON to false

	I1216 11:39:38.600008   10008 start.go:129] hostinfo: {"hostname":"minikube4","uptime":399449,"bootTime":1733949729,"procs":212,"os":"windows","platform":"Microsoft Windows 10 Enterprise N","platformFamily":"Standalone Workstation","platformVersion":"10.0.19045.5198 Build 19045.5198","kernelVersion":"10.0.19045.5198 Build 19045.5198","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"df6bfb5f-73f2-4acb-9365-df7854ecbb28"}

	W1216 11:39:38.600008   10008 start.go:137] gopshost.Virtualization returned error: not implemented yet

	I1216 11:39:38.609012   10008 out.go:177] * [old-k8s-version-501600] minikube v1.34.0 on Microsoft Windows 10 Enterprise N 10.0.19045.5198 Build 19045.5198

	I1216 11:39:38.612017   10008 notify.go:220] Checking for updates...

	I1216 11:39:38.617005   10008 out.go:177]   - KUBECONFIG=C:\Users\jenkins.minikube4\minikube-integration\kubeconfig

	I1216 11:39:38.620031   10008 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=

	I1216 11:39:38.621995   10008 out.go:177]   - MINIKUBE_HOME=C:\Users\jenkins.minikube4\minikube-integration\.minikube

	I1216 11:39:38.625007   10008 out.go:177]   - MINIKUBE_LOCATION=20107

	I1216 11:39:38.628010   10008 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I1216 11:39:38.632009   10008 config.go:182] Loaded profile config "old-k8s-version-501600": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.20.0

	I1216 11:39:38.636016   10008 out.go:177] * Kubernetes 1.31.2 is now available. If you would like to upgrade, specify: --kubernetes-version=v1.31.2

	I1216 11:39:38.638040   10008 driver.go:394] Setting default libvirt URI to qemu:///system

	I1216 11:39:38.896168   10008 docker.go:123] docker version: linux-27.2.0:Docker Desktop 4.34.2 (167172)

	I1216 11:39:38.915143   10008 cli_runner.go:164] Run: docker system info --format "{{json .}}"

	I1216 11:39:39.380401   10008 info.go:266] docker info: {ID:a15b78d1-f772-48f7-bbf5-f8fe086f3f87 Containers:4 ContainersRunning:2 ContainersPaused:0 ContainersStopped:2 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:82 OomKillDisable:true NGoroutines:87 SystemTime:2024-12-16 11:39:39.344388659 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:12 KernelVersion:5.15.153.1-microsoft-standard-WSL2 OperatingSystem:Docker Desktop OSType:linux Architecture:x86_64 Ind

exServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:16 MemTotal:33657536512 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy:http.docker.internal:3128 HTTPSProxy:http.docker.internal:3128 NoProxy:hubproxy.docker.internal Name:docker-desktop Labels:[com.docker.desktop.address=npipe://\\.\pipe\docker_cli] ExperimentalBuild:false ServerVersion:27.2.0 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:8fc6bcff51318944179630522a095cc9dbf9f353 Expected:8fc6bcff51318944179630522a095cc9dbf9f353} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0

Expected:de40ad0} SecurityOptions:[name=seccomp,profile=unconfined] ProductLicense: Warnings:[WARNING: No blkio throttle.read_bps_device support WARNING: No blkio throttle.write_bps_device support WARNING: No blkio throttle.read_iops_device support WARNING: No blkio throttle.write_iops_device support WARNING: daemon is not using the default seccomp profile] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:C:\Program Files\Docker\cli-plugins\docker-buildx.exe SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.16.2-desktop.1] map[Name:compose Path:C:\Program Files\Docker\cli-plugins\docker-compose.exe SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.2-desktop.2] map[Name:debug Path:C:\Program Files\Docker\cli-plugins\docker-debug.exe SchemaVersion:0.1.0 ShortDescription:Get a shell into any image or container Vendor:Docker Inc. Version:0.0.34] map[Name:desktop Path:C:\Program Files\Docker\cli-plugins\docker-desktop.exe Schema

Version:0.1.0 ShortDescription:Docker Desktop commands (Alpha) Vendor:Docker Inc. Version:v0.0.15] map[Name:dev Path:C:\Program Files\Docker\cli-plugins\docker-dev.exe SchemaVersion:0.1.0 ShortDescription:Docker Dev Environments Vendor:Docker Inc. Version:v0.1.2] map[Name:extension Path:C:\Program Files\Docker\cli-plugins\docker-extension.exe SchemaVersion:0.1.0 ShortDescription:Manages Docker extensions Vendor:Docker Inc. Version:v0.2.25] map[Name:feedback Path:C:\Program Files\Docker\cli-plugins\docker-feedback.exe SchemaVersion:0.1.0 ShortDescription:Provide feedback, right in your terminal! Vendor:Docker Inc. Version:v1.0.5] map[Name:init Path:C:\Program Files\Docker\cli-plugins\docker-init.exe SchemaVersion:0.1.0 ShortDescription:Creates Docker-related starter files for your project Vendor:Docker Inc. Version:v1.3.0] map[Name:sbom Path:C:\Program Files\Docker\cli-plugins\docker-sbom.exe SchemaVersion:0.1.0 ShortDescription:View the packaged-based Software Bill Of Materials (SBOM) for an image URL:https:/

/github.com/docker/sbom-cli-plugin Vendor:Anchore Inc. Version:0.6.0] map[Name:scout Path:C:\Program Files\Docker\cli-plugins\docker-scout.exe SchemaVersion:0.1.0 ShortDescription:Docker Scout Vendor:Docker Inc. Version:v1.13.0]] Warnings:<nil>}}

	I1216 11:39:39.383398   10008 out.go:177] * Using the docker driver based on existing profile

	I1216 11:39:39.385406   10008 start.go:297] selected driver: docker

	I1216 11:39:39.385406   10008 start.go:901] validating driver "docker" against &{Name:old-k8s-version-501600 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1733912881-20083@sha256:64d8b27f78fd269d886e21ba8fc88be20de183ba5cc5bce33d0810e8a65f1df2 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-501600 Namespace:default APIServerHAVIP: AP

IServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.94.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountSt

ring:C:\Users\jenkins.minikube4:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I1216 11:39:39.385406   10008 start.go:912] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}

	I1216 11:39:39.489414   10008 cli_runner.go:164] Run: docker system info --format "{{json .}}"

	I1216 11:39:39.959651   10008 info.go:266] docker info: {ID:a15b78d1-f772-48f7-bbf5-f8fe086f3f87 Containers:4 ContainersRunning:2 ContainersPaused:0 ContainersStopped:2 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:82 OomKillDisable:true NGoroutines:87 SystemTime:2024-12-16 11:39:39.924664696 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:12 KernelVersion:5.15.153.1-microsoft-standard-WSL2 OperatingSystem:Docker Desktop OSType:linux Architecture:x86_64 Ind

exServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:16 MemTotal:33657536512 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy:http.docker.internal:3128 HTTPSProxy:http.docker.internal:3128 NoProxy:hubproxy.docker.internal Name:docker-desktop Labels:[com.docker.desktop.address=npipe://\\.\pipe\docker_cli] ExperimentalBuild:false ServerVersion:27.2.0 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:8fc6bcff51318944179630522a095cc9dbf9f353 Expected:8fc6bcff51318944179630522a095cc9dbf9f353} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0

Expected:de40ad0} SecurityOptions:[name=seccomp,profile=unconfined] ProductLicense: Warnings:[WARNING: No blkio throttle.read_bps_device support WARNING: No blkio throttle.write_bps_device support WARNING: No blkio throttle.read_iops_device support WARNING: No blkio throttle.write_iops_device support WARNING: daemon is not using the default seccomp profile] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:C:\Program Files\Docker\cli-plugins\docker-buildx.exe SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.16.2-desktop.1] map[Name:compose Path:C:\Program Files\Docker\cli-plugins\docker-compose.exe SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.2-desktop.2] map[Name:debug Path:C:\Program Files\Docker\cli-plugins\docker-debug.exe SchemaVersion:0.1.0 ShortDescription:Get a shell into any image or container Vendor:Docker Inc. Version:0.0.34] map[Name:desktop Path:C:\Program Files\Docker\cli-plugins\docker-desktop.exe Schema

Version:0.1.0 ShortDescription:Docker Desktop commands (Alpha) Vendor:Docker Inc. Version:v0.0.15] map[Name:dev Path:C:\Program Files\Docker\cli-plugins\docker-dev.exe SchemaVersion:0.1.0 ShortDescription:Docker Dev Environments Vendor:Docker Inc. Version:v0.1.2] map[Name:extension Path:C:\Program Files\Docker\cli-plugins\docker-extension.exe SchemaVersion:0.1.0 ShortDescription:Manages Docker extensions Vendor:Docker Inc. Version:v0.2.25] map[Name:feedback Path:C:\Program Files\Docker\cli-plugins\docker-feedback.exe SchemaVersion:0.1.0 ShortDescription:Provide feedback, right in your terminal! Vendor:Docker Inc. Version:v1.0.5] map[Name:init Path:C:\Program Files\Docker\cli-plugins\docker-init.exe SchemaVersion:0.1.0 ShortDescription:Creates Docker-related starter files for your project Vendor:Docker Inc. Version:v1.3.0] map[Name:sbom Path:C:\Program Files\Docker\cli-plugins\docker-sbom.exe SchemaVersion:0.1.0 ShortDescription:View the packaged-based Software Bill Of Materials (SBOM) for an image URL:https:/

/github.com/docker/sbom-cli-plugin Vendor:Anchore Inc. Version:0.6.0] map[Name:scout Path:C:\Program Files\Docker\cli-plugins\docker-scout.exe SchemaVersion:0.1.0 ShortDescription:Docker Scout Vendor:Docker Inc. Version:v1.13.0]] Warnings:<nil>}}

	I1216 11:39:39.961687   10008 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]

	I1216 11:39:39.962669   10008 cni.go:84] Creating CNI manager for ""

	I1216 11:39:39.962669   10008 cni.go:162] CNI unnecessary in this configuration, recommending no CNI

	I1216 11:39:39.962669   10008 start.go:340] cluster config:

	{Name:old-k8s-version-501600 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1733912881-20083@sha256:64d8b27f78fd269d886e21ba8fc88be20de183ba5cc5bce33d0810e8a65f1df2 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-501600 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local

ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.94.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:C:\Users\jenkins.minikube4:/minikube-host Mount9PVersion:9p2000.L MountGID:

docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I1216 11:39:39.967649   10008 out.go:177] * Starting "old-k8s-version-501600" primary control-plane node in "old-k8s-version-501600" cluster

	I1216 11:39:39.971651   10008 cache.go:121] Beginning downloading kic base image for docker with docker

	I1216 11:39:39.973645   10008 out.go:177] * Pulling base image v0.0.45-1733912881-20083 ...

	I1216 11:39:39.976647   10008 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime docker

	I1216 11:39:39.976647   10008 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1733912881-20083@sha256:64d8b27f78fd269d886e21ba8fc88be20de183ba5cc5bce33d0810e8a65f1df2 in local docker daemon

	I1216 11:39:39.977672   10008 preload.go:146] Found local preload: C:\Users\jenkins.minikube4\minikube-integration\.minikube\cache\preloaded-tarball\preloaded-images-k8s-v18-v1.20.0-docker-overlay2-amd64.tar.lz4

	I1216 11:39:39.977672   10008 cache.go:56] Caching tarball of preloaded images

	I1216 11:39:39.977672   10008 preload.go:172] Found C:\Users\jenkins.minikube4\minikube-integration\.minikube\cache\preloaded-tarball\preloaded-images-k8s-v18-v1.20.0-docker-overlay2-amd64.tar.lz4 in cache, skipping download

	I1216 11:39:39.977672   10008 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on docker

	I1216 11:39:39.978646   10008 profile.go:143] Saving config to C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\old-k8s-version-501600\config.json ...

	I1216 11:39:40.135436   10008 image.go:98] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1733912881-20083@sha256:64d8b27f78fd269d886e21ba8fc88be20de183ba5cc5bce33d0810e8a65f1df2 in local docker daemon, skipping pull

	I1216 11:39:40.135436   10008 cache.go:144] gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1733912881-20083@sha256:64d8b27f78fd269d886e21ba8fc88be20de183ba5cc5bce33d0810e8a65f1df2 exists in daemon, skipping load

	I1216 11:39:40.135436   10008 cache.go:194] Successfully downloaded all kic artifacts

	I1216 11:39:40.135436   10008 start.go:360] acquireMachinesLock for old-k8s-version-501600: {Name:mkdbcce269cc7724fa297b818b88546ee557e0c0 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I1216 11:39:40.135436   10008 start.go:364] duration metric: took 0s to acquireMachinesLock for "old-k8s-version-501600"

	I1216 11:39:40.135436   10008 start.go:96] Skipping create...Using existing machine configuration

	I1216 11:39:40.135436   10008 fix.go:54] fixHost starting: 

	I1216 11:39:40.176420   10008 cli_runner.go:164] Run: docker container inspect old-k8s-version-501600 --format={{.State.Status}}

	I1216 11:39:40.282444   10008 fix.go:112] recreateIfNeeded on old-k8s-version-501600: state=Stopped err=<nil>

	W1216 11:39:40.282444   10008 fix.go:138] unexpected machine state, will restart: <nil>

	I1216 11:39:40.285420   10008 out.go:177] * Restarting existing docker container for "old-k8s-version-501600" ...

	I1216 11:39:40.315417   10008 cli_runner.go:164] Run: docker start old-k8s-version-501600

	I1216 11:39:41.185793   10008 cli_runner.go:164] Run: docker container inspect old-k8s-version-501600 --format={{.State.Status}}

	I1216 11:39:41.278816   10008 kic.go:430] container "old-k8s-version-501600" state is running.

	I1216 11:39:41.294795   10008 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-501600

	I1216 11:39:41.388805   10008 profile.go:143] Saving config to C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\old-k8s-version-501600\config.json ...

	I1216 11:39:41.392803   10008 machine.go:93] provisionDockerMachine start ...

	I1216 11:39:41.404810   10008 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-501600

	I1216 11:39:41.503701   10008 main.go:141] libmachine: Using SSH client type: native

	I1216 11:39:41.503701   10008 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x1443ea0] 0x14469e0 <nil>  [] 0s} 127.0.0.1 52654 <nil> <nil>}

	I1216 11:39:41.504702   10008 main.go:141] libmachine: About to run SSH command:

	hostname

	I1216 11:39:41.506712   10008 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: EOF

	I1216 11:39:44.711558   10008 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-501600

	I1216 11:39:44.712082   10008 ubuntu.go:169] provisioning hostname "old-k8s-version-501600"

	I1216 11:39:44.729074   10008 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-501600

	I1216 11:39:44.827237   10008 main.go:141] libmachine: Using SSH client type: native

	I1216 11:39:44.827237   10008 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x1443ea0] 0x14469e0 <nil>  [] 0s} 127.0.0.1 52654 <nil> <nil>}

	I1216 11:39:44.827237   10008 main.go:141] libmachine: About to run SSH command:

	sudo hostname old-k8s-version-501600 && echo "old-k8s-version-501600" | sudo tee /etc/hostname

	I1216 11:39:45.057810   10008 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-501600

	I1216 11:39:45.067811   10008 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-501600

	I1216 11:39:45.150815   10008 main.go:141] libmachine: Using SSH client type: native

	I1216 11:39:45.150815   10008 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x1443ea0] 0x14469e0 <nil>  [] 0s} 127.0.0.1 52654 <nil> <nil>}

	I1216 11:39:45.150815   10008 main.go:141] libmachine: About to run SSH command:

			if ! grep -xq '.*\sold-k8s-version-501600' /etc/hosts; then

				if grep -xq '127.0.1.1\s.*' /etc/hosts; then

					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-501600/g' /etc/hosts;

				else 

					echo '127.0.1.1 old-k8s-version-501600' | sudo tee -a /etc/hosts; 

				fi

			fi

	I1216 11:39:45.340700   10008 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I1216 11:39:45.340700   10008 ubuntu.go:175] set auth options {CertDir:C:\Users\jenkins.minikube4\minikube-integration\.minikube CaCertPath:C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\ca.pem CaPrivateKeyPath:C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:C:\Users\jenkins.minikube4\minikube-integration\.minikube\machines\server.pem ServerKeyPath:C:\Users\jenkins.minikube4\minikube-integration\.minikube\machines\server-key.pem ClientKeyPath:C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\cert.pem ServerCertSANs:[] StorePath:C:\Users\jenkins.minikube4\minikube-integration\.minikube}

	I1216 11:39:45.340700   10008 ubuntu.go:177] setting up certificates

	I1216 11:39:45.340700   10008 provision.go:84] configureAuth start

	I1216 11:39:45.349695   10008 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-501600

	I1216 11:39:45.425711   10008 provision.go:143] copyHostCerts

	I1216 11:39:45.426712   10008 exec_runner.go:144] found C:\Users\jenkins.minikube4\minikube-integration\.minikube/cert.pem, removing ...

	I1216 11:39:45.426712   10008 exec_runner.go:203] rm: C:\Users\jenkins.minikube4\minikube-integration\.minikube\cert.pem

	I1216 11:39:45.426712   10008 exec_runner.go:151] cp: C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\cert.pem --> C:\Users\jenkins.minikube4\minikube-integration\.minikube/cert.pem (1123 bytes)

	I1216 11:39:45.427702   10008 exec_runner.go:144] found C:\Users\jenkins.minikube4\minikube-integration\.minikube/key.pem, removing ...

	I1216 11:39:45.427702   10008 exec_runner.go:203] rm: C:\Users\jenkins.minikube4\minikube-integration\.minikube\key.pem

	I1216 11:39:45.429840   10008 exec_runner.go:151] cp: C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\key.pem --> C:\Users\jenkins.minikube4\minikube-integration\.minikube/key.pem (1679 bytes)

	I1216 11:39:45.431719   10008 exec_runner.go:144] found C:\Users\jenkins.minikube4\minikube-integration\.minikube/ca.pem, removing ...

	I1216 11:39:45.431719   10008 exec_runner.go:203] rm: C:\Users\jenkins.minikube4\minikube-integration\.minikube\ca.pem

	I1216 11:39:45.431719   10008 exec_runner.go:151] cp: C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\ca.pem --> C:\Users\jenkins.minikube4\minikube-integration\.minikube/ca.pem (1078 bytes)

	I1216 11:39:45.433702   10008 provision.go:117] generating server cert: C:\Users\jenkins.minikube4\minikube-integration\.minikube\machines\server.pem ca-key=C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\ca.pem private-key=C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\ca-key.pem org=jenkins.old-k8s-version-501600 san=[127.0.0.1 192.168.94.2 localhost minikube old-k8s-version-501600]

	I1216 11:39:45.603886   10008 provision.go:177] copyRemoteCerts

	I1216 11:39:45.614617   10008 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker

	I1216 11:39:45.632625   10008 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-501600

	I1216 11:39:45.702613   10008 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:52654 SSHKeyPath:C:\Users\jenkins.minikube4\minikube-integration\.minikube\machines\old-k8s-version-501600\id_rsa Username:docker}

	I1216 11:39:45.835077   10008 ssh_runner.go:362] scp C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\ca.pem --> /etc/docker/ca.pem (1078 bytes)

	I1216 11:39:45.880377   10008 ssh_runner.go:362] scp C:\Users\jenkins.minikube4\minikube-integration\.minikube\machines\server.pem --> /etc/docker/server.pem (1233 bytes)

	I1216 11:39:45.929389   10008 ssh_runner.go:362] scp C:\Users\jenkins.minikube4\minikube-integration\.minikube\machines\server-key.pem --> /etc/docker/server-key.pem (1679 bytes)

	I1216 11:39:45.980857   10008 provision.go:87] duration metric: took 639.1374ms to configureAuth

	I1216 11:39:45.980857   10008 ubuntu.go:193] setting minikube options for container-runtime

	I1216 11:39:45.981779   10008 config.go:182] Loaded profile config "old-k8s-version-501600": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.20.0

	I1216 11:39:45.989558   10008 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-501600

	I1216 11:39:46.091356   10008 main.go:141] libmachine: Using SSH client type: native

	I1216 11:39:46.092363   10008 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x1443ea0] 0x14469e0 <nil>  [] 0s} 127.0.0.1 52654 <nil> <nil>}

	I1216 11:39:46.092363   10008 main.go:141] libmachine: About to run SSH command:

	df --output=fstype / | tail -n 1

	I1216 11:39:46.414492   10008 main.go:141] libmachine: SSH cmd err, output: <nil>: overlay

	I1216 11:39:46.415495   10008 ubuntu.go:71] root file system type: overlay

	I1216 11:39:46.415495   10008 provision.go:314] Updating docker unit: /lib/systemd/system/docker.service ...

	I1216 11:39:46.431532   10008 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-501600

	I1216 11:39:46.516940   10008 main.go:141] libmachine: Using SSH client type: native

	I1216 11:39:46.517592   10008 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x1443ea0] 0x14469e0 <nil>  [] 0s} 127.0.0.1 52654 <nil> <nil>}

	I1216 11:39:46.517592   10008 main.go:141] libmachine: About to run SSH command:

	sudo mkdir -p /lib/systemd/system && printf %s "[Unit]

	Description=Docker Application Container Engine

	Documentation=https://docs.docker.com

	BindsTo=containerd.service

	After=network-online.target firewalld.service containerd.service

	Wants=network-online.target

	Requires=docker.socket

	StartLimitBurst=3

	StartLimitIntervalSec=60

	[Service]

	Type=notify

	Restart=on-failure

	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	# The base configuration already specifies an 'ExecStart=...' command. The first directive

	# here is to clear out that command inherited from the base configuration. Without this,

	# the command from the base configuration and the command specified here are treated as

	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	# will catch this invalid input and refuse to start the service with an error like:

	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	ExecStart=

	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12 

	ExecReload=/bin/kill -s HUP \$MAINPID

	# Having non-zero Limit*s causes performance problems due to accounting overhead

	# in the kernel. We recommend using cgroups to do container-local accounting.

	LimitNOFILE=infinity

	LimitNPROC=infinity

	LimitCORE=infinity

	# Uncomment TasksMax if your systemd version supports it.

	# Only systemd 226 and above support this version.

	TasksMax=infinity

	TimeoutStartSec=0

	# set delegate yes so that systemd does not reset the cgroups of docker containers

	Delegate=yes

	# kill only the docker process, not all processes in the cgroup

	KillMode=process

	[Install]

	WantedBy=multi-user.target

	" | sudo tee /lib/systemd/system/docker.service.new

	I1216 11:39:46.725239   10008 main.go:141] libmachine: SSH cmd err, output: <nil>: [Unit]

	Description=Docker Application Container Engine

	Documentation=https://docs.docker.com

	BindsTo=containerd.service

	After=network-online.target firewalld.service containerd.service

	Wants=network-online.target

	Requires=docker.socket

	StartLimitBurst=3

	StartLimitIntervalSec=60

	[Service]

	Type=notify

	Restart=on-failure

	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	# The base configuration already specifies an 'ExecStart=...' command. The first directive

	# here is to clear out that command inherited from the base configuration. Without this,

	# the command from the base configuration and the command specified here are treated as

	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	# will catch this invalid input and refuse to start the service with an error like:

	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	ExecStart=

	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12 

	ExecReload=/bin/kill -s HUP $MAINPID

	# Having non-zero Limit*s causes performance problems due to accounting overhead

	# in the kernel. We recommend using cgroups to do container-local accounting.

	LimitNOFILE=infinity

	LimitNPROC=infinity

	LimitCORE=infinity

	# Uncomment TasksMax if your systemd version supports it.

	# Only systemd 226 and above support this version.

	TasksMax=infinity

	TimeoutStartSec=0

	# set delegate yes so that systemd does not reset the cgroups of docker containers

	Delegate=yes

	# kill only the docker process, not all processes in the cgroup

	KillMode=process

	[Install]

	WantedBy=multi-user.target

	I1216 11:39:46.737247   10008 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-501600

	I1216 11:39:46.819238   10008 main.go:141] libmachine: Using SSH client type: native

	I1216 11:39:46.820224   10008 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x1443ea0] 0x14469e0 <nil>  [] 0s} 127.0.0.1 52654 <nil> <nil>}

	I1216 11:39:46.821263   10008 main.go:141] libmachine: About to run SSH command:

	sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }

	I1216 11:39:47.025905   10008 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I1216 11:39:47.025905   10008 machine.go:96] duration metric: took 5.6328391s to provisionDockerMachine

	I1216 11:39:47.025905   10008 start.go:293] postStartSetup for "old-k8s-version-501600" (driver="docker")

	I1216 11:39:47.025905   10008 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]

	I1216 11:39:47.042166   10008 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs

	I1216 11:39:47.049903   10008 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-501600

	I1216 11:39:47.123918   10008 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:52654 SSHKeyPath:C:\Users\jenkins.minikube4\minikube-integration\.minikube\machines\old-k8s-version-501600\id_rsa Username:docker}

	I1216 11:39:47.270232   10008 ssh_runner.go:195] Run: cat /etc/os-release

	I1216 11:39:47.278228   10008 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found

	I1216 11:39:47.279230   10008 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found

	I1216 11:39:47.279230   10008 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found

	I1216 11:39:47.279230   10008 info.go:137] Remote host: Ubuntu 22.04.5 LTS

	I1216 11:39:47.279230   10008 filesync.go:126] Scanning C:\Users\jenkins.minikube4\minikube-integration\.minikube\addons for local assets ...

	I1216 11:39:47.279230   10008 filesync.go:126] Scanning C:\Users\jenkins.minikube4\minikube-integration\.minikube\files for local assets ...

	I1216 11:39:47.280237   10008 filesync.go:149] local asset: C:\Users\jenkins.minikube4\minikube-integration\.minikube\files\etc\ssl\certs\114522.pem -> 114522.pem in /etc/ssl/certs

	I1216 11:39:47.291245   10008 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs

	I1216 11:39:47.309229   10008 ssh_runner.go:362] scp C:\Users\jenkins.minikube4\minikube-integration\.minikube\files\etc\ssl\certs\114522.pem --> /etc/ssl/certs/114522.pem (1708 bytes)

	I1216 11:39:47.454935   10008 start.go:296] duration metric: took 429.01ms for postStartSetup

	I1216 11:39:47.465925   10008 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I1216 11:39:47.473939   10008 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-501600

	I1216 11:39:47.560954   10008 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:52654 SSHKeyPath:C:\Users\jenkins.minikube4\minikube-integration\.minikube\machines\old-k8s-version-501600\id_rsa Username:docker}

	I1216 11:39:47.701851   10008 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"

	I1216 11:39:47.719263   10008 fix.go:56] duration metric: took 7.5834726s for fixHost

	I1216 11:39:47.719263   10008 start.go:83] releasing machines lock for "old-k8s-version-501600", held for 7.5834726s

	I1216 11:39:47.739765   10008 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-501600

	I1216 11:39:47.820727   10008 ssh_runner.go:195] Run: curl.exe -sS -m 2 https://registry.k8s.io/

	I1216 11:39:47.838726   10008 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-501600

	I1216 11:39:47.841718   10008 ssh_runner.go:195] Run: cat /version.json

	I1216 11:39:47.853726   10008 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-501600

	I1216 11:39:47.931743   10008 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:52654 SSHKeyPath:C:\Users\jenkins.minikube4\minikube-integration\.minikube\machines\old-k8s-version-501600\id_rsa Username:docker}

	I1216 11:39:47.945860   10008 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:52654 SSHKeyPath:C:\Users\jenkins.minikube4\minikube-integration\.minikube\machines\old-k8s-version-501600\id_rsa Username:docker}

	W1216 11:39:48.070236   10008 start.go:867] [curl.exe -sS -m 2 https://registry.k8s.io/] failed: curl.exe -sS -m 2 https://registry.k8s.io/: Process exited with status 127

	stdout:

	stderr:

	bash: line 1: curl.exe: command not found

	I1216 11:39:48.084228   10008 ssh_runner.go:195] Run: systemctl --version

	I1216 11:39:48.107208   10008 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"

	I1216 11:39:48.146199   10008 ssh_runner.go:195] Run: sudo find \etc\cni\net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "grep -q loopback {} && ( grep -q name {} || sudo sed -i '/"type": "loopback"/i \ \ \ \ "name": "loopback",' {} ) && sudo sed -i 's|"cniVersion": ".*"|"cniVersion": "1.0.0"|g' {}" ;

	W1216 11:39:48.166208   10008 start.go:439] unable to name loopback interface in configureRuntimes: unable to patch loopback cni config "/etc/cni/net.d/*loopback.conf*": sudo find \etc\cni\net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "grep -q loopback {} && ( grep -q name {} || sudo sed -i '/"type": "loopback"/i \ \ \ \ "name": "loopback",' {} ) && sudo sed -i 's|"cniVersion": ".*"|"cniVersion": "1.0.0"|g' {}" ;: Process exited with status 1

	stdout:

	stderr:

	find: '\\etc\\cni\\net.d': No such file or directory

	I1216 11:39:48.176223   10008 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *bridge* -not -name *podman* -not -name *.mk_disabled -printf "%p, " -exec sh -c "sudo sed -i -r -e '/"dst": ".*:.*"/d' -e 's|^(.*)"dst": (.*)[,*]$|\1"dst": \2|g' -e '/"subnet": ".*:.*"/d' -e 's|^(.*)"subnet": ".*"(.*)[,*]$|\1"subnet": "10.244.0.0/16"\2|g' {}" ;

	W1216 11:39:48.187688   10008 out.go:270] ! Failing to connect to https://registry.k8s.io/ from inside the minikube container

	! Failing to connect to https://registry.k8s.io/ from inside the minikube container

	W1216 11:39:48.187688   10008 out.go:270] * To pull new external images, you may need to configure a proxy: https://minikube.sigs.k8s.io/docs/reference/networking/proxy/

	* To pull new external images, you may need to configure a proxy: https://minikube.sigs.k8s.io/docs/reference/networking/proxy/

	I1216 11:39:48.230757   10008 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *podman* -not -name *.mk_disabled -printf "%p, " -exec sh -c "sudo sed -i -r -e 's|^(.*)"subnet": ".*"(.*)$|\1"subnet": "10.244.0.0/16"\2|g' -e 's|^(.*)"gateway": ".*"(.*)$|\1"gateway": "10.244.0.1"\2|g' {}" ;

	I1216 11:39:48.283707   10008 cni.go:308] configured [/etc/cni/net.d/100-crio-bridge.conf, /etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)

	I1216 11:39:48.283707   10008 start.go:495] detecting cgroup driver to use...

	I1216 11:39:48.283707   10008 detect.go:187] detected "cgroupfs" cgroup driver on host os

	I1216 11:39:48.283707   10008 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///run/containerd/containerd.sock

	" | sudo tee /etc/crictl.yaml"

	I1216 11:39:48.345298   10008 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.2"|' /etc/containerd/config.toml"

	I1216 11:39:48.390286   10008 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"

	I1216 11:39:48.421538   10008 containerd.go:146] configuring containerd to use "cgroupfs" as cgroup driver...

	I1216 11:39:48.441279   10008 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"

	I1216 11:39:48.476269   10008 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"

	I1216 11:39:48.510302   10008 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"

	I1216 11:39:48.557551   10008 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"

	I1216 11:39:48.592557   10008 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"

	I1216 11:39:48.640600   10008 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"

	I1216 11:39:48.683386   10008 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables

	I1216 11:39:48.727747   10008 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"

	I1216 11:39:48.761699   10008 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I1216 11:39:48.957329   10008 ssh_runner.go:195] Run: sudo systemctl restart containerd

	I1216 11:39:49.198649   10008 start.go:495] detecting cgroup driver to use...

	I1216 11:39:49.198649   10008 detect.go:187] detected "cgroupfs" cgroup driver on host os

	I1216 11:39:49.216634   10008 ssh_runner.go:195] Run: sudo systemctl cat docker.service

	I1216 11:39:49.246656   10008 cruntime.go:279] skipping containerd shutdown because we are bound to it

	I1216 11:39:49.264634   10008 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio

	I1216 11:39:49.295694   10008 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/dockershim.sock

	" | sudo tee /etc/crictl.yaml"

	I1216 11:39:49.366644   10008 ssh_runner.go:195] Run: which cri-dockerd

	I1216 11:39:49.390629   10008 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/cri-docker.service.d

	I1216 11:39:49.409375   10008 ssh_runner.go:362] scp memory --> /etc/systemd/system/cri-docker.service.d/10-cni.conf (189 bytes)

	I1216 11:39:49.480539   10008 ssh_runner.go:195] Run: sudo systemctl unmask docker.service

	I1216 11:39:49.768904   10008 ssh_runner.go:195] Run: sudo systemctl enable docker.socket

	I1216 11:39:49.959157   10008 docker.go:574] configuring docker to use "cgroupfs" as cgroup driver...

	I1216 11:39:49.960190   10008 ssh_runner.go:362] scp memory --> /etc/docker/daemon.json (130 bytes)

	I1216 11:39:50.010153   10008 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I1216 11:39:50.202341   10008 ssh_runner.go:195] Run: sudo systemctl restart docker

	I1216 11:39:51.804973   10008 ssh_runner.go:235] Completed: sudo systemctl restart docker: (1.6025571s)

	I1216 11:39:51.822681   10008 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}

	I1216 11:39:51.898685   10008 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}

	I1216 11:39:51.979903   10008 out.go:235] * Preparing Kubernetes v1.20.0 on Docker 27.4.0 ...

	I1216 11:39:51.989915   10008 cli_runner.go:164] Run: docker exec -t old-k8s-version-501600 dig +short host.docker.internal

	I1216 11:39:52.200180   10008 network.go:96] got host ip for mount in container by digging dns: 192.168.65.254

	I1216 11:39:52.211200   10008 ssh_runner.go:195] Run: grep 192.168.65.254	host.minikube.internal$ /etc/hosts

	I1216 11:39:52.223197   10008 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.65.254	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I1216 11:39:52.264184   10008 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "8443/tcp") 0).HostPort}}'" old-k8s-version-501600

	I1216 11:39:52.347232   10008 kubeadm.go:883] updating cluster {Name:old-k8s-version-501600 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1733912881-20083@sha256:64d8b27f78fd269d886e21ba8fc88be20de183ba5cc5bce33d0810e8a65f1df2 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-501600 Namespace:default APIServerHAVIP: APIServerName:minik

ubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.94.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:C:\Users\jen

kins.minikube4:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...

	I1216 11:39:52.347232   10008 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime docker

	I1216 11:39:52.362207   10008 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}

	I1216 11:39:52.425948   10008 docker.go:689] Got preloaded images: -- stdout --

	gcr.io/k8s-minikube/storage-provisioner:v5

	k8s.gcr.io/kube-proxy:v1.20.0

	k8s.gcr.io/kube-scheduler:v1.20.0

	k8s.gcr.io/kube-apiserver:v1.20.0

	k8s.gcr.io/kube-controller-manager:v1.20.0

	k8s.gcr.io/etcd:3.4.13-0

	k8s.gcr.io/coredns:1.7.0

	k8s.gcr.io/pause:3.2

	gcr.io/k8s-minikube/busybox:1.28.4-glibc

	-- /stdout --

	I1216 11:39:52.425948   10008 docker.go:695] registry.k8s.io/kube-apiserver:v1.20.0 wasn't preloaded

	I1216 11:39:52.439948   10008 ssh_runner.go:195] Run: sudo cat /var/lib/docker/image/overlay2/repositories.json

	I1216 11:39:52.483945   10008 ssh_runner.go:195] Run: which lz4

	I1216 11:39:52.506961   10008 ssh_runner.go:195] Run: stat -c "%s %y" /preloaded.tar.lz4

	I1216 11:39:52.517996   10008 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%s %y" /preloaded.tar.lz4: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/preloaded.tar.lz4': No such file or directory

	I1216 11:39:52.517996   10008 ssh_runner.go:362] scp C:\Users\jenkins.minikube4\minikube-integration\.minikube\cache\preloaded-tarball\preloaded-images-k8s-v18-v1.20.0-docker-overlay2-amd64.tar.lz4 --> /preloaded.tar.lz4 (401930599 bytes)

	I1216 11:40:00.088598   10008 docker.go:653] duration metric: took 7.5932644s to copy over tarball

	I1216 11:40:00.110588   10008 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4

	I1216 11:40:06.835753   10008 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (6.7247425s)

	I1216 11:40:06.835804   10008 ssh_runner.go:146] rm: /preloaded.tar.lz4

	I1216 11:40:06.940084   10008 ssh_runner.go:195] Run: sudo cat /var/lib/docker/image/overlay2/repositories.json

	I1216 11:40:06.961159   10008 ssh_runner.go:362] scp memory --> /var/lib/docker/image/overlay2/repositories.json (2824 bytes)

	I1216 11:40:07.012544   10008 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I1216 11:40:07.183359   10008 ssh_runner.go:195] Run: sudo systemctl restart docker

	I1216 11:40:14.018132   10008 ssh_runner.go:235] Completed: sudo systemctl restart docker: (6.8343483s)

	I1216 11:40:14.031311   10008 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}

	I1216 11:40:14.082047   10008 docker.go:689] Got preloaded images: -- stdout --

	gcr.io/k8s-minikube/storage-provisioner:v5

	k8s.gcr.io/kube-proxy:v1.20.0

	k8s.gcr.io/kube-apiserver:v1.20.0

	k8s.gcr.io/kube-scheduler:v1.20.0

	k8s.gcr.io/kube-controller-manager:v1.20.0

	k8s.gcr.io/etcd:3.4.13-0

	k8s.gcr.io/coredns:1.7.0

	k8s.gcr.io/pause:3.2

	gcr.io/k8s-minikube/busybox:1.28.4-glibc

	-- /stdout --

	I1216 11:40:14.083047   10008 docker.go:695] registry.k8s.io/kube-apiserver:v1.20.0 wasn't preloaded

	I1216 11:40:14.083047   10008 cache_images.go:88] LoadCachedImages start: [registry.k8s.io/kube-apiserver:v1.20.0 registry.k8s.io/kube-controller-manager:v1.20.0 registry.k8s.io/kube-scheduler:v1.20.0 registry.k8s.io/kube-proxy:v1.20.0 registry.k8s.io/pause:3.2 registry.k8s.io/etcd:3.4.13-0 registry.k8s.io/coredns:1.7.0 gcr.io/k8s-minikube/storage-provisioner:v5]

	I1216 11:40:14.096051   10008 image.go:135] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v5

	I1216 11:40:14.102038   10008 image.go:135] retrieving image: registry.k8s.io/kube-proxy:v1.20.0

	I1216 11:40:14.112053   10008 image.go:178] daemon lookup for gcr.io/k8s-minikube/storage-provisioner:v5: Error response from daemon: No such image: gcr.io/k8s-minikube/storage-provisioner:v5

	I1216 11:40:14.114060   10008 image.go:135] retrieving image: registry.k8s.io/kube-apiserver:v1.20.0

	I1216 11:40:14.120057   10008 image.go:178] daemon lookup for registry.k8s.io/kube-proxy:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.20.0

	I1216 11:40:14.120057   10008 image.go:135] retrieving image: registry.k8s.io/kube-controller-manager:v1.20.0

	I1216 11:40:14.129046   10008 image.go:178] daemon lookup for registry.k8s.io/kube-apiserver:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.20.0

	I1216 11:40:14.129046   10008 image.go:135] retrieving image: registry.k8s.io/etcd:3.4.13-0

	I1216 11:40:14.135059   10008 image.go:135] retrieving image: registry.k8s.io/pause:3.2

	I1216 11:40:14.137064   10008 image.go:178] daemon lookup for registry.k8s.io/kube-controller-manager:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.20.0

	I1216 11:40:14.149048   10008 image.go:135] retrieving image: registry.k8s.io/kube-scheduler:v1.20.0

	I1216 11:40:14.151067   10008 image.go:178] daemon lookup for registry.k8s.io/etcd:3.4.13-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.4.13-0

	I1216 11:40:14.156065   10008 image.go:178] daemon lookup for registry.k8s.io/pause:3.2: Error response from daemon: No such image: registry.k8s.io/pause:3.2

	I1216 11:40:14.161068   10008 image.go:135] retrieving image: registry.k8s.io/coredns:1.7.0

	I1216 11:40:14.167065   10008 image.go:178] daemon lookup for registry.k8s.io/kube-scheduler:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.20.0

	I1216 11:40:14.175070   10008 image.go:178] daemon lookup for registry.k8s.io/coredns:1.7.0: Error response from daemon: No such image: registry.k8s.io/coredns:1.7.0

	W1216 11:40:14.231063   10008 image.go:188] authn lookup for gcr.io/k8s-minikube/storage-provisioner:v5 (trying anon): error getting credentials - err: exit status 1, out: `error getting credentials - err: exit status 1, out: `A specified logon session does not exist. It may already have been terminated.``

	W1216 11:40:14.333229   10008 image.go:188] authn lookup for registry.k8s.io/kube-proxy:v1.20.0 (trying anon): error getting credentials - err: exit status 1, out: `error getting credentials - err: exit status 1, out: `A specified logon session does not exist. It may already have been terminated.``

	W1216 11:40:14.434851   10008 image.go:188] authn lookup for registry.k8s.io/kube-apiserver:v1.20.0 (trying anon): error getting credentials - err: exit status 1, out: `error getting credentials - err: exit status 1, out: `A specified logon session does not exist. It may already have been terminated.``

	W1216 11:40:14.522551   10008 image.go:188] authn lookup for registry.k8s.io/kube-controller-manager:v1.20.0 (trying anon): error getting credentials - err: exit status 1, out: `error getting credentials - err: exit status 1, out: `A specified logon session does not exist. It may already have been terminated.``

	W1216 11:40:14.626965   10008 image.go:188] authn lookup for registry.k8s.io/etcd:3.4.13-0 (trying anon): error getting credentials - err: exit status 1, out: `error getting credentials - err: exit status 1, out: `A specified logon session does not exist. It may already have been terminated.``

	W1216 11:40:14.717576   10008 image.go:188] authn lookup for registry.k8s.io/pause:3.2 (trying anon): error getting credentials - err: exit status 1, out: `error getting credentials - err: exit status 1, out: `A specified logon session does not exist. It may already have been terminated.``

	I1216 11:40:14.823462   10008 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} gcr.io/k8s-minikube/storage-provisioner:v5

	W1216 11:40:14.823462   10008 image.go:188] authn lookup for registry.k8s.io/kube-scheduler:v1.20.0 (trying anon): error getting credentials - err: exit status 1, out: `error getting credentials - err: exit status 1, out: `A specified logon session does not exist. It may already have been terminated.``

	I1216 11:40:14.870470   10008 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/kube-apiserver:v1.20.0

	I1216 11:40:14.884462   10008 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/kube-proxy:v1.20.0

	I1216 11:40:14.922524   10008 cache_images.go:116] "registry.k8s.io/kube-apiserver:v1.20.0" needs transfer: "registry.k8s.io/kube-apiserver:v1.20.0" does not exist at hash "ca9843d3b545457f24b012d6d579ba85f132f2406aa171ad84d53caa55e5de99" in container runtime

	I1216 11:40:14.922524   10008 localpath.go:146] windows sanitize: C:\Users\jenkins.minikube4\minikube-integration\.minikube\cache\images\amd64\registry.k8s.io\kube-apiserver:v1.20.0 -> C:\Users\jenkins.minikube4\minikube-integration\.minikube\cache\images\amd64\registry.k8s.io\kube-apiserver_v1.20.0

	I1216 11:40:14.922524   10008 docker.go:337] Removing image: registry.k8s.io/kube-apiserver:v1.20.0

	W1216 11:40:14.932487   10008 image.go:188] authn lookup for registry.k8s.io/coredns:1.7.0 (trying anon): error getting credentials - err: exit status 1, out: `error getting credentials - err: exit status 1, out: `A specified logon session does not exist. It may already have been terminated.``

	I1216 11:40:14.939486   10008 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/pause:3.2

	I1216 11:40:14.940473   10008 ssh_runner.go:195] Run: docker rmi registry.k8s.io/kube-apiserver:v1.20.0

	I1216 11:40:14.940473   10008 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/kube-controller-manager:v1.20.0

	I1216 11:40:14.941483   10008 cache_images.go:116] "registry.k8s.io/kube-proxy:v1.20.0" needs transfer: "registry.k8s.io/kube-proxy:v1.20.0" does not exist at hash "10cc881966cfd9287656c2fce1f144625602653d1e8b011487a7a71feb100bdc" in container runtime

	I1216 11:40:14.941483   10008 localpath.go:146] windows sanitize: C:\Users\jenkins.minikube4\minikube-integration\.minikube\cache\images\amd64\registry.k8s.io\kube-proxy:v1.20.0 -> C:\Users\jenkins.minikube4\minikube-integration\.minikube\cache\images\amd64\registry.k8s.io\kube-proxy_v1.20.0

	I1216 11:40:14.941483   10008 docker.go:337] Removing image: registry.k8s.io/kube-proxy:v1.20.0

	I1216 11:40:14.944480   10008 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/etcd:3.4.13-0

	I1216 11:40:14.959467   10008 ssh_runner.go:195] Run: docker rmi registry.k8s.io/kube-proxy:v1.20.0

	I1216 11:40:15.035628   10008 cache_images.go:116] "registry.k8s.io/kube-controller-manager:v1.20.0" needs transfer: "registry.k8s.io/kube-controller-manager:v1.20.0" does not exist at hash "b9fa1895dcaa6d3dd241d6d9340e939ca30fc0946464ec9f205a8cbe738a8080" in container runtime

	I1216 11:40:15.035628   10008 localpath.go:146] windows sanitize: C:\Users\jenkins.minikube4\minikube-integration\.minikube\cache\images\amd64\registry.k8s.io\kube-controller-manager:v1.20.0 -> C:\Users\jenkins.minikube4\minikube-integration\.minikube\cache\images\amd64\registry.k8s.io\kube-controller-manager_v1.20.0

	I1216 11:40:15.035628   10008 docker.go:337] Removing image: registry.k8s.io/kube-controller-manager:v1.20.0

	I1216 11:40:15.037633   10008 cache_images.go:116] "registry.k8s.io/pause:3.2" needs transfer: "registry.k8s.io/pause:3.2" does not exist at hash "80d28bedfe5dec59da9ebf8e6260224ac9008ab5c11dbbe16ee3ba3e4439ac2c" in container runtime

	I1216 11:40:15.037633   10008 localpath.go:146] windows sanitize: C:\Users\jenkins.minikube4\minikube-integration\.minikube\cache\images\amd64\registry.k8s.io\pause:3.2 -> C:\Users\jenkins.minikube4\minikube-integration\.minikube\cache\images\amd64\registry.k8s.io\pause_3.2

	I1216 11:40:15.038634   10008 docker.go:337] Removing image: registry.k8s.io/pause:3.2

	I1216 11:40:15.040634   10008 cache_images.go:116] "registry.k8s.io/etcd:3.4.13-0" needs transfer: "registry.k8s.io/etcd:3.4.13-0" does not exist at hash "0369cf4303ffdb467dc219990960a9baa8512a54b0ad9283eaf55bd6c0adb934" in container runtime

	I1216 11:40:15.040634   10008 cache_images.go:289] Loading image from: C:\Users\jenkins.minikube4\minikube-integration\.minikube\cache\images\amd64\registry.k8s.io\kube-proxy_v1.20.0

	I1216 11:40:15.040634   10008 localpath.go:146] windows sanitize: C:\Users\jenkins.minikube4\minikube-integration\.minikube\cache\images\amd64\registry.k8s.io\etcd:3.4.13-0 -> C:\Users\jenkins.minikube4\minikube-integration\.minikube\cache\images\amd64\registry.k8s.io\etcd_3.4.13-0

	I1216 11:40:15.040634   10008 docker.go:337] Removing image: registry.k8s.io/etcd:3.4.13-0

	I1216 11:40:15.040634   10008 cache_images.go:289] Loading image from: C:\Users\jenkins.minikube4\minikube-integration\.minikube\cache\images\amd64\registry.k8s.io\kube-apiserver_v1.20.0

	I1216 11:40:15.050610   10008 ssh_runner.go:195] Run: docker rmi registry.k8s.io/kube-controller-manager:v1.20.0

	I1216 11:40:15.051615   10008 ssh_runner.go:195] Run: docker rmi registry.k8s.io/pause:3.2

	I1216 11:40:15.053886   10008 ssh_runner.go:195] Run: docker rmi registry.k8s.io/etcd:3.4.13-0

	I1216 11:40:15.129287   10008 cache_images.go:289] Loading image from: C:\Users\jenkins.minikube4\minikube-integration\.minikube\cache\images\amd64\registry.k8s.io\kube-controller-manager_v1.20.0

	I1216 11:40:15.140809   10008 cache_images.go:289] Loading image from: C:\Users\jenkins.minikube4\minikube-integration\.minikube\cache\images\amd64\registry.k8s.io\etcd_3.4.13-0

	I1216 11:40:15.140809   10008 cache_images.go:289] Loading image from: C:\Users\jenkins.minikube4\minikube-integration\.minikube\cache\images\amd64\registry.k8s.io\pause_3.2

	I1216 11:40:15.141859   10008 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/kube-scheduler:v1.20.0

	I1216 11:40:15.182585   10008 cache_images.go:116] "registry.k8s.io/kube-scheduler:v1.20.0" needs transfer: "registry.k8s.io/kube-scheduler:v1.20.0" does not exist at hash "3138b6e3d471224fd516f758f3b53309219bcb6824e07686b3cd60d78012c899" in container runtime

	I1216 11:40:15.182585   10008 localpath.go:146] windows sanitize: C:\Users\jenkins.minikube4\minikube-integration\.minikube\cache\images\amd64\registry.k8s.io\kube-scheduler:v1.20.0 -> C:\Users\jenkins.minikube4\minikube-integration\.minikube\cache\images\amd64\registry.k8s.io\kube-scheduler_v1.20.0

	I1216 11:40:15.182585   10008 docker.go:337] Removing image: registry.k8s.io/kube-scheduler:v1.20.0

	I1216 11:40:15.191589   10008 ssh_runner.go:195] Run: docker rmi registry.k8s.io/kube-scheduler:v1.20.0

	I1216 11:40:15.228938   10008 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/coredns:1.7.0

	I1216 11:40:15.235934   10008 cache_images.go:289] Loading image from: C:\Users\jenkins.minikube4\minikube-integration\.minikube\cache\images\amd64\registry.k8s.io\kube-scheduler_v1.20.0

	I1216 11:40:15.273555   10008 cache_images.go:116] "registry.k8s.io/coredns:1.7.0" needs transfer: "registry.k8s.io/coredns:1.7.0" does not exist at hash "bfe3a36ebd2528b454be6aebece806db5b40407b833e2af9617bf39afaff8c16" in container runtime

	I1216 11:40:15.273555   10008 localpath.go:146] windows sanitize: C:\Users\jenkins.minikube4\minikube-integration\.minikube\cache\images\amd64\registry.k8s.io\coredns:1.7.0 -> C:\Users\jenkins.minikube4\minikube-integration\.minikube\cache\images\amd64\registry.k8s.io\coredns_1.7.0

	I1216 11:40:15.273555   10008 docker.go:337] Removing image: registry.k8s.io/coredns:1.7.0

	I1216 11:40:15.283543   10008 ssh_runner.go:195] Run: docker rmi registry.k8s.io/coredns:1.7.0

	I1216 11:40:15.328472   10008 cache_images.go:289] Loading image from: C:\Users\jenkins.minikube4\minikube-integration\.minikube\cache\images\amd64\registry.k8s.io\coredns_1.7.0

	I1216 11:40:15.329039   10008 cache_images.go:92] duration metric: took 1.2459343s to LoadCachedImages

	W1216 11:40:15.329039   10008 out.go:270] X Unable to load cached images: LoadCachedImages: CreateFile C:\Users\jenkins.minikube4\minikube-integration\.minikube\cache\images\amd64\registry.k8s.io\kube-proxy_v1.20.0: The system cannot find the file specified.

	X Unable to load cached images: LoadCachedImages: CreateFile C:\Users\jenkins.minikube4\minikube-integration\.minikube\cache\images\amd64\registry.k8s.io\kube-proxy_v1.20.0: The system cannot find the file specified.

	I1216 11:40:15.329039   10008 kubeadm.go:934] updating node { 192.168.94.2 8443 v1.20.0 docker true true} ...

	I1216 11:40:15.329039   10008 kubeadm.go:946] kubelet [Unit]

	Wants=docker.socket

	[Service]

	ExecStart=

	ExecStart=/var/lib/minikube/binaries/v1.20.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=docker --hostname-override=old-k8s-version-501600 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.94.2

	[Install]

	 config:

	{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-501600 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}

	I1216 11:40:15.345125   10008 ssh_runner.go:195] Run: docker info --format {{.CgroupDriver}}

	I1216 11:40:15.449841   10008 cni.go:84] Creating CNI manager for ""

	I1216 11:40:15.449926   10008 cni.go:162] CNI unnecessary in this configuration, recommending no CNI

	I1216 11:40:15.449961   10008 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16

	I1216 11:40:15.450036   10008 kubeadm.go:189] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.94.2 APIServerPort:8443 KubernetesVersion:v1.20.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-501600 NodeName:old-k8s-version-501600 DNSDomain:cluster.local CRISocket:/var/run/dockershim.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.94.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.94.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticP

odPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}

	I1216 11:40:15.450373   10008 kubeadm.go:195] kubeadm config:

	apiVersion: kubeadm.k8s.io/v1beta2

	kind: InitConfiguration

	localAPIEndpoint:

	  advertiseAddress: 192.168.94.2

	  bindPort: 8443

	bootstrapTokens:

	  - groups:

	      - system:bootstrappers:kubeadm:default-node-token

	    ttl: 24h0m0s

	    usages:

	      - signing

	      - authentication

	nodeRegistration:

	  criSocket: /var/run/dockershim.sock

	  name: "old-k8s-version-501600"

	  kubeletExtraArgs:

	    node-ip: 192.168.94.2

	  taints: []

	---

	apiVersion: kubeadm.k8s.io/v1beta2

	kind: ClusterConfiguration

	apiServer:

	  certSANs: ["127.0.0.1", "localhost", "192.168.94.2"]

	  extraArgs:

	    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"

	controllerManager:

	  extraArgs:

	    allocate-node-cidrs: "true"

	    leader-elect: "false"

	scheduler:

	  extraArgs:

	    leader-elect: "false"

	certificatesDir: /var/lib/minikube/certs

	clusterName: mk

	controlPlaneEndpoint: control-plane.minikube.internal:8443

	dns:

	  type: CoreDNS

	etcd:

	  local:

	    dataDir: /var/lib/minikube/etcd

	    extraArgs:

	      proxy-refresh-interval: "70000"

	kubernetesVersion: v1.20.0

	networking:

	  dnsDomain: cluster.local

	  podSubnet: "10.244.0.0/16"

	  serviceSubnet: 10.96.0.0/12

	---

	apiVersion: kubelet.config.k8s.io/v1beta1

	kind: KubeletConfiguration

	authentication:

	  x509:

	    clientCAFile: /var/lib/minikube/certs/ca.crt

	cgroupDriver: cgroupfs

	hairpinMode: hairpin-veth

	runtimeRequestTimeout: 15m

	clusterDomain: "cluster.local"

	# disable disk resource management by default

	imageGCHighThresholdPercent: 100

	evictionHard:

	  nodefs.available: "0%"

	  nodefs.inodesFree: "0%"

	  imagefs.available: "0%"

	failSwapOn: false

	staticPodPath: /etc/kubernetes/manifests

	---

	apiVersion: kubeproxy.config.k8s.io/v1alpha1

	kind: KubeProxyConfiguration

	clusterCIDR: "10.244.0.0/16"

	metricsBindAddress: 0.0.0.0:10249

	conntrack:

	  maxPerCore: 0

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"

	  tcpEstablishedTimeout: 0s

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"

	  tcpCloseWaitTimeout: 0s

	I1216 11:40:15.468939   10008 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.20.0

	I1216 11:40:15.498187   10008 binaries.go:44] Found k8s binaries, skipping transfer

	I1216 11:40:15.512384   10008 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube

	I1216 11:40:15.531760   10008 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (348 bytes)

	I1216 11:40:15.568608   10008 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)

	I1216 11:40:15.605686   10008 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2118 bytes)

	I1216 11:40:15.665344   10008 ssh_runner.go:195] Run: grep 192.168.94.2	control-plane.minikube.internal$ /etc/hosts

	I1216 11:40:15.675365   10008 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.94.2	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I1216 11:40:15.714583   10008 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I1216 11:40:15.887810   10008 ssh_runner.go:195] Run: sudo systemctl start kubelet

	I1216 11:40:15.922178   10008 certs.go:68] Setting up C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\old-k8s-version-501600 for IP: 192.168.94.2

	I1216 11:40:15.922824   10008 certs.go:194] generating shared ca certs ...

	I1216 11:40:15.922824   10008 certs.go:226] acquiring lock for ca certs: {Name:mk92285f7546e1a5b3c3b23dab6135aa5a99cd14 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1216 11:40:15.922824   10008 certs.go:235] skipping valid "minikubeCA" ca cert: C:\Users\jenkins.minikube4\minikube-integration\.minikube\ca.key

	I1216 11:40:15.923823   10008 certs.go:235] skipping valid "proxyClientCA" ca cert: C:\Users\jenkins.minikube4\minikube-integration\.minikube\proxy-client-ca.key

	I1216 11:40:15.923823   10008 certs.go:256] generating profile certs ...

	I1216 11:40:15.924822   10008 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\old-k8s-version-501600\client.key

	I1216 11:40:15.924822   10008 certs.go:359] skipping valid signed profile cert regeneration for "minikube": C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\old-k8s-version-501600\apiserver.key.7a5409da

	I1216 11:40:15.925822   10008 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\old-k8s-version-501600\proxy-client.key

	I1216 11:40:15.927832   10008 certs.go:484] found cert: C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\11452.pem (1338 bytes)

	W1216 11:40:15.927832   10008 certs.go:480] ignoring C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\11452_empty.pem, impossibly tiny 0 bytes

	I1216 11:40:15.927832   10008 certs.go:484] found cert: C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\ca-key.pem (1675 bytes)

	I1216 11:40:15.928832   10008 certs.go:484] found cert: C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\ca.pem (1078 bytes)

	I1216 11:40:15.928832   10008 certs.go:484] found cert: C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\cert.pem (1123 bytes)

	I1216 11:40:15.928832   10008 certs.go:484] found cert: C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\key.pem (1679 bytes)

	I1216 11:40:15.929832   10008 certs.go:484] found cert: C:\Users\jenkins.minikube4\minikube-integration\.minikube\files\etc\ssl\certs\114522.pem (1708 bytes)

	I1216 11:40:15.931834   10008 ssh_runner.go:362] scp C:\Users\jenkins.minikube4\minikube-integration\.minikube\ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)

	I1216 11:40:15.989735   10008 ssh_runner.go:362] scp C:\Users\jenkins.minikube4\minikube-integration\.minikube\ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)

	I1216 11:40:16.043853   10008 ssh_runner.go:362] scp C:\Users\jenkins.minikube4\minikube-integration\.minikube\proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)

	I1216 11:40:16.112726   10008 ssh_runner.go:362] scp C:\Users\jenkins.minikube4\minikube-integration\.minikube\proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)

	I1216 11:40:16.176067   10008 ssh_runner.go:362] scp C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\old-k8s-version-501600\apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)

	I1216 11:40:16.238190   10008 ssh_runner.go:362] scp C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\old-k8s-version-501600\apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)

	I1216 11:40:16.324010   10008 ssh_runner.go:362] scp C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\old-k8s-version-501600\proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)

	I1216 11:40:16.380615   10008 ssh_runner.go:362] scp C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\old-k8s-version-501600\proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)

	I1216 11:40:16.461729   10008 ssh_runner.go:362] scp C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\11452.pem --> /usr/share/ca-certificates/11452.pem (1338 bytes)

	I1216 11:40:16.601419   10008 ssh_runner.go:362] scp C:\Users\jenkins.minikube4\minikube-integration\.minikube\files\etc\ssl\certs\114522.pem --> /usr/share/ca-certificates/114522.pem (1708 bytes)

	I1216 11:40:16.655428   10008 ssh_runner.go:362] scp C:\Users\jenkins.minikube4\minikube-integration\.minikube\ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)

	I1216 11:40:16.722744   10008 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)

	I1216 11:40:16.837880   10008 ssh_runner.go:195] Run: openssl version

	I1216 11:40:16.943018   10008 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/11452.pem && ln -fs /usr/share/ca-certificates/11452.pem /etc/ssl/certs/11452.pem"

	I1216 11:40:17.060440   10008 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/11452.pem

	I1216 11:40:17.113203   10008 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Dec 16 10:33 /usr/share/ca-certificates/11452.pem

	I1216 11:40:17.131219   10008 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/11452.pem

	I1216 11:40:17.167198   10008 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/11452.pem /etc/ssl/certs/51391683.0"

	I1216 11:40:17.237141   10008 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/114522.pem && ln -fs /usr/share/ca-certificates/114522.pem /etc/ssl/certs/114522.pem"

	I1216 11:40:17.279930   10008 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/114522.pem

	I1216 11:40:17.311302   10008 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Dec 16 10:33 /usr/share/ca-certificates/114522.pem

	I1216 11:40:17.334136   10008 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/114522.pem

	I1216 11:40:17.374061   10008 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/114522.pem /etc/ssl/certs/3ec20f2e.0"

	I1216 11:40:17.459676   10008 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"

	I1216 11:40:17.568411   10008 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem

	I1216 11:40:17.614376   10008 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Dec 16 10:22 /usr/share/ca-certificates/minikubeCA.pem

	I1216 11:40:17.639127   10008 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem

	I1216 11:40:17.672095   10008 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"

	I1216 11:40:17.755124   10008 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt

	I1216 11:40:17.849324   10008 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-etcd-client.crt -checkend 86400

	I1216 11:40:17.878593   10008 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-kubelet-client.crt -checkend 86400

	I1216 11:40:17.947589   10008 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/server.crt -checkend 86400

	I1216 11:40:17.982659   10008 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/healthcheck-client.crt -checkend 86400

	I1216 11:40:18.043748   10008 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/peer.crt -checkend 86400

	I1216 11:40:18.078759   10008 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/front-proxy-client.crt -checkend 86400

	I1216 11:40:18.122076   10008 kubeadm.go:392] StartCluster: {Name:old-k8s-version-501600 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1733912881-20083@sha256:64d8b27f78fd269d886e21ba8fc88be20de183ba5cc5bce33d0810e8a65f1df2 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-501600 Namespace:default APIServerHAVIP: APIServerName:minikube

CA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.94.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:C:\Users\jenkin

s.minikube4:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I1216 11:40:18.140592   10008 ssh_runner.go:195] Run: docker ps --filter status=paused --filter=name=k8s_.*_(kube-system)_ --format={{.ID}}

	I1216 11:40:18.253261   10008 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd

	I1216 11:40:18.325287   10008 kubeadm.go:408] found existing configuration files, will attempt cluster restart

	I1216 11:40:18.325287   10008 kubeadm.go:593] restartPrimaryControlPlane start ...

	I1216 11:40:18.343698   10008 ssh_runner.go:195] Run: sudo test -d /data/minikube

	I1216 11:40:18.416002   10008 kubeadm.go:130] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1

	stdout:

	stderr:

	I1216 11:40:18.432011   10008 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "8443/tcp") 0).HostPort}}'" old-k8s-version-501600

	I1216 11:40:18.519995   10008 kubeconfig.go:47] verify endpoint returned: get endpoint: "old-k8s-version-501600" does not appear in C:\Users\jenkins.minikube4\minikube-integration\kubeconfig

	I1216 11:40:18.522006   10008 kubeconfig.go:62] C:\Users\jenkins.minikube4\minikube-integration\kubeconfig needs updating (will repair): [kubeconfig missing "old-k8s-version-501600" cluster setting kubeconfig missing "old-k8s-version-501600" context setting]

	I1216 11:40:18.525015   10008 lock.go:35] WriteFile acquiring C:\Users\jenkins.minikube4\minikube-integration\kubeconfig: {Name:mk97c09b788e5010ffd4c9dd9525f9245d5edd25 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1216 11:40:18.565999   10008 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new

	I1216 11:40:18.721357   10008 kubeadm.go:630] The running cluster does not require reconfiguration: 127.0.0.1

	I1216 11:40:18.721357   10008 kubeadm.go:597] duration metric: took 396.0513ms to restartPrimaryControlPlane

	I1216 11:40:18.721357   10008 kubeadm.go:394] duration metric: took 599.4721ms to StartCluster

	I1216 11:40:18.721357   10008 settings.go:142] acquiring lock: {Name:mk5d8710830d010adb6db61f855b0ef766a8622c Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1216 11:40:18.721357   10008 settings.go:150] Updating kubeconfig:  C:\Users\jenkins.minikube4\minikube-integration\kubeconfig

	I1216 11:40:18.731033   10008 lock.go:35] WriteFile acquiring C:\Users\jenkins.minikube4\minikube-integration\kubeconfig: {Name:mk97c09b788e5010ffd4c9dd9525f9245d5edd25 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1216 11:40:18.732558   10008 start.go:235] Will wait 6m0s for node &{Name: IP:192.168.94.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:docker ControlPlane:true Worker:true}

	I1216 11:40:18.732558   10008 addons.go:507] enable addons start: toEnable=map[ambassador:false amd-gpu-device-plugin:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:true default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false]

	I1216 11:40:18.733555   10008 addons.go:69] Setting storage-provisioner=true in profile "old-k8s-version-501600"

	I1216 11:40:18.733555   10008 addons.go:234] Setting addon storage-provisioner=true in "old-k8s-version-501600"

	W1216 11:40:18.733555   10008 addons.go:243] addon storage-provisioner should already be in state true

	I1216 11:40:18.733555   10008 addons.go:69] Setting default-storageclass=true in profile "old-k8s-version-501600"

	I1216 11:40:18.733555   10008 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "old-k8s-version-501600"

	I1216 11:40:18.734562   10008 config.go:182] Loaded profile config "old-k8s-version-501600": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.20.0

	I1216 11:40:18.734562   10008 host.go:66] Checking if "old-k8s-version-501600" exists ...

	I1216 11:40:18.734562   10008 addons.go:69] Setting metrics-server=true in profile "old-k8s-version-501600"

	I1216 11:40:18.734562   10008 addons.go:234] Setting addon metrics-server=true in "old-k8s-version-501600"

	W1216 11:40:18.734562   10008 addons.go:243] addon metrics-server should already be in state true

	I1216 11:40:18.734562   10008 addons.go:69] Setting dashboard=true in profile "old-k8s-version-501600"

	I1216 11:40:18.734562   10008 addons.go:234] Setting addon dashboard=true in "old-k8s-version-501600"

	W1216 11:40:18.734562   10008 addons.go:243] addon dashboard should already be in state true

	I1216 11:40:18.734562   10008 host.go:66] Checking if "old-k8s-version-501600" exists ...

	I1216 11:40:18.734562   10008 host.go:66] Checking if "old-k8s-version-501600" exists ...

	I1216 11:40:18.736558   10008 out.go:177] * Verifying Kubernetes components...

	I1216 11:40:18.763659   10008 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I1216 11:40:18.765642   10008 cli_runner.go:164] Run: docker container inspect old-k8s-version-501600 --format={{.State.Status}}

	I1216 11:40:18.767658   10008 cli_runner.go:164] Run: docker container inspect old-k8s-version-501600 --format={{.State.Status}}

	I1216 11:40:18.768655   10008 cli_runner.go:164] Run: docker container inspect old-k8s-version-501600 --format={{.State.Status}}

	I1216 11:40:18.769662   10008 cli_runner.go:164] Run: docker container inspect old-k8s-version-501600 --format={{.State.Status}}

	I1216 11:40:18.867088   10008 out.go:177]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5

	I1216 11:40:18.868086   10008 out.go:177]   - Using image fake.domain/registry.k8s.io/echoserver:1.4

	I1216 11:40:18.870091   10008 addons.go:431] installing /etc/kubernetes/addons/storage-provisioner.yaml

	I1216 11:40:18.870091   10008 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)

	I1216 11:40:18.872095   10008 addons.go:431] installing /etc/kubernetes/addons/metrics-apiservice.yaml

	I1216 11:40:18.872095   10008 ssh_runner.go:362] scp metrics-server/metrics-apiservice.yaml --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)

	I1216 11:40:18.875099   10008 out.go:177]   - Using image docker.io/kubernetesui/dashboard:v2.7.0

	I1216 11:40:18.876089   10008 addons.go:234] Setting addon default-storageclass=true in "old-k8s-version-501600"

	W1216 11:40:18.876089   10008 addons.go:243] addon default-storageclass should already be in state true

	I1216 11:40:18.877089   10008 host.go:66] Checking if "old-k8s-version-501600" exists ...

	I1216 11:40:18.879104   10008 out.go:177]   - Using image registry.k8s.io/echoserver:1.4

	I1216 11:40:18.881089   10008 addons.go:431] installing /etc/kubernetes/addons/dashboard-ns.yaml

	I1216 11:40:18.881089   10008 ssh_runner.go:362] scp dashboard/dashboard-ns.yaml --> /etc/kubernetes/addons/dashboard-ns.yaml (759 bytes)

	I1216 11:40:18.881089   10008 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-501600

	I1216 11:40:18.881089   10008 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-501600

	I1216 11:40:18.894091   10008 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-501600

	I1216 11:40:18.898091   10008 cli_runner.go:164] Run: docker container inspect old-k8s-version-501600 --format={{.State.Status}}

	I1216 11:40:18.980947   10008 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:52654 SSHKeyPath:C:\Users\jenkins.minikube4\minikube-integration\.minikube\machines\old-k8s-version-501600\id_rsa Username:docker}

	I1216 11:40:18.981960   10008 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:52654 SSHKeyPath:C:\Users\jenkins.minikube4\minikube-integration\.minikube\machines\old-k8s-version-501600\id_rsa Username:docker}

	I1216 11:40:18.989943   10008 addons.go:431] installing /etc/kubernetes/addons/storageclass.yaml

	I1216 11:40:18.989943   10008 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)

	I1216 11:40:18.991952   10008 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:52654 SSHKeyPath:C:\Users\jenkins.minikube4\minikube-integration\.minikube\machines\old-k8s-version-501600\id_rsa Username:docker}

	I1216 11:40:18.999953   10008 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-501600

	I1216 11:40:19.080110   10008 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:52654 SSHKeyPath:C:\Users\jenkins.minikube4\minikube-integration\.minikube\machines\old-k8s-version-501600\id_rsa Username:docker}

	I1216 11:40:19.551382   10008 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml

	I1216 11:40:19.555326   10008 ssh_runner.go:195] Run: sudo systemctl start kubelet

	I1216 11:40:19.621108   10008 addons.go:431] installing /etc/kubernetes/addons/metrics-server-deployment.yaml

	I1216 11:40:19.621108   10008 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1825 bytes)

	I1216 11:40:19.722019   10008 addons.go:431] installing /etc/kubernetes/addons/dashboard-clusterrole.yaml

	I1216 11:40:19.722019   10008 ssh_runner.go:362] scp dashboard/dashboard-clusterrole.yaml --> /etc/kubernetes/addons/dashboard-clusterrole.yaml (1001 bytes)

	I1216 11:40:19.735741   10008 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml

	I1216 11:40:19.834511   10008 addons.go:431] installing /etc/kubernetes/addons/metrics-server-rbac.yaml

	I1216 11:40:19.834511   10008 ssh_runner.go:362] scp metrics-server/metrics-server-rbac.yaml --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)

	I1216 11:40:19.931761   10008 addons.go:431] installing /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml

	I1216 11:40:19.931848   10008 ssh_runner.go:362] scp dashboard/dashboard-clusterrolebinding.yaml --> /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml (1018 bytes)

	I1216 11:40:20.121176   10008 addons.go:431] installing /etc/kubernetes/addons/metrics-server-service.yaml

	I1216 11:40:20.121176   10008 ssh_runner.go:362] scp metrics-server/metrics-server-service.yaml --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)

	I1216 11:40:20.209695   10008 addons.go:431] installing /etc/kubernetes/addons/dashboard-configmap.yaml

	I1216 11:40:20.209695   10008 ssh_runner.go:362] scp dashboard/dashboard-configmap.yaml --> /etc/kubernetes/addons/dashboard-configmap.yaml (837 bytes)

	W1216 11:40:20.408947   10008 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	I1216 11:40:20.408947   10008 retry.go:31] will retry after 235.750787ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	I1216 11:40:20.433132   10008 addons.go:431] installing /etc/kubernetes/addons/dashboard-dp.yaml

	I1216 11:40:20.433348   10008 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-dp.yaml (4201 bytes)

	I1216 11:40:20.433762   10008 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "8443/tcp") 0).HostPort}}'" old-k8s-version-501600

	I1216 11:40:20.445288   10008 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml

	I1216 11:40:20.533816   10008 node_ready.go:35] waiting up to 6m0s for node "old-k8s-version-501600" to be "Ready" ...

	I1216 11:40:20.658129   10008 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml

	W1216 11:40:20.713433   10008 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	I1216 11:40:20.713750   10008 retry.go:31] will retry after 363.578946ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	I1216 11:40:20.725916   10008 addons.go:431] installing /etc/kubernetes/addons/dashboard-role.yaml

	I1216 11:40:20.725916   10008 ssh_runner.go:362] scp dashboard/dashboard-role.yaml --> /etc/kubernetes/addons/dashboard-role.yaml (1724 bytes)

	I1216 11:40:21.029805   10008 addons.go:431] installing /etc/kubernetes/addons/dashboard-rolebinding.yaml

	I1216 11:40:21.029805   10008 ssh_runner.go:362] scp dashboard/dashboard-rolebinding.yaml --> /etc/kubernetes/addons/dashboard-rolebinding.yaml (1046 bytes)

	I1216 11:40:21.088182   10008 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml

	I1216 11:40:21.232645   10008 addons.go:431] installing /etc/kubernetes/addons/dashboard-sa.yaml

	I1216 11:40:21.232645   10008 ssh_runner.go:362] scp dashboard/dashboard-sa.yaml --> /etc/kubernetes/addons/dashboard-sa.yaml (837 bytes)

	W1216 11:40:21.415106   10008 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	I1216 11:40:21.415106   10008 retry.go:31] will retry after 250.380985ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	W1216 11:40:21.627691   10008 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	I1216 11:40:21.627691   10008 retry.go:31] will retry after 511.866538ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	I1216 11:40:21.632634   10008 addons.go:431] installing /etc/kubernetes/addons/dashboard-secret.yaml

	I1216 11:40:21.632634   10008 ssh_runner.go:362] scp dashboard/dashboard-secret.yaml --> /etc/kubernetes/addons/dashboard-secret.yaml (1389 bytes)

	I1216 11:40:21.675030   10008 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml

	I1216 11:40:21.920328   10008 addons.go:431] installing /etc/kubernetes/addons/dashboard-svc.yaml

	I1216 11:40:21.920328   10008 ssh_runner.go:362] scp dashboard/dashboard-svc.yaml --> /etc/kubernetes/addons/dashboard-svc.yaml (1294 bytes)

	W1216 11:40:21.922342   10008 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	I1216 11:40:21.922342   10008 retry.go:31] will retry after 377.847638ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	I1216 11:40:22.158837   10008 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml

	I1216 11:40:22.162845   10008 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml

	I1216 11:40:22.316381   10008 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml

	I1216 11:40:30.521787   10008 node_ready.go:49] node "old-k8s-version-501600" has status "Ready":"True"

	I1216 11:40:30.521787   10008 node_ready.go:38] duration metric: took 9.9875042s for node "old-k8s-version-501600" to be "Ready" ...

	I1216 11:40:30.521787   10008 pod_ready.go:36] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I1216 11:40:30.931994   10008 pod_ready.go:79] waiting up to 6m0s for pod "coredns-74ff55c5b-9fdb9" in "kube-system" namespace to be "Ready" ...

	I1216 11:40:31.610412   10008 pod_ready.go:93] pod "coredns-74ff55c5b-9fdb9" in "kube-system" namespace has status "Ready":"True"

	I1216 11:40:31.610412   10008 pod_ready.go:82] duration metric: took 678.3861ms for pod "coredns-74ff55c5b-9fdb9" in "kube-system" namespace to be "Ready" ...

	I1216 11:40:31.610412   10008 pod_ready.go:79] waiting up to 6m0s for pod "etcd-old-k8s-version-501600" in "kube-system" namespace to be "Ready" ...

	I1216 11:40:33.144981   10008 pod_ready.go:93] pod "etcd-old-k8s-version-501600" in "kube-system" namespace has status "Ready":"True"

	I1216 11:40:33.144981   10008 pod_ready.go:82] duration metric: took 1.5344968s for pod "etcd-old-k8s-version-501600" in "kube-system" namespace to be "Ready" ...

	I1216 11:40:33.144981   10008 pod_ready.go:79] waiting up to 6m0s for pod "kube-apiserver-old-k8s-version-501600" in "kube-system" namespace to be "Ready" ...

	I1216 11:40:33.260968   10008 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (11.5853977s)

	I1216 11:40:33.260968   10008 addons.go:475] Verifying addon metrics-server=true in "old-k8s-version-501600"

	I1216 11:40:33.260968   10008 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: (11.0976047s)

	I1216 11:40:35.215440   10008 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: (13.0559934s)

	I1216 11:40:35.215440   10008 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: (12.8984571s)

	I1216 11:40:35.218386   10008 out.go:177] * Some dashboard features require the metrics-server addon. To enable all features please run:

		minikube -p old-k8s-version-501600 addons enable metrics-server

	I1216 11:40:35.240375   10008 pod_ready.go:103] pod "kube-apiserver-old-k8s-version-501600" in "kube-system" namespace has status "Ready":"False"

	I1216 11:40:35.327404   10008 out.go:177] * Enabled addons: metrics-server, storage-provisioner, dashboard, default-storageclass

	I1216 11:40:35.330420   10008 addons.go:510] duration metric: took 16.5970873s for enable addons: enabled=[metrics-server storage-provisioner dashboard default-storageclass]

	I1216 11:40:37.243575   10008 pod_ready.go:103] pod "kube-apiserver-old-k8s-version-501600" in "kube-system" namespace has status "Ready":"False"

	I1216 11:40:38.661747   10008 pod_ready.go:93] pod "kube-apiserver-old-k8s-version-501600" in "kube-system" namespace has status "Ready":"True"

	I1216 11:40:38.661747   10008 pod_ready.go:82] duration metric: took 5.5165088s for pod "kube-apiserver-old-k8s-version-501600" in "kube-system" namespace to be "Ready" ...

	I1216 11:40:38.661747   10008 pod_ready.go:79] waiting up to 6m0s for pod "kube-controller-manager-old-k8s-version-501600" in "kube-system" namespace to be "Ready" ...

	I1216 11:40:40.674821   10008 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-501600" in "kube-system" namespace has status "Ready":"False"

	I1216 11:40:42.675181   10008 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-501600" in "kube-system" namespace has status "Ready":"False"

	I1216 11:40:44.678083   10008 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-501600" in "kube-system" namespace has status "Ready":"False"

	I1216 11:40:47.176228   10008 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-501600" in "kube-system" namespace has status "Ready":"False"

	I1216 11:40:49.181772   10008 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-501600" in "kube-system" namespace has status "Ready":"False"

	I1216 11:40:51.226177   10008 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-501600" in "kube-system" namespace has status "Ready":"False"

	I1216 11:40:53.676379   10008 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-501600" in "kube-system" namespace has status "Ready":"False"

	I1216 11:40:55.679028   10008 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-501600" in "kube-system" namespace has status "Ready":"False"

	I1216 11:40:57.682125   10008 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-501600" in "kube-system" namespace has status "Ready":"False"

	I1216 11:41:00.181270   10008 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-501600" in "kube-system" namespace has status "Ready":"False"

	I1216 11:41:02.682999   10008 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-501600" in "kube-system" namespace has status "Ready":"False"

	I1216 11:41:05.916396   10008 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-501600" in "kube-system" namespace has status "Ready":"False"

	I1216 11:41:08.242756   10008 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-501600" in "kube-system" namespace has status "Ready":"False"

	I1216 11:41:10.738235   10008 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-501600" in "kube-system" namespace has status "Ready":"False"

	I1216 11:41:13.177762   10008 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-501600" in "kube-system" namespace has status "Ready":"False"

	I1216 11:41:15.179601   10008 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-501600" in "kube-system" namespace has status "Ready":"False"

	I1216 11:41:17.679171   10008 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-501600" in "kube-system" namespace has status "Ready":"False"

	I1216 11:41:20.179796   10008 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-501600" in "kube-system" namespace has status "Ready":"False"

	I1216 11:41:22.679103   10008 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-501600" in "kube-system" namespace has status "Ready":"False"

	I1216 11:41:25.179400   10008 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-501600" in "kube-system" namespace has status "Ready":"False"

	I1216 11:41:27.180766   10008 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-501600" in "kube-system" namespace has status "Ready":"False"

	I1216 11:41:29.680951   10008 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-501600" in "kube-system" namespace has status "Ready":"False"

	I1216 11:41:32.178216   10008 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-501600" in "kube-system" namespace has status "Ready":"False"

	I1216 11:41:34.179629   10008 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-501600" in "kube-system" namespace has status "Ready":"False"

	I1216 11:41:36.680974   10008 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-501600" in "kube-system" namespace has status "Ready":"False"

	I1216 11:41:39.180179   10008 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-501600" in "kube-system" namespace has status "Ready":"False"

	I1216 11:41:41.181898   10008 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-501600" in "kube-system" namespace has status "Ready":"False"

	I1216 11:41:43.678608   10008 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-501600" in "kube-system" namespace has status "Ready":"False"

	I1216 11:41:45.681171   10008 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-501600" in "kube-system" namespace has status "Ready":"False"

	I1216 11:41:48.179147   10008 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-501600" in "kube-system" namespace has status "Ready":"False"

	I1216 11:41:50.179628   10008 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-501600" in "kube-system" namespace has status "Ready":"False"

	I1216 11:41:52.181535   10008 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-501600" in "kube-system" namespace has status "Ready":"False"

	I1216 11:41:54.183317   10008 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-501600" in "kube-system" namespace has status "Ready":"False"

	I1216 11:41:55.179991   10008 pod_ready.go:93] pod "kube-controller-manager-old-k8s-version-501600" in "kube-system" namespace has status "Ready":"True"

	I1216 11:41:55.179991   10008 pod_ready.go:82] duration metric: took 1m16.5146718s for pod "kube-controller-manager-old-k8s-version-501600" in "kube-system" namespace to be "Ready" ...

	I1216 11:41:55.179991   10008 pod_ready.go:79] waiting up to 6m0s for pod "kube-proxy-j2ct6" in "kube-system" namespace to be "Ready" ...

	I1216 11:41:55.191072   10008 pod_ready.go:93] pod "kube-proxy-j2ct6" in "kube-system" namespace has status "Ready":"True"

	I1216 11:41:55.191178   10008 pod_ready.go:82] duration metric: took 11.1862ms for pod "kube-proxy-j2ct6" in "kube-system" namespace to be "Ready" ...

	I1216 11:41:55.191178   10008 pod_ready.go:79] waiting up to 6m0s for pod "kube-scheduler-old-k8s-version-501600" in "kube-system" namespace to be "Ready" ...

	I1216 11:41:55.203680   10008 pod_ready.go:93] pod "kube-scheduler-old-k8s-version-501600" in "kube-system" namespace has status "Ready":"True"

	I1216 11:41:55.203739   10008 pod_ready.go:82] duration metric: took 12.5607ms for pod "kube-scheduler-old-k8s-version-501600" in "kube-system" namespace to be "Ready" ...

	I1216 11:41:55.203739   10008 pod_ready.go:79] waiting up to 6m0s for pod "metrics-server-9975d5f86-zn4gg" in "kube-system" namespace to be "Ready" ...

	I1216 11:41:57.217852   10008 pod_ready.go:103] pod "metrics-server-9975d5f86-zn4gg" in "kube-system" namespace has status "Ready":"False"

	I1216 11:41:59.218980   10008 pod_ready.go:103] pod "metrics-server-9975d5f86-zn4gg" in "kube-system" namespace has status "Ready":"False"

	I1216 11:42:01.719847   10008 pod_ready.go:103] pod "metrics-server-9975d5f86-zn4gg" in "kube-system" namespace has status "Ready":"False"

	I1216 11:42:04.220146   10008 pod_ready.go:103] pod "metrics-server-9975d5f86-zn4gg" in "kube-system" namespace has status "Ready":"False"

	I1216 11:42:06.720005   10008 pod_ready.go:103] pod "metrics-server-9975d5f86-zn4gg" in "kube-system" namespace has status "Ready":"False"

	I1216 11:42:09.219107   10008 pod_ready.go:103] pod "metrics-server-9975d5f86-zn4gg" in "kube-system" namespace has status "Ready":"False"

	I1216 11:42:11.719301   10008 pod_ready.go:103] pod "metrics-server-9975d5f86-zn4gg" in "kube-system" namespace has status "Ready":"False"

	I1216 11:42:13.721677   10008 pod_ready.go:103] pod "metrics-server-9975d5f86-zn4gg" in "kube-system" namespace has status "Ready":"False"

	I1216 11:42:16.220198   10008 pod_ready.go:103] pod "metrics-server-9975d5f86-zn4gg" in "kube-system" namespace has status "Ready":"False"

	I1216 11:42:18.222309   10008 pod_ready.go:103] pod "metrics-server-9975d5f86-zn4gg" in "kube-system" namespace has status "Ready":"False"

	I1216 11:42:20.226861   10008 pod_ready.go:103] pod "metrics-server-9975d5f86-zn4gg" in "kube-system" namespace has status "Ready":"False"

	I1216 11:42:22.721908   10008 pod_ready.go:103] pod "metrics-server-9975d5f86-zn4gg" in "kube-system" namespace has status "Ready":"False"

	I1216 11:42:25.221599   10008 pod_ready.go:103] pod "metrics-server-9975d5f86-zn4gg" in "kube-system" namespace has status "Ready":"False"

	I1216 11:42:27.720636   10008 pod_ready.go:103] pod "metrics-server-9975d5f86-zn4gg" in "kube-system" namespace has status "Ready":"False"

	I1216 11:42:30.222593   10008 pod_ready.go:103] pod "metrics-server-9975d5f86-zn4gg" in "kube-system" namespace has status "Ready":"False"

	I1216 11:42:32.719637   10008 pod_ready.go:103] pod "metrics-server-9975d5f86-zn4gg" in "kube-system" namespace has status "Ready":"False"

	I1216 11:42:34.721357   10008 pod_ready.go:103] pod "metrics-server-9975d5f86-zn4gg" in "kube-system" namespace has status "Ready":"False"

	I1216 11:42:37.221530   10008 pod_ready.go:103] pod "metrics-server-9975d5f86-zn4gg" in "kube-system" namespace has status "Ready":"False"

	I1216 11:42:39.222407   10008 pod_ready.go:103] pod "metrics-server-9975d5f86-zn4gg" in "kube-system" namespace has status "Ready":"False"

	I1216 11:42:41.226601   10008 pod_ready.go:103] pod "metrics-server-9975d5f86-zn4gg" in "kube-system" namespace has status "Ready":"False"

	I1216 11:42:43.722371   10008 pod_ready.go:103] pod "metrics-server-9975d5f86-zn4gg" in "kube-system" namespace has status "Ready":"False"

	I1216 11:42:46.224358   10008 pod_ready.go:103] pod "metrics-server-9975d5f86-zn4gg" in "kube-system" namespace has status "Ready":"False"

	I1216 11:42:48.720438   10008 pod_ready.go:103] pod "metrics-server-9975d5f86-zn4gg" in "kube-system" namespace has status "Ready":"False"

	I1216 11:42:50.720813   10008 pod_ready.go:103] pod "metrics-server-9975d5f86-zn4gg" in "kube-system" namespace has status "Ready":"False"

	I1216 11:42:52.729262   10008 pod_ready.go:103] pod "metrics-server-9975d5f86-zn4gg" in "kube-system" namespace has status "Ready":"False"

	I1216 11:42:55.221772   10008 pod_ready.go:103] pod "metrics-server-9975d5f86-zn4gg" in "kube-system" namespace has status "Ready":"False"

	I1216 11:42:57.223398   10008 pod_ready.go:103] pod "metrics-server-9975d5f86-zn4gg" in "kube-system" namespace has status "Ready":"False"

	I1216 11:42:59.720808   10008 pod_ready.go:103] pod "metrics-server-9975d5f86-zn4gg" in "kube-system" namespace has status "Ready":"False"

	I1216 11:43:01.721020   10008 pod_ready.go:103] pod "metrics-server-9975d5f86-zn4gg" in "kube-system" namespace has status "Ready":"False"

	I1216 11:43:03.722668   10008 pod_ready.go:103] pod "metrics-server-9975d5f86-zn4gg" in "kube-system" namespace has status "Ready":"False"

	I1216 11:43:06.221485   10008 pod_ready.go:103] pod "metrics-server-9975d5f86-zn4gg" in "kube-system" namespace has status "Ready":"False"

	I1216 11:43:08.224214   10008 pod_ready.go:103] pod "metrics-server-9975d5f86-zn4gg" in "kube-system" namespace has status "Ready":"False"

	I1216 11:43:10.721830   10008 pod_ready.go:103] pod "metrics-server-9975d5f86-zn4gg" in "kube-system" namespace has status "Ready":"False"

	I1216 11:43:12.722017   10008 pod_ready.go:103] pod "metrics-server-9975d5f86-zn4gg" in "kube-system" namespace has status "Ready":"False"

	I1216 11:43:15.225137   10008 pod_ready.go:103] pod "metrics-server-9975d5f86-zn4gg" in "kube-system" namespace has status "Ready":"False"

	I1216 11:43:17.721433   10008 pod_ready.go:103] pod "metrics-server-9975d5f86-zn4gg" in "kube-system" namespace has status "Ready":"False"

	I1216 11:43:19.724340   10008 pod_ready.go:103] pod "metrics-server-9975d5f86-zn4gg" in "kube-system" namespace has status "Ready":"False"

	I1216 11:43:22.222287   10008 pod_ready.go:103] pod "metrics-server-9975d5f86-zn4gg" in "kube-system" namespace has status "Ready":"False"

	I1216 11:43:24.223148   10008 pod_ready.go:103] pod "metrics-server-9975d5f86-zn4gg" in "kube-system" namespace has status "Ready":"False"

	I1216 11:43:26.722686   10008 pod_ready.go:103] pod "metrics-server-9975d5f86-zn4gg" in "kube-system" namespace has status "Ready":"False"

	I1216 11:43:28.729336   10008 pod_ready.go:103] pod "metrics-server-9975d5f86-zn4gg" in "kube-system" namespace has status "Ready":"False"

	I1216 11:43:31.228806   10008 pod_ready.go:103] pod "metrics-server-9975d5f86-zn4gg" in "kube-system" namespace has status "Ready":"False"

	I1216 11:43:33.230090   10008 pod_ready.go:103] pod "metrics-server-9975d5f86-zn4gg" in "kube-system" namespace has status "Ready":"False"

	I1216 11:43:35.723053   10008 pod_ready.go:103] pod "metrics-server-9975d5f86-zn4gg" in "kube-system" namespace has status "Ready":"False"

	I1216 11:43:38.222424   10008 pod_ready.go:103] pod "metrics-server-9975d5f86-zn4gg" in "kube-system" namespace has status "Ready":"False"

	I1216 11:43:40.223174   10008 pod_ready.go:103] pod "metrics-server-9975d5f86-zn4gg" in "kube-system" namespace has status "Ready":"False"

	I1216 11:43:42.721962   10008 pod_ready.go:103] pod "metrics-server-9975d5f86-zn4gg" in "kube-system" namespace has status "Ready":"False"

	I1216 11:43:44.727772   10008 pod_ready.go:103] pod "metrics-server-9975d5f86-zn4gg" in "kube-system" namespace has status "Ready":"False"

	I1216 11:43:47.225460   10008 pod_ready.go:103] pod "metrics-server-9975d5f86-zn4gg" in "kube-system" namespace has status "Ready":"False"

	I1216 11:43:49.724375   10008 pod_ready.go:103] pod "metrics-server-9975d5f86-zn4gg" in "kube-system" namespace has status "Ready":"False"

	I1216 11:43:51.725849   10008 pod_ready.go:103] pod "metrics-server-9975d5f86-zn4gg" in "kube-system" namespace has status "Ready":"False"

	I1216 11:43:54.227262   10008 pod_ready.go:103] pod "metrics-server-9975d5f86-zn4gg" in "kube-system" namespace has status "Ready":"False"

	I1216 11:43:56.234301   10008 pod_ready.go:103] pod "metrics-server-9975d5f86-zn4gg" in "kube-system" namespace has status "Ready":"False"

	I1216 11:43:58.760843   10008 pod_ready.go:103] pod "metrics-server-9975d5f86-zn4gg" in "kube-system" namespace has status "Ready":"False"

	I1216 11:44:01.229597   10008 pod_ready.go:103] pod "metrics-server-9975d5f86-zn4gg" in "kube-system" namespace has status "Ready":"False"

	I1216 11:44:03.239790   10008 pod_ready.go:103] pod "metrics-server-9975d5f86-zn4gg" in "kube-system" namespace has status "Ready":"False"

	I1216 11:44:05.733005   10008 pod_ready.go:103] pod "metrics-server-9975d5f86-zn4gg" in "kube-system" namespace has status "Ready":"False"

	I1216 11:44:08.225217   10008 pod_ready.go:103] pod "metrics-server-9975d5f86-zn4gg" in "kube-system" namespace has status "Ready":"False"

	I1216 11:44:10.243666   10008 pod_ready.go:103] pod "metrics-server-9975d5f86-zn4gg" in "kube-system" namespace has status "Ready":"False"

	I1216 11:44:12.254265   10008 pod_ready.go:103] pod "metrics-server-9975d5f86-zn4gg" in "kube-system" namespace has status "Ready":"False"

	I1216 11:44:14.729625   10008 pod_ready.go:103] pod "metrics-server-9975d5f86-zn4gg" in "kube-system" namespace has status "Ready":"False"

	I1216 11:44:16.733288   10008 pod_ready.go:103] pod "metrics-server-9975d5f86-zn4gg" in "kube-system" namespace has status "Ready":"False"

	I1216 11:44:19.228577   10008 pod_ready.go:103] pod "metrics-server-9975d5f86-zn4gg" in "kube-system" namespace has status "Ready":"False"

	I1216 11:44:21.229814   10008 pod_ready.go:103] pod "metrics-server-9975d5f86-zn4gg" in "kube-system" namespace has status "Ready":"False"

	I1216 11:44:23.727987   10008 pod_ready.go:103] pod "metrics-server-9975d5f86-zn4gg" in "kube-system" namespace has status "Ready":"False"

	I1216 11:44:25.729806   10008 pod_ready.go:103] pod "metrics-server-9975d5f86-zn4gg" in "kube-system" namespace has status "Ready":"False"

	I1216 11:44:28.225504   10008 pod_ready.go:103] pod "metrics-server-9975d5f86-zn4gg" in "kube-system" namespace has status "Ready":"False"

	I1216 11:44:30.229486   10008 pod_ready.go:103] pod "metrics-server-9975d5f86-zn4gg" in "kube-system" namespace has status "Ready":"False"

	I1216 11:44:32.519088   10008 pod_ready.go:103] pod "metrics-server-9975d5f86-zn4gg" in "kube-system" namespace has status "Ready":"False"

	I1216 11:44:34.733790   10008 pod_ready.go:103] pod "metrics-server-9975d5f86-zn4gg" in "kube-system" namespace has status "Ready":"False"

	I1216 11:44:37.230001   10008 pod_ready.go:103] pod "metrics-server-9975d5f86-zn4gg" in "kube-system" namespace has status "Ready":"False"

	I1216 11:44:39.725452   10008 pod_ready.go:103] pod "metrics-server-9975d5f86-zn4gg" in "kube-system" namespace has status "Ready":"False"

	I1216 11:44:41.727089   10008 pod_ready.go:103] pod "metrics-server-9975d5f86-zn4gg" in "kube-system" namespace has status "Ready":"False"

	I1216 11:44:43.733557   10008 pod_ready.go:103] pod "metrics-server-9975d5f86-zn4gg" in "kube-system" namespace has status "Ready":"False"

	I1216 11:44:46.313130   10008 pod_ready.go:103] pod "metrics-server-9975d5f86-zn4gg" in "kube-system" namespace has status "Ready":"False"

	I1216 11:44:48.730666   10008 pod_ready.go:103] pod "metrics-server-9975d5f86-zn4gg" in "kube-system" namespace has status "Ready":"False"

	I1216 11:44:51.229171   10008 pod_ready.go:103] pod "metrics-server-9975d5f86-zn4gg" in "kube-system" namespace has status "Ready":"False"

	I1216 11:44:53.725584   10008 pod_ready.go:103] pod "metrics-server-9975d5f86-zn4gg" in "kube-system" namespace has status "Ready":"False"

	I1216 11:44:56.261507   10008 pod_ready.go:103] pod "metrics-server-9975d5f86-zn4gg" in "kube-system" namespace has status "Ready":"False"

	I1216 11:44:58.727012   10008 pod_ready.go:103] pod "metrics-server-9975d5f86-zn4gg" in "kube-system" namespace has status "Ready":"False"

	I1216 11:45:01.229972   10008 pod_ready.go:103] pod "metrics-server-9975d5f86-zn4gg" in "kube-system" namespace has status "Ready":"False"

	I1216 11:45:03.732187   10008 pod_ready.go:103] pod "metrics-server-9975d5f86-zn4gg" in "kube-system" namespace has status "Ready":"False"

	I1216 11:45:06.226270   10008 pod_ready.go:103] pod "metrics-server-9975d5f86-zn4gg" in "kube-system" namespace has status "Ready":"False"

	I1216 11:45:08.232659   10008 pod_ready.go:103] pod "metrics-server-9975d5f86-zn4gg" in "kube-system" namespace has status "Ready":"False"

	I1216 11:45:10.233861   10008 pod_ready.go:103] pod "metrics-server-9975d5f86-zn4gg" in "kube-system" namespace has status "Ready":"False"

	I1216 11:45:12.726920   10008 pod_ready.go:103] pod "metrics-server-9975d5f86-zn4gg" in "kube-system" namespace has status "Ready":"False"

	I1216 11:45:15.232071   10008 pod_ready.go:103] pod "metrics-server-9975d5f86-zn4gg" in "kube-system" namespace has status "Ready":"False"

	I1216 11:45:17.728808   10008 pod_ready.go:103] pod "metrics-server-9975d5f86-zn4gg" in "kube-system" namespace has status "Ready":"False"

	I1216 11:45:20.232862   10008 pod_ready.go:103] pod "metrics-server-9975d5f86-zn4gg" in "kube-system" namespace has status "Ready":"False"

	I1216 11:45:22.274018   10008 pod_ready.go:103] pod "metrics-server-9975d5f86-zn4gg" in "kube-system" namespace has status "Ready":"False"

	I1216 11:45:24.730544   10008 pod_ready.go:103] pod "metrics-server-9975d5f86-zn4gg" in "kube-system" namespace has status "Ready":"False"

	I1216 11:45:26.732899   10008 pod_ready.go:103] pod "metrics-server-9975d5f86-zn4gg" in "kube-system" namespace has status "Ready":"False"

	I1216 11:45:29.231878   10008 pod_ready.go:103] pod "metrics-server-9975d5f86-zn4gg" in "kube-system" namespace has status "Ready":"False"

	I1216 11:45:31.726082   10008 pod_ready.go:103] pod "metrics-server-9975d5f86-zn4gg" in "kube-system" namespace has status "Ready":"False"

	I1216 11:45:33.730264   10008 pod_ready.go:103] pod "metrics-server-9975d5f86-zn4gg" in "kube-system" namespace has status "Ready":"False"

	I1216 11:45:35.732927   10008 pod_ready.go:103] pod "metrics-server-9975d5f86-zn4gg" in "kube-system" namespace has status "Ready":"False"

	I1216 11:45:38.231504   10008 pod_ready.go:103] pod "metrics-server-9975d5f86-zn4gg" in "kube-system" namespace has status "Ready":"False"

	I1216 11:45:40.730278   10008 pod_ready.go:103] pod "metrics-server-9975d5f86-zn4gg" in "kube-system" namespace has status "Ready":"False"

	I1216 11:45:43.230721   10008 pod_ready.go:103] pod "metrics-server-9975d5f86-zn4gg" in "kube-system" namespace has status "Ready":"False"

	I1216 11:45:45.733181   10008 pod_ready.go:103] pod "metrics-server-9975d5f86-zn4gg" in "kube-system" namespace has status "Ready":"False"

	I1216 11:45:48.229977   10008 pod_ready.go:103] pod "metrics-server-9975d5f86-zn4gg" in "kube-system" namespace has status "Ready":"False"

	I1216 11:45:50.739673   10008 pod_ready.go:103] pod "metrics-server-9975d5f86-zn4gg" in "kube-system" namespace has status "Ready":"False"

	I1216 11:45:52.746845   10008 pod_ready.go:103] pod "metrics-server-9975d5f86-zn4gg" in "kube-system" namespace has status "Ready":"False"

	I1216 11:45:55.215463   10008 pod_ready.go:82] duration metric: took 4m0.0005382s for pod "metrics-server-9975d5f86-zn4gg" in "kube-system" namespace to be "Ready" ...

	E1216 11:45:55.215463   10008 pod_ready.go:67] WaitExtra: waitPodCondition: context deadline exceeded

	I1216 11:45:55.215463   10008 pod_ready.go:39] duration metric: took 5m24.6785372s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I1216 11:45:55.215463   10008 api_server.go:52] waiting for apiserver process to appear ...

	I1216 11:45:55.229052   10008 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}

	I1216 11:45:55.283198   10008 logs.go:282] 2 containers: [56bb0e9c28d2 7ddd764ff8e3]

	I1216 11:45:55.292442   10008 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}

	I1216 11:45:55.346187   10008 logs.go:282] 2 containers: [fd156a045ffd 25fc9ee43f0a]

	I1216 11:45:55.356179   10008 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}

	I1216 11:45:55.404135   10008 logs.go:282] 2 containers: [e314bd292ad5 219798af5c41]

	I1216 11:45:55.419537   10008 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}

	I1216 11:45:55.465097   10008 logs.go:282] 2 containers: [8ddd1a91749a 5bfd011d16fd]

	I1216 11:45:55.476099   10008 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}

	I1216 11:45:55.533343   10008 logs.go:282] 2 containers: [58e72cba6157 8cce9bacca4b]

	I1216 11:45:55.547070   10008 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}

	I1216 11:45:55.587061   10008 logs.go:282] 2 containers: [d341318320dc 268c261f4e09]

	I1216 11:45:55.598610   10008 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}

	I1216 11:45:55.649615   10008 logs.go:282] 0 containers: []

	W1216 11:45:55.649615   10008 logs.go:284] No container was found matching "kindnet"

	I1216 11:45:55.657946   10008 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kubernetes-dashboard --format={{.ID}}

	I1216 11:45:55.705368   10008 logs.go:282] 1 containers: [19b65a7c34eb]

	I1216 11:45:55.722321   10008 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}

	I1216 11:45:55.762938   10008 logs.go:282] 2 containers: [230a8a7960d9 2f9bdc06bf7f]

	I1216 11:45:55.762938   10008 logs.go:123] Gathering logs for storage-provisioner [2f9bdc06bf7f] ...

	I1216 11:45:55.762938   10008 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 2f9bdc06bf7f"

	I1216 11:45:55.810126   10008 logs.go:123] Gathering logs for coredns [219798af5c41] ...

	I1216 11:45:55.811139   10008 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 219798af5c41"

	I1216 11:45:55.866945   10008 logs.go:123] Gathering logs for kube-controller-manager [268c261f4e09] ...

	I1216 11:45:55.866945   10008 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 268c261f4e09"

	I1216 11:45:55.933598   10008 logs.go:123] Gathering logs for storage-provisioner [230a8a7960d9] ...

	I1216 11:45:55.933598   10008 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 230a8a7960d9"

	I1216 11:45:55.980190   10008 logs.go:123] Gathering logs for Docker ...

	I1216 11:45:55.980190   10008 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"

	I1216 11:45:56.028833   10008 logs.go:123] Gathering logs for dmesg ...

	I1216 11:45:56.028833   10008 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"

	I1216 11:45:56.056830   10008 logs.go:123] Gathering logs for etcd [25fc9ee43f0a] ...

	I1216 11:45:56.056889   10008 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 25fc9ee43f0a"

	I1216 11:45:56.131641   10008 logs.go:123] Gathering logs for kube-scheduler [8ddd1a91749a] ...

	I1216 11:45:56.131641   10008 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 8ddd1a91749a"

	I1216 11:45:56.178941   10008 logs.go:123] Gathering logs for coredns [e314bd292ad5] ...

	I1216 11:45:56.178941   10008 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 e314bd292ad5"

	I1216 11:45:56.237906   10008 logs.go:123] Gathering logs for kube-proxy [58e72cba6157] ...

	I1216 11:45:56.237906   10008 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 58e72cba6157"

	I1216 11:45:56.289913   10008 logs.go:123] Gathering logs for kube-proxy [8cce9bacca4b] ...

	I1216 11:45:56.289913   10008 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 8cce9bacca4b"

	I1216 11:45:56.361533   10008 logs.go:123] Gathering logs for kube-controller-manager [d341318320dc] ...

	I1216 11:45:56.361592   10008 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d341318320dc"

	I1216 11:45:56.443207   10008 logs.go:123] Gathering logs for describe nodes ...

	I1216 11:45:56.443207   10008 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"

	I1216 11:45:56.687695   10008 logs.go:123] Gathering logs for kube-apiserver [56bb0e9c28d2] ...

	I1216 11:45:56.687695   10008 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 56bb0e9c28d2"

	I1216 11:45:56.774695   10008 logs.go:123] Gathering logs for etcd [fd156a045ffd] ...

	I1216 11:45:56.774695   10008 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 fd156a045ffd"

	I1216 11:45:56.852703   10008 logs.go:123] Gathering logs for kubernetes-dashboard [19b65a7c34eb] ...

	I1216 11:45:56.852703   10008 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 19b65a7c34eb"

	I1216 11:45:56.919159   10008 logs.go:123] Gathering logs for container status ...

	I1216 11:45:56.919159   10008 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"

	I1216 11:45:57.049284   10008 logs.go:123] Gathering logs for kubelet ...

	I1216 11:45:57.049284   10008 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"

	W1216 11:45:57.155282   10008 logs.go:138] Found kubelet problem: Dec 16 11:40:30 old-k8s-version-501600 kubelet[1909]: E1216 11:40:30.611863    1909 reflector.go:138] object-"kube-system"/"storage-provisioner-token-h2pb2": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "storage-provisioner-token-h2pb2" is forbidden: User "system:node:old-k8s-version-501600" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-501600' and this object

	W1216 11:45:57.164285   10008 logs.go:138] Found kubelet problem: Dec 16 11:40:36 old-k8s-version-501600 kubelet[1909]: E1216 11:40:36.024919    1909 pod_workers.go:191] Error syncing pod d2896fe7-5eeb-43d2-95d6-927aef485e51 ("metrics-server-9975d5f86-zn4gg_kube-system(d2896fe7-5eeb-43d2-95d6-927aef485e51)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = Error response from daemon: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.65.254:53: no such host"

	W1216 11:45:57.166149   10008 logs.go:138] Found kubelet problem: Dec 16 11:40:37 old-k8s-version-501600 kubelet[1909]: E1216 11:40:37.028492    1909 pod_workers.go:191] Error syncing pod d2896fe7-5eeb-43d2-95d6-927aef485e51 ("metrics-server-9975d5f86-zn4gg_kube-system(d2896fe7-5eeb-43d2-95d6-927aef485e51)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1216 11:45:57.166991   10008 logs.go:138] Found kubelet problem: Dec 16 11:40:38 old-k8s-version-501600 kubelet[1909]: E1216 11:40:38.707195    1909 pod_workers.go:191] Error syncing pod d2896fe7-5eeb-43d2-95d6-927aef485e51 ("metrics-server-9975d5f86-zn4gg_kube-system(d2896fe7-5eeb-43d2-95d6-927aef485e51)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1216 11:45:57.169926   10008 logs.go:138] Found kubelet problem: Dec 16 11:40:51 old-k8s-version-501600 kubelet[1909]: E1216 11:40:51.972752    1909 pod_workers.go:191] Error syncing pod d2896fe7-5eeb-43d2-95d6-927aef485e51 ("metrics-server-9975d5f86-zn4gg_kube-system(d2896fe7-5eeb-43d2-95d6-927aef485e51)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = Error response from daemon: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.65.254:53: no such host"

	W1216 11:45:57.173553   10008 logs.go:138] Found kubelet problem: Dec 16 11:40:53 old-k8s-version-501600 kubelet[1909]: E1216 11:40:53.819814    1909 pod_workers.go:191] Error syncing pod 37a1d62a-03f1-4e8e-bd42-ca72275d6ccb ("dashboard-metrics-scraper-8d5bb5db8-4wwm7_kubernetes-dashboard(37a1d62a-03f1-4e8e-bd42-ca72275d6ccb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ErrImagePull: "rpc error: code = Unknown desc = [DEPRECATION NOTICE] Docker Image Format v1 and Docker Image manifest version 2, schema 1 support is disabled by default and will be removed in an upcoming release. Suggest the author of registry.k8s.io/echoserver:1.4 to upgrade the image to the OCI Format or Docker Image manifest v2, schema 2. More information at https://docs.docker.com/go/deprecated-image-specs/"

	W1216 11:45:57.173553   10008 logs.go:138] Found kubelet problem: Dec 16 11:40:54 old-k8s-version-501600 kubelet[1909]: E1216 11:40:54.247688    1909 pod_workers.go:191] Error syncing pod 37a1d62a-03f1-4e8e-bd42-ca72275d6ccb ("dashboard-metrics-scraper-8d5bb5db8-4wwm7_kubernetes-dashboard(37a1d62a-03f1-4e8e-bd42-ca72275d6ccb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""

	W1216 11:45:57.173553   10008 logs.go:138] Found kubelet problem: Dec 16 11:40:55 old-k8s-version-501600 kubelet[1909]: E1216 11:40:55.271609    1909 pod_workers.go:191] Error syncing pod 37a1d62a-03f1-4e8e-bd42-ca72275d6ccb ("dashboard-metrics-scraper-8d5bb5db8-4wwm7_kubernetes-dashboard(37a1d62a-03f1-4e8e-bd42-ca72275d6ccb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""

	W1216 11:45:57.174552   10008 logs.go:138] Found kubelet problem: Dec 16 11:40:59 old-k8s-version-501600 kubelet[1909]: E1216 11:40:59.364188    1909 pod_workers.go:191] Error syncing pod 21b24a0c-f627-4a14-9eb5-704f6fe85772 ("storage-provisioner_kube-system(21b24a0c-f627-4a14-9eb5-704f6fe85772)"), skipping: failed to "StartContainer" for "storage-provisioner" with CrashLoopBackOff: "back-off 10s restarting failed container=storage-provisioner pod=storage-provisioner_kube-system(21b24a0c-f627-4a14-9eb5-704f6fe85772)"

	W1216 11:45:57.174552   10008 logs.go:138] Found kubelet problem: Dec 16 11:41:04 old-k8s-version-501600 kubelet[1909]: E1216 11:41:04.917670    1909 pod_workers.go:191] Error syncing pod d2896fe7-5eeb-43d2-95d6-927aef485e51 ("metrics-server-9975d5f86-zn4gg_kube-system(d2896fe7-5eeb-43d2-95d6-927aef485e51)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1216 11:45:57.181565   10008 logs.go:138] Found kubelet problem: Dec 16 11:41:14 old-k8s-version-501600 kubelet[1909]: E1216 11:41:14.532141    1909 pod_workers.go:191] Error syncing pod 37a1d62a-03f1-4e8e-bd42-ca72275d6ccb ("dashboard-metrics-scraper-8d5bb5db8-4wwm7_kubernetes-dashboard(37a1d62a-03f1-4e8e-bd42-ca72275d6ccb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ErrImagePull: "rpc error: code = Unknown desc = [DEPRECATION NOTICE] Docker Image Format v1 and Docker Image manifest version 2, schema 1 support is disabled by default and will be removed in an upcoming release. Suggest the author of registry.k8s.io/echoserver:1.4 to upgrade the image to the OCI Format or Docker Image manifest v2, schema 2. More information at https://docs.docker.com/go/deprecated-image-specs/"

	W1216 11:45:57.185552   10008 logs.go:138] Found kubelet problem: Dec 16 11:41:18 old-k8s-version-501600 kubelet[1909]: E1216 11:41:18.993736    1909 pod_workers.go:191] Error syncing pod d2896fe7-5eeb-43d2-95d6-927aef485e51 ("metrics-server-9975d5f86-zn4gg_kube-system(d2896fe7-5eeb-43d2-95d6-927aef485e51)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = Error response from daemon: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.65.254:53: no such host"

	W1216 11:45:57.185552   10008 logs.go:138] Found kubelet problem: Dec 16 11:41:25 old-k8s-version-501600 kubelet[1909]: E1216 11:41:25.914536    1909 pod_workers.go:191] Error syncing pod 37a1d62a-03f1-4e8e-bd42-ca72275d6ccb ("dashboard-metrics-scraper-8d5bb5db8-4wwm7_kubernetes-dashboard(37a1d62a-03f1-4e8e-bd42-ca72275d6ccb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""

	W1216 11:45:57.186571   10008 logs.go:138] Found kubelet problem: Dec 16 11:41:29 old-k8s-version-501600 kubelet[1909]: E1216 11:41:29.914402    1909 pod_workers.go:191] Error syncing pod d2896fe7-5eeb-43d2-95d6-927aef485e51 ("metrics-server-9975d5f86-zn4gg_kube-system(d2896fe7-5eeb-43d2-95d6-927aef485e51)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1216 11:45:57.190647   10008 logs.go:138] Found kubelet problem: Dec 16 11:41:37 old-k8s-version-501600 kubelet[1909]: E1216 11:41:37.438642    1909 pod_workers.go:191] Error syncing pod 37a1d62a-03f1-4e8e-bd42-ca72275d6ccb ("dashboard-metrics-scraper-8d5bb5db8-4wwm7_kubernetes-dashboard(37a1d62a-03f1-4e8e-bd42-ca72275d6ccb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ErrImagePull: "rpc error: code = Unknown desc = [DEPRECATION NOTICE] Docker Image Format v1 and Docker Image manifest version 2, schema 1 support is disabled by default and will be removed in an upcoming release. Suggest the author of registry.k8s.io/echoserver:1.4 to upgrade the image to the OCI Format or Docker Image manifest v2, schema 2. More information at https://docs.docker.com/go/deprecated-image-specs/"

	W1216 11:45:57.190647   10008 logs.go:138] Found kubelet problem: Dec 16 11:41:40 old-k8s-version-501600 kubelet[1909]: E1216 11:41:40.912394    1909 pod_workers.go:191] Error syncing pod d2896fe7-5eeb-43d2-95d6-927aef485e51 ("metrics-server-9975d5f86-zn4gg_kube-system(d2896fe7-5eeb-43d2-95d6-927aef485e51)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1216 11:45:57.190647   10008 logs.go:138] Found kubelet problem: Dec 16 11:41:48 old-k8s-version-501600 kubelet[1909]: E1216 11:41:48.911506    1909 pod_workers.go:191] Error syncing pod 37a1d62a-03f1-4e8e-bd42-ca72275d6ccb ("dashboard-metrics-scraper-8d5bb5db8-4wwm7_kubernetes-dashboard(37a1d62a-03f1-4e8e-bd42-ca72275d6ccb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""

	W1216 11:45:57.191582   10008 logs.go:138] Found kubelet problem: Dec 16 11:41:52 old-k8s-version-501600 kubelet[1909]: E1216 11:41:52.911934    1909 pod_workers.go:191] Error syncing pod d2896fe7-5eeb-43d2-95d6-927aef485e51 ("metrics-server-9975d5f86-zn4gg_kube-system(d2896fe7-5eeb-43d2-95d6-927aef485e51)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1216 11:45:57.191582   10008 logs.go:138] Found kubelet problem: Dec 16 11:42:00 old-k8s-version-501600 kubelet[1909]: E1216 11:42:00.925934    1909 pod_workers.go:191] Error syncing pod 37a1d62a-03f1-4e8e-bd42-ca72275d6ccb ("dashboard-metrics-scraper-8d5bb5db8-4wwm7_kubernetes-dashboard(37a1d62a-03f1-4e8e-bd42-ca72275d6ccb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""

	W1216 11:45:57.195548   10008 logs.go:138] Found kubelet problem: Dec 16 11:42:06 old-k8s-version-501600 kubelet[1909]: E1216 11:42:06.960188    1909 pod_workers.go:191] Error syncing pod d2896fe7-5eeb-43d2-95d6-927aef485e51 ("metrics-server-9975d5f86-zn4gg_kube-system(d2896fe7-5eeb-43d2-95d6-927aef485e51)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = Error response from daemon: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.65.254:53: no such host"

	W1216 11:45:57.195548   10008 logs.go:138] Found kubelet problem: Dec 16 11:42:11 old-k8s-version-501600 kubelet[1909]: E1216 11:42:11.908414    1909 pod_workers.go:191] Error syncing pod 37a1d62a-03f1-4e8e-bd42-ca72275d6ccb ("dashboard-metrics-scraper-8d5bb5db8-4wwm7_kubernetes-dashboard(37a1d62a-03f1-4e8e-bd42-ca72275d6ccb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""

	W1216 11:45:57.195548   10008 logs.go:138] Found kubelet problem: Dec 16 11:42:17 old-k8s-version-501600 kubelet[1909]: E1216 11:42:17.908853    1909 pod_workers.go:191] Error syncing pod d2896fe7-5eeb-43d2-95d6-927aef485e51 ("metrics-server-9975d5f86-zn4gg_kube-system(d2896fe7-5eeb-43d2-95d6-927aef485e51)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1216 11:45:57.198605   10008 logs.go:138] Found kubelet problem: Dec 16 11:42:23 old-k8s-version-501600 kubelet[1909]: E1216 11:42:23.391511    1909 pod_workers.go:191] Error syncing pod 37a1d62a-03f1-4e8e-bd42-ca72275d6ccb ("dashboard-metrics-scraper-8d5bb5db8-4wwm7_kubernetes-dashboard(37a1d62a-03f1-4e8e-bd42-ca72275d6ccb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ErrImagePull: "rpc error: code = Unknown desc = [DEPRECATION NOTICE] Docker Image Format v1 and Docker Image manifest version 2, schema 1 support is disabled by default and will be removed in an upcoming release. Suggest the author of registry.k8s.io/echoserver:1.4 to upgrade the image to the OCI Format or Docker Image manifest v2, schema 2. More information at https://docs.docker.com/go/deprecated-image-specs/"

	W1216 11:45:57.198605   10008 logs.go:138] Found kubelet problem: Dec 16 11:42:29 old-k8s-version-501600 kubelet[1909]: E1216 11:42:29.909302    1909 pod_workers.go:191] Error syncing pod d2896fe7-5eeb-43d2-95d6-927aef485e51 ("metrics-server-9975d5f86-zn4gg_kube-system(d2896fe7-5eeb-43d2-95d6-927aef485e51)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1216 11:45:57.199548   10008 logs.go:138] Found kubelet problem: Dec 16 11:42:37 old-k8s-version-501600 kubelet[1909]: E1216 11:42:37.905786    1909 pod_workers.go:191] Error syncing pod 37a1d62a-03f1-4e8e-bd42-ca72275d6ccb ("dashboard-metrics-scraper-8d5bb5db8-4wwm7_kubernetes-dashboard(37a1d62a-03f1-4e8e-bd42-ca72275d6ccb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""

	W1216 11:45:57.199548   10008 logs.go:138] Found kubelet problem: Dec 16 11:42:44 old-k8s-version-501600 kubelet[1909]: E1216 11:42:44.905838    1909 pod_workers.go:191] Error syncing pod d2896fe7-5eeb-43d2-95d6-927aef485e51 ("metrics-server-9975d5f86-zn4gg_kube-system(d2896fe7-5eeb-43d2-95d6-927aef485e51)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1216 11:45:57.199548   10008 logs.go:138] Found kubelet problem: Dec 16 11:42:49 old-k8s-version-501600 kubelet[1909]: E1216 11:42:49.907458    1909 pod_workers.go:191] Error syncing pod 37a1d62a-03f1-4e8e-bd42-ca72275d6ccb ("dashboard-metrics-scraper-8d5bb5db8-4wwm7_kubernetes-dashboard(37a1d62a-03f1-4e8e-bd42-ca72275d6ccb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""

	W1216 11:45:57.199548   10008 logs.go:138] Found kubelet problem: Dec 16 11:42:57 old-k8s-version-501600 kubelet[1909]: E1216 11:42:57.906185    1909 pod_workers.go:191] Error syncing pod d2896fe7-5eeb-43d2-95d6-927aef485e51 ("metrics-server-9975d5f86-zn4gg_kube-system(d2896fe7-5eeb-43d2-95d6-927aef485e51)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1216 11:45:57.199548   10008 logs.go:138] Found kubelet problem: Dec 16 11:43:04 old-k8s-version-501600 kubelet[1909]: E1216 11:43:04.922686    1909 pod_workers.go:191] Error syncing pod 37a1d62a-03f1-4e8e-bd42-ca72275d6ccb ("dashboard-metrics-scraper-8d5bb5db8-4wwm7_kubernetes-dashboard(37a1d62a-03f1-4e8e-bd42-ca72275d6ccb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""

	W1216 11:45:57.200575   10008 logs.go:138] Found kubelet problem: Dec 16 11:43:11 old-k8s-version-501600 kubelet[1909]: E1216 11:43:11.903620    1909 pod_workers.go:191] Error syncing pod d2896fe7-5eeb-43d2-95d6-927aef485e51 ("metrics-server-9975d5f86-zn4gg_kube-system(d2896fe7-5eeb-43d2-95d6-927aef485e51)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1216 11:45:57.200575   10008 logs.go:138] Found kubelet problem: Dec 16 11:43:19 old-k8s-version-501600 kubelet[1909]: E1216 11:43:19.904521    1909 pod_workers.go:191] Error syncing pod 37a1d62a-03f1-4e8e-bd42-ca72275d6ccb ("dashboard-metrics-scraper-8d5bb5db8-4wwm7_kubernetes-dashboard(37a1d62a-03f1-4e8e-bd42-ca72275d6ccb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""

	W1216 11:45:57.200575   10008 logs.go:138] Found kubelet problem: Dec 16 11:43:25 old-k8s-version-501600 kubelet[1909]: E1216 11:43:25.902968    1909 pod_workers.go:191] Error syncing pod d2896fe7-5eeb-43d2-95d6-927aef485e51 ("metrics-server-9975d5f86-zn4gg_kube-system(d2896fe7-5eeb-43d2-95d6-927aef485e51)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1216 11:45:57.200575   10008 logs.go:138] Found kubelet problem: Dec 16 11:43:34 old-k8s-version-501600 kubelet[1909]: E1216 11:43:34.907258    1909 pod_workers.go:191] Error syncing pod 37a1d62a-03f1-4e8e-bd42-ca72275d6ccb ("dashboard-metrics-scraper-8d5bb5db8-4wwm7_kubernetes-dashboard(37a1d62a-03f1-4e8e-bd42-ca72275d6ccb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""

	W1216 11:45:57.202559   10008 logs.go:138] Found kubelet problem: Dec 16 11:43:36 old-k8s-version-501600 kubelet[1909]: E1216 11:43:36.956321    1909 pod_workers.go:191] Error syncing pod d2896fe7-5eeb-43d2-95d6-927aef485e51 ("metrics-server-9975d5f86-zn4gg_kube-system(d2896fe7-5eeb-43d2-95d6-927aef485e51)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = Error response from daemon: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.65.254:53: no such host"

	W1216 11:45:57.205565   10008 logs.go:138] Found kubelet problem: Dec 16 11:43:48 old-k8s-version-501600 kubelet[1909]: E1216 11:43:48.383349    1909 pod_workers.go:191] Error syncing pod 37a1d62a-03f1-4e8e-bd42-ca72275d6ccb ("dashboard-metrics-scraper-8d5bb5db8-4wwm7_kubernetes-dashboard(37a1d62a-03f1-4e8e-bd42-ca72275d6ccb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ErrImagePull: "rpc error: code = Unknown desc = [DEPRECATION NOTICE] Docker Image Format v1 and Docker Image manifest version 2, schema 1 support is disabled by default and will be removed in an upcoming release. Suggest the author of registry.k8s.io/echoserver:1.4 to upgrade the image to the OCI Format or Docker Image manifest v2, schema 2. More information at https://docs.docker.com/go/deprecated-image-specs/"

	W1216 11:45:57.205565   10008 logs.go:138] Found kubelet problem: Dec 16 11:43:49 old-k8s-version-501600 kubelet[1909]: E1216 11:43:49.900605    1909 pod_workers.go:191] Error syncing pod d2896fe7-5eeb-43d2-95d6-927aef485e51 ("metrics-server-9975d5f86-zn4gg_kube-system(d2896fe7-5eeb-43d2-95d6-927aef485e51)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1216 11:45:57.206549   10008 logs.go:138] Found kubelet problem: Dec 16 11:44:03 old-k8s-version-501600 kubelet[1909]: E1216 11:44:03.900541    1909 pod_workers.go:191] Error syncing pod 37a1d62a-03f1-4e8e-bd42-ca72275d6ccb ("dashboard-metrics-scraper-8d5bb5db8-4wwm7_kubernetes-dashboard(37a1d62a-03f1-4e8e-bd42-ca72275d6ccb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""

	W1216 11:45:57.206549   10008 logs.go:138] Found kubelet problem: Dec 16 11:44:03 old-k8s-version-501600 kubelet[1909]: E1216 11:44:03.900719    1909 pod_workers.go:191] Error syncing pod d2896fe7-5eeb-43d2-95d6-927aef485e51 ("metrics-server-9975d5f86-zn4gg_kube-system(d2896fe7-5eeb-43d2-95d6-927aef485e51)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1216 11:45:57.206549   10008 logs.go:138] Found kubelet problem: Dec 16 11:44:14 old-k8s-version-501600 kubelet[1909]: E1216 11:44:14.897911    1909 pod_workers.go:191] Error syncing pod d2896fe7-5eeb-43d2-95d6-927aef485e51 ("metrics-server-9975d5f86-zn4gg_kube-system(d2896fe7-5eeb-43d2-95d6-927aef485e51)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1216 11:45:57.206549   10008 logs.go:138] Found kubelet problem: Dec 16 11:44:15 old-k8s-version-501600 kubelet[1909]: E1216 11:44:15.919796    1909 pod_workers.go:191] Error syncing pod 37a1d62a-03f1-4e8e-bd42-ca72275d6ccb ("dashboard-metrics-scraper-8d5bb5db8-4wwm7_kubernetes-dashboard(37a1d62a-03f1-4e8e-bd42-ca72275d6ccb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""

	W1216 11:45:57.207565   10008 logs.go:138] Found kubelet problem: Dec 16 11:44:26 old-k8s-version-501600 kubelet[1909]: E1216 11:44:26.900810    1909 pod_workers.go:191] Error syncing pod d2896fe7-5eeb-43d2-95d6-927aef485e51 ("metrics-server-9975d5f86-zn4gg_kube-system(d2896fe7-5eeb-43d2-95d6-927aef485e51)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1216 11:45:57.207565   10008 logs.go:138] Found kubelet problem: Dec 16 11:44:27 old-k8s-version-501600 kubelet[1909]: E1216 11:44:27.906368    1909 pod_workers.go:191] Error syncing pod 37a1d62a-03f1-4e8e-bd42-ca72275d6ccb ("dashboard-metrics-scraper-8d5bb5db8-4wwm7_kubernetes-dashboard(37a1d62a-03f1-4e8e-bd42-ca72275d6ccb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""

	W1216 11:45:57.207565   10008 logs.go:138] Found kubelet problem: Dec 16 11:44:38 old-k8s-version-501600 kubelet[1909]: E1216 11:44:38.897229    1909 pod_workers.go:191] Error syncing pod d2896fe7-5eeb-43d2-95d6-927aef485e51 ("metrics-server-9975d5f86-zn4gg_kube-system(d2896fe7-5eeb-43d2-95d6-927aef485e51)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1216 11:45:57.208567   10008 logs.go:138] Found kubelet problem: Dec 16 11:44:39 old-k8s-version-501600 kubelet[1909]: E1216 11:44:39.896174    1909 pod_workers.go:191] Error syncing pod 37a1d62a-03f1-4e8e-bd42-ca72275d6ccb ("dashboard-metrics-scraper-8d5bb5db8-4wwm7_kubernetes-dashboard(37a1d62a-03f1-4e8e-bd42-ca72275d6ccb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""

	W1216 11:45:57.208567   10008 logs.go:138] Found kubelet problem: Dec 16 11:44:50 old-k8s-version-501600 kubelet[1909]: E1216 11:44:50.898286    1909 pod_workers.go:191] Error syncing pod d2896fe7-5eeb-43d2-95d6-927aef485e51 ("metrics-server-9975d5f86-zn4gg_kube-system(d2896fe7-5eeb-43d2-95d6-927aef485e51)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1216 11:45:57.208567   10008 logs.go:138] Found kubelet problem: Dec 16 11:44:52 old-k8s-version-501600 kubelet[1909]: E1216 11:44:52.894556    1909 pod_workers.go:191] Error syncing pod 37a1d62a-03f1-4e8e-bd42-ca72275d6ccb ("dashboard-metrics-scraper-8d5bb5db8-4wwm7_kubernetes-dashboard(37a1d62a-03f1-4e8e-bd42-ca72275d6ccb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""

	W1216 11:45:57.209551   10008 logs.go:138] Found kubelet problem: Dec 16 11:45:03 old-k8s-version-501600 kubelet[1909]: E1216 11:45:03.895647    1909 pod_workers.go:191] Error syncing pod 37a1d62a-03f1-4e8e-bd42-ca72275d6ccb ("dashboard-metrics-scraper-8d5bb5db8-4wwm7_kubernetes-dashboard(37a1d62a-03f1-4e8e-bd42-ca72275d6ccb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""

	W1216 11:45:57.209551   10008 logs.go:138] Found kubelet problem: Dec 16 11:45:04 old-k8s-version-501600 kubelet[1909]: E1216 11:45:04.897659    1909 pod_workers.go:191] Error syncing pod d2896fe7-5eeb-43d2-95d6-927aef485e51 ("metrics-server-9975d5f86-zn4gg_kube-system(d2896fe7-5eeb-43d2-95d6-927aef485e51)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1216 11:45:57.209551   10008 logs.go:138] Found kubelet problem: Dec 16 11:45:15 old-k8s-version-501600 kubelet[1909]: E1216 11:45:15.893423    1909 pod_workers.go:191] Error syncing pod 37a1d62a-03f1-4e8e-bd42-ca72275d6ccb ("dashboard-metrics-scraper-8d5bb5db8-4wwm7_kubernetes-dashboard(37a1d62a-03f1-4e8e-bd42-ca72275d6ccb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""

	W1216 11:45:57.210615   10008 logs.go:138] Found kubelet problem: Dec 16 11:45:16 old-k8s-version-501600 kubelet[1909]: E1216 11:45:16.895909    1909 pod_workers.go:191] Error syncing pod d2896fe7-5eeb-43d2-95d6-927aef485e51 ("metrics-server-9975d5f86-zn4gg_kube-system(d2896fe7-5eeb-43d2-95d6-927aef485e51)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1216 11:45:57.211544   10008 logs.go:138] Found kubelet problem: Dec 16 11:45:26 old-k8s-version-501600 kubelet[1909]: E1216 11:45:26.948454    1909 pod_workers.go:191] Error syncing pod 37a1d62a-03f1-4e8e-bd42-ca72275d6ccb ("dashboard-metrics-scraper-8d5bb5db8-4wwm7_kubernetes-dashboard(37a1d62a-03f1-4e8e-bd42-ca72275d6ccb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""

	W1216 11:45:57.212559   10008 logs.go:138] Found kubelet problem: Dec 16 11:45:32 old-k8s-version-501600 kubelet[1909]: E1216 11:45:32.894388    1909 pod_workers.go:191] Error syncing pod d2896fe7-5eeb-43d2-95d6-927aef485e51 ("metrics-server-9975d5f86-zn4gg_kube-system(d2896fe7-5eeb-43d2-95d6-927aef485e51)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1216 11:45:57.212559   10008 logs.go:138] Found kubelet problem: Dec 16 11:45:38 old-k8s-version-501600 kubelet[1909]: E1216 11:45:38.892058    1909 pod_workers.go:191] Error syncing pod 37a1d62a-03f1-4e8e-bd42-ca72275d6ccb ("dashboard-metrics-scraper-8d5bb5db8-4wwm7_kubernetes-dashboard(37a1d62a-03f1-4e8e-bd42-ca72275d6ccb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""

	W1216 11:45:57.212559   10008 logs.go:138] Found kubelet problem: Dec 16 11:45:44 old-k8s-version-501600 kubelet[1909]: E1216 11:45:44.890057    1909 pod_workers.go:191] Error syncing pod d2896fe7-5eeb-43d2-95d6-927aef485e51 ("metrics-server-9975d5f86-zn4gg_kube-system(d2896fe7-5eeb-43d2-95d6-927aef485e51)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1216 11:45:57.213549   10008 logs.go:138] Found kubelet problem: Dec 16 11:45:49 old-k8s-version-501600 kubelet[1909]: E1216 11:45:49.888740    1909 pod_workers.go:191] Error syncing pod 37a1d62a-03f1-4e8e-bd42-ca72275d6ccb ("dashboard-metrics-scraper-8d5bb5db8-4wwm7_kubernetes-dashboard(37a1d62a-03f1-4e8e-bd42-ca72275d6ccb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""

	W1216 11:45:57.213549   10008 logs.go:138] Found kubelet problem: Dec 16 11:45:56 old-k8s-version-501600 kubelet[1909]: E1216 11:45:56.890796    1909 pod_workers.go:191] Error syncing pod d2896fe7-5eeb-43d2-95d6-927aef485e51 ("metrics-server-9975d5f86-zn4gg_kube-system(d2896fe7-5eeb-43d2-95d6-927aef485e51)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	I1216 11:45:57.213549   10008 logs.go:123] Gathering logs for kube-apiserver [7ddd764ff8e3] ...

	I1216 11:45:57.213549   10008 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 7ddd764ff8e3"

	I1216 11:45:57.344481   10008 logs.go:123] Gathering logs for kube-scheduler [5bfd011d16fd] ...

	I1216 11:45:57.344481   10008 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5bfd011d16fd"

	I1216 11:45:57.412768   10008 out.go:358] Setting ErrFile to fd 1560...

	I1216 11:45:57.412807   10008 out.go:392] TERM=,COLORTERM=, which probably does not support color

	W1216 11:45:57.412807   10008 out.go:270] X Problems detected in kubelet:

	X Problems detected in kubelet:

	W1216 11:45:57.412807   10008 out.go:270]   Dec 16 11:45:32 old-k8s-version-501600 kubelet[1909]: E1216 11:45:32.894388    1909 pod_workers.go:191] Error syncing pod d2896fe7-5eeb-43d2-95d6-927aef485e51 ("metrics-server-9975d5f86-zn4gg_kube-system(d2896fe7-5eeb-43d2-95d6-927aef485e51)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	  Dec 16 11:45:32 old-k8s-version-501600 kubelet[1909]: E1216 11:45:32.894388    1909 pod_workers.go:191] Error syncing pod d2896fe7-5eeb-43d2-95d6-927aef485e51 ("metrics-server-9975d5f86-zn4gg_kube-system(d2896fe7-5eeb-43d2-95d6-927aef485e51)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1216 11:45:57.412807   10008 out.go:270]   Dec 16 11:45:38 old-k8s-version-501600 kubelet[1909]: E1216 11:45:38.892058    1909 pod_workers.go:191] Error syncing pod 37a1d62a-03f1-4e8e-bd42-ca72275d6ccb ("dashboard-metrics-scraper-8d5bb5db8-4wwm7_kubernetes-dashboard(37a1d62a-03f1-4e8e-bd42-ca72275d6ccb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""

	  Dec 16 11:45:38 old-k8s-version-501600 kubelet[1909]: E1216 11:45:38.892058    1909 pod_workers.go:191] Error syncing pod 37a1d62a-03f1-4e8e-bd42-ca72275d6ccb ("dashboard-metrics-scraper-8d5bb5db8-4wwm7_kubernetes-dashboard(37a1d62a-03f1-4e8e-bd42-ca72275d6ccb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""

	W1216 11:45:57.412807   10008 out.go:270]   Dec 16 11:45:44 old-k8s-version-501600 kubelet[1909]: E1216 11:45:44.890057    1909 pod_workers.go:191] Error syncing pod d2896fe7-5eeb-43d2-95d6-927aef485e51 ("metrics-server-9975d5f86-zn4gg_kube-system(d2896fe7-5eeb-43d2-95d6-927aef485e51)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	  Dec 16 11:45:44 old-k8s-version-501600 kubelet[1909]: E1216 11:45:44.890057    1909 pod_workers.go:191] Error syncing pod d2896fe7-5eeb-43d2-95d6-927aef485e51 ("metrics-server-9975d5f86-zn4gg_kube-system(d2896fe7-5eeb-43d2-95d6-927aef485e51)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1216 11:45:57.412807   10008 out.go:270]   Dec 16 11:45:49 old-k8s-version-501600 kubelet[1909]: E1216 11:45:49.888740    1909 pod_workers.go:191] Error syncing pod 37a1d62a-03f1-4e8e-bd42-ca72275d6ccb ("dashboard-metrics-scraper-8d5bb5db8-4wwm7_kubernetes-dashboard(37a1d62a-03f1-4e8e-bd42-ca72275d6ccb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""

	  Dec 16 11:45:49 old-k8s-version-501600 kubelet[1909]: E1216 11:45:49.888740    1909 pod_workers.go:191] Error syncing pod 37a1d62a-03f1-4e8e-bd42-ca72275d6ccb ("dashboard-metrics-scraper-8d5bb5db8-4wwm7_kubernetes-dashboard(37a1d62a-03f1-4e8e-bd42-ca72275d6ccb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""

	W1216 11:45:57.412807   10008 out.go:270]   Dec 16 11:45:56 old-k8s-version-501600 kubelet[1909]: E1216 11:45:56.890796    1909 pod_workers.go:191] Error syncing pod d2896fe7-5eeb-43d2-95d6-927aef485e51 ("metrics-server-9975d5f86-zn4gg_kube-system(d2896fe7-5eeb-43d2-95d6-927aef485e51)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	  Dec 16 11:45:56 old-k8s-version-501600 kubelet[1909]: E1216 11:45:56.890796    1909 pod_workers.go:191] Error syncing pod d2896fe7-5eeb-43d2-95d6-927aef485e51 ("metrics-server-9975d5f86-zn4gg_kube-system(d2896fe7-5eeb-43d2-95d6-927aef485e51)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	I1216 11:45:57.412807   10008 out.go:358] Setting ErrFile to fd 1560...

	I1216 11:45:57.412807   10008 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I1216 11:46:07.425281   10008 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I1216 11:46:07.448992   10008 api_server.go:72] duration metric: took 5m48.6991764s to wait for apiserver process to appear ...

	I1216 11:46:07.449079   10008 api_server.go:88] waiting for apiserver healthz status ...

	I1216 11:46:07.458043   10008 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}

	I1216 11:46:07.515677   10008 logs.go:282] 2 containers: [56bb0e9c28d2 7ddd764ff8e3]

	I1216 11:46:07.525692   10008 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}

	I1216 11:46:07.571111   10008 logs.go:282] 2 containers: [fd156a045ffd 25fc9ee43f0a]

	I1216 11:46:07.587150   10008 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}

	I1216 11:46:07.636272   10008 logs.go:282] 2 containers: [e314bd292ad5 219798af5c41]

	I1216 11:46:07.644281   10008 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}

	I1216 11:46:07.690310   10008 logs.go:282] 2 containers: [8ddd1a91749a 5bfd011d16fd]

	I1216 11:46:07.705294   10008 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}

	I1216 11:46:07.747278   10008 logs.go:282] 2 containers: [58e72cba6157 8cce9bacca4b]

	I1216 11:46:07.755285   10008 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}

	I1216 11:46:07.811859   10008 logs.go:282] 2 containers: [d341318320dc 268c261f4e09]

	I1216 11:46:07.819843   10008 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}

	I1216 11:46:07.858846   10008 logs.go:282] 0 containers: []

	W1216 11:46:07.858846   10008 logs.go:284] No container was found matching "kindnet"

	I1216 11:46:07.869852   10008 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kubernetes-dashboard --format={{.ID}}

	I1216 11:46:07.924965   10008 logs.go:282] 1 containers: [19b65a7c34eb]

	I1216 11:46:07.932927   10008 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}

	I1216 11:46:07.992760   10008 logs.go:282] 2 containers: [230a8a7960d9 2f9bdc06bf7f]

	I1216 11:46:07.992760   10008 logs.go:123] Gathering logs for kube-apiserver [7ddd764ff8e3] ...

	I1216 11:46:07.992760   10008 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 7ddd764ff8e3"

	I1216 11:46:08.117861   10008 logs.go:123] Gathering logs for etcd [fd156a045ffd] ...

	I1216 11:46:08.117861   10008 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 fd156a045ffd"

	I1216 11:46:08.187648   10008 logs.go:123] Gathering logs for coredns [219798af5c41] ...

	I1216 11:46:08.187648   10008 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 219798af5c41"

	I1216 11:46:08.241337   10008 logs.go:123] Gathering logs for kube-scheduler [8ddd1a91749a] ...

	I1216 11:46:08.241416   10008 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 8ddd1a91749a"

	I1216 11:46:08.296607   10008 logs.go:123] Gathering logs for kube-proxy [8cce9bacca4b] ...

	I1216 11:46:08.296607   10008 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 8cce9bacca4b"

	I1216 11:46:08.341608   10008 logs.go:123] Gathering logs for kubelet ...

	I1216 11:46:08.341608   10008 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"

	W1216 11:46:08.434637   10008 logs.go:138] Found kubelet problem: Dec 16 11:40:30 old-k8s-version-501600 kubelet[1909]: E1216 11:40:30.611863    1909 reflector.go:138] object-"kube-system"/"storage-provisioner-token-h2pb2": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "storage-provisioner-token-h2pb2" is forbidden: User "system:node:old-k8s-version-501600" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-501600' and this object

	W1216 11:46:08.442412   10008 logs.go:138] Found kubelet problem: Dec 16 11:40:36 old-k8s-version-501600 kubelet[1909]: E1216 11:40:36.024919    1909 pod_workers.go:191] Error syncing pod d2896fe7-5eeb-43d2-95d6-927aef485e51 ("metrics-server-9975d5f86-zn4gg_kube-system(d2896fe7-5eeb-43d2-95d6-927aef485e51)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = Error response from daemon: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.65.254:53: no such host"

	W1216 11:46:08.443274   10008 logs.go:138] Found kubelet problem: Dec 16 11:40:37 old-k8s-version-501600 kubelet[1909]: E1216 11:40:37.028492    1909 pod_workers.go:191] Error syncing pod d2896fe7-5eeb-43d2-95d6-927aef485e51 ("metrics-server-9975d5f86-zn4gg_kube-system(d2896fe7-5eeb-43d2-95d6-927aef485e51)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1216 11:46:08.444285   10008 logs.go:138] Found kubelet problem: Dec 16 11:40:38 old-k8s-version-501600 kubelet[1909]: E1216 11:40:38.707195    1909 pod_workers.go:191] Error syncing pod d2896fe7-5eeb-43d2-95d6-927aef485e51 ("metrics-server-9975d5f86-zn4gg_kube-system(d2896fe7-5eeb-43d2-95d6-927aef485e51)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1216 11:46:08.448252   10008 logs.go:138] Found kubelet problem: Dec 16 11:40:51 old-k8s-version-501600 kubelet[1909]: E1216 11:40:51.972752    1909 pod_workers.go:191] Error syncing pod d2896fe7-5eeb-43d2-95d6-927aef485e51 ("metrics-server-9975d5f86-zn4gg_kube-system(d2896fe7-5eeb-43d2-95d6-927aef485e51)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = Error response from daemon: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.65.254:53: no such host"

	W1216 11:46:08.451256   10008 logs.go:138] Found kubelet problem: Dec 16 11:40:53 old-k8s-version-501600 kubelet[1909]: E1216 11:40:53.819814    1909 pod_workers.go:191] Error syncing pod 37a1d62a-03f1-4e8e-bd42-ca72275d6ccb ("dashboard-metrics-scraper-8d5bb5db8-4wwm7_kubernetes-dashboard(37a1d62a-03f1-4e8e-bd42-ca72275d6ccb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ErrImagePull: "rpc error: code = Unknown desc = [DEPRECATION NOTICE] Docker Image Format v1 and Docker Image manifest version 2, schema 1 support is disabled by default and will be removed in an upcoming release. Suggest the author of registry.k8s.io/echoserver:1.4 to upgrade the image to the OCI Format or Docker Image manifest v2, schema 2. More information at https://docs.docker.com/go/deprecated-image-specs/"

	W1216 11:46:08.452248   10008 logs.go:138] Found kubelet problem: Dec 16 11:40:54 old-k8s-version-501600 kubelet[1909]: E1216 11:40:54.247688    1909 pod_workers.go:191] Error syncing pod 37a1d62a-03f1-4e8e-bd42-ca72275d6ccb ("dashboard-metrics-scraper-8d5bb5db8-4wwm7_kubernetes-dashboard(37a1d62a-03f1-4e8e-bd42-ca72275d6ccb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""

	W1216 11:46:08.452248   10008 logs.go:138] Found kubelet problem: Dec 16 11:40:55 old-k8s-version-501600 kubelet[1909]: E1216 11:40:55.271609    1909 pod_workers.go:191] Error syncing pod 37a1d62a-03f1-4e8e-bd42-ca72275d6ccb ("dashboard-metrics-scraper-8d5bb5db8-4wwm7_kubernetes-dashboard(37a1d62a-03f1-4e8e-bd42-ca72275d6ccb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""

	W1216 11:46:08.453248   10008 logs.go:138] Found kubelet problem: Dec 16 11:40:59 old-k8s-version-501600 kubelet[1909]: E1216 11:40:59.364188    1909 pod_workers.go:191] Error syncing pod 21b24a0c-f627-4a14-9eb5-704f6fe85772 ("storage-provisioner_kube-system(21b24a0c-f627-4a14-9eb5-704f6fe85772)"), skipping: failed to "StartContainer" for "storage-provisioner" with CrashLoopBackOff: "back-off 10s restarting failed container=storage-provisioner pod=storage-provisioner_kube-system(21b24a0c-f627-4a14-9eb5-704f6fe85772)"

	W1216 11:46:08.453837   10008 logs.go:138] Found kubelet problem: Dec 16 11:41:04 old-k8s-version-501600 kubelet[1909]: E1216 11:41:04.917670    1909 pod_workers.go:191] Error syncing pod d2896fe7-5eeb-43d2-95d6-927aef485e51 ("metrics-server-9975d5f86-zn4gg_kube-system(d2896fe7-5eeb-43d2-95d6-927aef485e51)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1216 11:46:08.456939   10008 logs.go:138] Found kubelet problem: Dec 16 11:41:14 old-k8s-version-501600 kubelet[1909]: E1216 11:41:14.532141    1909 pod_workers.go:191] Error syncing pod 37a1d62a-03f1-4e8e-bd42-ca72275d6ccb ("dashboard-metrics-scraper-8d5bb5db8-4wwm7_kubernetes-dashboard(37a1d62a-03f1-4e8e-bd42-ca72275d6ccb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ErrImagePull: "rpc error: code = Unknown desc = [DEPRECATION NOTICE] Docker Image Format v1 and Docker Image manifest version 2, schema 1 support is disabled by default and will be removed in an upcoming release. Suggest the author of registry.k8s.io/echoserver:1.4 to upgrade the image to the OCI Format or Docker Image manifest v2, schema 2. More information at https://docs.docker.com/go/deprecated-image-specs/"

	W1216 11:46:08.459046   10008 logs.go:138] Found kubelet problem: Dec 16 11:41:18 old-k8s-version-501600 kubelet[1909]: E1216 11:41:18.993736    1909 pod_workers.go:191] Error syncing pod d2896fe7-5eeb-43d2-95d6-927aef485e51 ("metrics-server-9975d5f86-zn4gg_kube-system(d2896fe7-5eeb-43d2-95d6-927aef485e51)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = Error response from daemon: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.65.254:53: no such host"

	W1216 11:46:08.459945   10008 logs.go:138] Found kubelet problem: Dec 16 11:41:25 old-k8s-version-501600 kubelet[1909]: E1216 11:41:25.914536    1909 pod_workers.go:191] Error syncing pod 37a1d62a-03f1-4e8e-bd42-ca72275d6ccb ("dashboard-metrics-scraper-8d5bb5db8-4wwm7_kubernetes-dashboard(37a1d62a-03f1-4e8e-bd42-ca72275d6ccb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""

	W1216 11:46:08.460182   10008 logs.go:138] Found kubelet problem: Dec 16 11:41:29 old-k8s-version-501600 kubelet[1909]: E1216 11:41:29.914402    1909 pod_workers.go:191] Error syncing pod d2896fe7-5eeb-43d2-95d6-927aef485e51 ("metrics-server-9975d5f86-zn4gg_kube-system(d2896fe7-5eeb-43d2-95d6-927aef485e51)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1216 11:46:08.462455   10008 logs.go:138] Found kubelet problem: Dec 16 11:41:37 old-k8s-version-501600 kubelet[1909]: E1216 11:41:37.438642    1909 pod_workers.go:191] Error syncing pod 37a1d62a-03f1-4e8e-bd42-ca72275d6ccb ("dashboard-metrics-scraper-8d5bb5db8-4wwm7_kubernetes-dashboard(37a1d62a-03f1-4e8e-bd42-ca72275d6ccb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ErrImagePull: "rpc error: code = Unknown desc = [DEPRECATION NOTICE] Docker Image Format v1 and Docker Image manifest version 2, schema 1 support is disabled by default and will be removed in an upcoming release. Suggest the author of registry.k8s.io/echoserver:1.4 to upgrade the image to the OCI Format or Docker Image manifest v2, schema 2. More information at https://docs.docker.com/go/deprecated-image-specs/"

	W1216 11:46:08.462862   10008 logs.go:138] Found kubelet problem: Dec 16 11:41:40 old-k8s-version-501600 kubelet[1909]: E1216 11:41:40.912394    1909 pod_workers.go:191] Error syncing pod d2896fe7-5eeb-43d2-95d6-927aef485e51 ("metrics-server-9975d5f86-zn4gg_kube-system(d2896fe7-5eeb-43d2-95d6-927aef485e51)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1216 11:46:08.463097   10008 logs.go:138] Found kubelet problem: Dec 16 11:41:48 old-k8s-version-501600 kubelet[1909]: E1216 11:41:48.911506    1909 pod_workers.go:191] Error syncing pod 37a1d62a-03f1-4e8e-bd42-ca72275d6ccb ("dashboard-metrics-scraper-8d5bb5db8-4wwm7_kubernetes-dashboard(37a1d62a-03f1-4e8e-bd42-ca72275d6ccb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""

	W1216 11:46:08.463350   10008 logs.go:138] Found kubelet problem: Dec 16 11:41:52 old-k8s-version-501600 kubelet[1909]: E1216 11:41:52.911934    1909 pod_workers.go:191] Error syncing pod d2896fe7-5eeb-43d2-95d6-927aef485e51 ("metrics-server-9975d5f86-zn4gg_kube-system(d2896fe7-5eeb-43d2-95d6-927aef485e51)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1216 11:46:08.463578   10008 logs.go:138] Found kubelet problem: Dec 16 11:42:00 old-k8s-version-501600 kubelet[1909]: E1216 11:42:00.925934    1909 pod_workers.go:191] Error syncing pod 37a1d62a-03f1-4e8e-bd42-ca72275d6ccb ("dashboard-metrics-scraper-8d5bb5db8-4wwm7_kubernetes-dashboard(37a1d62a-03f1-4e8e-bd42-ca72275d6ccb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""

	W1216 11:46:08.465492   10008 logs.go:138] Found kubelet problem: Dec 16 11:42:06 old-k8s-version-501600 kubelet[1909]: E1216 11:42:06.960188    1909 pod_workers.go:191] Error syncing pod d2896fe7-5eeb-43d2-95d6-927aef485e51 ("metrics-server-9975d5f86-zn4gg_kube-system(d2896fe7-5eeb-43d2-95d6-927aef485e51)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = Error response from daemon: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.65.254:53: no such host"

	W1216 11:46:08.466074   10008 logs.go:138] Found kubelet problem: Dec 16 11:42:11 old-k8s-version-501600 kubelet[1909]: E1216 11:42:11.908414    1909 pod_workers.go:191] Error syncing pod 37a1d62a-03f1-4e8e-bd42-ca72275d6ccb ("dashboard-metrics-scraper-8d5bb5db8-4wwm7_kubernetes-dashboard(37a1d62a-03f1-4e8e-bd42-ca72275d6ccb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""

	W1216 11:46:08.466375   10008 logs.go:138] Found kubelet problem: Dec 16 11:42:17 old-k8s-version-501600 kubelet[1909]: E1216 11:42:17.908853    1909 pod_workers.go:191] Error syncing pod d2896fe7-5eeb-43d2-95d6-927aef485e51 ("metrics-server-9975d5f86-zn4gg_kube-system(d2896fe7-5eeb-43d2-95d6-927aef485e51)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1216 11:46:08.468692   10008 logs.go:138] Found kubelet problem: Dec 16 11:42:23 old-k8s-version-501600 kubelet[1909]: E1216 11:42:23.391511    1909 pod_workers.go:191] Error syncing pod 37a1d62a-03f1-4e8e-bd42-ca72275d6ccb ("dashboard-metrics-scraper-8d5bb5db8-4wwm7_kubernetes-dashboard(37a1d62a-03f1-4e8e-bd42-ca72275d6ccb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ErrImagePull: "rpc error: code = Unknown desc = [DEPRECATION NOTICE] Docker Image Format v1 and Docker Image manifest version 2, schema 1 support is disabled by default and will be removed in an upcoming release. Suggest the author of registry.k8s.io/echoserver:1.4 to upgrade the image to the OCI Format or Docker Image manifest v2, schema 2. More information at https://docs.docker.com/go/deprecated-image-specs/"

	W1216 11:46:08.468926   10008 logs.go:138] Found kubelet problem: Dec 16 11:42:29 old-k8s-version-501600 kubelet[1909]: E1216 11:42:29.909302    1909 pod_workers.go:191] Error syncing pod d2896fe7-5eeb-43d2-95d6-927aef485e51 ("metrics-server-9975d5f86-zn4gg_kube-system(d2896fe7-5eeb-43d2-95d6-927aef485e51)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1216 11:46:08.469106   10008 logs.go:138] Found kubelet problem: Dec 16 11:42:37 old-k8s-version-501600 kubelet[1909]: E1216 11:42:37.905786    1909 pod_workers.go:191] Error syncing pod 37a1d62a-03f1-4e8e-bd42-ca72275d6ccb ("dashboard-metrics-scraper-8d5bb5db8-4wwm7_kubernetes-dashboard(37a1d62a-03f1-4e8e-bd42-ca72275d6ccb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""

	W1216 11:46:08.469379   10008 logs.go:138] Found kubelet problem: Dec 16 11:42:44 old-k8s-version-501600 kubelet[1909]: E1216 11:42:44.905838    1909 pod_workers.go:191] Error syncing pod d2896fe7-5eeb-43d2-95d6-927aef485e51 ("metrics-server-9975d5f86-zn4gg_kube-system(d2896fe7-5eeb-43d2-95d6-927aef485e51)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1216 11:46:08.469695   10008 logs.go:138] Found kubelet problem: Dec 16 11:42:49 old-k8s-version-501600 kubelet[1909]: E1216 11:42:49.907458    1909 pod_workers.go:191] Error syncing pod 37a1d62a-03f1-4e8e-bd42-ca72275d6ccb ("dashboard-metrics-scraper-8d5bb5db8-4wwm7_kubernetes-dashboard(37a1d62a-03f1-4e8e-bd42-ca72275d6ccb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""

	W1216 11:46:08.469863   10008 logs.go:138] Found kubelet problem: Dec 16 11:42:57 old-k8s-version-501600 kubelet[1909]: E1216 11:42:57.906185    1909 pod_workers.go:191] Error syncing pod d2896fe7-5eeb-43d2-95d6-927aef485e51 ("metrics-server-9975d5f86-zn4gg_kube-system(d2896fe7-5eeb-43d2-95d6-927aef485e51)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1216 11:46:08.470107   10008 logs.go:138] Found kubelet problem: Dec 16 11:43:04 old-k8s-version-501600 kubelet[1909]: E1216 11:43:04.922686    1909 pod_workers.go:191] Error syncing pod 37a1d62a-03f1-4e8e-bd42-ca72275d6ccb ("dashboard-metrics-scraper-8d5bb5db8-4wwm7_kubernetes-dashboard(37a1d62a-03f1-4e8e-bd42-ca72275d6ccb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""

	W1216 11:46:08.470693   10008 logs.go:138] Found kubelet problem: Dec 16 11:43:11 old-k8s-version-501600 kubelet[1909]: E1216 11:43:11.903620    1909 pod_workers.go:191] Error syncing pod d2896fe7-5eeb-43d2-95d6-927aef485e51 ("metrics-server-9975d5f86-zn4gg_kube-system(d2896fe7-5eeb-43d2-95d6-927aef485e51)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1216 11:46:08.470917   10008 logs.go:138] Found kubelet problem: Dec 16 11:43:19 old-k8s-version-501600 kubelet[1909]: E1216 11:43:19.904521    1909 pod_workers.go:191] Error syncing pod 37a1d62a-03f1-4e8e-bd42-ca72275d6ccb ("dashboard-metrics-scraper-8d5bb5db8-4wwm7_kubernetes-dashboard(37a1d62a-03f1-4e8e-bd42-ca72275d6ccb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""

	W1216 11:46:08.470917   10008 logs.go:138] Found kubelet problem: Dec 16 11:43:25 old-k8s-version-501600 kubelet[1909]: E1216 11:43:25.902968    1909 pod_workers.go:191] Error syncing pod d2896fe7-5eeb-43d2-95d6-927aef485e51 ("metrics-server-9975d5f86-zn4gg_kube-system(d2896fe7-5eeb-43d2-95d6-927aef485e51)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1216 11:46:08.470917   10008 logs.go:138] Found kubelet problem: Dec 16 11:43:34 old-k8s-version-501600 kubelet[1909]: E1216 11:43:34.907258    1909 pod_workers.go:191] Error syncing pod 37a1d62a-03f1-4e8e-bd42-ca72275d6ccb ("dashboard-metrics-scraper-8d5bb5db8-4wwm7_kubernetes-dashboard(37a1d62a-03f1-4e8e-bd42-ca72275d6ccb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""

	W1216 11:46:08.473705   10008 logs.go:138] Found kubelet problem: Dec 16 11:43:36 old-k8s-version-501600 kubelet[1909]: E1216 11:43:36.956321    1909 pod_workers.go:191] Error syncing pod d2896fe7-5eeb-43d2-95d6-927aef485e51 ("metrics-server-9975d5f86-zn4gg_kube-system(d2896fe7-5eeb-43d2-95d6-927aef485e51)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = Error response from daemon: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.65.254:53: no such host"

	W1216 11:46:08.477199   10008 logs.go:138] Found kubelet problem: Dec 16 11:43:48 old-k8s-version-501600 kubelet[1909]: E1216 11:43:48.383349    1909 pod_workers.go:191] Error syncing pod 37a1d62a-03f1-4e8e-bd42-ca72275d6ccb ("dashboard-metrics-scraper-8d5bb5db8-4wwm7_kubernetes-dashboard(37a1d62a-03f1-4e8e-bd42-ca72275d6ccb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ErrImagePull: "rpc error: code = Unknown desc = [DEPRECATION NOTICE] Docker Image Format v1 and Docker Image manifest version 2, schema 1 support is disabled by default and will be removed in an upcoming release. Suggest the author of registry.k8s.io/echoserver:1.4 to upgrade the image to the OCI Format or Docker Image manifest v2, schema 2. More information at https://docs.docker.com/go/deprecated-image-specs/"

	W1216 11:46:08.478206   10008 logs.go:138] Found kubelet problem: Dec 16 11:43:49 old-k8s-version-501600 kubelet[1909]: E1216 11:43:49.900605    1909 pod_workers.go:191] Error syncing pod d2896fe7-5eeb-43d2-95d6-927aef485e51 ("metrics-server-9975d5f86-zn4gg_kube-system(d2896fe7-5eeb-43d2-95d6-927aef485e51)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1216 11:46:08.478206   10008 logs.go:138] Found kubelet problem: Dec 16 11:44:03 old-k8s-version-501600 kubelet[1909]: E1216 11:44:03.900541    1909 pod_workers.go:191] Error syncing pod 37a1d62a-03f1-4e8e-bd42-ca72275d6ccb ("dashboard-metrics-scraper-8d5bb5db8-4wwm7_kubernetes-dashboard(37a1d62a-03f1-4e8e-bd42-ca72275d6ccb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""

	W1216 11:46:08.478806   10008 logs.go:138] Found kubelet problem: Dec 16 11:44:03 old-k8s-version-501600 kubelet[1909]: E1216 11:44:03.900719    1909 pod_workers.go:191] Error syncing pod d2896fe7-5eeb-43d2-95d6-927aef485e51 ("metrics-server-9975d5f86-zn4gg_kube-system(d2896fe7-5eeb-43d2-95d6-927aef485e51)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1216 11:46:08.479392   10008 logs.go:138] Found kubelet problem: Dec 16 11:44:14 old-k8s-version-501600 kubelet[1909]: E1216 11:44:14.897911    1909 pod_workers.go:191] Error syncing pod d2896fe7-5eeb-43d2-95d6-927aef485e51 ("metrics-server-9975d5f86-zn4gg_kube-system(d2896fe7-5eeb-43d2-95d6-927aef485e51)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1216 11:46:08.479904   10008 logs.go:138] Found kubelet problem: Dec 16 11:44:15 old-k8s-version-501600 kubelet[1909]: E1216 11:44:15.919796    1909 pod_workers.go:191] Error syncing pod 37a1d62a-03f1-4e8e-bd42-ca72275d6ccb ("dashboard-metrics-scraper-8d5bb5db8-4wwm7_kubernetes-dashboard(37a1d62a-03f1-4e8e-bd42-ca72275d6ccb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""

	W1216 11:46:08.479904   10008 logs.go:138] Found kubelet problem: Dec 16 11:44:26 old-k8s-version-501600 kubelet[1909]: E1216 11:44:26.900810    1909 pod_workers.go:191] Error syncing pod d2896fe7-5eeb-43d2-95d6-927aef485e51 ("metrics-server-9975d5f86-zn4gg_kube-system(d2896fe7-5eeb-43d2-95d6-927aef485e51)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1216 11:46:08.480426   10008 logs.go:138] Found kubelet problem: Dec 16 11:44:27 old-k8s-version-501600 kubelet[1909]: E1216 11:44:27.906368    1909 pod_workers.go:191] Error syncing pod 37a1d62a-03f1-4e8e-bd42-ca72275d6ccb ("dashboard-metrics-scraper-8d5bb5db8-4wwm7_kubernetes-dashboard(37a1d62a-03f1-4e8e-bd42-ca72275d6ccb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""

	W1216 11:46:08.480426   10008 logs.go:138] Found kubelet problem: Dec 16 11:44:38 old-k8s-version-501600 kubelet[1909]: E1216 11:44:38.897229    1909 pod_workers.go:191] Error syncing pod d2896fe7-5eeb-43d2-95d6-927aef485e51 ("metrics-server-9975d5f86-zn4gg_kube-system(d2896fe7-5eeb-43d2-95d6-927aef485e51)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1216 11:46:08.481376   10008 logs.go:138] Found kubelet problem: Dec 16 11:44:39 old-k8s-version-501600 kubelet[1909]: E1216 11:44:39.896174    1909 pod_workers.go:191] Error syncing pod 37a1d62a-03f1-4e8e-bd42-ca72275d6ccb ("dashboard-metrics-scraper-8d5bb5db8-4wwm7_kubernetes-dashboard(37a1d62a-03f1-4e8e-bd42-ca72275d6ccb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""

	W1216 11:46:08.481995   10008 logs.go:138] Found kubelet problem: Dec 16 11:44:50 old-k8s-version-501600 kubelet[1909]: E1216 11:44:50.898286    1909 pod_workers.go:191] Error syncing pod d2896fe7-5eeb-43d2-95d6-927aef485e51 ("metrics-server-9975d5f86-zn4gg_kube-system(d2896fe7-5eeb-43d2-95d6-927aef485e51)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1216 11:46:08.482321   10008 logs.go:138] Found kubelet problem: Dec 16 11:44:52 old-k8s-version-501600 kubelet[1909]: E1216 11:44:52.894556    1909 pod_workers.go:191] Error syncing pod 37a1d62a-03f1-4e8e-bd42-ca72275d6ccb ("dashboard-metrics-scraper-8d5bb5db8-4wwm7_kubernetes-dashboard(37a1d62a-03f1-4e8e-bd42-ca72275d6ccb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""

	W1216 11:46:08.482321   10008 logs.go:138] Found kubelet problem: Dec 16 11:45:03 old-k8s-version-501600 kubelet[1909]: E1216 11:45:03.895647    1909 pod_workers.go:191] Error syncing pod 37a1d62a-03f1-4e8e-bd42-ca72275d6ccb ("dashboard-metrics-scraper-8d5bb5db8-4wwm7_kubernetes-dashboard(37a1d62a-03f1-4e8e-bd42-ca72275d6ccb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""

	W1216 11:46:08.483252   10008 logs.go:138] Found kubelet problem: Dec 16 11:45:04 old-k8s-version-501600 kubelet[1909]: E1216 11:45:04.897659    1909 pod_workers.go:191] Error syncing pod d2896fe7-5eeb-43d2-95d6-927aef485e51 ("metrics-server-9975d5f86-zn4gg_kube-system(d2896fe7-5eeb-43d2-95d6-927aef485e51)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1216 11:46:08.483252   10008 logs.go:138] Found kubelet problem: Dec 16 11:45:15 old-k8s-version-501600 kubelet[1909]: E1216 11:45:15.893423    1909 pod_workers.go:191] Error syncing pod 37a1d62a-03f1-4e8e-bd42-ca72275d6ccb ("dashboard-metrics-scraper-8d5bb5db8-4wwm7_kubernetes-dashboard(37a1d62a-03f1-4e8e-bd42-ca72275d6ccb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""

	W1216 11:46:08.484214   10008 logs.go:138] Found kubelet problem: Dec 16 11:45:16 old-k8s-version-501600 kubelet[1909]: E1216 11:45:16.895909    1909 pod_workers.go:191] Error syncing pod d2896fe7-5eeb-43d2-95d6-927aef485e51 ("metrics-server-9975d5f86-zn4gg_kube-system(d2896fe7-5eeb-43d2-95d6-927aef485e51)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1216 11:46:08.484214   10008 logs.go:138] Found kubelet problem: Dec 16 11:45:26 old-k8s-version-501600 kubelet[1909]: E1216 11:45:26.948454    1909 pod_workers.go:191] Error syncing pod 37a1d62a-03f1-4e8e-bd42-ca72275d6ccb ("dashboard-metrics-scraper-8d5bb5db8-4wwm7_kubernetes-dashboard(37a1d62a-03f1-4e8e-bd42-ca72275d6ccb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""

	W1216 11:46:08.485212   10008 logs.go:138] Found kubelet problem: Dec 16 11:45:32 old-k8s-version-501600 kubelet[1909]: E1216 11:45:32.894388    1909 pod_workers.go:191] Error syncing pod d2896fe7-5eeb-43d2-95d6-927aef485e51 ("metrics-server-9975d5f86-zn4gg_kube-system(d2896fe7-5eeb-43d2-95d6-927aef485e51)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1216 11:46:08.485212   10008 logs.go:138] Found kubelet problem: Dec 16 11:45:38 old-k8s-version-501600 kubelet[1909]: E1216 11:45:38.892058    1909 pod_workers.go:191] Error syncing pod 37a1d62a-03f1-4e8e-bd42-ca72275d6ccb ("dashboard-metrics-scraper-8d5bb5db8-4wwm7_kubernetes-dashboard(37a1d62a-03f1-4e8e-bd42-ca72275d6ccb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""

	W1216 11:46:08.485212   10008 logs.go:138] Found kubelet problem: Dec 16 11:45:44 old-k8s-version-501600 kubelet[1909]: E1216 11:45:44.890057    1909 pod_workers.go:191] Error syncing pod d2896fe7-5eeb-43d2-95d6-927aef485e51 ("metrics-server-9975d5f86-zn4gg_kube-system(d2896fe7-5eeb-43d2-95d6-927aef485e51)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1216 11:46:08.486227   10008 logs.go:138] Found kubelet problem: Dec 16 11:45:49 old-k8s-version-501600 kubelet[1909]: E1216 11:45:49.888740    1909 pod_workers.go:191] Error syncing pod 37a1d62a-03f1-4e8e-bd42-ca72275d6ccb ("dashboard-metrics-scraper-8d5bb5db8-4wwm7_kubernetes-dashboard(37a1d62a-03f1-4e8e-bd42-ca72275d6ccb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""

	W1216 11:46:08.486227   10008 logs.go:138] Found kubelet problem: Dec 16 11:45:56 old-k8s-version-501600 kubelet[1909]: E1216 11:45:56.890796    1909 pod_workers.go:191] Error syncing pod d2896fe7-5eeb-43d2-95d6-927aef485e51 ("metrics-server-9975d5f86-zn4gg_kube-system(d2896fe7-5eeb-43d2-95d6-927aef485e51)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1216 11:46:08.488233   10008 logs.go:138] Found kubelet problem: Dec 16 11:46:01 old-k8s-version-501600 kubelet[1909]: E1216 11:46:01.889316    1909 pod_workers.go:191] Error syncing pod 37a1d62a-03f1-4e8e-bd42-ca72275d6ccb ("dashboard-metrics-scraper-8d5bb5db8-4wwm7_kubernetes-dashboard(37a1d62a-03f1-4e8e-bd42-ca72275d6ccb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""

	I1216 11:46:08.488233   10008 logs.go:123] Gathering logs for etcd [25fc9ee43f0a] ...

	I1216 11:46:08.488233   10008 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 25fc9ee43f0a"

	I1216 11:46:08.555814   10008 logs.go:123] Gathering logs for kube-scheduler [5bfd011d16fd] ...

	I1216 11:46:08.555814   10008 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5bfd011d16fd"

	I1216 11:46:08.624068   10008 logs.go:123] Gathering logs for kube-proxy [58e72cba6157] ...

	I1216 11:46:08.624068   10008 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 58e72cba6157"

	I1216 11:46:08.668513   10008 logs.go:123] Gathering logs for kubernetes-dashboard [19b65a7c34eb] ...

	I1216 11:46:08.668513   10008 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 19b65a7c34eb"

	I1216 11:46:08.728466   10008 logs.go:123] Gathering logs for container status ...

	I1216 11:46:08.728466   10008 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"

	I1216 11:46:08.837554   10008 logs.go:123] Gathering logs for kube-apiserver [56bb0e9c28d2] ...

	I1216 11:46:08.837554   10008 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 56bb0e9c28d2"

	I1216 11:46:08.914386   10008 logs.go:123] Gathering logs for coredns [e314bd292ad5] ...

	I1216 11:46:08.914386   10008 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 e314bd292ad5"

	I1216 11:46:08.961957   10008 logs.go:123] Gathering logs for kube-controller-manager [d341318320dc] ...

	I1216 11:46:08.961957   10008 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d341318320dc"

	I1216 11:46:09.028247   10008 logs.go:123] Gathering logs for kube-controller-manager [268c261f4e09] ...

	I1216 11:46:09.029230   10008 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 268c261f4e09"

	I1216 11:46:09.098033   10008 logs.go:123] Gathering logs for storage-provisioner [230a8a7960d9] ...

	I1216 11:46:09.098033   10008 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 230a8a7960d9"

	I1216 11:46:09.144024   10008 logs.go:123] Gathering logs for Docker ...

	I1216 11:46:09.144024   10008 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"

	I1216 11:46:09.194035   10008 logs.go:123] Gathering logs for dmesg ...

	I1216 11:46:09.194035   10008 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"

	I1216 11:46:09.222530   10008 logs.go:123] Gathering logs for describe nodes ...

	I1216 11:46:09.222656   10008 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"

	I1216 11:46:09.476940   10008 logs.go:123] Gathering logs for storage-provisioner [2f9bdc06bf7f] ...

	I1216 11:46:09.476940   10008 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 2f9bdc06bf7f"

	I1216 11:46:09.538135   10008 out.go:358] Setting ErrFile to fd 1560...

	I1216 11:46:09.538135   10008 out.go:392] TERM=,COLORTERM=, which probably does not support color

	W1216 11:46:09.540184   10008 out.go:270] X Problems detected in kubelet:

	X Problems detected in kubelet:

	W1216 11:46:09.540184   10008 out.go:270]   Dec 16 11:45:38 old-k8s-version-501600 kubelet[1909]: E1216 11:45:38.892058    1909 pod_workers.go:191] Error syncing pod 37a1d62a-03f1-4e8e-bd42-ca72275d6ccb ("dashboard-metrics-scraper-8d5bb5db8-4wwm7_kubernetes-dashboard(37a1d62a-03f1-4e8e-bd42-ca72275d6ccb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""

	  Dec 16 11:45:38 old-k8s-version-501600 kubelet[1909]: E1216 11:45:38.892058    1909 pod_workers.go:191] Error syncing pod 37a1d62a-03f1-4e8e-bd42-ca72275d6ccb ("dashboard-metrics-scraper-8d5bb5db8-4wwm7_kubernetes-dashboard(37a1d62a-03f1-4e8e-bd42-ca72275d6ccb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""

	W1216 11:46:09.540184   10008 out.go:270]   Dec 16 11:45:44 old-k8s-version-501600 kubelet[1909]: E1216 11:45:44.890057    1909 pod_workers.go:191] Error syncing pod d2896fe7-5eeb-43d2-95d6-927aef485e51 ("metrics-server-9975d5f86-zn4gg_kube-system(d2896fe7-5eeb-43d2-95d6-927aef485e51)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	  Dec 16 11:45:44 old-k8s-version-501600 kubelet[1909]: E1216 11:45:44.890057    1909 pod_workers.go:191] Error syncing pod d2896fe7-5eeb-43d2-95d6-927aef485e51 ("metrics-server-9975d5f86-zn4gg_kube-system(d2896fe7-5eeb-43d2-95d6-927aef485e51)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1216 11:46:09.540184   10008 out.go:270]   Dec 16 11:45:49 old-k8s-version-501600 kubelet[1909]: E1216 11:45:49.888740    1909 pod_workers.go:191] Error syncing pod 37a1d62a-03f1-4e8e-bd42-ca72275d6ccb ("dashboard-metrics-scraper-8d5bb5db8-4wwm7_kubernetes-dashboard(37a1d62a-03f1-4e8e-bd42-ca72275d6ccb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""

	  Dec 16 11:45:49 old-k8s-version-501600 kubelet[1909]: E1216 11:45:49.888740    1909 pod_workers.go:191] Error syncing pod 37a1d62a-03f1-4e8e-bd42-ca72275d6ccb ("dashboard-metrics-scraper-8d5bb5db8-4wwm7_kubernetes-dashboard(37a1d62a-03f1-4e8e-bd42-ca72275d6ccb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""

	W1216 11:46:09.540184   10008 out.go:270]   Dec 16 11:45:56 old-k8s-version-501600 kubelet[1909]: E1216 11:45:56.890796    1909 pod_workers.go:191] Error syncing pod d2896fe7-5eeb-43d2-95d6-927aef485e51 ("metrics-server-9975d5f86-zn4gg_kube-system(d2896fe7-5eeb-43d2-95d6-927aef485e51)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	  Dec 16 11:45:56 old-k8s-version-501600 kubelet[1909]: E1216 11:45:56.890796    1909 pod_workers.go:191] Error syncing pod d2896fe7-5eeb-43d2-95d6-927aef485e51 ("metrics-server-9975d5f86-zn4gg_kube-system(d2896fe7-5eeb-43d2-95d6-927aef485e51)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1216 11:46:09.540184   10008 out.go:270]   Dec 16 11:46:01 old-k8s-version-501600 kubelet[1909]: E1216 11:46:01.889316    1909 pod_workers.go:191] Error syncing pod 37a1d62a-03f1-4e8e-bd42-ca72275d6ccb ("dashboard-metrics-scraper-8d5bb5db8-4wwm7_kubernetes-dashboard(37a1d62a-03f1-4e8e-bd42-ca72275d6ccb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""

	  Dec 16 11:46:01 old-k8s-version-501600 kubelet[1909]: E1216 11:46:01.889316    1909 pod_workers.go:191] Error syncing pod 37a1d62a-03f1-4e8e-bd42-ca72275d6ccb ("dashboard-metrics-scraper-8d5bb5db8-4wwm7_kubernetes-dashboard(37a1d62a-03f1-4e8e-bd42-ca72275d6ccb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""

	I1216 11:46:09.540184   10008 out.go:358] Setting ErrFile to fd 1560...

	I1216 11:46:09.540184   10008 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I1216 11:46:19.541664   10008 api_server.go:253] Checking apiserver healthz at https://127.0.0.1:52658/healthz ...

	I1216 11:46:19.564355   10008 api_server.go:279] https://127.0.0.1:52658/healthz returned 200:

	ok

	I1216 11:46:19.568035   10008 out.go:201] 

	W1216 11:46:19.570426   10008 out.go:270] X Exiting due to K8S_UNHEALTHY_CONTROL_PLANE: wait 6m0s for node: wait for healthy API server: controlPlane never updated to v1.20.0

	X Exiting due to K8S_UNHEALTHY_CONTROL_PLANE: wait 6m0s for node: wait for healthy API server: controlPlane never updated to v1.20.0

	W1216 11:46:19.570589   10008 out.go:270] * Suggestion: Control Plane could not update, try minikube delete --all --purge

	* Suggestion: Control Plane could not update, try minikube delete --all --purge

	W1216 11:46:19.570733   10008 out.go:270] * Related issue: https://github.com/kubernetes/minikube/issues/11417

	* Related issue: https://github.com/kubernetes/minikube/issues/11417

	W1216 11:46:19.570811   10008 out.go:270] * 

	* 

	W1216 11:46:19.572809   10008 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	I1216 11:46:19.576379   10008 out.go:201] 

** /stderr **

start_stop_delete_test.go:257: failed to start minikube post-stop. args "out/minikube-windows-amd64.exe start -p old-k8s-version-501600 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --kubernetes-version=v1.20.0": exit status 102

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:230: ======>  post-mortem[TestStartStop/group/old-k8s-version/serial/SecondStart]: docker inspect <======

helpers_test.go:231: (dbg) Run:  docker inspect old-k8s-version-501600

helpers_test.go:235: (dbg) docker inspect old-k8s-version-501600:

-- stdout --

	[

	    {

	        "Id": "fdcc7b3bda79d18a8eb7ba218e537f935f367da3c81bc5952b53dd56ad166a8c",

	        "Created": "2024-12-16T11:36:44.496495685Z",

	        "Path": "/usr/local/bin/entrypoint",

	        "Args": [

	            "/sbin/init"

	        ],

	        "State": {

	            "Status": "running",

	            "Running": true,

	            "Paused": false,

	            "Restarting": false,

	            "OOMKilled": false,

	            "Dead": false,

	            "Pid": 327370,

	            "ExitCode": 0,

	            "Error": "",

	            "StartedAt": "2024-12-16T11:39:40.696144157Z",

	            "FinishedAt": "2024-12-16T11:39:36.048021693Z"

	        },

	        "Image": "sha256:7036ee4d70b7e266f67949e27a52ed21246dbdde9902b1d29235748548d311cb",

	        "ResolvConfPath": "/var/lib/docker/containers/fdcc7b3bda79d18a8eb7ba218e537f935f367da3c81bc5952b53dd56ad166a8c/resolv.conf",

	        "HostnamePath": "/var/lib/docker/containers/fdcc7b3bda79d18a8eb7ba218e537f935f367da3c81bc5952b53dd56ad166a8c/hostname",

	        "HostsPath": "/var/lib/docker/containers/fdcc7b3bda79d18a8eb7ba218e537f935f367da3c81bc5952b53dd56ad166a8c/hosts",

	        "LogPath": "/var/lib/docker/containers/fdcc7b3bda79d18a8eb7ba218e537f935f367da3c81bc5952b53dd56ad166a8c/fdcc7b3bda79d18a8eb7ba218e537f935f367da3c81bc5952b53dd56ad166a8c-json.log",

	        "Name": "/old-k8s-version-501600",

	        "RestartCount": 0,

	        "Driver": "overlay2",

	        "Platform": "linux",

	        "MountLabel": "",

	        "ProcessLabel": "",

	        "AppArmorProfile": "",

	        "ExecIDs": null,

	        "HostConfig": {

	            "Binds": [

	                "/lib/modules:/lib/modules:ro",

	                "old-k8s-version-501600:/var"

	            ],

	            "ContainerIDFile": "",

	            "LogConfig": {

	                "Type": "json-file",

	                "Config": {}

	            },

	            "NetworkMode": "old-k8s-version-501600",

	            "PortBindings": {

	                "22/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "0"

	                    }

	                ],

	                "2376/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "0"

	                    }

	                ],

	                "32443/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "0"

	                    }

	                ],

	                "5000/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "0"

	                    }

	                ],

	                "8443/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "0"

	                    }

	                ]

	            },

	            "RestartPolicy": {

	                "Name": "no",

	                "MaximumRetryCount": 0

	            },

	            "AutoRemove": false,

	            "VolumeDriver": "",

	            "VolumesFrom": null,

	            "ConsoleSize": [

	                0,

	                0

	            ],

	            "CapAdd": null,

	            "CapDrop": null,

	            "CgroupnsMode": "host",

	            "Dns": [],

	            "DnsOptions": [],

	            "DnsSearch": [],

	            "ExtraHosts": null,

	            "GroupAdd": null,

	            "IpcMode": "private",

	            "Cgroup": "",

	            "Links": null,

	            "OomScoreAdj": 0,

	            "PidMode": "",

	            "Privileged": true,

	            "PublishAllPorts": false,

	            "ReadonlyRootfs": false,

	            "SecurityOpt": [

	                "seccomp=unconfined",

	                "apparmor=unconfined",

	                "label=disable"

	            ],

	            "Tmpfs": {

	                "/run": "",

	                "/tmp": ""

	            },

	            "UTSMode": "",

	            "UsernsMode": "",

	            "ShmSize": 67108864,

	            "Runtime": "runc",

	            "Isolation": "",

	            "CpuShares": 0,

	            "Memory": 2306867200,

	            "NanoCpus": 2000000000,

	            "CgroupParent": "",

	            "BlkioWeight": 0,

	            "BlkioWeightDevice": [],

	            "BlkioDeviceReadBps": [],

	            "BlkioDeviceWriteBps": [],

	            "BlkioDeviceReadIOps": [],

	            "BlkioDeviceWriteIOps": [],

	            "CpuPeriod": 0,

	            "CpuQuota": 0,

	            "CpuRealtimePeriod": 0,

	            "CpuRealtimeRuntime": 0,

	            "CpusetCpus": "",

	            "CpusetMems": "",

	            "Devices": [],

	            "DeviceCgroupRules": null,

	            "DeviceRequests": null,

	            "MemoryReservation": 0,

	            "MemorySwap": 2306867200,

	            "MemorySwappiness": null,

	            "OomKillDisable": false,

	            "PidsLimit": null,

	            "Ulimits": [],

	            "CpuCount": 0,

	            "CpuPercent": 0,

	            "IOMaximumIOps": 0,

	            "IOMaximumBandwidth": 0,

	            "MaskedPaths": null,

	            "ReadonlyPaths": null

	        },

	        "GraphDriver": {

	            "Data": {

	                "LowerDir": "/var/lib/docker/overlay2/a56e17ca21330403e938fff158a5a52d1fd1d82f70755c3e4e6c93e9ce9f97a1-init/diff:/var/lib/docker/overlay2/de1fddd2bf40a2564ebb63a93d07f014b28ed957c2e7e31e096c52511a2a382c/diff",

	                "MergedDir": "/var/lib/docker/overlay2/a56e17ca21330403e938fff158a5a52d1fd1d82f70755c3e4e6c93e9ce9f97a1/merged",

	                "UpperDir": "/var/lib/docker/overlay2/a56e17ca21330403e938fff158a5a52d1fd1d82f70755c3e4e6c93e9ce9f97a1/diff",

	                "WorkDir": "/var/lib/docker/overlay2/a56e17ca21330403e938fff158a5a52d1fd1d82f70755c3e4e6c93e9ce9f97a1/work"

	            },

	            "Name": "overlay2"

	        },

	        "Mounts": [

	            {

	                "Type": "volume",

	                "Name": "old-k8s-version-501600",

	                "Source": "/var/lib/docker/volumes/old-k8s-version-501600/_data",

	                "Destination": "/var",

	                "Driver": "local",

	                "Mode": "z",

	                "RW": true,

	                "Propagation": ""

	            },

	            {

	                "Type": "bind",

	                "Source": "/lib/modules",

	                "Destination": "/lib/modules",

	                "Mode": "ro",

	                "RW": false,

	                "Propagation": "rprivate"

	            }

	        ],

	        "Config": {

	            "Hostname": "old-k8s-version-501600",

	            "Domainname": "",

	            "User": "",

	            "AttachStdin": false,

	            "AttachStdout": false,

	            "AttachStderr": false,

	            "ExposedPorts": {

	                "22/tcp": {},

	                "2376/tcp": {},

	                "32443/tcp": {},

	                "5000/tcp": {},

	                "8443/tcp": {}

	            },

	            "Tty": true,

	            "OpenStdin": false,

	            "StdinOnce": false,

	            "Env": [

	                "container=docker",

	                "PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"

	            ],

	            "Cmd": null,

	            "Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1733912881-20083@sha256:64d8b27f78fd269d886e21ba8fc88be20de183ba5cc5bce33d0810e8a65f1df2",

	            "Volumes": null,

	            "WorkingDir": "/",

	            "Entrypoint": [

	                "/usr/local/bin/entrypoint",

	                "/sbin/init"

	            ],

	            "OnBuild": null,

	            "Labels": {

	                "created_by.minikube.sigs.k8s.io": "true",

	                "mode.minikube.sigs.k8s.io": "old-k8s-version-501600",

	                "name.minikube.sigs.k8s.io": "old-k8s-version-501600",

	                "role.minikube.sigs.k8s.io": ""

	            },

	            "StopSignal": "SIGRTMIN+3"

	        },

	        "NetworkSettings": {

	            "Bridge": "",

	            "SandboxID": "54e7cb0d8828ea1012489620f7ffe3345ec0d744af95d8e063550f42aa97eebf",

	            "SandboxKey": "/var/run/docker/netns/54e7cb0d8828",

	            "Ports": {

	                "22/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "52654"

	                    }

	                ],

	                "2376/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "52655"

	                    }

	                ],

	                "32443/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "52656"

	                    }

	                ],

	                "5000/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "52657"

	                    }

	                ],

	                "8443/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "52658"

	                    }

	                ]

	            },

	            "HairpinMode": false,

	            "LinkLocalIPv6Address": "",

	            "LinkLocalIPv6PrefixLen": 0,

	            "SecondaryIPAddresses": null,

	            "SecondaryIPv6Addresses": null,

	            "EndpointID": "",

	            "Gateway": "",

	            "GlobalIPv6Address": "",

	            "GlobalIPv6PrefixLen": 0,

	            "IPAddress": "",

	            "IPPrefixLen": 0,

	            "IPv6Gateway": "",

	            "MacAddress": "",

	            "Networks": {

	                "old-k8s-version-501600": {

	                    "IPAMConfig": {

	                        "IPv4Address": "192.168.94.2"

	                    },

	                    "Links": null,

	                    "Aliases": null,

	                    "MacAddress": "02:42:c0:a8:5e:02",

	                    "DriverOpts": null,

	                    "NetworkID": "7f913c2cac3a30c2e0aa7ff9d4d3e2475fb09baab5af6f2fe530e5f6984d0431",

	                    "EndpointID": "88344483b6f74d30e854c4bf27fbe9051d3788037858ca4bcb22355423c923b1",

	                    "Gateway": "192.168.94.1",

	                    "IPAddress": "192.168.94.2",

	                    "IPPrefixLen": 24,

	                    "IPv6Gateway": "",

	                    "GlobalIPv6Address": "",

	                    "GlobalIPv6PrefixLen": 0,

	                    "DNSNames": [

	                        "old-k8s-version-501600",

	                        "fdcc7b3bda79"

	                    ]

	                }

	            }

	        }

	    }

	]

-- /stdout --

helpers_test.go:239: (dbg) Run:  out/minikube-windows-amd64.exe status --format={{.Host}} -p old-k8s-version-501600 -n old-k8s-version-501600

helpers_test.go:239: (dbg) Done: out/minikube-windows-amd64.exe status --format={{.Host}} -p old-k8s-version-501600 -n old-k8s-version-501600: (1.5438653s)

helpers_test.go:244: <<< TestStartStop/group/old-k8s-version/serial/SecondStart FAILED: start of post-mortem logs <<<

helpers_test.go:245: ======>  post-mortem[TestStartStop/group/old-k8s-version/serial/SecondStart]: minikube logs <======

helpers_test.go:247: (dbg) Run:  out/minikube-windows-amd64.exe -p old-k8s-version-501600 logs -n 25

helpers_test.go:247: (dbg) Done: out/minikube-windows-amd64.exe -p old-k8s-version-501600 logs -n 25: (5.3521027s)

helpers_test.go:252: TestStartStop/group/old-k8s-version/serial/SecondStart logs: 

-- stdout --

	==> Audit <==

	|---------|--------------------------------------------------------|------------------------------|-------------------|---------|---------------------|---------------------|

	| Command |                          Args                          |           Profile            |       User        | Version |     Start Time      |      End Time       |

	|---------|--------------------------------------------------------|------------------------------|-------------------|---------|---------------------|---------------------|

	| pause   | -p embed-certs-467500                                  | embed-certs-467500           | minikube4\jenkins | v1.34.0 | 16 Dec 24 11:43 UTC | 16 Dec 24 11:43 UTC |

	|         | --alsologtostderr -v=1                                 |                              |                   |         |                     |                     |

	| unpause | -p embed-certs-467500                                  | embed-certs-467500           | minikube4\jenkins | v1.34.0 | 16 Dec 24 11:44 UTC | 16 Dec 24 11:44 UTC |

	|         | --alsologtostderr -v=1                                 |                              |                   |         |                     |                     |

	| delete  | -p embed-certs-467500                                  | embed-certs-467500           | minikube4\jenkins | v1.34.0 | 16 Dec 24 11:44 UTC | 16 Dec 24 11:44 UTC |

	| delete  | -p embed-certs-467500                                  | embed-certs-467500           | minikube4\jenkins | v1.34.0 | 16 Dec 24 11:44 UTC | 16 Dec 24 11:44 UTC |

	| image   | no-preload-811800 image list                           | no-preload-811800            | minikube4\jenkins | v1.34.0 | 16 Dec 24 11:44 UTC | 16 Dec 24 11:44 UTC |

	|         | --format=json                                          |                              |                   |         |                     |                     |

	| start   | -p newest-cni-648700 --memory=2200 --alsologtostderr   | newest-cni-648700            | minikube4\jenkins | v1.34.0 | 16 Dec 24 11:44 UTC | 16 Dec 24 11:45 UTC |

	|         | --wait=apiserver,system_pods,default_sa                |                              |                   |         |                     |                     |

	|         | --network-plugin=cni                                   |                              |                   |         |                     |                     |

	|         | --extra-config=kubeadm.pod-network-cidr=10.42.0.0/16   |                              |                   |         |                     |                     |

	|         | --driver=docker --kubernetes-version=v1.31.2           |                              |                   |         |                     |                     |

	| pause   | -p no-preload-811800                                   | no-preload-811800            | minikube4\jenkins | v1.34.0 | 16 Dec 24 11:44 UTC | 16 Dec 24 11:44 UTC |

	|         | --alsologtostderr -v=1                                 |                              |                   |         |                     |                     |

	| unpause | -p no-preload-811800                                   | no-preload-811800            | minikube4\jenkins | v1.34.0 | 16 Dec 24 11:44 UTC | 16 Dec 24 11:44 UTC |

	|         | --alsologtostderr -v=1                                 |                              |                   |         |                     |                     |

	| delete  | -p no-preload-811800                                   | no-preload-811800            | minikube4\jenkins | v1.34.0 | 16 Dec 24 11:44 UTC | 16 Dec 24 11:44 UTC |

	| delete  | -p no-preload-811800                                   | no-preload-811800            | minikube4\jenkins | v1.34.0 | 16 Dec 24 11:44 UTC | 16 Dec 24 11:44 UTC |

	| start   | -p auto-928300 --memory=3072                           | auto-928300                  | minikube4\jenkins | v1.34.0 | 16 Dec 24 11:44 UTC | 16 Dec 24 11:46 UTC |

	|         | --alsologtostderr --wait=true                          |                              |                   |         |                     |                     |

	|         | --wait-timeout=15m                                     |                              |                   |         |                     |                     |

	|         | --driver=docker                                        |                              |                   |         |                     |                     |

	| image   | default-k8s-diff-port-850800                           | default-k8s-diff-port-850800 | minikube4\jenkins | v1.34.0 | 16 Dec 24 11:44 UTC | 16 Dec 24 11:44 UTC |

	|         | image list --format=json                               |                              |                   |         |                     |                     |

	| pause   | -p                                                     | default-k8s-diff-port-850800 | minikube4\jenkins | v1.34.0 | 16 Dec 24 11:44 UTC | 16 Dec 24 11:44 UTC |

	|         | default-k8s-diff-port-850800                           |                              |                   |         |                     |                     |

	|         | --alsologtostderr -v=1                                 |                              |                   |         |                     |                     |

	| unpause | -p                                                     | default-k8s-diff-port-850800 | minikube4\jenkins | v1.34.0 | 16 Dec 24 11:45 UTC | 16 Dec 24 11:45 UTC |

	|         | default-k8s-diff-port-850800                           |                              |                   |         |                     |                     |

	|         | --alsologtostderr -v=1                                 |                              |                   |         |                     |                     |

	| delete  | -p                                                     | default-k8s-diff-port-850800 | minikube4\jenkins | v1.34.0 | 16 Dec 24 11:45 UTC | 16 Dec 24 11:45 UTC |

	|         | default-k8s-diff-port-850800                           |                              |                   |         |                     |                     |

	| delete  | -p                                                     | default-k8s-diff-port-850800 | minikube4\jenkins | v1.34.0 | 16 Dec 24 11:45 UTC | 16 Dec 24 11:45 UTC |

	|         | default-k8s-diff-port-850800                           |                              |                   |         |                     |                     |

	| start   | -p kindnet-928300                                      | kindnet-928300               | minikube4\jenkins | v1.34.0 | 16 Dec 24 11:45 UTC |                     |

	|         | --memory=3072                                          |                              |                   |         |                     |                     |

	|         | --alsologtostderr --wait=true                          |                              |                   |         |                     |                     |

	|         | --wait-timeout=15m                                     |                              |                   |         |                     |                     |

	|         | --cni=kindnet --driver=docker                          |                              |                   |         |                     |                     |

	| addons  | enable metrics-server -p newest-cni-648700             | newest-cni-648700            | minikube4\jenkins | v1.34.0 | 16 Dec 24 11:45 UTC | 16 Dec 24 11:45 UTC |

	|         | --images=MetricsServer=registry.k8s.io/echoserver:1.4  |                              |                   |         |                     |                     |

	|         | --registries=MetricsServer=fake.domain                 |                              |                   |         |                     |                     |

	| stop    | -p newest-cni-648700                                   | newest-cni-648700            | minikube4\jenkins | v1.34.0 | 16 Dec 24 11:45 UTC | 16 Dec 24 11:45 UTC |

	|         | --alsologtostderr -v=3                                 |                              |                   |         |                     |                     |

	| addons  | enable dashboard -p newest-cni-648700                  | newest-cni-648700            | minikube4\jenkins | v1.34.0 | 16 Dec 24 11:45 UTC | 16 Dec 24 11:45 UTC |

	|         | --images=MetricsScraper=registry.k8s.io/echoserver:1.4 |                              |                   |         |                     |                     |

	| start   | -p newest-cni-648700 --memory=2200 --alsologtostderr   | newest-cni-648700            | minikube4\jenkins | v1.34.0 | 16 Dec 24 11:45 UTC | 16 Dec 24 11:46 UTC |

	|         | --wait=apiserver,system_pods,default_sa                |                              |                   |         |                     |                     |

	|         | --network-plugin=cni                                   |                              |                   |         |                     |                     |

	|         | --extra-config=kubeadm.pod-network-cidr=10.42.0.0/16   |                              |                   |         |                     |                     |

	|         | --driver=docker --kubernetes-version=v1.31.2           |                              |                   |         |                     |                     |

	| image   | newest-cni-648700 image list                           | newest-cni-648700            | minikube4\jenkins | v1.34.0 | 16 Dec 24 11:46 UTC | 16 Dec 24 11:46 UTC |

	|         | --format=json                                          |                              |                   |         |                     |                     |

	| pause   | -p newest-cni-648700                                   | newest-cni-648700            | minikube4\jenkins | v1.34.0 | 16 Dec 24 11:46 UTC | 16 Dec 24 11:46 UTC |

	|         | --alsologtostderr -v=1                                 |                              |                   |         |                     |                     |

	| ssh     | -p auto-928300 pgrep -a                                | auto-928300                  | minikube4\jenkins | v1.34.0 | 16 Dec 24 11:46 UTC | 16 Dec 24 11:46 UTC |

	|         | kubelet                                                |                              |                   |         |                     |                     |

	| unpause | -p newest-cni-648700                                   | newest-cni-648700            | minikube4\jenkins | v1.34.0 | 16 Dec 24 11:46 UTC | 16 Dec 24 11:46 UTC |

	|         | --alsologtostderr -v=1                                 |                              |                   |         |                     |                     |

	|---------|--------------------------------------------------------|------------------------------|-------------------|---------|---------------------|---------------------|

	==> Last Start <==

	Log file created at: 2024/12/16 11:45:41

	Running on machine: minikube4

	Binary: Built with gc go1.23.3 for windows/amd64

	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg

	I1216 11:45:41.413985   10820 out.go:345] Setting OutFile to fd 1216 ...

	I1216 11:45:41.501364   10820 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I1216 11:45:41.501364   10820 out.go:358] Setting ErrFile to fd 1564...

	I1216 11:45:41.501364   10820 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I1216 11:45:41.529625   10820 out.go:352] Setting JSON to false

	I1216 11:45:41.534135   10820 start.go:129] hostinfo: {"hostname":"minikube4","uptime":399812,"bootTime":1733949729,"procs":210,"os":"windows","platform":"Microsoft Windows 10 Enterprise N","platformFamily":"Standalone Workstation","platformVersion":"10.0.19045.5198 Build 19045.5198","kernelVersion":"10.0.19045.5198 Build 19045.5198","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"df6bfb5f-73f2-4acb-9365-df7854ecbb28"}

	W1216 11:45:41.534135   10820 start.go:137] gopshost.Virtualization returned error: not implemented yet

	I1216 11:45:41.538110   10820 out.go:177] * [newest-cni-648700] minikube v1.34.0 on Microsoft Windows 10 Enterprise N 10.0.19045.5198 Build 19045.5198

	I1216 11:45:41.541138   10820 notify.go:220] Checking for updates...

	I1216 11:45:41.543168   10820 out.go:177]   - KUBECONFIG=C:\Users\jenkins.minikube4\minikube-integration\kubeconfig

	I1216 11:45:41.545118   10820 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=

	I1216 11:45:41.547271   10820 out.go:177]   - MINIKUBE_HOME=C:\Users\jenkins.minikube4\minikube-integration\.minikube

	I1216 11:45:41.551313   10820 out.go:177]   - MINIKUBE_LOCATION=20107

	I1216 11:45:41.554409   10820 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I1216 11:45:37.609294    5556 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1216 11:45:38.101646    5556 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1216 11:45:38.605030    5556 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1216 11:45:39.100983    5556 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1216 11:45:39.609798    5556 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1216 11:45:40.108543    5556 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1216 11:45:40.609545    5556 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1216 11:45:41.119782    5556 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1216 11:45:41.679542    5556 kubeadm.go:1113] duration metric: took 5.1934229s to wait for elevateKubeSystemPrivileges

	I1216 11:45:41.679542    5556 kubeadm.go:394] duration metric: took 31.1226686s to StartCluster

	I1216 11:45:41.679542    5556 settings.go:142] acquiring lock: {Name:mk5d8710830d010adb6db61f855b0ef766a8622c Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1216 11:45:41.680529    5556 settings.go:150] Updating kubeconfig:  C:\Users\jenkins.minikube4\minikube-integration\kubeconfig

	I1216 11:45:41.682531    5556 lock.go:35] WriteFile acquiring C:\Users\jenkins.minikube4\minikube-integration\kubeconfig: {Name:mk97c09b788e5010ffd4c9dd9525f9245d5edd25 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1216 11:45:41.684531    5556 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.31.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"

	I1216 11:45:41.684531    5556 start.go:235] Will wait 15m0s for node &{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true}

	I1216 11:45:41.684531    5556 addons.go:507] enable addons start: toEnable=map[ambassador:false amd-gpu-device-plugin:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false]

	I1216 11:45:41.684531    5556 addons.go:69] Setting storage-provisioner=true in profile "auto-928300"

	I1216 11:45:41.684531    5556 addons.go:234] Setting addon storage-provisioner=true in "auto-928300"

	I1216 11:45:41.685531    5556 config.go:182] Loaded profile config "auto-928300": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.31.2

	I1216 11:45:41.685531    5556 host.go:66] Checking if "auto-928300" exists ...

	I1216 11:45:41.684531    5556 addons.go:69] Setting default-storageclass=true in profile "auto-928300"

	I1216 11:45:41.685531    5556 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "auto-928300"

	I1216 11:45:41.691523    5556 out.go:177] * Verifying Kubernetes components...

	I1216 11:45:41.720602    5556 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I1216 11:45:41.723529    5556 cli_runner.go:164] Run: docker container inspect auto-928300 --format={{.State.Status}}

	I1216 11:45:41.728526    5556 cli_runner.go:164] Run: docker container inspect auto-928300 --format={{.State.Status}}

	I1216 11:45:41.810550    5556 addons.go:234] Setting addon default-storageclass=true in "auto-928300"

	I1216 11:45:41.810550    5556 host.go:66] Checking if "auto-928300" exists ...

	I1216 11:45:41.816533    5556 out.go:177]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5

	I1216 11:45:41.556391   10820 config.go:182] Loaded profile config "newest-cni-648700": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.31.2

	I1216 11:45:41.557498   10820 driver.go:394] Setting default libvirt URI to qemu:///system

	I1216 11:45:41.770537   10820 docker.go:123] docker version: linux-27.2.0:Docker Desktop 4.34.2 (167172)

	I1216 11:45:41.785552   10820 cli_runner.go:164] Run: docker system info --format "{{json .}}"

	I1216 11:45:42.208268   10820 info.go:266] docker info: {ID:a15b78d1-f772-48f7-bbf5-f8fe086f3f87 Containers:4 ContainersRunning:3 ContainersPaused:0 ContainersStopped:1 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:92 OomKillDisable:true NGoroutines:92 SystemTime:2024-12-16 11:45:42.16638444 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:12 KernelVersion:5.15.153.1-microsoft-standard-WSL2 OperatingSystem:Docker Desktop OSType:linux Architecture:x86_64 Inde

xServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:16 MemTotal:33657536512 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy:http.docker.internal:3128 HTTPSProxy:http.docker.internal:3128 NoProxy:hubproxy.docker.internal Name:docker-desktop Labels:[com.docker.desktop.address=npipe://\\.\pipe\docker_cli] ExperimentalBuild:false ServerVersion:27.2.0 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:8fc6bcff51318944179630522a095cc9dbf9f353 Expected:8fc6bcff51318944179630522a095cc9dbf9f353} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0 E

xpected:de40ad0} SecurityOptions:[name=seccomp,profile=unconfined] ProductLicense: Warnings:[WARNING: No blkio throttle.read_bps_device support WARNING: No blkio throttle.write_bps_device support WARNING: No blkio throttle.read_iops_device support WARNING: No blkio throttle.write_iops_device support WARNING: daemon is not using the default seccomp profile] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:C:\Program Files\Docker\cli-plugins\docker-buildx.exe SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.16.2-desktop.1] map[Name:compose Path:C:\Program Files\Docker\cli-plugins\docker-compose.exe SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.2-desktop.2] map[Name:debug Path:C:\Program Files\Docker\cli-plugins\docker-debug.exe SchemaVersion:0.1.0 ShortDescription:Get a shell into any image or container Vendor:Docker Inc. Version:0.0.34] map[Name:desktop Path:C:\Program Files\Docker\cli-plugins\docker-desktop.exe SchemaV

ersion:0.1.0 ShortDescription:Docker Desktop commands (Alpha) Vendor:Docker Inc. Version:v0.0.15] map[Name:dev Path:C:\Program Files\Docker\cli-plugins\docker-dev.exe SchemaVersion:0.1.0 ShortDescription:Docker Dev Environments Vendor:Docker Inc. Version:v0.1.2] map[Name:extension Path:C:\Program Files\Docker\cli-plugins\docker-extension.exe SchemaVersion:0.1.0 ShortDescription:Manages Docker extensions Vendor:Docker Inc. Version:v0.2.25] map[Name:feedback Path:C:\Program Files\Docker\cli-plugins\docker-feedback.exe SchemaVersion:0.1.0 ShortDescription:Provide feedback, right in your terminal! Vendor:Docker Inc. Version:v1.0.5] map[Name:init Path:C:\Program Files\Docker\cli-plugins\docker-init.exe SchemaVersion:0.1.0 ShortDescription:Creates Docker-related starter files for your project Vendor:Docker Inc. Version:v1.3.0] map[Name:sbom Path:C:\Program Files\Docker\cli-plugins\docker-sbom.exe SchemaVersion:0.1.0 ShortDescription:View the packaged-based Software Bill Of Materials (SBOM) for an image URL:https://

github.com/docker/sbom-cli-plugin Vendor:Anchore Inc. Version:0.6.0] map[Name:scout Path:C:\Program Files\Docker\cli-plugins\docker-scout.exe SchemaVersion:0.1.0 ShortDescription:Docker Scout Vendor:Docker Inc. Version:v1.13.0]] Warnings:<nil>}}

	I1216 11:45:42.216928   10820 out.go:177] * Using the docker driver based on existing profile

	I1216 11:45:41.818540    5556 addons.go:431] installing /etc/kubernetes/addons/storage-provisioner.yaml

	I1216 11:45:41.818540    5556 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)

	I1216 11:45:41.827531    5556 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" auto-928300

	I1216 11:45:41.829552    5556 cli_runner.go:164] Run: docker container inspect auto-928300 --format={{.State.Status}}

	I1216 11:45:41.960609    5556 addons.go:431] installing /etc/kubernetes/addons/storageclass.yaml

	I1216 11:45:41.960609    5556 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)

	I1216 11:45:41.974600    5556 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:53002 SSHKeyPath:C:\Users\jenkins.minikube4\minikube-integration\.minikube\machines\auto-928300\id_rsa Username:docker}

	I1216 11:45:41.981634    5556 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" auto-928300

	I1216 11:45:42.062614    5556 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:53002 SSHKeyPath:C:\Users\jenkins.minikube4\minikube-integration\.minikube\machines\auto-928300\id_rsa Username:docker}

	I1216 11:45:42.405347    5556 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.31.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.65.254 host.minikube.internal\n           fallthrough\n        }' -e '/^        errors *$/i \        log' | sudo /var/lib/minikube/binaries/v1.31.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"

	I1216 11:45:42.512971    5556 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.2/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml

	I1216 11:45:42.220114   10820 start.go:297] selected driver: docker

	I1216 11:45:42.220228   10820 start.go:901] validating driver "docker" against &{Name:newest-cni-648700 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1733912881-20083@sha256:64d8b27f78fd269d886e21ba8fc88be20de183ba5cc5bce33d0810e8a65f1df2 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.2 ClusterName:newest-cni-648700 Namespace:default APIServerHAVIP: APIServerNa

me:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:kubeadm Key:pod-network-cidr Value:10.42.0.0/16}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:false default_sa:true extra:false kubelet:false node_ready:false system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false E

xtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:C:\Users\jenkins.minikube4:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I1216 11:45:42.220228   10820 start.go:912] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}

	I1216 11:45:42.308356   10820 cli_runner.go:164] Run: docker system info --format "{{json .}}"

	I1216 11:45:42.665053   10820 info.go:266] docker info: {ID:a15b78d1-f772-48f7-bbf5-f8fe086f3f87 Containers:4 ContainersRunning:3 ContainersPaused:0 ContainersStopped:1 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:92 OomKillDisable:true NGoroutines:92 SystemTime:2024-12-16 11:45:42.638153927 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:12 KernelVersion:5.15.153.1-microsoft-standard-WSL2 OperatingSystem:Docker Desktop OSType:linux Architecture:x86_64 Ind

exServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:16 MemTotal:33657536512 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy:http.docker.internal:3128 HTTPSProxy:http.docker.internal:3128 NoProxy:hubproxy.docker.internal Name:docker-desktop Labels:[com.docker.desktop.address=npipe://\\.\pipe\docker_cli] ExperimentalBuild:false ServerVersion:27.2.0 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:8fc6bcff51318944179630522a095cc9dbf9f353 Expected:8fc6bcff51318944179630522a095cc9dbf9f353} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0

Expected:de40ad0} SecurityOptions:[name=seccomp,profile=unconfined] ProductLicense: Warnings:[WARNING: No blkio throttle.read_bps_device support WARNING: No blkio throttle.write_bps_device support WARNING: No blkio throttle.read_iops_device support WARNING: No blkio throttle.write_iops_device support WARNING: daemon is not using the default seccomp profile] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:C:\Program Files\Docker\cli-plugins\docker-buildx.exe SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.16.2-desktop.1] map[Name:compose Path:C:\Program Files\Docker\cli-plugins\docker-compose.exe SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.2-desktop.2] map[Name:debug Path:C:\Program Files\Docker\cli-plugins\docker-debug.exe SchemaVersion:0.1.0 ShortDescription:Get a shell into any image or container Vendor:Docker Inc. Version:0.0.34] map[Name:desktop Path:C:\Program Files\Docker\cli-plugins\docker-desktop.exe Schema

Version:0.1.0 ShortDescription:Docker Desktop commands (Alpha) Vendor:Docker Inc. Version:v0.0.15] map[Name:dev Path:C:\Program Files\Docker\cli-plugins\docker-dev.exe SchemaVersion:0.1.0 ShortDescription:Docker Dev Environments Vendor:Docker Inc. Version:v0.1.2] map[Name:extension Path:C:\Program Files\Docker\cli-plugins\docker-extension.exe SchemaVersion:0.1.0 ShortDescription:Manages Docker extensions Vendor:Docker Inc. Version:v0.2.25] map[Name:feedback Path:C:\Program Files\Docker\cli-plugins\docker-feedback.exe SchemaVersion:0.1.0 ShortDescription:Provide feedback, right in your terminal! Vendor:Docker Inc. Version:v1.0.5] map[Name:init Path:C:\Program Files\Docker\cli-plugins\docker-init.exe SchemaVersion:0.1.0 ShortDescription:Creates Docker-related starter files for your project Vendor:Docker Inc. Version:v1.3.0] map[Name:sbom Path:C:\Program Files\Docker\cli-plugins\docker-sbom.exe SchemaVersion:0.1.0 ShortDescription:View the packaged-based Software Bill Of Materials (SBOM) for an image URL:https:/

/github.com/docker/sbom-cli-plugin Vendor:Anchore Inc. Version:0.6.0] map[Name:scout Path:C:\Program Files\Docker\cli-plugins\docker-scout.exe SchemaVersion:0.1.0 ShortDescription:Docker Scout Vendor:Docker Inc. Version:v1.13.0]] Warnings:<nil>}}

	I1216 11:45:42.665053   10820 start_flags.go:966] Waiting for components: map[apiserver:true apps_running:false default_sa:true extra:false kubelet:false node_ready:false system_pods:true]

	I1216 11:45:42.665053   10820 cni.go:84] Creating CNI manager for ""

	I1216 11:45:42.665053   10820 cni.go:158] "docker" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge

	I1216 11:45:42.665053   10820 start.go:340] cluster config:

	{Name:newest-cni-648700 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1733912881-20083@sha256:64d8b27f78fd269d886e21ba8fc88be20de183ba5cc5bce33d0810e8a65f1df2 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.2 ClusterName:newest-cni-648700 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local Containe

rRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:kubeadm Key:pod-network-cidr Value:10.42.0.0/16}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:false default_sa:true extra:false kubelet:false node_ready:false system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:C:\Users\jenkins.m

inikube4:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I1216 11:45:42.669071   10820 out.go:177] * Starting "newest-cni-648700" primary control-plane node in "newest-cni-648700" cluster

	I1216 11:45:42.671070   10820 cache.go:121] Beginning downloading kic base image for docker with docker

	I1216 11:45:42.674068   10820 out.go:177] * Pulling base image v0.0.45-1733912881-20083 ...

	I1216 11:45:42.676071   10820 preload.go:131] Checking if preload exists for k8s version v1.31.2 and runtime docker

	I1216 11:45:42.676071   10820 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1733912881-20083@sha256:64d8b27f78fd269d886e21ba8fc88be20de183ba5cc5bce33d0810e8a65f1df2 in local docker daemon

	I1216 11:45:42.676071   10820 preload.go:146] Found local preload: C:\Users\jenkins.minikube4\minikube-integration\.minikube\cache\preloaded-tarball\preloaded-images-k8s-v18-v1.31.2-docker-overlay2-amd64.tar.lz4

	I1216 11:45:42.676071   10820 cache.go:56] Caching tarball of preloaded images

	I1216 11:45:42.677105   10820 preload.go:172] Found C:\Users\jenkins.minikube4\minikube-integration\.minikube\cache\preloaded-tarball\preloaded-images-k8s-v18-v1.31.2-docker-overlay2-amd64.tar.lz4 in cache, skipping download

	I1216 11:45:42.678074   10820 cache.go:59] Finished verifying existence of preloaded tar for v1.31.2 on docker

	I1216 11:45:42.678074   10820 profile.go:143] Saving config to C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\newest-cni-648700\config.json ...

	I1216 11:45:42.807070   10820 image.go:98] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1733912881-20083@sha256:64d8b27f78fd269d886e21ba8fc88be20de183ba5cc5bce33d0810e8a65f1df2 in local docker daemon, skipping pull

	I1216 11:45:42.807070   10820 cache.go:144] gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1733912881-20083@sha256:64d8b27f78fd269d886e21ba8fc88be20de183ba5cc5bce33d0810e8a65f1df2 exists in daemon, skipping load

	I1216 11:45:42.808078   10820 cache.go:194] Successfully downloaded all kic artifacts

	I1216 11:45:42.808078   10820 start.go:360] acquireMachinesLock for newest-cni-648700: {Name:mkbcadaea0a69fa8ba2e13043ab38c2c12047b88 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I1216 11:45:42.809085   10820 start.go:364] duration metric: took 1.007ms to acquireMachinesLock for "newest-cni-648700"

	I1216 11:45:42.809085   10820 start.go:96] Skipping create...Using existing machine configuration

	I1216 11:45:42.809085   10820 fix.go:54] fixHost starting: 

	I1216 11:45:42.832065   10820 cli_runner.go:164] Run: docker container inspect newest-cni-648700 --format={{.State.Status}}

	I1216 11:45:42.925046   10820 fix.go:112] recreateIfNeeded on newest-cni-648700: state=Stopped err=<nil>

	W1216 11:45:42.925145   10820 fix.go:138] unexpected machine state, will restart: <nil>

	I1216 11:45:42.929428   10820 out.go:177] * Restarting existing docker container for "newest-cni-648700" ...

	I1216 11:45:40.730278   10008 pod_ready.go:103] pod "metrics-server-9975d5f86-zn4gg" in "kube-system" namespace has status "Ready":"False"

	I1216 11:45:43.230721   10008 pod_ready.go:103] pod "metrics-server-9975d5f86-zn4gg" in "kube-system" namespace has status "Ready":"False"

	I1216 11:45:42.611068    5556 ssh_runner.go:195] Run: sudo systemctl start kubelet

	I1216 11:45:42.612067    5556 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.2/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml

	I1216 11:45:43.887183    5556 ssh_runner.go:235] Completed: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.31.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.65.254 host.minikube.internal\n           fallthrough\n        }' -e '/^        errors *$/i \        log' | sudo /var/lib/minikube/binaries/v1.31.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -": (1.4817664s)

	I1216 11:45:43.887183    5556 start.go:971] {"host.minikube.internal": 192.168.65.254} host record injected into CoreDNS's ConfigMap

	I1216 11:45:44.491011    5556 kapi.go:214] "coredns" deployment in "kube-system" namespace and "auto-928300" context rescaled to 1 replicas

	I1216 11:45:45.283911    5556 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.2/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: (2.7708108s)

	I1216 11:45:45.283911    5556 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.2/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: (2.6717193s)

	I1216 11:45:45.283911    5556 ssh_runner.go:235] Completed: sudo systemctl start kubelet: (2.6727179s)

	I1216 11:45:45.299614    5556 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "8443/tcp") 0).HostPort}}'" auto-928300

	I1216 11:45:45.390764    5556 node_ready.go:35] waiting up to 15m0s for node "auto-928300" to be "Ready" ...

	I1216 11:45:45.393786    5556 out.go:177] * Enabled addons: storage-provisioner, default-storageclass

	I1216 11:45:42.118670    5140 main.go:141] libmachine: SSH cmd err, output: <nil>: --- /lib/systemd/system/docker.service	2024-12-07 10:37:19.000000000 +0000

	+++ /lib/systemd/system/docker.service.new	2024-12-16 11:45:39.943413623 +0000

	@@ -1,46 +1,49 @@

	 [Unit]

	 Description=Docker Application Container Engine

	 Documentation=https://docs.docker.com

	-After=network-online.target docker.socket firewalld.service containerd.service time-set.target

	-Wants=network-online.target containerd.service

	+BindsTo=containerd.service

	+After=network-online.target firewalld.service containerd.service

	+Wants=network-online.target

	 Requires=docker.socket

	+StartLimitBurst=3

	+StartLimitIntervalSec=60

	 [Service]

	 Type=notify

	-# the default is not to use systemd for cgroups because the delegate issues still

	-# exists and systemd currently does not support the cgroup feature set required

	-# for containers run by docker

	-ExecStart=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock

	-ExecReload=/bin/kill -s HUP $MAINPID

	-TimeoutStartSec=0

	-RestartSec=2

	-Restart=always

	+Restart=on-failure

	-# Note that StartLimit* options were moved from "Service" to "Unit" in systemd 229.

	-# Both the old, and new location are accepted by systemd 229 and up, so using the old location

	-# to make them work for either version of systemd.

	-StartLimitBurst=3

	-# Note that StartLimitInterval was renamed to StartLimitIntervalSec in systemd 230.

	-# Both the old, and new name are accepted by systemd 230 and up, so using the old name to make

	-# this option work for either version of systemd.

	-StartLimitInterval=60s

	+

	+# This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	+# The base configuration already specifies an 'ExecStart=...' command. The first directive

	+# here is to clear out that command inherited from the base configuration. Without this,

	+# the command from the base configuration and the command specified here are treated as

	+# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	+# will catch this invalid input and refuse to start the service with an error like:

	+#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	+

	+# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	+# container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	+ExecStart=

	+ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12 

	+ExecReload=/bin/kill -s HUP $MAINPID

	 # Having non-zero Limit*s causes performance problems due to accounting overhead

	 # in the kernel. We recommend using cgroups to do container-local accounting.

	+LimitNOFILE=infinity

	 LimitNPROC=infinity

	 LimitCORE=infinity

	-# Comment TasksMax if your systemd version does not support it.

	-# Only systemd 226 and above support this option.

	+# Uncomment TasksMax if your systemd version supports it.

	+# Only systemd 226 and above support this version.

	 TasksMax=infinity

	+TimeoutStartSec=0

	 # set delegate yes so that systemd does not reset the cgroups of docker containers

	 Delegate=yes

	 # kill only the docker process, not all processes in the cgroup

	 KillMode=process

	-OOMScoreAdjust=-500

	 [Install]

	 WantedBy=multi-user.target

	Synchronizing state of docker.service with SysV service script with /lib/systemd/systemd-sysv-install.

	Executing: /lib/systemd/systemd-sysv-install enable docker

	I1216 11:45:42.118670    5140 machine.go:96] duration metric: took 4.5282933s to provisionDockerMachine

	I1216 11:45:42.118670    5140 client.go:171] duration metric: took 29.8820284s to LocalClient.Create

	I1216 11:45:42.118670    5140 start.go:167] duration metric: took 29.8820284s to libmachine.API.Create "kindnet-928300"

	I1216 11:45:42.118670    5140 start.go:293] postStartSetup for "kindnet-928300" (driver="docker")

	I1216 11:45:42.118670    5140 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]

	I1216 11:45:42.134378    5140 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs

	I1216 11:45:42.141394    5140 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kindnet-928300

	I1216 11:45:42.234775    5140 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:53070 SSHKeyPath:C:\Users\jenkins.minikube4\minikube-integration\.minikube\machines\kindnet-928300\id_rsa Username:docker}

	I1216 11:45:42.430345    5140 ssh_runner.go:195] Run: cat /etc/os-release

	I1216 11:45:42.444349    5140 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found

	I1216 11:45:42.444349    5140 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found

	I1216 11:45:42.444349    5140 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found

	I1216 11:45:42.444349    5140 info.go:137] Remote host: Ubuntu 22.04.5 LTS

	I1216 11:45:42.444349    5140 filesync.go:126] Scanning C:\Users\jenkins.minikube4\minikube-integration\.minikube\addons for local assets ...

	I1216 11:45:42.444349    5140 filesync.go:126] Scanning C:\Users\jenkins.minikube4\minikube-integration\.minikube\files for local assets ...

	I1216 11:45:42.444349    5140 filesync.go:149] local asset: C:\Users\jenkins.minikube4\minikube-integration\.minikube\files\etc\ssl\certs\114522.pem -> 114522.pem in /etc/ssl/certs

	I1216 11:45:42.458334    5140 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs

	I1216 11:45:42.481355    5140 ssh_runner.go:362] scp C:\Users\jenkins.minikube4\minikube-integration\.minikube\files\etc\ssl\certs\114522.pem --> /etc/ssl/certs/114522.pem (1708 bytes)

	I1216 11:45:42.538554    5140 start.go:296] duration metric: took 419.8648ms for postStartSetup

	I1216 11:45:42.551913    5140 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" kindnet-928300

	I1216 11:45:42.641067    5140 profile.go:143] Saving config to C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\kindnet-928300\config.json ...

	I1216 11:45:42.659067    5140 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I1216 11:45:42.667072    5140 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kindnet-928300

	I1216 11:45:42.760080    5140 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:53070 SSHKeyPath:C:\Users\jenkins.minikube4\minikube-integration\.minikube\machines\kindnet-928300\id_rsa Username:docker}

	I1216 11:45:42.937436    5140 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"

	I1216 11:45:42.949422    5140 start.go:128] duration metric: took 30.7197404s to createHost

	I1216 11:45:42.949422    5140 start.go:83] releasing machines lock for "kindnet-928300", held for 30.7197404s

	I1216 11:45:42.957436    5140 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" kindnet-928300

	I1216 11:45:43.051379    5140 ssh_runner.go:195] Run: curl.exe -sS -m 2 https://registry.k8s.io/

	I1216 11:45:43.059386    5140 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kindnet-928300

	I1216 11:45:43.060381    5140 ssh_runner.go:195] Run: cat /version.json

	I1216 11:45:43.068391    5140 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kindnet-928300

	I1216 11:45:43.140399    5140 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:53070 SSHKeyPath:C:\Users\jenkins.minikube4\minikube-integration\.minikube\machines\kindnet-928300\id_rsa Username:docker}

	I1216 11:45:43.142413    5140 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:53070 SSHKeyPath:C:\Users\jenkins.minikube4\minikube-integration\.minikube\machines\kindnet-928300\id_rsa Username:docker}

	W1216 11:45:43.259797    5140 start.go:867] [curl.exe -sS -m 2 https://registry.k8s.io/] failed: curl.exe -sS -m 2 https://registry.k8s.io/: Process exited with status 127

	stdout:

	stderr:

	bash: line 1: curl.exe: command not found

	I1216 11:45:43.270802    5140 ssh_runner.go:195] Run: systemctl --version

	I1216 11:45:43.310801    5140 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"

	I1216 11:45:43.337904    5140 ssh_runner.go:195] Run: sudo find \etc\cni\net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "grep -q loopback {} && ( grep -q name {} || sudo sed -i '/"type": "loopback"/i \ \ \ \ "name": "loopback",' {} ) && sudo sed -i 's|"cniVersion": ".*"|"cniVersion": "1.0.0"|g' {}" ;

	W1216 11:45:43.359958    5140 start.go:439] unable to name loopback interface in configureRuntimes: unable to patch loopback cni config "/etc/cni/net.d/*loopback.conf*": sudo find \etc\cni\net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "grep -q loopback {} && ( grep -q name {} || sudo sed -i '/"type": "loopback"/i \ \ \ \ "name": "loopback",' {} ) && sudo sed -i 's|"cniVersion": ".*"|"cniVersion": "1.0.0"|g' {}" ;: Process exited with status 1

	stdout:

	stderr:

	find: '\\etc\\cni\\net.d': No such file or directory

	W1216 11:45:43.359958    5140 out.go:270] ! Failing to connect to https://registry.k8s.io/ from inside the minikube container

	W1216 11:45:43.359958    5140 out.go:270] * To pull new external images, you may need to configure a proxy: https://minikube.sigs.k8s.io/docs/reference/networking/proxy/

	I1216 11:45:43.368954    5140 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;

	I1216 11:45:43.442966    5140 cni.go:262] disabled [/etc/cni/net.d/100-crio-bridge.conf, /etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)

	I1216 11:45:43.442966    5140 start.go:495] detecting cgroup driver to use...

	I1216 11:45:43.442966    5140 detect.go:187] detected "cgroupfs" cgroup driver on host os

	I1216 11:45:43.444028    5140 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///run/containerd/containerd.sock

	" | sudo tee /etc/crictl.yaml"

	I1216 11:45:43.601523    5140 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.10"|' /etc/containerd/config.toml"

	I1216 11:45:43.646062    5140 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"

	I1216 11:45:43.671038    5140 containerd.go:146] configuring containerd to use "cgroupfs" as cgroup driver...

	I1216 11:45:43.693171    5140 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"

	I1216 11:45:43.743155    5140 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"

	I1216 11:45:43.781171    5140 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"

	I1216 11:45:43.823166    5140 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"

	I1216 11:45:43.862165    5140 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"

	I1216 11:45:43.905180    5140 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"

	I1216 11:45:44.026779    5140 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *enable_unprivileged_ports = .*/d' /etc/containerd/config.toml"

	I1216 11:45:44.059778    5140 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)\[plugins."io.containerd.grpc.v1.cri"\]|&\n\1  enable_unprivileged_ports = true|' /etc/containerd/config.toml"

	I1216 11:45:44.110102    5140 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables

	I1216 11:45:44.146523    5140 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"

	I1216 11:45:44.193348    5140 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I1216 11:45:44.383502    5140 ssh_runner.go:195] Run: sudo systemctl restart containerd

	I1216 11:45:44.643101    5140 start.go:495] detecting cgroup driver to use...

	I1216 11:45:44.643177    5140 detect.go:187] detected "cgroupfs" cgroup driver on host os

	I1216 11:45:44.658507    5140 ssh_runner.go:195] Run: sudo systemctl cat docker.service

	I1216 11:45:44.698520    5140 cruntime.go:279] skipping containerd shutdown because we are bound to it

	I1216 11:45:44.719511    5140 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio

	I1216 11:45:44.749506    5140 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/cri-dockerd.sock

	" | sudo tee /etc/crictl.yaml"

	I1216 11:45:44.810157    5140 ssh_runner.go:195] Run: which cri-dockerd

	I1216 11:45:44.832124    5140 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/cri-docker.service.d

	I1216 11:45:44.851134    5140 ssh_runner.go:362] scp memory --> /etc/systemd/system/cri-docker.service.d/10-cni.conf (190 bytes)

	I1216 11:45:44.922194    5140 ssh_runner.go:195] Run: sudo systemctl unmask docker.service

	I1216 11:45:45.122003    5140 ssh_runner.go:195] Run: sudo systemctl enable docker.socket

	I1216 11:45:45.312213    5140 docker.go:574] configuring docker to use "cgroupfs" as cgroup driver...

	I1216 11:45:45.313537    5140 ssh_runner.go:362] scp memory --> /etc/docker/daemon.json (130 bytes)

	I1216 11:45:45.361767    5140 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I1216 11:45:45.569930    5140 ssh_runner.go:195] Run: sudo systemctl restart docker

	I1216 11:45:42.949422   10820 cli_runner.go:164] Run: docker start newest-cni-648700

	I1216 11:45:43.662037   10820 cli_runner.go:164] Run: docker container inspect newest-cni-648700 --format={{.State.Status}}

	I1216 11:45:43.750154   10820 kic.go:430] container "newest-cni-648700" state is running.

	I1216 11:45:43.761156   10820 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" newest-cni-648700

	I1216 11:45:43.853165   10820 profile.go:143] Saving config to C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\newest-cni-648700\config.json ...

	I1216 11:45:43.855154   10820 machine.go:93] provisionDockerMachine start ...

	I1216 11:45:43.866180   10820 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" newest-cni-648700

	I1216 11:45:43.991718   10820 main.go:141] libmachine: Using SSH client type: native

	I1216 11:45:43.991718   10820 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x1443ea0] 0x14469e0 <nil>  [] 0s} 127.0.0.1 53107 <nil> <nil>}

	I1216 11:45:43.992667   10820 main.go:141] libmachine: About to run SSH command:

	hostname

	I1216 11:45:43.996363   10820 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: EOF

	I1216 11:45:45.401767    5556 addons.go:510] duration metric: took 3.7170629s for enable addons: enabled=[storage-provisioner default-storageclass]

	I1216 11:45:45.432676    5556 node_ready.go:49] node "auto-928300" has status "Ready":"True"

	I1216 11:45:45.432746    5556 node_ready.go:38] duration metric: took 41.9802ms for node "auto-928300" to be "Ready" ...

	I1216 11:45:45.432833    5556 pod_ready.go:36] extra waiting up to 15m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I1216 11:45:45.497247    5556 pod_ready.go:79] waiting up to 15m0s for pod "coredns-7c65d6cfc9-f2lcp" in "kube-system" namespace to be "Ready" ...

	I1216 11:45:47.524338    5556 pod_ready.go:103] pod "coredns-7c65d6cfc9-f2lcp" in "kube-system" namespace has status "Ready":"False"

	I1216 11:45:46.579347    5140 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service cri-docker.socket

	I1216 11:45:46.632841    5140 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service cri-docker.service

	I1216 11:45:46.674044    5140 ssh_runner.go:195] Run: sudo systemctl unmask cri-docker.socket

	I1216 11:45:46.867527    5140 ssh_runner.go:195] Run: sudo systemctl enable cri-docker.socket

	I1216 11:45:47.067743    5140 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I1216 11:45:47.262718    5140 ssh_runner.go:195] Run: sudo systemctl restart cri-docker.socket

	I1216 11:45:47.304724    5140 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service cri-docker.service

	I1216 11:45:47.343590    5140 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I1216 11:45:47.536105    5140 ssh_runner.go:195] Run: sudo systemctl restart cri-docker.service

	I1216 11:45:47.705980    5140 start.go:542] Will wait 60s for socket path /var/run/cri-dockerd.sock

	I1216 11:45:47.718964    5140 ssh_runner.go:195] Run: stat /var/run/cri-dockerd.sock

	I1216 11:45:47.728964    5140 start.go:563] Will wait 60s for crictl version

	I1216 11:45:47.737969    5140 ssh_runner.go:195] Run: which crictl

	I1216 11:45:47.759981    5140 ssh_runner.go:195] Run: sudo /usr/bin/crictl version

	I1216 11:45:47.832654    5140 start.go:579] Version:  0.1.0

	RuntimeName:  docker

	RuntimeVersion:  27.4.0

	RuntimeApiVersion:  v1

	I1216 11:45:47.839652    5140 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}

	I1216 11:45:47.924526    5140 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}

	I1216 11:45:45.733181   10008 pod_ready.go:103] pod "metrics-server-9975d5f86-zn4gg" in "kube-system" namespace has status "Ready":"False"

	I1216 11:45:48.229977   10008 pod_ready.go:103] pod "metrics-server-9975d5f86-zn4gg" in "kube-system" namespace has status "Ready":"False"

	I1216 11:45:47.983310    5140 out.go:235] * Preparing Kubernetes v1.31.2 on Docker 27.4.0 ...

	I1216 11:45:47.994468    5140 cli_runner.go:164] Run: docker exec -t kindnet-928300 dig +short host.docker.internal

	I1216 11:45:48.216978    5140 network.go:96] got host ip for mount in container by digging dns: 192.168.65.254

	I1216 11:45:48.229977    5140 ssh_runner.go:195] Run: grep 192.168.65.254	host.minikube.internal$ /etc/hosts

	I1216 11:45:48.237992    5140 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.65.254	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I1216 11:45:48.272269    5140 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "8443/tcp") 0).HostPort}}'" kindnet-928300

	I1216 11:45:48.352044    5140 kubeadm.go:883] updating cluster {Name:kindnet-928300 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1733912881-20083@sha256:64d8b27f78fd269d886e21ba8fc88be20de183ba5cc5bce33d0810e8a65f1df2 Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.2 ClusterName:kindnet-928300 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServer

Names:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:kindnet} Nodes:[{Name: IP:192.168.103.2 Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:C:\Users\jenkins.minikube4:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableM

etrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...

	I1216 11:45:48.352044    5140 preload.go:131] Checking if preload exists for k8s version v1.31.2 and runtime docker

	I1216 11:45:48.362056    5140 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}

	I1216 11:45:48.408168    5140 docker.go:689] Got preloaded images: -- stdout --

	registry.k8s.io/kube-apiserver:v1.31.2

	registry.k8s.io/kube-controller-manager:v1.31.2

	registry.k8s.io/kube-scheduler:v1.31.2

	registry.k8s.io/kube-proxy:v1.31.2

	registry.k8s.io/coredns/coredns:v1.11.3

	registry.k8s.io/etcd:3.5.15-0

	registry.k8s.io/pause:3.10

	gcr.io/k8s-minikube/storage-provisioner:v5

	-- /stdout --

	I1216 11:45:48.408168    5140 docker.go:619] Images already preloaded, skipping extraction

	I1216 11:45:48.422035    5140 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}

	I1216 11:45:48.469790    5140 docker.go:689] Got preloaded images: -- stdout --

	registry.k8s.io/kube-apiserver:v1.31.2

	registry.k8s.io/kube-controller-manager:v1.31.2

	registry.k8s.io/kube-scheduler:v1.31.2

	registry.k8s.io/kube-proxy:v1.31.2

	registry.k8s.io/coredns/coredns:v1.11.3

	registry.k8s.io/etcd:3.5.15-0

	registry.k8s.io/pause:3.10

	gcr.io/k8s-minikube/storage-provisioner:v5

	-- /stdout --

	I1216 11:45:48.469857    5140 cache_images.go:84] Images are preloaded, skipping loading

	I1216 11:45:48.469913    5140 kubeadm.go:934] updating node { 192.168.103.2 8443 v1.31.2 docker true true} ...

	I1216 11:45:48.470239    5140 kubeadm.go:946] kubelet [Unit]

	Wants=docker.socket

	[Service]

	ExecStart=

	ExecStart=/var/lib/minikube/binaries/v1.31.2/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=kindnet-928300 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.103.2

	[Install]

	 config:

	{KubernetesVersion:v1.31.2 ClusterName:kindnet-928300 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:kindnet}

	I1216 11:45:48.483387    5140 ssh_runner.go:195] Run: docker info --format {{.CgroupDriver}}

	I1216 11:45:48.603105    5140 cni.go:84] Creating CNI manager for "kindnet"

	I1216 11:45:48.603174    5140 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16

	I1216 11:45:48.603174    5140 kubeadm.go:189] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.103.2 APIServerPort:8443 KubernetesVersion:v1.31.2 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:kindnet-928300 NodeName:kindnet-928300 DNSDomain:cluster.local CRISocket:/var/run/cri-dockerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.103.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.103.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/

kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///var/run/cri-dockerd.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}

	I1216 11:45:48.603384    5140 kubeadm.go:195] kubeadm config:

	apiVersion: kubeadm.k8s.io/v1beta4

	kind: InitConfiguration

	localAPIEndpoint:

	  advertiseAddress: 192.168.103.2

	  bindPort: 8443

	bootstrapTokens:

	  - groups:

	      - system:bootstrappers:kubeadm:default-node-token

	    ttl: 24h0m0s

	    usages:

	      - signing

	      - authentication

	nodeRegistration:

	  criSocket: unix:///var/run/cri-dockerd.sock

	  name: "kindnet-928300"

	  kubeletExtraArgs:

	    - name: "node-ip"

	      value: "192.168.103.2"

	  taints: []

	---

	apiVersion: kubeadm.k8s.io/v1beta4

	kind: ClusterConfiguration

	apiServer:

	  certSANs: ["127.0.0.1", "localhost", "192.168.103.2"]

	  extraArgs:

	    - name: "enable-admission-plugins"

	      value: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"

	controllerManager:

	  extraArgs:

	    - name: "allocate-node-cidrs"

	      value: "true"

	    - name: "leader-elect"

	      value: "false"

	scheduler:

	  extraArgs:

	    - name: "leader-elect"

	      value: "false"

	certificatesDir: /var/lib/minikube/certs

	clusterName: mk

	controlPlaneEndpoint: control-plane.minikube.internal:8443

	etcd:

	  local:

	    dataDir: /var/lib/minikube/etcd

	    extraArgs:

	      - name: "proxy-refresh-interval"

	        value: "70000"

	kubernetesVersion: v1.31.2

	networking:

	  dnsDomain: cluster.local

	  podSubnet: "10.244.0.0/16"

	  serviceSubnet: 10.96.0.0/12

	---

	apiVersion: kubelet.config.k8s.io/v1beta1

	kind: KubeletConfiguration

	authentication:

	  x509:

	    clientCAFile: /var/lib/minikube/certs/ca.crt

	cgroupDriver: cgroupfs

	containerRuntimeEndpoint: unix:///var/run/cri-dockerd.sock

	hairpinMode: hairpin-veth

	runtimeRequestTimeout: 15m

	clusterDomain: "cluster.local"

	# disable disk resource management by default

	imageGCHighThresholdPercent: 100

	evictionHard:

	  nodefs.available: "0%"

	  nodefs.inodesFree: "0%"

	  imagefs.available: "0%"

	failSwapOn: false

	staticPodPath: /etc/kubernetes/manifests

	---

	apiVersion: kubeproxy.config.k8s.io/v1alpha1

	kind: KubeProxyConfiguration

	clusterCIDR: "10.244.0.0/16"

	metricsBindAddress: 0.0.0.0:10249

	conntrack:

	  maxPerCore: 0

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"

	  tcpEstablishedTimeout: 0s

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"

	  tcpCloseWaitTimeout: 0s

	I1216 11:45:48.614569    5140 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.31.2

	I1216 11:45:48.630561    5140 binaries.go:44] Found k8s binaries, skipping transfer

	I1216 11:45:48.640566    5140 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube

	I1216 11:45:48.657568    5140 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (314 bytes)

	I1216 11:45:48.702231    5140 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)

	I1216 11:45:48.741700    5140 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2295 bytes)

	I1216 11:45:48.812393    5140 ssh_runner.go:195] Run: grep 192.168.103.2	control-plane.minikube.internal$ /etc/hosts

	I1216 11:45:48.822243    5140 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.103.2	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I1216 11:45:48.853251    5140 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I1216 11:45:49.034415    5140 ssh_runner.go:195] Run: sudo systemctl start kubelet

	I1216 11:45:49.067982    5140 certs.go:68] Setting up C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\kindnet-928300 for IP: 192.168.103.2

	I1216 11:45:49.068055    5140 certs.go:194] generating shared ca certs ...

	I1216 11:45:49.068117    5140 certs.go:226] acquiring lock for ca certs: {Name:mk92285f7546e1a5b3c3b23dab6135aa5a99cd14 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1216 11:45:49.068310    5140 certs.go:235] skipping valid "minikubeCA" ca cert: C:\Users\jenkins.minikube4\minikube-integration\.minikube\ca.key

	I1216 11:45:49.068958    5140 certs.go:235] skipping valid "proxyClientCA" ca cert: C:\Users\jenkins.minikube4\minikube-integration\.minikube\proxy-client-ca.key

	I1216 11:45:49.068958    5140 certs.go:256] generating profile certs ...

	I1216 11:45:49.070608    5140 certs.go:363] generating signed profile cert for "minikube-user": C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\kindnet-928300\client.key

	I1216 11:45:49.070830    5140 crypto.go:68] Generating cert C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\kindnet-928300\client.crt with IP's: []

	I1216 11:45:49.223491    5140 crypto.go:156] Writing cert to C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\kindnet-928300\client.crt ...

	I1216 11:45:49.223491    5140 lock.go:35] WriteFile acquiring C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\kindnet-928300\client.crt: {Name:mk301e520fc70e13e56713fb91270c34f49fb871 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1216 11:45:49.224487    5140 crypto.go:164] Writing key to C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\kindnet-928300\client.key ...

	I1216 11:45:49.225477    5140 lock.go:35] WriteFile acquiring C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\kindnet-928300\client.key: {Name:mk979aa69e629dcfcc2387d6145a1aa6222c2ddf Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1216 11:45:49.226483    5140 certs.go:363] generating signed profile cert for "minikube": C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\kindnet-928300\apiserver.key.13ec987e

	I1216 11:45:49.226483    5140 crypto.go:68] Generating cert C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\kindnet-928300\apiserver.crt.13ec987e with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.103.2]

	I1216 11:45:50.042491    5140 crypto.go:156] Writing cert to C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\kindnet-928300\apiserver.crt.13ec987e ...

	I1216 11:45:50.042491    5140 lock.go:35] WriteFile acquiring C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\kindnet-928300\apiserver.crt.13ec987e: {Name:mkab1637640563ed1c9f02992cb4bc9e00d13594 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1216 11:45:50.043496    5140 crypto.go:164] Writing key to C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\kindnet-928300\apiserver.key.13ec987e ...

	I1216 11:45:50.043496    5140 lock.go:35] WriteFile acquiring C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\kindnet-928300\apiserver.key.13ec987e: {Name:mk841d38fd43667b89732a038e65589765ad3251 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1216 11:45:50.044495    5140 certs.go:381] copying C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\kindnet-928300\apiserver.crt.13ec987e -> C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\kindnet-928300\apiserver.crt

	I1216 11:45:50.061492    5140 certs.go:385] copying C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\kindnet-928300\apiserver.key.13ec987e -> C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\kindnet-928300\apiserver.key

	I1216 11:45:50.062498    5140 certs.go:363] generating signed profile cert for "aggregator": C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\kindnet-928300\proxy-client.key

	I1216 11:45:50.062498    5140 crypto.go:68] Generating cert C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\kindnet-928300\proxy-client.crt with IP's: []

	I1216 11:45:50.294853    5140 crypto.go:156] Writing cert to C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\kindnet-928300\proxy-client.crt ...

	I1216 11:45:50.294853    5140 lock.go:35] WriteFile acquiring C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\kindnet-928300\proxy-client.crt: {Name:mkccd85a8026b462cc8eb12031723f98386b2db1 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1216 11:45:50.296808    5140 crypto.go:164] Writing key to C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\kindnet-928300\proxy-client.key ...

	I1216 11:45:50.296888    5140 lock.go:35] WriteFile acquiring C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\kindnet-928300\proxy-client.key: {Name:mkea74f2b950e2515ef2d63bd1082e6460c56fdf Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1216 11:45:50.312863    5140 certs.go:484] found cert: C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\11452.pem (1338 bytes)

	W1216 11:45:50.313482    5140 certs.go:480] ignoring C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\11452_empty.pem, impossibly tiny 0 bytes

	I1216 11:45:50.313482    5140 certs.go:484] found cert: C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\ca-key.pem (1675 bytes)

	I1216 11:45:50.313748    5140 certs.go:484] found cert: C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\ca.pem (1078 bytes)

	I1216 11:45:50.313748    5140 certs.go:484] found cert: C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\cert.pem (1123 bytes)

	I1216 11:45:50.314488    5140 certs.go:484] found cert: C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\key.pem (1679 bytes)

	I1216 11:45:50.315021    5140 certs.go:484] found cert: C:\Users\jenkins.minikube4\minikube-integration\.minikube\files\etc\ssl\certs\114522.pem (1708 bytes)

	I1216 11:45:50.319515    5140 ssh_runner.go:362] scp C:\Users\jenkins.minikube4\minikube-integration\.minikube\ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)

	I1216 11:45:50.380875    5140 ssh_runner.go:362] scp C:\Users\jenkins.minikube4\minikube-integration\.minikube\ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)

	I1216 11:45:50.435683    5140 ssh_runner.go:362] scp C:\Users\jenkins.minikube4\minikube-integration\.minikube\proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)

	I1216 11:45:50.489763    5140 ssh_runner.go:362] scp C:\Users\jenkins.minikube4\minikube-integration\.minikube\proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)

	I1216 11:45:50.552968    5140 ssh_runner.go:362] scp C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\kindnet-928300\apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1419 bytes)

	I1216 11:45:50.613939    5140 ssh_runner.go:362] scp C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\kindnet-928300\apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)

	I1216 11:45:50.668733    5140 ssh_runner.go:362] scp C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\kindnet-928300\proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)

	I1216 11:45:50.733339    5140 ssh_runner.go:362] scp C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\kindnet-928300\proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)

	I1216 11:45:50.795849    5140 ssh_runner.go:362] scp C:\Users\jenkins.minikube4\minikube-integration\.minikube\ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)

	I1216 11:45:50.854390    5140 ssh_runner.go:362] scp C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\11452.pem --> /usr/share/ca-certificates/11452.pem (1338 bytes)

	I1216 11:45:50.916416    5140 ssh_runner.go:362] scp C:\Users\jenkins.minikube4\minikube-integration\.minikube\files\etc\ssl\certs\114522.pem --> /usr/share/ca-certificates/114522.pem (1708 bytes)

	I1216 11:45:50.969534    5140 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)

	I1216 11:45:47.188286   10820 main.go:141] libmachine: SSH cmd err, output: <nil>: newest-cni-648700

	I1216 11:45:47.188286   10820 ubuntu.go:169] provisioning hostname "newest-cni-648700"

	I1216 11:45:47.200906   10820 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" newest-cni-648700

	I1216 11:45:47.285715   10820 main.go:141] libmachine: Using SSH client type: native

	I1216 11:45:47.285715   10820 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x1443ea0] 0x14469e0 <nil>  [] 0s} 127.0.0.1 53107 <nil> <nil>}

	I1216 11:45:47.285715   10820 main.go:141] libmachine: About to run SSH command:

	sudo hostname newest-cni-648700 && echo "newest-cni-648700" | sudo tee /etc/hostname

	I1216 11:45:47.495174   10820 main.go:141] libmachine: SSH cmd err, output: <nil>: newest-cni-648700

	I1216 11:45:47.510330   10820 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" newest-cni-648700

	I1216 11:45:47.598396   10820 main.go:141] libmachine: Using SSH client type: native

	I1216 11:45:47.598396   10820 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x1443ea0] 0x14469e0 <nil>  [] 0s} 127.0.0.1 53107 <nil> <nil>}

	I1216 11:45:47.598396   10820 main.go:141] libmachine: About to run SSH command:

			if ! grep -xq '.*\snewest-cni-648700' /etc/hosts; then

				if grep -xq '127.0.1.1\s.*' /etc/hosts; then

					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 newest-cni-648700/g' /etc/hosts;

				else 

					echo '127.0.1.1 newest-cni-648700' | sudo tee -a /etc/hosts; 

				fi

			fi

	I1216 11:45:47.787902   10820 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I1216 11:45:47.787981   10820 ubuntu.go:175] set auth options {CertDir:C:\Users\jenkins.minikube4\minikube-integration\.minikube CaCertPath:C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\ca.pem CaPrivateKeyPath:C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:C:\Users\jenkins.minikube4\minikube-integration\.minikube\machines\server.pem ServerKeyPath:C:\Users\jenkins.minikube4\minikube-integration\.minikube\machines\server-key.pem ClientKeyPath:C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\cert.pem ServerCertSANs:[] StorePath:C:\Users\jenkins.minikube4\minikube-integration\.minikube}

	I1216 11:45:47.788034   10820 ubuntu.go:177] setting up certificates

	I1216 11:45:47.788034   10820 provision.go:84] configureAuth start

	I1216 11:45:47.795654   10820 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" newest-cni-648700

	I1216 11:45:47.869968   10820 provision.go:143] copyHostCerts

	I1216 11:45:47.870299   10820 exec_runner.go:144] found C:\Users\jenkins.minikube4\minikube-integration\.minikube/cert.pem, removing ...

	I1216 11:45:47.870299   10820 exec_runner.go:203] rm: C:\Users\jenkins.minikube4\minikube-integration\.minikube\cert.pem

	I1216 11:45:47.870872   10820 exec_runner.go:151] cp: C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\cert.pem --> C:\Users\jenkins.minikube4\minikube-integration\.minikube/cert.pem (1123 bytes)

	I1216 11:45:47.871803   10820 exec_runner.go:144] found C:\Users\jenkins.minikube4\minikube-integration\.minikube/key.pem, removing ...

	I1216 11:45:47.871803   10820 exec_runner.go:203] rm: C:\Users\jenkins.minikube4\minikube-integration\.minikube\key.pem

	I1216 11:45:47.872459   10820 exec_runner.go:151] cp: C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\key.pem --> C:\Users\jenkins.minikube4\minikube-integration\.minikube/key.pem (1679 bytes)

	I1216 11:45:47.873179   10820 exec_runner.go:144] found C:\Users\jenkins.minikube4\minikube-integration\.minikube/ca.pem, removing ...

	I1216 11:45:47.873179   10820 exec_runner.go:203] rm: C:\Users\jenkins.minikube4\minikube-integration\.minikube\ca.pem

	I1216 11:45:47.873179   10820 exec_runner.go:151] cp: C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\ca.pem --> C:\Users\jenkins.minikube4\minikube-integration\.minikube/ca.pem (1078 bytes)

	I1216 11:45:47.874811   10820 provision.go:117] generating server cert: C:\Users\jenkins.minikube4\minikube-integration\.minikube\machines\server.pem ca-key=C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\ca.pem private-key=C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\ca-key.pem org=jenkins.newest-cni-648700 san=[127.0.0.1 192.168.76.2 localhost minikube newest-cni-648700]

	I1216 11:45:48.049026   10820 provision.go:177] copyRemoteCerts

	I1216 11:45:48.066163   10820 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker

	I1216 11:45:48.077098   10820 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" newest-cni-648700

	I1216 11:45:48.165700   10820 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:53107 SSHKeyPath:C:\Users\jenkins.minikube4\minikube-integration\.minikube\machines\newest-cni-648700\id_rsa Username:docker}

	I1216 11:45:48.319057   10820 ssh_runner.go:362] scp C:\Users\jenkins.minikube4\minikube-integration\.minikube\machines\server.pem --> /etc/docker/server.pem (1220 bytes)

	I1216 11:45:48.369057   10820 ssh_runner.go:362] scp C:\Users\jenkins.minikube4\minikube-integration\.minikube\machines\server-key.pem --> /etc/docker/server-key.pem (1679 bytes)

	I1216 11:45:48.418196   10820 ssh_runner.go:362] scp C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\ca.pem --> /etc/docker/ca.pem (1078 bytes)

	I1216 11:45:48.471911   10820 provision.go:87] duration metric: took 683.8453ms to configureAuth

	I1216 11:45:48.471911   10820 ubuntu.go:193] setting minikube options for container-runtime

	I1216 11:45:48.471911   10820 config.go:182] Loaded profile config "newest-cni-648700": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.31.2

	I1216 11:45:48.487499   10820 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" newest-cni-648700

	I1216 11:45:48.568280   10820 main.go:141] libmachine: Using SSH client type: native

	I1216 11:45:48.568280   10820 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x1443ea0] 0x14469e0 <nil>  [] 0s} 127.0.0.1 53107 <nil> <nil>}

	I1216 11:45:48.568280   10820 main.go:141] libmachine: About to run SSH command:

	df --output=fstype / | tail -n 1

	I1216 11:45:48.758572   10820 main.go:141] libmachine: SSH cmd err, output: <nil>: overlay

	I1216 11:45:48.758572   10820 ubuntu.go:71] root file system type: overlay

	I1216 11:45:48.759185   10820 provision.go:314] Updating docker unit: /lib/systemd/system/docker.service ...

	I1216 11:45:48.772254   10820 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" newest-cni-648700

	I1216 11:45:48.856249   10820 main.go:141] libmachine: Using SSH client type: native

	I1216 11:45:48.857252   10820 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x1443ea0] 0x14469e0 <nil>  [] 0s} 127.0.0.1 53107 <nil> <nil>}

	I1216 11:45:48.857252   10820 main.go:141] libmachine: About to run SSH command:

	sudo mkdir -p /lib/systemd/system && printf %s "[Unit]

	Description=Docker Application Container Engine

	Documentation=https://docs.docker.com

	BindsTo=containerd.service

	After=network-online.target firewalld.service containerd.service

	Wants=network-online.target

	Requires=docker.socket

	StartLimitBurst=3

	StartLimitIntervalSec=60

	[Service]

	Type=notify

	Restart=on-failure

	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	# The base configuration already specifies an 'ExecStart=...' command. The first directive

	# here is to clear out that command inherited from the base configuration. Without this,

	# the command from the base configuration and the command specified here are treated as

	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	# will catch this invalid input and refuse to start the service with an error like:

	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	ExecStart=

	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12 

	ExecReload=/bin/kill -s HUP \$MAINPID

	# Having non-zero Limit*s causes performance problems due to accounting overhead

	# in the kernel. We recommend using cgroups to do container-local accounting.

	LimitNOFILE=infinity

	LimitNPROC=infinity

	LimitCORE=infinity

	# Uncomment TasksMax if your systemd version supports it.

	# Only systemd 226 and above support this version.

	TasksMax=infinity

	TimeoutStartSec=0

	# set delegate yes so that systemd does not reset the cgroups of docker containers

	Delegate=yes

	# kill only the docker process, not all processes in the cgroup

	KillMode=process

	[Install]

	WantedBy=multi-user.target

	" | sudo tee /lib/systemd/system/docker.service.new

	I1216 11:45:49.076332   10820 main.go:141] libmachine: SSH cmd err, output: <nil>: [Unit]

	Description=Docker Application Container Engine

	Documentation=https://docs.docker.com

	BindsTo=containerd.service

	After=network-online.target firewalld.service containerd.service

	Wants=network-online.target

	Requires=docker.socket

	StartLimitBurst=3

	StartLimitIntervalSec=60

	[Service]

	Type=notify

	Restart=on-failure

	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	# The base configuration already specifies an 'ExecStart=...' command. The first directive

	# here is to clear out that command inherited from the base configuration. Without this,

	# the command from the base configuration and the command specified here are treated as

	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	# will catch this invalid input and refuse to start the service with an error like:

	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	ExecStart=

	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12 

	ExecReload=/bin/kill -s HUP $MAINPID

	# Having non-zero Limit*s causes performance problems due to accounting overhead

	# in the kernel. We recommend using cgroups to do container-local accounting.

	LimitNOFILE=infinity

	LimitNPROC=infinity

	LimitCORE=infinity

	# Uncomment TasksMax if your systemd version supports it.

	# Only systemd 226 and above support this version.

	TasksMax=infinity

	TimeoutStartSec=0

	# set delegate yes so that systemd does not reset the cgroups of docker containers

	Delegate=yes

	# kill only the docker process, not all processes in the cgroup

	KillMode=process

	[Install]

	WantedBy=multi-user.target

	I1216 11:45:49.088152   10820 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" newest-cni-648700

	I1216 11:45:49.174160   10820 main.go:141] libmachine: Using SSH client type: native

	I1216 11:45:49.174852   10820 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x1443ea0] 0x14469e0 <nil>  [] 0s} 127.0.0.1 53107 <nil> <nil>}

	I1216 11:45:49.174911   10820 main.go:141] libmachine: About to run SSH command:

	sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }

	I1216 11:45:49.372297   10820 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I1216 11:45:49.372297   10820 machine.go:96] duration metric: took 5.5168859s to provisionDockerMachine

	I1216 11:45:49.372297   10820 start.go:293] postStartSetup for "newest-cni-648700" (driver="docker")

	I1216 11:45:49.372297   10820 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]

	I1216 11:45:49.385048   10820 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs

	I1216 11:45:49.393138   10820 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" newest-cni-648700

	I1216 11:45:49.480761   10820 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:53107 SSHKeyPath:C:\Users\jenkins.minikube4\minikube-integration\.minikube\machines\newest-cni-648700\id_rsa Username:docker}

	I1216 11:45:49.613281   10820 ssh_runner.go:195] Run: cat /etc/os-release

	I1216 11:45:49.621272   10820 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found

	I1216 11:45:49.621272   10820 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found

	I1216 11:45:49.621272   10820 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found

	I1216 11:45:49.621272   10820 info.go:137] Remote host: Ubuntu 22.04.5 LTS

	I1216 11:45:49.621272   10820 filesync.go:126] Scanning C:\Users\jenkins.minikube4\minikube-integration\.minikube\addons for local assets ...

	I1216 11:45:49.621272   10820 filesync.go:126] Scanning C:\Users\jenkins.minikube4\minikube-integration\.minikube\files for local assets ...

	I1216 11:45:49.623075   10820 filesync.go:149] local asset: C:\Users\jenkins.minikube4\minikube-integration\.minikube\files\etc\ssl\certs\114522.pem -> 114522.pem in /etc/ssl/certs

	I1216 11:45:49.637460   10820 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs

	I1216 11:45:49.666017   10820 ssh_runner.go:362] scp C:\Users\jenkins.minikube4\minikube-integration\.minikube\files\etc\ssl\certs\114522.pem --> /etc/ssl/certs/114522.pem (1708 bytes)

	I1216 11:45:49.713130   10820 start.go:296] duration metric: took 340.8175ms for postStartSetup

	I1216 11:45:49.723133   10820 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I1216 11:45:49.731133   10820 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" newest-cni-648700

	I1216 11:45:49.802220   10820 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:53107 SSHKeyPath:C:\Users\jenkins.minikube4\minikube-integration\.minikube\machines\newest-cni-648700\id_rsa Username:docker}

	I1216 11:45:49.949517   10820 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"

	I1216 11:45:49.962488   10820 fix.go:56] duration metric: took 7.1530704s for fixHost

	I1216 11:45:49.962488   10820 start.go:83] releasing machines lock for "newest-cni-648700", held for 7.1530704s

	I1216 11:45:49.970474   10820 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" newest-cni-648700

	I1216 11:45:50.040497   10820 ssh_runner.go:195] Run: curl.exe -sS -m 2 https://registry.k8s.io/

	I1216 11:45:50.049495   10820 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" newest-cni-648700

	I1216 11:45:50.051496   10820 ssh_runner.go:195] Run: cat /version.json

	I1216 11:45:50.064502   10820 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" newest-cni-648700

	I1216 11:45:50.137393   10820 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:53107 SSHKeyPath:C:\Users\jenkins.minikube4\minikube-integration\.minikube\machines\newest-cni-648700\id_rsa Username:docker}

	I1216 11:45:50.144542   10820 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:53107 SSHKeyPath:C:\Users\jenkins.minikube4\minikube-integration\.minikube\machines\newest-cni-648700\id_rsa Username:docker}

	W1216 11:45:50.270637   10820 start.go:867] [curl.exe -sS -m 2 https://registry.k8s.io/] failed: curl.exe -sS -m 2 https://registry.k8s.io/: Process exited with status 127

	stdout:

	stderr:

	bash: line 1: curl.exe: command not found

	I1216 11:45:50.302707   10820 ssh_runner.go:195] Run: systemctl --version

	I1216 11:45:50.327116   10820 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"

	I1216 11:45:50.355416   10820 ssh_runner.go:195] Run: sudo find \etc\cni\net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "grep -q loopback {} && ( grep -q name {} || sudo sed -i '/"type": "loopback"/i \ \ \ \ "name": "loopback",' {} ) && sudo sed -i 's|"cniVersion": ".*"|"cniVersion": "1.0.0"|g' {}" ;

	W1216 11:45:50.377930   10820 start.go:439] unable to name loopback interface in configureRuntimes: unable to patch loopback cni config "/etc/cni/net.d/*loopback.conf*": sudo find \etc\cni\net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "grep -q loopback {} && ( grep -q name {} || sudo sed -i '/"type": "loopback"/i \ \ \ \ "name": "loopback",' {} ) && sudo sed -i 's|"cniVersion": ".*"|"cniVersion": "1.0.0"|g' {}" ;: Process exited with status 1

	stdout:

	stderr:

	find: '\\etc\\cni\\net.d': No such file or directory

	W1216 11:45:50.383234   10820 out.go:270] ! Failing to connect to https://registry.k8s.io/ from inside the minikube container

	W1216 11:45:50.383234   10820 out.go:270] * To pull new external images, you may need to configure a proxy: https://minikube.sigs.k8s.io/docs/reference/networking/proxy/

	I1216 11:45:50.389254   10820 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;

	I1216 11:45:50.409339   10820 cni.go:259] no active bridge cni configs found in "/etc/cni/net.d" - nothing to disable

	I1216 11:45:50.409400   10820 start.go:495] detecting cgroup driver to use...

	I1216 11:45:50.409400   10820 detect.go:187] detected "cgroupfs" cgroup driver on host os

	I1216 11:45:50.409573   10820 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///run/containerd/containerd.sock

	" | sudo tee /etc/crictl.yaml"

	I1216 11:45:50.465944   10820 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.10"|' /etc/containerd/config.toml"

	I1216 11:45:50.505485   10820 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"

	I1216 11:45:50.530044   10820 containerd.go:146] configuring containerd to use "cgroupfs" as cgroup driver...

	I1216 11:45:50.541527   10820 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"

	I1216 11:45:50.578014   10820 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"

	I1216 11:45:50.619685   10820 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"

	I1216 11:45:50.652376   10820 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"

	I1216 11:45:50.691876   10820 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"

	I1216 11:45:50.738711   10820 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"

	I1216 11:45:50.778195   10820 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *enable_unprivileged_ports = .*/d' /etc/containerd/config.toml"

	I1216 11:45:50.814480   10820 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)\[plugins."io.containerd.grpc.v1.cri"\]|&\n\1  enable_unprivileged_ports = true|' /etc/containerd/config.toml"

	I1216 11:45:50.851395   10820 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables

	I1216 11:45:50.886412   10820 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"

	I1216 11:45:50.927045   10820 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I1216 11:45:51.110292   10820 ssh_runner.go:195] Run: sudo systemctl restart containerd

	I1216 11:45:51.364010   10820 start.go:495] detecting cgroup driver to use...

	I1216 11:45:51.364010   10820 detect.go:187] detected "cgroupfs" cgroup driver on host os

	I1216 11:45:51.377020   10820 ssh_runner.go:195] Run: sudo systemctl cat docker.service

	I1216 11:45:51.414409   10820 cruntime.go:279] skipping containerd shutdown because we are bound to it

	I1216 11:45:51.432763   10820 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio

	I1216 11:45:51.463844   10820 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/cri-dockerd.sock

	" | sudo tee /etc/crictl.yaml"

	I1216 11:45:50.011524    5556 pod_ready.go:103] pod "coredns-7c65d6cfc9-f2lcp" in "kube-system" namespace has status "Ready":"False"

	I1216 11:45:52.020950    5556 pod_ready.go:103] pod "coredns-7c65d6cfc9-f2lcp" in "kube-system" namespace has status "Ready":"False"

	I1216 11:45:50.739673   10008 pod_ready.go:103] pod "metrics-server-9975d5f86-zn4gg" in "kube-system" namespace has status "Ready":"False"

	I1216 11:45:52.746845   10008 pod_ready.go:103] pod "metrics-server-9975d5f86-zn4gg" in "kube-system" namespace has status "Ready":"False"

	I1216 11:45:51.543843   10820 ssh_runner.go:195] Run: which cri-dockerd

	I1216 11:45:51.583872   10820 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/cri-docker.service.d

	I1216 11:45:51.608879   10820 ssh_runner.go:362] scp memory --> /etc/systemd/system/cri-docker.service.d/10-cni.conf (190 bytes)

	I1216 11:45:51.695516   10820 ssh_runner.go:195] Run: sudo systemctl unmask docker.service

	I1216 11:45:51.961991   10820 ssh_runner.go:195] Run: sudo systemctl enable docker.socket

	I1216 11:45:52.133028   10820 docker.go:574] configuring docker to use "cgroupfs" as cgroup driver...

	I1216 11:45:52.133291   10820 ssh_runner.go:362] scp memory --> /etc/docker/daemon.json (130 bytes)

	I1216 11:45:52.196007   10820 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I1216 11:45:52.405021   10820 ssh_runner.go:195] Run: sudo systemctl restart docker

	I1216 11:45:53.413831   10820 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service cri-docker.socket

	I1216 11:45:53.451815   10820 ssh_runner.go:195] Run: sudo systemctl stop cri-docker.socket

	I1216 11:45:53.492145   10820 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service cri-docker.service

	I1216 11:45:53.530211   10820 ssh_runner.go:195] Run: sudo systemctl unmask cri-docker.socket

	I1216 11:45:53.701465   10820 ssh_runner.go:195] Run: sudo systemctl enable cri-docker.socket

	I1216 11:45:53.863208   10820 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I1216 11:45:54.015821   10820 ssh_runner.go:195] Run: sudo systemctl restart cri-docker.socket

	I1216 11:45:54.062202   10820 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service cri-docker.service

	I1216 11:45:54.106937   10820 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I1216 11:45:54.278675   10820 ssh_runner.go:195] Run: sudo systemctl restart cri-docker.service

	I1216 11:45:54.432339   10820 start.go:542] Will wait 60s for socket path /var/run/cri-dockerd.sock

	I1216 11:45:54.443769   10820 ssh_runner.go:195] Run: stat /var/run/cri-dockerd.sock

	I1216 11:45:54.457510   10820 start.go:563] Will wait 60s for crictl version

	I1216 11:45:54.469803   10820 ssh_runner.go:195] Run: which crictl

	I1216 11:45:54.494238   10820 ssh_runner.go:195] Run: sudo /usr/bin/crictl version

	I1216 11:45:54.573246   10820 start.go:579] Version:  0.1.0

	RuntimeName:  docker

	RuntimeVersion:  27.4.0

	RuntimeApiVersion:  v1

	I1216 11:45:54.585684   10820 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}

	I1216 11:45:54.654434   10820 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}

	I1216 11:45:54.719412   10820 out.go:235] * Preparing Kubernetes v1.31.2 on Docker 27.4.0 ...

	I1216 11:45:54.733300   10820 cli_runner.go:164] Run: docker exec -t newest-cni-648700 dig +short host.docker.internal

	I1216 11:45:54.903851   10820 network.go:96] got host ip for mount in container by digging dns: 192.168.65.254

	I1216 11:45:54.921124   10820 ssh_runner.go:195] Run: grep 192.168.65.254	host.minikube.internal$ /etc/hosts

	I1216 11:45:54.930160   10820 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.65.254	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I1216 11:45:54.959143   10820 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "8443/tcp") 0).HostPort}}'" newest-cni-648700

	I1216 11:45:55.045002   10820 out.go:177]   - kubeadm.pod-network-cidr=10.42.0.0/16

	I1216 11:45:51.012097    5140 ssh_runner.go:195] Run: openssl version

	I1216 11:45:51.039494    5140 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"

	I1216 11:45:51.071302    5140 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem

	I1216 11:45:51.082299    5140 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Dec 16 10:22 /usr/share/ca-certificates/minikubeCA.pem

	I1216 11:45:51.092287    5140 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem

	I1216 11:45:51.117286    5140 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"

	I1216 11:45:51.150603    5140 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/11452.pem && ln -fs /usr/share/ca-certificates/11452.pem /etc/ssl/certs/11452.pem"

	I1216 11:45:51.183243    5140 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/11452.pem

	I1216 11:45:51.197224    5140 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Dec 16 10:33 /usr/share/ca-certificates/11452.pem

	I1216 11:45:51.209019    5140 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/11452.pem

	I1216 11:45:51.238624    5140 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/11452.pem /etc/ssl/certs/51391683.0"

	I1216 11:45:51.271633    5140 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/114522.pem && ln -fs /usr/share/ca-certificates/114522.pem /etc/ssl/certs/114522.pem"

	I1216 11:45:51.310856    5140 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/114522.pem

	I1216 11:45:51.323369    5140 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Dec 16 10:33 /usr/share/ca-certificates/114522.pem

	I1216 11:45:51.335718    5140 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/114522.pem

	I1216 11:45:51.364010    5140 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/114522.pem /etc/ssl/certs/3ec20f2e.0"

	I1216 11:45:51.396006    5140 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt

	I1216 11:45:51.410355    5140 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory

	I1216 11:45:51.410491    5140 kubeadm.go:392] StartCluster: {Name:kindnet-928300 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1733912881-20083@sha256:64d8b27f78fd269d886e21ba8fc88be20de183ba5cc5bce33d0810e8a65f1df2 Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.2 ClusterName:kindnet-928300 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNam

es:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:kindnet} Nodes:[{Name: IP:192.168.103.2 Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:C:\Users\jenkins.minikube4:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetr

ics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I1216 11:45:51.426954    5140 ssh_runner.go:195] Run: docker ps --filter status=paused --filter=name=k8s_.*_(kube-system)_ --format={{.ID}}

	I1216 11:45:51.488304    5140 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd

	I1216 11:45:51.535100    5140 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml

	I1216 11:45:51.568874    5140 kubeadm.go:214] ignoring SystemVerification for kubeadm because of docker driver

	I1216 11:45:51.579887    5140 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf

	I1216 11:45:51.604884    5140 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2

	stdout:

	stderr:

	ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory

	I1216 11:45:51.604884    5140 kubeadm.go:157] found existing configuration files:

	I1216 11:45:51.617866    5140 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf

	I1216 11:45:51.644510    5140 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2

	stdout:

	stderr:

	grep: /etc/kubernetes/admin.conf: No such file or directory

	I1216 11:45:51.657503    5140 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf

	I1216 11:45:51.690542    5140 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf

	I1216 11:45:51.717205    5140 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2

	stdout:

	stderr:

	grep: /etc/kubernetes/kubelet.conf: No such file or directory

	I1216 11:45:51.736847    5140 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf

	I1216 11:45:51.768985    5140 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf

	I1216 11:45:51.791703    5140 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2

	stdout:

	stderr:

	grep: /etc/kubernetes/controller-manager.conf: No such file or directory

	I1216 11:45:51.816170    5140 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf

	I1216 11:45:51.848579    5140 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf

	I1216 11:45:51.869635    5140 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2

	stdout:

	stderr:

	grep: /etc/kubernetes/scheduler.conf: No such file or directory

	I1216 11:45:51.887247    5140 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf

	I1216 11:45:51.907047    5140 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.31.2:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"

	I1216 11:45:52.040936    5140 kubeadm.go:310] 	[WARNING Swap]: swap is supported for cgroup v2 only. The kubelet must be properly configured to use swap. Please refer to https://kubernetes.io/docs/concepts/architecture/nodes/#swap-memory, or disable swap on the node

	I1216 11:45:52.188015    5140 kubeadm.go:310] 	[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'

	I1216 11:45:55.046913   10820 kubeadm.go:883] updating cluster {Name:newest-cni-648700 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1733912881-20083@sha256:64d8b27f78fd269d886e21ba8fc88be20de183ba5cc5bce33d0810e8a65f1df2 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.2 ClusterName:newest-cni-648700 Namespace:default APIServerHAVIP: APIServerName:minikubeCA API

ServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:kubeadm Key:pod-network-cidr Value:10.42.0.0/16}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:false default_sa:true extra:false kubelet:false node_ready:false system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertE

xpiration:26280h0m0s Mount:false MountString:C:\Users\jenkins.minikube4:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...

	I1216 11:45:55.046913   10820 preload.go:131] Checking if preload exists for k8s version v1.31.2 and runtime docker

	I1216 11:45:55.054918   10820 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}

	I1216 11:45:55.098090   10820 docker.go:689] Got preloaded images: -- stdout --

	registry.k8s.io/kube-apiserver:v1.31.2

	registry.k8s.io/kube-scheduler:v1.31.2

	registry.k8s.io/kube-controller-manager:v1.31.2

	registry.k8s.io/kube-proxy:v1.31.2

	registry.k8s.io/coredns/coredns:v1.11.3

	registry.k8s.io/etcd:3.5.15-0

	registry.k8s.io/pause:3.10

	gcr.io/k8s-minikube/storage-provisioner:v5

	-- /stdout --

	I1216 11:45:55.098209   10820 docker.go:619] Images already preloaded, skipping extraction

	I1216 11:45:55.109831   10820 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}

	I1216 11:45:55.150667   10820 docker.go:689] Got preloaded images: -- stdout --

	registry.k8s.io/kube-apiserver:v1.31.2

	registry.k8s.io/kube-controller-manager:v1.31.2

	registry.k8s.io/kube-scheduler:v1.31.2

	registry.k8s.io/kube-proxy:v1.31.2

	registry.k8s.io/coredns/coredns:v1.11.3

	registry.k8s.io/etcd:3.5.15-0

	registry.k8s.io/pause:3.10

	gcr.io/k8s-minikube/storage-provisioner:v5

	-- /stdout --

	I1216 11:45:55.150667   10820 cache_images.go:84] Images are preloaded, skipping loading

	I1216 11:45:55.150667   10820 kubeadm.go:934] updating node { 192.168.76.2 8443 v1.31.2 docker true true} ...

	I1216 11:45:55.150667   10820 kubeadm.go:946] kubelet [Unit]

	Wants=docker.socket

	[Service]

	ExecStart=

	ExecStart=/var/lib/minikube/binaries/v1.31.2/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=newest-cni-648700 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.76.2

	[Install]

	 config:

	{KubernetesVersion:v1.31.2 ClusterName:newest-cni-648700 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:kubeadm Key:pod-network-cidr Value:10.42.0.0/16}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}

	I1216 11:45:55.161253   10820 ssh_runner.go:195] Run: docker info --format {{.CgroupDriver}}

	I1216 11:45:55.270996   10820 cni.go:84] Creating CNI manager for ""

	I1216 11:45:55.271060   10820 cni.go:158] "docker" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge

	I1216 11:45:55.271126   10820 kubeadm.go:84] Using pod CIDR: 10.42.0.0/16

	I1216 11:45:55.271190   10820 kubeadm.go:189] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.42.0.0/16 AdvertiseAddress:192.168.76.2 APIServerPort:8443 KubernetesVersion:v1.31.2 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:newest-cni-648700 NodeName:newest-cni-648700 DNSDomain:cluster.local CRISocket:/var/run/cri-dockerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.76.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.76.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/et

c/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///var/run/cri-dockerd.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}

	I1216 11:45:55.271688   10820 kubeadm.go:195] kubeadm config:

	apiVersion: kubeadm.k8s.io/v1beta4

	kind: InitConfiguration

	localAPIEndpoint:

	  advertiseAddress: 192.168.76.2

	  bindPort: 8443

	bootstrapTokens:

	  - groups:

	      - system:bootstrappers:kubeadm:default-node-token

	    ttl: 24h0m0s

	    usages:

	      - signing

	      - authentication

	nodeRegistration:

	  criSocket: unix:///var/run/cri-dockerd.sock

	  name: "newest-cni-648700"

	  kubeletExtraArgs:

	    - name: "node-ip"

	      value: "192.168.76.2"

	  taints: []

	---

	apiVersion: kubeadm.k8s.io/v1beta4

	kind: ClusterConfiguration

	apiServer:

	  certSANs: ["127.0.0.1", "localhost", "192.168.76.2"]

	  extraArgs:

	    - name: "enable-admission-plugins"

	      value: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"

	controllerManager:

	  extraArgs:

	    - name: "allocate-node-cidrs"

	      value: "true"

	    - name: "leader-elect"

	      value: "false"

	scheduler:

	  extraArgs:

	    - name: "leader-elect"

	      value: "false"

	certificatesDir: /var/lib/minikube/certs

	clusterName: mk

	controlPlaneEndpoint: control-plane.minikube.internal:8443

	etcd:

	  local:

	    dataDir: /var/lib/minikube/etcd

	    extraArgs:

	      - name: "proxy-refresh-interval"

	        value: "70000"

	kubernetesVersion: v1.31.2

	networking:

	  dnsDomain: cluster.local

	  podSubnet: "10.42.0.0/16"

	  serviceSubnet: 10.96.0.0/12

	---

	apiVersion: kubelet.config.k8s.io/v1beta1

	kind: KubeletConfiguration

	authentication:

	  x509:

	    clientCAFile: /var/lib/minikube/certs/ca.crt

	cgroupDriver: cgroupfs

	containerRuntimeEndpoint: unix:///var/run/cri-dockerd.sock

	hairpinMode: hairpin-veth

	runtimeRequestTimeout: 15m

	clusterDomain: "cluster.local"

	# disable disk resource management by default

	imageGCHighThresholdPercent: 100

	evictionHard:

	  nodefs.available: "0%"

	  nodefs.inodesFree: "0%"

	  imagefs.available: "0%"

	failSwapOn: false

	staticPodPath: /etc/kubernetes/manifests

	---

	apiVersion: kubeproxy.config.k8s.io/v1alpha1

	kind: KubeProxyConfiguration

	clusterCIDR: "10.42.0.0/16"

	metricsBindAddress: 0.0.0.0:10249

	conntrack:

	  maxPerCore: 0

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"

	  tcpEstablishedTimeout: 0s

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"

	  tcpCloseWaitTimeout: 0s

	I1216 11:45:55.290441   10820 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.31.2

	I1216 11:45:55.314501   10820 binaries.go:44] Found k8s binaries, skipping transfer

	I1216 11:45:55.330190   10820 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube

	I1216 11:45:55.354245   10820 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (316 bytes)

	I1216 11:45:55.393492   10820 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)

	I1216 11:45:55.447097   10820 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2293 bytes)

	I1216 11:45:55.499204   10820 ssh_runner.go:195] Run: grep 192.168.76.2	control-plane.minikube.internal$ /etc/hosts

	I1216 11:45:55.514746   10820 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.76.2	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I1216 11:45:55.557063   10820 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I1216 11:45:55.709882   10820 ssh_runner.go:195] Run: sudo systemctl start kubelet

	I1216 11:45:55.746927   10820 certs.go:68] Setting up C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\newest-cni-648700 for IP: 192.168.76.2

	I1216 11:45:55.746927   10820 certs.go:194] generating shared ca certs ...

	I1216 11:45:55.747931   10820 certs.go:226] acquiring lock for ca certs: {Name:mk92285f7546e1a5b3c3b23dab6135aa5a99cd14 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1216 11:45:55.747931   10820 certs.go:235] skipping valid "minikubeCA" ca cert: C:\Users\jenkins.minikube4\minikube-integration\.minikube\ca.key

	I1216 11:45:55.747931   10820 certs.go:235] skipping valid "proxyClientCA" ca cert: C:\Users\jenkins.minikube4\minikube-integration\.minikube\proxy-client-ca.key

	I1216 11:45:55.748952   10820 certs.go:256] generating profile certs ...

	I1216 11:45:55.748952   10820 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\newest-cni-648700\client.key

	I1216 11:45:55.749928   10820 certs.go:359] skipping valid signed profile cert regeneration for "minikube": C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\newest-cni-648700\apiserver.key.6e75ff12

	I1216 11:45:55.749928   10820 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\newest-cni-648700\proxy-client.key

	I1216 11:45:55.750929   10820 certs.go:484] found cert: C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\11452.pem (1338 bytes)

	W1216 11:45:55.750929   10820 certs.go:480] ignoring C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\11452_empty.pem, impossibly tiny 0 bytes

	I1216 11:45:55.751930   10820 certs.go:484] found cert: C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\ca-key.pem (1675 bytes)

	I1216 11:45:55.751930   10820 certs.go:484] found cert: C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\ca.pem (1078 bytes)

	I1216 11:45:55.751930   10820 certs.go:484] found cert: C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\cert.pem (1123 bytes)

	I1216 11:45:55.751930   10820 certs.go:484] found cert: C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\key.pem (1679 bytes)

	I1216 11:45:55.752927   10820 certs.go:484] found cert: C:\Users\jenkins.minikube4\minikube-integration\.minikube\files\etc\ssl\certs\114522.pem (1708 bytes)

	I1216 11:45:55.753929   10820 ssh_runner.go:362] scp C:\Users\jenkins.minikube4\minikube-integration\.minikube\ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)

	I1216 11:45:55.808123   10820 ssh_runner.go:362] scp C:\Users\jenkins.minikube4\minikube-integration\.minikube\ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)

	I1216 11:45:55.884384   10820 ssh_runner.go:362] scp C:\Users\jenkins.minikube4\minikube-integration\.minikube\proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)

	I1216 11:45:55.934594   10820 ssh_runner.go:362] scp C:\Users\jenkins.minikube4\minikube-integration\.minikube\proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)

	I1216 11:45:56.082908   10820 ssh_runner.go:362] scp C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\newest-cni-648700\apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1424 bytes)

	I1216 11:45:56.189845   10820 ssh_runner.go:362] scp C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\newest-cni-648700\apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)

	I1216 11:45:56.278533   10820 ssh_runner.go:362] scp C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\newest-cni-648700\proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)

	I1216 11:45:56.341286   10820 ssh_runner.go:362] scp C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\newest-cni-648700\proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)

	I1216 11:45:56.434135   10820 ssh_runner.go:362] scp C:\Users\jenkins.minikube4\minikube-integration\.minikube\ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)

	I1216 11:45:54.514765    5556 pod_ready.go:103] pod "coredns-7c65d6cfc9-f2lcp" in "kube-system" namespace has status "Ready":"False"

	I1216 11:45:56.518195    5556 pod_ready.go:103] pod "coredns-7c65d6cfc9-f2lcp" in "kube-system" namespace has status "Ready":"False"

	I1216 11:45:56.525275   10820 ssh_runner.go:362] scp C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\11452.pem --> /usr/share/ca-certificates/11452.pem (1338 bytes)

	I1216 11:45:56.575998   10820 ssh_runner.go:362] scp C:\Users\jenkins.minikube4\minikube-integration\.minikube\files\etc\ssl\certs\114522.pem --> /usr/share/ca-certificates/114522.pem (1708 bytes)

	I1216 11:45:56.633107   10820 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)

	I1216 11:45:56.679692   10820 ssh_runner.go:195] Run: openssl version

	I1216 11:45:56.713696   10820 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/11452.pem && ln -fs /usr/share/ca-certificates/11452.pem /etc/ssl/certs/11452.pem"

	I1216 11:45:56.759702   10820 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/11452.pem

	I1216 11:45:56.774695   10820 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Dec 16 10:33 /usr/share/ca-certificates/11452.pem

	I1216 11:45:56.786688   10820 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/11452.pem

	I1216 11:45:56.824704   10820 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/11452.pem /etc/ssl/certs/51391683.0"

	I1216 11:45:56.873719   10820 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/114522.pem && ln -fs /usr/share/ca-certificates/114522.pem /etc/ssl/certs/114522.pem"

	I1216 11:45:56.922161   10820 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/114522.pem

	I1216 11:45:56.937158   10820 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Dec 16 10:33 /usr/share/ca-certificates/114522.pem

	I1216 11:45:56.950162   10820 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/114522.pem

	I1216 11:45:56.978163   10820 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/114522.pem /etc/ssl/certs/3ec20f2e.0"

	I1216 11:45:57.026298   10820 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"

	I1216 11:45:57.069291   10820 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem

	I1216 11:45:57.086281   10820 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Dec 16 10:22 /usr/share/ca-certificates/minikubeCA.pem

	I1216 11:45:57.107299   10820 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem

	I1216 11:45:57.142291   10820 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"

	I1216 11:45:57.217559   10820 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt

	I1216 11:45:57.313177   10820 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-etcd-client.crt -checkend 86400

	I1216 11:45:57.414088   10820 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-kubelet-client.crt -checkend 86400

	I1216 11:45:57.513217   10820 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/server.crt -checkend 86400

	I1216 11:45:57.615302   10820 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/healthcheck-client.crt -checkend 86400

	I1216 11:45:57.718112   10820 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/peer.crt -checkend 86400

	I1216 11:45:57.800992   10820 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/front-proxy-client.crt -checkend 86400

	I1216 11:45:57.883330   10820 kubeadm.go:392] StartCluster: {Name:newest-cni-648700 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1733912881-20083@sha256:64d8b27f78fd269d886e21ba8fc88be20de183ba5cc5bce33d0810e8a65f1df2 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.2 ClusterName:newest-cni-648700 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APISer

verNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:kubeadm Key:pod-network-cidr Value:10.42.0.0/16}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:false default_sa:true extra:false kubelet:false node_ready:false system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpi

ration:26280h0m0s Mount:false MountString:C:\Users\jenkins.minikube4:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I1216 11:45:57.904061   10820 ssh_runner.go:195] Run: docker ps --filter status=paused --filter=name=k8s_.*_(kube-system)_ --format={{.ID}}

	I1216 11:45:58.102371   10820 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd

	I1216 11:45:58.129031   10820 kubeadm.go:408] found existing configuration files, will attempt cluster restart

	I1216 11:45:58.129031   10820 kubeadm.go:593] restartPrimaryControlPlane start ...

	I1216 11:45:58.146088   10820 ssh_runner.go:195] Run: sudo test -d /data/minikube

	I1216 11:45:58.194936   10820 kubeadm.go:130] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1

	stdout:

	stderr:

	I1216 11:45:58.212290   10820 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "8443/tcp") 0).HostPort}}'" newest-cni-648700

	I1216 11:45:58.304787   10820 kubeconfig.go:47] verify endpoint returned: get endpoint: "newest-cni-648700" does not appear in C:\Users\jenkins.minikube4\minikube-integration\kubeconfig

	I1216 11:45:58.305682   10820 kubeconfig.go:62] C:\Users\jenkins.minikube4\minikube-integration\kubeconfig needs updating (will repair): [kubeconfig missing "newest-cni-648700" cluster setting kubeconfig missing "newest-cni-648700" context setting]

	I1216 11:45:58.306685   10820 lock.go:35] WriteFile acquiring C:\Users\jenkins.minikube4\minikube-integration\kubeconfig: {Name:mk97c09b788e5010ffd4c9dd9525f9245d5edd25 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1216 11:45:58.341920   10820 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new

	I1216 11:45:58.391519   10820 kubeadm.go:630] The running cluster does not require reconfiguration: 127.0.0.1

	I1216 11:45:58.392528   10820 kubeadm.go:597] duration metric: took 263.4846ms to restartPrimaryControlPlane

	I1216 11:45:58.392528   10820 kubeadm.go:394] duration metric: took 509.2849ms to StartCluster

	I1216 11:45:58.392528   10820 settings.go:142] acquiring lock: {Name:mk5d8710830d010adb6db61f855b0ef766a8622c Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1216 11:45:58.392528   10820 settings.go:150] Updating kubeconfig:  C:\Users\jenkins.minikube4\minikube-integration\kubeconfig

	I1216 11:45:58.395669   10820 lock.go:35] WriteFile acquiring C:\Users\jenkins.minikube4\minikube-integration\kubeconfig: {Name:mk97c09b788e5010ffd4c9dd9525f9245d5edd25 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1216 11:45:58.398038   10820 start.go:235] Will wait 6m0s for node &{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true}

	I1216 11:45:58.398317   10820 addons.go:507] enable addons start: toEnable=map[ambassador:false amd-gpu-device-plugin:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:true default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false]

	I1216 11:45:58.398450   10820 config.go:182] Loaded profile config "newest-cni-648700": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.31.2

	I1216 11:45:58.398450   10820 addons.go:69] Setting storage-provisioner=true in profile "newest-cni-648700"

	I1216 11:45:58.398450   10820 addons.go:234] Setting addon storage-provisioner=true in "newest-cni-648700"

	W1216 11:45:58.398450   10820 addons.go:243] addon storage-provisioner should already be in state true

	I1216 11:45:58.398698   10820 host.go:66] Checking if "newest-cni-648700" exists ...

	I1216 11:45:58.398698   10820 addons.go:69] Setting metrics-server=true in profile "newest-cni-648700"

	I1216 11:45:58.398744   10820 addons.go:234] Setting addon metrics-server=true in "newest-cni-648700"

	W1216 11:45:58.398744   10820 addons.go:243] addon metrics-server should already be in state true

	I1216 11:45:58.398450   10820 addons.go:69] Setting default-storageclass=true in profile "newest-cni-648700"

	I1216 11:45:58.398744   10820 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "newest-cni-648700"

	I1216 11:45:58.398744   10820 host.go:66] Checking if "newest-cni-648700" exists ...

	I1216 11:45:58.398744   10820 addons.go:69] Setting dashboard=true in profile "newest-cni-648700"

	I1216 11:45:58.398744   10820 addons.go:234] Setting addon dashboard=true in "newest-cni-648700"

	W1216 11:45:58.398744   10820 addons.go:243] addon dashboard should already be in state true

	I1216 11:45:58.398744   10820 host.go:66] Checking if "newest-cni-648700" exists ...

	I1216 11:45:58.402376   10820 out.go:177] * Verifying Kubernetes components...

	I1216 11:45:55.215463   10008 pod_ready.go:82] duration metric: took 4m0.0005382s for pod "metrics-server-9975d5f86-zn4gg" in "kube-system" namespace to be "Ready" ...

	E1216 11:45:55.215463   10008 pod_ready.go:67] WaitExtra: waitPodCondition: context deadline exceeded

	I1216 11:45:55.215463   10008 pod_ready.go:39] duration metric: took 5m24.6785372s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I1216 11:45:55.215463   10008 api_server.go:52] waiting for apiserver process to appear ...

	I1216 11:45:55.229052   10008 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}

	I1216 11:45:55.283198   10008 logs.go:282] 2 containers: [56bb0e9c28d2 7ddd764ff8e3]

	I1216 11:45:55.292442   10008 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}

	I1216 11:45:55.346187   10008 logs.go:282] 2 containers: [fd156a045ffd 25fc9ee43f0a]

	I1216 11:45:55.356179   10008 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}

	I1216 11:45:55.404135   10008 logs.go:282] 2 containers: [e314bd292ad5 219798af5c41]

	I1216 11:45:55.419537   10008 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}

	I1216 11:45:55.465097   10008 logs.go:282] 2 containers: [8ddd1a91749a 5bfd011d16fd]

	I1216 11:45:55.476099   10008 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}

	I1216 11:45:55.533343   10008 logs.go:282] 2 containers: [58e72cba6157 8cce9bacca4b]

	I1216 11:45:55.547070   10008 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}

	I1216 11:45:55.587061   10008 logs.go:282] 2 containers: [d341318320dc 268c261f4e09]

	I1216 11:45:55.598610   10008 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}

	I1216 11:45:55.649615   10008 logs.go:282] 0 containers: []

	W1216 11:45:55.649615   10008 logs.go:284] No container was found matching "kindnet"

	I1216 11:45:55.657946   10008 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kubernetes-dashboard --format={{.ID}}

	I1216 11:45:55.705368   10008 logs.go:282] 1 containers: [19b65a7c34eb]

	I1216 11:45:55.722321   10008 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}

	I1216 11:45:55.762938   10008 logs.go:282] 2 containers: [230a8a7960d9 2f9bdc06bf7f]

	I1216 11:45:55.762938   10008 logs.go:123] Gathering logs for storage-provisioner [2f9bdc06bf7f] ...

	I1216 11:45:55.762938   10008 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 2f9bdc06bf7f"

	I1216 11:45:55.810126   10008 logs.go:123] Gathering logs for coredns [219798af5c41] ...

	I1216 11:45:55.811139   10008 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 219798af5c41"

	I1216 11:45:55.866945   10008 logs.go:123] Gathering logs for kube-controller-manager [268c261f4e09] ...

	I1216 11:45:55.866945   10008 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 268c261f4e09"

	I1216 11:45:55.933598   10008 logs.go:123] Gathering logs for storage-provisioner [230a8a7960d9] ...

	I1216 11:45:55.933598   10008 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 230a8a7960d9"

	I1216 11:45:55.980190   10008 logs.go:123] Gathering logs for Docker ...

	I1216 11:45:55.980190   10008 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"

	I1216 11:45:56.028833   10008 logs.go:123] Gathering logs for dmesg ...

	I1216 11:45:56.028833   10008 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"

	I1216 11:45:56.056830   10008 logs.go:123] Gathering logs for etcd [25fc9ee43f0a] ...

	I1216 11:45:56.056889   10008 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 25fc9ee43f0a"

	I1216 11:45:56.131641   10008 logs.go:123] Gathering logs for kube-scheduler [8ddd1a91749a] ...

	I1216 11:45:56.131641   10008 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 8ddd1a91749a"

	I1216 11:45:56.178941   10008 logs.go:123] Gathering logs for coredns [e314bd292ad5] ...

	I1216 11:45:56.178941   10008 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 e314bd292ad5"

	I1216 11:45:56.237906   10008 logs.go:123] Gathering logs for kube-proxy [58e72cba6157] ...

	I1216 11:45:56.237906   10008 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 58e72cba6157"

	I1216 11:45:56.289913   10008 logs.go:123] Gathering logs for kube-proxy [8cce9bacca4b] ...

	I1216 11:45:56.289913   10008 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 8cce9bacca4b"

	I1216 11:45:56.361533   10008 logs.go:123] Gathering logs for kube-controller-manager [d341318320dc] ...

	I1216 11:45:56.361592   10008 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d341318320dc"

	I1216 11:45:56.443207   10008 logs.go:123] Gathering logs for describe nodes ...

	I1216 11:45:56.443207   10008 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"

	I1216 11:45:56.687695   10008 logs.go:123] Gathering logs for kube-apiserver [56bb0e9c28d2] ...

	I1216 11:45:56.687695   10008 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 56bb0e9c28d2"

	I1216 11:45:56.774695   10008 logs.go:123] Gathering logs for etcd [fd156a045ffd] ...

	I1216 11:45:56.774695   10008 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 fd156a045ffd"

	I1216 11:45:56.852703   10008 logs.go:123] Gathering logs for kubernetes-dashboard [19b65a7c34eb] ...

	I1216 11:45:56.852703   10008 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 19b65a7c34eb"

	I1216 11:45:56.919159   10008 logs.go:123] Gathering logs for container status ...

	I1216 11:45:56.919159   10008 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"

	I1216 11:45:57.049284   10008 logs.go:123] Gathering logs for kubelet ...

	I1216 11:45:57.049284   10008 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"

	W1216 11:45:57.155282   10008 logs.go:138] Found kubelet problem: Dec 16 11:40:30 old-k8s-version-501600 kubelet[1909]: E1216 11:40:30.611863    1909 reflector.go:138] object-"kube-system"/"storage-provisioner-token-h2pb2": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "storage-provisioner-token-h2pb2" is forbidden: User "system:node:old-k8s-version-501600" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-501600' and this object

	W1216 11:45:57.164285   10008 logs.go:138] Found kubelet problem: Dec 16 11:40:36 old-k8s-version-501600 kubelet[1909]: E1216 11:40:36.024919    1909 pod_workers.go:191] Error syncing pod d2896fe7-5eeb-43d2-95d6-927aef485e51 ("metrics-server-9975d5f86-zn4gg_kube-system(d2896fe7-5eeb-43d2-95d6-927aef485e51)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = Error response from daemon: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.65.254:53: no such host"

	W1216 11:45:57.166149   10008 logs.go:138] Found kubelet problem: Dec 16 11:40:37 old-k8s-version-501600 kubelet[1909]: E1216 11:40:37.028492    1909 pod_workers.go:191] Error syncing pod d2896fe7-5eeb-43d2-95d6-927aef485e51 ("metrics-server-9975d5f86-zn4gg_kube-system(d2896fe7-5eeb-43d2-95d6-927aef485e51)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1216 11:45:57.166991   10008 logs.go:138] Found kubelet problem: Dec 16 11:40:38 old-k8s-version-501600 kubelet[1909]: E1216 11:40:38.707195    1909 pod_workers.go:191] Error syncing pod d2896fe7-5eeb-43d2-95d6-927aef485e51 ("metrics-server-9975d5f86-zn4gg_kube-system(d2896fe7-5eeb-43d2-95d6-927aef485e51)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1216 11:45:57.169926   10008 logs.go:138] Found kubelet problem: Dec 16 11:40:51 old-k8s-version-501600 kubelet[1909]: E1216 11:40:51.972752    1909 pod_workers.go:191] Error syncing pod d2896fe7-5eeb-43d2-95d6-927aef485e51 ("metrics-server-9975d5f86-zn4gg_kube-system(d2896fe7-5eeb-43d2-95d6-927aef485e51)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = Error response from daemon: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.65.254:53: no such host"

	W1216 11:45:57.173553   10008 logs.go:138] Found kubelet problem: Dec 16 11:40:53 old-k8s-version-501600 kubelet[1909]: E1216 11:40:53.819814    1909 pod_workers.go:191] Error syncing pod 37a1d62a-03f1-4e8e-bd42-ca72275d6ccb ("dashboard-metrics-scraper-8d5bb5db8-4wwm7_kubernetes-dashboard(37a1d62a-03f1-4e8e-bd42-ca72275d6ccb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ErrImagePull: "rpc error: code = Unknown desc = [DEPRECATION NOTICE] Docker Image Format v1 and Docker Image manifest version 2, schema 1 support is disabled by default and will be removed in an upcoming release. Suggest the author of registry.k8s.io/echoserver:1.4 to upgrade the image to the OCI Format or Docker Image manifest v2, schema 2. More information at https://docs.docker.com/go/deprecated-image-specs/"

	W1216 11:45:57.173553   10008 logs.go:138] Found kubelet problem: Dec 16 11:40:54 old-k8s-version-501600 kubelet[1909]: E1216 11:40:54.247688    1909 pod_workers.go:191] Error syncing pod 37a1d62a-03f1-4e8e-bd42-ca72275d6ccb ("dashboard-metrics-scraper-8d5bb5db8-4wwm7_kubernetes-dashboard(37a1d62a-03f1-4e8e-bd42-ca72275d6ccb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""

	W1216 11:45:57.173553   10008 logs.go:138] Found kubelet problem: Dec 16 11:40:55 old-k8s-version-501600 kubelet[1909]: E1216 11:40:55.271609    1909 pod_workers.go:191] Error syncing pod 37a1d62a-03f1-4e8e-bd42-ca72275d6ccb ("dashboard-metrics-scraper-8d5bb5db8-4wwm7_kubernetes-dashboard(37a1d62a-03f1-4e8e-bd42-ca72275d6ccb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""

	W1216 11:45:57.174552   10008 logs.go:138] Found kubelet problem: Dec 16 11:40:59 old-k8s-version-501600 kubelet[1909]: E1216 11:40:59.364188    1909 pod_workers.go:191] Error syncing pod 21b24a0c-f627-4a14-9eb5-704f6fe85772 ("storage-provisioner_kube-system(21b24a0c-f627-4a14-9eb5-704f6fe85772)"), skipping: failed to "StartContainer" for "storage-provisioner" with CrashLoopBackOff: "back-off 10s restarting failed container=storage-provisioner pod=storage-provisioner_kube-system(21b24a0c-f627-4a14-9eb5-704f6fe85772)"

	W1216 11:45:57.174552   10008 logs.go:138] Found kubelet problem: Dec 16 11:41:04 old-k8s-version-501600 kubelet[1909]: E1216 11:41:04.917670    1909 pod_workers.go:191] Error syncing pod d2896fe7-5eeb-43d2-95d6-927aef485e51 ("metrics-server-9975d5f86-zn4gg_kube-system(d2896fe7-5eeb-43d2-95d6-927aef485e51)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1216 11:45:57.181565   10008 logs.go:138] Found kubelet problem: Dec 16 11:41:14 old-k8s-version-501600 kubelet[1909]: E1216 11:41:14.532141    1909 pod_workers.go:191] Error syncing pod 37a1d62a-03f1-4e8e-bd42-ca72275d6ccb ("dashboard-metrics-scraper-8d5bb5db8-4wwm7_kubernetes-dashboard(37a1d62a-03f1-4e8e-bd42-ca72275d6ccb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ErrImagePull: "rpc error: code = Unknown desc = [DEPRECATION NOTICE] Docker Image Format v1 and Docker Image manifest version 2, schema 1 support is disabled by default and will be removed in an upcoming release. Suggest the author of registry.k8s.io/echoserver:1.4 to upgrade the image to the OCI Format or Docker Image manifest v2, schema 2. More information at https://docs.docker.com/go/deprecated-image-specs/"

	W1216 11:45:57.185552   10008 logs.go:138] Found kubelet problem: Dec 16 11:41:18 old-k8s-version-501600 kubelet[1909]: E1216 11:41:18.993736    1909 pod_workers.go:191] Error syncing pod d2896fe7-5eeb-43d2-95d6-927aef485e51 ("metrics-server-9975d5f86-zn4gg_kube-system(d2896fe7-5eeb-43d2-95d6-927aef485e51)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = Error response from daemon: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.65.254:53: no such host"

	W1216 11:45:57.185552   10008 logs.go:138] Found kubelet problem: Dec 16 11:41:25 old-k8s-version-501600 kubelet[1909]: E1216 11:41:25.914536    1909 pod_workers.go:191] Error syncing pod 37a1d62a-03f1-4e8e-bd42-ca72275d6ccb ("dashboard-metrics-scraper-8d5bb5db8-4wwm7_kubernetes-dashboard(37a1d62a-03f1-4e8e-bd42-ca72275d6ccb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""

	W1216 11:45:57.186571   10008 logs.go:138] Found kubelet problem: Dec 16 11:41:29 old-k8s-version-501600 kubelet[1909]: E1216 11:41:29.914402    1909 pod_workers.go:191] Error syncing pod d2896fe7-5eeb-43d2-95d6-927aef485e51 ("metrics-server-9975d5f86-zn4gg_kube-system(d2896fe7-5eeb-43d2-95d6-927aef485e51)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1216 11:45:57.190647   10008 logs.go:138] Found kubelet problem: Dec 16 11:41:37 old-k8s-version-501600 kubelet[1909]: E1216 11:41:37.438642    1909 pod_workers.go:191] Error syncing pod 37a1d62a-03f1-4e8e-bd42-ca72275d6ccb ("dashboard-metrics-scraper-8d5bb5db8-4wwm7_kubernetes-dashboard(37a1d62a-03f1-4e8e-bd42-ca72275d6ccb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ErrImagePull: "rpc error: code = Unknown desc = [DEPRECATION NOTICE] Docker Image Format v1 and Docker Image manifest version 2, schema 1 support is disabled by default and will be removed in an upcoming release. Suggest the author of registry.k8s.io/echoserver:1.4 to upgrade the image to the OCI Format or Docker Image manifest v2, schema 2. More information at https://docs.docker.com/go/deprecated-image-specs/"

	W1216 11:45:57.190647   10008 logs.go:138] Found kubelet problem: Dec 16 11:41:40 old-k8s-version-501600 kubelet[1909]: E1216 11:41:40.912394    1909 pod_workers.go:191] Error syncing pod d2896fe7-5eeb-43d2-95d6-927aef485e51 ("metrics-server-9975d5f86-zn4gg_kube-system(d2896fe7-5eeb-43d2-95d6-927aef485e51)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1216 11:45:57.190647   10008 logs.go:138] Found kubelet problem: Dec 16 11:41:48 old-k8s-version-501600 kubelet[1909]: E1216 11:41:48.911506    1909 pod_workers.go:191] Error syncing pod 37a1d62a-03f1-4e8e-bd42-ca72275d6ccb ("dashboard-metrics-scraper-8d5bb5db8-4wwm7_kubernetes-dashboard(37a1d62a-03f1-4e8e-bd42-ca72275d6ccb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""

	W1216 11:45:57.191582   10008 logs.go:138] Found kubelet problem: Dec 16 11:41:52 old-k8s-version-501600 kubelet[1909]: E1216 11:41:52.911934    1909 pod_workers.go:191] Error syncing pod d2896fe7-5eeb-43d2-95d6-927aef485e51 ("metrics-server-9975d5f86-zn4gg_kube-system(d2896fe7-5eeb-43d2-95d6-927aef485e51)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1216 11:45:57.191582   10008 logs.go:138] Found kubelet problem: Dec 16 11:42:00 old-k8s-version-501600 kubelet[1909]: E1216 11:42:00.925934    1909 pod_workers.go:191] Error syncing pod 37a1d62a-03f1-4e8e-bd42-ca72275d6ccb ("dashboard-metrics-scraper-8d5bb5db8-4wwm7_kubernetes-dashboard(37a1d62a-03f1-4e8e-bd42-ca72275d6ccb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""

	W1216 11:45:57.195548   10008 logs.go:138] Found kubelet problem: Dec 16 11:42:06 old-k8s-version-501600 kubelet[1909]: E1216 11:42:06.960188    1909 pod_workers.go:191] Error syncing pod d2896fe7-5eeb-43d2-95d6-927aef485e51 ("metrics-server-9975d5f86-zn4gg_kube-system(d2896fe7-5eeb-43d2-95d6-927aef485e51)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = Error response from daemon: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.65.254:53: no such host"

	W1216 11:45:57.195548   10008 logs.go:138] Found kubelet problem: Dec 16 11:42:11 old-k8s-version-501600 kubelet[1909]: E1216 11:42:11.908414    1909 pod_workers.go:191] Error syncing pod 37a1d62a-03f1-4e8e-bd42-ca72275d6ccb ("dashboard-metrics-scraper-8d5bb5db8-4wwm7_kubernetes-dashboard(37a1d62a-03f1-4e8e-bd42-ca72275d6ccb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""

	W1216 11:45:57.195548   10008 logs.go:138] Found kubelet problem: Dec 16 11:42:17 old-k8s-version-501600 kubelet[1909]: E1216 11:42:17.908853    1909 pod_workers.go:191] Error syncing pod d2896fe7-5eeb-43d2-95d6-927aef485e51 ("metrics-server-9975d5f86-zn4gg_kube-system(d2896fe7-5eeb-43d2-95d6-927aef485e51)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1216 11:45:57.198605   10008 logs.go:138] Found kubelet problem: Dec 16 11:42:23 old-k8s-version-501600 kubelet[1909]: E1216 11:42:23.391511    1909 pod_workers.go:191] Error syncing pod 37a1d62a-03f1-4e8e-bd42-ca72275d6ccb ("dashboard-metrics-scraper-8d5bb5db8-4wwm7_kubernetes-dashboard(37a1d62a-03f1-4e8e-bd42-ca72275d6ccb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ErrImagePull: "rpc error: code = Unknown desc = [DEPRECATION NOTICE] Docker Image Format v1 and Docker Image manifest version 2, schema 1 support is disabled by default and will be removed in an upcoming release. Suggest the author of registry.k8s.io/echoserver:1.4 to upgrade the image to the OCI Format or Docker Image manifest v2, schema 2. More information at https://docs.docker.com/go/deprecated-image-specs/"

	W1216 11:45:57.198605   10008 logs.go:138] Found kubelet problem: Dec 16 11:42:29 old-k8s-version-501600 kubelet[1909]: E1216 11:42:29.909302    1909 pod_workers.go:191] Error syncing pod d2896fe7-5eeb-43d2-95d6-927aef485e51 ("metrics-server-9975d5f86-zn4gg_kube-system(d2896fe7-5eeb-43d2-95d6-927aef485e51)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1216 11:45:57.199548   10008 logs.go:138] Found kubelet problem: Dec 16 11:42:37 old-k8s-version-501600 kubelet[1909]: E1216 11:42:37.905786    1909 pod_workers.go:191] Error syncing pod 37a1d62a-03f1-4e8e-bd42-ca72275d6ccb ("dashboard-metrics-scraper-8d5bb5db8-4wwm7_kubernetes-dashboard(37a1d62a-03f1-4e8e-bd42-ca72275d6ccb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""

	W1216 11:45:57.199548   10008 logs.go:138] Found kubelet problem: Dec 16 11:42:44 old-k8s-version-501600 kubelet[1909]: E1216 11:42:44.905838    1909 pod_workers.go:191] Error syncing pod d2896fe7-5eeb-43d2-95d6-927aef485e51 ("metrics-server-9975d5f86-zn4gg_kube-system(d2896fe7-5eeb-43d2-95d6-927aef485e51)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1216 11:45:57.199548   10008 logs.go:138] Found kubelet problem: Dec 16 11:42:49 old-k8s-version-501600 kubelet[1909]: E1216 11:42:49.907458    1909 pod_workers.go:191] Error syncing pod 37a1d62a-03f1-4e8e-bd42-ca72275d6ccb ("dashboard-metrics-scraper-8d5bb5db8-4wwm7_kubernetes-dashboard(37a1d62a-03f1-4e8e-bd42-ca72275d6ccb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""

	W1216 11:45:57.199548   10008 logs.go:138] Found kubelet problem: Dec 16 11:42:57 old-k8s-version-501600 kubelet[1909]: E1216 11:42:57.906185    1909 pod_workers.go:191] Error syncing pod d2896fe7-5eeb-43d2-95d6-927aef485e51 ("metrics-server-9975d5f86-zn4gg_kube-system(d2896fe7-5eeb-43d2-95d6-927aef485e51)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1216 11:45:57.199548   10008 logs.go:138] Found kubelet problem: Dec 16 11:43:04 old-k8s-version-501600 kubelet[1909]: E1216 11:43:04.922686    1909 pod_workers.go:191] Error syncing pod 37a1d62a-03f1-4e8e-bd42-ca72275d6ccb ("dashboard-metrics-scraper-8d5bb5db8-4wwm7_kubernetes-dashboard(37a1d62a-03f1-4e8e-bd42-ca72275d6ccb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""

	W1216 11:45:57.200575   10008 logs.go:138] Found kubelet problem: Dec 16 11:43:11 old-k8s-version-501600 kubelet[1909]: E1216 11:43:11.903620    1909 pod_workers.go:191] Error syncing pod d2896fe7-5eeb-43d2-95d6-927aef485e51 ("metrics-server-9975d5f86-zn4gg_kube-system(d2896fe7-5eeb-43d2-95d6-927aef485e51)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1216 11:45:57.200575   10008 logs.go:138] Found kubelet problem: Dec 16 11:43:19 old-k8s-version-501600 kubelet[1909]: E1216 11:43:19.904521    1909 pod_workers.go:191] Error syncing pod 37a1d62a-03f1-4e8e-bd42-ca72275d6ccb ("dashboard-metrics-scraper-8d5bb5db8-4wwm7_kubernetes-dashboard(37a1d62a-03f1-4e8e-bd42-ca72275d6ccb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""

	W1216 11:45:57.200575   10008 logs.go:138] Found kubelet problem: Dec 16 11:43:25 old-k8s-version-501600 kubelet[1909]: E1216 11:43:25.902968    1909 pod_workers.go:191] Error syncing pod d2896fe7-5eeb-43d2-95d6-927aef485e51 ("metrics-server-9975d5f86-zn4gg_kube-system(d2896fe7-5eeb-43d2-95d6-927aef485e51)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1216 11:45:57.200575   10008 logs.go:138] Found kubelet problem: Dec 16 11:43:34 old-k8s-version-501600 kubelet[1909]: E1216 11:43:34.907258    1909 pod_workers.go:191] Error syncing pod 37a1d62a-03f1-4e8e-bd42-ca72275d6ccb ("dashboard-metrics-scraper-8d5bb5db8-4wwm7_kubernetes-dashboard(37a1d62a-03f1-4e8e-bd42-ca72275d6ccb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""

	W1216 11:45:57.202559   10008 logs.go:138] Found kubelet problem: Dec 16 11:43:36 old-k8s-version-501600 kubelet[1909]: E1216 11:43:36.956321    1909 pod_workers.go:191] Error syncing pod d2896fe7-5eeb-43d2-95d6-927aef485e51 ("metrics-server-9975d5f86-zn4gg_kube-system(d2896fe7-5eeb-43d2-95d6-927aef485e51)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = Error response from daemon: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.65.254:53: no such host"

	W1216 11:45:57.205565   10008 logs.go:138] Found kubelet problem: Dec 16 11:43:48 old-k8s-version-501600 kubelet[1909]: E1216 11:43:48.383349    1909 pod_workers.go:191] Error syncing pod 37a1d62a-03f1-4e8e-bd42-ca72275d6ccb ("dashboard-metrics-scraper-8d5bb5db8-4wwm7_kubernetes-dashboard(37a1d62a-03f1-4e8e-bd42-ca72275d6ccb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ErrImagePull: "rpc error: code = Unknown desc = [DEPRECATION NOTICE] Docker Image Format v1 and Docker Image manifest version 2, schema 1 support is disabled by default and will be removed in an upcoming release. Suggest the author of registry.k8s.io/echoserver:1.4 to upgrade the image to the OCI Format or Docker Image manifest v2, schema 2. More information at https://docs.docker.com/go/deprecated-image-specs/"

	W1216 11:45:57.205565   10008 logs.go:138] Found kubelet problem: Dec 16 11:43:49 old-k8s-version-501600 kubelet[1909]: E1216 11:43:49.900605    1909 pod_workers.go:191] Error syncing pod d2896fe7-5eeb-43d2-95d6-927aef485e51 ("metrics-server-9975d5f86-zn4gg_kube-system(d2896fe7-5eeb-43d2-95d6-927aef485e51)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1216 11:45:57.206549   10008 logs.go:138] Found kubelet problem: Dec 16 11:44:03 old-k8s-version-501600 kubelet[1909]: E1216 11:44:03.900541    1909 pod_workers.go:191] Error syncing pod 37a1d62a-03f1-4e8e-bd42-ca72275d6ccb ("dashboard-metrics-scraper-8d5bb5db8-4wwm7_kubernetes-dashboard(37a1d62a-03f1-4e8e-bd42-ca72275d6ccb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""

	W1216 11:45:57.206549   10008 logs.go:138] Found kubelet problem: Dec 16 11:44:03 old-k8s-version-501600 kubelet[1909]: E1216 11:44:03.900719    1909 pod_workers.go:191] Error syncing pod d2896fe7-5eeb-43d2-95d6-927aef485e51 ("metrics-server-9975d5f86-zn4gg_kube-system(d2896fe7-5eeb-43d2-95d6-927aef485e51)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1216 11:45:57.206549   10008 logs.go:138] Found kubelet problem: Dec 16 11:44:14 old-k8s-version-501600 kubelet[1909]: E1216 11:44:14.897911    1909 pod_workers.go:191] Error syncing pod d2896fe7-5eeb-43d2-95d6-927aef485e51 ("metrics-server-9975d5f86-zn4gg_kube-system(d2896fe7-5eeb-43d2-95d6-927aef485e51)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1216 11:45:57.206549   10008 logs.go:138] Found kubelet problem: Dec 16 11:44:15 old-k8s-version-501600 kubelet[1909]: E1216 11:44:15.919796    1909 pod_workers.go:191] Error syncing pod 37a1d62a-03f1-4e8e-bd42-ca72275d6ccb ("dashboard-metrics-scraper-8d5bb5db8-4wwm7_kubernetes-dashboard(37a1d62a-03f1-4e8e-bd42-ca72275d6ccb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""

	W1216 11:45:57.207565   10008 logs.go:138] Found kubelet problem: Dec 16 11:44:26 old-k8s-version-501600 kubelet[1909]: E1216 11:44:26.900810    1909 pod_workers.go:191] Error syncing pod d2896fe7-5eeb-43d2-95d6-927aef485e51 ("metrics-server-9975d5f86-zn4gg_kube-system(d2896fe7-5eeb-43d2-95d6-927aef485e51)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1216 11:45:57.207565   10008 logs.go:138] Found kubelet problem: Dec 16 11:44:27 old-k8s-version-501600 kubelet[1909]: E1216 11:44:27.906368    1909 pod_workers.go:191] Error syncing pod 37a1d62a-03f1-4e8e-bd42-ca72275d6ccb ("dashboard-metrics-scraper-8d5bb5db8-4wwm7_kubernetes-dashboard(37a1d62a-03f1-4e8e-bd42-ca72275d6ccb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""

	W1216 11:45:57.207565   10008 logs.go:138] Found kubelet problem: Dec 16 11:44:38 old-k8s-version-501600 kubelet[1909]: E1216 11:44:38.897229    1909 pod_workers.go:191] Error syncing pod d2896fe7-5eeb-43d2-95d6-927aef485e51 ("metrics-server-9975d5f86-zn4gg_kube-system(d2896fe7-5eeb-43d2-95d6-927aef485e51)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1216 11:45:57.208567   10008 logs.go:138] Found kubelet problem: Dec 16 11:44:39 old-k8s-version-501600 kubelet[1909]: E1216 11:44:39.896174    1909 pod_workers.go:191] Error syncing pod 37a1d62a-03f1-4e8e-bd42-ca72275d6ccb ("dashboard-metrics-scraper-8d5bb5db8-4wwm7_kubernetes-dashboard(37a1d62a-03f1-4e8e-bd42-ca72275d6ccb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""

	W1216 11:45:57.208567   10008 logs.go:138] Found kubelet problem: Dec 16 11:44:50 old-k8s-version-501600 kubelet[1909]: E1216 11:44:50.898286    1909 pod_workers.go:191] Error syncing pod d2896fe7-5eeb-43d2-95d6-927aef485e51 ("metrics-server-9975d5f86-zn4gg_kube-system(d2896fe7-5eeb-43d2-95d6-927aef485e51)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1216 11:45:57.208567   10008 logs.go:138] Found kubelet problem: Dec 16 11:44:52 old-k8s-version-501600 kubelet[1909]: E1216 11:44:52.894556    1909 pod_workers.go:191] Error syncing pod 37a1d62a-03f1-4e8e-bd42-ca72275d6ccb ("dashboard-metrics-scraper-8d5bb5db8-4wwm7_kubernetes-dashboard(37a1d62a-03f1-4e8e-bd42-ca72275d6ccb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""

	W1216 11:45:57.209551   10008 logs.go:138] Found kubelet problem: Dec 16 11:45:03 old-k8s-version-501600 kubelet[1909]: E1216 11:45:03.895647    1909 pod_workers.go:191] Error syncing pod 37a1d62a-03f1-4e8e-bd42-ca72275d6ccb ("dashboard-metrics-scraper-8d5bb5db8-4wwm7_kubernetes-dashboard(37a1d62a-03f1-4e8e-bd42-ca72275d6ccb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""

	W1216 11:45:57.209551   10008 logs.go:138] Found kubelet problem: Dec 16 11:45:04 old-k8s-version-501600 kubelet[1909]: E1216 11:45:04.897659    1909 pod_workers.go:191] Error syncing pod d2896fe7-5eeb-43d2-95d6-927aef485e51 ("metrics-server-9975d5f86-zn4gg_kube-system(d2896fe7-5eeb-43d2-95d6-927aef485e51)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1216 11:45:57.209551   10008 logs.go:138] Found kubelet problem: Dec 16 11:45:15 old-k8s-version-501600 kubelet[1909]: E1216 11:45:15.893423    1909 pod_workers.go:191] Error syncing pod 37a1d62a-03f1-4e8e-bd42-ca72275d6ccb ("dashboard-metrics-scraper-8d5bb5db8-4wwm7_kubernetes-dashboard(37a1d62a-03f1-4e8e-bd42-ca72275d6ccb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""

	W1216 11:45:57.210615   10008 logs.go:138] Found kubelet problem: Dec 16 11:45:16 old-k8s-version-501600 kubelet[1909]: E1216 11:45:16.895909    1909 pod_workers.go:191] Error syncing pod d2896fe7-5eeb-43d2-95d6-927aef485e51 ("metrics-server-9975d5f86-zn4gg_kube-system(d2896fe7-5eeb-43d2-95d6-927aef485e51)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1216 11:45:57.211544   10008 logs.go:138] Found kubelet problem: Dec 16 11:45:26 old-k8s-version-501600 kubelet[1909]: E1216 11:45:26.948454    1909 pod_workers.go:191] Error syncing pod 37a1d62a-03f1-4e8e-bd42-ca72275d6ccb ("dashboard-metrics-scraper-8d5bb5db8-4wwm7_kubernetes-dashboard(37a1d62a-03f1-4e8e-bd42-ca72275d6ccb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""

	W1216 11:45:57.212559   10008 logs.go:138] Found kubelet problem: Dec 16 11:45:32 old-k8s-version-501600 kubelet[1909]: E1216 11:45:32.894388    1909 pod_workers.go:191] Error syncing pod d2896fe7-5eeb-43d2-95d6-927aef485e51 ("metrics-server-9975d5f86-zn4gg_kube-system(d2896fe7-5eeb-43d2-95d6-927aef485e51)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1216 11:45:57.212559   10008 logs.go:138] Found kubelet problem: Dec 16 11:45:38 old-k8s-version-501600 kubelet[1909]: E1216 11:45:38.892058    1909 pod_workers.go:191] Error syncing pod 37a1d62a-03f1-4e8e-bd42-ca72275d6ccb ("dashboard-metrics-scraper-8d5bb5db8-4wwm7_kubernetes-dashboard(37a1d62a-03f1-4e8e-bd42-ca72275d6ccb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""

	W1216 11:45:57.212559   10008 logs.go:138] Found kubelet problem: Dec 16 11:45:44 old-k8s-version-501600 kubelet[1909]: E1216 11:45:44.890057    1909 pod_workers.go:191] Error syncing pod d2896fe7-5eeb-43d2-95d6-927aef485e51 ("metrics-server-9975d5f86-zn4gg_kube-system(d2896fe7-5eeb-43d2-95d6-927aef485e51)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1216 11:45:57.213549   10008 logs.go:138] Found kubelet problem: Dec 16 11:45:49 old-k8s-version-501600 kubelet[1909]: E1216 11:45:49.888740    1909 pod_workers.go:191] Error syncing pod 37a1d62a-03f1-4e8e-bd42-ca72275d6ccb ("dashboard-metrics-scraper-8d5bb5db8-4wwm7_kubernetes-dashboard(37a1d62a-03f1-4e8e-bd42-ca72275d6ccb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""

	W1216 11:45:57.213549   10008 logs.go:138] Found kubelet problem: Dec 16 11:45:56 old-k8s-version-501600 kubelet[1909]: E1216 11:45:56.890796    1909 pod_workers.go:191] Error syncing pod d2896fe7-5eeb-43d2-95d6-927aef485e51 ("metrics-server-9975d5f86-zn4gg_kube-system(d2896fe7-5eeb-43d2-95d6-927aef485e51)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	I1216 11:45:57.213549   10008 logs.go:123] Gathering logs for kube-apiserver [7ddd764ff8e3] ...

	I1216 11:45:57.213549   10008 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 7ddd764ff8e3"

	I1216 11:45:57.344481   10008 logs.go:123] Gathering logs for kube-scheduler [5bfd011d16fd] ...

	I1216 11:45:57.344481   10008 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5bfd011d16fd"

	I1216 11:45:57.412768   10008 out.go:358] Setting ErrFile to fd 1560...

	I1216 11:45:57.412807   10008 out.go:392] TERM=,COLORTERM=, which probably does not support color

	W1216 11:45:57.412807   10008 out.go:270] X Problems detected in kubelet:

	W1216 11:45:57.412807   10008 out.go:270]   Dec 16 11:45:32 old-k8s-version-501600 kubelet[1909]: E1216 11:45:32.894388    1909 pod_workers.go:191] Error syncing pod d2896fe7-5eeb-43d2-95d6-927aef485e51 ("metrics-server-9975d5f86-zn4gg_kube-system(d2896fe7-5eeb-43d2-95d6-927aef485e51)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1216 11:45:57.412807   10008 out.go:270]   Dec 16 11:45:38 old-k8s-version-501600 kubelet[1909]: E1216 11:45:38.892058    1909 pod_workers.go:191] Error syncing pod 37a1d62a-03f1-4e8e-bd42-ca72275d6ccb ("dashboard-metrics-scraper-8d5bb5db8-4wwm7_kubernetes-dashboard(37a1d62a-03f1-4e8e-bd42-ca72275d6ccb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""

	W1216 11:45:57.412807   10008 out.go:270]   Dec 16 11:45:44 old-k8s-version-501600 kubelet[1909]: E1216 11:45:44.890057    1909 pod_workers.go:191] Error syncing pod d2896fe7-5eeb-43d2-95d6-927aef485e51 ("metrics-server-9975d5f86-zn4gg_kube-system(d2896fe7-5eeb-43d2-95d6-927aef485e51)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1216 11:45:57.412807   10008 out.go:270]   Dec 16 11:45:49 old-k8s-version-501600 kubelet[1909]: E1216 11:45:49.888740    1909 pod_workers.go:191] Error syncing pod 37a1d62a-03f1-4e8e-bd42-ca72275d6ccb ("dashboard-metrics-scraper-8d5bb5db8-4wwm7_kubernetes-dashboard(37a1d62a-03f1-4e8e-bd42-ca72275d6ccb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""

	W1216 11:45:57.412807   10008 out.go:270]   Dec 16 11:45:56 old-k8s-version-501600 kubelet[1909]: E1216 11:45:56.890796    1909 pod_workers.go:191] Error syncing pod d2896fe7-5eeb-43d2-95d6-927aef485e51 ("metrics-server-9975d5f86-zn4gg_kube-system(d2896fe7-5eeb-43d2-95d6-927aef485e51)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	I1216 11:45:57.412807   10008 out.go:358] Setting ErrFile to fd 1560...

	I1216 11:45:57.412807   10008 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I1216 11:45:58.429167   10820 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I1216 11:45:58.436324   10820 cli_runner.go:164] Run: docker container inspect newest-cni-648700 --format={{.State.Status}}

	I1216 11:45:58.437288   10820 cli_runner.go:164] Run: docker container inspect newest-cni-648700 --format={{.State.Status}}

	I1216 11:45:58.437734   10820 cli_runner.go:164] Run: docker container inspect newest-cni-648700 --format={{.State.Status}}

	I1216 11:45:58.438284   10820 cli_runner.go:164] Run: docker container inspect newest-cni-648700 --format={{.State.Status}}

	I1216 11:45:58.524465   10820 out.go:177]   - Using image fake.domain/registry.k8s.io/echoserver:1.4

	I1216 11:45:58.525446   10820 out.go:177]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5

	I1216 11:45:58.525446   10820 out.go:177]   - Using image docker.io/kubernetesui/dashboard:v2.7.0

	I1216 11:45:58.527464   10820 addons.go:431] installing /etc/kubernetes/addons/metrics-apiservice.yaml

	I1216 11:45:58.529464   10820 ssh_runner.go:362] scp metrics-server/metrics-apiservice.yaml --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)

	I1216 11:45:58.529464   10820 addons.go:431] installing /etc/kubernetes/addons/storage-provisioner.yaml

	I1216 11:45:58.529464   10820 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)

	I1216 11:45:58.533456   10820 out.go:177]   - Using image registry.k8s.io/echoserver:1.4

	I1216 11:45:58.534452   10820 addons.go:431] installing /etc/kubernetes/addons/dashboard-ns.yaml

	I1216 11:45:58.535452   10820 ssh_runner.go:362] scp dashboard/dashboard-ns.yaml --> /etc/kubernetes/addons/dashboard-ns.yaml (759 bytes)

	I1216 11:45:58.537447   10820 addons.go:234] Setting addon default-storageclass=true in "newest-cni-648700"

	W1216 11:45:58.537447   10820 addons.go:243] addon default-storageclass should already be in state true

	I1216 11:45:58.537447   10820 host.go:66] Checking if "newest-cni-648700" exists ...

	I1216 11:45:58.538473   10820 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" newest-cni-648700

	I1216 11:45:58.538473   10820 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" newest-cni-648700

	I1216 11:45:58.544453   10820 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" newest-cni-648700

	I1216 11:45:58.555454   10820 cli_runner.go:164] Run: docker container inspect newest-cni-648700 --format={{.State.Status}}

	I1216 11:45:58.631629   10820 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:53107 SSHKeyPath:C:\Users\jenkins.minikube4\minikube-integration\.minikube\machines\newest-cni-648700\id_rsa Username:docker}

	I1216 11:45:58.631629   10820 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:53107 SSHKeyPath:C:\Users\jenkins.minikube4\minikube-integration\.minikube\machines\newest-cni-648700\id_rsa Username:docker}

	I1216 11:45:58.634629   10820 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:53107 SSHKeyPath:C:\Users\jenkins.minikube4\minikube-integration\.minikube\machines\newest-cni-648700\id_rsa Username:docker}

	I1216 11:45:58.640625   10820 addons.go:431] installing /etc/kubernetes/addons/storageclass.yaml

	I1216 11:45:58.640625   10820 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)

	I1216 11:45:58.649625   10820 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" newest-cni-648700

	I1216 11:45:58.728386   10820 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:53107 SSHKeyPath:C:\Users\jenkins.minikube4\minikube-integration\.minikube\machines\newest-cni-648700\id_rsa Username:docker}

	I1216 11:45:59.284013   10820 addons.go:431] installing /etc/kubernetes/addons/dashboard-clusterrole.yaml

	I1216 11:45:59.284200   10820 ssh_runner.go:362] scp dashboard/dashboard-clusterrole.yaml --> /etc/kubernetes/addons/dashboard-clusterrole.yaml (1001 bytes)

	I1216 11:45:59.478805   10820 addons.go:431] installing /etc/kubernetes/addons/metrics-server-deployment.yaml

	I1216 11:45:59.479037   10820 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1825 bytes)

	I1216 11:45:59.482503   10820 ssh_runner.go:235] Completed: sudo systemctl daemon-reload: (1.053287s)

	I1216 11:45:59.504835   10820 ssh_runner.go:195] Run: sudo systemctl start kubelet

	I1216 11:45:59.505487   10820 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.2/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml

	I1216 11:45:59.678222   10820 addons.go:431] installing /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml

	I1216 11:45:59.678308   10820 ssh_runner.go:362] scp dashboard/dashboard-clusterrolebinding.yaml --> /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml (1018 bytes)

	I1216 11:45:59.698825   10820 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.2/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml

	I1216 11:45:59.777725   10820 addons.go:431] installing /etc/kubernetes/addons/metrics-server-rbac.yaml

	I1216 11:45:59.778285   10820 ssh_runner.go:362] scp metrics-server/metrics-server-rbac.yaml --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)

	I1216 11:45:59.797240   10820 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "8443/tcp") 0).HostPort}}'" newest-cni-648700

	I1216 11:45:59.886538   10820 api_server.go:52] waiting for apiserver process to appear ...

	I1216 11:45:59.904884   10820 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I1216 11:45:59.980938   10820 addons.go:431] installing /etc/kubernetes/addons/dashboard-configmap.yaml

	I1216 11:45:59.981291   10820 ssh_runner.go:362] scp dashboard/dashboard-configmap.yaml --> /etc/kubernetes/addons/dashboard-configmap.yaml (837 bytes)

	I1216 11:46:00.276134   10820 addons.go:431] installing /etc/kubernetes/addons/metrics-server-service.yaml

	I1216 11:46:00.276134   10820 ssh_runner.go:362] scp metrics-server/metrics-server-service.yaml --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)

	I1216 11:46:00.278288   10820 addons.go:431] installing /etc/kubernetes/addons/dashboard-dp.yaml

	I1216 11:46:00.278288   10820 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-dp.yaml (4201 bytes)

	I1216 11:46:00.491526   10820 addons.go:431] installing /etc/kubernetes/addons/dashboard-role.yaml

	I1216 11:46:00.491526   10820 ssh_runner.go:362] scp dashboard/dashboard-role.yaml --> /etc/kubernetes/addons/dashboard-role.yaml (1724 bytes)

	I1216 11:46:00.503181   10820 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.2/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml

	I1216 11:46:00.690109   10820 addons.go:431] installing /etc/kubernetes/addons/dashboard-rolebinding.yaml

	I1216 11:46:00.690109   10820 ssh_runner.go:362] scp dashboard/dashboard-rolebinding.yaml --> /etc/kubernetes/addons/dashboard-rolebinding.yaml (1046 bytes)

	I1216 11:46:00.877053   10820 addons.go:431] installing /etc/kubernetes/addons/dashboard-sa.yaml

	I1216 11:46:00.877053   10820 ssh_runner.go:362] scp dashboard/dashboard-sa.yaml --> /etc/kubernetes/addons/dashboard-sa.yaml (837 bytes)

	I1216 11:46:01.001949   10820 addons.go:431] installing /etc/kubernetes/addons/dashboard-secret.yaml

	I1216 11:46:01.001949   10820 ssh_runner.go:362] scp dashboard/dashboard-secret.yaml --> /etc/kubernetes/addons/dashboard-secret.yaml (1389 bytes)

	I1216 11:46:01.113470   10820 addons.go:431] installing /etc/kubernetes/addons/dashboard-svc.yaml

	I1216 11:46:01.113470   10820 ssh_runner.go:362] scp dashboard/dashboard-svc.yaml --> /etc/kubernetes/addons/dashboard-svc.yaml (1294 bytes)

	I1216 11:46:01.230755   10820 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.2/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml

	I1216 11:45:59.015082    5556 pod_ready.go:103] pod "coredns-7c65d6cfc9-f2lcp" in "kube-system" namespace has status "Ready":"False"

	I1216 11:46:01.020449    5556 pod_ready.go:103] pod "coredns-7c65d6cfc9-f2lcp" in "kube-system" namespace has status "Ready":"False"

	I1216 11:46:03.021734    5556 pod_ready.go:103] pod "coredns-7c65d6cfc9-f2lcp" in "kube-system" namespace has status "Ready":"False"

	I1216 11:46:05.513994    5556 pod_ready.go:103] pod "coredns-7c65d6cfc9-f2lcp" in "kube-system" namespace has status "Ready":"False"

	I1216 11:46:07.515677    5556 pod_ready.go:103] pod "coredns-7c65d6cfc9-f2lcp" in "kube-system" namespace has status "Ready":"False"

	I1216 11:46:07.425281   10008 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I1216 11:46:07.448992   10008 api_server.go:72] duration metric: took 5m48.6991764s to wait for apiserver process to appear ...

	I1216 11:46:07.449079   10008 api_server.go:88] waiting for apiserver healthz status ...

	I1216 11:46:07.458043   10008 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}

	I1216 11:46:07.515677   10008 logs.go:282] 2 containers: [56bb0e9c28d2 7ddd764ff8e3]

	I1216 11:46:07.525692   10008 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}

	I1216 11:46:07.571111   10008 logs.go:282] 2 containers: [fd156a045ffd 25fc9ee43f0a]

	I1216 11:46:07.587150   10008 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}

	I1216 11:46:07.636272   10008 logs.go:282] 2 containers: [e314bd292ad5 219798af5c41]

	I1216 11:46:07.644281   10008 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}

	I1216 11:46:07.690310   10008 logs.go:282] 2 containers: [8ddd1a91749a 5bfd011d16fd]

	I1216 11:46:07.705294   10008 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}

	I1216 11:46:07.747278   10008 logs.go:282] 2 containers: [58e72cba6157 8cce9bacca4b]

	I1216 11:46:07.755285   10008 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}

	I1216 11:46:07.811859   10008 logs.go:282] 2 containers: [d341318320dc 268c261f4e09]

	I1216 11:46:07.819843   10008 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}

	I1216 11:46:07.858846   10008 logs.go:282] 0 containers: []

	W1216 11:46:07.858846   10008 logs.go:284] No container was found matching "kindnet"

	I1216 11:46:07.869852   10008 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kubernetes-dashboard --format={{.ID}}

	I1216 11:46:07.924965   10008 logs.go:282] 1 containers: [19b65a7c34eb]

	I1216 11:46:07.932927   10008 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}

	I1216 11:46:07.992760   10008 logs.go:282] 2 containers: [230a8a7960d9 2f9bdc06bf7f]

	I1216 11:46:07.992760   10008 logs.go:123] Gathering logs for kube-apiserver [7ddd764ff8e3] ...

	I1216 11:46:07.992760   10008 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 7ddd764ff8e3"

	I1216 11:46:08.117861   10008 logs.go:123] Gathering logs for etcd [fd156a045ffd] ...

	I1216 11:46:08.117861   10008 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 fd156a045ffd"

	I1216 11:46:08.187648   10008 logs.go:123] Gathering logs for coredns [219798af5c41] ...

	I1216 11:46:08.187648   10008 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 219798af5c41"

	I1216 11:46:08.241337   10008 logs.go:123] Gathering logs for kube-scheduler [8ddd1a91749a] ...

	I1216 11:46:08.241416   10008 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 8ddd1a91749a"

	I1216 11:46:08.296607   10008 logs.go:123] Gathering logs for kube-proxy [8cce9bacca4b] ...

	I1216 11:46:08.296607   10008 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 8cce9bacca4b"

	I1216 11:46:08.341608   10008 logs.go:123] Gathering logs for kubelet ...

	I1216 11:46:08.341608   10008 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"

	W1216 11:46:08.434637   10008 logs.go:138] Found kubelet problem: Dec 16 11:40:30 old-k8s-version-501600 kubelet[1909]: E1216 11:40:30.611863    1909 reflector.go:138] object-"kube-system"/"storage-provisioner-token-h2pb2": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "storage-provisioner-token-h2pb2" is forbidden: User "system:node:old-k8s-version-501600" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-501600' and this object

	W1216 11:46:08.442412   10008 logs.go:138] Found kubelet problem: Dec 16 11:40:36 old-k8s-version-501600 kubelet[1909]: E1216 11:40:36.024919    1909 pod_workers.go:191] Error syncing pod d2896fe7-5eeb-43d2-95d6-927aef485e51 ("metrics-server-9975d5f86-zn4gg_kube-system(d2896fe7-5eeb-43d2-95d6-927aef485e51)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = Error response from daemon: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.65.254:53: no such host"

	W1216 11:46:08.443274   10008 logs.go:138] Found kubelet problem: Dec 16 11:40:37 old-k8s-version-501600 kubelet[1909]: E1216 11:40:37.028492    1909 pod_workers.go:191] Error syncing pod d2896fe7-5eeb-43d2-95d6-927aef485e51 ("metrics-server-9975d5f86-zn4gg_kube-system(d2896fe7-5eeb-43d2-95d6-927aef485e51)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1216 11:46:08.444285   10008 logs.go:138] Found kubelet problem: Dec 16 11:40:38 old-k8s-version-501600 kubelet[1909]: E1216 11:40:38.707195    1909 pod_workers.go:191] Error syncing pod d2896fe7-5eeb-43d2-95d6-927aef485e51 ("metrics-server-9975d5f86-zn4gg_kube-system(d2896fe7-5eeb-43d2-95d6-927aef485e51)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1216 11:46:08.448252   10008 logs.go:138] Found kubelet problem: Dec 16 11:40:51 old-k8s-version-501600 kubelet[1909]: E1216 11:40:51.972752    1909 pod_workers.go:191] Error syncing pod d2896fe7-5eeb-43d2-95d6-927aef485e51 ("metrics-server-9975d5f86-zn4gg_kube-system(d2896fe7-5eeb-43d2-95d6-927aef485e51)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = Error response from daemon: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.65.254:53: no such host"

	W1216 11:46:08.451256   10008 logs.go:138] Found kubelet problem: Dec 16 11:40:53 old-k8s-version-501600 kubelet[1909]: E1216 11:40:53.819814    1909 pod_workers.go:191] Error syncing pod 37a1d62a-03f1-4e8e-bd42-ca72275d6ccb ("dashboard-metrics-scraper-8d5bb5db8-4wwm7_kubernetes-dashboard(37a1d62a-03f1-4e8e-bd42-ca72275d6ccb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ErrImagePull: "rpc error: code = Unknown desc = [DEPRECATION NOTICE] Docker Image Format v1 and Docker Image manifest version 2, schema 1 support is disabled by default and will be removed in an upcoming release. Suggest the author of registry.k8s.io/echoserver:1.4 to upgrade the image to the OCI Format or Docker Image manifest v2, schema 2. More information at https://docs.docker.com/go/deprecated-image-specs/"

	W1216 11:46:08.452248   10008 logs.go:138] Found kubelet problem: Dec 16 11:40:54 old-k8s-version-501600 kubelet[1909]: E1216 11:40:54.247688    1909 pod_workers.go:191] Error syncing pod 37a1d62a-03f1-4e8e-bd42-ca72275d6ccb ("dashboard-metrics-scraper-8d5bb5db8-4wwm7_kubernetes-dashboard(37a1d62a-03f1-4e8e-bd42-ca72275d6ccb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""

	W1216 11:46:08.452248   10008 logs.go:138] Found kubelet problem: Dec 16 11:40:55 old-k8s-version-501600 kubelet[1909]: E1216 11:40:55.271609    1909 pod_workers.go:191] Error syncing pod 37a1d62a-03f1-4e8e-bd42-ca72275d6ccb ("dashboard-metrics-scraper-8d5bb5db8-4wwm7_kubernetes-dashboard(37a1d62a-03f1-4e8e-bd42-ca72275d6ccb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""

	W1216 11:46:08.453248   10008 logs.go:138] Found kubelet problem: Dec 16 11:40:59 old-k8s-version-501600 kubelet[1909]: E1216 11:40:59.364188    1909 pod_workers.go:191] Error syncing pod 21b24a0c-f627-4a14-9eb5-704f6fe85772 ("storage-provisioner_kube-system(21b24a0c-f627-4a14-9eb5-704f6fe85772)"), skipping: failed to "StartContainer" for "storage-provisioner" with CrashLoopBackOff: "back-off 10s restarting failed container=storage-provisioner pod=storage-provisioner_kube-system(21b24a0c-f627-4a14-9eb5-704f6fe85772)"

	W1216 11:46:08.453837   10008 logs.go:138] Found kubelet problem: Dec 16 11:41:04 old-k8s-version-501600 kubelet[1909]: E1216 11:41:04.917670    1909 pod_workers.go:191] Error syncing pod d2896fe7-5eeb-43d2-95d6-927aef485e51 ("metrics-server-9975d5f86-zn4gg_kube-system(d2896fe7-5eeb-43d2-95d6-927aef485e51)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1216 11:46:08.456939   10008 logs.go:138] Found kubelet problem: Dec 16 11:41:14 old-k8s-version-501600 kubelet[1909]: E1216 11:41:14.532141    1909 pod_workers.go:191] Error syncing pod 37a1d62a-03f1-4e8e-bd42-ca72275d6ccb ("dashboard-metrics-scraper-8d5bb5db8-4wwm7_kubernetes-dashboard(37a1d62a-03f1-4e8e-bd42-ca72275d6ccb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ErrImagePull: "rpc error: code = Unknown desc = [DEPRECATION NOTICE] Docker Image Format v1 and Docker Image manifest version 2, schema 1 support is disabled by default and will be removed in an upcoming release. Suggest the author of registry.k8s.io/echoserver:1.4 to upgrade the image to the OCI Format or Docker Image manifest v2, schema 2. More information at https://docs.docker.com/go/deprecated-image-specs/"

	W1216 11:46:08.459046   10008 logs.go:138] Found kubelet problem: Dec 16 11:41:18 old-k8s-version-501600 kubelet[1909]: E1216 11:41:18.993736    1909 pod_workers.go:191] Error syncing pod d2896fe7-5eeb-43d2-95d6-927aef485e51 ("metrics-server-9975d5f86-zn4gg_kube-system(d2896fe7-5eeb-43d2-95d6-927aef485e51)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = Error response from daemon: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.65.254:53: no such host"

	W1216 11:46:08.459945   10008 logs.go:138] Found kubelet problem: Dec 16 11:41:25 old-k8s-version-501600 kubelet[1909]: E1216 11:41:25.914536    1909 pod_workers.go:191] Error syncing pod 37a1d62a-03f1-4e8e-bd42-ca72275d6ccb ("dashboard-metrics-scraper-8d5bb5db8-4wwm7_kubernetes-dashboard(37a1d62a-03f1-4e8e-bd42-ca72275d6ccb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""

	W1216 11:46:08.460182   10008 logs.go:138] Found kubelet problem: Dec 16 11:41:29 old-k8s-version-501600 kubelet[1909]: E1216 11:41:29.914402    1909 pod_workers.go:191] Error syncing pod d2896fe7-5eeb-43d2-95d6-927aef485e51 ("metrics-server-9975d5f86-zn4gg_kube-system(d2896fe7-5eeb-43d2-95d6-927aef485e51)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1216 11:46:08.462455   10008 logs.go:138] Found kubelet problem: Dec 16 11:41:37 old-k8s-version-501600 kubelet[1909]: E1216 11:41:37.438642    1909 pod_workers.go:191] Error syncing pod 37a1d62a-03f1-4e8e-bd42-ca72275d6ccb ("dashboard-metrics-scraper-8d5bb5db8-4wwm7_kubernetes-dashboard(37a1d62a-03f1-4e8e-bd42-ca72275d6ccb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ErrImagePull: "rpc error: code = Unknown desc = [DEPRECATION NOTICE] Docker Image Format v1 and Docker Image manifest version 2, schema 1 support is disabled by default and will be removed in an upcoming release. Suggest the author of registry.k8s.io/echoserver:1.4 to upgrade the image to the OCI Format or Docker Image manifest v2, schema 2. More information at https://docs.docker.com/go/deprecated-image-specs/"

	W1216 11:46:08.462862   10008 logs.go:138] Found kubelet problem: Dec 16 11:41:40 old-k8s-version-501600 kubelet[1909]: E1216 11:41:40.912394    1909 pod_workers.go:191] Error syncing pod d2896fe7-5eeb-43d2-95d6-927aef485e51 ("metrics-server-9975d5f86-zn4gg_kube-system(d2896fe7-5eeb-43d2-95d6-927aef485e51)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1216 11:46:08.463097   10008 logs.go:138] Found kubelet problem: Dec 16 11:41:48 old-k8s-version-501600 kubelet[1909]: E1216 11:41:48.911506    1909 pod_workers.go:191] Error syncing pod 37a1d62a-03f1-4e8e-bd42-ca72275d6ccb ("dashboard-metrics-scraper-8d5bb5db8-4wwm7_kubernetes-dashboard(37a1d62a-03f1-4e8e-bd42-ca72275d6ccb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""

	W1216 11:46:08.463350   10008 logs.go:138] Found kubelet problem: Dec 16 11:41:52 old-k8s-version-501600 kubelet[1909]: E1216 11:41:52.911934    1909 pod_workers.go:191] Error syncing pod d2896fe7-5eeb-43d2-95d6-927aef485e51 ("metrics-server-9975d5f86-zn4gg_kube-system(d2896fe7-5eeb-43d2-95d6-927aef485e51)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1216 11:46:08.463578   10008 logs.go:138] Found kubelet problem: Dec 16 11:42:00 old-k8s-version-501600 kubelet[1909]: E1216 11:42:00.925934    1909 pod_workers.go:191] Error syncing pod 37a1d62a-03f1-4e8e-bd42-ca72275d6ccb ("dashboard-metrics-scraper-8d5bb5db8-4wwm7_kubernetes-dashboard(37a1d62a-03f1-4e8e-bd42-ca72275d6ccb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""

	W1216 11:46:08.465492   10008 logs.go:138] Found kubelet problem: Dec 16 11:42:06 old-k8s-version-501600 kubelet[1909]: E1216 11:42:06.960188    1909 pod_workers.go:191] Error syncing pod d2896fe7-5eeb-43d2-95d6-927aef485e51 ("metrics-server-9975d5f86-zn4gg_kube-system(d2896fe7-5eeb-43d2-95d6-927aef485e51)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = Error response from daemon: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.65.254:53: no such host"

	W1216 11:46:08.466074   10008 logs.go:138] Found kubelet problem: Dec 16 11:42:11 old-k8s-version-501600 kubelet[1909]: E1216 11:42:11.908414    1909 pod_workers.go:191] Error syncing pod 37a1d62a-03f1-4e8e-bd42-ca72275d6ccb ("dashboard-metrics-scraper-8d5bb5db8-4wwm7_kubernetes-dashboard(37a1d62a-03f1-4e8e-bd42-ca72275d6ccb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""

	W1216 11:46:08.466375   10008 logs.go:138] Found kubelet problem: Dec 16 11:42:17 old-k8s-version-501600 kubelet[1909]: E1216 11:42:17.908853    1909 pod_workers.go:191] Error syncing pod d2896fe7-5eeb-43d2-95d6-927aef485e51 ("metrics-server-9975d5f86-zn4gg_kube-system(d2896fe7-5eeb-43d2-95d6-927aef485e51)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1216 11:46:08.468692   10008 logs.go:138] Found kubelet problem: Dec 16 11:42:23 old-k8s-version-501600 kubelet[1909]: E1216 11:42:23.391511    1909 pod_workers.go:191] Error syncing pod 37a1d62a-03f1-4e8e-bd42-ca72275d6ccb ("dashboard-metrics-scraper-8d5bb5db8-4wwm7_kubernetes-dashboard(37a1d62a-03f1-4e8e-bd42-ca72275d6ccb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ErrImagePull: "rpc error: code = Unknown desc = [DEPRECATION NOTICE] Docker Image Format v1 and Docker Image manifest version 2, schema 1 support is disabled by default and will be removed in an upcoming release. Suggest the author of registry.k8s.io/echoserver:1.4 to upgrade the image to the OCI Format or Docker Image manifest v2, schema 2. More information at https://docs.docker.com/go/deprecated-image-specs/"

	W1216 11:46:08.468926   10008 logs.go:138] Found kubelet problem: Dec 16 11:42:29 old-k8s-version-501600 kubelet[1909]: E1216 11:42:29.909302    1909 pod_workers.go:191] Error syncing pod d2896fe7-5eeb-43d2-95d6-927aef485e51 ("metrics-server-9975d5f86-zn4gg_kube-system(d2896fe7-5eeb-43d2-95d6-927aef485e51)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1216 11:46:08.469106   10008 logs.go:138] Found kubelet problem: Dec 16 11:42:37 old-k8s-version-501600 kubelet[1909]: E1216 11:42:37.905786    1909 pod_workers.go:191] Error syncing pod 37a1d62a-03f1-4e8e-bd42-ca72275d6ccb ("dashboard-metrics-scraper-8d5bb5db8-4wwm7_kubernetes-dashboard(37a1d62a-03f1-4e8e-bd42-ca72275d6ccb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""

	W1216 11:46:08.469379   10008 logs.go:138] Found kubelet problem: Dec 16 11:42:44 old-k8s-version-501600 kubelet[1909]: E1216 11:42:44.905838    1909 pod_workers.go:191] Error syncing pod d2896fe7-5eeb-43d2-95d6-927aef485e51 ("metrics-server-9975d5f86-zn4gg_kube-system(d2896fe7-5eeb-43d2-95d6-927aef485e51)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1216 11:46:08.469695   10008 logs.go:138] Found kubelet problem: Dec 16 11:42:49 old-k8s-version-501600 kubelet[1909]: E1216 11:42:49.907458    1909 pod_workers.go:191] Error syncing pod 37a1d62a-03f1-4e8e-bd42-ca72275d6ccb ("dashboard-metrics-scraper-8d5bb5db8-4wwm7_kubernetes-dashboard(37a1d62a-03f1-4e8e-bd42-ca72275d6ccb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""

	W1216 11:46:08.469863   10008 logs.go:138] Found kubelet problem: Dec 16 11:42:57 old-k8s-version-501600 kubelet[1909]: E1216 11:42:57.906185    1909 pod_workers.go:191] Error syncing pod d2896fe7-5eeb-43d2-95d6-927aef485e51 ("metrics-server-9975d5f86-zn4gg_kube-system(d2896fe7-5eeb-43d2-95d6-927aef485e51)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1216 11:46:08.470107   10008 logs.go:138] Found kubelet problem: Dec 16 11:43:04 old-k8s-version-501600 kubelet[1909]: E1216 11:43:04.922686    1909 pod_workers.go:191] Error syncing pod 37a1d62a-03f1-4e8e-bd42-ca72275d6ccb ("dashboard-metrics-scraper-8d5bb5db8-4wwm7_kubernetes-dashboard(37a1d62a-03f1-4e8e-bd42-ca72275d6ccb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""

	W1216 11:46:08.470693   10008 logs.go:138] Found kubelet problem: Dec 16 11:43:11 old-k8s-version-501600 kubelet[1909]: E1216 11:43:11.903620    1909 pod_workers.go:191] Error syncing pod d2896fe7-5eeb-43d2-95d6-927aef485e51 ("metrics-server-9975d5f86-zn4gg_kube-system(d2896fe7-5eeb-43d2-95d6-927aef485e51)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1216 11:46:08.470917   10008 logs.go:138] Found kubelet problem: Dec 16 11:43:19 old-k8s-version-501600 kubelet[1909]: E1216 11:43:19.904521    1909 pod_workers.go:191] Error syncing pod 37a1d62a-03f1-4e8e-bd42-ca72275d6ccb ("dashboard-metrics-scraper-8d5bb5db8-4wwm7_kubernetes-dashboard(37a1d62a-03f1-4e8e-bd42-ca72275d6ccb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""

	W1216 11:46:08.470917   10008 logs.go:138] Found kubelet problem: Dec 16 11:43:25 old-k8s-version-501600 kubelet[1909]: E1216 11:43:25.902968    1909 pod_workers.go:191] Error syncing pod d2896fe7-5eeb-43d2-95d6-927aef485e51 ("metrics-server-9975d5f86-zn4gg_kube-system(d2896fe7-5eeb-43d2-95d6-927aef485e51)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1216 11:46:08.470917   10008 logs.go:138] Found kubelet problem: Dec 16 11:43:34 old-k8s-version-501600 kubelet[1909]: E1216 11:43:34.907258    1909 pod_workers.go:191] Error syncing pod 37a1d62a-03f1-4e8e-bd42-ca72275d6ccb ("dashboard-metrics-scraper-8d5bb5db8-4wwm7_kubernetes-dashboard(37a1d62a-03f1-4e8e-bd42-ca72275d6ccb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""

	W1216 11:46:08.473705   10008 logs.go:138] Found kubelet problem: Dec 16 11:43:36 old-k8s-version-501600 kubelet[1909]: E1216 11:43:36.956321    1909 pod_workers.go:191] Error syncing pod d2896fe7-5eeb-43d2-95d6-927aef485e51 ("metrics-server-9975d5f86-zn4gg_kube-system(d2896fe7-5eeb-43d2-95d6-927aef485e51)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = Error response from daemon: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.65.254:53: no such host"

	W1216 11:46:08.477199   10008 logs.go:138] Found kubelet problem: Dec 16 11:43:48 old-k8s-version-501600 kubelet[1909]: E1216 11:43:48.383349    1909 pod_workers.go:191] Error syncing pod 37a1d62a-03f1-4e8e-bd42-ca72275d6ccb ("dashboard-metrics-scraper-8d5bb5db8-4wwm7_kubernetes-dashboard(37a1d62a-03f1-4e8e-bd42-ca72275d6ccb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ErrImagePull: "rpc error: code = Unknown desc = [DEPRECATION NOTICE] Docker Image Format v1 and Docker Image manifest version 2, schema 1 support is disabled by default and will be removed in an upcoming release. Suggest the author of registry.k8s.io/echoserver:1.4 to upgrade the image to the OCI Format or Docker Image manifest v2, schema 2. More information at https://docs.docker.com/go/deprecated-image-specs/"

	W1216 11:46:08.478206   10008 logs.go:138] Found kubelet problem: Dec 16 11:43:49 old-k8s-version-501600 kubelet[1909]: E1216 11:43:49.900605    1909 pod_workers.go:191] Error syncing pod d2896fe7-5eeb-43d2-95d6-927aef485e51 ("metrics-server-9975d5f86-zn4gg_kube-system(d2896fe7-5eeb-43d2-95d6-927aef485e51)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1216 11:46:08.478206   10008 logs.go:138] Found kubelet problem: Dec 16 11:44:03 old-k8s-version-501600 kubelet[1909]: E1216 11:44:03.900541    1909 pod_workers.go:191] Error syncing pod 37a1d62a-03f1-4e8e-bd42-ca72275d6ccb ("dashboard-metrics-scraper-8d5bb5db8-4wwm7_kubernetes-dashboard(37a1d62a-03f1-4e8e-bd42-ca72275d6ccb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""

	W1216 11:46:08.478806   10008 logs.go:138] Found kubelet problem: Dec 16 11:44:03 old-k8s-version-501600 kubelet[1909]: E1216 11:44:03.900719    1909 pod_workers.go:191] Error syncing pod d2896fe7-5eeb-43d2-95d6-927aef485e51 ("metrics-server-9975d5f86-zn4gg_kube-system(d2896fe7-5eeb-43d2-95d6-927aef485e51)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1216 11:46:08.479392   10008 logs.go:138] Found kubelet problem: Dec 16 11:44:14 old-k8s-version-501600 kubelet[1909]: E1216 11:44:14.897911    1909 pod_workers.go:191] Error syncing pod d2896fe7-5eeb-43d2-95d6-927aef485e51 ("metrics-server-9975d5f86-zn4gg_kube-system(d2896fe7-5eeb-43d2-95d6-927aef485e51)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1216 11:46:08.479904   10008 logs.go:138] Found kubelet problem: Dec 16 11:44:15 old-k8s-version-501600 kubelet[1909]: E1216 11:44:15.919796    1909 pod_workers.go:191] Error syncing pod 37a1d62a-03f1-4e8e-bd42-ca72275d6ccb ("dashboard-metrics-scraper-8d5bb5db8-4wwm7_kubernetes-dashboard(37a1d62a-03f1-4e8e-bd42-ca72275d6ccb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""

	W1216 11:46:08.479904   10008 logs.go:138] Found kubelet problem: Dec 16 11:44:26 old-k8s-version-501600 kubelet[1909]: E1216 11:44:26.900810    1909 pod_workers.go:191] Error syncing pod d2896fe7-5eeb-43d2-95d6-927aef485e51 ("metrics-server-9975d5f86-zn4gg_kube-system(d2896fe7-5eeb-43d2-95d6-927aef485e51)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1216 11:46:08.480426   10008 logs.go:138] Found kubelet problem: Dec 16 11:44:27 old-k8s-version-501600 kubelet[1909]: E1216 11:44:27.906368    1909 pod_workers.go:191] Error syncing pod 37a1d62a-03f1-4e8e-bd42-ca72275d6ccb ("dashboard-metrics-scraper-8d5bb5db8-4wwm7_kubernetes-dashboard(37a1d62a-03f1-4e8e-bd42-ca72275d6ccb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""

	W1216 11:46:08.480426   10008 logs.go:138] Found kubelet problem: Dec 16 11:44:38 old-k8s-version-501600 kubelet[1909]: E1216 11:44:38.897229    1909 pod_workers.go:191] Error syncing pod d2896fe7-5eeb-43d2-95d6-927aef485e51 ("metrics-server-9975d5f86-zn4gg_kube-system(d2896fe7-5eeb-43d2-95d6-927aef485e51)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1216 11:46:08.481376   10008 logs.go:138] Found kubelet problem: Dec 16 11:44:39 old-k8s-version-501600 kubelet[1909]: E1216 11:44:39.896174    1909 pod_workers.go:191] Error syncing pod 37a1d62a-03f1-4e8e-bd42-ca72275d6ccb ("dashboard-metrics-scraper-8d5bb5db8-4wwm7_kubernetes-dashboard(37a1d62a-03f1-4e8e-bd42-ca72275d6ccb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""

	W1216 11:46:08.481995   10008 logs.go:138] Found kubelet problem: Dec 16 11:44:50 old-k8s-version-501600 kubelet[1909]: E1216 11:44:50.898286    1909 pod_workers.go:191] Error syncing pod d2896fe7-5eeb-43d2-95d6-927aef485e51 ("metrics-server-9975d5f86-zn4gg_kube-system(d2896fe7-5eeb-43d2-95d6-927aef485e51)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1216 11:46:08.482321   10008 logs.go:138] Found kubelet problem: Dec 16 11:44:52 old-k8s-version-501600 kubelet[1909]: E1216 11:44:52.894556    1909 pod_workers.go:191] Error syncing pod 37a1d62a-03f1-4e8e-bd42-ca72275d6ccb ("dashboard-metrics-scraper-8d5bb5db8-4wwm7_kubernetes-dashboard(37a1d62a-03f1-4e8e-bd42-ca72275d6ccb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""

	W1216 11:46:08.482321   10008 logs.go:138] Found kubelet problem: Dec 16 11:45:03 old-k8s-version-501600 kubelet[1909]: E1216 11:45:03.895647    1909 pod_workers.go:191] Error syncing pod 37a1d62a-03f1-4e8e-bd42-ca72275d6ccb ("dashboard-metrics-scraper-8d5bb5db8-4wwm7_kubernetes-dashboard(37a1d62a-03f1-4e8e-bd42-ca72275d6ccb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""

	W1216 11:46:08.483252   10008 logs.go:138] Found kubelet problem: Dec 16 11:45:04 old-k8s-version-501600 kubelet[1909]: E1216 11:45:04.897659    1909 pod_workers.go:191] Error syncing pod d2896fe7-5eeb-43d2-95d6-927aef485e51 ("metrics-server-9975d5f86-zn4gg_kube-system(d2896fe7-5eeb-43d2-95d6-927aef485e51)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1216 11:46:08.483252   10008 logs.go:138] Found kubelet problem: Dec 16 11:45:15 old-k8s-version-501600 kubelet[1909]: E1216 11:45:15.893423    1909 pod_workers.go:191] Error syncing pod 37a1d62a-03f1-4e8e-bd42-ca72275d6ccb ("dashboard-metrics-scraper-8d5bb5db8-4wwm7_kubernetes-dashboard(37a1d62a-03f1-4e8e-bd42-ca72275d6ccb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""

	W1216 11:46:08.484214   10008 logs.go:138] Found kubelet problem: Dec 16 11:45:16 old-k8s-version-501600 kubelet[1909]: E1216 11:45:16.895909    1909 pod_workers.go:191] Error syncing pod d2896fe7-5eeb-43d2-95d6-927aef485e51 ("metrics-server-9975d5f86-zn4gg_kube-system(d2896fe7-5eeb-43d2-95d6-927aef485e51)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1216 11:46:08.484214   10008 logs.go:138] Found kubelet problem: Dec 16 11:45:26 old-k8s-version-501600 kubelet[1909]: E1216 11:45:26.948454    1909 pod_workers.go:191] Error syncing pod 37a1d62a-03f1-4e8e-bd42-ca72275d6ccb ("dashboard-metrics-scraper-8d5bb5db8-4wwm7_kubernetes-dashboard(37a1d62a-03f1-4e8e-bd42-ca72275d6ccb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""

	W1216 11:46:08.485212   10008 logs.go:138] Found kubelet problem: Dec 16 11:45:32 old-k8s-version-501600 kubelet[1909]: E1216 11:45:32.894388    1909 pod_workers.go:191] Error syncing pod d2896fe7-5eeb-43d2-95d6-927aef485e51 ("metrics-server-9975d5f86-zn4gg_kube-system(d2896fe7-5eeb-43d2-95d6-927aef485e51)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1216 11:46:08.485212   10008 logs.go:138] Found kubelet problem: Dec 16 11:45:38 old-k8s-version-501600 kubelet[1909]: E1216 11:45:38.892058    1909 pod_workers.go:191] Error syncing pod 37a1d62a-03f1-4e8e-bd42-ca72275d6ccb ("dashboard-metrics-scraper-8d5bb5db8-4wwm7_kubernetes-dashboard(37a1d62a-03f1-4e8e-bd42-ca72275d6ccb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""

	W1216 11:46:08.485212   10008 logs.go:138] Found kubelet problem: Dec 16 11:45:44 old-k8s-version-501600 kubelet[1909]: E1216 11:45:44.890057    1909 pod_workers.go:191] Error syncing pod d2896fe7-5eeb-43d2-95d6-927aef485e51 ("metrics-server-9975d5f86-zn4gg_kube-system(d2896fe7-5eeb-43d2-95d6-927aef485e51)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1216 11:46:08.486227   10008 logs.go:138] Found kubelet problem: Dec 16 11:45:49 old-k8s-version-501600 kubelet[1909]: E1216 11:45:49.888740    1909 pod_workers.go:191] Error syncing pod 37a1d62a-03f1-4e8e-bd42-ca72275d6ccb ("dashboard-metrics-scraper-8d5bb5db8-4wwm7_kubernetes-dashboard(37a1d62a-03f1-4e8e-bd42-ca72275d6ccb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""

	W1216 11:46:08.486227   10008 logs.go:138] Found kubelet problem: Dec 16 11:45:56 old-k8s-version-501600 kubelet[1909]: E1216 11:45:56.890796    1909 pod_workers.go:191] Error syncing pod d2896fe7-5eeb-43d2-95d6-927aef485e51 ("metrics-server-9975d5f86-zn4gg_kube-system(d2896fe7-5eeb-43d2-95d6-927aef485e51)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1216 11:46:08.488233   10008 logs.go:138] Found kubelet problem: Dec 16 11:46:01 old-k8s-version-501600 kubelet[1909]: E1216 11:46:01.889316    1909 pod_workers.go:191] Error syncing pod 37a1d62a-03f1-4e8e-bd42-ca72275d6ccb ("dashboard-metrics-scraper-8d5bb5db8-4wwm7_kubernetes-dashboard(37a1d62a-03f1-4e8e-bd42-ca72275d6ccb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""

	I1216 11:46:08.488233   10008 logs.go:123] Gathering logs for etcd [25fc9ee43f0a] ...

	I1216 11:46:08.488233   10008 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 25fc9ee43f0a"

	I1216 11:46:10.493489   10820 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.2/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: (10.7941615s)

	I1216 11:46:10.494121   10820 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.2/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: (10.9880441s)

	I1216 11:46:10.494121   10820 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.2/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (9.9904742s)

	I1216 11:46:10.494642   10820 addons.go:475] Verifying addon metrics-server=true in "newest-cni-648700"

	I1216 11:46:10.494052   10820 ssh_runner.go:235] Completed: sudo pgrep -xnf kube-apiserver.*minikube.*: (10.5881123s)

	I1216 11:46:10.494642   10820 api_server.go:72] duration metric: took 12.0958339s to wait for apiserver process to appear ...

	I1216 11:46:10.494642   10820 api_server.go:88] waiting for apiserver healthz status ...

	I1216 11:46:10.494642   10820 api_server.go:253] Checking apiserver healthz at https://127.0.0.1:53106/healthz ...

	I1216 11:46:10.594568   10820 api_server.go:279] https://127.0.0.1:53106/healthz returned 500:

	[+]ping ok

	[+]log ok

	[+]etcd ok

	[+]poststarthook/start-apiserver-admission-initializer ok

	[+]poststarthook/generic-apiserver-start-informers ok

	[+]poststarthook/priority-and-fairness-config-consumer ok

	[+]poststarthook/priority-and-fairness-filter ok

	[+]poststarthook/storage-object-count-tracker-hook ok

	[+]poststarthook/start-apiextensions-informers ok

	[+]poststarthook/start-apiextensions-controllers ok

	[+]poststarthook/crd-informer-synced ok

	[+]poststarthook/start-system-namespaces-controller ok

	[+]poststarthook/start-cluster-authentication-info-controller ok

	[+]poststarthook/start-kube-apiserver-identity-lease-controller ok

	[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok

	[+]poststarthook/start-legacy-token-tracking-controller ok

	[+]poststarthook/start-service-ip-repair-controllers ok

	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld

	[+]poststarthook/scheduling/bootstrap-system-priority-classes ok

	[+]poststarthook/priority-and-fairness-config-producer ok

	[+]poststarthook/bootstrap-controller ok

	[+]poststarthook/aggregator-reload-proxy-client-cert ok

	[+]poststarthook/start-kube-aggregator-informers ok

	[+]poststarthook/apiservice-status-local-available-controller ok

	[+]poststarthook/apiservice-status-remote-available-controller ok

	[+]poststarthook/apiservice-registration-controller ok

	[+]poststarthook/apiservice-discovery-controller ok

	[+]poststarthook/kube-apiserver-autoregistration ok

	[+]autoregister-completion ok

	[+]poststarthook/apiservice-openapi-controller ok

	[+]poststarthook/apiservice-openapiv3-controller ok

	healthz check failed

	W1216 11:46:10.594568   10820 api_server.go:103] status: https://127.0.0.1:53106/healthz returned error 500:

	[+]ping ok

	[+]log ok

	[+]etcd ok

	[+]poststarthook/start-apiserver-admission-initializer ok

	[+]poststarthook/generic-apiserver-start-informers ok

	[+]poststarthook/priority-and-fairness-config-consumer ok

	[+]poststarthook/priority-and-fairness-filter ok

	[+]poststarthook/storage-object-count-tracker-hook ok

	[+]poststarthook/start-apiextensions-informers ok

	[+]poststarthook/start-apiextensions-controllers ok

	[+]poststarthook/crd-informer-synced ok

	[+]poststarthook/start-system-namespaces-controller ok

	[+]poststarthook/start-cluster-authentication-info-controller ok

	[+]poststarthook/start-kube-apiserver-identity-lease-controller ok

	[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok

	[+]poststarthook/start-legacy-token-tracking-controller ok

	[+]poststarthook/start-service-ip-repair-controllers ok

	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld

	[+]poststarthook/scheduling/bootstrap-system-priority-classes ok

	[+]poststarthook/priority-and-fairness-config-producer ok

	[+]poststarthook/bootstrap-controller ok

	[+]poststarthook/aggregator-reload-proxy-client-cert ok

	[+]poststarthook/start-kube-aggregator-informers ok

	[+]poststarthook/apiservice-status-local-available-controller ok

	[+]poststarthook/apiservice-status-remote-available-controller ok

	[+]poststarthook/apiservice-registration-controller ok

	[+]poststarthook/apiservice-discovery-controller ok

	[+]poststarthook/kube-apiserver-autoregistration ok

	[+]autoregister-completion ok

	[+]poststarthook/apiservice-openapi-controller ok

	[+]poststarthook/apiservice-openapiv3-controller ok

	healthz check failed

	I1216 11:46:10.994938   10820 api_server.go:253] Checking apiserver healthz at https://127.0.0.1:53106/healthz ...

	I1216 11:46:11.083744   10820 api_server.go:279] https://127.0.0.1:53106/healthz returned 500:

	[+]ping ok

	[+]log ok

	[+]etcd ok

	[+]poststarthook/start-apiserver-admission-initializer ok

	[+]poststarthook/generic-apiserver-start-informers ok

	[+]poststarthook/priority-and-fairness-config-consumer ok

	[+]poststarthook/priority-and-fairness-filter ok

	[+]poststarthook/storage-object-count-tracker-hook ok

	[+]poststarthook/start-apiextensions-informers ok

	[+]poststarthook/start-apiextensions-controllers ok

	[+]poststarthook/crd-informer-synced ok

	[+]poststarthook/start-system-namespaces-controller ok

	[+]poststarthook/start-cluster-authentication-info-controller ok

	[+]poststarthook/start-kube-apiserver-identity-lease-controller ok

	[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok

	[+]poststarthook/start-legacy-token-tracking-controller ok

	[+]poststarthook/start-service-ip-repair-controllers ok

	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld

	[+]poststarthook/scheduling/bootstrap-system-priority-classes ok

	[+]poststarthook/priority-and-fairness-config-producer ok

	[+]poststarthook/bootstrap-controller ok

	[+]poststarthook/aggregator-reload-proxy-client-cert ok

	[+]poststarthook/start-kube-aggregator-informers ok

	[+]poststarthook/apiservice-status-local-available-controller ok

	[+]poststarthook/apiservice-status-remote-available-controller ok

	[+]poststarthook/apiservice-registration-controller ok

	[+]poststarthook/apiservice-discovery-controller ok

	[+]poststarthook/kube-apiserver-autoregistration ok

	[+]autoregister-completion ok

	[+]poststarthook/apiservice-openapi-controller ok

	[+]poststarthook/apiservice-openapiv3-controller ok

	healthz check failed

	W1216 11:46:11.083744   10820 api_server.go:103] status: https://127.0.0.1:53106/healthz returned error 500:

	[+]ping ok

	[+]log ok

	[+]etcd ok

	[+]poststarthook/start-apiserver-admission-initializer ok

	[+]poststarthook/generic-apiserver-start-informers ok

	[+]poststarthook/priority-and-fairness-config-consumer ok

	[+]poststarthook/priority-and-fairness-filter ok

	[+]poststarthook/storage-object-count-tracker-hook ok

	[+]poststarthook/start-apiextensions-informers ok

	[+]poststarthook/start-apiextensions-controllers ok

	[+]poststarthook/crd-informer-synced ok

	[+]poststarthook/start-system-namespaces-controller ok

	[+]poststarthook/start-cluster-authentication-info-controller ok

	[+]poststarthook/start-kube-apiserver-identity-lease-controller ok

	[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok

	[+]poststarthook/start-legacy-token-tracking-controller ok

	[+]poststarthook/start-service-ip-repair-controllers ok

	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld

	[+]poststarthook/scheduling/bootstrap-system-priority-classes ok

	[+]poststarthook/priority-and-fairness-config-producer ok

	[+]poststarthook/bootstrap-controller ok

	[+]poststarthook/aggregator-reload-proxy-client-cert ok

	[+]poststarthook/start-kube-aggregator-informers ok

	[+]poststarthook/apiservice-status-local-available-controller ok

	[+]poststarthook/apiservice-status-remote-available-controller ok

	[+]poststarthook/apiservice-registration-controller ok

	[+]poststarthook/apiservice-discovery-controller ok

	[+]poststarthook/kube-apiserver-autoregistration ok

	[+]autoregister-completion ok

	[+]poststarthook/apiservice-openapi-controller ok

	[+]poststarthook/apiservice-openapiv3-controller ok

	healthz check failed

	I1216 11:46:11.495289   10820 api_server.go:253] Checking apiserver healthz at https://127.0.0.1:53106/healthz ...

	I1216 11:46:11.513720   10820 api_server.go:279] https://127.0.0.1:53106/healthz returned 200:

	ok

	I1216 11:46:11.533015   10820 api_server.go:141] control plane version: v1.31.2

	I1216 11:46:11.533015   10820 api_server.go:131] duration metric: took 1.038325s to wait for apiserver health ...

	I1216 11:46:11.533015   10820 system_pods.go:43] waiting for kube-system pods to appear ...

	I1216 11:46:11.533015   10820 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.2/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: (10.3017802s)

	I1216 11:46:11.537993   10820 out.go:177] * Some dashboard features require the metrics-server addon. To enable all features please run:

		minikube -p newest-cni-648700 addons enable metrics-server

	I1216 11:46:11.542019   10820 out.go:177] * Enabled addons: storage-provisioner, metrics-server, default-storageclass, dashboard

	I1216 11:46:11.797500    5140 kubeadm.go:310] [init] Using Kubernetes version: v1.31.2

	I1216 11:46:11.797500    5140 kubeadm.go:310] [preflight] Running pre-flight checks

	I1216 11:46:11.797500    5140 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster

	I1216 11:46:11.797500    5140 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection

	I1216 11:46:11.798482    5140 kubeadm.go:310] [preflight] You can also perform this action beforehand using 'kubeadm config images pull'

	I1216 11:46:11.798482    5140 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"

	I1216 11:46:11.801473    5140 out.go:235]   - Generating certificates and keys ...

	I1216 11:46:11.801646    5140 kubeadm.go:310] [certs] Using existing ca certificate authority

	I1216 11:46:11.802008    5140 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk

	I1216 11:46:11.802379    5140 kubeadm.go:310] [certs] Generating "apiserver-kubelet-client" certificate and key

	I1216 11:46:11.802670    5140 kubeadm.go:310] [certs] Generating "front-proxy-ca" certificate and key

	I1216 11:46:11.802806    5140 kubeadm.go:310] [certs] Generating "front-proxy-client" certificate and key

	I1216 11:46:11.803008    5140 kubeadm.go:310] [certs] Generating "etcd/ca" certificate and key

	I1216 11:46:11.803008    5140 kubeadm.go:310] [certs] Generating "etcd/server" certificate and key

	I1216 11:46:11.803763    5140 kubeadm.go:310] [certs] etcd/server serving cert is signed for DNS names [kindnet-928300 localhost] and IPs [192.168.103.2 127.0.0.1 ::1]

	I1216 11:46:11.803763    5140 kubeadm.go:310] [certs] Generating "etcd/peer" certificate and key

	I1216 11:46:11.804685    5140 kubeadm.go:310] [certs] etcd/peer serving cert is signed for DNS names [kindnet-928300 localhost] and IPs [192.168.103.2 127.0.0.1 ::1]

	I1216 11:46:11.804812    5140 kubeadm.go:310] [certs] Generating "etcd/healthcheck-client" certificate and key

	I1216 11:46:11.804812    5140 kubeadm.go:310] [certs] Generating "apiserver-etcd-client" certificate and key

	I1216 11:46:11.804812    5140 kubeadm.go:310] [certs] Generating "sa" key and public key

	I1216 11:46:11.804812    5140 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"

	I1216 11:46:11.804812    5140 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file

	I1216 11:46:11.804812    5140 kubeadm.go:310] [kubeconfig] Writing "super-admin.conf" kubeconfig file

	I1216 11:46:11.804812    5140 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file

	I1216 11:46:11.804812    5140 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file

	I1216 11:46:11.804812    5140 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file

	I1216 11:46:11.806521    5140 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"

	I1216 11:46:11.806627    5140 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"

	I1216 11:46:11.809774    5140 out.go:235]   - Booting up control plane ...

	I1216 11:46:11.810321    5140 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"

	I1216 11:46:11.810493    5140 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"

	I1216 11:46:11.810672    5140 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"

	I1216 11:46:11.810672    5140 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"

	I1216 11:46:11.811910    5140 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"

	I1216 11:46:11.811910    5140 kubeadm.go:310] [kubelet-start] Starting the kubelet

	I1216 11:46:11.812581    5140 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests"

	I1216 11:46:11.812581    5140 kubeadm.go:310] [kubelet-check] Waiting for a healthy kubelet at http://127.0.0.1:10248/healthz. This can take up to 4m0s

	I1216 11:46:11.813815    5140 kubeadm.go:310] [kubelet-check] The kubelet is healthy after 1.502217109s

	I1216 11:46:11.814234    5140 kubeadm.go:310] [api-check] Waiting for a healthy API server. This can take up to 4m0s

	I1216 11:46:11.814515    5140 kubeadm.go:310] [api-check] The API server is healthy after 10.508211599s

	I1216 11:46:11.814702    5140 kubeadm.go:310] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace

	I1216 11:46:11.815036    5140 kubeadm.go:310] [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster

	I1216 11:46:11.815331    5140 kubeadm.go:310] [upload-certs] Skipping phase. Please see --upload-certs

	I1216 11:46:11.815744    5140 kubeadm.go:310] [mark-control-plane] Marking the node kindnet-928300 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]

	I1216 11:46:11.815807    5140 kubeadm.go:310] [bootstrap-token] Using token: w4a6qy.unz5ssdb8qng00sz

	I1216 11:46:11.819597    5140 out.go:235]   - Configuring RBAC rules ...

	I1216 11:46:11.819947    5140 kubeadm.go:310] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles

	I1216 11:46:11.820013    5140 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes

	I1216 11:46:11.820564    5140 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials

	I1216 11:46:11.821065    5140 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token

	I1216 11:46:11.821065    5140 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster

	I1216 11:46:11.822039    5140 kubeadm.go:310] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace

	I1216 11:46:11.822242    5140 kubeadm.go:310] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key

	I1216 11:46:11.822242    5140 kubeadm.go:310] [addons] Applied essential addon: CoreDNS

	I1216 11:46:11.822242    5140 kubeadm.go:310] [addons] Applied essential addon: kube-proxy

	I1216 11:46:11.822242    5140 kubeadm.go:310] 

	I1216 11:46:11.822242    5140 kubeadm.go:310] Your Kubernetes control-plane has initialized successfully!

	I1216 11:46:11.822242    5140 kubeadm.go:310] 

	I1216 11:46:11.823244    5140 kubeadm.go:310] To start using your cluster, you need to run the following as a regular user:

	I1216 11:46:11.823244    5140 kubeadm.go:310] 

	I1216 11:46:11.823244    5140 kubeadm.go:310]   mkdir -p $HOME/.kube

	I1216 11:46:11.823244    5140 kubeadm.go:310]   sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config

	I1216 11:46:11.823244    5140 kubeadm.go:310]   sudo chown $(id -u):$(id -g) $HOME/.kube/config

	I1216 11:46:11.824204    5140 kubeadm.go:310] 

	I1216 11:46:11.824204    5140 kubeadm.go:310] Alternatively, if you are the root user, you can run:

	I1216 11:46:11.824204    5140 kubeadm.go:310] 

	I1216 11:46:11.824204    5140 kubeadm.go:310]   export KUBECONFIG=/etc/kubernetes/admin.conf

	I1216 11:46:11.824204    5140 kubeadm.go:310] 

	I1216 11:46:11.824204    5140 kubeadm.go:310] You should now deploy a pod network to the cluster.

	I1216 11:46:11.824204    5140 kubeadm.go:310] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:

	I1216 11:46:11.824204    5140 kubeadm.go:310]   https://kubernetes.io/docs/concepts/cluster-administration/addons/

	I1216 11:46:11.824204    5140 kubeadm.go:310] 

	I1216 11:46:11.825206    5140 kubeadm.go:310] You can now join any number of control-plane nodes by copying certificate authorities

	I1216 11:46:11.825206    5140 kubeadm.go:310] and service account keys on each node and then running the following as root:

	I1216 11:46:11.825206    5140 kubeadm.go:310] 

	I1216 11:46:11.825206    5140 kubeadm.go:310]   kubeadm join control-plane.minikube.internal:8443 --token w4a6qy.unz5ssdb8qng00sz \

	I1216 11:46:11.825206    5140 kubeadm.go:310] 	--discovery-token-ca-cert-hash sha256:7cf9121e88040791b5d6e2534ba28cb728c3ebec57bf68e5027cce6a5b134a5e \

	I1216 11:46:11.825206    5140 kubeadm.go:310] 	--control-plane 

	I1216 11:46:11.826184    5140 kubeadm.go:310] 

	I1216 11:46:11.826184    5140 kubeadm.go:310] Then you can join any number of worker nodes by running the following on each as root:

	I1216 11:46:11.826184    5140 kubeadm.go:310] 

	I1216 11:46:11.826184    5140 kubeadm.go:310] kubeadm join control-plane.minikube.internal:8443 --token w4a6qy.unz5ssdb8qng00sz \

	I1216 11:46:11.827205    5140 kubeadm.go:310] 	--discovery-token-ca-cert-hash sha256:7cf9121e88040791b5d6e2534ba28cb728c3ebec57bf68e5027cce6a5b134a5e 

	I1216 11:46:11.827205    5140 cni.go:84] Creating CNI manager for "kindnet"

	I1216 11:46:11.829196    5140 out.go:177] * Configuring CNI (Container Networking Interface) ...

	I1216 11:46:11.543978   10820 addons.go:510] duration metric: took 13.1451207s for enable addons: enabled=[storage-provisioner metrics-server default-storageclass dashboard]

	I1216 11:46:11.598473   10820 system_pods.go:59] 8 kube-system pods found

	I1216 11:46:11.598473   10820 system_pods.go:61] "coredns-7c65d6cfc9-jsjkx" [3b287521-1367-4d3e-8aa3-ae3932b56f37] Running / Ready:ContainersNotReady (containers with unready status: [coredns]) / ContainersReady:ContainersNotReady (containers with unready status: [coredns])

	I1216 11:46:11.598473   10820 system_pods.go:61] "etcd-newest-cni-648700" [bc72b575-e874-48b5-a465-4820668e7bf8] Running / Ready:ContainersNotReady (containers with unready status: [etcd]) / ContainersReady:ContainersNotReady (containers with unready status: [etcd])

	I1216 11:46:11.598473   10820 system_pods.go:61] "kube-apiserver-newest-cni-648700" [b23f8da6-dd24-4ced-861f-f9b1869f8f98] Running / Ready:ContainersNotReady (containers with unready status: [kube-apiserver]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-apiserver])

	I1216 11:46:11.598473   10820 system_pods.go:61] "kube-controller-manager-newest-cni-648700" [a11e8d98-c4ae-4704-8386-71d90d7846d7] Running / Ready:ContainersNotReady (containers with unready status: [kube-controller-manager]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-controller-manager])

	I1216 11:46:11.598473   10820 system_pods.go:61] "kube-proxy-cg98r" [ff2cb16d-f443-4e0b-b3e9-2666db0ba150] Running

	I1216 11:46:11.598473   10820 system_pods.go:61] "kube-scheduler-newest-cni-648700" [fe314364-56a4-4bfa-b299-0cc025cd0eb0] Running / Ready:ContainersNotReady (containers with unready status: [kube-scheduler]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-scheduler])

	I1216 11:46:11.599112   10820 system_pods.go:61] "metrics-server-6867b74b74-wwdlh" [9af48c7a-41c9-4e9d-b582-edc79f04ee91] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])

	I1216 11:46:11.599317   10820 system_pods.go:61] "storage-provisioner" [120a95ba-f640-491b-8094-bfdeb9d0d66e] Running / Ready:ContainersNotReady (containers with unready status: [storage-provisioner]) / ContainersReady:ContainersNotReady (containers with unready status: [storage-provisioner])

	I1216 11:46:11.599317   10820 system_pods.go:74] duration metric: took 66.2982ms to wait for pod list to return data ...

	I1216 11:46:11.599317   10820 default_sa.go:34] waiting for default service account to be created ...

	I1216 11:46:11.609617   10820 default_sa.go:45] found service account: "default"

	I1216 11:46:11.609617   10820 default_sa.go:55] duration metric: took 10.2997ms for default service account to be created ...

	I1216 11:46:11.609745   10820 kubeadm.go:582] duration metric: took 13.2107568s to wait for: map[apiserver:true apps_running:false default_sa:true extra:false kubelet:false node_ready:false system_pods:true]

	I1216 11:46:11.609794   10820 node_conditions.go:102] verifying NodePressure condition ...

	I1216 11:46:11.680653   10820 node_conditions.go:122] node storage ephemeral capacity is 1055762868Ki

	I1216 11:46:11.680712   10820 node_conditions.go:123] node cpu capacity is 16

	I1216 11:46:11.680712   10820 node_conditions.go:105] duration metric: took 70.859ms to run NodePressure ...

	I1216 11:46:11.680712   10820 start.go:241] waiting for startup goroutines ...

	I1216 11:46:11.680712   10820 start.go:246] waiting for cluster config update ...

	I1216 11:46:11.680712   10820 start.go:255] writing updated cluster config ...

	I1216 11:46:11.703338   10820 ssh_runner.go:195] Run: rm -f paused

	I1216 11:46:11.902937   10820 start.go:600] kubectl: 1.32.0, cluster: 1.31.2 (minor skew: 1)

	I1216 11:46:11.909087   10820 out.go:177] * Done! kubectl is now configured to use "newest-cni-648700" cluster and "default" namespace by default

	I1216 11:46:10.014067    5556 pod_ready.go:103] pod "coredns-7c65d6cfc9-f2lcp" in "kube-system" namespace has status "Ready":"False"

	I1216 11:46:12.017617    5556 pod_ready.go:103] pod "coredns-7c65d6cfc9-f2lcp" in "kube-system" namespace has status "Ready":"False"

	I1216 11:46:08.555814   10008 logs.go:123] Gathering logs for kube-scheduler [5bfd011d16fd] ...

	I1216 11:46:08.555814   10008 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5bfd011d16fd"

	I1216 11:46:08.624068   10008 logs.go:123] Gathering logs for kube-proxy [58e72cba6157] ...

	I1216 11:46:08.624068   10008 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 58e72cba6157"

	I1216 11:46:08.668513   10008 logs.go:123] Gathering logs for kubernetes-dashboard [19b65a7c34eb] ...

	I1216 11:46:08.668513   10008 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 19b65a7c34eb"

	I1216 11:46:08.728466   10008 logs.go:123] Gathering logs for container status ...

	I1216 11:46:08.728466   10008 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"

	I1216 11:46:08.837554   10008 logs.go:123] Gathering logs for kube-apiserver [56bb0e9c28d2] ...

	I1216 11:46:08.837554   10008 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 56bb0e9c28d2"

	I1216 11:46:08.914386   10008 logs.go:123] Gathering logs for coredns [e314bd292ad5] ...

	I1216 11:46:08.914386   10008 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 e314bd292ad5"

	I1216 11:46:08.961957   10008 logs.go:123] Gathering logs for kube-controller-manager [d341318320dc] ...

	I1216 11:46:08.961957   10008 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d341318320dc"

	I1216 11:46:09.028247   10008 logs.go:123] Gathering logs for kube-controller-manager [268c261f4e09] ...

	I1216 11:46:09.029230   10008 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 268c261f4e09"

	I1216 11:46:09.098033   10008 logs.go:123] Gathering logs for storage-provisioner [230a8a7960d9] ...

	I1216 11:46:09.098033   10008 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 230a8a7960d9"

	I1216 11:46:09.144024   10008 logs.go:123] Gathering logs for Docker ...

	I1216 11:46:09.144024   10008 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"

	I1216 11:46:09.194035   10008 logs.go:123] Gathering logs for dmesg ...

	I1216 11:46:09.194035   10008 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"

	I1216 11:46:09.222530   10008 logs.go:123] Gathering logs for describe nodes ...

	I1216 11:46:09.222656   10008 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"

	I1216 11:46:09.476940   10008 logs.go:123] Gathering logs for storage-provisioner [2f9bdc06bf7f] ...

	I1216 11:46:09.476940   10008 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 2f9bdc06bf7f"

	I1216 11:46:09.538135   10008 out.go:358] Setting ErrFile to fd 1560...

	I1216 11:46:09.538135   10008 out.go:392] TERM=,COLORTERM=, which probably does not support color

	W1216 11:46:09.540184   10008 out.go:270] X Problems detected in kubelet:

	W1216 11:46:09.540184   10008 out.go:270]   Dec 16 11:45:38 old-k8s-version-501600 kubelet[1909]: E1216 11:45:38.892058    1909 pod_workers.go:191] Error syncing pod 37a1d62a-03f1-4e8e-bd42-ca72275d6ccb ("dashboard-metrics-scraper-8d5bb5db8-4wwm7_kubernetes-dashboard(37a1d62a-03f1-4e8e-bd42-ca72275d6ccb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""

	W1216 11:46:09.540184   10008 out.go:270]   Dec 16 11:45:44 old-k8s-version-501600 kubelet[1909]: E1216 11:45:44.890057    1909 pod_workers.go:191] Error syncing pod d2896fe7-5eeb-43d2-95d6-927aef485e51 ("metrics-server-9975d5f86-zn4gg_kube-system(d2896fe7-5eeb-43d2-95d6-927aef485e51)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1216 11:46:09.540184   10008 out.go:270]   Dec 16 11:45:49 old-k8s-version-501600 kubelet[1909]: E1216 11:45:49.888740    1909 pod_workers.go:191] Error syncing pod 37a1d62a-03f1-4e8e-bd42-ca72275d6ccb ("dashboard-metrics-scraper-8d5bb5db8-4wwm7_kubernetes-dashboard(37a1d62a-03f1-4e8e-bd42-ca72275d6ccb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""

	W1216 11:46:09.540184   10008 out.go:270]   Dec 16 11:45:56 old-k8s-version-501600 kubelet[1909]: E1216 11:45:56.890796    1909 pod_workers.go:191] Error syncing pod d2896fe7-5eeb-43d2-95d6-927aef485e51 ("metrics-server-9975d5f86-zn4gg_kube-system(d2896fe7-5eeb-43d2-95d6-927aef485e51)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1216 11:46:09.540184   10008 out.go:270]   Dec 16 11:46:01 old-k8s-version-501600 kubelet[1909]: E1216 11:46:01.889316    1909 pod_workers.go:191] Error syncing pod 37a1d62a-03f1-4e8e-bd42-ca72275d6ccb ("dashboard-metrics-scraper-8d5bb5db8-4wwm7_kubernetes-dashboard(37a1d62a-03f1-4e8e-bd42-ca72275d6ccb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""

	I1216 11:46:09.540184   10008 out.go:358] Setting ErrFile to fd 1560...

	I1216 11:46:09.540184   10008 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I1216 11:46:11.846194    5140 ssh_runner.go:195] Run: stat /opt/cni/bin/portmap

	I1216 11:46:11.992604    5140 cni.go:182] applying CNI manifest using /var/lib/minikube/binaries/v1.31.2/kubectl ...

	I1216 11:46:11.992604    5140 ssh_runner.go:362] scp memory --> /var/tmp/minikube/cni.yaml (2601 bytes)

	I1216 11:46:12.133187    5140 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.2/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml

	I1216 11:46:12.993472    5140 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"

	I1216 11:46:13.013482    5140 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes kindnet-928300 minikube.k8s.io/updated_at=2024_12_16T11_46_12_0700 minikube.k8s.io/version=v1.34.0 minikube.k8s.io/commit=22da80be3b90f71512d84256b3df4ef76bd13ff8 minikube.k8s.io/name=kindnet-928300 minikube.k8s.io/primary=true

	I1216 11:46:13.013482    5140 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.2/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig

	I1216 11:46:13.015495    5140 ops.go:34] apiserver oom_adj: -16

	I1216 11:46:13.287235    5140 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1216 11:46:13.796874    5140 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1216 11:46:14.295227    5140 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1216 11:46:14.801049    5140 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1216 11:46:15.295483    5140 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1216 11:46:15.798434    5140 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1216 11:46:14.514384    5556 pod_ready.go:93] pod "coredns-7c65d6cfc9-f2lcp" in "kube-system" namespace has status "Ready":"True"

	I1216 11:46:14.514384    5556 pod_ready.go:82] duration metric: took 29.0157843s for pod "coredns-7c65d6cfc9-f2lcp" in "kube-system" namespace to be "Ready" ...

	I1216 11:46:14.514384    5556 pod_ready.go:79] waiting up to 15m0s for pod "coredns-7c65d6cfc9-mwlvp" in "kube-system" namespace to be "Ready" ...

	I1216 11:46:14.519380    5556 pod_ready.go:98] error getting pod "coredns-7c65d6cfc9-mwlvp" in "kube-system" namespace (skipping!): pods "coredns-7c65d6cfc9-mwlvp" not found

	I1216 11:46:14.519380    5556 pod_ready.go:82] duration metric: took 4.996ms for pod "coredns-7c65d6cfc9-mwlvp" in "kube-system" namespace to be "Ready" ...

	E1216 11:46:14.519380    5556 pod_ready.go:67] WaitExtra: waitPodCondition: error getting pod "coredns-7c65d6cfc9-mwlvp" in "kube-system" namespace (skipping!): pods "coredns-7c65d6cfc9-mwlvp" not found

	I1216 11:46:14.519380    5556 pod_ready.go:79] waiting up to 15m0s for pod "etcd-auto-928300" in "kube-system" namespace to be "Ready" ...

	I1216 11:46:14.531376    5556 pod_ready.go:93] pod "etcd-auto-928300" in "kube-system" namespace has status "Ready":"True"

	I1216 11:46:14.531376    5556 pod_ready.go:82] duration metric: took 11.9951ms for pod "etcd-auto-928300" in "kube-system" namespace to be "Ready" ...

	I1216 11:46:14.531376    5556 pod_ready.go:79] waiting up to 15m0s for pod "kube-apiserver-auto-928300" in "kube-system" namespace to be "Ready" ...

	I1216 11:46:14.541383    5556 pod_ready.go:93] pod "kube-apiserver-auto-928300" in "kube-system" namespace has status "Ready":"True"

	I1216 11:46:14.541383    5556 pod_ready.go:82] duration metric: took 10.007ms for pod "kube-apiserver-auto-928300" in "kube-system" namespace to be "Ready" ...

	I1216 11:46:14.541383    5556 pod_ready.go:79] waiting up to 15m0s for pod "kube-controller-manager-auto-928300" in "kube-system" namespace to be "Ready" ...

	I1216 11:46:14.551384    5556 pod_ready.go:93] pod "kube-controller-manager-auto-928300" in "kube-system" namespace has status "Ready":"True"

	I1216 11:46:14.551384    5556 pod_ready.go:82] duration metric: took 10.0006ms for pod "kube-controller-manager-auto-928300" in "kube-system" namespace to be "Ready" ...

	I1216 11:46:14.551384    5556 pod_ready.go:79] waiting up to 15m0s for pod "kube-proxy-cdg77" in "kube-system" namespace to be "Ready" ...

	I1216 11:46:14.708381    5556 pod_ready.go:93] pod "kube-proxy-cdg77" in "kube-system" namespace has status "Ready":"True"

	I1216 11:46:14.708948    5556 pod_ready.go:82] duration metric: took 156.99ms for pod "kube-proxy-cdg77" in "kube-system" namespace to be "Ready" ...

	I1216 11:46:14.708948    5556 pod_ready.go:79] waiting up to 15m0s for pod "kube-scheduler-auto-928300" in "kube-system" namespace to be "Ready" ...

	I1216 11:46:15.108363    5556 pod_ready.go:93] pod "kube-scheduler-auto-928300" in "kube-system" namespace has status "Ready":"True"

	I1216 11:46:15.108393    5556 pod_ready.go:82] duration metric: took 399.4267ms for pod "kube-scheduler-auto-928300" in "kube-system" namespace to be "Ready" ...

	I1216 11:46:15.108393    5556 pod_ready.go:39] duration metric: took 29.6741471s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I1216 11:46:15.108393    5556 api_server.go:52] waiting for apiserver process to appear ...

	I1216 11:46:15.126699    5556 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I1216 11:46:15.157573    5556 api_server.go:72] duration metric: took 33.4714819s to wait for apiserver process to appear ...

	I1216 11:46:15.157689    5556 api_server.go:88] waiting for apiserver healthz status ...

	I1216 11:46:15.157726    5556 api_server.go:253] Checking apiserver healthz at https://127.0.0.1:53006/healthz ...

	I1216 11:46:15.172094    5556 api_server.go:279] https://127.0.0.1:53006/healthz returned 200:

	ok

	I1216 11:46:15.175605    5556 api_server.go:141] control plane version: v1.31.2

	I1216 11:46:15.175605    5556 api_server.go:131] duration metric: took 17.8776ms to wait for apiserver health ...

	I1216 11:46:15.175605    5556 system_pods.go:43] waiting for kube-system pods to appear ...

	I1216 11:46:15.316316    5556 system_pods.go:59] 7 kube-system pods found

	I1216 11:46:15.316316    5556 system_pods.go:61] "coredns-7c65d6cfc9-f2lcp" [4e7c118f-c448-411d-af40-029166c5effe] Running

	I1216 11:46:15.316316    5556 system_pods.go:61] "etcd-auto-928300" [066edaf3-4382-439a-9570-d0d62d442777] Running

	I1216 11:46:15.316316    5556 system_pods.go:61] "kube-apiserver-auto-928300" [d7f70cff-d1f2-4e64-989b-2ec1a52a0b05] Running

	I1216 11:46:15.316316    5556 system_pods.go:61] "kube-controller-manager-auto-928300" [0127533a-f823-44fa-8f49-42b19a3d9964] Running

	I1216 11:46:15.316316    5556 system_pods.go:61] "kube-proxy-cdg77" [8a8a40ff-cd36-4e1a-9d43-80b6cd255033] Running

	I1216 11:46:15.316316    5556 system_pods.go:61] "kube-scheduler-auto-928300" [e2346150-d1f6-4f99-8e2e-18077b8ec027] Running

	I1216 11:46:15.316316    5556 system_pods.go:61] "storage-provisioner" [f3d88b82-bbb6-49bd-af48-37b73c904e9d] Running

	I1216 11:46:15.316316    5556 system_pods.go:74] duration metric: took 140.7051ms to wait for pod list to return data ...

	I1216 11:46:15.316316    5556 default_sa.go:34] waiting for default service account to be created ...

	I1216 11:46:15.509478    5556 default_sa.go:45] found service account: "default"

	I1216 11:46:15.509704    5556 default_sa.go:55] duration metric: took 193.3785ms for default service account to be created ...

	I1216 11:46:15.509704    5556 system_pods.go:116] waiting for k8s-apps to be running ...

	I1216 11:46:15.712550    5556 system_pods.go:86] 7 kube-system pods found

	I1216 11:46:15.712831    5556 system_pods.go:89] "coredns-7c65d6cfc9-f2lcp" [4e7c118f-c448-411d-af40-029166c5effe] Running

	I1216 11:46:15.712906    5556 system_pods.go:89] "etcd-auto-928300" [066edaf3-4382-439a-9570-d0d62d442777] Running

	I1216 11:46:15.712906    5556 system_pods.go:89] "kube-apiserver-auto-928300" [d7f70cff-d1f2-4e64-989b-2ec1a52a0b05] Running

	I1216 11:46:15.712971    5556 system_pods.go:89] "kube-controller-manager-auto-928300" [0127533a-f823-44fa-8f49-42b19a3d9964] Running

	I1216 11:46:15.712971    5556 system_pods.go:89] "kube-proxy-cdg77" [8a8a40ff-cd36-4e1a-9d43-80b6cd255033] Running

	I1216 11:46:15.713021    5556 system_pods.go:89] "kube-scheduler-auto-928300" [e2346150-d1f6-4f99-8e2e-18077b8ec027] Running

	I1216 11:46:15.713021    5556 system_pods.go:89] "storage-provisioner" [f3d88b82-bbb6-49bd-af48-37b73c904e9d] Running

	I1216 11:46:15.713021    5556 system_pods.go:126] duration metric: took 203.3078ms to wait for k8s-apps to be running ...

	I1216 11:46:15.713079    5556 system_svc.go:44] waiting for kubelet service to be running ....

	I1216 11:46:15.728442    5556 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I1216 11:46:15.755434    5556 system_svc.go:56] duration metric: took 42.3527ms WaitForService to wait for kubelet

	I1216 11:46:15.755434    5556 kubeadm.go:582] duration metric: took 34.0693148s to wait for: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]

	I1216 11:46:15.755434    5556 node_conditions.go:102] verifying NodePressure condition ...

	I1216 11:46:15.909778    5556 node_conditions.go:122] node storage ephemeral capacity is 1055762868Ki

	I1216 11:46:15.909893    5556 node_conditions.go:123] node cpu capacity is 16

	I1216 11:46:15.909929    5556 node_conditions.go:105] duration metric: took 154.4881ms to run NodePressure ...

	I1216 11:46:15.909929    5556 start.go:241] waiting for startup goroutines ...

	I1216 11:46:15.909929    5556 start.go:246] waiting for cluster config update ...

	I1216 11:46:15.909929    5556 start.go:255] writing updated cluster config ...

	I1216 11:46:15.934051    5556 ssh_runner.go:195] Run: rm -f paused

	I1216 11:46:16.147708    5556 start.go:600] kubectl: 1.32.0, cluster: 1.31.2 (minor skew: 1)

	I1216 11:46:16.151714    5556 out.go:177] * Done! kubectl is now configured to use "auto-928300" cluster and "default" namespace by default

	I1216 11:46:16.278953    5140 kubeadm.go:1113] duration metric: took 3.2853286s to wait for elevateKubeSystemPrivileges

	I1216 11:46:16.278953    5140 kubeadm.go:394] duration metric: took 24.8673034s to StartCluster

	I1216 11:46:16.278953    5140 settings.go:142] acquiring lock: {Name:mk5d8710830d010adb6db61f855b0ef766a8622c Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1216 11:46:16.278953    5140 settings.go:150] Updating kubeconfig:  C:\Users\jenkins.minikube4\minikube-integration\kubeconfig

	I1216 11:46:16.284955    5140 lock.go:35] WriteFile acquiring C:\Users\jenkins.minikube4\minikube-integration\kubeconfig: {Name:mk97c09b788e5010ffd4c9dd9525f9245d5edd25 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1216 11:46:16.285976    5140 start.go:235] Will wait 15m0s for node &{Name: IP:192.168.103.2 Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true}

	I1216 11:46:16.286969    5140 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.31.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"

	I1216 11:46:16.286969    5140 addons.go:507] enable addons start: toEnable=map[ambassador:false amd-gpu-device-plugin:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false]

	I1216 11:46:16.286969    5140 addons.go:69] Setting storage-provisioner=true in profile "kindnet-928300"

	I1216 11:46:16.286969    5140 addons.go:234] Setting addon storage-provisioner=true in "kindnet-928300"

	I1216 11:46:16.286969    5140 host.go:66] Checking if "kindnet-928300" exists ...

	I1216 11:46:16.286969    5140 config.go:182] Loaded profile config "kindnet-928300": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.31.2

	I1216 11:46:16.286969    5140 addons.go:69] Setting default-storageclass=true in profile "kindnet-928300"

	I1216 11:46:16.286969    5140 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "kindnet-928300"

	I1216 11:46:16.290950    5140 out.go:177] * Verifying Kubernetes components...

	I1216 11:46:16.322954    5140 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I1216 11:46:16.328951    5140 cli_runner.go:164] Run: docker container inspect kindnet-928300 --format={{.State.Status}}

	I1216 11:46:16.329964    5140 cli_runner.go:164] Run: docker container inspect kindnet-928300 --format={{.State.Status}}

	I1216 11:46:16.423006    5140 out.go:177]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5

	I1216 11:46:19.541664   10008 api_server.go:253] Checking apiserver healthz at https://127.0.0.1:52658/healthz ...

	I1216 11:46:19.564355   10008 api_server.go:279] https://127.0.0.1:52658/healthz returned 200:

	ok

	I1216 11:46:19.568035   10008 out.go:201] 

	W1216 11:46:19.570426   10008 out.go:270] X Exiting due to K8S_UNHEALTHY_CONTROL_PLANE: wait 6m0s for node: wait for healthy API server: controlPlane never updated to v1.20.0

	W1216 11:46:19.570589   10008 out.go:270] * Suggestion: Control Plane could not update, try minikube delete --all --purge

	W1216 11:46:19.570733   10008 out.go:270] * Related issue: https://github.com/kubernetes/minikube/issues/11417

	W1216 11:46:19.570811   10008 out.go:270] * 

	W1216 11:46:19.572809   10008 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	I1216 11:46:19.576379   10008 out.go:201] 

	I1216 11:46:16.423006    5140 addons.go:234] Setting addon default-storageclass=true in "kindnet-928300"

	I1216 11:46:16.423961    5140 host.go:66] Checking if "kindnet-928300" exists ...

	I1216 11:46:16.424966    5140 addons.go:431] installing /etc/kubernetes/addons/storage-provisioner.yaml

	I1216 11:46:16.424966    5140 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)

	I1216 11:46:16.435987    5140 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kindnet-928300

	I1216 11:46:16.447960    5140 cli_runner.go:164] Run: docker container inspect kindnet-928300 --format={{.State.Status}}

	I1216 11:46:16.600223    5140 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:53070 SSHKeyPath:C:\Users\jenkins.minikube4\minikube-integration\.minikube\machines\kindnet-928300\id_rsa Username:docker}

	I1216 11:46:16.600223    5140 addons.go:431] installing /etc/kubernetes/addons/storageclass.yaml

	I1216 11:46:16.600223    5140 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)

	I1216 11:46:16.614218    5140 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kindnet-928300

	I1216 11:46:16.708353    5140 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:53070 SSHKeyPath:C:\Users\jenkins.minikube4\minikube-integration\.minikube\machines\kindnet-928300\id_rsa Username:docker}

	I1216 11:46:16.990374    5140 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.31.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.65.254 host.minikube.internal\n           fallthrough\n        }' -e '/^        errors *$/i \        log' | sudo /var/lib/minikube/binaries/v1.31.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"

	I1216 11:46:17.103352    5140 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.2/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml

	I1216 11:46:17.115315    5140 ssh_runner.go:195] Run: sudo systemctl start kubelet

	I1216 11:46:17.315647    5140 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.2/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml

	I1216 11:46:18.581288    5140 ssh_runner.go:235] Completed: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.31.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.65.254 host.minikube.internal\n           fallthrough\n        }' -e '/^        errors *$/i \        log' | sudo /var/lib/minikube/binaries/v1.31.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -": (1.5908399s)

	I1216 11:46:18.581288    5140 start.go:971] {"host.minikube.internal": 192.168.65.254} host record injected into CoreDNS's ConfigMap

	I1216 11:46:19.295548    5140 kapi.go:214] "coredns" deployment in "kube-system" namespace and "kindnet-928300" context rescaled to 1 replicas

	I1216 11:46:20.185654    5140 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.2/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: (3.0821579s)

	I1216 11:46:20.185654    5140 ssh_runner.go:235] Completed: sudo systemctl start kubelet: (3.070196s)

	I1216 11:46:20.186656    5140 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.2/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: (2.870875s)

	I1216 11:46:20.210679    5140 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "8443/tcp") 0).HostPort}}'" kindnet-928300

	I1216 11:46:20.311451    5140 out.go:177] * Enabled addons: storage-provisioner, default-storageclass

	I1216 11:46:20.316428    5140 addons.go:510] duration metric: took 4.0292708s for enable addons: enabled=[storage-provisioner default-storageclass]

	I1216 11:46:20.364429    5140 node_ready.go:35] waiting up to 15m0s for node "kindnet-928300" to be "Ready" ...

	I1216 11:46:20.399432    5140 node_ready.go:49] node "kindnet-928300" has status "Ready":"True"

	I1216 11:46:20.399432    5140 node_ready.go:38] duration metric: took 35.0018ms for node "kindnet-928300" to be "Ready" ...

	I1216 11:46:20.399432    5140 pod_ready.go:36] extra waiting up to 15m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I1216 11:46:20.424425    5140 pod_ready.go:79] waiting up to 15m0s for pod "coredns-7c65d6cfc9-6xpdl" in "kube-system" namespace to be "Ready" ...

	==> Docker <==

	Dec 16 11:41:14 old-k8s-version-501600 dockerd[1468]: time="2024-12-16T11:41:14.522565882Z" level=info msg="Attempting next endpoint for pull after error: [DEPRECATION NOTICE] Docker Image Format v1 and Docker Image manifest version 2, schema 1 support is disabled by default and will be removed in an upcoming release. Suggest the author of registry.k8s.io/echoserver:1.4 to upgrade the image to the OCI Format or Docker Image manifest v2, schema 2. More information at https://docs.docker.com/go/deprecated-image-specs/" spanID=69c339ecd04e9622 traceID=095ab15daba493d82df5b21bde5917c4

	Dec 16 11:41:18 old-k8s-version-501600 dockerd[1468]: time="2024-12-16T11:41:18.981648081Z" level=warning msg="Error getting v2 registry: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.65.254:53: no such host" spanID=397b7804133fb89c traceID=d8d398906c5fefd711573768ffbe8ba4

	Dec 16 11:41:18 old-k8s-version-501600 dockerd[1468]: time="2024-12-16T11:41:18.981790501Z" level=info msg="Attempting next endpoint for pull after error: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.65.254:53: no such host" spanID=397b7804133fb89c traceID=d8d398906c5fefd711573768ffbe8ba4

	Dec 16 11:41:18 old-k8s-version-501600 dockerd[1468]: time="2024-12-16T11:41:18.992069458Z" level=error msg="Handler for POST /v1.40/images/create returned error: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.65.254:53: no such host" spanID=397b7804133fb89c traceID=d8d398906c5fefd711573768ffbe8ba4

	Dec 16 11:41:37 old-k8s-version-501600 dockerd[1468]: time="2024-12-16T11:41:37.233098283Z" level=warning msg="reference for unknown type: application/vnd.docker.distribution.manifest.v1+prettyjws" digest="sha256:5d99aa1120524c801bc8c1a7077e8f5ec122ba16b6dda1a5d3826057f67b9bcb" remote="registry.k8s.io/echoserver:1.4" spanID=72eaee3bb18f6b5e traceID=c62b94eeb4ad7a8df59c00e1afb582e0

	Dec 16 11:41:37 old-k8s-version-501600 dockerd[1468]: time="2024-12-16T11:41:37.424744974Z" level=warning msg="Error persisting manifest" digest="sha256:5d99aa1120524c801bc8c1a7077e8f5ec122ba16b6dda1a5d3826057f67b9bcb" error="error committing manifest to content store: commit failed: unexpected commit digest sha256:eaee4c452b076cdb05b391ed7e75e1ad0aca136665875ab5d7e2f3d9f4675769, expected sha256:5d99aa1120524c801bc8c1a7077e8f5ec122ba16b6dda1a5d3826057f67b9bcb: failed precondition" remote="registry.k8s.io/echoserver:1.4" spanID=72eaee3bb18f6b5e traceID=c62b94eeb4ad7a8df59c00e1afb582e0

	Dec 16 11:41:37 old-k8s-version-501600 dockerd[1468]: time="2024-12-16T11:41:37.425082420Z" level=warning msg="[DEPRECATION NOTICE] Docker Image Format v1 and Docker Image manifest version 2, schema 1 support is disabled by default and will be removed in an upcoming release. Suggest the author of registry.k8s.io/echoserver:1.4 to upgrade the image to the OCI Format or Docker Image manifest v2, schema 2. More information at https://docs.docker.com/go/deprecated-image-specs/" digest="sha256:5d99aa1120524c801bc8c1a7077e8f5ec122ba16b6dda1a5d3826057f67b9bcb" remote="registry.k8s.io/echoserver:1.4" spanID=72eaee3bb18f6b5e traceID=c62b94eeb4ad7a8df59c00e1afb582e0

	Dec 16 11:41:37 old-k8s-version-501600 dockerd[1468]: time="2024-12-16T11:41:37.425147329Z" level=info msg="Attempting next endpoint for pull after error: [DEPRECATION NOTICE] Docker Image Format v1 and Docker Image manifest version 2, schema 1 support is disabled by default and will be removed in an upcoming release. Suggest the author of registry.k8s.io/echoserver:1.4 to upgrade the image to the OCI Format or Docker Image manifest v2, schema 2. More information at https://docs.docker.com/go/deprecated-image-specs/" spanID=72eaee3bb18f6b5e traceID=c62b94eeb4ad7a8df59c00e1afb582e0

	Dec 16 11:42:06 old-k8s-version-501600 dockerd[1468]: time="2024-12-16T11:42:06.946581545Z" level=warning msg="Error getting v2 registry: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.65.254:53: no such host" spanID=97cec1ec92687953 traceID=89bcba6731bfd1d604f2c892a4668c68

	Dec 16 11:42:06 old-k8s-version-501600 dockerd[1468]: time="2024-12-16T11:42:06.946873881Z" level=info msg="Attempting next endpoint for pull after error: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.65.254:53: no such host" spanID=97cec1ec92687953 traceID=89bcba6731bfd1d604f2c892a4668c68

	Dec 16 11:42:06 old-k8s-version-501600 dockerd[1468]: time="2024-12-16T11:42:06.958873833Z" level=error msg="Handler for POST /v1.40/images/create returned error: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.65.254:53: no such host" spanID=97cec1ec92687953 traceID=89bcba6731bfd1d604f2c892a4668c68

	Dec 16 11:42:23 old-k8s-version-501600 dockerd[1468]: time="2024-12-16T11:42:23.178230429Z" level=warning msg="reference for unknown type: application/vnd.docker.distribution.manifest.v1+prettyjws" digest="sha256:5d99aa1120524c801bc8c1a7077e8f5ec122ba16b6dda1a5d3826057f67b9bcb" remote="registry.k8s.io/echoserver:1.4" spanID=c2bd82bb934ff820 traceID=527595d7b60eb60adf240628f352df36

	Dec 16 11:42:23 old-k8s-version-501600 dockerd[1468]: time="2024-12-16T11:42:23.380645177Z" level=warning msg="Error persisting manifest" digest="sha256:5d99aa1120524c801bc8c1a7077e8f5ec122ba16b6dda1a5d3826057f67b9bcb" error="error committing manifest to content store: commit failed: unexpected commit digest sha256:eaee4c452b076cdb05b391ed7e75e1ad0aca136665875ab5d7e2f3d9f4675769, expected sha256:5d99aa1120524c801bc8c1a7077e8f5ec122ba16b6dda1a5d3826057f67b9bcb: failed precondition" remote="registry.k8s.io/echoserver:1.4" spanID=c2bd82bb934ff820 traceID=527595d7b60eb60adf240628f352df36

	Dec 16 11:42:23 old-k8s-version-501600 dockerd[1468]: time="2024-12-16T11:42:23.380947730Z" level=warning msg="[DEPRECATION NOTICE] Docker Image Format v1 and Docker Image manifest version 2, schema 1 support is disabled by default and will be removed in an upcoming release. Suggest the author of registry.k8s.io/echoserver:1.4 to upgrade the image to the OCI Format or Docker Image manifest v2, schema 2. More information at https://docs.docker.com/go/deprecated-image-specs/" digest="sha256:5d99aa1120524c801bc8c1a7077e8f5ec122ba16b6dda1a5d3826057f67b9bcb" remote="registry.k8s.io/echoserver:1.4" spanID=c2bd82bb934ff820 traceID=527595d7b60eb60adf240628f352df36

	Dec 16 11:42:23 old-k8s-version-501600 dockerd[1468]: time="2024-12-16T11:42:23.381073652Z" level=info msg="Attempting next endpoint for pull after error: [DEPRECATION NOTICE] Docker Image Format v1 and Docker Image manifest version 2, schema 1 support is disabled by default and will be removed in an upcoming release. Suggest the author of registry.k8s.io/echoserver:1.4 to upgrade the image to the OCI Format or Docker Image manifest v2, schema 2. More information at https://docs.docker.com/go/deprecated-image-specs/" spanID=c2bd82bb934ff820 traceID=527595d7b60eb60adf240628f352df36

	Dec 16 11:43:36 old-k8s-version-501600 dockerd[1468]: time="2024-12-16T11:43:36.945427441Z" level=warning msg="Error getting v2 registry: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.65.254:53: no such host" spanID=8abb6a2b99d26cfe traceID=458dc35e6c041ccf7b61a076ea7a93bb

	Dec 16 11:43:36 old-k8s-version-501600 dockerd[1468]: time="2024-12-16T11:43:36.945568158Z" level=info msg="Attempting next endpoint for pull after error: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.65.254:53: no such host" spanID=8abb6a2b99d26cfe traceID=458dc35e6c041ccf7b61a076ea7a93bb

	Dec 16 11:43:36 old-k8s-version-501600 dockerd[1468]: time="2024-12-16T11:43:36.955046472Z" level=error msg="Handler for POST /v1.40/images/create returned error: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.65.254:53: no such host" spanID=8abb6a2b99d26cfe traceID=458dc35e6c041ccf7b61a076ea7a93bb

	Dec 16 11:43:48 old-k8s-version-501600 dockerd[1468]: time="2024-12-16T11:43:48.162182600Z" level=warning msg="reference for unknown type: application/vnd.docker.distribution.manifest.v1+prettyjws" digest="sha256:5d99aa1120524c801bc8c1a7077e8f5ec122ba16b6dda1a5d3826057f67b9bcb" remote="registry.k8s.io/echoserver:1.4" spanID=aada4228087e045b traceID=331c80c252e84ab1666e1dd4cb8549f5

	Dec 16 11:43:48 old-k8s-version-501600 dockerd[1468]: time="2024-12-16T11:43:48.373646426Z" level=warning msg="Error persisting manifest" digest="sha256:5d99aa1120524c801bc8c1a7077e8f5ec122ba16b6dda1a5d3826057f67b9bcb" error="error committing manifest to content store: commit failed: unexpected commit digest sha256:eaee4c452b076cdb05b391ed7e75e1ad0aca136665875ab5d7e2f3d9f4675769, expected sha256:5d99aa1120524c801bc8c1a7077e8f5ec122ba16b6dda1a5d3826057f67b9bcb: failed precondition" remote="registry.k8s.io/echoserver:1.4" spanID=aada4228087e045b traceID=331c80c252e84ab1666e1dd4cb8549f5

	Dec 16 11:43:48 old-k8s-version-501600 dockerd[1468]: time="2024-12-16T11:43:48.373898062Z" level=warning msg="[DEPRECATION NOTICE] Docker Image Format v1 and Docker Image manifest version 2, schema 1 support is disabled by default and will be removed in an upcoming release. Suggest the author of registry.k8s.io/echoserver:1.4 to upgrade the image to the OCI Format or Docker Image manifest v2, schema 2. More information at https://docs.docker.com/go/deprecated-image-specs/" digest="sha256:5d99aa1120524c801bc8c1a7077e8f5ec122ba16b6dda1a5d3826057f67b9bcb" remote="registry.k8s.io/echoserver:1.4" spanID=aada4228087e045b traceID=331c80c252e84ab1666e1dd4cb8549f5

	Dec 16 11:43:48 old-k8s-version-501600 dockerd[1468]: time="2024-12-16T11:43:48.373959471Z" level=info msg="Attempting next endpoint for pull after error: [DEPRECATION NOTICE] Docker Image Format v1 and Docker Image manifest version 2, schema 1 support is disabled by default and will be removed in an upcoming release. Suggest the author of registry.k8s.io/echoserver:1.4 to upgrade the image to the OCI Format or Docker Image manifest v2, schema 2. More information at https://docs.docker.com/go/deprecated-image-specs/" spanID=aada4228087e045b traceID=331c80c252e84ab1666e1dd4cb8549f5

	Dec 16 11:46:23 old-k8s-version-501600 dockerd[1468]: time="2024-12-16T11:46:23.941641547Z" level=warning msg="Error getting v2 registry: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.65.254:53: no such host" spanID=84c5f153e4f4bdbe traceID=37eda2824f0924100e2a98eadc74c3e9

	Dec 16 11:46:23 old-k8s-version-501600 dockerd[1468]: time="2024-12-16T11:46:23.941937888Z" level=info msg="Attempting next endpoint for pull after error: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.65.254:53: no such host" spanID=84c5f153e4f4bdbe traceID=37eda2824f0924100e2a98eadc74c3e9

	Dec 16 11:46:23 old-k8s-version-501600 dockerd[1468]: time="2024-12-16T11:46:23.956964095Z" level=error msg="Handler for POST /v1.40/images/create returned error: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.65.254:53: no such host" spanID=84c5f153e4f4bdbe traceID=37eda2824f0924100e2a98eadc74c3e9

	==> container status <==

	CONTAINER           IMAGE                                                                                                 CREATED             STATE               NAME                      ATTEMPT             POD ID              POD

	19b65a7c34eb1       kubernetesui/dashboard@sha256:2e500d29e9d5f4a086b908eb8dfe7ecac57d2ab09d65b24f588b1d449841ef93        5 minutes ago       Running             kubernetes-dashboard      0                   6f987732fdf04       kubernetes-dashboard-cd95d586-9kbg8

	230a8a7960d90       6e38f40d628db                                                                                         5 minutes ago       Running             storage-provisioner       2                   6ed06caaf86bc       storage-provisioner

	e314bd292ad5d       bfe3a36ebd252                                                                                         5 minutes ago       Running             coredns                   1                   77166b83947d2       coredns-74ff55c5b-9fdb9

	9e2a57a377579       56cc512116c8f                                                                                         5 minutes ago       Running             busybox                   1                   d87afc4776cdb       busybox

	2f9bdc06bf7f1       6e38f40d628db                                                                                         5 minutes ago       Exited              storage-provisioner       1                   6ed06caaf86bc       storage-provisioner

	58e72cba6157f       10cc881966cfd                                                                                         5 minutes ago       Running             kube-proxy                1                   1f8edc5027f87       kube-proxy-j2ct6

	56bb0e9c28d2a       ca9843d3b5454                                                                                         6 minutes ago       Running             kube-apiserver            1                   d74e0b88243fc       kube-apiserver-old-k8s-version-501600

	d341318320dcd       b9fa1895dcaa6                                                                                         6 minutes ago       Running             kube-controller-manager   1                   cf6a722e9bbbf       kube-controller-manager-old-k8s-version-501600

	8ddd1a91749ab       3138b6e3d4712                                                                                         6 minutes ago       Running             kube-scheduler            1                   8f57a8d5710df       kube-scheduler-old-k8s-version-501600

	fd156a045ffd7       0369cf4303ffd                                                                                         6 minutes ago       Running             etcd                      1                   853bff2d8b001       etcd-old-k8s-version-501600

	c320ee5a89dae       gcr.io/k8s-minikube/busybox@sha256:2d03e6ceeb99250061dd110530b0ece7998cd84121f952adef120ea7c5a6f00e   7 minutes ago       Exited              busybox                   0                   f8ca164af6366       busybox

	219798af5c41d       bfe3a36ebd252                                                                                         8 minutes ago       Exited              coredns                   0                   22bd0923e047e       coredns-74ff55c5b-9fdb9

	8cce9bacca4b7       10cc881966cfd                                                                                         8 minutes ago       Exited              kube-proxy                0                   c19a4630080e0       kube-proxy-j2ct6

	7ddd764ff8e38       ca9843d3b5454                                                                                         8 minutes ago       Exited              kube-apiserver            0                   ea7584bb1e493       kube-apiserver-old-k8s-version-501600

	268c261f4e09e       b9fa1895dcaa6                                                                                         8 minutes ago       Exited              kube-controller-manager   0                   256fca36edea2       kube-controller-manager-old-k8s-version-501600

	5bfd011d16fd4       3138b6e3d4712                                                                                         8 minutes ago       Exited              kube-scheduler            0                   4c54d4ccce6dc       kube-scheduler-old-k8s-version-501600

	25fc9ee43f0a1       0369cf4303ffd                                                                                         8 minutes ago       Exited              etcd                      0                   68889489617c7       etcd-old-k8s-version-501600

	==> coredns [219798af5c41] <==

	.:53

	[INFO] plugin/reload: Running configuration MD5 = db32ca3650231d74073ff4cf814959a7

	CoreDNS-1.7.0

	linux/amd64, go1.14.4, f59c03d

	[INFO] Reloading

	[INFO] plugin/health: Going into lameduck mode for 5s

	[INFO] plugin/reload: Running configuration MD5 = 512bc0e06a520fa44f35dc15de10fdd6

	[INFO] Reloading complete

	[INFO] SIGTERM: Shutting down servers then terminating

	[INFO] plugin/health: Going into lameduck mode for 5s

	E1216 11:39:25.515761       1 reflector.go:382] pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125: Failed to watch *v1.Namespace: Get "https://10.96.0.1:443/api/v1/namespaces?allowWatchBookmarks=true&resourceVersion=207&timeout=9m4s&timeoutSeconds=544&watch=true": dial tcp 10.96.0.1:443: connect: connection refused

	E1216 11:39:25.515877       1 reflector.go:382] pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125: Failed to watch *v1.Service: Get "https://10.96.0.1:443/api/v1/services?allowWatchBookmarks=true&resourceVersion=556&timeout=6m4s&timeoutSeconds=364&watch=true": dial tcp 10.96.0.1:443: connect: connection refused

	E1216 11:39:25.515918       1 reflector.go:382] pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125: Failed to watch *v1.Endpoints: Get "https://10.96.0.1:443/api/v1/endpoints?allowWatchBookmarks=true&resourceVersion=558&timeout=6m54s&timeoutSeconds=414&watch=true": dial tcp 10.96.0.1:443: connect: connection refused

	==> coredns [e314bd292ad5] <==

	.:53

	[INFO] plugin/reload: Running configuration MD5 = 512bc0e06a520fa44f35dc15de10fdd6

	CoreDNS-1.7.0

	linux/amd64, go1.14.4, f59c03d

	[INFO] 127.0.0.1:36809 - 5228 "HINFO IN 7684202964903450488.3295720211783763393. udp 57 false 512" NXDOMAIN qr,rd,ra 57 0.037260266s

	[INFO] plugin/ready: Still waiting on: "kubernetes"

	[INFO] plugin/ready: Still waiting on: "kubernetes"

	I1216 11:40:58.746418       1 trace.go:116] Trace[2019727887]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125 (started: 2024-12-16 11:40:37.711752164 +0000 UTC m=+0.200523543) (total time: 21.034438316s):

	Trace[2019727887]: [21.034438316s] [21.034438316s] END

	I1216 11:40:58.746555       1 trace.go:116] Trace[939984059]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125 (started: 2024-12-16 11:40:37.711788169 +0000 UTC m=+0.200559548) (total time: 21.03473886s):

	Trace[939984059]: [21.03473886s] [21.03473886s] END

	E1216 11:40:58.746589       1 reflector.go:178] pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125: Failed to list *v1.Endpoints: Get "https://10.96.0.1:443/api/v1/endpoints?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: connect: connection refused

	E1216 11:40:58.746646       1 reflector.go:178] pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125: Failed to list *v1.Namespace: Get "https://10.96.0.1:443/api/v1/namespaces?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: connect: connection refused

	I1216 11:40:58.746463       1 trace.go:116] Trace[1427131847]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125 (started: 2024-12-16 11:40:37.712013501 +0000 UTC m=+0.200784880) (total time: 21.03439301s):

	Trace[1427131847]: [21.03439301s] [21.03439301s] END

	E1216 11:40:58.746675       1 reflector.go:178] pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125: Failed to list *v1.Service: Get "https://10.96.0.1:443/api/v1/services?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: connect: connection refused

	==> describe nodes <==

	Name:               old-k8s-version-501600

	Roles:              control-plane,master

	Labels:             beta.kubernetes.io/arch=amd64

	                    beta.kubernetes.io/os=linux

	                    kubernetes.io/arch=amd64

	                    kubernetes.io/hostname=old-k8s-version-501600

	                    kubernetes.io/os=linux

	                    minikube.k8s.io/commit=22da80be3b90f71512d84256b3df4ef76bd13ff8

	                    minikube.k8s.io/name=old-k8s-version-501600

	                    minikube.k8s.io/primary=true

	                    minikube.k8s.io/updated_at=2024_12_16T11_37_56_0700

	                    minikube.k8s.io/version=v1.34.0

	                    node-role.kubernetes.io/control-plane=

	                    node-role.kubernetes.io/master=

	Annotations:        kubeadm.alpha.kubernetes.io/cri-socket: /var/run/dockershim.sock

	                    node.alpha.kubernetes.io/ttl: 0

	                    volumes.kubernetes.io/controller-managed-attach-detach: true

	CreationTimestamp:  Mon, 16 Dec 2024 11:37:49 +0000

	Taints:             <none>

	Unschedulable:      false

	Lease:

	  HolderIdentity:  old-k8s-version-501600

	  AcquireTime:     <unset>

	  RenewTime:       Mon, 16 Dec 2024 11:46:22 +0000

	Conditions:

	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message

	  ----             ------  -----------------                 ------------------                ------                       -------

	  MemoryPressure   False   Mon, 16 Dec 2024 11:46:23 +0000   Mon, 16 Dec 2024 11:37:41 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available

	  DiskPressure     False   Mon, 16 Dec 2024 11:46:23 +0000   Mon, 16 Dec 2024 11:37:41 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure

	  PIDPressure      False   Mon, 16 Dec 2024 11:46:23 +0000   Mon, 16 Dec 2024 11:37:41 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available

	  Ready            True    Mon, 16 Dec 2024 11:46:23 +0000   Mon, 16 Dec 2024 11:38:08 +0000   KubeletReady                 kubelet is posting ready status

	Addresses:

	  InternalIP:  192.168.94.2

	  Hostname:    old-k8s-version-501600

	Capacity:

	  cpu:                16

	  ephemeral-storage:  1055762868Ki

	  hugepages-1Gi:      0

	  hugepages-2Mi:      0

	  memory:             32868688Ki

	  pods:               110

	Allocatable:

	  cpu:                16

	  ephemeral-storage:  1055762868Ki

	  hugepages-1Gi:      0

	  hugepages-2Mi:      0

	  memory:             32868688Ki

	  pods:               110

	System Info:

	  Machine ID:                 d55a52f37dde4699a010db2acf6754b4

	  System UUID:                d55a52f37dde4699a010db2acf6754b4

	  Boot ID:                    98a2616d-0d72-4a6b-b82c-595db0d53963

	  Kernel Version:             5.15.153.1-microsoft-standard-WSL2

	  OS Image:                   Ubuntu 22.04.5 LTS

	  Operating System:           linux

	  Architecture:               amd64

	  Container Runtime Version:  docker://27.4.0

	  Kubelet Version:            v1.20.0

	  Kube-Proxy Version:         v1.20.0

	PodCIDR:                      10.244.0.0/24

	PodCIDRs:                     10.244.0.0/24

	Non-terminated Pods:          (11 in total)

	  Namespace                   Name                                              CPU Requests  CPU Limits  Memory Requests  Memory Limits  AGE

	  ---------                   ----                                              ------------  ----------  ---------------  -------------  ---

	  default                     busybox                                           0 (0%)        0 (0%)      0 (0%)           0 (0%)         7m15s

	  kube-system                 coredns-74ff55c5b-9fdb9                           100m (0%)     0 (0%)      70Mi (0%)        170Mi (0%)     8m14s

	  kube-system                 etcd-old-k8s-version-501600                       100m (0%)     0 (0%)      100Mi (0%)       0 (0%)         8m27s

	  kube-system                 kube-apiserver-old-k8s-version-501600             250m (1%)     0 (0%)      0 (0%)           0 (0%)         8m27s

	  kube-system                 kube-controller-manager-old-k8s-version-501600    200m (1%)     0 (0%)      0 (0%)           0 (0%)         8m27s

	  kube-system                 kube-proxy-j2ct6                                  0 (0%)        0 (0%)      0 (0%)           0 (0%)         8m13s

	  kube-system                 kube-scheduler-old-k8s-version-501600             100m (0%)     0 (0%)      0 (0%)           0 (0%)         8m27s

	  kube-system                 metrics-server-9975d5f86-zn4gg                    100m (0%)     0 (0%)      200Mi (0%)       0 (0%)         7m1s

	  kube-system                 storage-provisioner                               0 (0%)        0 (0%)      0 (0%)           0 (0%)         8m9s

	  kubernetes-dashboard        dashboard-metrics-scraper-8d5bb5db8-4wwm7         0 (0%)        0 (0%)      0 (0%)           0 (0%)         5m34s

	  kubernetes-dashboard        kubernetes-dashboard-cd95d586-9kbg8               0 (0%)        0 (0%)      0 (0%)           0 (0%)         5m34s

	Allocated resources:

	  (Total limits may be over 100 percent, i.e., overcommitted.)

	  Resource           Requests    Limits

	  --------           --------    ------

	  cpu                850m (5%)   0 (0%)

	  memory             370Mi (1%)  170Mi (0%)

	  ephemeral-storage  100Mi (0%)  0 (0%)

	  hugepages-1Gi      0 (0%)      0 (0%)

	  hugepages-2Mi      0 (0%)      0 (0%)

	Events:

	  Type    Reason                   Age                    From        Message

	  ----    ------                   ----                   ----        -------

	  Normal  NodeHasSufficientMemory  8m47s (x6 over 8m48s)  kubelet     Node old-k8s-version-501600 status is now: NodeHasSufficientMemory

	  Normal  NodeHasNoDiskPressure    8m47s (x6 over 8m48s)  kubelet     Node old-k8s-version-501600 status is now: NodeHasNoDiskPressure

	  Normal  NodeHasSufficientPID     8m47s (x6 over 8m48s)  kubelet     Node old-k8s-version-501600 status is now: NodeHasSufficientPID

	  Normal  Starting                 8m28s                  kubelet     Starting kubelet.

	  Normal  NodeHasSufficientMemory  8m28s                  kubelet     Node old-k8s-version-501600 status is now: NodeHasSufficientMemory

	  Normal  NodeHasNoDiskPressure    8m28s                  kubelet     Node old-k8s-version-501600 status is now: NodeHasNoDiskPressure

	  Normal  NodeHasSufficientPID     8m28s                  kubelet     Node old-k8s-version-501600 status is now: NodeHasSufficientPID

	  Normal  NodeAllocatableEnforced  8m27s                  kubelet     Updated Node Allocatable limit across pods

	  Normal  NodeReady                8m17s                  kubelet     Node old-k8s-version-501600 status is now: NodeReady

	  Normal  Starting                 8m9s                   kube-proxy  Starting kube-proxy.

	  Normal  Starting                 6m9s                   kubelet     Starting kubelet.

	  Normal  NodeHasSufficientMemory  6m8s (x8 over 6m8s)    kubelet     Node old-k8s-version-501600 status is now: NodeHasSufficientMemory

	  Normal  NodeHasNoDiskPressure    6m8s (x8 over 6m8s)    kubelet     Node old-k8s-version-501600 status is now: NodeHasNoDiskPressure

	  Normal  NodeHasSufficientPID     6m8s (x7 over 6m8s)    kubelet     Node old-k8s-version-501600 status is now: NodeHasSufficientPID

	  Normal  NodeAllocatableEnforced  6m8s                   kubelet     Updated Node Allocatable limit across pods

	  Normal  Starting                 5m48s                  kube-proxy  Starting kube-proxy.

	==> dmesg <==

	[ +11.521660] tmpfs: Unknown parameter 'noswap'

	[ +10.345541] tmpfs: Unknown parameter 'noswap'

	[  +1.262060] tmpfs: Unknown parameter 'noswap'

	[Dec16 11:35] tmpfs: Unknown parameter 'noswap'

	[  +0.192791] tmpfs: Unknown parameter 'noswap'

	[Dec16 11:36] tmpfs: Unknown parameter 'noswap'

	[  +8.400905] tmpfs: Unknown parameter 'noswap'

	[  +9.325765] tmpfs: Unknown parameter 'noswap'

	[Dec16 11:37] tmpfs: Unknown parameter 'noswap'

	[ +18.712657] tmpfs: Unknown parameter 'noswap'

	[ +10.800446] tmpfs: Unknown parameter 'noswap'

	[Dec16 11:38] tmpfs: Unknown parameter 'noswap'

	[ +16.408601] tmpfs: Unknown parameter 'noswap'

	[Dec16 11:39] tmpfs: Unknown parameter 'noswap'

	[Dec16 11:43] tmpfs: Unknown parameter 'noswap'

	[ +14.032124] tmpfs: Unknown parameter 'noswap'

	[Dec16 11:44] tmpfs: Unknown parameter 'noswap'

	[  +3.107344] tmpfs: Unknown parameter 'noswap'

	[ +12.113081] tmpfs: Unknown parameter 'noswap'

	[  +1.363462] tmpfs: Unknown parameter 'noswap'

	[ +16.898402] tmpfs: Unknown parameter 'noswap'

	[ +20.153523] tmpfs: Unknown parameter 'noswap'

	[Dec16 11:45] tmpfs: Unknown parameter 'noswap'

	[ +11.868545] tmpfs: Unknown parameter 'noswap'

	[  +8.856219] tmpfs: Unknown parameter 'noswap'

	==> etcd [25fc9ee43f0a] <==

	2024-12-16 11:37:58.506072 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2024-12-16 11:38:04.755724 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2024-12-16 11:38:12.034704 W | etcdserver: read-only range request "key:\"/registry/deployments/kube-system/coredns\" " with result "range_response_count:1 size:3575" took too long (102.851364ms) to execute

	2024-12-16 11:38:12.120724 W | etcdserver: read-only range request "key:\"/registry/serviceaccounts/kube-node-lease/default\" " with result "range_response_count:1 size:189" took too long (188.625525ms) to execute

	2024-12-16 11:38:12.235897 W | etcdserver: read-only range request "key:\"/registry/replicasets/kube-system/coredns-74ff55c5b\" " with result "range_response_count:1 size:3672" took too long (113.249326ms) to execute

	2024-12-16 11:38:12.235960 W | etcdserver: read-only range request "key:\"/registry/clusterroles/edit\" " with result "range_response_count:1 size:3252" took too long (189.363029ms) to execute

	2024-12-16 11:38:12.236080 W | etcdserver: read-only range request "key:\"/registry/services/endpoints/kube-system/kube-dns\" " with result "range_response_count:1 size:611" took too long (113.444953ms) to execute

	2024-12-16 11:38:12.236228 W | etcdserver: read-only range request "key:\"/registry/endpointslices/kube-system/kube-dns-gc8jb\" " with result "range_response_count:1 size:1018" took too long (194.710881ms) to execute

	2024-12-16 11:38:12.236575 W | etcdserver: read-only range request "key:\"/registry/serviceaccounts/default/default\" " with result "range_response_count:1 size:173" took too long (117.223984ms) to execute

	2024-12-16 11:38:12.237729 W | etcdserver: read-only range request "key:\"/registry/events/kube-system/coredns-74ff55c5b-9fdb9.1811a54f6043ac62\" " with result "range_response_count:1 size:826" took too long (118.533868ms) to execute

	2024-12-16 11:38:12.245565 W | etcdserver: read-only range request "key:\"/registry/clusterroles/admin\" " with result "range_response_count:1 size:2109" took too long (126.387373ms) to execute

	2024-12-16 11:38:12.629415 W | etcdserver: request "header:<ID:6571758799646512595 username:\"kube-apiserver-etcd-client\" auth_revision:1 > txn:<compare:<target:MOD key:\"/registry/serviceaccounts/kube-system/default\" mod_revision:396 > success:<request_put:<key:\"/registry/serviceaccounts/kube-system/default\" value_size:149 >> failure:<request_range:<key:\"/registry/serviceaccounts/kube-system/default\" > >>" with result "size:16" took too long (110.00767ms) to execute

	2024-12-16 11:38:12.630449 W | etcdserver: read-only range request "key:\"/registry/daemonsets/kube-system/kube-proxy\" " with result "range_response_count:1 size:2949" took too long (105.53004ms) to execute

	2024-12-16 11:38:12.630584 W | etcdserver: read-only range request "key:\"/registry/minions/old-k8s-version-501600\" " with result "range_response_count:1 size:5241" took too long (105.585748ms) to execute

	2024-12-16 11:38:14.824879 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2024-12-16 11:38:15.219898 W | etcdserver: read-only range request "key:\"/registry/pods/kube-system/coredns-74ff55c5b-9fdb9\" " with result "range_response_count:1 size:3727" took too long (184.886138ms) to execute

	2024-12-16 11:38:24.756573 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2024-12-16 11:38:34.758056 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2024-12-16 11:38:44.750206 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2024-12-16 11:38:54.750810 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2024-12-16 11:39:04.757419 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2024-12-16 11:39:14.750522 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2024-12-16 11:39:24.751038 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2024-12-16 11:39:25.514972 N | pkg/osutil: received terminated signal, shutting down...

	2024-12-16 11:39:25.531655 I | etcdserver: skipped leadership transfer for single voting member cluster

	==> etcd [fd156a045ffd] <==

	2024-12-16 11:44:21.954257 W | etcdserver: read-only range request "key:\"/registry/pods/kube-system/metrics-server-9975d5f86-zn4gg\" " with result "range_response_count:1 size:4052" took too long (187.945193ms) to execute

	2024-12-16 11:44:22.087952 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2024-12-16 11:44:32.506759 W | etcdserver: request "header:<ID:6571758799687659938 username:\"kube-apiserver-etcd-client\" auth_revision:1 > txn:<compare:<target:MOD key:\"/registry/leases/kube-node-lease/old-k8s-version-501600\" mod_revision:943 > success:<request_put:<key:\"/registry/leases/kube-node-lease/old-k8s-version-501600\" value_size:578 >> failure:<request_range:<key:\"/registry/leases/kube-node-lease/old-k8s-version-501600\" > >>" with result "size:16" took too long (306.553812ms) to execute

	2024-12-16 11:44:32.507157 W | etcdserver: read-only range request "key:\"/registry/leases/\" range_end:\"/registry/leases0\" count_only:true " with result "range_response_count:0 size:7" took too long (493.728977ms) to execute

	2024-12-16 11:44:32.507180 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2024-12-16 11:44:32.507196 W | etcdserver: read-only range request "key:\"/registry/namespaces/kube-system\" " with result "range_response_count:1 size:263" took too long (468.78107ms) to execute

	2024-12-16 11:44:32.507228 W | etcdserver: read-only range request "key:\"/registry/pods/kube-system/metrics-server-9975d5f86-zn4gg\" " with result "range_response_count:1 size:4052" took too long (290.905701ms) to execute

	2024-12-16 11:44:33.020522 W | etcdserver: read-only range request "key:\"/registry/pods/kube-system/metrics-server-9975d5f86-zn4gg\" " with result "range_response_count:1 size:4052" took too long (301.519966ms) to execute

	2024-12-16 11:44:42.083205 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2024-12-16 11:44:43.103343 W | etcdserver: read-only range request "key:\"/registry/pods/kube-system/metrics-server-9975d5f86-zn4gg\" " with result "range_response_count:1 size:4052" took too long (376.660955ms) to execute

	2024-12-16 11:44:44.355894 W | etcdserver: read-only range request "key:\"/registry/pods/kube-system/metrics-server-9975d5f86-zn4gg\" " with result "range_response_count:1 size:4052" took too long (139.138944ms) to execute

	2024-12-16 11:44:52.083443 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2024-12-16 11:45:02.083021 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2024-12-16 11:45:12.081612 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2024-12-16 11:45:22.080904 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2024-12-16 11:45:22.677970 W | etcdserver: read-only range request "key:\"/registry/health\" " with result "range_response_count:0 size:5" took too long (197.616591ms) to execute

	2024-12-16 11:45:22.678235 W | etcdserver: request "header:<ID:6571758799687660357 username:\"kube-apiserver-etcd-client\" auth_revision:1 > txn:<compare:<target:MOD key:\"/registry/leases/kube-node-lease/old-k8s-version-501600\" mod_revision:978 > success:<request_put:<key:\"/registry/leases/kube-node-lease/old-k8s-version-501600\" value_size:578 >> failure:<request_range:<key:\"/registry/leases/kube-node-lease/old-k8s-version-501600\" > >>" with result "size:16" took too long (113.677014ms) to execute

	2024-12-16 11:45:26.724978 W | etcdserver: read-only range request "key:\"/registry/health\" " with result "range_response_count:0 size:5" took too long (233.536077ms) to execute

	2024-12-16 11:45:27.024814 W | etcdserver: read-only range request "key:\"/registry/services/endpoints/default/kubernetes\" " with result "range_response_count:1 size:420" took too long (108.180091ms) to execute

	2024-12-16 11:45:32.085635 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2024-12-16 11:45:42.077872 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2024-12-16 11:45:52.077881 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2024-12-16 11:46:02.077696 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2024-12-16 11:46:12.077513 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2024-12-16 11:46:22.075191 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	==> kernel <==

	 11:46:25 up 4 days, 15:04,  0 users,  load average: 11.03, 7.36, 5.97

	Linux old-k8s-version-501600 5.15.153.1-microsoft-standard-WSL2 #1 SMP Fri Mar 29 23:14:13 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux

	PRETTY_NAME="Ubuntu 22.04.5 LTS"

	==> kube-apiserver [56bb0e9c28d2] <==

	I1216 11:44:20.561166       1 trace.go:205] Trace[2069510462]: "Get" url:/api/v1/namespaces/kube-system/pods/metrics-server-9975d5f86-zn4gg,user-agent:minikube-windows-amd64.exe/v0.0.0 (windows/amd64) kubernetes/$Format,client:192.168.94.1 (16-Dec-2024 11:44:19.714) (total time: 846ms):

	Trace[2069510462]: ---"About to write a response" 845ms (11:44:00.560)

	Trace[2069510462]: [846.426067ms] [846.426067ms] END

	I1216 11:44:21.621515       1 client.go:360] parsed scheme: "passthrough"

	I1216 11:44:21.621644       1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379  <nil> 0 <nil>}] <nil> <nil>}

	I1216 11:44:21.621657       1 clientconn.go:948] ClientConn switching balancer to "pick_first"

	I1216 11:44:32.507711       1 trace.go:205] Trace[316849025]: "GuaranteedUpdate etcd3" type:*coordination.Lease (16-Dec-2024 11:44:31.909) (total time: 598ms):

	Trace[316849025]: ---"Transaction committed" 597ms (11:44:00.507)

	Trace[316849025]: [598.504048ms] [598.504048ms] END

	I1216 11:44:32.508188       1 trace.go:205] Trace[1438972545]: "Update" url:/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/old-k8s-version-501600,user-agent:kubelet/v1.20.0 (linux/amd64) kubernetes/af46c47,client:192.168.94.2 (16-Dec-2024 11:44:31.908) (total time: 599ms):

	Trace[1438972545]: ---"Object stored in database" 598ms (11:44:00.507)

	Trace[1438972545]: [599.29865ms] [599.29865ms] END

	I1216 11:45:05.612699       1 client.go:360] parsed scheme: "passthrough"

	I1216 11:45:05.612843       1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379  <nil> 0 <nil>}] <nil> <nil>}

	I1216 11:45:05.612855       1 clientconn.go:948] ClientConn switching balancer to "pick_first"

	W1216 11:45:31.395469       1 handler_proxy.go:102] no RequestInfo found in the context

	E1216 11:45:31.395916       1 controller.go:116] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable

	, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]

	I1216 11:45:31.395933       1 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.

	I1216 11:45:37.257601       1 client.go:360] parsed scheme: "passthrough"

	I1216 11:45:37.257725       1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379  <nil> 0 <nil>}] <nil> <nil>}

	I1216 11:45:37.257738       1 clientconn.go:948] ClientConn switching balancer to "pick_first"

	I1216 11:46:13.224294       1 client.go:360] parsed scheme: "passthrough"

	I1216 11:46:13.224466       1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379  <nil> 0 <nil>}] <nil> <nil>}

	I1216 11:46:13.224485       1 clientconn.go:948] ClientConn switching balancer to "pick_first"

	==> kube-apiserver [7ddd764ff8e3] <==

	W1216 11:39:34.934154       1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379  <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...

	W1216 11:39:34.957246       1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379  <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...

	W1216 11:39:34.982723       1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379  <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...

	W1216 11:39:34.989996       1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379  <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...

	W1216 11:39:35.030366       1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379  <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...

	W1216 11:39:35.093497       1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379  <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...

	W1216 11:39:35.095079       1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379  <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...

	W1216 11:39:35.098942       1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379  <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...

	W1216 11:39:35.113799       1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379  <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...

	W1216 11:39:35.118906       1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379  <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...

	W1216 11:39:35.157690       1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379  <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...

	W1216 11:39:35.160394       1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379  <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...

	W1216 11:39:35.177633       1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379  <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...

	W1216 11:39:35.208951       1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379  <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...

	W1216 11:39:35.238977       1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379  <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...

	W1216 11:39:35.273961       1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379  <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...

	W1216 11:39:35.297862       1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379  <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...

	W1216 11:39:35.315879       1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379  <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...

	W1216 11:39:35.395821       1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379  <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...

	W1216 11:39:35.447000       1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379  <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...

	W1216 11:39:35.473628       1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379  <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...

	W1216 11:39:35.485083       1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379  <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...

	W1216 11:39:35.502807       1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379  <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...

	W1216 11:39:35.519702       1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379  <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...

	W1216 11:39:35.539107       1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379  <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...

	==> kube-controller-manager [268c261f4e09] <==

	I1216 11:38:11.937975       1 event.go:291] "Event occurred" object="kube-system/coredns-74ff55c5b" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: coredns-74ff55c5b-gt4gb"

	I1216 11:38:12.019263       1 shared_informer.go:247] Caches are synced for resource quota 

	I1216 11:38:12.019502       1 shared_informer.go:247] Caches are synced for taint 

	I1216 11:38:12.019732       1 taint_manager.go:187] Starting NoExecuteTaintManager

	I1216 11:38:12.019754       1 node_lifecycle_controller.go:1429] Initializing eviction metric for zone: 

	W1216 11:38:12.019839       1 node_lifecycle_controller.go:1044] Missing timestamp for Node old-k8s-version-501600. Assuming now as a timestamp.

	I1216 11:38:12.019895       1 node_lifecycle_controller.go:1245] Controller detected that zone  is now in state Normal.

	I1216 11:38:12.020212       1 event.go:291] "Event occurred" object="old-k8s-version-501600" kind="Node" apiVersion="v1" type="Normal" reason="RegisteredNode" message="Node old-k8s-version-501600 event: Registered Node old-k8s-version-501600 in Controller"

	I1216 11:38:12.038571       1 range_allocator.go:373] Set node old-k8s-version-501600 PodCIDR to [10.244.0.0/24]

	I1216 11:38:12.127298       1 event.go:291] "Event occurred" object="kube-system/kube-proxy" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: kube-proxy-j2ct6"

	I1216 11:38:12.136642       1 shared_informer.go:240] Waiting for caches to sync for garbage collector

	I1216 11:38:12.240680       1 event.go:291] "Event occurred" object="kube-dns" kind="Endpoints" apiVersion="v1" type="Warning" reason="FailedToCreateEndpoint" message="Failed to create endpoint for service kube-system/kube-dns: endpoints \"kube-dns\" already exists"

	E1216 11:38:12.245642       1 clusterroleaggregation_controller.go:181] edit failed with : Operation cannot be fulfilled on clusterroles.rbac.authorization.k8s.io "edit": the object has been modified; please apply your changes to the latest version and try again

	E1216 11:38:12.323212       1 clusterroleaggregation_controller.go:181] admin failed with : Operation cannot be fulfilled on clusterroles.rbac.authorization.k8s.io "admin": the object has been modified; please apply your changes to the latest version and try again

	I1216 11:38:12.437283       1 shared_informer.go:247] Caches are synced for garbage collector 

	I1216 11:38:12.520142       1 shared_informer.go:247] Caches are synced for garbage collector 

	I1216 11:38:12.520260       1 garbagecollector.go:151] Garbage collector: all resource monitors have synced. Proceeding to collect garbage

	E1216 11:38:12.525515       1 clusterroleaggregation_controller.go:181] admin failed with : Operation cannot be fulfilled on clusterroles.rbac.authorization.k8s.io "admin": the object has been modified; please apply your changes to the latest version and try again

	I1216 11:38:12.739321       1 request.go:655] Throttling request took 1.014668888s, request: GET:https://192.168.94.2:8443/apis/apiextensions.k8s.io/v1?timeout=32s

	I1216 11:38:13.545157       1 shared_informer.go:240] Waiting for caches to sync for resource quota

	I1216 11:38:13.545208       1 shared_informer.go:247] Caches are synced for resource quota 

	I1216 11:38:15.623280       1 event.go:291] "Event occurred" object="kube-system/coredns" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled down replica set coredns-74ff55c5b to 1"

	I1216 11:38:15.730814       1 event.go:291] "Event occurred" object="kube-system/coredns-74ff55c5b" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulDelete" message="Deleted pod: coredns-74ff55c5b-gt4gb"

	I1216 11:39:23.255581       1 event.go:291] "Event occurred" object="kube-system/metrics-server" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled up replica set metrics-server-9975d5f86 to 1"

	I1216 11:39:24.357459       1 event.go:291] "Event occurred" object="kube-system/metrics-server-9975d5f86" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: metrics-server-9975d5f86-zn4gg"

	==> kube-controller-manager [d341318320dc] <==

	W1216 11:41:58.552386       1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]

	E1216 11:42:24.422880       1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request

	I1216 11:42:30.200335       1 request.go:655] Throttling request took 1.047103581s, request: GET:https://192.168.94.2:8443/apis/storage.k8s.io/v1?timeout=32s

	W1216 11:42:31.083875       1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]

	E1216 11:42:54.922502       1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request

	I1216 11:43:02.732327       1 request.go:655] Throttling request took 1.04764754s, request: GET:https://192.168.94.2:8443/apis/certificates.k8s.io/v1?timeout=32s

	W1216 11:43:03.584034       1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]

	E1216 11:43:25.423258       1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request

	I1216 11:43:35.232888       1 request.go:655] Throttling request took 1.045881019s, request: GET:https://192.168.94.2:8443/apis/certificates.k8s.io/v1beta1?timeout=32s

	W1216 11:43:36.081802       1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]

	E1216 11:43:55.924306       1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request

	I1216 11:44:07.730679       1 request.go:655] Throttling request took 1.047249911s, request: GET:https://192.168.94.2:8443/apis/discovery.k8s.io/v1beta1?timeout=32s

	W1216 11:44:08.582873       1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]

	E1216 11:44:26.425436       1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request

	I1216 11:44:40.229993       1 request.go:655] Throttling request took 1.046103082s, request: GET:https://192.168.94.2:8443/apis/admissionregistration.k8s.io/v1beta1?timeout=32s

	W1216 11:44:41.082719       1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]

	E1216 11:44:56.927871       1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request

	I1216 11:45:12.732544       1 request.go:655] Throttling request took 1.047598507s, request: GET:https://192.168.94.2:8443/apis/storage.k8s.io/v1?timeout=32s

	W1216 11:45:13.584881       1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]

	E1216 11:45:27.432157       1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request

	I1216 11:45:45.232384       1 request.go:655] Throttling request took 1.045782894s, request: GET:https://192.168.94.2:8443/apis/apiextensions.k8s.io/v1?timeout=32s

	W1216 11:45:46.086571       1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]

	E1216 11:45:57.931578       1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request

	I1216 11:46:17.736425       1 request.go:655] Throttling request took 1.045150181s, request: GET:https://192.168.94.2:8443/apis/autoscaling/v2beta2?timeout=32s

	W1216 11:46:18.590773       1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]

	==> kube-proxy [58e72cba6157] <==

	I1216 11:40:37.441902       1 node.go:172] Successfully retrieved node IP: 192.168.94.2

	I1216 11:40:37.442127       1 server_others.go:142] kube-proxy node IP is an IPv4 address (192.168.94.2), assume IPv4 operation

	W1216 11:40:37.625860       1 server_others.go:578] Unknown proxy mode "", assuming iptables proxy

	I1216 11:40:37.626065       1 server_others.go:185] Using iptables Proxier.

	I1216 11:40:37.626453       1 server.go:650] Version: v1.20.0

	I1216 11:40:37.627843       1 config.go:224] Starting endpoint slice config controller

	I1216 11:40:37.627884       1 shared_informer.go:240] Waiting for caches to sync for endpoint slice config

	I1216 11:40:37.628168       1 config.go:315] Starting service config controller

	I1216 11:40:37.628187       1 shared_informer.go:240] Waiting for caches to sync for service config

	I1216 11:40:37.728144       1 shared_informer.go:247] Caches are synced for endpoint slice config 

	I1216 11:40:37.728979       1 shared_informer.go:247] Caches are synced for service config 

	==> kube-proxy [8cce9bacca4b] <==

	I1216 11:38:16.684761       1 node.go:172] Successfully retrieved node IP: 192.168.94.2

	I1216 11:38:16.684959       1 server_others.go:142] kube-proxy node IP is an IPv4 address (192.168.94.2), assume IPv4 operation

	W1216 11:38:16.821532       1 server_others.go:578] Unknown proxy mode "", assuming iptables proxy

	I1216 11:38:16.821905       1 server_others.go:185] Using iptables Proxier.

	I1216 11:38:16.825543       1 server.go:650] Version: v1.20.0

	I1216 11:38:16.827658       1 config.go:224] Starting endpoint slice config controller

	I1216 11:38:16.827786       1 shared_informer.go:240] Waiting for caches to sync for endpoint slice config

	I1216 11:38:16.827837       1 config.go:315] Starting service config controller

	I1216 11:38:16.827851       1 shared_informer.go:240] Waiting for caches to sync for service config

	I1216 11:38:16.928652       1 shared_informer.go:247] Caches are synced for service config 

	I1216 11:38:16.928811       1 shared_informer.go:247] Caches are synced for endpoint slice config 

	==> kube-scheduler [5bfd011d16fd] <==

	E1216 11:37:49.226794       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope

	E1216 11:37:50.112656       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope

	E1216 11:37:50.124072       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope

	E1216 11:37:50.216525       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope

	E1216 11:37:50.286348       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope

	E1216 11:37:50.460087       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope

	E1216 11:37:50.522135       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope

	E1216 11:37:50.530529       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope

	E1216 11:37:50.556865       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1beta1.PodDisruptionBudget: failed to list *v1beta1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope

	E1216 11:37:50.639606       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope

	E1216 11:37:50.700383       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope

	E1216 11:37:50.740031       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope

	E1216 11:37:50.740689       1 reflector.go:138] k8s.io/apiserver/pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"

	E1216 11:37:52.453556       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope

	E1216 11:37:52.457173       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1beta1.PodDisruptionBudget: failed to list *v1beta1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope

	E1216 11:37:52.476283       1 reflector.go:138] k8s.io/apiserver/pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"

	E1216 11:37:52.625683       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope

	E1216 11:37:52.721532       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope

	E1216 11:37:52.754687       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope

	E1216 11:37:52.901523       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope

	E1216 11:37:52.939948       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope

	E1216 11:37:53.263755       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope

	E1216 11:37:53.267606       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope

	E1216 11:37:53.293793       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope

	I1216 11:37:58.244684       1 shared_informer.go:247] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file 

	==> kube-scheduler [8ddd1a91749a] <==

	I1216 11:40:24.256938       1 serving.go:331] Generated self-signed cert in-memory

	I1216 11:40:31.122720       1 secure_serving.go:197] Serving securely on 127.0.0.1:10259

	I1216 11:40:31.123548       1 requestheader_controller.go:169] Starting RequestHeaderAuthRequestController

	I1216 11:40:31.123639       1 shared_informer.go:240] Waiting for caches to sync for RequestHeaderAuthRequestController

	I1216 11:40:31.123675       1 tlsconfig.go:240] Starting DynamicServingCertificateController

	I1216 11:40:31.207291       1 configmap_cafile_content.go:202] Starting client-ca::kube-system::extension-apiserver-authentication::client-ca-file

	I1216 11:40:31.207342       1 shared_informer.go:240] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file

	I1216 11:40:31.207369       1 configmap_cafile_content.go:202] Starting client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file

	I1216 11:40:31.207376       1 shared_informer.go:240] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file

	I1216 11:40:31.316383       1 shared_informer.go:247] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file 

	I1216 11:40:31.324788       1 shared_informer.go:247] Caches are synced for RequestHeaderAuthRequestController 

	I1216 11:40:31.407776       1 shared_informer.go:247] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file 

	==> kubelet <==

	Dec 16 11:44:27 old-k8s-version-501600 kubelet[1909]: E1216 11:44:27.906368    1909 pod_workers.go:191] Error syncing pod 37a1d62a-03f1-4e8e-bd42-ca72275d6ccb ("dashboard-metrics-scraper-8d5bb5db8-4wwm7_kubernetes-dashboard(37a1d62a-03f1-4e8e-bd42-ca72275d6ccb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""

	Dec 16 11:44:38 old-k8s-version-501600 kubelet[1909]: E1216 11:44:38.897229    1909 pod_workers.go:191] Error syncing pod d2896fe7-5eeb-43d2-95d6-927aef485e51 ("metrics-server-9975d5f86-zn4gg_kube-system(d2896fe7-5eeb-43d2-95d6-927aef485e51)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	Dec 16 11:44:39 old-k8s-version-501600 kubelet[1909]: E1216 11:44:39.896174    1909 pod_workers.go:191] Error syncing pod 37a1d62a-03f1-4e8e-bd42-ca72275d6ccb ("dashboard-metrics-scraper-8d5bb5db8-4wwm7_kubernetes-dashboard(37a1d62a-03f1-4e8e-bd42-ca72275d6ccb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""

	Dec 16 11:44:50 old-k8s-version-501600 kubelet[1909]: E1216 11:44:50.898286    1909 pod_workers.go:191] Error syncing pod d2896fe7-5eeb-43d2-95d6-927aef485e51 ("metrics-server-9975d5f86-zn4gg_kube-system(d2896fe7-5eeb-43d2-95d6-927aef485e51)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	Dec 16 11:44:52 old-k8s-version-501600 kubelet[1909]: E1216 11:44:52.894556    1909 pod_workers.go:191] Error syncing pod 37a1d62a-03f1-4e8e-bd42-ca72275d6ccb ("dashboard-metrics-scraper-8d5bb5db8-4wwm7_kubernetes-dashboard(37a1d62a-03f1-4e8e-bd42-ca72275d6ccb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""

	Dec 16 11:45:03 old-k8s-version-501600 kubelet[1909]: E1216 11:45:03.895647    1909 pod_workers.go:191] Error syncing pod 37a1d62a-03f1-4e8e-bd42-ca72275d6ccb ("dashboard-metrics-scraper-8d5bb5db8-4wwm7_kubernetes-dashboard(37a1d62a-03f1-4e8e-bd42-ca72275d6ccb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""

	Dec 16 11:45:04 old-k8s-version-501600 kubelet[1909]: E1216 11:45:04.897659    1909 pod_workers.go:191] Error syncing pod d2896fe7-5eeb-43d2-95d6-927aef485e51 ("metrics-server-9975d5f86-zn4gg_kube-system(d2896fe7-5eeb-43d2-95d6-927aef485e51)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	Dec 16 11:45:15 old-k8s-version-501600 kubelet[1909]: E1216 11:45:15.893423    1909 pod_workers.go:191] Error syncing pod 37a1d62a-03f1-4e8e-bd42-ca72275d6ccb ("dashboard-metrics-scraper-8d5bb5db8-4wwm7_kubernetes-dashboard(37a1d62a-03f1-4e8e-bd42-ca72275d6ccb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""

	Dec 16 11:45:16 old-k8s-version-501600 kubelet[1909]: E1216 11:45:16.895909    1909 pod_workers.go:191] Error syncing pod d2896fe7-5eeb-43d2-95d6-927aef485e51 ("metrics-server-9975d5f86-zn4gg_kube-system(d2896fe7-5eeb-43d2-95d6-927aef485e51)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	Dec 16 11:45:16 old-k8s-version-501600 kubelet[1909]: W1216 11:45:16.986213    1909 sysinfo.go:203] Nodes topology is not available, providing CPU topology

	Dec 16 11:45:16 old-k8s-version-501600 kubelet[1909]: W1216 11:45:16.988851    1909 sysfs.go:348] unable to read /sys/devices/system/cpu/cpu0/online: open /sys/devices/system/cpu/cpu0/online: no such file or directory

	Dec 16 11:45:26 old-k8s-version-501600 kubelet[1909]: E1216 11:45:26.948454    1909 pod_workers.go:191] Error syncing pod 37a1d62a-03f1-4e8e-bd42-ca72275d6ccb ("dashboard-metrics-scraper-8d5bb5db8-4wwm7_kubernetes-dashboard(37a1d62a-03f1-4e8e-bd42-ca72275d6ccb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""

	Dec 16 11:45:32 old-k8s-version-501600 kubelet[1909]: E1216 11:45:32.894388    1909 pod_workers.go:191] Error syncing pod d2896fe7-5eeb-43d2-95d6-927aef485e51 ("metrics-server-9975d5f86-zn4gg_kube-system(d2896fe7-5eeb-43d2-95d6-927aef485e51)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	Dec 16 11:45:38 old-k8s-version-501600 kubelet[1909]: E1216 11:45:38.892058    1909 pod_workers.go:191] Error syncing pod 37a1d62a-03f1-4e8e-bd42-ca72275d6ccb ("dashboard-metrics-scraper-8d5bb5db8-4wwm7_kubernetes-dashboard(37a1d62a-03f1-4e8e-bd42-ca72275d6ccb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""

	Dec 16 11:45:44 old-k8s-version-501600 kubelet[1909]: E1216 11:45:44.890057    1909 pod_workers.go:191] Error syncing pod d2896fe7-5eeb-43d2-95d6-927aef485e51 ("metrics-server-9975d5f86-zn4gg_kube-system(d2896fe7-5eeb-43d2-95d6-927aef485e51)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	Dec 16 11:45:49 old-k8s-version-501600 kubelet[1909]: E1216 11:45:49.888740    1909 pod_workers.go:191] Error syncing pod 37a1d62a-03f1-4e8e-bd42-ca72275d6ccb ("dashboard-metrics-scraper-8d5bb5db8-4wwm7_kubernetes-dashboard(37a1d62a-03f1-4e8e-bd42-ca72275d6ccb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""

	Dec 16 11:45:56 old-k8s-version-501600 kubelet[1909]: E1216 11:45:56.890796    1909 pod_workers.go:191] Error syncing pod d2896fe7-5eeb-43d2-95d6-927aef485e51 ("metrics-server-9975d5f86-zn4gg_kube-system(d2896fe7-5eeb-43d2-95d6-927aef485e51)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	Dec 16 11:46:01 old-k8s-version-501600 kubelet[1909]: E1216 11:46:01.889316    1909 pod_workers.go:191] Error syncing pod 37a1d62a-03f1-4e8e-bd42-ca72275d6ccb ("dashboard-metrics-scraper-8d5bb5db8-4wwm7_kubernetes-dashboard(37a1d62a-03f1-4e8e-bd42-ca72275d6ccb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""

	Dec 16 11:46:09 old-k8s-version-501600 kubelet[1909]: E1216 11:46:09.887507    1909 pod_workers.go:191] Error syncing pod d2896fe7-5eeb-43d2-95d6-927aef485e51 ("metrics-server-9975d5f86-zn4gg_kube-system(d2896fe7-5eeb-43d2-95d6-927aef485e51)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	Dec 16 11:46:12 old-k8s-version-501600 kubelet[1909]: E1216 11:46:12.893911    1909 pod_workers.go:191] Error syncing pod 37a1d62a-03f1-4e8e-bd42-ca72275d6ccb ("dashboard-metrics-scraper-8d5bb5db8-4wwm7_kubernetes-dashboard(37a1d62a-03f1-4e8e-bd42-ca72275d6ccb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""

	Dec 16 11:46:23 old-k8s-version-501600 kubelet[1909]: E1216 11:46:23.958084    1909 remote_image.go:113] PullImage "fake.domain/registry.k8s.io/echoserver:1.4" from image service failed: rpc error: code = Unknown desc = Error response from daemon: Get "https://fake.domain/v2/": dial tcp: lookup fake.domain on 192.168.65.254:53: no such host

	Dec 16 11:46:23 old-k8s-version-501600 kubelet[1909]: E1216 11:46:23.958262    1909 kuberuntime_image.go:51] Pull image "fake.domain/registry.k8s.io/echoserver:1.4" failed: rpc error: code = Unknown desc = Error response from daemon: Get "https://fake.domain/v2/": dial tcp: lookup fake.domain on 192.168.65.254:53: no such host

	Dec 16 11:46:23 old-k8s-version-501600 kubelet[1909]: E1216 11:46:23.958579    1909 kuberuntime_manager.go:829] container &Container{Name:metrics-server,Image:fake.domain/registry.k8s.io/echoserver:1.4,Command:[],Args:[--cert-dir=/tmp --secure-port=4443 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --kubelet-use-node-status-port --metric-resolution=60s --kubelet-insecure-tls],WorkingDir:,Ports:[]ContainerPort{ContainerPort{Name:https,HostPort:0,ContainerPort:4443,Protocol:TCP,HostIP:,},},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{cpu: {{100 -3} {<nil>} 100m DecimalSI},memory: {{209715200 0} {<nil>}  BinarySI},},},VolumeMounts:[]VolumeMount{VolumeMount{Name:tmp-dir,ReadOnly:false,MountPath:/tmp,SubPath:,MountPropagation:nil,SubPathExpr:,},VolumeMount{Name:metrics-server-token-xhzmx,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,},},LivenessProbe:&Probe{Handler:Handler{Exe

c:nil,HTTPGet:&HTTPGetAction{Path:/livez,Port:{1 0 https},Host:,Scheme:HTTPS,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,},InitialDelaySeconds:0,TimeoutSeconds:1,PeriodSeconds:10,SuccessThreshold:1,FailureThreshold:3,},ReadinessProbe:&Probe{Handler:Handler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/readyz,Port:{1 0 https},Host:,Scheme:HTTPS,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,},InitialDelaySeconds:0,TimeoutSeconds:1,PeriodSeconds:10,SuccessThreshold:1,FailureThreshold:3,},Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:nil,Privileged:nil,SELinuxOptions:nil,RunAsUser:*1000,RunAsNonRoot:*true,ReadOnlyRootFilesystem:*true,AllowPrivilegeEscalation:nil,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,} start failed in pod metrics-server-9975d5f86-zn4gg_kube-system(d2896f

e7-5eeb-43d2-95d6-927aef485e51): ErrImagePull: rpc error: code = Unknown desc = Error response from daemon: Get "https://fake.domain/v2/": dial tcp: lookup fake.domain on 192.168.65.254:53: no such host

	Dec 16 11:46:23 old-k8s-version-501600 kubelet[1909]: E1216 11:46:23.958799    1909 pod_workers.go:191] Error syncing pod d2896fe7-5eeb-43d2-95d6-927aef485e51 ("metrics-server-9975d5f86-zn4gg_kube-system(d2896fe7-5eeb-43d2-95d6-927aef485e51)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = Error response from daemon: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.65.254:53: no such host"

	Dec 16 11:46:25 old-k8s-version-501600 kubelet[1909]: E1216 11:46:25.894417    1909 pod_workers.go:191] Error syncing pod 37a1d62a-03f1-4e8e-bd42-ca72275d6ccb ("dashboard-metrics-scraper-8d5bb5db8-4wwm7_kubernetes-dashboard(37a1d62a-03f1-4e8e-bd42-ca72275d6ccb)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""

	==> kubernetes-dashboard [19b65a7c34eb] <==

	2024/12/16 11:41:14 Starting overwatch

	2024/12/16 11:41:14 Using namespace: kubernetes-dashboard

	2024/12/16 11:41:14 Using in-cluster config to connect to apiserver

	2024/12/16 11:41:14 Using secret token for csrf signing

	2024/12/16 11:41:14 Initializing csrf token from kubernetes-dashboard-csrf secret

	2024/12/16 11:41:14 Empty token. Generating and storing in a secret kubernetes-dashboard-csrf

	2024/12/16 11:41:14 Successful initial request to the apiserver, version: v1.20.0

	2024/12/16 11:41:14 Generating JWE encryption key

	2024/12/16 11:41:14 New synchronizer has been registered: kubernetes-dashboard-key-holder-kubernetes-dashboard. Starting

	2024/12/16 11:41:14 Starting secret synchronizer for kubernetes-dashboard-key-holder in namespace kubernetes-dashboard

	2024/12/16 11:41:15 Initializing JWE encryption key from synchronized object

	2024/12/16 11:41:15 Creating in-cluster Sidecar client

	2024/12/16 11:41:15 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.

	2024/12/16 11:41:15 Serving insecurely on HTTP port: 9090

	2024/12/16 11:41:45 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.

	2024/12/16 11:42:15 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.

	2024/12/16 11:42:45 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.

	2024/12/16 11:43:15 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.

	2024/12/16 11:43:45 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.

	2024/12/16 11:44:15 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.

	2024/12/16 11:44:45 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.

	2024/12/16 11:45:15 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.

	2024/12/16 11:45:45 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.

	2024/12/16 11:46:15 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.

	==> storage-provisioner [230a8a7960d9] <==

	I1216 11:41:12.406959       1 storage_provisioner.go:116] Initializing the minikube storage provisioner...

	I1216 11:41:12.431258       1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!

	I1216 11:41:12.432542       1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...

	I1216 11:41:29.957595       1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath

	I1216 11:41:29.957906       1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_old-k8s-version-501600_c61bc59c-cab8-4dbe-b7f1-5adfd78c98a2!

	I1216 11:41:29.958067       1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"cd1362d5-8e7b-40b6-af2a-e76097cf3a64", APIVersion:"v1", ResourceVersion:"787", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' old-k8s-version-501600_c61bc59c-cab8-4dbe-b7f1-5adfd78c98a2 became leader

	I1216 11:41:30.058460       1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_old-k8s-version-501600_c61bc59c-cab8-4dbe-b7f1-5adfd78c98a2!

	==> storage-provisioner [2f9bdc06bf7f] <==

	I1216 11:40:37.332966       1 storage_provisioner.go:116] Initializing the minikube storage provisioner...

	F1216 11:40:58.428817       1 main.go:39] error getting server version: Get "https://10.96.0.1:443/version?timeout=32s": dial tcp 10.96.0.1:443: connect: connection refused

-- /stdout --

helpers_test.go:254: (dbg) Run:  out/minikube-windows-amd64.exe status --format={{.APIServer}} -p old-k8s-version-501600 -n old-k8s-version-501600

helpers_test.go:254: (dbg) Done: out/minikube-windows-amd64.exe status --format={{.APIServer}} -p old-k8s-version-501600 -n old-k8s-version-501600: (1.055671s)

helpers_test.go:261: (dbg) Run:  kubectl --context old-k8s-version-501600 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running

helpers_test.go:272: non-running pods: metrics-server-9975d5f86-zn4gg dashboard-metrics-scraper-8d5bb5db8-4wwm7

helpers_test.go:274: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/SecondStart]: describe non-running pods <======

helpers_test.go:277: (dbg) Run:  kubectl --context old-k8s-version-501600 describe pod metrics-server-9975d5f86-zn4gg dashboard-metrics-scraper-8d5bb5db8-4wwm7

helpers_test.go:277: (dbg) Non-zero exit: kubectl --context old-k8s-version-501600 describe pod metrics-server-9975d5f86-zn4gg dashboard-metrics-scraper-8d5bb5db8-4wwm7: exit status 1 (926.1909ms)

** stderr ** 

	E1216 11:46:30.843042   11100 memcache.go:287] "Unhandled Error" err="couldn't get resource list for metrics.k8s.io/v1beta1: the server is currently unable to handle the request"

	E1216 11:46:30.957051   11100 memcache.go:121] "Unhandled Error" err="couldn't get resource list for metrics.k8s.io/v1beta1: the server is currently unable to handle the request"

	E1216 11:46:30.976052   11100 memcache.go:121] "Unhandled Error" err="couldn't get resource list for metrics.k8s.io/v1beta1: the server is currently unable to handle the request"

	E1216 11:46:30.995033   11100 memcache.go:121] "Unhandled Error" err="couldn't get resource list for metrics.k8s.io/v1beta1: the server is currently unable to handle the request"

	Error from server (NotFound): pods "metrics-server-9975d5f86-zn4gg" not found

	Error from server (NotFound): pods "dashboard-metrics-scraper-8d5bb5db8-4wwm7" not found

** /stderr **

helpers_test.go:279: kubectl --context old-k8s-version-501600 describe pod metrics-server-9975d5f86-zn4gg dashboard-metrics-scraper-8d5bb5db8-4wwm7: exit status 1

--- FAIL: TestStartStop/group/old-k8s-version/serial/SecondStart (412.78s)

=== RUN   TestDownloadOnly/v1.20.0/json-events

aaa_download_only_test.go:81: (dbg) Run:  out/minikube-windows-amd64.exe start -o=json --download-only -p download-only-912200 --force --alsologtostderr --kubernetes-version=v1.20.0 --container-runtime=docker --driver=docker

aaa_download_only_test.go:81: (dbg) Done: out/minikube-windows-amd64.exe start -o=json --download-only -p download-only-912200 --force --alsologtostderr --kubernetes-version=v1.20.0 --container-runtime=docker --driver=docker: (8.9016253s)

--- PASS: TestDownloadOnly/v1.20.0/json-events (8.90s)

=== RUN   TestDownloadOnly/v1.20.0/preload-exists

I1216 10:19:45.797634   11452 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime docker

I1216 10:19:45.874371   11452 preload.go:146] Found local preload: C:\Users\jenkins.minikube4\minikube-integration\.minikube\cache\preloaded-tarball\preloaded-images-k8s-v18-v1.20.0-docker-overlay2-amd64.tar.lz4

--- PASS: TestDownloadOnly/v1.20.0/preload-exists (0.08s)

=== RUN   TestDownloadOnly/v1.20.0/kubectl

--- PASS: TestDownloadOnly/v1.20.0/kubectl (0.00s)

=== RUN   TestDownloadOnly/v1.20.0/LogsDuration

aaa_download_only_test.go:184: (dbg) Run:  out/minikube-windows-amd64.exe logs -p download-only-912200

aaa_download_only_test.go:184: (dbg) Non-zero exit: out/minikube-windows-amd64.exe logs -p download-only-912200: exit status 85 (532.594ms)

-- stdout --

	==> Audit <==

	|---------|--------------------------------|----------------------|-------------------|---------|---------------------|----------|

	| Command |              Args              |       Profile        |       User        | Version |     Start Time      | End Time |

	|---------|--------------------------------|----------------------|-------------------|---------|---------------------|----------|

	| start   | -o=json --download-only        | download-only-912200 | minikube4\jenkins | v1.34.0 | 16 Dec 24 10:19 UTC |          |

	|         | -p download-only-912200        |                      |                   |         |                     |          |

	|         | --force --alsologtostderr      |                      |                   |         |                     |          |

	|         | --kubernetes-version=v1.20.0   |                      |                   |         |                     |          |

	|         | --container-runtime=docker     |                      |                   |         |                     |          |

	|         | --driver=docker                |                      |                   |         |                     |          |

	|---------|--------------------------------|----------------------|-------------------|---------|---------------------|----------|

	==> Last Start <==

	Log file created at: 2024/12/16 10:19:37

	Running on machine: minikube4

	Binary: Built with gc go1.23.3 for windows/amd64

	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg

	I1216 10:19:37.000511    3872 out.go:345] Setting OutFile to fd 724 ...

	I1216 10:19:37.083888    3872 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I1216 10:19:37.083888    3872 out.go:358] Setting ErrFile to fd 728...

	I1216 10:19:37.083888    3872 out.go:392] TERM=,COLORTERM=, which probably does not support color

	W1216 10:19:37.097044    3872 root.go:314] Error reading config file at C:\Users\jenkins.minikube4\minikube-integration\.minikube\config\config.json: open C:\Users\jenkins.minikube4\minikube-integration\.minikube\config\config.json: The system cannot find the path specified.

	I1216 10:19:37.109395    3872 out.go:352] Setting JSON to true

	I1216 10:19:37.112615    3872 start.go:129] hostinfo: {"hostname":"minikube4","uptime":394647,"bootTime":1733949729,"procs":206,"os":"windows","platform":"Microsoft Windows 10 Enterprise N","platformFamily":"Standalone Workstation","platformVersion":"10.0.19045.5198 Build 19045.5198","kernelVersion":"10.0.19045.5198 Build 19045.5198","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"df6bfb5f-73f2-4acb-9365-df7854ecbb28"}

	W1216 10:19:37.112615    3872 start.go:137] gopshost.Virtualization returned error: not implemented yet

	I1216 10:19:37.122222    3872 out.go:97] [download-only-912200] minikube v1.34.0 on Microsoft Windows 10 Enterprise N 10.0.19045.5198 Build 19045.5198

	I1216 10:19:37.122890    3872 notify.go:220] Checking for updates...

	W1216 10:19:37.122939    3872 preload.go:293] Failed to list preload files: open C:\Users\jenkins.minikube4\minikube-integration\.minikube\cache\preloaded-tarball: The system cannot find the file specified.

	I1216 10:19:37.124197    3872 out.go:169] KUBECONFIG=C:\Users\jenkins.minikube4\minikube-integration\kubeconfig

	I1216 10:19:37.131428    3872 out.go:169] MINIKUBE_HOME=C:\Users\jenkins.minikube4\minikube-integration\.minikube

	I1216 10:19:37.136505    3872 out.go:169] MINIKUBE_LOCATION=20107

	I1216 10:19:37.141974    3872 out.go:169] MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	W1216 10:19:37.153899    3872 out.go:321] minikube skips various validations when --force is supplied; this may lead to unexpected behavior

	I1216 10:19:37.154876    3872 driver.go:394] Setting default libvirt URI to qemu:///system

	I1216 10:19:37.341389    3872 docker.go:123] docker version: linux-27.2.0:Docker Desktop 4.34.2 (167172)

	I1216 10:19:37.352694    3872 cli_runner.go:164] Run: docker system info --format "{{json .}}"

	I1216 10:19:37.694461    3872 info.go:266] docker info: {ID:a15b78d1-f772-48f7-bbf5-f8fe086f3f87 Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:0 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:53 OomKillDisable:true NGoroutines:76 SystemTime:2024-12-16 10:19:37.668422069 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:12 KernelVersion:5.15.153.1-microsoft-standard-WSL2 OperatingSystem:Docker Desktop OSType:linux Architecture:x86_64 Ind

exServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:16 MemTotal:33657536512 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy:http.docker.internal:3128 HTTPSProxy:http.docker.internal:3128 NoProxy:hubproxy.docker.internal Name:docker-desktop Labels:[com.docker.desktop.address=npipe://\\.\pipe\docker_cli] ExperimentalBuild:false ServerVersion:27.2.0 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:8fc6bcff51318944179630522a095cc9dbf9f353 Expected:8fc6bcff51318944179630522a095cc9dbf9f353} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0

Expected:de40ad0} SecurityOptions:[name=seccomp,profile=unconfined] ProductLicense: Warnings:[WARNING: No blkio throttle.read_bps_device support WARNING: No blkio throttle.write_bps_device support WARNING: No blkio throttle.read_iops_device support WARNING: No blkio throttle.write_iops_device support WARNING: daemon is not using the default seccomp profile] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:C:\Program Files\Docker\cli-plugins\docker-buildx.exe SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.16.2-desktop.1] map[Name:compose Path:C:\Program Files\Docker\cli-plugins\docker-compose.exe SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.2-desktop.2] map[Name:debug Path:C:\Program Files\Docker\cli-plugins\docker-debug.exe SchemaVersion:0.1.0 ShortDescription:Get a shell into any image or container Vendor:Docker Inc. Version:0.0.34] map[Name:desktop Path:C:\Program Files\Docker\cli-plugins\docker-desktop.exe Schema

Version:0.1.0 ShortDescription:Docker Desktop commands (Alpha) Vendor:Docker Inc. Version:v0.0.15] map[Name:dev Path:C:\Program Files\Docker\cli-plugins\docker-dev.exe SchemaVersion:0.1.0 ShortDescription:Docker Dev Environments Vendor:Docker Inc. Version:v0.1.2] map[Name:extension Path:C:\Program Files\Docker\cli-plugins\docker-extension.exe SchemaVersion:0.1.0 ShortDescription:Manages Docker extensions Vendor:Docker Inc. Version:v0.2.25] map[Name:feedback Path:C:\Program Files\Docker\cli-plugins\docker-feedback.exe SchemaVersion:0.1.0 ShortDescription:Provide feedback, right in your terminal! Vendor:Docker Inc. Version:v1.0.5] map[Name:init Path:C:\Program Files\Docker\cli-plugins\docker-init.exe SchemaVersion:0.1.0 ShortDescription:Creates Docker-related starter files for your project Vendor:Docker Inc. Version:v1.3.0] map[Name:sbom Path:C:\Program Files\Docker\cli-plugins\docker-sbom.exe SchemaVersion:0.1.0 ShortDescription:View the packaged-based Software Bill Of Materials (SBOM) for an image URL:https:/

/github.com/docker/sbom-cli-plugin Vendor:Anchore Inc. Version:0.6.0] map[Name:scout Path:C:\Program Files\Docker\cli-plugins\docker-scout.exe SchemaVersion:0.1.0 ShortDescription:Docker Scout Vendor:Docker Inc. Version:v1.13.0]] Warnings:<nil>}}

	I1216 10:19:37.699171    3872 out.go:97] Using the docker driver based on user configuration

	I1216 10:19:37.699171    3872 start.go:297] selected driver: docker

	I1216 10:19:37.699171    3872 start.go:901] validating driver "docker" against <nil>

	I1216 10:19:37.715312    3872 cli_runner.go:164] Run: docker system info --format "{{json .}}"

	I1216 10:19:38.031458    3872 info.go:266] docker info: {ID:a15b78d1-f772-48f7-bbf5-f8fe086f3f87 Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:0 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:53 OomKillDisable:true NGoroutines:76 SystemTime:2024-12-16 10:19:38.001389045 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:12 KernelVersion:5.15.153.1-microsoft-standard-WSL2 OperatingSystem:Docker Desktop OSType:linux Architecture:x86_64 Ind

exServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:16 MemTotal:33657536512 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy:http.docker.internal:3128 HTTPSProxy:http.docker.internal:3128 NoProxy:hubproxy.docker.internal Name:docker-desktop Labels:[com.docker.desktop.address=npipe://\\.\pipe\docker_cli] ExperimentalBuild:false ServerVersion:27.2.0 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:8fc6bcff51318944179630522a095cc9dbf9f353 Expected:8fc6bcff51318944179630522a095cc9dbf9f353} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0

Expected:de40ad0} SecurityOptions:[name=seccomp,profile=unconfined] ProductLicense: Warnings:[WARNING: No blkio throttle.read_bps_device support WARNING: No blkio throttle.write_bps_device support WARNING: No blkio throttle.read_iops_device support WARNING: No blkio throttle.write_iops_device support WARNING: daemon is not using the default seccomp profile] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:C:\Program Files\Docker\cli-plugins\docker-buildx.exe SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.16.2-desktop.1] map[Name:compose Path:C:\Program Files\Docker\cli-plugins\docker-compose.exe SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.2-desktop.2] map[Name:debug Path:C:\Program Files\Docker\cli-plugins\docker-debug.exe SchemaVersion:0.1.0 ShortDescription:Get a shell into any image or container Vendor:Docker Inc. Version:0.0.34] map[Name:desktop Path:C:\Program Files\Docker\cli-plugins\docker-desktop.exe Schema

Version:0.1.0 ShortDescription:Docker Desktop commands (Alpha) Vendor:Docker Inc. Version:v0.0.15] map[Name:dev Path:C:\Program Files\Docker\cli-plugins\docker-dev.exe SchemaVersion:0.1.0 ShortDescription:Docker Dev Environments Vendor:Docker Inc. Version:v0.1.2] map[Name:extension Path:C:\Program Files\Docker\cli-plugins\docker-extension.exe SchemaVersion:0.1.0 ShortDescription:Manages Docker extensions Vendor:Docker Inc. Version:v0.2.25] map[Name:feedback Path:C:\Program Files\Docker\cli-plugins\docker-feedback.exe SchemaVersion:0.1.0 ShortDescription:Provide feedback, right in your terminal! Vendor:Docker Inc. Version:v1.0.5] map[Name:init Path:C:\Program Files\Docker\cli-plugins\docker-init.exe SchemaVersion:0.1.0 ShortDescription:Creates Docker-related starter files for your project Vendor:Docker Inc. Version:v1.3.0] map[Name:sbom Path:C:\Program Files\Docker\cli-plugins\docker-sbom.exe SchemaVersion:0.1.0 ShortDescription:View the packaged-based Software Bill Of Materials (SBOM) for an image URL:https:/

/github.com/docker/sbom-cli-plugin Vendor:Anchore Inc. Version:0.6.0] map[Name:scout Path:C:\Program Files\Docker\cli-plugins\docker-scout.exe SchemaVersion:0.1.0 ShortDescription:Docker Scout Vendor:Docker Inc. Version:v1.13.0]] Warnings:<nil>}}

	I1216 10:19:38.032462    3872 start_flags.go:310] no existing cluster config was found, will generate one from the flags 

	I1216 10:19:38.100925    3872 start_flags.go:393] Using suggested 16300MB memory alloc based on sys=65534MB, container=32098MB

	I1216 10:19:38.102294    3872 start_flags.go:929] Wait components to verify : map[apiserver:true system_pods:true]

	I1216 10:19:38.109908    3872 out.go:169] Using Docker Desktop driver with root privileges

	I1216 10:19:38.112963    3872 cni.go:84] Creating CNI manager for ""

	I1216 10:19:38.112963    3872 cni.go:162] CNI unnecessary in this configuration, recommending no CNI

	I1216 10:19:38.113690    3872 start.go:340] cluster config:

	{Name:download-only-912200 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1733912881-20083@sha256:64d8b27f78fd269d886e21ba8fc88be20de183ba5cc5bce33d0810e8a65f1df2 Memory:16300 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:download-only-912200 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local C

ontainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:C:\Users\jenkins.minikube4:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I1216 10:19:38.115832    3872 out.go:97] Starting "download-only-912200" primary control-plane node in "download-only-912200" cluster

	I1216 10:19:38.115832    3872 cache.go:121] Beginning downloading kic base image for docker with docker

	I1216 10:19:38.119914    3872 out.go:97] Pulling base image v0.0.45-1733912881-20083 ...

	I1216 10:19:38.120037    3872 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime docker

	I1216 10:19:38.120037    3872 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1733912881-20083@sha256:64d8b27f78fd269d886e21ba8fc88be20de183ba5cc5bce33d0810e8a65f1df2 in local docker daemon

	I1216 10:19:38.167195    3872 preload.go:118] Found remote preload: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.20.0/preloaded-images-k8s-v18-v1.20.0-docker-overlay2-amd64.tar.lz4

	I1216 10:19:38.168199    3872 cache.go:56] Caching tarball of preloaded images

	I1216 10:19:38.168199    3872 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime docker

	I1216 10:19:38.171192    3872 out.go:97] Downloading Kubernetes v1.20.0 preload ...

	I1216 10:19:38.171192    3872 preload.go:236] getting checksum for preloaded-images-k8s-v18-v1.20.0-docker-overlay2-amd64.tar.lz4 ...

	I1216 10:19:38.189231    3872 cache.go:149] Downloading gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1733912881-20083@sha256:64d8b27f78fd269d886e21ba8fc88be20de183ba5cc5bce33d0810e8a65f1df2 to local cache

	I1216 10:19:38.189231    3872 localpath.go:146] windows sanitize: C:\Users\jenkins.minikube4\minikube-integration\.minikube\cache\kic\amd64\kicbase-builds:v0.0.45-1733912881-20083@sha256:64d8b27f78fd269d886e21ba8fc88be20de183ba5cc5bce33d0810e8a65f1df2.tar -> C:\Users\jenkins.minikube4\minikube-integration\.minikube\cache\kic\amd64\kicbase-builds_v0.0.45-1733912881-20083@sha256_64d8b27f78fd269d886e21ba8fc88be20de183ba5cc5bce33d0810e8a65f1df2.tar

	I1216 10:19:38.189231    3872 localpath.go:146] windows sanitize: C:\Users\jenkins.minikube4\minikube-integration\.minikube\cache\kic\amd64\kicbase-builds:v0.0.45-1733912881-20083@sha256:64d8b27f78fd269d886e21ba8fc88be20de183ba5cc5bce33d0810e8a65f1df2.tar -> C:\Users\jenkins.minikube4\minikube-integration\.minikube\cache\kic\amd64\kicbase-builds_v0.0.45-1733912881-20083@sha256_64d8b27f78fd269d886e21ba8fc88be20de183ba5cc5bce33d0810e8a65f1df2.tar

	I1216 10:19:38.189231    3872 image.go:63] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1733912881-20083@sha256:64d8b27f78fd269d886e21ba8fc88be20de183ba5cc5bce33d0810e8a65f1df2 in local cache directory

	I1216 10:19:38.190199    3872 image.go:148] Writing gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1733912881-20083@sha256:64d8b27f78fd269d886e21ba8fc88be20de183ba5cc5bce33d0810e8a65f1df2 to local cache

	I1216 10:19:38.237714    3872 download.go:107] Downloading: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.20.0/preloaded-images-k8s-v18-v1.20.0-docker-overlay2-amd64.tar.lz4?checksum=md5:9a82241e9b8b4ad2b5cca73108f2c7a3 -> C:\Users\jenkins.minikube4\minikube-integration\.minikube\cache\preloaded-tarball\preloaded-images-k8s-v18-v1.20.0-docker-overlay2-amd64.tar.lz4

	I1216 10:19:41.763211    3872 preload.go:247] saving checksum for preloaded-images-k8s-v18-v1.20.0-docker-overlay2-amd64.tar.lz4 ...

	I1216 10:19:41.763211    3872 preload.go:254] verifying checksum of C:\Users\jenkins.minikube4\minikube-integration\.minikube\cache\preloaded-tarball\preloaded-images-k8s-v18-v1.20.0-docker-overlay2-amd64.tar.lz4 ...

	* The control-plane node download-only-912200 host does not exist

	  To start a cluster, run: "minikube start -p download-only-912200"

-- /stdout --

aaa_download_only_test.go:185: minikube logs failed with error: exit status 85

--- PASS: TestDownloadOnly/v1.20.0/LogsDuration (0.53s)

=== RUN   TestDownloadOnly/v1.20.0/DeleteAll

aaa_download_only_test.go:197: (dbg) Run:  out/minikube-windows-amd64.exe delete --all

aaa_download_only_test.go:197: (dbg) Done: out/minikube-windows-amd64.exe delete --all: (1.6209006s)

--- PASS: TestDownloadOnly/v1.20.0/DeleteAll (1.62s)

=== RUN   TestDownloadOnly/v1.20.0/DeleteAlwaysSucceeds

aaa_download_only_test.go:208: (dbg) Run:  out/minikube-windows-amd64.exe delete -p download-only-912200

--- PASS: TestDownloadOnly/v1.20.0/DeleteAlwaysSucceeds (0.67s)

=== RUN   TestDownloadOnly/v1.31.2/json-events

aaa_download_only_test.go:81: (dbg) Run:  out/minikube-windows-amd64.exe start -o=json --download-only -p download-only-150500 --force --alsologtostderr --kubernetes-version=v1.31.2 --container-runtime=docker --driver=docker

aaa_download_only_test.go:81: (dbg) Done: out/minikube-windows-amd64.exe start -o=json --download-only -p download-only-150500 --force --alsologtostderr --kubernetes-version=v1.31.2 --container-runtime=docker --driver=docker: (6.8875089s)

--- PASS: TestDownloadOnly/v1.31.2/json-events (6.89s)

=== RUN   TestDownloadOnly/v1.31.2/preload-exists

I1216 10:19:55.594226   11452 preload.go:131] Checking if preload exists for k8s version v1.31.2 and runtime docker

I1216 10:19:55.594226   11452 preload.go:146] Found local preload: C:\Users\jenkins.minikube4\minikube-integration\.minikube\cache\preloaded-tarball\preloaded-images-k8s-v18-v1.31.2-docker-overlay2-amd64.tar.lz4

--- PASS: TestDownloadOnly/v1.31.2/preload-exists (0.00s)

=== RUN   TestDownloadOnly/v1.31.2/kubectl

--- PASS: TestDownloadOnly/v1.31.2/kubectl (0.00s)

=== RUN   TestDownloadOnly/v1.31.2/LogsDuration

aaa_download_only_test.go:184: (dbg) Run:  out/minikube-windows-amd64.exe logs -p download-only-150500

aaa_download_only_test.go:184: (dbg) Non-zero exit: out/minikube-windows-amd64.exe logs -p download-only-150500: exit status 85 (741.8405ms)

-- stdout --

	==> Audit <==

	|---------|--------------------------------|----------------------|-------------------|---------|---------------------|---------------------|

	| Command |              Args              |       Profile        |       User        | Version |     Start Time      |      End Time       |

	|---------|--------------------------------|----------------------|-------------------|---------|---------------------|---------------------|

	| start   | -o=json --download-only        | download-only-912200 | minikube4\jenkins | v1.34.0 | 16 Dec 24 10:19 UTC |                     |

	|         | -p download-only-912200        |                      |                   |         |                     |                     |

	|         | --force --alsologtostderr      |                      |                   |         |                     |                     |

	|         | --kubernetes-version=v1.20.0   |                      |                   |         |                     |                     |

	|         | --container-runtime=docker     |                      |                   |         |                     |                     |

	|         | --driver=docker                |                      |                   |         |                     |                     |

	| delete  | --all                          | minikube             | minikube4\jenkins | v1.34.0 | 16 Dec 24 10:19 UTC | 16 Dec 24 10:19 UTC |

	| delete  | -p download-only-912200        | download-only-912200 | minikube4\jenkins | v1.34.0 | 16 Dec 24 10:19 UTC | 16 Dec 24 10:19 UTC |

	| start   | -o=json --download-only        | download-only-150500 | minikube4\jenkins | v1.34.0 | 16 Dec 24 10:19 UTC |                     |

	|         | -p download-only-150500        |                      |                   |         |                     |                     |

	|         | --force --alsologtostderr      |                      |                   |         |                     |                     |

	|         | --kubernetes-version=v1.31.2   |                      |                   |         |                     |                     |

	|         | --container-runtime=docker     |                      |                   |         |                     |                     |

	|         | --driver=docker                |                      |                   |         |                     |                     |

	|---------|--------------------------------|----------------------|-------------------|---------|---------------------|---------------------|

	==> Last Start <==

	Log file created at: 2024/12/16 10:19:48

	Running on machine: minikube4

	Binary: Built with gc go1.23.3 for windows/amd64

	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg

	I1216 10:19:48.814011    8672 out.go:345] Setting OutFile to fd 828 ...

	I1216 10:19:48.888166    8672 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I1216 10:19:48.888823    8672 out.go:358] Setting ErrFile to fd 832...

	I1216 10:19:48.888823    8672 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I1216 10:19:48.910529    8672 out.go:352] Setting JSON to true

	I1216 10:19:48.915286    8672 start.go:129] hostinfo: {"hostname":"minikube4","uptime":394659,"bootTime":1733949729,"procs":206,"os":"windows","platform":"Microsoft Windows 10 Enterprise N","platformFamily":"Standalone Workstation","platformVersion":"10.0.19045.5198 Build 19045.5198","kernelVersion":"10.0.19045.5198 Build 19045.5198","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"df6bfb5f-73f2-4acb-9365-df7854ecbb28"}

	W1216 10:19:48.915850    8672 start.go:137] gopshost.Virtualization returned error: not implemented yet

	I1216 10:19:48.931042    8672 out.go:97] [download-only-150500] minikube v1.34.0 on Microsoft Windows 10 Enterprise N 10.0.19045.5198 Build 19045.5198

	I1216 10:19:48.931362    8672 notify.go:220] Checking for updates...

	I1216 10:19:48.940947    8672 out.go:169] KUBECONFIG=C:\Users\jenkins.minikube4\minikube-integration\kubeconfig

	I1216 10:19:48.949341    8672 out.go:169] MINIKUBE_HOME=C:\Users\jenkins.minikube4\minikube-integration\.minikube

	I1216 10:19:48.957308    8672 out.go:169] MINIKUBE_LOCATION=20107

	I1216 10:19:48.966536    8672 out.go:169] MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	W1216 10:19:48.998041    8672 out.go:321] minikube skips various validations when --force is supplied; this may lead to unexpected behavior

	I1216 10:19:48.999731    8672 driver.go:394] Setting default libvirt URI to qemu:///system

	I1216 10:19:49.189508    8672 docker.go:123] docker version: linux-27.2.0:Docker Desktop 4.34.2 (167172)

	I1216 10:19:49.205392    8672 cli_runner.go:164] Run: docker system info --format "{{json .}}"

	I1216 10:19:49.609640    8672 info.go:266] docker info: {ID:a15b78d1-f772-48f7-bbf5-f8fe086f3f87 Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:0 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:53 OomKillDisable:true NGoroutines:76 SystemTime:2024-12-16 10:19:49.579177423 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:12 KernelVersion:5.15.153.1-microsoft-standard-WSL2 OperatingSystem:Docker Desktop OSType:linux Architecture:x86_64 Ind

exServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:16 MemTotal:33657536512 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy:http.docker.internal:3128 HTTPSProxy:http.docker.internal:3128 NoProxy:hubproxy.docker.internal Name:docker-desktop Labels:[com.docker.desktop.address=npipe://\\.\pipe\docker_cli] ExperimentalBuild:false ServerVersion:27.2.0 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:8fc6bcff51318944179630522a095cc9dbf9f353 Expected:8fc6bcff51318944179630522a095cc9dbf9f353} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0

Expected:de40ad0} SecurityOptions:[name=seccomp,profile=unconfined] ProductLicense: Warnings:[WARNING: No blkio throttle.read_bps_device support WARNING: No blkio throttle.write_bps_device support WARNING: No blkio throttle.read_iops_device support WARNING: No blkio throttle.write_iops_device support WARNING: daemon is not using the default seccomp profile] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:C:\Program Files\Docker\cli-plugins\docker-buildx.exe SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.16.2-desktop.1] map[Name:compose Path:C:\Program Files\Docker\cli-plugins\docker-compose.exe SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.2-desktop.2] map[Name:debug Path:C:\Program Files\Docker\cli-plugins\docker-debug.exe SchemaVersion:0.1.0 ShortDescription:Get a shell into any image or container Vendor:Docker Inc. Version:0.0.34] map[Name:desktop Path:C:\Program Files\Docker\cli-plugins\docker-desktop.exe Schema

Version:0.1.0 ShortDescription:Docker Desktop commands (Alpha) Vendor:Docker Inc. Version:v0.0.15] map[Name:dev Path:C:\Program Files\Docker\cli-plugins\docker-dev.exe SchemaVersion:0.1.0 ShortDescription:Docker Dev Environments Vendor:Docker Inc. Version:v0.1.2] map[Name:extension Path:C:\Program Files\Docker\cli-plugins\docker-extension.exe SchemaVersion:0.1.0 ShortDescription:Manages Docker extensions Vendor:Docker Inc. Version:v0.2.25] map[Name:feedback Path:C:\Program Files\Docker\cli-plugins\docker-feedback.exe SchemaVersion:0.1.0 ShortDescription:Provide feedback, right in your terminal! Vendor:Docker Inc. Version:v1.0.5] map[Name:init Path:C:\Program Files\Docker\cli-plugins\docker-init.exe SchemaVersion:0.1.0 ShortDescription:Creates Docker-related starter files for your project Vendor:Docker Inc. Version:v1.3.0] map[Name:sbom Path:C:\Program Files\Docker\cli-plugins\docker-sbom.exe SchemaVersion:0.1.0 ShortDescription:View the packaged-based Software Bill Of Materials (SBOM) for an image URL:https:/

/github.com/docker/sbom-cli-plugin Vendor:Anchore Inc. Version:0.6.0] map[Name:scout Path:C:\Program Files\Docker\cli-plugins\docker-scout.exe SchemaVersion:0.1.0 ShortDescription:Docker Scout Vendor:Docker Inc. Version:v1.13.0]] Warnings:<nil>}}

	I1216 10:19:49.630216    8672 out.go:97] Using the docker driver based on user configuration

	I1216 10:19:49.630393    8672 start.go:297] selected driver: docker

	I1216 10:19:49.630393    8672 start.go:901] validating driver "docker" against <nil>

	I1216 10:19:49.649674    8672 cli_runner.go:164] Run: docker system info --format "{{json .}}"

	I1216 10:19:49.965038    8672 info.go:266] docker info: {ID:a15b78d1-f772-48f7-bbf5-f8fe086f3f87 Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:0 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:53 OomKillDisable:true NGoroutines:76 SystemTime:2024-12-16 10:19:49.939561583 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:12 KernelVersion:5.15.153.1-microsoft-standard-WSL2 OperatingSystem:Docker Desktop OSType:linux Architecture:x86_64 Ind

exServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:16 MemTotal:33657536512 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy:http.docker.internal:3128 HTTPSProxy:http.docker.internal:3128 NoProxy:hubproxy.docker.internal Name:docker-desktop Labels:[com.docker.desktop.address=npipe://\\.\pipe\docker_cli] ExperimentalBuild:false ServerVersion:27.2.0 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:8fc6bcff51318944179630522a095cc9dbf9f353 Expected:8fc6bcff51318944179630522a095cc9dbf9f353} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0

Expected:de40ad0} SecurityOptions:[name=seccomp,profile=unconfined] ProductLicense: Warnings:[WARNING: No blkio throttle.read_bps_device support WARNING: No blkio throttle.write_bps_device support WARNING: No blkio throttle.read_iops_device support WARNING: No blkio throttle.write_iops_device support WARNING: daemon is not using the default seccomp profile] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:C:\Program Files\Docker\cli-plugins\docker-buildx.exe SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.16.2-desktop.1] map[Name:compose Path:C:\Program Files\Docker\cli-plugins\docker-compose.exe SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.2-desktop.2] map[Name:debug Path:C:\Program Files\Docker\cli-plugins\docker-debug.exe SchemaVersion:0.1.0 ShortDescription:Get a shell into any image or container Vendor:Docker Inc. Version:0.0.34] map[Name:desktop Path:C:\Program Files\Docker\cli-plugins\docker-desktop.exe Schema

Version:0.1.0 ShortDescription:Docker Desktop commands (Alpha) Vendor:Docker Inc. Version:v0.0.15] map[Name:dev Path:C:\Program Files\Docker\cli-plugins\docker-dev.exe SchemaVersion:0.1.0 ShortDescription:Docker Dev Environments Vendor:Docker Inc. Version:v0.1.2] map[Name:extension Path:C:\Program Files\Docker\cli-plugins\docker-extension.exe SchemaVersion:0.1.0 ShortDescription:Manages Docker extensions Vendor:Docker Inc. Version:v0.2.25] map[Name:feedback Path:C:\Program Files\Docker\cli-plugins\docker-feedback.exe SchemaVersion:0.1.0 ShortDescription:Provide feedback, right in your terminal! Vendor:Docker Inc. Version:v1.0.5] map[Name:init Path:C:\Program Files\Docker\cli-plugins\docker-init.exe SchemaVersion:0.1.0 ShortDescription:Creates Docker-related starter files for your project Vendor:Docker Inc. Version:v1.3.0] map[Name:sbom Path:C:\Program Files\Docker\cli-plugins\docker-sbom.exe SchemaVersion:0.1.0 ShortDescription:View the packaged-based Software Bill Of Materials (SBOM) for an image URL:https:/

/github.com/docker/sbom-cli-plugin Vendor:Anchore Inc. Version:0.6.0] map[Name:scout Path:C:\Program Files\Docker\cli-plugins\docker-scout.exe SchemaVersion:0.1.0 ShortDescription:Docker Scout Vendor:Docker Inc. Version:v1.13.0]] Warnings:<nil>}}

	I1216 10:19:49.965380    8672 start_flags.go:310] no existing cluster config was found, will generate one from the flags 

	I1216 10:19:50.013328    8672 start_flags.go:393] Using suggested 16300MB memory alloc based on sys=65534MB, container=32098MB

	I1216 10:19:50.014003    8672 start_flags.go:929] Wait components to verify : map[apiserver:true system_pods:true]

	I1216 10:19:50.027185    8672 out.go:169] Using Docker Desktop driver with root privileges

	I1216 10:19:50.032026    8672 cni.go:84] Creating CNI manager for ""

	I1216 10:19:50.032026    8672 cni.go:158] "docker" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge

	I1216 10:19:50.032026    8672 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni

	I1216 10:19:50.033039    8672 start.go:340] cluster config:

	{Name:download-only-150500 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1733912881-20083@sha256:64d8b27f78fd269d886e21ba8fc88be20de183ba5cc5bce33d0810e8a65f1df2 Memory:16300 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.2 ClusterName:download-only-150500 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local C

ontainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:C:\Users\jenkins.minikube4:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I1216 10:19:50.037206    8672 out.go:97] Starting "download-only-150500" primary control-plane node in "download-only-150500" cluster

	I1216 10:19:50.038045    8672 cache.go:121] Beginning downloading kic base image for docker with docker

	I1216 10:19:50.043533    8672 out.go:97] Pulling base image v0.0.45-1733912881-20083 ...

	I1216 10:19:50.043533    8672 preload.go:131] Checking if preload exists for k8s version v1.31.2 and runtime docker

	I1216 10:19:50.043533    8672 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1733912881-20083@sha256:64d8b27f78fd269d886e21ba8fc88be20de183ba5cc5bce33d0810e8a65f1df2 in local docker daemon

	I1216 10:19:50.089413    8672 preload.go:118] Found remote preload: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.31.2/preloaded-images-k8s-v18-v1.31.2-docker-overlay2-amd64.tar.lz4

	I1216 10:19:50.089538    8672 cache.go:56] Caching tarball of preloaded images

	I1216 10:19:50.090210    8672 preload.go:131] Checking if preload exists for k8s version v1.31.2 and runtime docker

	I1216 10:19:50.094322    8672 out.go:97] Downloading Kubernetes v1.31.2 preload ...

	I1216 10:19:50.094322    8672 preload.go:236] getting checksum for preloaded-images-k8s-v18-v1.31.2-docker-overlay2-amd64.tar.lz4 ...

	I1216 10:19:50.126755    8672 cache.go:149] Downloading gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1733912881-20083@sha256:64d8b27f78fd269d886e21ba8fc88be20de183ba5cc5bce33d0810e8a65f1df2 to local cache

	I1216 10:19:50.127157    8672 localpath.go:146] windows sanitize: C:\Users\jenkins.minikube4\minikube-integration\.minikube\cache\kic\amd64\kicbase-builds:v0.0.45-1733912881-20083@sha256:64d8b27f78fd269d886e21ba8fc88be20de183ba5cc5bce33d0810e8a65f1df2.tar -> C:\Users\jenkins.minikube4\minikube-integration\.minikube\cache\kic\amd64\kicbase-builds_v0.0.45-1733912881-20083@sha256_64d8b27f78fd269d886e21ba8fc88be20de183ba5cc5bce33d0810e8a65f1df2.tar

	I1216 10:19:50.127255    8672 localpath.go:146] windows sanitize: C:\Users\jenkins.minikube4\minikube-integration\.minikube\cache\kic\amd64\kicbase-builds:v0.0.45-1733912881-20083@sha256:64d8b27f78fd269d886e21ba8fc88be20de183ba5cc5bce33d0810e8a65f1df2.tar -> C:\Users\jenkins.minikube4\minikube-integration\.minikube\cache\kic\amd64\kicbase-builds_v0.0.45-1733912881-20083@sha256_64d8b27f78fd269d886e21ba8fc88be20de183ba5cc5bce33d0810e8a65f1df2.tar

	I1216 10:19:50.127255    8672 image.go:63] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1733912881-20083@sha256:64d8b27f78fd269d886e21ba8fc88be20de183ba5cc5bce33d0810e8a65f1df2 in local cache directory

	I1216 10:19:50.127255    8672 image.go:66] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1733912881-20083@sha256:64d8b27f78fd269d886e21ba8fc88be20de183ba5cc5bce33d0810e8a65f1df2 in local cache directory, skipping pull

	I1216 10:19:50.127255    8672 image.go:135] gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1733912881-20083@sha256:64d8b27f78fd269d886e21ba8fc88be20de183ba5cc5bce33d0810e8a65f1df2 exists in cache, skipping pull

	I1216 10:19:50.127255    8672 cache.go:152] successfully saved gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1733912881-20083@sha256:64d8b27f78fd269d886e21ba8fc88be20de183ba5cc5bce33d0810e8a65f1df2 as a tarball

	I1216 10:19:50.160544    8672 download.go:107] Downloading: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.31.2/preloaded-images-k8s-v18-v1.31.2-docker-overlay2-amd64.tar.lz4?checksum=md5:979f32540b837894423b337fec69fbf6 -> C:\Users\jenkins.minikube4\minikube-integration\.minikube\cache\preloaded-tarball\preloaded-images-k8s-v18-v1.31.2-docker-overlay2-amd64.tar.lz4

	I1216 10:19:53.304942    8672 preload.go:247] saving checksum for preloaded-images-k8s-v18-v1.31.2-docker-overlay2-amd64.tar.lz4 ...

	I1216 10:19:53.305945    8672 preload.go:254] verifying checksum of C:\Users\jenkins.minikube4\minikube-integration\.minikube\cache\preloaded-tarball\preloaded-images-k8s-v18-v1.31.2-docker-overlay2-amd64.tar.lz4 ...

	* The control-plane node download-only-150500 host does not exist

	  To start a cluster, run: "minikube start -p download-only-150500"

-- /stdout --

aaa_download_only_test.go:185: minikube logs failed with error: exit status 85

--- PASS: TestDownloadOnly/v1.31.2/LogsDuration (0.74s)

=== RUN   TestDownloadOnly/v1.31.2/DeleteAll

aaa_download_only_test.go:197: (dbg) Run:  out/minikube-windows-amd64.exe delete --all

aaa_download_only_test.go:197: (dbg) Done: out/minikube-windows-amd64.exe delete --all: (1.4078854s)

--- PASS: TestDownloadOnly/v1.31.2/DeleteAll (1.41s)

=== RUN   TestDownloadOnly/v1.31.2/DeleteAlwaysSucceeds

aaa_download_only_test.go:208: (dbg) Run:  out/minikube-windows-amd64.exe delete -p download-only-150500

--- PASS: TestDownloadOnly/v1.31.2/DeleteAlwaysSucceeds (0.64s)

=== RUN   TestDownloadOnlyKic

aaa_download_only_test.go:232: (dbg) Run:  out/minikube-windows-amd64.exe start --download-only -p download-docker-145000 --alsologtostderr --driver=docker

aaa_download_only_test.go:232: (dbg) Done: out/minikube-windows-amd64.exe start --download-only -p download-docker-145000 --alsologtostderr --driver=docker: (1.648049s)

helpers_test.go:175: Cleaning up "download-docker-145000" profile ...

helpers_test.go:178: (dbg) Run:  out/minikube-windows-amd64.exe delete -p download-docker-145000

--- PASS: TestDownloadOnlyKic (3.33s)

=== RUN   TestBinaryMirror

I1216 10:20:03.213231   11452 binary.go:74] Not caching binary, using https://dl.k8s.io/release/v1.31.2/bin/windows/amd64/kubectl.exe?checksum=file:https://dl.k8s.io/release/v1.31.2/bin/windows/amd64/kubectl.exe.sha256

aaa_download_only_test.go:314: (dbg) Run:  out/minikube-windows-amd64.exe start --download-only -p binary-mirror-296500 --alsologtostderr --binary-mirror http://127.0.0.1:63789 --driver=docker

aaa_download_only_test.go:314: (dbg) Done: out/minikube-windows-amd64.exe start --download-only -p binary-mirror-296500 --alsologtostderr --binary-mirror http://127.0.0.1:63789 --driver=docker: (1.7373261s)

helpers_test.go:175: Cleaning up "binary-mirror-296500" profile ...

helpers_test.go:178: (dbg) Run:  out/minikube-windows-amd64.exe delete -p binary-mirror-296500

--- PASS: TestBinaryMirror (2.82s)

=== RUN   TestOffline

=== PAUSE TestOffline

=== CONT  TestOffline

aab_offline_test.go:55: (dbg) Run:  out/minikube-windows-amd64.exe start -p offline-docker-583800 --alsologtostderr -v=1 --memory=2048 --wait=true --driver=docker

aab_offline_test.go:55: (dbg) Done: out/minikube-windows-amd64.exe start -p offline-docker-583800 --alsologtostderr -v=1 --memory=2048 --wait=true --driver=docker: (2m17.2174878s)

helpers_test.go:175: Cleaning up "offline-docker-583800" profile ...

helpers_test.go:178: (dbg) Run:  out/minikube-windows-amd64.exe delete -p offline-docker-583800

helpers_test.go:178: (dbg) Done: out/minikube-windows-amd64.exe delete -p offline-docker-583800: (5.748222s)

--- PASS: TestOffline (142.97s)

=== RUN   TestAddons/PreSetup/EnablingAddonOnNonExistingCluster

=== PAUSE TestAddons/PreSetup/EnablingAddonOnNonExistingCluster

=== CONT  TestAddons/PreSetup/EnablingAddonOnNonExistingCluster

addons_test.go:939: (dbg) Run:  out/minikube-windows-amd64.exe addons enable dashboard -p addons-434500

addons_test.go:939: (dbg) Non-zero exit: out/minikube-windows-amd64.exe addons enable dashboard -p addons-434500: exit status 85 (248.4824ms)

-- stdout --

	* Profile "addons-434500" not found. Run "minikube profile list" to view all profiles.

	  To start a cluster, run: "minikube start -p addons-434500"

-- /stdout --

--- PASS: TestAddons/PreSetup/EnablingAddonOnNonExistingCluster (0.25s)

=== RUN   TestAddons/PreSetup/DisablingAddonOnNonExistingCluster

=== PAUSE TestAddons/PreSetup/DisablingAddonOnNonExistingCluster

=== CONT  TestAddons/PreSetup/DisablingAddonOnNonExistingCluster

addons_test.go:950: (dbg) Run:  out/minikube-windows-amd64.exe addons disable dashboard -p addons-434500

addons_test.go:950: (dbg) Non-zero exit: out/minikube-windows-amd64.exe addons disable dashboard -p addons-434500: exit status 85 (265.709ms)

-- stdout --

	* Profile "addons-434500" not found. Run "minikube profile list" to view all profiles.

	  To start a cluster, run: "minikube start -p addons-434500"

-- /stdout --

--- PASS: TestAddons/PreSetup/DisablingAddonOnNonExistingCluster (0.27s)

=== RUN   TestAddons/Setup

addons_test.go:107: (dbg) Run:  out/minikube-windows-amd64.exe start -p addons-434500 --wait=true --memory=4000 --alsologtostderr --addons=registry --addons=metrics-server --addons=volumesnapshots --addons=csi-hostpath-driver --addons=gcp-auth --addons=cloud-spanner --addons=inspektor-gadget --addons=nvidia-device-plugin --addons=yakd --addons=volcano --addons=amd-gpu-device-plugin --driver=docker --addons=ingress --addons=ingress-dns --addons=storage-provisioner-rancher

addons_test.go:107: (dbg) Done: out/minikube-windows-amd64.exe start -p addons-434500 --wait=true --memory=4000 --alsologtostderr --addons=registry --addons=metrics-server --addons=volumesnapshots --addons=csi-hostpath-driver --addons=gcp-auth --addons=cloud-spanner --addons=inspektor-gadget --addons=nvidia-device-plugin --addons=yakd --addons=volcano --addons=amd-gpu-device-plugin --driver=docker --addons=ingress --addons=ingress-dns --addons=storage-provisioner-rancher: (8m33.197374s)

--- PASS: TestAddons/Setup (513.20s)

=== RUN   TestAddons/serial/Volcano

addons_test.go:807: volcano-scheduler stabilized in 20.9945ms

addons_test.go:815: volcano-admission stabilized in 21.9886ms

addons_test.go:823: volcano-controller stabilized in 21.9886ms

addons_test.go:829: (dbg) TestAddons/serial/Volcano: waiting 6m0s for pods matching "app=volcano-scheduler" in namespace "volcano-system" ...

helpers_test.go:344: "volcano-scheduler-6c9778cbdf-7bmk7" [8a3d53cd-8558-43a3-aeea-fc012874940f] Running

addons_test.go:829: (dbg) TestAddons/serial/Volcano: app=volcano-scheduler healthy within 5.0090329s

addons_test.go:833: (dbg) TestAddons/serial/Volcano: waiting 6m0s for pods matching "app=volcano-admission" in namespace "volcano-system" ...

helpers_test.go:344: "volcano-admission-5874dfdd79-79dkh" [2e9972d7-174a-41e3-a29c-0d66ab940c19] Running

addons_test.go:833: (dbg) TestAddons/serial/Volcano: app=volcano-admission healthy within 5.0085679s

addons_test.go:837: (dbg) TestAddons/serial/Volcano: waiting 6m0s for pods matching "app=volcano-controller" in namespace "volcano-system" ...

helpers_test.go:344: "volcano-controllers-789ffc5785-9l8p6" [713c9dfa-1947-46fa-abbe-bc8609cf89e0] Running

addons_test.go:837: (dbg) TestAddons/serial/Volcano: app=volcano-controller healthy within 5.0076482s

addons_test.go:842: (dbg) Run:  kubectl --context addons-434500 delete -n volcano-system job volcano-admission-init

addons_test.go:848: (dbg) Run:  kubectl --context addons-434500 create -f testdata\vcjob.yaml

addons_test.go:856: (dbg) Run:  kubectl --context addons-434500 get vcjob -n my-volcano

addons_test.go:874: (dbg) TestAddons/serial/Volcano: waiting 3m0s for pods matching "volcano.sh/job-name=test-job" in namespace "my-volcano" ...

helpers_test.go:344: "test-job-nginx-0" [5ef71a80-d4f1-42d9-a450-602d193cf9ff] Pending

helpers_test.go:344: "test-job-nginx-0" [5ef71a80-d4f1-42d9-a450-602d193cf9ff] Pending / Ready:ContainersNotReady (containers with unready status: [nginx]) / ContainersReady:ContainersNotReady (containers with unready status: [nginx])

helpers_test.go:344: "test-job-nginx-0" [5ef71a80-d4f1-42d9-a450-602d193cf9ff] Running

addons_test.go:874: (dbg) TestAddons/serial/Volcano: volcano.sh/job-name=test-job healthy within 27.0077684s

addons_test.go:992: (dbg) Run:  out/minikube-windows-amd64.exe -p addons-434500 addons disable volcano --alsologtostderr -v=1

addons_test.go:992: (dbg) Done: out/minikube-windows-amd64.exe -p addons-434500 addons disable volcano --alsologtostderr -v=1: (12.2925145s)

--- PASS: TestAddons/serial/Volcano (55.26s)

=== RUN   TestAddons/serial/GCPAuth/Namespaces

addons_test.go:569: (dbg) Run:  kubectl --context addons-434500 create ns new-namespace

addons_test.go:583: (dbg) Run:  kubectl --context addons-434500 get secret gcp-auth -n new-namespace

--- PASS: TestAddons/serial/GCPAuth/Namespaces (0.36s)

=== RUN   TestAddons/serial/GCPAuth/FakeCredentials

addons_test.go:614: (dbg) Run:  kubectl --context addons-434500 create -f testdata\busybox.yaml

addons_test.go:621: (dbg) Run:  kubectl --context addons-434500 create sa gcp-auth-test

addons_test.go:627: (dbg) TestAddons/serial/GCPAuth/FakeCredentials: waiting 8m0s for pods matching "integration-test=busybox" in namespace "default" ...

helpers_test.go:344: "busybox" [fd44ccb6-999d-4d87-9fd4-bb08bd957c00] Pending / Ready:ContainersNotReady (containers with unready status: [busybox]) / ContainersReady:ContainersNotReady (containers with unready status: [busybox])

helpers_test.go:344: "busybox" [fd44ccb6-999d-4d87-9fd4-bb08bd957c00] Running

addons_test.go:627: (dbg) TestAddons/serial/GCPAuth/FakeCredentials: integration-test=busybox healthy within 9.0070849s

addons_test.go:633: (dbg) Run:  kubectl --context addons-434500 exec busybox -- /bin/sh -c "printenv GOOGLE_APPLICATION_CREDENTIALS"

addons_test.go:645: (dbg) Run:  kubectl --context addons-434500 describe sa gcp-auth-test

addons_test.go:659: (dbg) Run:  kubectl --context addons-434500 exec busybox -- /bin/sh -c "cat /google-app-creds.json"

addons_test.go:683: (dbg) Run:  kubectl --context addons-434500 exec busybox -- /bin/sh -c "printenv GOOGLE_CLOUD_PROJECT"

--- PASS: TestAddons/serial/GCPAuth/FakeCredentials (10.65s)

=== RUN   TestAddons/parallel/InspektorGadget

=== PAUSE TestAddons/parallel/InspektorGadget

=== CONT  TestAddons/parallel/InspektorGadget

addons_test.go:762: (dbg) TestAddons/parallel/InspektorGadget: waiting 8m0s for pods matching "k8s-app=gadget" in namespace "gadget" ...

helpers_test.go:344: "gadget-j88rt" [a6e07807-9cb9-4900-aa57-a81d1976314a] Running

addons_test.go:762: (dbg) TestAddons/parallel/InspektorGadget: k8s-app=gadget healthy within 6.0089481s

addons_test.go:992: (dbg) Run:  out/minikube-windows-amd64.exe -p addons-434500 addons disable inspektor-gadget --alsologtostderr -v=1

addons_test.go:992: (dbg) Done: out/minikube-windows-amd64.exe -p addons-434500 addons disable inspektor-gadget --alsologtostderr -v=1: (8.7929907s)

--- PASS: TestAddons/parallel/InspektorGadget (14.80s)

=== RUN   TestAddons/parallel/MetricsServer

=== PAUSE TestAddons/parallel/MetricsServer

=== CONT  TestAddons/parallel/MetricsServer

addons_test.go:394: metrics-server stabilized in 8.6523ms

addons_test.go:396: (dbg) TestAddons/parallel/MetricsServer: waiting 6m0s for pods matching "k8s-app=metrics-server" in namespace "kube-system" ...

helpers_test.go:344: "metrics-server-84c5f94fbc-nhgl2" [c6a2fb4b-d7a1-4ce0-8d7b-97a3a272417a] Running

addons_test.go:396: (dbg) TestAddons/parallel/MetricsServer: k8s-app=metrics-server healthy within 6.0461777s

addons_test.go:402: (dbg) Run:  kubectl --context addons-434500 top pods -n kube-system

addons_test.go:992: (dbg) Run:  out/minikube-windows-amd64.exe -p addons-434500 addons disable metrics-server --alsologtostderr -v=1

addons_test.go:992: (dbg) Done: out/minikube-windows-amd64.exe -p addons-434500 addons disable metrics-server --alsologtostderr -v=1: (4.3056017s)

--- PASS: TestAddons/parallel/MetricsServer (10.63s)

=== RUN   TestAddons/parallel/CSI

=== PAUSE TestAddons/parallel/CSI

=== CONT  TestAddons/parallel/CSI

I1216 10:30:24.753966   11452 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=csi-hostpath-driver" in ns "kube-system" ...

I1216 10:30:24.810113   11452 kapi.go:86] Found 3 Pods for label selector kubernetes.io/minikube-addons=csi-hostpath-driver

I1216 10:30:24.810220   11452 kapi.go:107] duration metric: took 56.3267ms to wait for kubernetes.io/minikube-addons=csi-hostpath-driver ...

addons_test.go:488: csi-hostpath-driver pods stabilized in 56.3267ms

addons_test.go:491: (dbg) Run:  kubectl --context addons-434500 create -f testdata\csi-hostpath-driver\pvc.yaml

addons_test.go:496: (dbg) TestAddons/parallel/CSI: waiting 6m0s for pvc "hpvc" in namespace "default" ...

helpers_test.go:394: (dbg) Run:  kubectl --context addons-434500 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-434500 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-434500 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-434500 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-434500 get pvc hpvc -o jsonpath={.status.phase} -n default

addons_test.go:501: (dbg) Run:  kubectl --context addons-434500 create -f testdata\csi-hostpath-driver\pv-pod.yaml

addons_test.go:506: (dbg) TestAddons/parallel/CSI: waiting 6m0s for pods matching "app=task-pv-pod" in namespace "default" ...

helpers_test.go:344: "task-pv-pod" [531bbefc-08d0-4557-bb86-2e9fd69777c0] Pending

helpers_test.go:344: "task-pv-pod" [531bbefc-08d0-4557-bb86-2e9fd69777c0] Pending / Ready:ContainersNotReady (containers with unready status: [task-pv-container]) / ContainersReady:ContainersNotReady (containers with unready status: [task-pv-container])

helpers_test.go:344: "task-pv-pod" [531bbefc-08d0-4557-bb86-2e9fd69777c0] Running

addons_test.go:506: (dbg) TestAddons/parallel/CSI: app=task-pv-pod healthy within 10.0711881s

addons_test.go:511: (dbg) Run:  kubectl --context addons-434500 create -f testdata\csi-hostpath-driver\snapshot.yaml

addons_test.go:516: (dbg) TestAddons/parallel/CSI: waiting 6m0s for volume snapshot "new-snapshot-demo" in namespace "default" ...

helpers_test.go:419: (dbg) Run:  kubectl --context addons-434500 get volumesnapshot new-snapshot-demo -o jsonpath={.status.readyToUse} -n default

helpers_test.go:419: (dbg) Run:  kubectl --context addons-434500 get volumesnapshot new-snapshot-demo -o jsonpath={.status.readyToUse} -n default

addons_test.go:521: (dbg) Run:  kubectl --context addons-434500 delete pod task-pv-pod

addons_test.go:521: (dbg) Done: kubectl --context addons-434500 delete pod task-pv-pod: (2.4915319s)

addons_test.go:527: (dbg) Run:  kubectl --context addons-434500 delete pvc hpvc

addons_test.go:533: (dbg) Run:  kubectl --context addons-434500 create -f testdata\csi-hostpath-driver\pvc-restore.yaml

addons_test.go:538: (dbg) TestAddons/parallel/CSI: waiting 6m0s for pvc "hpvc-restore" in namespace "default" ...

helpers_test.go:394: (dbg) Run:  kubectl --context addons-434500 get pvc hpvc-restore -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-434500 get pvc hpvc-restore -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-434500 get pvc hpvc-restore -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-434500 get pvc hpvc-restore -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-434500 get pvc hpvc-restore -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-434500 get pvc hpvc-restore -o jsonpath={.status.phase} -n default

addons_test.go:543: (dbg) Run:  kubectl --context addons-434500 create -f testdata\csi-hostpath-driver\pv-pod-restore.yaml

addons_test.go:548: (dbg) TestAddons/parallel/CSI: waiting 6m0s for pods matching "app=task-pv-pod-restore" in namespace "default" ...

helpers_test.go:344: "task-pv-pod-restore" [e6362d79-ca49-4435-b172-c353ac62becc] Pending

helpers_test.go:344: "task-pv-pod-restore" [e6362d79-ca49-4435-b172-c353ac62becc] Pending / Ready:ContainersNotReady (containers with unready status: [task-pv-container]) / ContainersReady:ContainersNotReady (containers with unready status: [task-pv-container])

helpers_test.go:344: "task-pv-pod-restore" [e6362d79-ca49-4435-b172-c353ac62becc] Running

addons_test.go:548: (dbg) TestAddons/parallel/CSI: app=task-pv-pod-restore healthy within 8.0120071s

addons_test.go:553: (dbg) Run:  kubectl --context addons-434500 delete pod task-pv-pod-restore

addons_test.go:553: (dbg) Done: kubectl --context addons-434500 delete pod task-pv-pod-restore: (1.1722379s)

addons_test.go:557: (dbg) Run:  kubectl --context addons-434500 delete pvc hpvc-restore

addons_test.go:561: (dbg) Run:  kubectl --context addons-434500 delete volumesnapshot new-snapshot-demo

addons_test.go:992: (dbg) Run:  out/minikube-windows-amd64.exe -p addons-434500 addons disable volumesnapshots --alsologtostderr -v=1

addons_test.go:992: (dbg) Done: out/minikube-windows-amd64.exe -p addons-434500 addons disable volumesnapshots --alsologtostderr -v=1: (2.2191622s)

addons_test.go:992: (dbg) Run:  out/minikube-windows-amd64.exe -p addons-434500 addons disable csi-hostpath-driver --alsologtostderr -v=1

addons_test.go:992: (dbg) Done: out/minikube-windows-amd64.exe -p addons-434500 addons disable csi-hostpath-driver --alsologtostderr -v=1: (8.8181167s)

--- PASS: TestAddons/parallel/CSI (46.41s)

=== RUN   TestAddons/parallel/Headlamp

=== PAUSE TestAddons/parallel/Headlamp

=== CONT  TestAddons/parallel/Headlamp

addons_test.go:747: (dbg) Run:  out/minikube-windows-amd64.exe addons enable headlamp -p addons-434500 --alsologtostderr -v=1

addons_test.go:747: (dbg) Done: out/minikube-windows-amd64.exe addons enable headlamp -p addons-434500 --alsologtostderr -v=1: (1.9129938s)

addons_test.go:752: (dbg) TestAddons/parallel/Headlamp: waiting 8m0s for pods matching "app.kubernetes.io/name=headlamp" in namespace "headlamp" ...

helpers_test.go:344: "headlamp-cd8ffd6fc-696tv" [f81c0529-0e37-408d-839e-2251962349c7] Pending / Ready:ContainersNotReady (containers with unready status: [headlamp]) / ContainersReady:ContainersNotReady (containers with unready status: [headlamp])

helpers_test.go:344: "headlamp-cd8ffd6fc-696tv" [f81c0529-0e37-408d-839e-2251962349c7] Running

addons_test.go:752: (dbg) TestAddons/parallel/Headlamp: app.kubernetes.io/name=headlamp healthy within 24.0470218s

addons_test.go:992: (dbg) Run:  out/minikube-windows-amd64.exe -p addons-434500 addons disable headlamp --alsologtostderr -v=1

addons_test.go:992: (dbg) Done: out/minikube-windows-amd64.exe -p addons-434500 addons disable headlamp --alsologtostderr -v=1: (7.9668101s)

--- PASS: TestAddons/parallel/Headlamp (33.93s)

=== RUN   TestAddons/parallel/CloudSpanner

=== PAUSE TestAddons/parallel/CloudSpanner

=== CONT  TestAddons/parallel/CloudSpanner

addons_test.go:779: (dbg) TestAddons/parallel/CloudSpanner: waiting 6m0s for pods matching "app=cloud-spanner-emulator" in namespace "default" ...

helpers_test.go:344: "cloud-spanner-emulator-dc5db94f4-4tl54" [1b24070b-e479-4b76-8a85-eb75967ce388] Running

addons_test.go:779: (dbg) TestAddons/parallel/CloudSpanner: app=cloud-spanner-emulator healthy within 6.0083291s

addons_test.go:992: (dbg) Run:  out/minikube-windows-amd64.exe -p addons-434500 addons disable cloud-spanner --alsologtostderr -v=1

addons_test.go:992: (dbg) Done: out/minikube-windows-amd64.exe -p addons-434500 addons disable cloud-spanner --alsologtostderr -v=1: (2.0491803s)

--- PASS: TestAddons/parallel/CloudSpanner (8.09s)

=== RUN   TestAddons/parallel/LocalPath

=== PAUSE TestAddons/parallel/LocalPath

=== CONT  TestAddons/parallel/LocalPath

addons_test.go:888: (dbg) Run:  kubectl --context addons-434500 apply -f testdata\storage-provisioner-rancher\pvc.yaml

addons_test.go:894: (dbg) Run:  kubectl --context addons-434500 apply -f testdata\storage-provisioner-rancher\pod.yaml

addons_test.go:898: (dbg) TestAddons/parallel/LocalPath: waiting 5m0s for pvc "test-pvc" in namespace "default" ...

helpers_test.go:394: (dbg) Run:  kubectl --context addons-434500 get pvc test-pvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-434500 get pvc test-pvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-434500 get pvc test-pvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-434500 get pvc test-pvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-434500 get pvc test-pvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-434500 get pvc test-pvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-434500 get pvc test-pvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-434500 get pvc test-pvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-434500 get pvc test-pvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-434500 get pvc test-pvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-434500 get pvc test-pvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-434500 get pvc test-pvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-434500 get pvc test-pvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-434500 get pvc test-pvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-434500 get pvc test-pvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-434500 get pvc test-pvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-434500 get pvc test-pvc -o jsonpath={.status.phase} -n default

addons_test.go:901: (dbg) TestAddons/parallel/LocalPath: waiting 3m0s for pods matching "run=test-local-path" in namespace "default" ...

helpers_test.go:344: "test-local-path" [83ad6a51-e12d-4890-86b2-cbeb9d11ff13] Pending

helpers_test.go:344: "test-local-path" [83ad6a51-e12d-4890-86b2-cbeb9d11ff13] Pending / Ready:ContainersNotReady (containers with unready status: [busybox]) / ContainersReady:ContainersNotReady (containers with unready status: [busybox])

helpers_test.go:344: "test-local-path" [83ad6a51-e12d-4890-86b2-cbeb9d11ff13] Pending / Initialized:PodCompleted / Ready:PodCompleted / ContainersReady:PodCompleted

helpers_test.go:344: "test-local-path" [83ad6a51-e12d-4890-86b2-cbeb9d11ff13] Succeeded / Initialized:PodCompleted / Ready:PodCompleted / ContainersReady:PodCompleted

addons_test.go:901: (dbg) TestAddons/parallel/LocalPath: run=test-local-path healthy within 9.0994561s

addons_test.go:906: (dbg) Run:  kubectl --context addons-434500 get pvc test-pvc -o=json

addons_test.go:915: (dbg) Run:  out/minikube-windows-amd64.exe -p addons-434500 ssh "cat /opt/local-path-provisioner/pvc-e6122696-a9c1-47c9-9e57-3f80094ac6cb_default_test-pvc/file1"

addons_test.go:927: (dbg) Run:  kubectl --context addons-434500 delete pod test-local-path

addons_test.go:931: (dbg) Run:  kubectl --context addons-434500 delete pvc test-pvc

addons_test.go:992: (dbg) Run:  out/minikube-windows-amd64.exe -p addons-434500 addons disable storage-provisioner-rancher --alsologtostderr -v=1

addons_test.go:992: (dbg) Done: out/minikube-windows-amd64.exe -p addons-434500 addons disable storage-provisioner-rancher --alsologtostderr -v=1: (47.1359867s)

--- PASS: TestAddons/parallel/LocalPath (75.02s)

=== RUN   TestAddons/parallel/NvidiaDevicePlugin

=== PAUSE TestAddons/parallel/NvidiaDevicePlugin

=== CONT  TestAddons/parallel/NvidiaDevicePlugin

addons_test.go:964: (dbg) TestAddons/parallel/NvidiaDevicePlugin: waiting 6m0s for pods matching "name=nvidia-device-plugin-ds" in namespace "kube-system" ...

helpers_test.go:344: "nvidia-device-plugin-daemonset-n8dt8" [f4da33d4-458b-42c6-82bb-b8c882e7b809] Running

addons_test.go:964: (dbg) TestAddons/parallel/NvidiaDevicePlugin: name=nvidia-device-plugin-ds healthy within 6.0576194s

addons_test.go:992: (dbg) Run:  out/minikube-windows-amd64.exe -p addons-434500 addons disable nvidia-device-plugin --alsologtostderr -v=1

addons_test.go:992: (dbg) Done: out/minikube-windows-amd64.exe -p addons-434500 addons disable nvidia-device-plugin --alsologtostderr -v=1: (1.6400495s)

--- PASS: TestAddons/parallel/NvidiaDevicePlugin (7.70s)

=== RUN   TestAddons/parallel/Yakd

=== PAUSE TestAddons/parallel/Yakd

=== CONT  TestAddons/parallel/Yakd

addons_test.go:986: (dbg) TestAddons/parallel/Yakd: waiting 2m0s for pods matching "app.kubernetes.io/name=yakd-dashboard" in namespace "yakd-dashboard" ...

helpers_test.go:344: "yakd-dashboard-67d98fc6b-p9n5h" [001dc94e-ba9f-46cb-a55d-7f2cdc96e658] Running

addons_test.go:986: (dbg) TestAddons/parallel/Yakd: app.kubernetes.io/name=yakd-dashboard healthy within 6.0409752s

addons_test.go:992: (dbg) Run:  out/minikube-windows-amd64.exe -p addons-434500 addons disable yakd --alsologtostderr -v=1

addons_test.go:992: (dbg) Done: out/minikube-windows-amd64.exe -p addons-434500 addons disable yakd --alsologtostderr -v=1: (7.227226s)

--- PASS: TestAddons/parallel/Yakd (13.27s)

=== RUN   TestAddons/parallel/AmdGpuDevicePlugin

=== PAUSE TestAddons/parallel/AmdGpuDevicePlugin

=== CONT  TestAddons/parallel/AmdGpuDevicePlugin

addons_test.go:977: (dbg) TestAddons/parallel/AmdGpuDevicePlugin: waiting 6m0s for pods matching "name=amd-gpu-device-plugin" in namespace "kube-system" ...

helpers_test.go:344: "amd-gpu-device-plugin-r8bmj" [5dd77a73-7e16-4b4d-ad8d-3a2690b0c92b] Running

addons_test.go:977: (dbg) TestAddons/parallel/AmdGpuDevicePlugin: name=amd-gpu-device-plugin healthy within 6.007665s

addons_test.go:992: (dbg) Run:  out/minikube-windows-amd64.exe -p addons-434500 addons disable amd-gpu-device-plugin --alsologtostderr -v=1

addons_test.go:992: (dbg) Done: out/minikube-windows-amd64.exe -p addons-434500 addons disable amd-gpu-device-plugin --alsologtostderr -v=1: (1.5810652s)

--- PASS: TestAddons/parallel/AmdGpuDevicePlugin (7.59s)

=== RUN   TestAddons/StoppedEnableDisable

addons_test.go:170: (dbg) Run:  out/minikube-windows-amd64.exe stop -p addons-434500

addons_test.go:170: (dbg) Done: out/minikube-windows-amd64.exe stop -p addons-434500: (12.1447765s)

addons_test.go:174: (dbg) Run:  out/minikube-windows-amd64.exe addons enable dashboard -p addons-434500

addons_test.go:178: (dbg) Run:  out/minikube-windows-amd64.exe addons disable dashboard -p addons-434500

addons_test.go:183: (dbg) Run:  out/minikube-windows-amd64.exe addons disable gvisor -p addons-434500

--- PASS: TestAddons/StoppedEnableDisable (13.32s)

=== RUN   TestCertOptions

=== PAUSE TestCertOptions

=== CONT  TestCertOptions

cert_options_test.go:49: (dbg) Run:  out/minikube-windows-amd64.exe start -p cert-options-493800 --memory=2048 --apiserver-ips=127.0.0.1 --apiserver-ips=192.168.15.15 --apiserver-names=localhost --apiserver-names=www.google.com --apiserver-port=8555 --driver=docker --apiserver-name=localhost

cert_options_test.go:49: (dbg) Done: out/minikube-windows-amd64.exe start -p cert-options-493800 --memory=2048 --apiserver-ips=127.0.0.1 --apiserver-ips=192.168.15.15 --apiserver-names=localhost --apiserver-names=www.google.com --apiserver-port=8555 --driver=docker --apiserver-name=localhost: (1m10.8643525s)

cert_options_test.go:60: (dbg) Run:  out/minikube-windows-amd64.exe -p cert-options-493800 ssh "openssl x509 -text -noout -in /var/lib/minikube/certs/apiserver.crt"

I1216 11:36:08.929215   11452 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "8555/tcp") 0).HostPort}}'" cert-options-493800

cert_options_test.go:100: (dbg) Run:  out/minikube-windows-amd64.exe ssh -p cert-options-493800 -- "sudo cat /etc/kubernetes/admin.conf"

cert_options_test.go:100: (dbg) Done: out/minikube-windows-amd64.exe ssh -p cert-options-493800 -- "sudo cat /etc/kubernetes/admin.conf": (1.1099325s)

helpers_test.go:175: Cleaning up "cert-options-493800" profile ...

helpers_test.go:178: (dbg) Run:  out/minikube-windows-amd64.exe delete -p cert-options-493800

helpers_test.go:178: (dbg) Done: out/minikube-windows-amd64.exe delete -p cert-options-493800: (6.1955796s)

--- PASS: TestCertOptions (79.25s)

=== RUN   TestCertExpiration

=== PAUSE TestCertExpiration

=== CONT  TestCertExpiration

cert_options_test.go:123: (dbg) Run:  out/minikube-windows-amd64.exe start -p cert-expiration-824000 --memory=2048 --cert-expiration=3m --driver=docker

cert_options_test.go:123: (dbg) Done: out/minikube-windows-amd64.exe start -p cert-expiration-824000 --memory=2048 --cert-expiration=3m --driver=docker: (1m3.2660667s)

cert_options_test.go:131: (dbg) Run:  out/minikube-windows-amd64.exe start -p cert-expiration-824000 --memory=2048 --cert-expiration=8760h --driver=docker

E1216 11:36:47.524742   11452 cert_rotation.go:171] "Unhandled Error" err="key failed with : open C:\\Users\\jenkins.minikube4\\minikube-integration\\.minikube\\profiles\\functional-638500\\client.crt: The system cannot find the path specified." logger="UnhandledError"

E1216 11:37:04.442617   11452 cert_rotation.go:171] "Unhandled Error" err="key failed with : open C:\\Users\\jenkins.minikube4\\minikube-integration\\.minikube\\profiles\\functional-638500\\client.crt: The system cannot find the path specified." logger="UnhandledError"

cert_options_test.go:131: (dbg) Done: out/minikube-windows-amd64.exe start -p cert-expiration-824000 --memory=2048 --cert-expiration=8760h --driver=docker: (40.6360508s)

helpers_test.go:175: Cleaning up "cert-expiration-824000" profile ...

helpers_test.go:178: (dbg) Run:  out/minikube-windows-amd64.exe delete -p cert-expiration-824000

helpers_test.go:178: (dbg) Done: out/minikube-windows-amd64.exe delete -p cert-expiration-824000: (5.1764207s)

--- PASS: TestCertExpiration (289.08s)

=== RUN   TestDockerFlags

=== PAUSE TestDockerFlags

=== CONT  TestDockerFlags

docker_test.go:51: (dbg) Run:  out/minikube-windows-amd64.exe start -p docker-flags-378200 --cache-images=false --memory=2048 --install-addons=false --wait=false --docker-env=FOO=BAR --docker-env=BAZ=BAT --docker-opt=debug --docker-opt=icc=true --alsologtostderr -v=5 --driver=docker

docker_test.go:51: (dbg) Done: out/minikube-windows-amd64.exe start -p docker-flags-378200 --cache-images=false --memory=2048 --install-addons=false --wait=false --docker-env=FOO=BAR --docker-env=BAZ=BAT --docker-opt=debug --docker-opt=icc=true --alsologtostderr -v=5 --driver=docker: (1m3.5594432s)

docker_test.go:56: (dbg) Run:  out/minikube-windows-amd64.exe -p docker-flags-378200 ssh "sudo systemctl show docker --property=Environment --no-pager"

docker_test.go:67: (dbg) Run:  out/minikube-windows-amd64.exe -p docker-flags-378200 ssh "sudo systemctl show docker --property=ExecStart --no-pager"

docker_test.go:67: (dbg) Done: out/minikube-windows-amd64.exe -p docker-flags-378200 ssh "sudo systemctl show docker --property=ExecStart --no-pager": (1.1919429s)

helpers_test.go:175: Cleaning up "docker-flags-378200" profile ...

helpers_test.go:178: (dbg) Run:  out/minikube-windows-amd64.exe delete -p docker-flags-378200

helpers_test.go:178: (dbg) Done: out/minikube-windows-amd64.exe delete -p docker-flags-378200: (4.6075403s)

--- PASS: TestDockerFlags (70.17s)

=== RUN   TestForceSystemdFlag

=== PAUSE TestForceSystemdFlag

=== CONT  TestForceSystemdFlag

docker_test.go:91: (dbg) Run:  out/minikube-windows-amd64.exe start -p force-systemd-flag-829000 --memory=2048 --force-systemd --alsologtostderr -v=5 --driver=docker

docker_test.go:91: (dbg) Done: out/minikube-windows-amd64.exe start -p force-systemd-flag-829000 --memory=2048 --force-systemd --alsologtostderr -v=5 --driver=docker: (1m12.4620229s)

docker_test.go:110: (dbg) Run:  out/minikube-windows-amd64.exe -p force-systemd-flag-829000 ssh "docker info --format {{.CgroupDriver}}"

docker_test.go:110: (dbg) Done: out/minikube-windows-amd64.exe -p force-systemd-flag-829000 ssh "docker info --format {{.CgroupDriver}}": (1.1546408s)

helpers_test.go:175: Cleaning up "force-systemd-flag-829000" profile ...

helpers_test.go:178: (dbg) Run:  out/minikube-windows-amd64.exe delete -p force-systemd-flag-829000

helpers_test.go:178: (dbg) Done: out/minikube-windows-amd64.exe delete -p force-systemd-flag-829000: (4.8351477s)

--- PASS: TestForceSystemdFlag (78.45s)

=== RUN   TestForceSystemdEnv

=== PAUSE TestForceSystemdEnv

=== CONT  TestForceSystemdEnv

docker_test.go:155: (dbg) Run:  out/minikube-windows-amd64.exe start -p force-systemd-env-739200 --memory=2048 --alsologtostderr -v=5 --driver=docker

docker_test.go:155: (dbg) Done: out/minikube-windows-amd64.exe start -p force-systemd-env-739200 --memory=2048 --alsologtostderr -v=5 --driver=docker: (1m17.1950101s)

docker_test.go:110: (dbg) Run:  out/minikube-windows-amd64.exe -p force-systemd-env-739200 ssh "docker info --format {{.CgroupDriver}}"

docker_test.go:110: (dbg) Done: out/minikube-windows-amd64.exe -p force-systemd-env-739200 ssh "docker info --format {{.CgroupDriver}}": (1.5054359s)

helpers_test.go:175: Cleaning up "force-systemd-env-739200" profile ...

helpers_test.go:178: (dbg) Run:  out/minikube-windows-amd64.exe delete -p force-systemd-env-739200

helpers_test.go:178: (dbg) Done: out/minikube-windows-amd64.exe delete -p force-systemd-env-739200: (6.294347s)

--- PASS: TestForceSystemdEnv (85.00s)

=== RUN   TestErrorSpam/start

error_spam_test.go:216: Cleaning up 1 logfile(s) ...

error_spam_test.go:159: (dbg) Run:  out/minikube-windows-amd64.exe -p nospam-148100 --log_dir C:\Users\jenkins.minikube4\AppData\Local\Temp\nospam-148100 start --dry-run

error_spam_test.go:159: (dbg) Done: out/minikube-windows-amd64.exe -p nospam-148100 --log_dir C:\Users\jenkins.minikube4\AppData\Local\Temp\nospam-148100 start --dry-run: (1.227045s)

error_spam_test.go:159: (dbg) Run:  out/minikube-windows-amd64.exe -p nospam-148100 --log_dir C:\Users\jenkins.minikube4\AppData\Local\Temp\nospam-148100 start --dry-run

error_spam_test.go:159: (dbg) Done: out/minikube-windows-amd64.exe -p nospam-148100 --log_dir C:\Users\jenkins.minikube4\AppData\Local\Temp\nospam-148100 start --dry-run: (1.2539387s)

error_spam_test.go:182: (dbg) Run:  out/minikube-windows-amd64.exe -p nospam-148100 --log_dir C:\Users\jenkins.minikube4\AppData\Local\Temp\nospam-148100 start --dry-run

error_spam_test.go:182: (dbg) Done: out/minikube-windows-amd64.exe -p nospam-148100 --log_dir C:\Users\jenkins.minikube4\AppData\Local\Temp\nospam-148100 start --dry-run: (1.3480801s)

--- PASS: TestErrorSpam/start (3.83s)

=== RUN   TestErrorSpam/status

error_spam_test.go:216: Cleaning up 0 logfile(s) ...

error_spam_test.go:159: (dbg) Run:  out/minikube-windows-amd64.exe -p nospam-148100 --log_dir C:\Users\jenkins.minikube4\AppData\Local\Temp\nospam-148100 status

error_spam_test.go:159: (dbg) Done: out/minikube-windows-amd64.exe -p nospam-148100 --log_dir C:\Users\jenkins.minikube4\AppData\Local\Temp\nospam-148100 status: (1.0088321s)

error_spam_test.go:159: (dbg) Run:  out/minikube-windows-amd64.exe -p nospam-148100 --log_dir C:\Users\jenkins.minikube4\AppData\Local\Temp\nospam-148100 status

error_spam_test.go:182: (dbg) Run:  out/minikube-windows-amd64.exe -p nospam-148100 --log_dir C:\Users\jenkins.minikube4\AppData\Local\Temp\nospam-148100 status

--- PASS: TestErrorSpam/status (2.79s)

=== RUN   TestErrorSpam/pause

error_spam_test.go:216: Cleaning up 0 logfile(s) ...

error_spam_test.go:159: (dbg) Run:  out/minikube-windows-amd64.exe -p nospam-148100 --log_dir C:\Users\jenkins.minikube4\AppData\Local\Temp\nospam-148100 pause

error_spam_test.go:159: (dbg) Done: out/minikube-windows-amd64.exe -p nospam-148100 --log_dir C:\Users\jenkins.minikube4\AppData\Local\Temp\nospam-148100 pause: (1.3337699s)

error_spam_test.go:159: (dbg) Run:  out/minikube-windows-amd64.exe -p nospam-148100 --log_dir C:\Users\jenkins.minikube4\AppData\Local\Temp\nospam-148100 pause

error_spam_test.go:182: (dbg) Run:  out/minikube-windows-amd64.exe -p nospam-148100 --log_dir C:\Users\jenkins.minikube4\AppData\Local\Temp\nospam-148100 pause

--- PASS: TestErrorSpam/pause (3.20s)

=== RUN   TestErrorSpam/unpause

error_spam_test.go:216: Cleaning up 0 logfile(s) ...

error_spam_test.go:159: (dbg) Run:  out/minikube-windows-amd64.exe -p nospam-148100 --log_dir C:\Users\jenkins.minikube4\AppData\Local\Temp\nospam-148100 unpause

error_spam_test.go:159: (dbg) Done: out/minikube-windows-amd64.exe -p nospam-148100 --log_dir C:\Users\jenkins.minikube4\AppData\Local\Temp\nospam-148100 unpause: (1.1934171s)

error_spam_test.go:159: (dbg) Run:  out/minikube-windows-amd64.exe -p nospam-148100 --log_dir C:\Users\jenkins.minikube4\AppData\Local\Temp\nospam-148100 unpause

error_spam_test.go:159: (dbg) Done: out/minikube-windows-amd64.exe -p nospam-148100 --log_dir C:\Users\jenkins.minikube4\AppData\Local\Temp\nospam-148100 unpause: (1.1842876s)

error_spam_test.go:182: (dbg) Run:  out/minikube-windows-amd64.exe -p nospam-148100 --log_dir C:\Users\jenkins.minikube4\AppData\Local\Temp\nospam-148100 unpause

--- PASS: TestErrorSpam/unpause (3.33s)

=== RUN   TestErrorSpam/stop

error_spam_test.go:216: Cleaning up 0 logfile(s) ...

error_spam_test.go:159: (dbg) Run:  out/minikube-windows-amd64.exe -p nospam-148100 --log_dir C:\Users\jenkins.minikube4\AppData\Local\Temp\nospam-148100 stop

error_spam_test.go:159: (dbg) Done: out/minikube-windows-amd64.exe -p nospam-148100 --log_dir C:\Users\jenkins.minikube4\AppData\Local\Temp\nospam-148100 stop: (7.0802884s)

error_spam_test.go:159: (dbg) Run:  out/minikube-windows-amd64.exe -p nospam-148100 --log_dir C:\Users\jenkins.minikube4\AppData\Local\Temp\nospam-148100 stop

error_spam_test.go:159: (dbg) Done: out/minikube-windows-amd64.exe -p nospam-148100 --log_dir C:\Users\jenkins.minikube4\AppData\Local\Temp\nospam-148100 stop: (3.5712506s)

error_spam_test.go:182: (dbg) Run:  out/minikube-windows-amd64.exe -p nospam-148100 --log_dir C:\Users\jenkins.minikube4\AppData\Local\Temp\nospam-148100 stop

error_spam_test.go:182: (dbg) Done: out/minikube-windows-amd64.exe -p nospam-148100 --log_dir C:\Users\jenkins.minikube4\AppData\Local\Temp\nospam-148100 stop: (3.4105314s)

--- PASS: TestErrorSpam/stop (14.07s)

=== RUN   TestFunctional/serial/CopySyncFile

functional_test.go:1855: local sync path: C:\Users\jenkins.minikube4\minikube-integration\.minikube\files\etc\test\nested\copy\11452\hosts

--- PASS: TestFunctional/serial/CopySyncFile (0.03s)

=== RUN   TestFunctional/serial/StartWithProxy

functional_test.go:2234: (dbg) Run:  out/minikube-windows-amd64.exe start -p functional-638500 --memory=4000 --apiserver-port=8441 --wait=all --driver=docker

E1216 10:33:39.537515   11452 cert_rotation.go:171] "Unhandled Error" err="key failed with : open C:\\Users\\jenkins.minikube4\\minikube-integration\\.minikube\\profiles\\addons-434500\\client.crt: The system cannot find the path specified." logger="UnhandledError"

E1216 10:33:39.544605   11452 cert_rotation.go:171] "Unhandled Error" err="key failed with : open C:\\Users\\jenkins.minikube4\\minikube-integration\\.minikube\\profiles\\addons-434500\\client.crt: The system cannot find the path specified." logger="UnhandledError"

E1216 10:33:39.556001   11452 cert_rotation.go:171] "Unhandled Error" err="key failed with : open C:\\Users\\jenkins.minikube4\\minikube-integration\\.minikube\\profiles\\addons-434500\\client.crt: The system cannot find the path specified." logger="UnhandledError"

E1216 10:33:39.577855   11452 cert_rotation.go:171] "Unhandled Error" err="key failed with : open C:\\Users\\jenkins.minikube4\\minikube-integration\\.minikube\\profiles\\addons-434500\\client.crt: The system cannot find the path specified." logger="UnhandledError"

E1216 10:33:39.619898   11452 cert_rotation.go:171] "Unhandled Error" err="key failed with : open C:\\Users\\jenkins.minikube4\\minikube-integration\\.minikube\\profiles\\addons-434500\\client.crt: The system cannot find the path specified." logger="UnhandledError"

E1216 10:33:39.702453   11452 cert_rotation.go:171] "Unhandled Error" err="key failed with : open C:\\Users\\jenkins.minikube4\\minikube-integration\\.minikube\\profiles\\addons-434500\\client.crt: The system cannot find the path specified." logger="UnhandledError"

E1216 10:33:39.865114   11452 cert_rotation.go:171] "Unhandled Error" err="key failed with : open C:\\Users\\jenkins.minikube4\\minikube-integration\\.minikube\\profiles\\addons-434500\\client.crt: The system cannot find the path specified." logger="UnhandledError"

E1216 10:33:40.187704   11452 cert_rotation.go:171] "Unhandled Error" err="key failed with : open C:\\Users\\jenkins.minikube4\\minikube-integration\\.minikube\\profiles\\addons-434500\\client.crt: The system cannot find the path specified." logger="UnhandledError"

E1216 10:33:40.829444   11452 cert_rotation.go:171] "Unhandled Error" err="key failed with : open C:\\Users\\jenkins.minikube4\\minikube-integration\\.minikube\\profiles\\addons-434500\\client.crt: The system cannot find the path specified." logger="UnhandledError"

E1216 10:33:42.111454   11452 cert_rotation.go:171] "Unhandled Error" err="key failed with : open C:\\Users\\jenkins.minikube4\\minikube-integration\\.minikube\\profiles\\addons-434500\\client.crt: The system cannot find the path specified." logger="UnhandledError"

E1216 10:33:44.673546   11452 cert_rotation.go:171] "Unhandled Error" err="key failed with : open C:\\Users\\jenkins.minikube4\\minikube-integration\\.minikube\\profiles\\addons-434500\\client.crt: The system cannot find the path specified." logger="UnhandledError"

E1216 10:33:49.796611   11452 cert_rotation.go:171] "Unhandled Error" err="key failed with : open C:\\Users\\jenkins.minikube4\\minikube-integration\\.minikube\\profiles\\addons-434500\\client.crt: The system cannot find the path specified." logger="UnhandledError"

E1216 10:34:00.038593   11452 cert_rotation.go:171] "Unhandled Error" err="key failed with : open C:\\Users\\jenkins.minikube4\\minikube-integration\\.minikube\\profiles\\addons-434500\\client.crt: The system cannot find the path specified." logger="UnhandledError"

E1216 10:34:20.522970   11452 cert_rotation.go:171] "Unhandled Error" err="key failed with : open C:\\Users\\jenkins.minikube4\\minikube-integration\\.minikube\\profiles\\addons-434500\\client.crt: The system cannot find the path specified." logger="UnhandledError"

functional_test.go:2234: (dbg) Done: out/minikube-windows-amd64.exe start -p functional-638500 --memory=4000 --apiserver-port=8441 --wait=all --driver=docker: (1m37.1209036s)

--- PASS: TestFunctional/serial/StartWithProxy (97.13s)

=== RUN   TestFunctional/serial/AuditLog

--- PASS: TestFunctional/serial/AuditLog (0.00s)

=== RUN   TestFunctional/serial/SoftStart

I1216 10:34:51.317776   11452 config.go:182] Loaded profile config "functional-638500": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.31.2

functional_test.go:659: (dbg) Run:  out/minikube-windows-amd64.exe start -p functional-638500 --alsologtostderr -v=8

E1216 10:35:01.486317   11452 cert_rotation.go:171] "Unhandled Error" err="key failed with : open C:\\Users\\jenkins.minikube4\\minikube-integration\\.minikube\\profiles\\addons-434500\\client.crt: The system cannot find the path specified." logger="UnhandledError"

functional_test.go:659: (dbg) Done: out/minikube-windows-amd64.exe start -p functional-638500 --alsologtostderr -v=8: (39.8201556s)

functional_test.go:663: soft start took 39.8209461s for "functional-638500" cluster.

I1216 10:35:31.141251   11452 config.go:182] Loaded profile config "functional-638500": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.31.2

--- PASS: TestFunctional/serial/SoftStart (39.82s)

=== RUN   TestFunctional/serial/KubeContext

functional_test.go:681: (dbg) Run:  kubectl config current-context

--- PASS: TestFunctional/serial/KubeContext (0.12s)

=== RUN   TestFunctional/serial/KubectlGetPods

functional_test.go:696: (dbg) Run:  kubectl --context functional-638500 get po -A

--- PASS: TestFunctional/serial/KubectlGetPods (0.22s)

=== RUN   TestFunctional/serial/CacheCmd/cache/add_remote

functional_test.go:1049: (dbg) Run:  out/minikube-windows-amd64.exe -p functional-638500 cache add registry.k8s.io/pause:3.1

functional_test.go:1049: (dbg) Done: out/minikube-windows-amd64.exe -p functional-638500 cache add registry.k8s.io/pause:3.1: (2.1482225s)

functional_test.go:1049: (dbg) Run:  out/minikube-windows-amd64.exe -p functional-638500 cache add registry.k8s.io/pause:3.3

functional_test.go:1049: (dbg) Done: out/minikube-windows-amd64.exe -p functional-638500 cache add registry.k8s.io/pause:3.3: (2.0295294s)

functional_test.go:1049: (dbg) Run:  out/minikube-windows-amd64.exe -p functional-638500 cache add registry.k8s.io/pause:latest

functional_test.go:1049: (dbg) Done: out/minikube-windows-amd64.exe -p functional-638500 cache add registry.k8s.io/pause:latest: (2.0027686s)

--- PASS: TestFunctional/serial/CacheCmd/cache/add_remote (6.18s)