=== RUN TestStartStop/group/old-k8s-version/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run: out/minikube-windows-amd64.exe start -p old-k8s-version-694600 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --kubernetes-version=v1.20.0
E0923 12:38:04.975057 13200 cert_rotation.go:171] "Unhandled Error" err="key failed with : open C:\\Users\\jenkins.minikube2\\minikube-integration\\.minikube\\profiles\\functional-716900\\client.crt: The system cannot find the path specified." logger="UnhandledError"
start_stop_delete_test.go:256: (dbg) Non-zero exit: out/minikube-windows-amd64.exe start -p old-k8s-version-694600 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --kubernetes-version=v1.20.0: exit status 102 (6m49.8738538s)
-- stdout --
* [old-k8s-version-694600] minikube v1.34.0 on Microsoft Windows 10 Enterprise N 10.0.19045.4894 Build 19045.4894
- KUBECONFIG=C:\Users\jenkins.minikube2\minikube-integration\kubeconfig
- MINIKUBE_FORCE_SYSTEMD=
- MINIKUBE_HOME=C:\Users\jenkins.minikube2\minikube-integration\.minikube
- MINIKUBE_LOCATION=19690
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
* Kubernetes 1.31.1 is now available. If you would like to upgrade, specify: --kubernetes-version=v1.31.1
* Using the docker driver based on existing profile
* Starting "old-k8s-version-694600" primary control-plane node in "old-k8s-version-694600" cluster
* Pulling base image v0.0.45-1726784731-19672 ...
* Restarting existing docker container for "old-k8s-version-694600" ...
* Preparing Kubernetes v1.20.0 on Docker 27.3.0 ...
* Verifying Kubernetes components...
- Using image gcr.io/k8s-minikube/storage-provisioner:v5
- Using image fake.domain/registry.k8s.io/echoserver:1.4
- Using image docker.io/kubernetesui/dashboard:v2.7.0
- Using image registry.k8s.io/echoserver:1.4
* Some dashboard features require the metrics-server addon. To enable all features please run:
minikube -p old-k8s-version-694600 addons enable metrics-server
* Enabled addons: storage-provisioner, metrics-server, dashboard, default-storageclass
-- /stdout --
** stderr **
I0923 12:37:50.065673 4228 out.go:345] Setting OutFile to fd 1284 ...
I0923 12:37:50.166700 4228 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0923 12:37:50.166700 4228 out.go:358] Setting ErrFile to fd 1892...
I0923 12:37:50.166700 4228 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0923 12:37:50.195096 4228 out.go:352] Setting JSON to false
I0923 12:37:50.199481 4228 start.go:129] hostinfo: {"hostname":"minikube2","uptime":5937,"bootTime":1727089132,"procs":188,"os":"windows","platform":"Microsoft Windows 10 Enterprise N","platformFamily":"Standalone Workstation","platformVersion":"10.0.19045.4894 Build 19045.4894","kernelVersion":"10.0.19045.4894 Build 19045.4894","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"29dced62-21fb-45d8-a34e-472b66ced002"}
W0923 12:37:50.200105 4228 start.go:137] gopshost.Virtualization returned error: not implemented yet
I0923 12:37:50.203583 4228 out.go:177] * [old-k8s-version-694600] minikube v1.34.0 on Microsoft Windows 10 Enterprise N 10.0.19045.4894 Build 19045.4894
I0923 12:37:50.208091 4228 out.go:177] - KUBECONFIG=C:\Users\jenkins.minikube2\minikube-integration\kubeconfig
I0923 12:37:50.208146 4228 notify.go:220] Checking for updates...
I0923 12:37:50.212313 4228 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0923 12:37:50.215244 4228 out.go:177] - MINIKUBE_HOME=C:\Users\jenkins.minikube2\minikube-integration\.minikube
I0923 12:37:50.220567 4228 out.go:177] - MINIKUBE_LOCATION=19690
I0923 12:37:50.223348 4228 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0923 12:37:50.227322 4228 config.go:182] Loaded profile config "old-k8s-version-694600": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.20.0
I0923 12:37:50.230731 4228 out.go:177] * Kubernetes 1.31.1 is now available. If you would like to upgrade, specify: --kubernetes-version=v1.31.1
I0923 12:37:50.233622 4228 driver.go:394] Setting default libvirt URI to qemu:///system
I0923 12:37:50.462999 4228 docker.go:123] docker version: linux-27.2.0:Docker Desktop 4.34.1 (166053)
I0923 12:37:50.472294 4228 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0923 12:37:50.912562 4228 info.go:266] docker info: {ID:e770b6ad-f18b-4184-94e7-b0fdb570deb0 Containers:4 ContainersRunning:3 ContainersPaused:0 ContainersStopped:1 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:98 OomKillDisable:true NGoroutines:92 SystemTime:2024-09-23 12:37:50.87479325 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:12 KernelVersion:5.15.153.1-microsoft-standard-WSL2 OperatingSystem:Docker Desktop OSType:linux Architecture:x86_64 Inde
xServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:16 MemTotal:33657536512 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy:http.docker.internal:3128 HTTPSProxy:http.docker.internal:3128 NoProxy:hubproxy.docker.internal Name:docker-desktop Labels:[com.docker.desktop.address=npipe://\\.\pipe\docker_cli] ExperimentalBuild:false ServerVersion:27.2.0 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:8fc6bcff51318944179630522a095cc9dbf9f353 Expected:8fc6bcff51318944179630522a095cc9dbf9f353} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0 E
xpected:de40ad0} SecurityOptions:[name=seccomp,profile=unconfined] ProductLicense: Warnings:[WARNING: No blkio throttle.read_bps_device support WARNING: No blkio throttle.write_bps_device support WARNING: No blkio throttle.read_iops_device support WARNING: No blkio throttle.write_iops_device support WARNING: daemon is not using the default seccomp profile] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:C:\Program Files\Docker\cli-plugins\docker-buildx.exe SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.16.2-desktop.1] map[Name:compose Path:C:\Program Files\Docker\cli-plugins\docker-compose.exe SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.2-desktop.2] map[Name:debug Path:C:\Program Files\Docker\cli-plugins\docker-debug.exe SchemaVersion:0.1.0 ShortDescription:Get a shell into any image or container Vendor:Docker Inc. Version:0.0.34] map[Name:desktop Path:C:\Program Files\Docker\cli-plugins\docker-desktop.exe SchemaV
ersion:0.1.0 ShortDescription:Docker Desktop commands (Alpha) Vendor:Docker Inc. Version:v0.0.15] map[Name:dev Path:C:\Program Files\Docker\cli-plugins\docker-dev.exe SchemaVersion:0.1.0 ShortDescription:Docker Dev Environments Vendor:Docker Inc. Version:v0.1.2] map[Name:extension Path:C:\Program Files\Docker\cli-plugins\docker-extension.exe SchemaVersion:0.1.0 ShortDescription:Manages Docker extensions Vendor:Docker Inc. Version:v0.2.25] map[Name:feedback Path:C:\Program Files\Docker\cli-plugins\docker-feedback.exe SchemaVersion:0.1.0 ShortDescription:Provide feedback, right in your terminal! Vendor:Docker Inc. Version:v1.0.5] map[Name:init Path:C:\Program Files\Docker\cli-plugins\docker-init.exe SchemaVersion:0.1.0 ShortDescription:Creates Docker-related starter files for your project Vendor:Docker Inc. Version:v1.3.0] map[Name:sbom Path:C:\Program Files\Docker\cli-plugins\docker-sbom.exe SchemaVersion:0.1.0 ShortDescription:View the packaged-based Software Bill Of Materials (SBOM) for an image URL:https://
github.com/docker/sbom-cli-plugin Vendor:Anchore Inc. Version:0.6.0] map[Name:scout Path:C:\Program Files\Docker\cli-plugins\docker-scout.exe SchemaVersion:0.1.0 ShortDescription:Docker Scout Vendor:Docker Inc. Version:v1.13.0]] Warnings:<nil>}}
I0923 12:37:50.916523 4228 out.go:177] * Using the docker driver based on existing profile
I0923 12:37:50.920281 4228 start.go:297] selected driver: docker
I0923 12:37:50.920347 4228 start.go:901] validating driver "docker" against &{Name:old-k8s-version-694600 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726784731-19672@sha256:7f8c62ddb0100a5b958dd19c5b5478b8c7ef13da9a0a4d6c7d18f43544e0dbed Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-694600 Namespace:default APIServerHAVIP: AP
IServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.103.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountS
tring:C:\Users\jenkins.minikube2:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0923 12:37:50.920573 4228 start.go:912] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0923 12:37:51.004956 4228 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0923 12:37:51.403332 4228 info.go:266] docker info: {ID:e770b6ad-f18b-4184-94e7-b0fdb570deb0 Containers:4 ContainersRunning:3 ContainersPaused:0 ContainersStopped:1 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:98 OomKillDisable:true NGoroutines:92 SystemTime:2024-09-23 12:37:51.358222752 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:12 KernelVersion:5.15.153.1-microsoft-standard-WSL2 OperatingSystem:Docker Desktop OSType:linux Architecture:x86_64 Ind
exServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:16 MemTotal:33657536512 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy:http.docker.internal:3128 HTTPSProxy:http.docker.internal:3128 NoProxy:hubproxy.docker.internal Name:docker-desktop Labels:[com.docker.desktop.address=npipe://\\.\pipe\docker_cli] ExperimentalBuild:false ServerVersion:27.2.0 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:8fc6bcff51318944179630522a095cc9dbf9f353 Expected:8fc6bcff51318944179630522a095cc9dbf9f353} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0
Expected:de40ad0} SecurityOptions:[name=seccomp,profile=unconfined] ProductLicense: Warnings:[WARNING: No blkio throttle.read_bps_device support WARNING: No blkio throttle.write_bps_device support WARNING: No blkio throttle.read_iops_device support WARNING: No blkio throttle.write_iops_device support WARNING: daemon is not using the default seccomp profile] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:C:\Program Files\Docker\cli-plugins\docker-buildx.exe SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.16.2-desktop.1] map[Name:compose Path:C:\Program Files\Docker\cli-plugins\docker-compose.exe SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.2-desktop.2] map[Name:debug Path:C:\Program Files\Docker\cli-plugins\docker-debug.exe SchemaVersion:0.1.0 ShortDescription:Get a shell into any image or container Vendor:Docker Inc. Version:0.0.34] map[Name:desktop Path:C:\Program Files\Docker\cli-plugins\docker-desktop.exe Schema
Version:0.1.0 ShortDescription:Docker Desktop commands (Alpha) Vendor:Docker Inc. Version:v0.0.15] map[Name:dev Path:C:\Program Files\Docker\cli-plugins\docker-dev.exe SchemaVersion:0.1.0 ShortDescription:Docker Dev Environments Vendor:Docker Inc. Version:v0.1.2] map[Name:extension Path:C:\Program Files\Docker\cli-plugins\docker-extension.exe SchemaVersion:0.1.0 ShortDescription:Manages Docker extensions Vendor:Docker Inc. Version:v0.2.25] map[Name:feedback Path:C:\Program Files\Docker\cli-plugins\docker-feedback.exe SchemaVersion:0.1.0 ShortDescription:Provide feedback, right in your terminal! Vendor:Docker Inc. Version:v1.0.5] map[Name:init Path:C:\Program Files\Docker\cli-plugins\docker-init.exe SchemaVersion:0.1.0 ShortDescription:Creates Docker-related starter files for your project Vendor:Docker Inc. Version:v1.3.0] map[Name:sbom Path:C:\Program Files\Docker\cli-plugins\docker-sbom.exe SchemaVersion:0.1.0 ShortDescription:View the packaged-based Software Bill Of Materials (SBOM) for an image URL:https:/
/github.com/docker/sbom-cli-plugin Vendor:Anchore Inc. Version:0.6.0] map[Name:scout Path:C:\Program Files\Docker\cli-plugins\docker-scout.exe SchemaVersion:0.1.0 ShortDescription:Docker Scout Vendor:Docker Inc. Version:v1.13.0]] Warnings:<nil>}}
I0923 12:37:51.404447 4228 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0923 12:37:51.404641 4228 cni.go:84] Creating CNI manager for ""
I0923 12:37:51.404641 4228 cni.go:162] CNI unnecessary in this configuration, recommending no CNI
I0923 12:37:51.405018 4228 start.go:340] cluster config:
{Name:old-k8s-version-694600 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726784731-19672@sha256:7f8c62ddb0100a5b958dd19c5b5478b8c7ef13da9a0a4d6c7d18f43544e0dbed Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-694600 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local
ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.103.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:C:\Users\jenkins.minikube2:/minikube-host Mount9PVersion:9p2000.L MountGID
:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0923 12:37:51.412479 4228 out.go:177] * Starting "old-k8s-version-694600" primary control-plane node in "old-k8s-version-694600" cluster
I0923 12:37:51.414985 4228 cache.go:121] Beginning downloading kic base image for docker with docker
I0923 12:37:51.419178 4228 out.go:177] * Pulling base image v0.0.45-1726784731-19672 ...
I0923 12:37:51.421746 4228 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime docker
I0923 12:37:51.421746 4228 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726784731-19672@sha256:7f8c62ddb0100a5b958dd19c5b5478b8c7ef13da9a0a4d6c7d18f43544e0dbed in local docker daemon
I0923 12:37:51.421746 4228 preload.go:146] Found local preload: C:\Users\jenkins.minikube2\minikube-integration\.minikube\cache\preloaded-tarball\preloaded-images-k8s-v18-v1.20.0-docker-overlay2-amd64.tar.lz4
I0923 12:37:51.421746 4228 cache.go:56] Caching tarball of preloaded images
I0923 12:37:51.423495 4228 preload.go:172] Found C:\Users\jenkins.minikube2\minikube-integration\.minikube\cache\preloaded-tarball\preloaded-images-k8s-v18-v1.20.0-docker-overlay2-amd64.tar.lz4 in cache, skipping download
I0923 12:37:51.423495 4228 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on docker
I0923 12:37:51.424562 4228 profile.go:143] Saving config to C:\Users\jenkins.minikube2\minikube-integration\.minikube\profiles\old-k8s-version-694600\config.json ...
I0923 12:37:51.569125 4228 image.go:98] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726784731-19672@sha256:7f8c62ddb0100a5b958dd19c5b5478b8c7ef13da9a0a4d6c7d18f43544e0dbed in local docker daemon, skipping pull
I0923 12:37:51.569125 4228 cache.go:144] gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726784731-19672@sha256:7f8c62ddb0100a5b958dd19c5b5478b8c7ef13da9a0a4d6c7d18f43544e0dbed exists in daemon, skipping load
I0923 12:37:51.569125 4228 cache.go:194] Successfully downloaded all kic artifacts
I0923 12:37:51.569125 4228 start.go:360] acquireMachinesLock for old-k8s-version-694600: {Name:mk60e57ef64ed7ba55c5b0fe4d3c9f2a9be93adf Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0923 12:37:51.569125 4228 start.go:364] duration metric: took 0s to acquireMachinesLock for "old-k8s-version-694600"
I0923 12:37:51.569821 4228 start.go:96] Skipping create...Using existing machine configuration
I0923 12:37:51.569821 4228 fix.go:54] fixHost starting:
I0923 12:37:51.593465 4228 cli_runner.go:164] Run: docker container inspect old-k8s-version-694600 --format={{.State.Status}}
I0923 12:37:51.693218 4228 fix.go:112] recreateIfNeeded on old-k8s-version-694600: state=Stopped err=<nil>
W0923 12:37:51.693218 4228 fix.go:138] unexpected machine state, will restart: <nil>
I0923 12:37:51.697947 4228 out.go:177] * Restarting existing docker container for "old-k8s-version-694600" ...
I0923 12:37:51.714841 4228 cli_runner.go:164] Run: docker start old-k8s-version-694600
I0923 12:37:52.504008 4228 cli_runner.go:164] Run: docker container inspect old-k8s-version-694600 --format={{.State.Status}}
I0923 12:37:52.607998 4228 kic.go:430] container "old-k8s-version-694600" state is running.
I0923 12:37:52.621325 4228 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-694600
I0923 12:37:52.725001 4228 profile.go:143] Saving config to C:\Users\jenkins.minikube2\minikube-integration\.minikube\profiles\old-k8s-version-694600\config.json ...
I0923 12:37:52.728358 4228 machine.go:93] provisionDockerMachine start ...
I0923 12:37:52.744082 4228 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-694600
I0923 12:37:52.868525 4228 main.go:141] libmachine: Using SSH client type: native
I0923 12:37:52.869177 4228 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x551bc0] 0x554700 <nil> [] 0s} 127.0.0.1 60038 <nil> <nil>}
I0923 12:37:52.869251 4228 main.go:141] libmachine: About to run SSH command:
hostname
I0923 12:37:52.872773 4228 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: EOF
I0923 12:37:56.105037 4228 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-694600
I0923 12:37:56.105195 4228 ubuntu.go:169] provisioning hostname "old-k8s-version-694600"
I0923 12:37:56.117882 4228 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-694600
I0923 12:37:56.219761 4228 main.go:141] libmachine: Using SSH client type: native
I0923 12:37:56.220418 4228 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x551bc0] 0x554700 <nil> [] 0s} 127.0.0.1 60038 <nil> <nil>}
I0923 12:37:56.220418 4228 main.go:141] libmachine: About to run SSH command:
sudo hostname old-k8s-version-694600 && echo "old-k8s-version-694600" | sudo tee /etc/hostname
I0923 12:37:56.456853 4228 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-694600
I0923 12:37:56.471002 4228 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-694600
I0923 12:37:56.567799 4228 main.go:141] libmachine: Using SSH client type: native
I0923 12:37:56.568544 4228 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x551bc0] 0x554700 <nil> [] 0s} 127.0.0.1 60038 <nil> <nil>}
I0923 12:37:56.568606 4228 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-694600' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-694600/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-694600' | sudo tee -a /etc/hosts;
fi
fi
I0923 12:37:56.762996 4228 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0923 12:37:56.763068 4228 ubuntu.go:175] set auth options {CertDir:C:\Users\jenkins.minikube2\minikube-integration\.minikube CaCertPath:C:\Users\jenkins.minikube2\minikube-integration\.minikube\certs\ca.pem CaPrivateKeyPath:C:\Users\jenkins.minikube2\minikube-integration\.minikube\certs\ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:C:\Users\jenkins.minikube2\minikube-integration\.minikube\machines\server.pem ServerKeyPath:C:\Users\jenkins.minikube2\minikube-integration\.minikube\machines\server-key.pem ClientKeyPath:C:\Users\jenkins.minikube2\minikube-integration\.minikube\certs\key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:C:\Users\jenkins.minikube2\minikube-integration\.minikube\certs\cert.pem ServerCertSANs:[] StorePath:C:\Users\jenkins.minikube2\minikube-integration\.minikube}
I0923 12:37:56.763179 4228 ubuntu.go:177] setting up certificates
I0923 12:37:56.763216 4228 provision.go:84] configureAuth start
I0923 12:37:56.774237 4228 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-694600
I0923 12:37:56.862198 4228 provision.go:143] copyHostCerts
I0923 12:37:56.862839 4228 exec_runner.go:144] found C:\Users\jenkins.minikube2\minikube-integration\.minikube/ca.pem, removing ...
I0923 12:37:56.862893 4228 exec_runner.go:203] rm: C:\Users\jenkins.minikube2\minikube-integration\.minikube\ca.pem
I0923 12:37:56.863372 4228 exec_runner.go:151] cp: C:\Users\jenkins.minikube2\minikube-integration\.minikube\certs\ca.pem --> C:\Users\jenkins.minikube2\minikube-integration\.minikube/ca.pem (1078 bytes)
I0923 12:37:56.864568 4228 exec_runner.go:144] found C:\Users\jenkins.minikube2\minikube-integration\.minikube/cert.pem, removing ...
I0923 12:37:56.864568 4228 exec_runner.go:203] rm: C:\Users\jenkins.minikube2\minikube-integration\.minikube\cert.pem
I0923 12:37:56.864568 4228 exec_runner.go:151] cp: C:\Users\jenkins.minikube2\minikube-integration\.minikube\certs\cert.pem --> C:\Users\jenkins.minikube2\minikube-integration\.minikube/cert.pem (1123 bytes)
I0923 12:37:56.866150 4228 exec_runner.go:144] found C:\Users\jenkins.minikube2\minikube-integration\.minikube/key.pem, removing ...
I0923 12:37:56.866150 4228 exec_runner.go:203] rm: C:\Users\jenkins.minikube2\minikube-integration\.minikube\key.pem
I0923 12:37:56.866150 4228 exec_runner.go:151] cp: C:\Users\jenkins.minikube2\minikube-integration\.minikube\certs\key.pem --> C:\Users\jenkins.minikube2\minikube-integration\.minikube/key.pem (1675 bytes)
I0923 12:37:56.867419 4228 provision.go:117] generating server cert: C:\Users\jenkins.minikube2\minikube-integration\.minikube\machines\server.pem ca-key=C:\Users\jenkins.minikube2\minikube-integration\.minikube\certs\ca.pem private-key=C:\Users\jenkins.minikube2\minikube-integration\.minikube\certs\ca-key.pem org=jenkins.old-k8s-version-694600 san=[127.0.0.1 192.168.103.2 localhost minikube old-k8s-version-694600]
I0923 12:37:57.002619 4228 provision.go:177] copyRemoteCerts
I0923 12:37:57.022455 4228 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0923 12:37:57.032808 4228 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-694600
I0923 12:37:57.126749 4228 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:60038 SSHKeyPath:C:\Users\jenkins.minikube2\minikube-integration\.minikube\machines\old-k8s-version-694600\id_rsa Username:docker}
I0923 12:37:57.284571 4228 ssh_runner.go:362] scp C:\Users\jenkins.minikube2\minikube-integration\.minikube\certs\ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0923 12:37:57.349962 4228 ssh_runner.go:362] scp C:\Users\jenkins.minikube2\minikube-integration\.minikube\machines\server.pem --> /etc/docker/server.pem (1233 bytes)
I0923 12:37:57.417035 4228 ssh_runner.go:362] scp C:\Users\jenkins.minikube2\minikube-integration\.minikube\machines\server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I0923 12:37:57.466324 4228 provision.go:87] duration metric: took 703.103ms to configureAuth
I0923 12:37:57.466324 4228 ubuntu.go:193] setting minikube options for container-runtime
I0923 12:37:57.476234 4228 config.go:182] Loaded profile config "old-k8s-version-694600": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.20.0
I0923 12:37:57.486438 4228 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-694600
I0923 12:37:57.574962 4228 main.go:141] libmachine: Using SSH client type: native
I0923 12:37:57.575413 4228 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x551bc0] 0x554700 <nil> [] 0s} 127.0.0.1 60038 <nil> <nil>}
I0923 12:37:57.575522 4228 main.go:141] libmachine: About to run SSH command:
df --output=fstype / | tail -n 1
I0923 12:37:57.774104 4228 main.go:141] libmachine: SSH cmd err, output: <nil>: overlay
I0923 12:37:57.774215 4228 ubuntu.go:71] root file system type: overlay
I0923 12:37:57.774421 4228 provision.go:314] Updating docker unit: /lib/systemd/system/docker.service ...
I0923 12:37:57.784752 4228 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-694600
I0923 12:37:57.880458 4228 main.go:141] libmachine: Using SSH client type: native
I0923 12:37:57.881020 4228 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x551bc0] 0x554700 <nil> [] 0s} 127.0.0.1 60038 <nil> <nil>}
I0923 12:37:57.881020 4228 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /lib/systemd/system && printf %s "[Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
BindsTo=containerd.service
After=network-online.target firewalld.service containerd.service
Wants=network-online.target
Requires=docker.socket
StartLimitBurst=3
StartLimitIntervalSec=60
[Service]
Type=notify
Restart=on-failure
# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
# The base configuration already specifies an 'ExecStart=...' command. The first directive
# here is to clear out that command inherited from the base configuration. Without this,
# the command from the base configuration and the command specified here are treated as
# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
# will catch this invalid input and refuse to start the service with an error like:
# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
ExecStart=
ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12
ExecReload=/bin/kill -s HUP \$MAINPID
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
LimitNOFILE=infinity
LimitNPROC=infinity
LimitCORE=infinity
# Uncomment TasksMax if your systemd version supports it.
# Only systemd 226 and above support this version.
TasksMax=infinity
TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
# kill only the docker process, not all processes in the cgroup
KillMode=process
[Install]
WantedBy=multi-user.target
" | sudo tee /lib/systemd/system/docker.service.new
I0923 12:37:58.116243 4228 main.go:141] libmachine: SSH cmd err, output: <nil>: [Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
BindsTo=containerd.service
After=network-online.target firewalld.service containerd.service
Wants=network-online.target
Requires=docker.socket
StartLimitBurst=3
StartLimitIntervalSec=60
[Service]
Type=notify
Restart=on-failure
# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
# The base configuration already specifies an 'ExecStart=...' command. The first directive
# here is to clear out that command inherited from the base configuration. Without this,
# the command from the base configuration and the command specified here are treated as
# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
# will catch this invalid input and refuse to start the service with an error like:
# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
ExecStart=
ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12
ExecReload=/bin/kill -s HUP $MAINPID
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
LimitNOFILE=infinity
LimitNPROC=infinity
LimitCORE=infinity
# Uncomment TasksMax if your systemd version supports it.
# Only systemd 226 and above support this version.
TasksMax=infinity
TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
# kill only the docker process, not all processes in the cgroup
KillMode=process
[Install]
WantedBy=multi-user.target
I0923 12:37:58.129971 4228 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-694600
I0923 12:37:58.225949 4228 main.go:141] libmachine: Using SSH client type: native
I0923 12:37:58.226493 4228 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x551bc0] 0x554700 <nil> [] 0s} 127.0.0.1 60038 <nil> <nil>}
I0923 12:37:58.226605 4228 main.go:141] libmachine: About to run SSH command:
sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }
I0923 12:37:58.458662 4228 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0923 12:37:58.458662 4228 machine.go:96] duration metric: took 5.7299905s to provisionDockerMachine
I0923 12:37:58.458662 4228 start.go:293] postStartSetup for "old-k8s-version-694600" (driver="docker")
I0923 12:37:58.458759 4228 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0923 12:37:58.476391 4228 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0923 12:37:58.489377 4228 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-694600
I0923 12:37:58.575443 4228 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:60038 SSHKeyPath:C:\Users\jenkins.minikube2\minikube-integration\.minikube\machines\old-k8s-version-694600\id_rsa Username:docker}
I0923 12:37:58.770520 4228 ssh_runner.go:195] Run: cat /etc/os-release
I0923 12:37:58.781661 4228 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I0923 12:37:58.781661 4228 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
I0923 12:37:58.781661 4228 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
I0923 12:37:58.781817 4228 info.go:137] Remote host: Ubuntu 22.04.5 LTS
I0923 12:37:58.781857 4228 filesync.go:126] Scanning C:\Users\jenkins.minikube2\minikube-integration\.minikube\addons for local assets ...
I0923 12:37:58.782385 4228 filesync.go:126] Scanning C:\Users\jenkins.minikube2\minikube-integration\.minikube\files for local assets ...
I0923 12:37:58.783909 4228 filesync.go:149] local asset: C:\Users\jenkins.minikube2\minikube-integration\.minikube\files\etc\ssl\certs\132002.pem -> 132002.pem in /etc/ssl/certs
I0923 12:37:58.806194 4228 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0923 12:37:58.832638 4228 ssh_runner.go:362] scp C:\Users\jenkins.minikube2\minikube-integration\.minikube\files\etc\ssl\certs\132002.pem --> /etc/ssl/certs/132002.pem (1708 bytes)
I0923 12:37:58.878327 4228 start.go:296] duration metric: took 419.6619ms for postStartSetup
I0923 12:37:58.900436 4228 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I0923 12:37:58.913302 4228 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-694600
I0923 12:37:58.989576 4228 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:60038 SSHKeyPath:C:\Users\jenkins.minikube2\minikube-integration\.minikube\machines\old-k8s-version-694600\id_rsa Username:docker}
I0923 12:37:59.163235 4228 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
I0923 12:37:59.188685 4228 fix.go:56] duration metric: took 7.6188054s for fixHost
I0923 12:37:59.188685 4228 start.go:83] releasing machines lock for "old-k8s-version-694600", held for 7.6195019s
I0923 12:37:59.205254 4228 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-694600
I0923 12:37:59.310345 4228 ssh_runner.go:195] Run: curl.exe -sS -m 2 https://registry.k8s.io/
I0923 12:37:59.325680 4228 ssh_runner.go:195] Run: cat /version.json
I0923 12:37:59.327268 4228 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-694600
I0923 12:37:59.338560 4228 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-694600
I0923 12:37:59.438884 4228 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:60038 SSHKeyPath:C:\Users\jenkins.minikube2\minikube-integration\.minikube\machines\old-k8s-version-694600\id_rsa Username:docker}
I0923 12:37:59.443802 4228 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:60038 SSHKeyPath:C:\Users\jenkins.minikube2\minikube-integration\.minikube\machines\old-k8s-version-694600\id_rsa Username:docker}
W0923 12:37:59.571513 4228 start.go:867] [curl.exe -sS -m 2 https://registry.k8s.io/] failed: curl.exe -sS -m 2 https://registry.k8s.io/: Process exited with status 127
stdout:
stderr:
bash: line 1: curl.exe: command not found
I0923 12:37:59.588613 4228 ssh_runner.go:195] Run: systemctl --version
I0923 12:37:59.623444 4228 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
I0923 12:37:59.657439 4228 ssh_runner.go:195] Run: sudo find \etc\cni\net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "grep -q loopback {} && ( grep -q name {} || sudo sed -i '/"type": "loopback"/i \ \ \ \ "name": "loopback",' {} ) && sudo sed -i 's|"cniVersion": ".*"|"cniVersion": "1.0.0"|g' {}" ;
W0923 12:37:59.683977 4228 out.go:270] ! Failing to connect to https://registry.k8s.io/ from inside the minikube container
! Failing to connect to https://registry.k8s.io/ from inside the minikube container
W0923 12:37:59.683977 4228 out.go:270] * To pull new external images, you may need to configure a proxy: https://minikube.sigs.k8s.io/docs/reference/networking/proxy/
* To pull new external images, you may need to configure a proxy: https://minikube.sigs.k8s.io/docs/reference/networking/proxy/
W0923 12:37:59.688566 4228 start.go:439] unable to name loopback interface in configureRuntimes: unable to patch loopback cni config "/etc/cni/net.d/*loopback.conf*": sudo find \etc\cni\net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "grep -q loopback {} && ( grep -q name {} || sudo sed -i '/"type": "loopback"/i \ \ \ \ "name": "loopback",' {} ) && sudo sed -i 's|"cniVersion": ".*"|"cniVersion": "1.0.0"|g' {}" ;: Process exited with status 1
stdout:
stderr:
find: '\\etc\\cni\\net.d': No such file or directory
I0923 12:37:59.708918 4228 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *bridge* -not -name *podman* -not -name *.mk_disabled -printf "%p, " -exec sh -c "sudo sed -i -r -e '/"dst": ".*:.*"/d' -e 's|^(.*)"dst": (.*)[,*]$|\1"dst": \2|g' -e '/"subnet": ".*:.*"/d' -e 's|^(.*)"subnet": ".*"(.*)[,*]$|\1"subnet": "10.244.0.0/16"\2|g' {}" ;
I0923 12:37:59.765762 4228 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *podman* -not -name *.mk_disabled -printf "%p, " -exec sh -c "sudo sed -i -r -e 's|^(.*)"subnet": ".*"(.*)$|\1"subnet": "10.244.0.0/16"\2|g' -e 's|^(.*)"gateway": ".*"(.*)$|\1"gateway": "10.244.0.1"\2|g' {}" ;
I0923 12:37:59.817705 4228 cni.go:308] configured [/etc/cni/net.d/100-crio-bridge.conf, /etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I0923 12:37:59.817705 4228 start.go:495] detecting cgroup driver to use...
I0923 12:37:59.817705 4228 detect.go:187] detected "cgroupfs" cgroup driver on host os
I0923 12:37:59.818256 4228 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///run/containerd/containerd.sock
" | sudo tee /etc/crictl.yaml"
I0923 12:37:59.867103 4228 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.2"|' /etc/containerd/config.toml"
I0923 12:37:59.911814 4228 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"
I0923 12:37:59.939097 4228 containerd.go:146] configuring containerd to use "cgroupfs" as cgroup driver...
I0923 12:37:59.951678 4228 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"
I0923 12:37:59.992297 4228 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0923 12:38:00.043533 4228 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"
I0923 12:38:00.089099 4228 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0923 12:38:00.136954 4228 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0923 12:38:00.188460 4228 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"
I0923 12:38:00.239993 4228 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0923 12:38:00.275160 4228 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0923 12:38:00.326421 4228 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0923 12:38:00.501070 4228 ssh_runner.go:195] Run: sudo systemctl restart containerd
I0923 12:38:00.758432 4228 start.go:495] detecting cgroup driver to use...
I0923 12:38:00.758551 4228 detect.go:187] detected "cgroupfs" cgroup driver on host os
I0923 12:38:00.773747 4228 ssh_runner.go:195] Run: sudo systemctl cat docker.service
I0923 12:38:00.812461 4228 cruntime.go:279] skipping containerd shutdown because we are bound to it
I0923 12:38:00.828256 4228 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
I0923 12:38:00.860761 4228 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/dockershim.sock
" | sudo tee /etc/crictl.yaml"
I0923 12:38:00.932775 4228 ssh_runner.go:195] Run: which cri-dockerd
I0923 12:38:00.966018 4228 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/cri-docker.service.d
I0923 12:38:00.976656 4228 ssh_runner.go:362] scp memory --> /etc/systemd/system/cri-docker.service.d/10-cni.conf (189 bytes)
I0923 12:38:01.061457 4228 ssh_runner.go:195] Run: sudo systemctl unmask docker.service
I0923 12:38:01.311055 4228 ssh_runner.go:195] Run: sudo systemctl enable docker.socket
I0923 12:38:01.501090 4228 docker.go:574] configuring docker to use "cgroupfs" as cgroup driver...
I0923 12:38:01.501697 4228 ssh_runner.go:362] scp memory --> /etc/docker/daemon.json (130 bytes)
I0923 12:38:01.560604 4228 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0923 12:38:01.785734 4228 ssh_runner.go:195] Run: sudo systemctl restart docker
I0923 12:38:02.942142 4228 ssh_runner.go:235] Completed: sudo systemctl restart docker: (1.1563993s)
I0923 12:38:02.955055 4228 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}
I0923 12:38:03.033280 4228 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}
I0923 12:38:03.113069 4228 out.go:235] * Preparing Kubernetes v1.20.0 on Docker 27.3.0 ...
I0923 12:38:03.122384 4228 cli_runner.go:164] Run: docker exec -t old-k8s-version-694600 dig +short host.docker.internal
I0923 12:38:03.350250 4228 network.go:96] got host ip for mount in container by digging dns: 192.168.65.254
I0923 12:38:03.363258 4228 ssh_runner.go:195] Run: grep 192.168.65.254 host.minikube.internal$ /etc/hosts
I0923 12:38:03.378975 4228 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.65.254 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0923 12:38:03.423457 4228 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "8443/tcp") 0).HostPort}}'" old-k8s-version-694600
I0923 12:38:03.523496 4228 kubeadm.go:883] updating cluster {Name:old-k8s-version-694600 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726784731-19672@sha256:7f8c62ddb0100a5b958dd19c5b5478b8c7ef13da9a0a4d6c7d18f43544e0dbed Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-694600 Namespace:default APIServerHAVIP: APIServerName:minik
ubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.103.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:C:\Users\je
nkins.minikube2:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0923 12:38:03.523496 4228 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime docker
I0923 12:38:03.535640 4228 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}
I0923 12:38:03.594536 4228 docker.go:685] Got preloaded images: -- stdout --
gcr.io/k8s-minikube/storage-provisioner:v5
k8s.gcr.io/kube-proxy:v1.20.0
k8s.gcr.io/kube-apiserver:v1.20.0
k8s.gcr.io/kube-scheduler:v1.20.0
k8s.gcr.io/kube-controller-manager:v1.20.0
k8s.gcr.io/etcd:3.4.13-0
k8s.gcr.io/coredns:1.7.0
k8s.gcr.io/pause:3.2
gcr.io/k8s-minikube/busybox:1.28.4-glibc
-- /stdout --
I0923 12:38:03.594536 4228 docker.go:691] registry.k8s.io/kube-apiserver:v1.20.0 wasn't preloaded
I0923 12:38:03.609878 4228 ssh_runner.go:195] Run: sudo cat /var/lib/docker/image/overlay2/repositories.json
I0923 12:38:03.652610 4228 ssh_runner.go:195] Run: which lz4
I0923 12:38:03.682853 4228 ssh_runner.go:195] Run: stat -c "%s %y" /preloaded.tar.lz4
I0923 12:38:03.698147 4228 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%s %y" /preloaded.tar.lz4: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/preloaded.tar.lz4': No such file or directory
I0923 12:38:03.698481 4228 ssh_runner.go:362] scp C:\Users\jenkins.minikube2\minikube-integration\.minikube\cache\preloaded-tarball\preloaded-images-k8s-v18-v1.20.0-docker-overlay2-amd64.tar.lz4 --> /preloaded.tar.lz4 (401930599 bytes)
I0923 12:38:12.979114 4228 docker.go:649] duration metric: took 9.3099898s to copy over tarball
I0923 12:38:13.002100 4228 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4
I0923 12:38:19.148586 4228 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (6.1463931s)
I0923 12:38:19.148642 4228 ssh_runner.go:146] rm: /preloaded.tar.lz4
I0923 12:38:21.403767 4228 ssh_runner.go:195] Run: sudo cat /var/lib/docker/image/overlay2/repositories.json
I0923 12:38:21.431708 4228 ssh_runner.go:362] scp memory --> /var/lib/docker/image/overlay2/repositories.json (2824 bytes)
I0923 12:38:21.488781 4228 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0923 12:38:21.668279 4228 ssh_runner.go:195] Run: sudo systemctl restart docker
I0923 12:38:31.259068 4228 ssh_runner.go:235] Completed: sudo systemctl restart docker: (9.5907151s)
I0923 12:38:31.268044 4228 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}
I0923 12:38:31.325654 4228 docker.go:685] Got preloaded images: -- stdout --
gcr.io/k8s-minikube/storage-provisioner:v5
k8s.gcr.io/kube-proxy:v1.20.0
k8s.gcr.io/kube-apiserver:v1.20.0
k8s.gcr.io/kube-controller-manager:v1.20.0
k8s.gcr.io/kube-scheduler:v1.20.0
k8s.gcr.io/etcd:3.4.13-0
k8s.gcr.io/coredns:1.7.0
k8s.gcr.io/pause:3.2
gcr.io/k8s-minikube/busybox:1.28.4-glibc
-- /stdout --
I0923 12:38:31.325654 4228 docker.go:691] registry.k8s.io/kube-apiserver:v1.20.0 wasn't preloaded
I0923 12:38:31.325929 4228 cache_images.go:88] LoadCachedImages start: [registry.k8s.io/kube-apiserver:v1.20.0 registry.k8s.io/kube-controller-manager:v1.20.0 registry.k8s.io/kube-scheduler:v1.20.0 registry.k8s.io/kube-proxy:v1.20.0 registry.k8s.io/pause:3.2 registry.k8s.io/etcd:3.4.13-0 registry.k8s.io/coredns:1.7.0 gcr.io/k8s-minikube/storage-provisioner:v5]
I0923 12:38:31.342155 4228 image.go:135] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v5
I0923 12:38:31.349981 4228 image.go:135] retrieving image: registry.k8s.io/kube-apiserver:v1.20.0
I0923 12:38:31.359612 4228 image.go:178] daemon lookup for gcr.io/k8s-minikube/storage-provisioner:v5: Error response from daemon: No such image: gcr.io/k8s-minikube/storage-provisioner:v5
I0923 12:38:31.359911 4228 image.go:135] retrieving image: registry.k8s.io/coredns:1.7.0
I0923 12:38:31.368169 4228 image.go:178] daemon lookup for registry.k8s.io/kube-apiserver:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.20.0
I0923 12:38:31.374819 4228 image.go:135] retrieving image: registry.k8s.io/etcd:3.4.13-0
I0923 12:38:31.379023 4228 image.go:135] retrieving image: registry.k8s.io/kube-scheduler:v1.20.0
I0923 12:38:31.382944 4228 image.go:178] daemon lookup for registry.k8s.io/coredns:1.7.0: Error response from daemon: No such image: registry.k8s.io/coredns:1.7.0
I0923 12:38:31.387755 4228 image.go:135] retrieving image: registry.k8s.io/pause:3.2
I0923 12:38:31.396648 4228 image.go:178] daemon lookup for registry.k8s.io/etcd:3.4.13-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.4.13-0
I0923 12:38:31.398288 4228 image.go:178] daemon lookup for registry.k8s.io/kube-scheduler:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.20.0
I0923 12:38:31.399488 4228 image.go:135] retrieving image: registry.k8s.io/kube-controller-manager:v1.20.0
I0923 12:38:31.409488 4228 image.go:135] retrieving image: registry.k8s.io/kube-proxy:v1.20.0
I0923 12:38:31.412443 4228 image.go:178] daemon lookup for registry.k8s.io/pause:3.2: Error response from daemon: No such image: registry.k8s.io/pause:3.2
I0923 12:38:31.427542 4228 image.go:178] daemon lookup for registry.k8s.io/kube-controller-manager:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.20.0
I0923 12:38:31.435482 4228 image.go:178] daemon lookup for registry.k8s.io/kube-proxy:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.20.0
W0923 12:38:31.487818 4228 image.go:188] authn lookup for gcr.io/k8s-minikube/storage-provisioner:v5 (trying anon): error getting credentials - err: exit status 1, out: `error getting credentials - err: exit status 1, out: `A specified logon session does not exist. It may already have been terminated.``
W0923 12:38:31.573981 4228 image.go:188] authn lookup for registry.k8s.io/kube-apiserver:v1.20.0 (trying anon): error getting credentials - err: exit status 1, out: `error getting credentials - err: exit status 1, out: `A specified logon session does not exist. It may already have been terminated.``
W0923 12:38:31.665982 4228 image.go:188] authn lookup for registry.k8s.io/coredns:1.7.0 (trying anon): error getting credentials - err: exit status 1, out: `error getting credentials - err: exit status 1, out: `A specified logon session does not exist. It may already have been terminated.``
W0923 12:38:31.758464 4228 image.go:188] authn lookup for registry.k8s.io/etcd:3.4.13-0 (trying anon): error getting credentials - err: exit status 1, out: `error getting credentials - err: exit status 1, out: `A specified logon session does not exist. It may already have been terminated.``
W0923 12:38:31.848124 4228 image.go:188] authn lookup for registry.k8s.io/kube-scheduler:v1.20.0 (trying anon): error getting credentials - err: exit status 1, out: `error getting credentials - err: exit status 1, out: `A specified logon session does not exist. It may already have been terminated.``
W0923 12:38:31.944485 4228 image.go:188] authn lookup for registry.k8s.io/pause:3.2 (trying anon): error getting credentials - err: exit status 1, out: `error getting credentials - err: exit status 1, out: `A specified logon session does not exist. It may already have been terminated.``
W0923 12:38:32.037978 4228 image.go:188] authn lookup for registry.k8s.io/kube-controller-manager:v1.20.0 (trying anon): error getting credentials - err: exit status 1, out: `error getting credentials - err: exit status 1, out: `A specified logon session does not exist. It may already have been terminated.``
I0923 12:38:32.075151 4228 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/kube-apiserver:v1.20.0
I0923 12:38:32.077459 4228 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/coredns:1.7.0
I0923 12:38:32.106530 4228 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} gcr.io/k8s-minikube/storage-provisioner:v5
I0923 12:38:32.107835 4228 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/etcd:3.4.13-0
W0923 12:38:32.152252 4228 image.go:188] authn lookup for registry.k8s.io/kube-proxy:v1.20.0 (trying anon): error getting credentials - err: exit status 1, out: `error getting credentials - err: exit status 1, out: `A specified logon session does not exist. It may already have been terminated.``
I0923 12:38:32.196500 4228 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/kube-scheduler:v1.20.0
I0923 12:38:32.197188 4228 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/pause:3.2
I0923 12:38:32.281025 4228 cache_images.go:116] "registry.k8s.io/kube-apiserver:v1.20.0" needs transfer: "registry.k8s.io/kube-apiserver:v1.20.0" does not exist at hash "ca9843d3b545457f24b012d6d579ba85f132f2406aa171ad84d53caa55e5de99" in container runtime
I0923 12:38:32.281429 4228 localpath.go:151] windows sanitize: C:\Users\jenkins.minikube2\minikube-integration\.minikube\cache\images\amd64\registry.k8s.io\kube-apiserver:v1.20.0 -> C:\Users\jenkins.minikube2\minikube-integration\.minikube\cache\images\amd64\registry.k8s.io\kube-apiserver_v1.20.0
I0923 12:38:32.281429 4228 docker.go:337] Removing image: registry.k8s.io/kube-apiserver:v1.20.0
I0923 12:38:32.282913 4228 cache_images.go:116] "registry.k8s.io/coredns:1.7.0" needs transfer: "registry.k8s.io/coredns:1.7.0" does not exist at hash "bfe3a36ebd2528b454be6aebece806db5b40407b833e2af9617bf39afaff8c16" in container runtime
I0923 12:38:32.282913 4228 localpath.go:151] windows sanitize: C:\Users\jenkins.minikube2\minikube-integration\.minikube\cache\images\amd64\registry.k8s.io\coredns:1.7.0 -> C:\Users\jenkins.minikube2\minikube-integration\.minikube\cache\images\amd64\registry.k8s.io\coredns_1.7.0
I0923 12:38:32.282913 4228 docker.go:337] Removing image: registry.k8s.io/coredns:1.7.0
I0923 12:38:32.303214 4228 ssh_runner.go:195] Run: docker rmi registry.k8s.io/coredns:1.7.0
I0923 12:38:32.304630 4228 ssh_runner.go:195] Run: docker rmi registry.k8s.io/kube-apiserver:v1.20.0
I0923 12:38:32.313892 4228 cache_images.go:116] "registry.k8s.io/etcd:3.4.13-0" needs transfer: "registry.k8s.io/etcd:3.4.13-0" does not exist at hash "0369cf4303ffdb467dc219990960a9baa8512a54b0ad9283eaf55bd6c0adb934" in container runtime
I0923 12:38:32.314062 4228 localpath.go:151] windows sanitize: C:\Users\jenkins.minikube2\minikube-integration\.minikube\cache\images\amd64\registry.k8s.io\etcd:3.4.13-0 -> C:\Users\jenkins.minikube2\minikube-integration\.minikube\cache\images\amd64\registry.k8s.io\etcd_3.4.13-0
I0923 12:38:32.314102 4228 docker.go:337] Removing image: registry.k8s.io/etcd:3.4.13-0
I0923 12:38:32.330233 4228 ssh_runner.go:195] Run: docker rmi registry.k8s.io/etcd:3.4.13-0
I0923 12:38:32.340349 4228 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/kube-controller-manager:v1.20.0
I0923 12:38:32.417606 4228 cache_images.go:116] "registry.k8s.io/kube-scheduler:v1.20.0" needs transfer: "registry.k8s.io/kube-scheduler:v1.20.0" does not exist at hash "3138b6e3d471224fd516f758f3b53309219bcb6824e07686b3cd60d78012c899" in container runtime
I0923 12:38:32.417753 4228 localpath.go:151] windows sanitize: C:\Users\jenkins.minikube2\minikube-integration\.minikube\cache\images\amd64\registry.k8s.io\kube-scheduler:v1.20.0 -> C:\Users\jenkins.minikube2\minikube-integration\.minikube\cache\images\amd64\registry.k8s.io\kube-scheduler_v1.20.0
I0923 12:38:32.417606 4228 cache_images.go:116] "registry.k8s.io/pause:3.2" needs transfer: "registry.k8s.io/pause:3.2" does not exist at hash "80d28bedfe5dec59da9ebf8e6260224ac9008ab5c11dbbe16ee3ba3e4439ac2c" in container runtime
I0923 12:38:32.417753 4228 docker.go:337] Removing image: registry.k8s.io/kube-scheduler:v1.20.0
I0923 12:38:32.417753 4228 localpath.go:151] windows sanitize: C:\Users\jenkins.minikube2\minikube-integration\.minikube\cache\images\amd64\registry.k8s.io\pause:3.2 -> C:\Users\jenkins.minikube2\minikube-integration\.minikube\cache\images\amd64\registry.k8s.io\pause_3.2
I0923 12:38:32.417753 4228 docker.go:337] Removing image: registry.k8s.io/pause:3.2
I0923 12:38:32.428474 4228 ssh_runner.go:195] Run: docker rmi registry.k8s.io/pause:3.2
I0923 12:38:32.429277 4228 ssh_runner.go:195] Run: docker rmi registry.k8s.io/kube-scheduler:v1.20.0
I0923 12:38:32.471894 4228 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/kube-proxy:v1.20.0
I0923 12:38:32.501401 4228 cache_images.go:289] Loading image from: C:\Users\jenkins.minikube2\minikube-integration\.minikube\cache\images\amd64\registry.k8s.io\kube-apiserver_v1.20.0
I0923 12:38:32.502026 4228 cache_images.go:289] Loading image from: C:\Users\jenkins.minikube2\minikube-integration\.minikube\cache\images\amd64\registry.k8s.io\coredns_1.7.0
I0923 12:38:32.581389 4228 cache_images.go:289] Loading image from: C:\Users\jenkins.minikube2\minikube-integration\.minikube\cache\images\amd64\registry.k8s.io\etcd_3.4.13-0
I0923 12:38:32.590479 4228 cache_images.go:116] "registry.k8s.io/kube-controller-manager:v1.20.0" needs transfer: "registry.k8s.io/kube-controller-manager:v1.20.0" does not exist at hash "b9fa1895dcaa6d3dd241d6d9340e939ca30fc0946464ec9f205a8cbe738a8080" in container runtime
I0923 12:38:32.590479 4228 localpath.go:151] windows sanitize: C:\Users\jenkins.minikube2\minikube-integration\.minikube\cache\images\amd64\registry.k8s.io\kube-controller-manager:v1.20.0 -> C:\Users\jenkins.minikube2\minikube-integration\.minikube\cache\images\amd64\registry.k8s.io\kube-controller-manager_v1.20.0
I0923 12:38:32.590628 4228 docker.go:337] Removing image: registry.k8s.io/kube-controller-manager:v1.20.0
I0923 12:38:32.613883 4228 ssh_runner.go:195] Run: docker rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0923 12:38:32.628190 4228 cache_images.go:289] Loading image from: C:\Users\jenkins.minikube2\minikube-integration\.minikube\cache\images\amd64\registry.k8s.io\kube-scheduler_v1.20.0
I0923 12:38:32.628289 4228 cache_images.go:289] Loading image from: C:\Users\jenkins.minikube2\minikube-integration\.minikube\cache\images\amd64\registry.k8s.io\pause_3.2
I0923 12:38:32.697495 4228 cache_images.go:116] "registry.k8s.io/kube-proxy:v1.20.0" needs transfer: "registry.k8s.io/kube-proxy:v1.20.0" does not exist at hash "10cc881966cfd9287656c2fce1f144625602653d1e8b011487a7a71feb100bdc" in container runtime
I0923 12:38:32.697495 4228 localpath.go:151] windows sanitize: C:\Users\jenkins.minikube2\minikube-integration\.minikube\cache\images\amd64\registry.k8s.io\kube-proxy:v1.20.0 -> C:\Users\jenkins.minikube2\minikube-integration\.minikube\cache\images\amd64\registry.k8s.io\kube-proxy_v1.20.0
I0923 12:38:32.697495 4228 docker.go:337] Removing image: registry.k8s.io/kube-proxy:v1.20.0
I0923 12:38:32.713921 4228 ssh_runner.go:195] Run: docker rmi registry.k8s.io/kube-proxy:v1.20.0
I0923 12:38:32.741707 4228 cache_images.go:289] Loading image from: C:\Users\jenkins.minikube2\minikube-integration\.minikube\cache\images\amd64\registry.k8s.io\kube-controller-manager_v1.20.0
I0923 12:38:32.768090 4228 cache_images.go:289] Loading image from: C:\Users\jenkins.minikube2\minikube-integration\.minikube\cache\images\amd64\registry.k8s.io\kube-proxy_v1.20.0
I0923 12:38:32.768760 4228 cache_images.go:92] duration metric: took 1.4428197s to LoadCachedImages
W0923 12:38:32.769133 4228 out.go:270] X Unable to load cached images: LoadCachedImages: CreateFile C:\Users\jenkins.minikube2\minikube-integration\.minikube\cache\images\amd64\registry.k8s.io\kube-apiserver_v1.20.0: The system cannot find the file specified.
X Unable to load cached images: LoadCachedImages: CreateFile C:\Users\jenkins.minikube2\minikube-integration\.minikube\cache\images\amd64\registry.k8s.io\kube-apiserver_v1.20.0: The system cannot find the file specified.
I0923 12:38:32.769234 4228 kubeadm.go:934] updating node { 192.168.103.2 8443 v1.20.0 docker true true} ...
I0923 12:38:32.769606 4228 kubeadm.go:946] kubelet [Unit]
Wants=docker.socket
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.20.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=docker --hostname-override=old-k8s-version-694600 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.103.2
[Install]
config:
{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-694600 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0923 12:38:32.780548 4228 ssh_runner.go:195] Run: docker info --format {{.CgroupDriver}}
I0923 12:38:32.908040 4228 cni.go:84] Creating CNI manager for ""
I0923 12:38:32.909118 4228 cni.go:162] CNI unnecessary in this configuration, recommending no CNI
I0923 12:38:32.909118 4228 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0923 12:38:32.909183 4228 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.103.2 APIServerPort:8443 KubernetesVersion:v1.20.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-694600 NodeName:old-k8s-version-694600 DNSDomain:cluster.local CRISocket:/var/run/dockershim.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.103.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.103.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt Stat
icPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
I0923 12:38:32.909558 4228 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta2
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.103.2
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /var/run/dockershim.sock
name: "old-k8s-version-694600"
kubeletExtraArgs:
node-ip: 192.168.103.2
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta2
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.103.2"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.20.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0923 12:38:32.932231 4228 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.20.0
I0923 12:38:32.957788 4228 binaries.go:44] Found k8s binaries, skipping transfer
I0923 12:38:32.970656 4228 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0923 12:38:32.997481 4228 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (349 bytes)
I0923 12:38:33.049081 4228 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0923 12:38:33.102549 4228 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2121 bytes)
I0923 12:38:33.158089 4228 ssh_runner.go:195] Run: grep 192.168.103.2 control-plane.minikube.internal$ /etc/hosts
I0923 12:38:33.173735 4228 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.103.2 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0923 12:38:33.221708 4228 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0923 12:38:33.426433 4228 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0923 12:38:33.460726 4228 certs.go:68] Setting up C:\Users\jenkins.minikube2\minikube-integration\.minikube\profiles\old-k8s-version-694600 for IP: 192.168.103.2
I0923 12:38:33.460726 4228 certs.go:194] generating shared ca certs ...
I0923 12:38:33.460726 4228 certs.go:226] acquiring lock for ca certs: {Name:mka39b35711ce17aa627001b408a7adb2f266bbc Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0923 12:38:33.461969 4228 certs.go:235] skipping valid "minikubeCA" ca cert: C:\Users\jenkins.minikube2\minikube-integration\.minikube\ca.key
I0923 12:38:33.462347 4228 certs.go:235] skipping valid "proxyClientCA" ca cert: C:\Users\jenkins.minikube2\minikube-integration\.minikube\proxy-client-ca.key
I0923 12:38:33.462649 4228 certs.go:256] generating profile certs ...
I0923 12:38:33.463541 4228 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": C:\Users\jenkins.minikube2\minikube-integration\.minikube\profiles\old-k8s-version-694600\client.key
I0923 12:38:33.464087 4228 certs.go:359] skipping valid signed profile cert regeneration for "minikube": C:\Users\jenkins.minikube2\minikube-integration\.minikube\profiles\old-k8s-version-694600\apiserver.key.c11ba674
I0923 12:38:33.464573 4228 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": C:\Users\jenkins.minikube2\minikube-integration\.minikube\profiles\old-k8s-version-694600\proxy-client.key
I0923 12:38:33.465652 4228 certs.go:484] found cert: C:\Users\jenkins.minikube2\minikube-integration\.minikube\certs\13200.pem (1338 bytes)
W0923 12:38:33.466200 4228 certs.go:480] ignoring C:\Users\jenkins.minikube2\minikube-integration\.minikube\certs\13200_empty.pem, impossibly tiny 0 bytes
I0923 12:38:33.466388 4228 certs.go:484] found cert: C:\Users\jenkins.minikube2\minikube-integration\.minikube\certs\ca-key.pem (1675 bytes)
I0923 12:38:33.466829 4228 certs.go:484] found cert: C:\Users\jenkins.minikube2\minikube-integration\.minikube\certs\ca.pem (1078 bytes)
I0923 12:38:33.467133 4228 certs.go:484] found cert: C:\Users\jenkins.minikube2\minikube-integration\.minikube\certs\cert.pem (1123 bytes)
I0923 12:38:33.467501 4228 certs.go:484] found cert: C:\Users\jenkins.minikube2\minikube-integration\.minikube\certs\key.pem (1675 bytes)
I0923 12:38:33.467566 4228 certs.go:484] found cert: C:\Users\jenkins.minikube2\minikube-integration\.minikube\files\etc\ssl\certs\132002.pem (1708 bytes)
I0923 12:38:33.469720 4228 ssh_runner.go:362] scp C:\Users\jenkins.minikube2\minikube-integration\.minikube\ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0923 12:38:33.529425 4228 ssh_runner.go:362] scp C:\Users\jenkins.minikube2\minikube-integration\.minikube\ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
I0923 12:38:33.600727 4228 ssh_runner.go:362] scp C:\Users\jenkins.minikube2\minikube-integration\.minikube\proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0923 12:38:33.690889 4228 ssh_runner.go:362] scp C:\Users\jenkins.minikube2\minikube-integration\.minikube\proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I0923 12:38:33.754667 4228 ssh_runner.go:362] scp C:\Users\jenkins.minikube2\minikube-integration\.minikube\profiles\old-k8s-version-694600\apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
I0923 12:38:33.828156 4228 ssh_runner.go:362] scp C:\Users\jenkins.minikube2\minikube-integration\.minikube\profiles\old-k8s-version-694600\apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I0923 12:38:33.913991 4228 ssh_runner.go:362] scp C:\Users\jenkins.minikube2\minikube-integration\.minikube\profiles\old-k8s-version-694600\proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0923 12:38:34.003607 4228 ssh_runner.go:362] scp C:\Users\jenkins.minikube2\minikube-integration\.minikube\profiles\old-k8s-version-694600\proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I0923 12:38:34.066717 4228 ssh_runner.go:362] scp C:\Users\jenkins.minikube2\minikube-integration\.minikube\certs\13200.pem --> /usr/share/ca-certificates/13200.pem (1338 bytes)
I0923 12:38:34.213736 4228 ssh_runner.go:362] scp C:\Users\jenkins.minikube2\minikube-integration\.minikube\files\etc\ssl\certs\132002.pem --> /usr/share/ca-certificates/132002.pem (1708 bytes)
I0923 12:38:34.273816 4228 ssh_runner.go:362] scp C:\Users\jenkins.minikube2\minikube-integration\.minikube\ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0923 12:38:34.331110 4228 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0923 12:38:34.403752 4228 ssh_runner.go:195] Run: openssl version
I0923 12:38:34.511043 4228 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/13200.pem && ln -fs /usr/share/ca-certificates/13200.pem /etc/ssl/certs/13200.pem"
I0923 12:38:34.619303 4228 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/13200.pem
I0923 12:38:34.680082 4228 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Sep 23 11:29 /usr/share/ca-certificates/13200.pem
I0923 12:38:34.703007 4228 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/13200.pem
I0923 12:38:34.743219 4228 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/13200.pem /etc/ssl/certs/51391683.0"
I0923 12:38:34.810496 4228 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/132002.pem && ln -fs /usr/share/ca-certificates/132002.pem /etc/ssl/certs/132002.pem"
I0923 12:38:34.910618 4228 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/132002.pem
I0923 12:38:34.981105 4228 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Sep 23 11:29 /usr/share/ca-certificates/132002.pem
I0923 12:38:34.997382 4228 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/132002.pem
I0923 12:38:35.038335 4228 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/132002.pem /etc/ssl/certs/3ec20f2e.0"
I0923 12:38:35.112669 4228 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0923 12:38:35.213955 4228 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0923 12:38:35.285199 4228 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Sep 23 11:09 /usr/share/ca-certificates/minikubeCA.pem
I0923 12:38:35.312442 4228 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0923 12:38:35.349064 4228 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0923 12:38:35.417906 4228 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0923 12:38:35.513799 4228 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-etcd-client.crt -checkend 86400
I0923 12:38:35.612552 4228 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-kubelet-client.crt -checkend 86400
I0923 12:38:35.708114 4228 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/server.crt -checkend 86400
I0923 12:38:35.805448 4228 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/healthcheck-client.crt -checkend 86400
I0923 12:38:35.843461 4228 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/peer.crt -checkend 86400
I0923 12:38:35.898709 4228 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/front-proxy-client.crt -checkend 86400
I0923 12:38:35.920863 4228 kubeadm.go:392] StartCluster: {Name:old-k8s-version-694600 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726784731-19672@sha256:7f8c62ddb0100a5b958dd19c5b5478b8c7ef13da9a0a4d6c7d18f43544e0dbed Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-694600 Namespace:default APIServerHAVIP: APIServerName:minikube
CA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.103.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:C:\Users\jenki
ns.minikube2:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0923 12:38:35.933411 4228 ssh_runner.go:195] Run: docker ps --filter status=paused --filter=name=k8s_.*_(kube-system)_ --format={{.ID}}
I0923 12:38:36.106749 4228 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0923 12:38:36.183084 4228 kubeadm.go:408] found existing configuration files, will attempt cluster restart
I0923 12:38:36.183212 4228 kubeadm.go:593] restartPrimaryControlPlane start ...
I0923 12:38:36.207156 4228 ssh_runner.go:195] Run: sudo test -d /data/minikube
I0923 12:38:36.292381 4228 kubeadm.go:130] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1
stdout:
stderr:
I0923 12:38:36.305811 4228 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "8443/tcp") 0).HostPort}}'" old-k8s-version-694600
I0923 12:38:36.406481 4228 kubeconfig.go:47] verify endpoint returned: get endpoint: "old-k8s-version-694600" does not appear in C:\Users\jenkins.minikube2\minikube-integration\kubeconfig
I0923 12:38:36.409732 4228 kubeconfig.go:62] C:\Users\jenkins.minikube2\minikube-integration\kubeconfig needs updating (will repair): [kubeconfig missing "old-k8s-version-694600" cluster setting kubeconfig missing "old-k8s-version-694600" context setting]
I0923 12:38:36.412826 4228 lock.go:35] WriteFile acquiring C:\Users\jenkins.minikube2\minikube-integration\kubeconfig: {Name:mk7e72b8b9c82f9d87d6aed6af6962a1c1fa489d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0923 12:38:36.449830 4228 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new
I0923 12:38:36.587302 4228 kubeadm.go:630] The running cluster does not require reconfiguration: 127.0.0.1
I0923 12:38:36.587487 4228 kubeadm.go:597] duration metric: took 404.2722ms to restartPrimaryControlPlane
I0923 12:38:36.587487 4228 kubeadm.go:394] duration metric: took 666.6192ms to StartCluster
I0923 12:38:36.587589 4228 settings.go:142] acquiring lock: {Name:mk9684611c6005d251a6ecf406b4611c2c1e30f5 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0923 12:38:36.587984 4228 settings.go:150] Updating kubeconfig: C:\Users\jenkins.minikube2\minikube-integration\kubeconfig
I0923 12:38:36.593188 4228 lock.go:35] WriteFile acquiring C:\Users\jenkins.minikube2\minikube-integration\kubeconfig: {Name:mk7e72b8b9c82f9d87d6aed6af6962a1c1fa489d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0923 12:38:36.595475 4228 start.go:235] Will wait 6m0s for node &{Name: IP:192.168.103.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:docker ControlPlane:true Worker:true}
I0923 12:38:36.595475 4228 addons.go:507] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:true default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false]
I0923 12:38:36.595475 4228 addons.go:69] Setting storage-provisioner=true in profile "old-k8s-version-694600"
I0923 12:38:36.595475 4228 addons.go:234] Setting addon storage-provisioner=true in "old-k8s-version-694600"
I0923 12:38:36.595475 4228 addons.go:69] Setting default-storageclass=true in profile "old-k8s-version-694600"
W0923 12:38:36.595475 4228 addons.go:243] addon storage-provisioner should already be in state true
I0923 12:38:36.596053 4228 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "old-k8s-version-694600"
I0923 12:38:36.596053 4228 addons.go:69] Setting dashboard=true in profile "old-k8s-version-694600"
I0923 12:38:36.596053 4228 addons.go:69] Setting metrics-server=true in profile "old-k8s-version-694600"
I0923 12:38:36.596188 4228 addons.go:234] Setting addon metrics-server=true in "old-k8s-version-694600"
W0923 12:38:36.596188 4228 addons.go:243] addon metrics-server should already be in state true
I0923 12:38:36.596053 4228 addons.go:234] Setting addon dashboard=true in "old-k8s-version-694600"
W0923 12:38:36.596188 4228 addons.go:243] addon dashboard should already be in state true
I0923 12:38:36.596188 4228 host.go:66] Checking if "old-k8s-version-694600" exists ...
I0923 12:38:36.596188 4228 host.go:66] Checking if "old-k8s-version-694600" exists ...
I0923 12:38:36.596188 4228 config.go:182] Loaded profile config "old-k8s-version-694600": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.20.0
I0923 12:38:36.596188 4228 host.go:66] Checking if "old-k8s-version-694600" exists ...
I0923 12:38:36.601510 4228 out.go:177] * Verifying Kubernetes components...
I0923 12:38:36.621794 4228 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0923 12:38:36.624791 4228 cli_runner.go:164] Run: docker container inspect old-k8s-version-694600 --format={{.State.Status}}
I0923 12:38:36.625404 4228 cli_runner.go:164] Run: docker container inspect old-k8s-version-694600 --format={{.State.Status}}
I0923 12:38:36.626454 4228 cli_runner.go:164] Run: docker container inspect old-k8s-version-694600 --format={{.State.Status}}
I0923 12:38:36.627915 4228 cli_runner.go:164] Run: docker container inspect old-k8s-version-694600 --format={{.State.Status}}
I0923 12:38:36.743725 4228 out.go:177] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
I0923 12:38:36.746685 4228 addons.go:431] installing /etc/kubernetes/addons/storage-provisioner.yaml
I0923 12:38:36.746741 4228 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I0923 12:38:36.746741 4228 out.go:177] - Using image fake.domain/registry.k8s.io/echoserver:1.4
I0923 12:38:36.749305 4228 addons.go:431] installing /etc/kubernetes/addons/metrics-apiservice.yaml
I0923 12:38:36.749373 4228 ssh_runner.go:362] scp metrics-server/metrics-apiservice.yaml --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)
I0923 12:38:36.749725 4228 out.go:177] - Using image docker.io/kubernetesui/dashboard:v2.7.0
I0923 12:38:36.752200 4228 out.go:177] - Using image registry.k8s.io/echoserver:1.4
I0923 12:38:36.754483 4228 addons.go:234] Setting addon default-storageclass=true in "old-k8s-version-694600"
W0923 12:38:36.754545 4228 addons.go:243] addon default-storageclass should already be in state true
I0923 12:38:36.754600 4228 host.go:66] Checking if "old-k8s-version-694600" exists ...
I0923 12:38:36.754781 4228 addons.go:431] installing /etc/kubernetes/addons/dashboard-ns.yaml
I0923 12:38:36.754845 4228 ssh_runner.go:362] scp dashboard/dashboard-ns.yaml --> /etc/kubernetes/addons/dashboard-ns.yaml (759 bytes)
I0923 12:38:36.762830 4228 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-694600
I0923 12:38:36.763484 4228 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-694600
I0923 12:38:36.769168 4228 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-694600
I0923 12:38:36.792162 4228 cli_runner.go:164] Run: docker container inspect old-k8s-version-694600 --format={{.State.Status}}
I0923 12:38:36.876912 4228 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:60038 SSHKeyPath:C:\Users\jenkins.minikube2\minikube-integration\.minikube\machines\old-k8s-version-694600\id_rsa Username:docker}
I0923 12:38:36.877275 4228 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:60038 SSHKeyPath:C:\Users\jenkins.minikube2\minikube-integration\.minikube\machines\old-k8s-version-694600\id_rsa Username:docker}
I0923 12:38:36.884612 4228 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:60038 SSHKeyPath:C:\Users\jenkins.minikube2\minikube-integration\.minikube\machines\old-k8s-version-694600\id_rsa Username:docker}
I0923 12:38:36.896178 4228 addons.go:431] installing /etc/kubernetes/addons/storageclass.yaml
I0923 12:38:36.896178 4228 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I0923 12:38:36.912916 4228 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-694600
I0923 12:38:37.011722 4228 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:60038 SSHKeyPath:C:\Users\jenkins.minikube2\minikube-integration\.minikube\machines\old-k8s-version-694600\id_rsa Username:docker}
I0923 12:38:37.702224 4228 addons.go:431] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
I0923 12:38:37.702224 4228 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1825 bytes)
I0923 12:38:37.803747 4228 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I0923 12:38:37.883826 4228 addons.go:431] installing /etc/kubernetes/addons/dashboard-clusterrole.yaml
I0923 12:38:37.883929 4228 ssh_runner.go:362] scp dashboard/dashboard-clusterrole.yaml --> /etc/kubernetes/addons/dashboard-clusterrole.yaml (1001 bytes)
I0923 12:38:37.886421 4228 ssh_runner.go:235] Completed: sudo systemctl daemon-reload: (1.264618s)
I0923 12:38:37.913725 4228 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0923 12:38:38.011225 4228 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
I0923 12:38:38.100962 4228 addons.go:431] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
I0923 12:38:38.101133 4228 ssh_runner.go:362] scp metrics-server/metrics-server-rbac.yaml --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)
I0923 12:38:38.187850 4228 addons.go:431] installing /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml
I0923 12:38:38.187850 4228 ssh_runner.go:362] scp dashboard/dashboard-clusterrolebinding.yaml --> /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml (1018 bytes)
I0923 12:38:38.380266 4228 addons.go:431] installing /etc/kubernetes/addons/metrics-server-service.yaml
I0923 12:38:38.380266 4228 ssh_runner.go:362] scp metrics-server/metrics-server-service.yaml --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)
I0923 12:38:38.496912 4228 addons.go:431] installing /etc/kubernetes/addons/dashboard-configmap.yaml
I0923 12:38:38.496912 4228 ssh_runner.go:362] scp dashboard/dashboard-configmap.yaml --> /etc/kubernetes/addons/dashboard-configmap.yaml (837 bytes)
I0923 12:38:38.613669 4228 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0923 12:38:38.792060 4228 addons.go:431] installing /etc/kubernetes/addons/dashboard-dp.yaml
I0923 12:38:38.792118 4228 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-dp.yaml (4201 bytes)
I0923 12:38:38.898318 4228 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: (1.0945618s)
W0923 12:38:38.898809 4228 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0923 12:38:38.898922 4228 retry.go:31] will retry after 271.123439ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0923 12:38:38.912362 4228 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "8443/tcp") 0).HostPort}}'" old-k8s-version-694600
W0923 12:38:38.986481 4228 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0923 12:38:38.987475 4228 retry.go:31] will retry after 138.078267ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0923 12:38:38.996312 4228 node_ready.go:35] waiting up to 6m0s for node "old-k8s-version-694600" to be "Ready" ...
I0923 12:38:39.090401 4228 addons.go:431] installing /etc/kubernetes/addons/dashboard-role.yaml
I0923 12:38:39.090486 4228 ssh_runner.go:362] scp dashboard/dashboard-role.yaml --> /etc/kubernetes/addons/dashboard-role.yaml (1724 bytes)
I0923 12:38:39.143319 4228 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
I0923 12:38:39.198190 4228 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
I0923 12:38:39.289832 4228 addons.go:431] installing /etc/kubernetes/addons/dashboard-rolebinding.yaml
I0923 12:38:39.289889 4228 ssh_runner.go:362] scp dashboard/dashboard-rolebinding.yaml --> /etc/kubernetes/addons/dashboard-rolebinding.yaml (1046 bytes)
W0923 12:38:39.391750 4228 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0923 12:38:39.391750 4228 retry.go:31] will retry after 372.857859ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0923 12:38:39.591487 4228 addons.go:431] installing /etc/kubernetes/addons/dashboard-sa.yaml
I0923 12:38:39.591586 4228 ssh_runner.go:362] scp dashboard/dashboard-sa.yaml --> /etc/kubernetes/addons/dashboard-sa.yaml (837 bytes)
I0923 12:38:39.782628 4228 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0923 12:38:39.883058 4228 addons.go:431] installing /etc/kubernetes/addons/dashboard-secret.yaml
I0923 12:38:39.883058 4228 ssh_runner.go:362] scp dashboard/dashboard-secret.yaml --> /etc/kubernetes/addons/dashboard-secret.yaml (1389 bytes)
I0923 12:38:40.183727 4228 addons.go:431] installing /etc/kubernetes/addons/dashboard-svc.yaml
I0923 12:38:40.183727 4228 ssh_runner.go:362] scp dashboard/dashboard-svc.yaml --> /etc/kubernetes/addons/dashboard-svc.yaml (1294 bytes)
W0923 12:38:40.189292 4228 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0923 12:38:40.189292 4228 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: (1.0459647s)
I0923 12:38:40.189292 4228 retry.go:31] will retry after 293.13656ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0923 12:38:40.189839 4228 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0923 12:38:40.189900 4228 retry.go:31] will retry after 347.668915ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0923 12:38:40.414135 4228 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
I0923 12:38:40.511411 4228 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
I0923 12:38:40.557391 4228 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
I0923 12:38:40.880783 4228 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (1.0973362s)
W0923 12:38:40.880783 4228 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0923 12:38:40.881265 4228 retry.go:31] will retry after 553.689055ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0923 12:38:41.449133 4228 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0923 12:38:48.200070 4228 node_ready.go:49] node "old-k8s-version-694600" has status "Ready":"True"
I0923 12:38:48.200140 4228 node_ready.go:38] duration metric: took 9.2037573s for node "old-k8s-version-694600" to be "Ready" ...
I0923 12:38:48.200140 4228 pod_ready.go:36] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0923 12:38:48.399809 4228 pod_ready.go:79] waiting up to 6m0s for pod "coredns-74ff55c5b-xs5mb" in "kube-system" namespace to be "Ready" ...
I0923 12:38:49.086100 4228 pod_ready.go:93] pod "coredns-74ff55c5b-xs5mb" in "kube-system" namespace has status "Ready":"True"
I0923 12:38:49.086190 4228 pod_ready.go:82] duration metric: took 685.832ms for pod "coredns-74ff55c5b-xs5mb" in "kube-system" namespace to be "Ready" ...
I0923 12:38:49.086264 4228 pod_ready.go:79] waiting up to 6m0s for pod "etcd-old-k8s-version-694600" in "kube-system" namespace to be "Ready" ...
I0923 12:38:49.381352 4228 pod_ready.go:93] pod "etcd-old-k8s-version-694600" in "kube-system" namespace has status "Ready":"True"
I0923 12:38:49.381451 4228 pod_ready.go:82] duration metric: took 295.1846ms for pod "etcd-old-k8s-version-694600" in "kube-system" namespace to be "Ready" ...
I0923 12:38:49.381451 4228 pod_ready.go:79] waiting up to 6m0s for pod "kube-apiserver-old-k8s-version-694600" in "kube-system" namespace to be "Ready" ...
I0923 12:38:51.415456 4228 pod_ready.go:103] pod "kube-apiserver-old-k8s-version-694600" in "kube-system" namespace has status "Ready":"False"
I0923 12:38:53.483702 4228 pod_ready.go:103] pod "kube-apiserver-old-k8s-version-694600" in "kube-system" namespace has status "Ready":"False"
I0923 12:38:54.383747 4228 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: (13.9694636s)
I0923 12:38:54.383747 4228 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: (13.8262501s)
I0923 12:38:54.385221 4228 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: (13.8737029s)
I0923 12:38:54.385685 4228 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (12.9361431s)
I0923 12:38:54.385749 4228 addons.go:475] Verifying addon metrics-server=true in "old-k8s-version-694600"
I0923 12:38:54.387698 4228 out.go:177] * Some dashboard features require the metrics-server addon. To enable all features please run:
minikube -p old-k8s-version-694600 addons enable metrics-server
I0923 12:38:54.598947 4228 out.go:177] * Enabled addons: storage-provisioner, metrics-server, dashboard, default-storageclass
I0923 12:38:54.605369 4228 addons.go:510] duration metric: took 18.0097556s for enable addons: enabled=[storage-provisioner metrics-server dashboard default-storageclass]
I0923 12:38:55.981033 4228 pod_ready.go:103] pod "kube-apiserver-old-k8s-version-694600" in "kube-system" namespace has status "Ready":"False"
I0923 12:38:57.904491 4228 pod_ready.go:93] pod "kube-apiserver-old-k8s-version-694600" in "kube-system" namespace has status "Ready":"True"
I0923 12:38:57.904556 4228 pod_ready.go:82] duration metric: took 8.5230394s for pod "kube-apiserver-old-k8s-version-694600" in "kube-system" namespace to be "Ready" ...
I0923 12:38:57.904617 4228 pod_ready.go:79] waiting up to 6m0s for pod "kube-controller-manager-old-k8s-version-694600" in "kube-system" namespace to be "Ready" ...
I0923 12:38:59.920760 4228 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-694600" in "kube-system" namespace has status "Ready":"False"
I0923 12:39:01.921844 4228 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-694600" in "kube-system" namespace has status "Ready":"False"
I0923 12:39:03.922119 4228 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-694600" in "kube-system" namespace has status "Ready":"False"
I0923 12:39:05.926278 4228 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-694600" in "kube-system" namespace has status "Ready":"False"
I0923 12:39:08.422949 4228 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-694600" in "kube-system" namespace has status "Ready":"False"
I0923 12:39:10.425694 4228 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-694600" in "kube-system" namespace has status "Ready":"False"
I0923 12:39:12.923491 4228 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-694600" in "kube-system" namespace has status "Ready":"False"
I0923 12:39:14.978247 4228 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-694600" in "kube-system" namespace has status "Ready":"False"
I0923 12:39:17.424460 4228 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-694600" in "kube-system" namespace has status "Ready":"False"
I0923 12:39:19.431178 4228 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-694600" in "kube-system" namespace has status "Ready":"False"
I0923 12:39:21.432148 4228 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-694600" in "kube-system" namespace has status "Ready":"False"
I0923 12:39:23.936013 4228 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-694600" in "kube-system" namespace has status "Ready":"False"
I0923 12:39:26.426923 4228 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-694600" in "kube-system" namespace has status "Ready":"False"
I0923 12:39:28.933629 4228 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-694600" in "kube-system" namespace has status "Ready":"False"
I0923 12:39:31.423245 4228 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-694600" in "kube-system" namespace has status "Ready":"False"
I0923 12:39:33.425001 4228 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-694600" in "kube-system" namespace has status "Ready":"False"
I0923 12:39:35.925259 4228 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-694600" in "kube-system" namespace has status "Ready":"False"
I0923 12:39:37.929416 4228 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-694600" in "kube-system" namespace has status "Ready":"False"
I0923 12:39:40.008139 4228 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-694600" in "kube-system" namespace has status "Ready":"False"
I0923 12:39:42.422489 4228 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-694600" in "kube-system" namespace has status "Ready":"False"
I0923 12:39:44.422876 4228 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-694600" in "kube-system" namespace has status "Ready":"False"
I0923 12:39:46.426660 4228 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-694600" in "kube-system" namespace has status "Ready":"False"
I0923 12:39:48.941528 4228 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-694600" in "kube-system" namespace has status "Ready":"False"
I0923 12:39:51.428553 4228 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-694600" in "kube-system" namespace has status "Ready":"False"
I0923 12:39:53.931212 4228 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-694600" in "kube-system" namespace has status "Ready":"False"
I0923 12:39:56.423916 4228 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-694600" in "kube-system" namespace has status "Ready":"False"
I0923 12:39:58.923480 4228 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-694600" in "kube-system" namespace has status "Ready":"False"
I0923 12:40:00.928138 4228 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-694600" in "kube-system" namespace has status "Ready":"False"
I0923 12:40:03.425863 4228 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-694600" in "kube-system" namespace has status "Ready":"False"
I0923 12:40:05.463224 4228 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-694600" in "kube-system" namespace has status "Ready":"False"
I0923 12:40:07.940395 4228 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-694600" in "kube-system" namespace has status "Ready":"False"
I0923 12:40:10.420260 4228 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-694600" in "kube-system" namespace has status "Ready":"False"
I0923 12:40:12.421485 4228 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-694600" in "kube-system" namespace has status "Ready":"False"
I0923 12:40:13.921277 4228 pod_ready.go:93] pod "kube-controller-manager-old-k8s-version-694600" in "kube-system" namespace has status "Ready":"True"
I0923 12:40:13.921313 4228 pod_ready.go:82] duration metric: took 1m16.016106s for pod "kube-controller-manager-old-k8s-version-694600" in "kube-system" namespace to be "Ready" ...
I0923 12:40:13.921313 4228 pod_ready.go:79] waiting up to 6m0s for pod "kube-proxy-nf8m5" in "kube-system" namespace to be "Ready" ...
I0923 12:40:13.934390 4228 pod_ready.go:93] pod "kube-proxy-nf8m5" in "kube-system" namespace has status "Ready":"True"
I0923 12:40:13.934390 4228 pod_ready.go:82] duration metric: took 13.077ms for pod "kube-proxy-nf8m5" in "kube-system" namespace to be "Ready" ...
I0923 12:40:13.934390 4228 pod_ready.go:79] waiting up to 6m0s for pod "kube-scheduler-old-k8s-version-694600" in "kube-system" namespace to be "Ready" ...
I0923 12:40:13.946207 4228 pod_ready.go:93] pod "kube-scheduler-old-k8s-version-694600" in "kube-system" namespace has status "Ready":"True"
I0923 12:40:13.946207 4228 pod_ready.go:82] duration metric: took 11.8176ms for pod "kube-scheduler-old-k8s-version-694600" in "kube-system" namespace to be "Ready" ...
I0923 12:40:13.946207 4228 pod_ready.go:79] waiting up to 6m0s for pod "metrics-server-9975d5f86-vmdbz" in "kube-system" namespace to be "Ready" ...
I0923 12:40:15.963580 4228 pod_ready.go:103] pod "metrics-server-9975d5f86-vmdbz" in "kube-system" namespace has status "Ready":"False"
I0923 12:40:18.462315 4228 pod_ready.go:103] pod "metrics-server-9975d5f86-vmdbz" in "kube-system" namespace has status "Ready":"False"
I0923 12:40:20.961336 4228 pod_ready.go:103] pod "metrics-server-9975d5f86-vmdbz" in "kube-system" namespace has status "Ready":"False"
I0923 12:40:22.986849 4228 pod_ready.go:103] pod "metrics-server-9975d5f86-vmdbz" in "kube-system" namespace has status "Ready":"False"
I0923 12:40:25.465469 4228 pod_ready.go:103] pod "metrics-server-9975d5f86-vmdbz" in "kube-system" namespace has status "Ready":"False"
I0923 12:40:27.963729 4228 pod_ready.go:103] pod "metrics-server-9975d5f86-vmdbz" in "kube-system" namespace has status "Ready":"False"
I0923 12:40:29.964788 4228 pod_ready.go:103] pod "metrics-server-9975d5f86-vmdbz" in "kube-system" namespace has status "Ready":"False"
I0923 12:40:32.462987 4228 pod_ready.go:103] pod "metrics-server-9975d5f86-vmdbz" in "kube-system" namespace has status "Ready":"False"
I0923 12:40:34.963803 4228 pod_ready.go:103] pod "metrics-server-9975d5f86-vmdbz" in "kube-system" namespace has status "Ready":"False"
I0923 12:40:37.461930 4228 pod_ready.go:103] pod "metrics-server-9975d5f86-vmdbz" in "kube-system" namespace has status "Ready":"False"
I0923 12:40:39.463289 4228 pod_ready.go:103] pod "metrics-server-9975d5f86-vmdbz" in "kube-system" namespace has status "Ready":"False"
I0923 12:40:41.962663 4228 pod_ready.go:103] pod "metrics-server-9975d5f86-vmdbz" in "kube-system" namespace has status "Ready":"False"
I0923 12:40:44.463824 4228 pod_ready.go:103] pod "metrics-server-9975d5f86-vmdbz" in "kube-system" namespace has status "Ready":"False"
I0923 12:40:46.963724 4228 pod_ready.go:103] pod "metrics-server-9975d5f86-vmdbz" in "kube-system" namespace has status "Ready":"False"
I0923 12:40:49.465088 4228 pod_ready.go:103] pod "metrics-server-9975d5f86-vmdbz" in "kube-system" namespace has status "Ready":"False"
I0923 12:40:51.962577 4228 pod_ready.go:103] pod "metrics-server-9975d5f86-vmdbz" in "kube-system" namespace has status "Ready":"False"
I0923 12:40:54.466302 4228 pod_ready.go:103] pod "metrics-server-9975d5f86-vmdbz" in "kube-system" namespace has status "Ready":"False"
I0923 12:40:56.962839 4228 pod_ready.go:103] pod "metrics-server-9975d5f86-vmdbz" in "kube-system" namespace has status "Ready":"False"
I0923 12:40:59.470386 4228 pod_ready.go:103] pod "metrics-server-9975d5f86-vmdbz" in "kube-system" namespace has status "Ready":"False"
I0923 12:41:01.962958 4228 pod_ready.go:103] pod "metrics-server-9975d5f86-vmdbz" in "kube-system" namespace has status "Ready":"False"
I0923 12:41:03.964949 4228 pod_ready.go:103] pod "metrics-server-9975d5f86-vmdbz" in "kube-system" namespace has status "Ready":"False"
I0923 12:41:05.966365 4228 pod_ready.go:103] pod "metrics-server-9975d5f86-vmdbz" in "kube-system" namespace has status "Ready":"False"
I0923 12:41:08.462036 4228 pod_ready.go:103] pod "metrics-server-9975d5f86-vmdbz" in "kube-system" namespace has status "Ready":"False"
I0923 12:41:10.963209 4228 pod_ready.go:103] pod "metrics-server-9975d5f86-vmdbz" in "kube-system" namespace has status "Ready":"False"
I0923 12:41:12.965049 4228 pod_ready.go:103] pod "metrics-server-9975d5f86-vmdbz" in "kube-system" namespace has status "Ready":"False"
I0923 12:41:15.464357 4228 pod_ready.go:103] pod "metrics-server-9975d5f86-vmdbz" in "kube-system" namespace has status "Ready":"False"
I0923 12:41:17.965894 4228 pod_ready.go:103] pod "metrics-server-9975d5f86-vmdbz" in "kube-system" namespace has status "Ready":"False"
I0923 12:41:20.463647 4228 pod_ready.go:103] pod "metrics-server-9975d5f86-vmdbz" in "kube-system" namespace has status "Ready":"False"
I0923 12:41:22.960584 4228 pod_ready.go:103] pod "metrics-server-9975d5f86-vmdbz" in "kube-system" namespace has status "Ready":"False"
I0923 12:41:24.983324 4228 pod_ready.go:103] pod "metrics-server-9975d5f86-vmdbz" in "kube-system" namespace has status "Ready":"False"
I0923 12:41:27.464303 4228 pod_ready.go:103] pod "metrics-server-9975d5f86-vmdbz" in "kube-system" namespace has status "Ready":"False"
I0923 12:41:29.969654 4228 pod_ready.go:103] pod "metrics-server-9975d5f86-vmdbz" in "kube-system" namespace has status "Ready":"False"
I0923 12:41:32.476396 4228 pod_ready.go:103] pod "metrics-server-9975d5f86-vmdbz" in "kube-system" namespace has status "Ready":"False"
I0923 12:41:34.966947 4228 pod_ready.go:103] pod "metrics-server-9975d5f86-vmdbz" in "kube-system" namespace has status "Ready":"False"
I0923 12:41:36.978533 4228 pod_ready.go:103] pod "metrics-server-9975d5f86-vmdbz" in "kube-system" namespace has status "Ready":"False"
I0923 12:41:39.486135 4228 pod_ready.go:103] pod "metrics-server-9975d5f86-vmdbz" in "kube-system" namespace has status "Ready":"False"
I0923 12:41:41.964905 4228 pod_ready.go:103] pod "metrics-server-9975d5f86-vmdbz" in "kube-system" namespace has status "Ready":"False"
I0923 12:41:44.463727 4228 pod_ready.go:103] pod "metrics-server-9975d5f86-vmdbz" in "kube-system" namespace has status "Ready":"False"
I0923 12:41:46.470607 4228 pod_ready.go:103] pod "metrics-server-9975d5f86-vmdbz" in "kube-system" namespace has status "Ready":"False"
I0923 12:41:48.964805 4228 pod_ready.go:103] pod "metrics-server-9975d5f86-vmdbz" in "kube-system" namespace has status "Ready":"False"
I0923 12:41:50.965939 4228 pod_ready.go:103] pod "metrics-server-9975d5f86-vmdbz" in "kube-system" namespace has status "Ready":"False"
I0923 12:41:53.465189 4228 pod_ready.go:103] pod "metrics-server-9975d5f86-vmdbz" in "kube-system" namespace has status "Ready":"False"
I0923 12:41:55.483449 4228 pod_ready.go:103] pod "metrics-server-9975d5f86-vmdbz" in "kube-system" namespace has status "Ready":"False"
I0923 12:41:59.022454 4228 pod_ready.go:103] pod "metrics-server-9975d5f86-vmdbz" in "kube-system" namespace has status "Ready":"False"
I0923 12:42:01.317033 4228 pod_ready.go:103] pod "metrics-server-9975d5f86-vmdbz" in "kube-system" namespace has status "Ready":"False"
I0923 12:42:03.464059 4228 pod_ready.go:103] pod "metrics-server-9975d5f86-vmdbz" in "kube-system" namespace has status "Ready":"False"
I0923 12:42:05.518531 4228 pod_ready.go:103] pod "metrics-server-9975d5f86-vmdbz" in "kube-system" namespace has status "Ready":"False"
I0923 12:42:07.983729 4228 pod_ready.go:103] pod "metrics-server-9975d5f86-vmdbz" in "kube-system" namespace has status "Ready":"False"
I0923 12:42:10.464919 4228 pod_ready.go:103] pod "metrics-server-9975d5f86-vmdbz" in "kube-system" namespace has status "Ready":"False"
I0923 12:42:12.468161 4228 pod_ready.go:103] pod "metrics-server-9975d5f86-vmdbz" in "kube-system" namespace has status "Ready":"False"
I0923 12:42:14.964097 4228 pod_ready.go:103] pod "metrics-server-9975d5f86-vmdbz" in "kube-system" namespace has status "Ready":"False"
I0923 12:42:17.085472 4228 pod_ready.go:103] pod "metrics-server-9975d5f86-vmdbz" in "kube-system" namespace has status "Ready":"False"
I0923 12:42:19.458913 4228 pod_ready.go:103] pod "metrics-server-9975d5f86-vmdbz" in "kube-system" namespace has status "Ready":"False"
I0923 12:42:21.461199 4228 pod_ready.go:103] pod "metrics-server-9975d5f86-vmdbz" in "kube-system" namespace has status "Ready":"False"
I0923 12:42:23.462326 4228 pod_ready.go:103] pod "metrics-server-9975d5f86-vmdbz" in "kube-system" namespace has status "Ready":"False"
I0923 12:42:25.462699 4228 pod_ready.go:103] pod "metrics-server-9975d5f86-vmdbz" in "kube-system" namespace has status "Ready":"False"
I0923 12:42:27.769477 4228 pod_ready.go:103] pod "metrics-server-9975d5f86-vmdbz" in "kube-system" namespace has status "Ready":"False"
I0923 12:42:29.813138 4228 pod_ready.go:103] pod "metrics-server-9975d5f86-vmdbz" in "kube-system" namespace has status "Ready":"False"
I0923 12:42:31.963212 4228 pod_ready.go:103] pod "metrics-server-9975d5f86-vmdbz" in "kube-system" namespace has status "Ready":"False"
I0923 12:42:33.969407 4228 pod_ready.go:103] pod "metrics-server-9975d5f86-vmdbz" in "kube-system" namespace has status "Ready":"False"
I0923 12:42:36.464909 4228 pod_ready.go:103] pod "metrics-server-9975d5f86-vmdbz" in "kube-system" namespace has status "Ready":"False"
I0923 12:42:38.465432 4228 pod_ready.go:103] pod "metrics-server-9975d5f86-vmdbz" in "kube-system" namespace has status "Ready":"False"
I0923 12:42:40.963371 4228 pod_ready.go:103] pod "metrics-server-9975d5f86-vmdbz" in "kube-system" namespace has status "Ready":"False"
I0923 12:42:43.469456 4228 pod_ready.go:103] pod "metrics-server-9975d5f86-vmdbz" in "kube-system" namespace has status "Ready":"False"
I0923 12:42:45.470329 4228 pod_ready.go:103] pod "metrics-server-9975d5f86-vmdbz" in "kube-system" namespace has status "Ready":"False"
I0923 12:42:47.965671 4228 pod_ready.go:103] pod "metrics-server-9975d5f86-vmdbz" in "kube-system" namespace has status "Ready":"False"
I0923 12:42:50.464523 4228 pod_ready.go:103] pod "metrics-server-9975d5f86-vmdbz" in "kube-system" namespace has status "Ready":"False"
I0923 12:42:52.968293 4228 pod_ready.go:103] pod "metrics-server-9975d5f86-vmdbz" in "kube-system" namespace has status "Ready":"False"
I0923 12:42:55.462578 4228 pod_ready.go:103] pod "metrics-server-9975d5f86-vmdbz" in "kube-system" namespace has status "Ready":"False"
I0923 12:42:57.467361 4228 pod_ready.go:103] pod "metrics-server-9975d5f86-vmdbz" in "kube-system" namespace has status "Ready":"False"
I0923 12:43:00.030842 4228 pod_ready.go:103] pod "metrics-server-9975d5f86-vmdbz" in "kube-system" namespace has status "Ready":"False"
I0923 12:43:02.467661 4228 pod_ready.go:103] pod "metrics-server-9975d5f86-vmdbz" in "kube-system" namespace has status "Ready":"False"
I0923 12:43:04.964850 4228 pod_ready.go:103] pod "metrics-server-9975d5f86-vmdbz" in "kube-system" namespace has status "Ready":"False"
I0923 12:43:07.468199 4228 pod_ready.go:103] pod "metrics-server-9975d5f86-vmdbz" in "kube-system" namespace has status "Ready":"False"
I0923 12:43:09.965707 4228 pod_ready.go:103] pod "metrics-server-9975d5f86-vmdbz" in "kube-system" namespace has status "Ready":"False"
I0923 12:43:12.469599 4228 pod_ready.go:103] pod "metrics-server-9975d5f86-vmdbz" in "kube-system" namespace has status "Ready":"False"
I0923 12:43:14.968776 4228 pod_ready.go:103] pod "metrics-server-9975d5f86-vmdbz" in "kube-system" namespace has status "Ready":"False"
I0923 12:43:16.971510 4228 pod_ready.go:103] pod "metrics-server-9975d5f86-vmdbz" in "kube-system" namespace has status "Ready":"False"
I0923 12:43:19.464247 4228 pod_ready.go:103] pod "metrics-server-9975d5f86-vmdbz" in "kube-system" namespace has status "Ready":"False"
I0923 12:43:21.468118 4228 pod_ready.go:103] pod "metrics-server-9975d5f86-vmdbz" in "kube-system" namespace has status "Ready":"False"
I0923 12:43:23.968652 4228 pod_ready.go:103] pod "metrics-server-9975d5f86-vmdbz" in "kube-system" namespace has status "Ready":"False"
I0923 12:43:26.466047 4228 pod_ready.go:103] pod "metrics-server-9975d5f86-vmdbz" in "kube-system" namespace has status "Ready":"False"
I0923 12:43:28.466821 4228 pod_ready.go:103] pod "metrics-server-9975d5f86-vmdbz" in "kube-system" namespace has status "Ready":"False"
I0923 12:43:30.965049 4228 pod_ready.go:103] pod "metrics-server-9975d5f86-vmdbz" in "kube-system" namespace has status "Ready":"False"
I0923 12:43:33.466742 4228 pod_ready.go:103] pod "metrics-server-9975d5f86-vmdbz" in "kube-system" namespace has status "Ready":"False"
I0923 12:43:35.973524 4228 pod_ready.go:103] pod "metrics-server-9975d5f86-vmdbz" in "kube-system" namespace has status "Ready":"False"
I0923 12:43:38.465393 4228 pod_ready.go:103] pod "metrics-server-9975d5f86-vmdbz" in "kube-system" namespace has status "Ready":"False"
I0923 12:43:40.467962 4228 pod_ready.go:103] pod "metrics-server-9975d5f86-vmdbz" in "kube-system" namespace has status "Ready":"False"
I0923 12:43:42.471423 4228 pod_ready.go:103] pod "metrics-server-9975d5f86-vmdbz" in "kube-system" namespace has status "Ready":"False"
I0923 12:43:44.963668 4228 pod_ready.go:103] pod "metrics-server-9975d5f86-vmdbz" in "kube-system" namespace has status "Ready":"False"
I0923 12:43:46.967051 4228 pod_ready.go:103] pod "metrics-server-9975d5f86-vmdbz" in "kube-system" namespace has status "Ready":"False"
I0923 12:43:48.975093 4228 pod_ready.go:103] pod "metrics-server-9975d5f86-vmdbz" in "kube-system" namespace has status "Ready":"False"
I0923 12:43:51.468183 4228 pod_ready.go:103] pod "metrics-server-9975d5f86-vmdbz" in "kube-system" namespace has status "Ready":"False"
I0923 12:43:53.475604 4228 pod_ready.go:103] pod "metrics-server-9975d5f86-vmdbz" in "kube-system" namespace has status "Ready":"False"
I0923 12:43:55.966531 4228 pod_ready.go:103] pod "metrics-server-9975d5f86-vmdbz" in "kube-system" namespace has status "Ready":"False"
I0923 12:43:58.462662 4228 pod_ready.go:103] pod "metrics-server-9975d5f86-vmdbz" in "kube-system" namespace has status "Ready":"False"
I0923 12:44:00.467103 4228 pod_ready.go:103] pod "metrics-server-9975d5f86-vmdbz" in "kube-system" namespace has status "Ready":"False"
I0923 12:44:02.480437 4228 pod_ready.go:103] pod "metrics-server-9975d5f86-vmdbz" in "kube-system" namespace has status "Ready":"False"
I0923 12:44:04.964621 4228 pod_ready.go:103] pod "metrics-server-9975d5f86-vmdbz" in "kube-system" namespace has status "Ready":"False"
I0923 12:44:06.968004 4228 pod_ready.go:103] pod "metrics-server-9975d5f86-vmdbz" in "kube-system" namespace has status "Ready":"False"
I0923 12:44:09.463262 4228 pod_ready.go:103] pod "metrics-server-9975d5f86-vmdbz" in "kube-system" namespace has status "Ready":"False"
I0923 12:44:11.465587 4228 pod_ready.go:103] pod "metrics-server-9975d5f86-vmdbz" in "kube-system" namespace has status "Ready":"False"
I0923 12:44:13.471620 4228 pod_ready.go:103] pod "metrics-server-9975d5f86-vmdbz" in "kube-system" namespace has status "Ready":"False"
I0923 12:44:13.948810 4228 pod_ready.go:82] duration metric: took 4m0.0007197s for pod "metrics-server-9975d5f86-vmdbz" in "kube-system" namespace to be "Ready" ...
E0923 12:44:13.948810 4228 pod_ready.go:67] WaitExtra: waitPodCondition: context deadline exceeded
I0923 12:44:13.948810 4228 pod_ready.go:39] duration metric: took 5m25.7460534s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0923 12:44:13.948810 4228 api_server.go:52] waiting for apiserver process to appear ...
I0923 12:44:13.970804 4228 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
I0923 12:44:14.026801 4228 logs.go:276] 2 containers: [bf2bddf93da4 99e36abc5feb]
I0923 12:44:14.035793 4228 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
I0923 12:44:14.104915 4228 logs.go:276] 2 containers: [db948e782f56 a7d64ac5d685]
I0923 12:44:14.116888 4228 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
I0923 12:44:14.173241 4228 logs.go:276] 2 containers: [ac17c0c4ecff db8367477ac1]
I0923 12:44:14.190100 4228 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
I0923 12:44:14.235095 4228 logs.go:276] 2 containers: [6f9ee2379541 585ea5a5976b]
I0923 12:44:14.242134 4228 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
I0923 12:44:14.327099 4228 logs.go:276] 2 containers: [ae76dbbad5df 606305ef153c]
I0923 12:44:14.333261 4228 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
I0923 12:44:14.393114 4228 logs.go:276] 2 containers: [cbaa7f55c1cf 1382815ffdc3]
I0923 12:44:14.406101 4228 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
I0923 12:44:14.455861 4228 logs.go:276] 0 containers: []
W0923 12:44:14.455861 4228 logs.go:278] No container was found matching "kindnet"
I0923 12:44:14.472860 4228 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kubernetes-dashboard --format={{.ID}}
I0923 12:44:14.521851 4228 logs.go:276] 1 containers: [5eb85a2791fd]
I0923 12:44:14.530863 4228 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
I0923 12:44:14.604603 4228 logs.go:276] 2 containers: [4b8130a0a631 9420ceb6a8a9]
I0923 12:44:14.604603 4228 logs.go:123] Gathering logs for describe nodes ...
I0923 12:44:14.604603 4228 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0923 12:44:14.872367 4228 logs.go:123] Gathering logs for coredns [db8367477ac1] ...
I0923 12:44:14.872367 4228 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 db8367477ac1"
I0923 12:44:14.937361 4228 logs.go:123] Gathering logs for kube-proxy [606305ef153c] ...
I0923 12:44:14.937361 4228 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 606305ef153c"
I0923 12:44:15.001367 4228 logs.go:123] Gathering logs for dmesg ...
I0923 12:44:15.001367 4228 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0923 12:44:15.033364 4228 logs.go:123] Gathering logs for etcd [a7d64ac5d685] ...
I0923 12:44:15.033364 4228 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a7d64ac5d685"
I0923 12:44:15.119365 4228 logs.go:123] Gathering logs for coredns [ac17c0c4ecff] ...
I0923 12:44:15.119365 4228 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ac17c0c4ecff"
I0923 12:44:15.179365 4228 logs.go:123] Gathering logs for kube-controller-manager [1382815ffdc3] ...
I0923 12:44:15.179365 4228 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 1382815ffdc3"
I0923 12:44:15.283384 4228 logs.go:123] Gathering logs for kubernetes-dashboard [5eb85a2791fd] ...
I0923 12:44:15.284404 4228 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5eb85a2791fd"
I0923 12:44:15.346360 4228 logs.go:123] Gathering logs for Docker ...
I0923 12:44:15.346360 4228 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
I0923 12:44:15.418380 4228 logs.go:123] Gathering logs for container status ...
I0923 12:44:15.418380 4228 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0923 12:44:15.525356 4228 logs.go:123] Gathering logs for kubelet ...
I0923 12:44:15.525356 4228 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
W0923 12:44:15.635365 4228 logs.go:138] Found kubelet problem: Sep 23 12:38:55 old-k8s-version-694600 kubelet[1893]: E0923 12:38:55.485189 1893 pod_workers.go:191] Error syncing pod ae849738-e0cf-4a30-9b07-5cddd83db4b6 ("metrics-server-9975d5f86-vmdbz_kube-system(ae849738-e0cf-4a30-9b07-5cddd83db4b6)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = Error response from daemon: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.65.254:53: no such host"
W0923 12:44:15.636362 4228 logs.go:138] Found kubelet problem: Sep 23 12:38:56 old-k8s-version-694600 kubelet[1893]: E0923 12:38:56.815962 1893 pod_workers.go:191] Error syncing pod ae849738-e0cf-4a30-9b07-5cddd83db4b6 ("metrics-server-9975d5f86-vmdbz_kube-system(ae849738-e0cf-4a30-9b07-5cddd83db4b6)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0923 12:44:15.636362 4228 logs.go:138] Found kubelet problem: Sep 23 12:38:57 old-k8s-version-694600 kubelet[1893]: E0923 12:38:57.902283 1893 pod_workers.go:191] Error syncing pod ae849738-e0cf-4a30-9b07-5cddd83db4b6 ("metrics-server-9975d5f86-vmdbz_kube-system(ae849738-e0cf-4a30-9b07-5cddd83db4b6)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0923 12:44:15.639385 4228 logs.go:138] Found kubelet problem: Sep 23 12:39:11 old-k8s-version-694600 kubelet[1893]: E0923 12:39:11.731791 1893 pod_workers.go:191] Error syncing pod ae849738-e0cf-4a30-9b07-5cddd83db4b6 ("metrics-server-9975d5f86-vmdbz_kube-system(ae849738-e0cf-4a30-9b07-5cddd83db4b6)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = Error response from daemon: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.65.254:53: no such host"
W0923 12:44:15.642388 4228 logs.go:138] Found kubelet problem: Sep 23 12:39:17 old-k8s-version-694600 kubelet[1893]: E0923 12:39:17.878257 1893 pod_workers.go:191] Error syncing pod 937b014a-169f-4dc5-ac66-a3eee1bc5138 ("storage-provisioner_kube-system(937b014a-169f-4dc5-ac66-a3eee1bc5138)"), skipping: failed to "StartContainer" for "storage-provisioner" with CrashLoopBackOff: "back-off 10s restarting failed container=storage-provisioner pod=storage-provisioner_kube-system(937b014a-169f-4dc5-ac66-a3eee1bc5138)"
W0923 12:44:15.643358 4228 logs.go:138] Found kubelet problem: Sep 23 12:39:23 old-k8s-version-694600 kubelet[1893]: E0923 12:39:23.681185 1893 pod_workers.go:191] Error syncing pod ae849738-e0cf-4a30-9b07-5cddd83db4b6 ("metrics-server-9975d5f86-vmdbz_kube-system(ae849738-e0cf-4a30-9b07-5cddd83db4b6)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0923 12:44:15.649381 4228 logs.go:138] Found kubelet problem: Sep 23 12:39:39 old-k8s-version-694600 kubelet[1893]: E0923 12:39:39.525345 1893 pod_workers.go:191] Error syncing pod ed366f72-9f74-45c1-9866-9faee4d9ffb0 ("dashboard-metrics-scraper-8d5bb5db8-2qtq6_kubernetes-dashboard(ed366f72-9f74-45c1-9866-9faee4d9ffb0)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ErrImagePull: "rpc error: code = Unknown desc = [DEPRECATION NOTICE] Docker Image Format v1 and Docker Image manifest version 2, schema 1 support is disabled by default and will be removed in an upcoming release. Suggest the author of registry.k8s.io/echoserver:1.4 to upgrade the image to the OCI Format or Docker Image manifest v2, schema 2. More information at https://docs.docker.com/go/deprecated-image-specs/"
W0923 12:44:15.653412 4228 logs.go:138] Found kubelet problem: Sep 23 12:39:39 old-k8s-version-694600 kubelet[1893]: E0923 12:39:39.605074 1893 pod_workers.go:191] Error syncing pod ae849738-e0cf-4a30-9b07-5cddd83db4b6 ("metrics-server-9975d5f86-vmdbz_kube-system(ae849738-e0cf-4a30-9b07-5cddd83db4b6)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = Error response from daemon: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.65.254:53: no such host"
W0923 12:44:15.654385 4228 logs.go:138] Found kubelet problem: Sep 23 12:39:39 old-k8s-version-694600 kubelet[1893]: E0923 12:39:39.711237 1893 pod_workers.go:191] Error syncing pod ed366f72-9f74-45c1-9866-9faee4d9ffb0 ("dashboard-metrics-scraper-8d5bb5db8-2qtq6_kubernetes-dashboard(ed366f72-9f74-45c1-9866-9faee4d9ffb0)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0923 12:44:15.659395 4228 logs.go:138] Found kubelet problem: Sep 23 12:39:53 old-k8s-version-694600 kubelet[1893]: E0923 12:39:53.262469 1893 pod_workers.go:191] Error syncing pod ed366f72-9f74-45c1-9866-9faee4d9ffb0 ("dashboard-metrics-scraper-8d5bb5db8-2qtq6_kubernetes-dashboard(ed366f72-9f74-45c1-9866-9faee4d9ffb0)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ErrImagePull: "rpc error: code = Unknown desc = [DEPRECATION NOTICE] Docker Image Format v1 and Docker Image manifest version 2, schema 1 support is disabled by default and will be removed in an upcoming release. Suggest the author of registry.k8s.io/echoserver:1.4 to upgrade the image to the OCI Format or Docker Image manifest v2, schema 2. More information at https://docs.docker.com/go/deprecated-image-specs/"
W0923 12:44:15.659395 4228 logs.go:138] Found kubelet problem: Sep 23 12:39:54 old-k8s-version-694600 kubelet[1893]: E0923 12:39:54.679747 1893 pod_workers.go:191] Error syncing pod ae849738-e0cf-4a30-9b07-5cddd83db4b6 ("metrics-server-9975d5f86-vmdbz_kube-system(ae849738-e0cf-4a30-9b07-5cddd83db4b6)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0923 12:44:15.659395 4228 logs.go:138] Found kubelet problem: Sep 23 12:40:07 old-k8s-version-694600 kubelet[1893]: E0923 12:40:07.675786 1893 pod_workers.go:191] Error syncing pod ed366f72-9f74-45c1-9866-9faee4d9ffb0 ("dashboard-metrics-scraper-8d5bb5db8-2qtq6_kubernetes-dashboard(ed366f72-9f74-45c1-9866-9faee4d9ffb0)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0923 12:44:15.659395 4228 logs.go:138] Found kubelet problem: Sep 23 12:40:09 old-k8s-version-694600 kubelet[1893]: E0923 12:40:09.676754 1893 pod_workers.go:191] Error syncing pod ae849738-e0cf-4a30-9b07-5cddd83db4b6 ("metrics-server-9975d5f86-vmdbz_kube-system(ae849738-e0cf-4a30-9b07-5cddd83db4b6)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0923 12:44:15.663380 4228 logs.go:138] Found kubelet problem: Sep 23 12:40:20 old-k8s-version-694600 kubelet[1893]: E0923 12:40:20.733409 1893 pod_workers.go:191] Error syncing pod ae849738-e0cf-4a30-9b07-5cddd83db4b6 ("metrics-server-9975d5f86-vmdbz_kube-system(ae849738-e0cf-4a30-9b07-5cddd83db4b6)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = Error response from daemon: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.65.254:53: no such host"
W0923 12:44:15.666369 4228 logs.go:138] Found kubelet problem: Sep 23 12:40:22 old-k8s-version-694600 kubelet[1893]: E0923 12:40:22.131490 1893 pod_workers.go:191] Error syncing pod ed366f72-9f74-45c1-9866-9faee4d9ffb0 ("dashboard-metrics-scraper-8d5bb5db8-2qtq6_kubernetes-dashboard(ed366f72-9f74-45c1-9866-9faee4d9ffb0)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ErrImagePull: "rpc error: code = Unknown desc = [DEPRECATION NOTICE] Docker Image Format v1 and Docker Image manifest version 2, schema 1 support is disabled by default and will be removed in an upcoming release. Suggest the author of registry.k8s.io/echoserver:1.4 to upgrade the image to the OCI Format or Docker Image manifest v2, schema 2. More information at https://docs.docker.com/go/deprecated-image-specs/"
W0923 12:44:15.666369 4228 logs.go:138] Found kubelet problem: Sep 23 12:40:34 old-k8s-version-694600 kubelet[1893]: E0923 12:40:34.672437 1893 pod_workers.go:191] Error syncing pod ae849738-e0cf-4a30-9b07-5cddd83db4b6 ("metrics-server-9975d5f86-vmdbz_kube-system(ae849738-e0cf-4a30-9b07-5cddd83db4b6)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0923 12:44:15.667374 4228 logs.go:138] Found kubelet problem: Sep 23 12:40:37 old-k8s-version-694600 kubelet[1893]: E0923 12:40:37.669640 1893 pod_workers.go:191] Error syncing pod ed366f72-9f74-45c1-9866-9faee4d9ffb0 ("dashboard-metrics-scraper-8d5bb5db8-2qtq6_kubernetes-dashboard(ed366f72-9f74-45c1-9866-9faee4d9ffb0)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0923 12:44:15.667374 4228 logs.go:138] Found kubelet problem: Sep 23 12:40:46 old-k8s-version-694600 kubelet[1893]: E0923 12:40:46.668789 1893 pod_workers.go:191] Error syncing pod ae849738-e0cf-4a30-9b07-5cddd83db4b6 ("metrics-server-9975d5f86-vmdbz_kube-system(ae849738-e0cf-4a30-9b07-5cddd83db4b6)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0923 12:44:15.667374 4228 logs.go:138] Found kubelet problem: Sep 23 12:40:50 old-k8s-version-694600 kubelet[1893]: E0923 12:40:50.669482 1893 pod_workers.go:191] Error syncing pod ed366f72-9f74-45c1-9866-9faee4d9ffb0 ("dashboard-metrics-scraper-8d5bb5db8-2qtq6_kubernetes-dashboard(ed366f72-9f74-45c1-9866-9faee4d9ffb0)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0923 12:44:15.668377 4228 logs.go:138] Found kubelet problem: Sep 23 12:41:00 old-k8s-version-694600 kubelet[1893]: E0923 12:41:00.669910 1893 pod_workers.go:191] Error syncing pod ae849738-e0cf-4a30-9b07-5cddd83db4b6 ("metrics-server-9975d5f86-vmdbz_kube-system(ae849738-e0cf-4a30-9b07-5cddd83db4b6)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0923 12:44:15.670366 4228 logs.go:138] Found kubelet problem: Sep 23 12:41:03 old-k8s-version-694600 kubelet[1893]: E0923 12:41:03.166885 1893 pod_workers.go:191] Error syncing pod ed366f72-9f74-45c1-9866-9faee4d9ffb0 ("dashboard-metrics-scraper-8d5bb5db8-2qtq6_kubernetes-dashboard(ed366f72-9f74-45c1-9866-9faee4d9ffb0)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ErrImagePull: "rpc error: code = Unknown desc = [DEPRECATION NOTICE] Docker Image Format v1 and Docker Image manifest version 2, schema 1 support is disabled by default and will be removed in an upcoming release. Suggest the author of registry.k8s.io/echoserver:1.4 to upgrade the image to the OCI Format or Docker Image manifest v2, schema 2. More information at https://docs.docker.com/go/deprecated-image-specs/"
W0923 12:44:15.670366 4228 logs.go:138] Found kubelet problem: Sep 23 12:41:15 old-k8s-version-694600 kubelet[1893]: E0923 12:41:15.677829 1893 pod_workers.go:191] Error syncing pod ae849738-e0cf-4a30-9b07-5cddd83db4b6 ("metrics-server-9975d5f86-vmdbz_kube-system(ae849738-e0cf-4a30-9b07-5cddd83db4b6)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0923 12:44:15.671380 4228 logs.go:138] Found kubelet problem: Sep 23 12:41:15 old-k8s-version-694600 kubelet[1893]: E0923 12:41:15.677922 1893 pod_workers.go:191] Error syncing pod ed366f72-9f74-45c1-9866-9faee4d9ffb0 ("dashboard-metrics-scraper-8d5bb5db8-2qtq6_kubernetes-dashboard(ed366f72-9f74-45c1-9866-9faee4d9ffb0)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0923 12:44:15.671380 4228 logs.go:138] Found kubelet problem: Sep 23 12:41:28 old-k8s-version-694600 kubelet[1893]: E0923 12:41:28.698549 1893 pod_workers.go:191] Error syncing pod ed366f72-9f74-45c1-9866-9faee4d9ffb0 ("dashboard-metrics-scraper-8d5bb5db8-2qtq6_kubernetes-dashboard(ed366f72-9f74-45c1-9866-9faee4d9ffb0)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0923 12:44:15.671380 4228 logs.go:138] Found kubelet problem: Sep 23 12:41:30 old-k8s-version-694600 kubelet[1893]: E0923 12:41:30.669230 1893 pod_workers.go:191] Error syncing pod ae849738-e0cf-4a30-9b07-5cddd83db4b6 ("metrics-server-9975d5f86-vmdbz_kube-system(ae849738-e0cf-4a30-9b07-5cddd83db4b6)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0923 12:44:15.672456 4228 logs.go:138] Found kubelet problem: Sep 23 12:41:39 old-k8s-version-694600 kubelet[1893]: E0923 12:41:39.664583 1893 pod_workers.go:191] Error syncing pod ed366f72-9f74-45c1-9866-9faee4d9ffb0 ("dashboard-metrics-scraper-8d5bb5db8-2qtq6_kubernetes-dashboard(ed366f72-9f74-45c1-9866-9faee4d9ffb0)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0923 12:44:15.675419 4228 logs.go:138] Found kubelet problem: Sep 23 12:41:43 old-k8s-version-694600 kubelet[1893]: E0923 12:41:43.768086 1893 pod_workers.go:191] Error syncing pod ae849738-e0cf-4a30-9b07-5cddd83db4b6 ("metrics-server-9975d5f86-vmdbz_kube-system(ae849738-e0cf-4a30-9b07-5cddd83db4b6)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = Error response from daemon: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.65.254:53: no such host"
W0923 12:44:15.676403 4228 logs.go:138] Found kubelet problem: Sep 23 12:41:52 old-k8s-version-694600 kubelet[1893]: E0923 12:41:52.664375 1893 pod_workers.go:191] Error syncing pod ed366f72-9f74-45c1-9866-9faee4d9ffb0 ("dashboard-metrics-scraper-8d5bb5db8-2qtq6_kubernetes-dashboard(ed366f72-9f74-45c1-9866-9faee4d9ffb0)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0923 12:44:15.676403 4228 logs.go:138] Found kubelet problem: Sep 23 12:41:57 old-k8s-version-694600 kubelet[1893]: E0923 12:41:57.678559 1893 pod_workers.go:191] Error syncing pod ae849738-e0cf-4a30-9b07-5cddd83db4b6 ("metrics-server-9975d5f86-vmdbz_kube-system(ae849738-e0cf-4a30-9b07-5cddd83db4b6)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0923 12:44:15.677513 4228 logs.go:138] Found kubelet problem: Sep 23 12:42:04 old-k8s-version-694600 kubelet[1893]: E0923 12:42:04.665461 1893 pod_workers.go:191] Error syncing pod ed366f72-9f74-45c1-9866-9faee4d9ffb0 ("dashboard-metrics-scraper-8d5bb5db8-2qtq6_kubernetes-dashboard(ed366f72-9f74-45c1-9866-9faee4d9ffb0)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0923 12:44:15.677513 4228 logs.go:138] Found kubelet problem: Sep 23 12:42:12 old-k8s-version-694600 kubelet[1893]: E0923 12:42:12.660131 1893 pod_workers.go:191] Error syncing pod ae849738-e0cf-4a30-9b07-5cddd83db4b6 ("metrics-server-9975d5f86-vmdbz_kube-system(ae849738-e0cf-4a30-9b07-5cddd83db4b6)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0923 12:44:15.678376 4228 logs.go:138] Found kubelet problem: Sep 23 12:42:16 old-k8s-version-694600 kubelet[1893]: E0923 12:42:16.660802 1893 pod_workers.go:191] Error syncing pod ed366f72-9f74-45c1-9866-9faee4d9ffb0 ("dashboard-metrics-scraper-8d5bb5db8-2qtq6_kubernetes-dashboard(ed366f72-9f74-45c1-9866-9faee4d9ffb0)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0923 12:44:15.678376 4228 logs.go:138] Found kubelet problem: Sep 23 12:42:24 old-k8s-version-694600 kubelet[1893]: E0923 12:42:24.660639 1893 pod_workers.go:191] Error syncing pod ae849738-e0cf-4a30-9b07-5cddd83db4b6 ("metrics-server-9975d5f86-vmdbz_kube-system(ae849738-e0cf-4a30-9b07-5cddd83db4b6)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0923 12:44:15.682405 4228 logs.go:138] Found kubelet problem: Sep 23 12:42:31 old-k8s-version-694600 kubelet[1893]: E0923 12:42:31.215753 1893 pod_workers.go:191] Error syncing pod ed366f72-9f74-45c1-9866-9faee4d9ffb0 ("dashboard-metrics-scraper-8d5bb5db8-2qtq6_kubernetes-dashboard(ed366f72-9f74-45c1-9866-9faee4d9ffb0)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ErrImagePull: "rpc error: code = Unknown desc = [DEPRECATION NOTICE] Docker Image Format v1 and Docker Image manifest version 2, schema 1 support is disabled by default and will be removed in an upcoming release. Suggest the author of registry.k8s.io/echoserver:1.4 to upgrade the image to the OCI Format or Docker Image manifest v2, schema 2. More information at https://docs.docker.com/go/deprecated-image-specs/"
W0923 12:44:15.683363 4228 logs.go:138] Found kubelet problem: Sep 23 12:42:39 old-k8s-version-694600 kubelet[1893]: E0923 12:42:39.657460 1893 pod_workers.go:191] Error syncing pod ae849738-e0cf-4a30-9b07-5cddd83db4b6 ("metrics-server-9975d5f86-vmdbz_kube-system(ae849738-e0cf-4a30-9b07-5cddd83db4b6)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0923 12:44:15.683363 4228 logs.go:138] Found kubelet problem: Sep 23 12:42:45 old-k8s-version-694600 kubelet[1893]: E0923 12:42:45.658547 1893 pod_workers.go:191] Error syncing pod ed366f72-9f74-45c1-9866-9faee4d9ffb0 ("dashboard-metrics-scraper-8d5bb5db8-2qtq6_kubernetes-dashboard(ed366f72-9f74-45c1-9866-9faee4d9ffb0)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0923 12:44:15.683363 4228 logs.go:138] Found kubelet problem: Sep 23 12:42:51 old-k8s-version-694600 kubelet[1893]: E0923 12:42:51.656478 1893 pod_workers.go:191] Error syncing pod ae849738-e0cf-4a30-9b07-5cddd83db4b6 ("metrics-server-9975d5f86-vmdbz_kube-system(ae849738-e0cf-4a30-9b07-5cddd83db4b6)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0923 12:44:15.684366 4228 logs.go:138] Found kubelet problem: Sep 23 12:42:58 old-k8s-version-694600 kubelet[1893]: E0923 12:42:58.657078 1893 pod_workers.go:191] Error syncing pod ed366f72-9f74-45c1-9866-9faee4d9ffb0 ("dashboard-metrics-scraper-8d5bb5db8-2qtq6_kubernetes-dashboard(ed366f72-9f74-45c1-9866-9faee4d9ffb0)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0923 12:44:15.684366 4228 logs.go:138] Found kubelet problem: Sep 23 12:43:06 old-k8s-version-694600 kubelet[1893]: E0923 12:43:06.656952 1893 pod_workers.go:191] Error syncing pod ae849738-e0cf-4a30-9b07-5cddd83db4b6 ("metrics-server-9975d5f86-vmdbz_kube-system(ae849738-e0cf-4a30-9b07-5cddd83db4b6)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0923 12:44:15.684366 4228 logs.go:138] Found kubelet problem: Sep 23 12:43:09 old-k8s-version-694600 kubelet[1893]: E0923 12:43:09.654057 1893 pod_workers.go:191] Error syncing pod ed366f72-9f74-45c1-9866-9faee4d9ffb0 ("dashboard-metrics-scraper-8d5bb5db8-2qtq6_kubernetes-dashboard(ed366f72-9f74-45c1-9866-9faee4d9ffb0)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0923 12:44:15.685434 4228 logs.go:138] Found kubelet problem: Sep 23 12:43:17 old-k8s-version-694600 kubelet[1893]: E0923 12:43:17.656711 1893 pod_workers.go:191] Error syncing pod ae849738-e0cf-4a30-9b07-5cddd83db4b6 ("metrics-server-9975d5f86-vmdbz_kube-system(ae849738-e0cf-4a30-9b07-5cddd83db4b6)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0923 12:44:15.685434 4228 logs.go:138] Found kubelet problem: Sep 23 12:43:22 old-k8s-version-694600 kubelet[1893]: E0923 12:43:22.657075 1893 pod_workers.go:191] Error syncing pod ed366f72-9f74-45c1-9866-9faee4d9ffb0 ("dashboard-metrics-scraper-8d5bb5db8-2qtq6_kubernetes-dashboard(ed366f72-9f74-45c1-9866-9faee4d9ffb0)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0923 12:44:15.685434 4228 logs.go:138] Found kubelet problem: Sep 23 12:43:31 old-k8s-version-694600 kubelet[1893]: E0923 12:43:31.654949 1893 pod_workers.go:191] Error syncing pod ae849738-e0cf-4a30-9b07-5cddd83db4b6 ("metrics-server-9975d5f86-vmdbz_kube-system(ae849738-e0cf-4a30-9b07-5cddd83db4b6)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0923 12:44:15.685434 4228 logs.go:138] Found kubelet problem: Sep 23 12:43:34 old-k8s-version-694600 kubelet[1893]: E0923 12:43:34.668314 1893 pod_workers.go:191] Error syncing pod ed366f72-9f74-45c1-9866-9faee4d9ffb0 ("dashboard-metrics-scraper-8d5bb5db8-2qtq6_kubernetes-dashboard(ed366f72-9f74-45c1-9866-9faee4d9ffb0)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0923 12:44:15.686374 4228 logs.go:138] Found kubelet problem: Sep 23 12:43:46 old-k8s-version-694600 kubelet[1893]: E0923 12:43:46.652277 1893 pod_workers.go:191] Error syncing pod ae849738-e0cf-4a30-9b07-5cddd83db4b6 ("metrics-server-9975d5f86-vmdbz_kube-system(ae849738-e0cf-4a30-9b07-5cddd83db4b6)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0923 12:44:15.686374 4228 logs.go:138] Found kubelet problem: Sep 23 12:43:48 old-k8s-version-694600 kubelet[1893]: E0923 12:43:48.653714 1893 pod_workers.go:191] Error syncing pod ed366f72-9f74-45c1-9866-9faee4d9ffb0 ("dashboard-metrics-scraper-8d5bb5db8-2qtq6_kubernetes-dashboard(ed366f72-9f74-45c1-9866-9faee4d9ffb0)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0923 12:44:15.686374 4228 logs.go:138] Found kubelet problem: Sep 23 12:44:00 old-k8s-version-694600 kubelet[1893]: E0923 12:44:00.654685 1893 pod_workers.go:191] Error syncing pod ae849738-e0cf-4a30-9b07-5cddd83db4b6 ("metrics-server-9975d5f86-vmdbz_kube-system(ae849738-e0cf-4a30-9b07-5cddd83db4b6)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0923 12:44:15.687380 4228 logs.go:138] Found kubelet problem: Sep 23 12:44:02 old-k8s-version-694600 kubelet[1893]: E0923 12:44:02.652220 1893 pod_workers.go:191] Error syncing pod ed366f72-9f74-45c1-9866-9faee4d9ffb0 ("dashboard-metrics-scraper-8d5bb5db8-2qtq6_kubernetes-dashboard(ed366f72-9f74-45c1-9866-9faee4d9ffb0)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0923 12:44:15.687380 4228 logs.go:138] Found kubelet problem: Sep 23 12:44:13 old-k8s-version-694600 kubelet[1893]: E0923 12:44:13.649211 1893 pod_workers.go:191] Error syncing pod ae849738-e0cf-4a30-9b07-5cddd83db4b6 ("metrics-server-9975d5f86-vmdbz_kube-system(ae849738-e0cf-4a30-9b07-5cddd83db4b6)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
I0923 12:44:15.687380 4228 logs.go:123] Gathering logs for etcd [db948e782f56] ...
I0923 12:44:15.687380 4228 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 db948e782f56"
I0923 12:44:15.758402 4228 logs.go:123] Gathering logs for kube-scheduler [6f9ee2379541] ...
I0923 12:44:15.758402 4228 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 6f9ee2379541"
I0923 12:44:15.823391 4228 logs.go:123] Gathering logs for kube-proxy [ae76dbbad5df] ...
I0923 12:44:15.823391 4228 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ae76dbbad5df"
I0923 12:44:15.888377 4228 logs.go:123] Gathering logs for kube-controller-manager [cbaa7f55c1cf] ...
I0923 12:44:15.888377 4228 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 cbaa7f55c1cf"
I0923 12:44:15.969372 4228 logs.go:123] Gathering logs for storage-provisioner [4b8130a0a631] ...
I0923 12:44:15.969372 4228 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4b8130a0a631"
I0923 12:44:16.031365 4228 logs.go:123] Gathering logs for storage-provisioner [9420ceb6a8a9] ...
I0923 12:44:16.031365 4228 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 9420ceb6a8a9"
I0923 12:44:16.099417 4228 logs.go:123] Gathering logs for kube-apiserver [bf2bddf93da4] ...
I0923 12:44:16.099417 4228 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 bf2bddf93da4"
I0923 12:44:16.190773 4228 logs.go:123] Gathering logs for kube-apiserver [99e36abc5feb] ...
I0923 12:44:16.190773 4228 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 99e36abc5feb"
I0923 12:44:16.293784 4228 logs.go:123] Gathering logs for kube-scheduler [585ea5a5976b] ...
I0923 12:44:16.293784 4228 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 585ea5a5976b"
I0923 12:44:16.351792 4228 out.go:358] Setting ErrFile to fd 1892...
I0923 12:44:16.351792 4228 out.go:392] TERM=,COLORTERM=, which probably does not support color
W0923 12:44:16.351792 4228 out.go:270] X Problems detected in kubelet:
X Problems detected in kubelet:
W0923 12:44:16.351792 4228 out.go:270] Sep 23 12:43:46 old-k8s-version-694600 kubelet[1893]: E0923 12:43:46.652277 1893 pod_workers.go:191] Error syncing pod ae849738-e0cf-4a30-9b07-5cddd83db4b6 ("metrics-server-9975d5f86-vmdbz_kube-system(ae849738-e0cf-4a30-9b07-5cddd83db4b6)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Sep 23 12:43:46 old-k8s-version-694600 kubelet[1893]: E0923 12:43:46.652277 1893 pod_workers.go:191] Error syncing pod ae849738-e0cf-4a30-9b07-5cddd83db4b6 ("metrics-server-9975d5f86-vmdbz_kube-system(ae849738-e0cf-4a30-9b07-5cddd83db4b6)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0923 12:44:16.351792 4228 out.go:270] Sep 23 12:43:48 old-k8s-version-694600 kubelet[1893]: E0923 12:43:48.653714 1893 pod_workers.go:191] Error syncing pod ed366f72-9f74-45c1-9866-9faee4d9ffb0 ("dashboard-metrics-scraper-8d5bb5db8-2qtq6_kubernetes-dashboard(ed366f72-9f74-45c1-9866-9faee4d9ffb0)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
Sep 23 12:43:48 old-k8s-version-694600 kubelet[1893]: E0923 12:43:48.653714 1893 pod_workers.go:191] Error syncing pod ed366f72-9f74-45c1-9866-9faee4d9ffb0 ("dashboard-metrics-scraper-8d5bb5db8-2qtq6_kubernetes-dashboard(ed366f72-9f74-45c1-9866-9faee4d9ffb0)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0923 12:44:16.351792 4228 out.go:270] Sep 23 12:44:00 old-k8s-version-694600 kubelet[1893]: E0923 12:44:00.654685 1893 pod_workers.go:191] Error syncing pod ae849738-e0cf-4a30-9b07-5cddd83db4b6 ("metrics-server-9975d5f86-vmdbz_kube-system(ae849738-e0cf-4a30-9b07-5cddd83db4b6)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Sep 23 12:44:00 old-k8s-version-694600 kubelet[1893]: E0923 12:44:00.654685 1893 pod_workers.go:191] Error syncing pod ae849738-e0cf-4a30-9b07-5cddd83db4b6 ("metrics-server-9975d5f86-vmdbz_kube-system(ae849738-e0cf-4a30-9b07-5cddd83db4b6)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0923 12:44:16.351792 4228 out.go:270] Sep 23 12:44:02 old-k8s-version-694600 kubelet[1893]: E0923 12:44:02.652220 1893 pod_workers.go:191] Error syncing pod ed366f72-9f74-45c1-9866-9faee4d9ffb0 ("dashboard-metrics-scraper-8d5bb5db8-2qtq6_kubernetes-dashboard(ed366f72-9f74-45c1-9866-9faee4d9ffb0)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
Sep 23 12:44:02 old-k8s-version-694600 kubelet[1893]: E0923 12:44:02.652220 1893 pod_workers.go:191] Error syncing pod ed366f72-9f74-45c1-9866-9faee4d9ffb0 ("dashboard-metrics-scraper-8d5bb5db8-2qtq6_kubernetes-dashboard(ed366f72-9f74-45c1-9866-9faee4d9ffb0)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0923 12:44:16.351792 4228 out.go:270] Sep 23 12:44:13 old-k8s-version-694600 kubelet[1893]: E0923 12:44:13.649211 1893 pod_workers.go:191] Error syncing pod ae849738-e0cf-4a30-9b07-5cddd83db4b6 ("metrics-server-9975d5f86-vmdbz_kube-system(ae849738-e0cf-4a30-9b07-5cddd83db4b6)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Sep 23 12:44:13 old-k8s-version-694600 kubelet[1893]: E0923 12:44:13.649211 1893 pod_workers.go:191] Error syncing pod ae849738-e0cf-4a30-9b07-5cddd83db4b6 ("metrics-server-9975d5f86-vmdbz_kube-system(ae849738-e0cf-4a30-9b07-5cddd83db4b6)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
I0923 12:44:16.351792 4228 out.go:358] Setting ErrFile to fd 1892...
I0923 12:44:16.351792 4228 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0923 12:44:26.366782 4228 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0923 12:44:26.396825 4228 api_server.go:72] duration metric: took 5m49.7986149s to wait for apiserver process to appear ...
I0923 12:44:26.396825 4228 api_server.go:88] waiting for apiserver healthz status ...
I0923 12:44:26.405814 4228 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
I0923 12:44:26.461700 4228 logs.go:276] 2 containers: [bf2bddf93da4 99e36abc5feb]
I0923 12:44:26.473719 4228 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
I0923 12:44:26.527587 4228 logs.go:276] 2 containers: [db948e782f56 a7d64ac5d685]
I0923 12:44:26.535572 4228 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
I0923 12:44:26.583105 4228 logs.go:276] 2 containers: [ac17c0c4ecff db8367477ac1]
I0923 12:44:26.596122 4228 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
I0923 12:44:26.646802 4228 logs.go:276] 2 containers: [6f9ee2379541 585ea5a5976b]
I0923 12:44:26.658798 4228 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
I0923 12:44:26.710800 4228 logs.go:276] 2 containers: [ae76dbbad5df 606305ef153c]
I0923 12:44:26.723792 4228 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
I0923 12:44:26.774423 4228 logs.go:276] 2 containers: [cbaa7f55c1cf 1382815ffdc3]
I0923 12:44:26.785981 4228 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
I0923 12:44:26.833985 4228 logs.go:276] 0 containers: []
W0923 12:44:26.833985 4228 logs.go:278] No container was found matching "kindnet"
I0923 12:44:26.851524 4228 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
I0923 12:44:26.903398 4228 logs.go:276] 2 containers: [4b8130a0a631 9420ceb6a8a9]
I0923 12:44:26.912397 4228 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kubernetes-dashboard --format={{.ID}}
I0923 12:44:26.963406 4228 logs.go:276] 1 containers: [5eb85a2791fd]
I0923 12:44:26.963406 4228 logs.go:123] Gathering logs for kube-apiserver [99e36abc5feb] ...
I0923 12:44:26.963406 4228 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 99e36abc5feb"
I0923 12:44:27.072432 4228 logs.go:123] Gathering logs for container status ...
I0923 12:44:27.072432 4228 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0923 12:44:27.189774 4228 logs.go:123] Gathering logs for describe nodes ...
I0923 12:44:27.189774 4228 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0923 12:44:27.823897 4228 logs.go:123] Gathering logs for etcd [a7d64ac5d685] ...
I0923 12:44:27.823897 4228 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a7d64ac5d685"
I0923 12:44:27.890035 4228 logs.go:123] Gathering logs for kube-scheduler [585ea5a5976b] ...
I0923 12:44:27.890035 4228 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 585ea5a5976b"
I0923 12:44:27.947602 4228 logs.go:123] Gathering logs for kube-proxy [606305ef153c] ...
I0923 12:44:27.947602 4228 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 606305ef153c"
I0923 12:44:28.012651 4228 logs.go:123] Gathering logs for storage-provisioner [4b8130a0a631] ...
I0923 12:44:28.012651 4228 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4b8130a0a631"
I0923 12:44:28.105743 4228 logs.go:123] Gathering logs for storage-provisioner [9420ceb6a8a9] ...
I0923 12:44:28.105743 4228 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 9420ceb6a8a9"
I0923 12:44:28.170383 4228 logs.go:123] Gathering logs for kubernetes-dashboard [5eb85a2791fd] ...
I0923 12:44:28.170383 4228 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5eb85a2791fd"
I0923 12:44:28.235386 4228 logs.go:123] Gathering logs for Docker ...
I0923 12:44:28.235386 4228 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
I0923 12:44:28.780490 4228 logs.go:123] Gathering logs for etcd [db948e782f56] ...
I0923 12:44:28.780490 4228 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 db948e782f56"
I0923 12:44:28.863631 4228 logs.go:123] Gathering logs for kube-apiserver [bf2bddf93da4] ...
I0923 12:44:28.863631 4228 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 bf2bddf93da4"
I0923 12:44:28.995447 4228 logs.go:123] Gathering logs for kube-proxy [ae76dbbad5df] ...
I0923 12:44:28.995486 4228 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ae76dbbad5df"
I0923 12:44:29.067116 4228 logs.go:123] Gathering logs for kube-controller-manager [cbaa7f55c1cf] ...
I0923 12:44:29.067116 4228 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 cbaa7f55c1cf"
I0923 12:44:29.160099 4228 logs.go:123] Gathering logs for kube-controller-manager [1382815ffdc3] ...
I0923 12:44:29.160099 4228 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 1382815ffdc3"
I0923 12:44:29.255092 4228 logs.go:123] Gathering logs for kubelet ...
I0923 12:44:29.255092 4228 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
W0923 12:44:29.389521 4228 logs.go:138] Found kubelet problem: Sep 23 12:38:55 old-k8s-version-694600 kubelet[1893]: E0923 12:38:55.485189 1893 pod_workers.go:191] Error syncing pod ae849738-e0cf-4a30-9b07-5cddd83db4b6 ("metrics-server-9975d5f86-vmdbz_kube-system(ae849738-e0cf-4a30-9b07-5cddd83db4b6)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = Error response from daemon: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.65.254:53: no such host"
W0923 12:44:29.390517 4228 logs.go:138] Found kubelet problem: Sep 23 12:38:56 old-k8s-version-694600 kubelet[1893]: E0923 12:38:56.815962 1893 pod_workers.go:191] Error syncing pod ae849738-e0cf-4a30-9b07-5cddd83db4b6 ("metrics-server-9975d5f86-vmdbz_kube-system(ae849738-e0cf-4a30-9b07-5cddd83db4b6)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0923 12:44:29.390517 4228 logs.go:138] Found kubelet problem: Sep 23 12:38:57 old-k8s-version-694600 kubelet[1893]: E0923 12:38:57.902283 1893 pod_workers.go:191] Error syncing pod ae849738-e0cf-4a30-9b07-5cddd83db4b6 ("metrics-server-9975d5f86-vmdbz_kube-system(ae849738-e0cf-4a30-9b07-5cddd83db4b6)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0923 12:44:29.393519 4228 logs.go:138] Found kubelet problem: Sep 23 12:39:11 old-k8s-version-694600 kubelet[1893]: E0923 12:39:11.731791 1893 pod_workers.go:191] Error syncing pod ae849738-e0cf-4a30-9b07-5cddd83db4b6 ("metrics-server-9975d5f86-vmdbz_kube-system(ae849738-e0cf-4a30-9b07-5cddd83db4b6)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = Error response from daemon: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.65.254:53: no such host"
W0923 12:44:29.401538 4228 logs.go:138] Found kubelet problem: Sep 23 12:39:17 old-k8s-version-694600 kubelet[1893]: E0923 12:39:17.878257 1893 pod_workers.go:191] Error syncing pod 937b014a-169f-4dc5-ac66-a3eee1bc5138 ("storage-provisioner_kube-system(937b014a-169f-4dc5-ac66-a3eee1bc5138)"), skipping: failed to "StartContainer" for "storage-provisioner" with CrashLoopBackOff: "back-off 10s restarting failed container=storage-provisioner pod=storage-provisioner_kube-system(937b014a-169f-4dc5-ac66-a3eee1bc5138)"
W0923 12:44:29.401538 4228 logs.go:138] Found kubelet problem: Sep 23 12:39:23 old-k8s-version-694600 kubelet[1893]: E0923 12:39:23.681185 1893 pod_workers.go:191] Error syncing pod ae849738-e0cf-4a30-9b07-5cddd83db4b6 ("metrics-server-9975d5f86-vmdbz_kube-system(ae849738-e0cf-4a30-9b07-5cddd83db4b6)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0923 12:44:29.406540 4228 logs.go:138] Found kubelet problem: Sep 23 12:39:39 old-k8s-version-694600 kubelet[1893]: E0923 12:39:39.525345 1893 pod_workers.go:191] Error syncing pod ed366f72-9f74-45c1-9866-9faee4d9ffb0 ("dashboard-metrics-scraper-8d5bb5db8-2qtq6_kubernetes-dashboard(ed366f72-9f74-45c1-9866-9faee4d9ffb0)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ErrImagePull: "rpc error: code = Unknown desc = [DEPRECATION NOTICE] Docker Image Format v1 and Docker Image manifest version 2, schema 1 support is disabled by default and will be removed in an upcoming release. Suggest the author of registry.k8s.io/echoserver:1.4 to upgrade the image to the OCI Format or Docker Image manifest v2, schema 2. More information at https://docs.docker.com/go/deprecated-image-specs/"
W0923 12:44:29.410518 4228 logs.go:138] Found kubelet problem: Sep 23 12:39:39 old-k8s-version-694600 kubelet[1893]: E0923 12:39:39.605074 1893 pod_workers.go:191] Error syncing pod ae849738-e0cf-4a30-9b07-5cddd83db4b6 ("metrics-server-9975d5f86-vmdbz_kube-system(ae849738-e0cf-4a30-9b07-5cddd83db4b6)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = Error response from daemon: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.65.254:53: no such host"
W0923 12:44:29.410518 4228 logs.go:138] Found kubelet problem: Sep 23 12:39:39 old-k8s-version-694600 kubelet[1893]: E0923 12:39:39.711237 1893 pod_workers.go:191] Error syncing pod ed366f72-9f74-45c1-9866-9faee4d9ffb0 ("dashboard-metrics-scraper-8d5bb5db8-2qtq6_kubernetes-dashboard(ed366f72-9f74-45c1-9866-9faee4d9ffb0)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0923 12:44:29.414526 4228 logs.go:138] Found kubelet problem: Sep 23 12:39:53 old-k8s-version-694600 kubelet[1893]: E0923 12:39:53.262469 1893 pod_workers.go:191] Error syncing pod ed366f72-9f74-45c1-9866-9faee4d9ffb0 ("dashboard-metrics-scraper-8d5bb5db8-2qtq6_kubernetes-dashboard(ed366f72-9f74-45c1-9866-9faee4d9ffb0)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ErrImagePull: "rpc error: code = Unknown desc = [DEPRECATION NOTICE] Docker Image Format v1 and Docker Image manifest version 2, schema 1 support is disabled by default and will be removed in an upcoming release. Suggest the author of registry.k8s.io/echoserver:1.4 to upgrade the image to the OCI Format or Docker Image manifest v2, schema 2. More information at https://docs.docker.com/go/deprecated-image-specs/"
W0923 12:44:29.415684 4228 logs.go:138] Found kubelet problem: Sep 23 12:39:54 old-k8s-version-694600 kubelet[1893]: E0923 12:39:54.679747 1893 pod_workers.go:191] Error syncing pod ae849738-e0cf-4a30-9b07-5cddd83db4b6 ("metrics-server-9975d5f86-vmdbz_kube-system(ae849738-e0cf-4a30-9b07-5cddd83db4b6)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0923 12:44:29.416143 4228 logs.go:138] Found kubelet problem: Sep 23 12:40:07 old-k8s-version-694600 kubelet[1893]: E0923 12:40:07.675786 1893 pod_workers.go:191] Error syncing pod ed366f72-9f74-45c1-9866-9faee4d9ffb0 ("dashboard-metrics-scraper-8d5bb5db8-2qtq6_kubernetes-dashboard(ed366f72-9f74-45c1-9866-9faee4d9ffb0)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0923 12:44:29.416571 4228 logs.go:138] Found kubelet problem: Sep 23 12:40:09 old-k8s-version-694600 kubelet[1893]: E0923 12:40:09.676754 1893 pod_workers.go:191] Error syncing pod ae849738-e0cf-4a30-9b07-5cddd83db4b6 ("metrics-server-9975d5f86-vmdbz_kube-system(ae849738-e0cf-4a30-9b07-5cddd83db4b6)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0923 12:44:29.420525 4228 logs.go:138] Found kubelet problem: Sep 23 12:40:20 old-k8s-version-694600 kubelet[1893]: E0923 12:40:20.733409 1893 pod_workers.go:191] Error syncing pod ae849738-e0cf-4a30-9b07-5cddd83db4b6 ("metrics-server-9975d5f86-vmdbz_kube-system(ae849738-e0cf-4a30-9b07-5cddd83db4b6)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = Error response from daemon: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.65.254:53: no such host"
W0923 12:44:29.423836 4228 logs.go:138] Found kubelet problem: Sep 23 12:40:22 old-k8s-version-694600 kubelet[1893]: E0923 12:40:22.131490 1893 pod_workers.go:191] Error syncing pod ed366f72-9f74-45c1-9866-9faee4d9ffb0 ("dashboard-metrics-scraper-8d5bb5db8-2qtq6_kubernetes-dashboard(ed366f72-9f74-45c1-9866-9faee4d9ffb0)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ErrImagePull: "rpc error: code = Unknown desc = [DEPRECATION NOTICE] Docker Image Format v1 and Docker Image manifest version 2, schema 1 support is disabled by default and will be removed in an upcoming release. Suggest the author of registry.k8s.io/echoserver:1.4 to upgrade the image to the OCI Format or Docker Image manifest v2, schema 2. More information at https://docs.docker.com/go/deprecated-image-specs/"
W0923 12:44:29.423836 4228 logs.go:138] Found kubelet problem: Sep 23 12:40:34 old-k8s-version-694600 kubelet[1893]: E0923 12:40:34.672437 1893 pod_workers.go:191] Error syncing pod ae849738-e0cf-4a30-9b07-5cddd83db4b6 ("metrics-server-9975d5f86-vmdbz_kube-system(ae849738-e0cf-4a30-9b07-5cddd83db4b6)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0923 12:44:29.424518 4228 logs.go:138] Found kubelet problem: Sep 23 12:40:37 old-k8s-version-694600 kubelet[1893]: E0923 12:40:37.669640 1893 pod_workers.go:191] Error syncing pod ed366f72-9f74-45c1-9866-9faee4d9ffb0 ("dashboard-metrics-scraper-8d5bb5db8-2qtq6_kubernetes-dashboard(ed366f72-9f74-45c1-9866-9faee4d9ffb0)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0923 12:44:29.424846 4228 logs.go:138] Found kubelet problem: Sep 23 12:40:46 old-k8s-version-694600 kubelet[1893]: E0923 12:40:46.668789 1893 pod_workers.go:191] Error syncing pod ae849738-e0cf-4a30-9b07-5cddd83db4b6 ("metrics-server-9975d5f86-vmdbz_kube-system(ae849738-e0cf-4a30-9b07-5cddd83db4b6)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0923 12:44:29.425245 4228 logs.go:138] Found kubelet problem: Sep 23 12:40:50 old-k8s-version-694600 kubelet[1893]: E0923 12:40:50.669482 1893 pod_workers.go:191] Error syncing pod ed366f72-9f74-45c1-9866-9faee4d9ffb0 ("dashboard-metrics-scraper-8d5bb5db8-2qtq6_kubernetes-dashboard(ed366f72-9f74-45c1-9866-9faee4d9ffb0)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0923 12:44:29.425580 4228 logs.go:138] Found kubelet problem: Sep 23 12:41:00 old-k8s-version-694600 kubelet[1893]: E0923 12:41:00.669910 1893 pod_workers.go:191] Error syncing pod ae849738-e0cf-4a30-9b07-5cddd83db4b6 ("metrics-server-9975d5f86-vmdbz_kube-system(ae849738-e0cf-4a30-9b07-5cddd83db4b6)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0923 12:44:29.428472 4228 logs.go:138] Found kubelet problem: Sep 23 12:41:03 old-k8s-version-694600 kubelet[1893]: E0923 12:41:03.166885 1893 pod_workers.go:191] Error syncing pod ed366f72-9f74-45c1-9866-9faee4d9ffb0 ("dashboard-metrics-scraper-8d5bb5db8-2qtq6_kubernetes-dashboard(ed366f72-9f74-45c1-9866-9faee4d9ffb0)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ErrImagePull: "rpc error: code = Unknown desc = [DEPRECATION NOTICE] Docker Image Format v1 and Docker Image manifest version 2, schema 1 support is disabled by default and will be removed in an upcoming release. Suggest the author of registry.k8s.io/echoserver:1.4 to upgrade the image to the OCI Format or Docker Image manifest v2, schema 2. More information at https://docs.docker.com/go/deprecated-image-specs/"
W0923 12:44:29.428929 4228 logs.go:138] Found kubelet problem: Sep 23 12:41:15 old-k8s-version-694600 kubelet[1893]: E0923 12:41:15.677829 1893 pod_workers.go:191] Error syncing pod ae849738-e0cf-4a30-9b07-5cddd83db4b6 ("metrics-server-9975d5f86-vmdbz_kube-system(ae849738-e0cf-4a30-9b07-5cddd83db4b6)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0923 12:44:29.429375 4228 logs.go:138] Found kubelet problem: Sep 23 12:41:15 old-k8s-version-694600 kubelet[1893]: E0923 12:41:15.677922 1893 pod_workers.go:191] Error syncing pod ed366f72-9f74-45c1-9866-9faee4d9ffb0 ("dashboard-metrics-scraper-8d5bb5db8-2qtq6_kubernetes-dashboard(ed366f72-9f74-45c1-9866-9faee4d9ffb0)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0923 12:44:29.429639 4228 logs.go:138] Found kubelet problem: Sep 23 12:41:28 old-k8s-version-694600 kubelet[1893]: E0923 12:41:28.698549 1893 pod_workers.go:191] Error syncing pod ed366f72-9f74-45c1-9866-9faee4d9ffb0 ("dashboard-metrics-scraper-8d5bb5db8-2qtq6_kubernetes-dashboard(ed366f72-9f74-45c1-9866-9faee4d9ffb0)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0923 12:44:29.429944 4228 logs.go:138] Found kubelet problem: Sep 23 12:41:30 old-k8s-version-694600 kubelet[1893]: E0923 12:41:30.669230 1893 pod_workers.go:191] Error syncing pod ae849738-e0cf-4a30-9b07-5cddd83db4b6 ("metrics-server-9975d5f86-vmdbz_kube-system(ae849738-e0cf-4a30-9b07-5cddd83db4b6)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0923 12:44:29.430272 4228 logs.go:138] Found kubelet problem: Sep 23 12:41:39 old-k8s-version-694600 kubelet[1893]: E0923 12:41:39.664583 1893 pod_workers.go:191] Error syncing pod ed366f72-9f74-45c1-9866-9faee4d9ffb0 ("dashboard-metrics-scraper-8d5bb5db8-2qtq6_kubernetes-dashboard(ed366f72-9f74-45c1-9866-9faee4d9ffb0)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0923 12:44:29.432386 4228 logs.go:138] Found kubelet problem: Sep 23 12:41:43 old-k8s-version-694600 kubelet[1893]: E0923 12:41:43.768086 1893 pod_workers.go:191] Error syncing pod ae849738-e0cf-4a30-9b07-5cddd83db4b6 ("metrics-server-9975d5f86-vmdbz_kube-system(ae849738-e0cf-4a30-9b07-5cddd83db4b6)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = Error response from daemon: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.65.254:53: no such host"
W0923 12:44:29.433002 4228 logs.go:138] Found kubelet problem: Sep 23 12:41:52 old-k8s-version-694600 kubelet[1893]: E0923 12:41:52.664375 1893 pod_workers.go:191] Error syncing pod ed366f72-9f74-45c1-9866-9faee4d9ffb0 ("dashboard-metrics-scraper-8d5bb5db8-2qtq6_kubernetes-dashboard(ed366f72-9f74-45c1-9866-9faee4d9ffb0)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0923 12:44:29.433161 4228 logs.go:138] Found kubelet problem: Sep 23 12:41:57 old-k8s-version-694600 kubelet[1893]: E0923 12:41:57.678559 1893 pod_workers.go:191] Error syncing pod ae849738-e0cf-4a30-9b07-5cddd83db4b6 ("metrics-server-9975d5f86-vmdbz_kube-system(ae849738-e0cf-4a30-9b07-5cddd83db4b6)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0923 12:44:29.433161 4228 logs.go:138] Found kubelet problem: Sep 23 12:42:04 old-k8s-version-694600 kubelet[1893]: E0923 12:42:04.665461 1893 pod_workers.go:191] Error syncing pod ed366f72-9f74-45c1-9866-9faee4d9ffb0 ("dashboard-metrics-scraper-8d5bb5db8-2qtq6_kubernetes-dashboard(ed366f72-9f74-45c1-9866-9faee4d9ffb0)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0923 12:44:29.433161 4228 logs.go:138] Found kubelet problem: Sep 23 12:42:12 old-k8s-version-694600 kubelet[1893]: E0923 12:42:12.660131 1893 pod_workers.go:191] Error syncing pod ae849738-e0cf-4a30-9b07-5cddd83db4b6 ("metrics-server-9975d5f86-vmdbz_kube-system(ae849738-e0cf-4a30-9b07-5cddd83db4b6)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0923 12:44:29.433991 4228 logs.go:138] Found kubelet problem: Sep 23 12:42:16 old-k8s-version-694600 kubelet[1893]: E0923 12:42:16.660802 1893 pod_workers.go:191] Error syncing pod ed366f72-9f74-45c1-9866-9faee4d9ffb0 ("dashboard-metrics-scraper-8d5bb5db8-2qtq6_kubernetes-dashboard(ed366f72-9f74-45c1-9866-9faee4d9ffb0)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0923 12:44:29.433991 4228 logs.go:138] Found kubelet problem: Sep 23 12:42:24 old-k8s-version-694600 kubelet[1893]: E0923 12:42:24.660639 1893 pod_workers.go:191] Error syncing pod ae849738-e0cf-4a30-9b07-5cddd83db4b6 ("metrics-server-9975d5f86-vmdbz_kube-system(ae849738-e0cf-4a30-9b07-5cddd83db4b6)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0923 12:44:29.435984 4228 logs.go:138] Found kubelet problem: Sep 23 12:42:31 old-k8s-version-694600 kubelet[1893]: E0923 12:42:31.215753 1893 pod_workers.go:191] Error syncing pod ed366f72-9f74-45c1-9866-9faee4d9ffb0 ("dashboard-metrics-scraper-8d5bb5db8-2qtq6_kubernetes-dashboard(ed366f72-9f74-45c1-9866-9faee4d9ffb0)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ErrImagePull: "rpc error: code = Unknown desc = [DEPRECATION NOTICE] Docker Image Format v1 and Docker Image manifest version 2, schema 1 support is disabled by default and will be removed in an upcoming release. Suggest the author of registry.k8s.io/echoserver:1.4 to upgrade the image to the OCI Format or Docker Image manifest v2, schema 2. More information at https://docs.docker.com/go/deprecated-image-specs/"
W0923 12:44:29.435984 4228 logs.go:138] Found kubelet problem: Sep 23 12:42:39 old-k8s-version-694600 kubelet[1893]: E0923 12:42:39.657460 1893 pod_workers.go:191] Error syncing pod ae849738-e0cf-4a30-9b07-5cddd83db4b6 ("metrics-server-9975d5f86-vmdbz_kube-system(ae849738-e0cf-4a30-9b07-5cddd83db4b6)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0923 12:44:29.436983 4228 logs.go:138] Found kubelet problem: Sep 23 12:42:45 old-k8s-version-694600 kubelet[1893]: E0923 12:42:45.658547 1893 pod_workers.go:191] Error syncing pod ed366f72-9f74-45c1-9866-9faee4d9ffb0 ("dashboard-metrics-scraper-8d5bb5db8-2qtq6_kubernetes-dashboard(ed366f72-9f74-45c1-9866-9faee4d9ffb0)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0923 12:44:29.436983 4228 logs.go:138] Found kubelet problem: Sep 23 12:42:51 old-k8s-version-694600 kubelet[1893]: E0923 12:42:51.656478 1893 pod_workers.go:191] Error syncing pod ae849738-e0cf-4a30-9b07-5cddd83db4b6 ("metrics-server-9975d5f86-vmdbz_kube-system(ae849738-e0cf-4a30-9b07-5cddd83db4b6)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0923 12:44:29.436983 4228 logs.go:138] Found kubelet problem: Sep 23 12:42:58 old-k8s-version-694600 kubelet[1893]: E0923 12:42:58.657078 1893 pod_workers.go:191] Error syncing pod ed366f72-9f74-45c1-9866-9faee4d9ffb0 ("dashboard-metrics-scraper-8d5bb5db8-2qtq6_kubernetes-dashboard(ed366f72-9f74-45c1-9866-9faee4d9ffb0)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0923 12:44:29.436983 4228 logs.go:138] Found kubelet problem: Sep 23 12:43:06 old-k8s-version-694600 kubelet[1893]: E0923 12:43:06.656952 1893 pod_workers.go:191] Error syncing pod ae849738-e0cf-4a30-9b07-5cddd83db4b6 ("metrics-server-9975d5f86-vmdbz_kube-system(ae849738-e0cf-4a30-9b07-5cddd83db4b6)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0923 12:44:29.437975 4228 logs.go:138] Found kubelet problem: Sep 23 12:43:09 old-k8s-version-694600 kubelet[1893]: E0923 12:43:09.654057 1893 pod_workers.go:191] Error syncing pod ed366f72-9f74-45c1-9866-9faee4d9ffb0 ("dashboard-metrics-scraper-8d5bb5db8-2qtq6_kubernetes-dashboard(ed366f72-9f74-45c1-9866-9faee4d9ffb0)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0923 12:44:29.437975 4228 logs.go:138] Found kubelet problem: Sep 23 12:43:17 old-k8s-version-694600 kubelet[1893]: E0923 12:43:17.656711 1893 pod_workers.go:191] Error syncing pod ae849738-e0cf-4a30-9b07-5cddd83db4b6 ("metrics-server-9975d5f86-vmdbz_kube-system(ae849738-e0cf-4a30-9b07-5cddd83db4b6)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0923 12:44:29.437975 4228 logs.go:138] Found kubelet problem: Sep 23 12:43:22 old-k8s-version-694600 kubelet[1893]: E0923 12:43:22.657075 1893 pod_workers.go:191] Error syncing pod ed366f72-9f74-45c1-9866-9faee4d9ffb0 ("dashboard-metrics-scraper-8d5bb5db8-2qtq6_kubernetes-dashboard(ed366f72-9f74-45c1-9866-9faee4d9ffb0)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0923 12:44:29.437975 4228 logs.go:138] Found kubelet problem: Sep 23 12:43:31 old-k8s-version-694600 kubelet[1893]: E0923 12:43:31.654949 1893 pod_workers.go:191] Error syncing pod ae849738-e0cf-4a30-9b07-5cddd83db4b6 ("metrics-server-9975d5f86-vmdbz_kube-system(ae849738-e0cf-4a30-9b07-5cddd83db4b6)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0923 12:44:29.438981 4228 logs.go:138] Found kubelet problem: Sep 23 12:43:34 old-k8s-version-694600 kubelet[1893]: E0923 12:43:34.668314 1893 pod_workers.go:191] Error syncing pod ed366f72-9f74-45c1-9866-9faee4d9ffb0 ("dashboard-metrics-scraper-8d5bb5db8-2qtq6_kubernetes-dashboard(ed366f72-9f74-45c1-9866-9faee4d9ffb0)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0923 12:44:29.438981 4228 logs.go:138] Found kubelet problem: Sep 23 12:43:46 old-k8s-version-694600 kubelet[1893]: E0923 12:43:46.652277 1893 pod_workers.go:191] Error syncing pod ae849738-e0cf-4a30-9b07-5cddd83db4b6 ("metrics-server-9975d5f86-vmdbz_kube-system(ae849738-e0cf-4a30-9b07-5cddd83db4b6)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0923 12:44:29.438981 4228 logs.go:138] Found kubelet problem: Sep 23 12:43:48 old-k8s-version-694600 kubelet[1893]: E0923 12:43:48.653714 1893 pod_workers.go:191] Error syncing pod ed366f72-9f74-45c1-9866-9faee4d9ffb0 ("dashboard-metrics-scraper-8d5bb5db8-2qtq6_kubernetes-dashboard(ed366f72-9f74-45c1-9866-9faee4d9ffb0)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0923 12:44:29.438981 4228 logs.go:138] Found kubelet problem: Sep 23 12:44:00 old-k8s-version-694600 kubelet[1893]: E0923 12:44:00.654685 1893 pod_workers.go:191] Error syncing pod ae849738-e0cf-4a30-9b07-5cddd83db4b6 ("metrics-server-9975d5f86-vmdbz_kube-system(ae849738-e0cf-4a30-9b07-5cddd83db4b6)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0923 12:44:29.439974 4228 logs.go:138] Found kubelet problem: Sep 23 12:44:02 old-k8s-version-694600 kubelet[1893]: E0923 12:44:02.652220 1893 pod_workers.go:191] Error syncing pod ed366f72-9f74-45c1-9866-9faee4d9ffb0 ("dashboard-metrics-scraper-8d5bb5db8-2qtq6_kubernetes-dashboard(ed366f72-9f74-45c1-9866-9faee4d9ffb0)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0923 12:44:29.439974 4228 logs.go:138] Found kubelet problem: Sep 23 12:44:13 old-k8s-version-694600 kubelet[1893]: E0923 12:44:13.649211 1893 pod_workers.go:191] Error syncing pod ae849738-e0cf-4a30-9b07-5cddd83db4b6 ("metrics-server-9975d5f86-vmdbz_kube-system(ae849738-e0cf-4a30-9b07-5cddd83db4b6)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0923 12:44:29.439974 4228 logs.go:138] Found kubelet problem: Sep 23 12:44:15 old-k8s-version-694600 kubelet[1893]: E0923 12:44:15.648344 1893 pod_workers.go:191] Error syncing pod ed366f72-9f74-45c1-9866-9faee4d9ffb0 ("dashboard-metrics-scraper-8d5bb5db8-2qtq6_kubernetes-dashboard(ed366f72-9f74-45c1-9866-9faee4d9ffb0)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0923 12:44:29.442976 4228 logs.go:138] Found kubelet problem: Sep 23 12:44:28 old-k8s-version-694600 kubelet[1893]: E0923 12:44:28.021315 1893 pod_workers.go:191] Error syncing pod ae849738-e0cf-4a30-9b07-5cddd83db4b6 ("metrics-server-9975d5f86-vmdbz_kube-system(ae849738-e0cf-4a30-9b07-5cddd83db4b6)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = Error response from daemon: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.65.254:53: no such host"
I0923 12:44:29.442976 4228 logs.go:123] Gathering logs for coredns [ac17c0c4ecff] ...
I0923 12:44:29.442976 4228 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ac17c0c4ecff"
I0923 12:44:29.499985 4228 logs.go:123] Gathering logs for coredns [db8367477ac1] ...
I0923 12:44:29.499985 4228 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 db8367477ac1"
I0923 12:44:29.566261 4228 logs.go:123] Gathering logs for kube-scheduler [6f9ee2379541] ...
I0923 12:44:29.566261 4228 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 6f9ee2379541"
I0923 12:44:29.684329 4228 logs.go:123] Gathering logs for dmesg ...
I0923 12:44:29.685336 4228 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0923 12:44:29.716302 4228 out.go:358] Setting ErrFile to fd 1892...
I0923 12:44:29.716302 4228 out.go:392] TERM=,COLORTERM=, which probably does not support color
W0923 12:44:29.716302 4228 out.go:270] X Problems detected in kubelet:
X Problems detected in kubelet:
W0923 12:44:29.716302 4228 out.go:270] Sep 23 12:44:00 old-k8s-version-694600 kubelet[1893]: E0923 12:44:00.654685 1893 pod_workers.go:191] Error syncing pod ae849738-e0cf-4a30-9b07-5cddd83db4b6 ("metrics-server-9975d5f86-vmdbz_kube-system(ae849738-e0cf-4a30-9b07-5cddd83db4b6)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Sep 23 12:44:00 old-k8s-version-694600 kubelet[1893]: E0923 12:44:00.654685 1893 pod_workers.go:191] Error syncing pod ae849738-e0cf-4a30-9b07-5cddd83db4b6 ("metrics-server-9975d5f86-vmdbz_kube-system(ae849738-e0cf-4a30-9b07-5cddd83db4b6)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0923 12:44:29.716302 4228 out.go:270] Sep 23 12:44:02 old-k8s-version-694600 kubelet[1893]: E0923 12:44:02.652220 1893 pod_workers.go:191] Error syncing pod ed366f72-9f74-45c1-9866-9faee4d9ffb0 ("dashboard-metrics-scraper-8d5bb5db8-2qtq6_kubernetes-dashboard(ed366f72-9f74-45c1-9866-9faee4d9ffb0)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
Sep 23 12:44:02 old-k8s-version-694600 kubelet[1893]: E0923 12:44:02.652220 1893 pod_workers.go:191] Error syncing pod ed366f72-9f74-45c1-9866-9faee4d9ffb0 ("dashboard-metrics-scraper-8d5bb5db8-2qtq6_kubernetes-dashboard(ed366f72-9f74-45c1-9866-9faee4d9ffb0)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0923 12:44:29.716302 4228 out.go:270] Sep 23 12:44:13 old-k8s-version-694600 kubelet[1893]: E0923 12:44:13.649211 1893 pod_workers.go:191] Error syncing pod ae849738-e0cf-4a30-9b07-5cddd83db4b6 ("metrics-server-9975d5f86-vmdbz_kube-system(ae849738-e0cf-4a30-9b07-5cddd83db4b6)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Sep 23 12:44:13 old-k8s-version-694600 kubelet[1893]: E0923 12:44:13.649211 1893 pod_workers.go:191] Error syncing pod ae849738-e0cf-4a30-9b07-5cddd83db4b6 ("metrics-server-9975d5f86-vmdbz_kube-system(ae849738-e0cf-4a30-9b07-5cddd83db4b6)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0923 12:44:29.716302 4228 out.go:270] Sep 23 12:44:15 old-k8s-version-694600 kubelet[1893]: E0923 12:44:15.648344 1893 pod_workers.go:191] Error syncing pod ed366f72-9f74-45c1-9866-9faee4d9ffb0 ("dashboard-metrics-scraper-8d5bb5db8-2qtq6_kubernetes-dashboard(ed366f72-9f74-45c1-9866-9faee4d9ffb0)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
Sep 23 12:44:15 old-k8s-version-694600 kubelet[1893]: E0923 12:44:15.648344 1893 pod_workers.go:191] Error syncing pod ed366f72-9f74-45c1-9866-9faee4d9ffb0 ("dashboard-metrics-scraper-8d5bb5db8-2qtq6_kubernetes-dashboard(ed366f72-9f74-45c1-9866-9faee4d9ffb0)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0923 12:44:29.716302 4228 out.go:270] Sep 23 12:44:28 old-k8s-version-694600 kubelet[1893]: E0923 12:44:28.021315 1893 pod_workers.go:191] Error syncing pod ae849738-e0cf-4a30-9b07-5cddd83db4b6 ("metrics-server-9975d5f86-vmdbz_kube-system(ae849738-e0cf-4a30-9b07-5cddd83db4b6)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = Error response from daemon: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.65.254:53: no such host"
Sep 23 12:44:28 old-k8s-version-694600 kubelet[1893]: E0923 12:44:28.021315 1893 pod_workers.go:191] Error syncing pod ae849738-e0cf-4a30-9b07-5cddd83db4b6 ("metrics-server-9975d5f86-vmdbz_kube-system(ae849738-e0cf-4a30-9b07-5cddd83db4b6)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = Error response from daemon: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.65.254:53: no such host"
I0923 12:44:29.716302 4228 out.go:358] Setting ErrFile to fd 1892...
I0923 12:44:29.716302 4228 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0923 12:44:39.717477 4228 api_server.go:253] Checking apiserver healthz at https://127.0.0.1:60042/healthz ...
I0923 12:44:39.735476 4228 api_server.go:279] https://127.0.0.1:60042/healthz returned 200:
ok
I0923 12:44:39.739491 4228 out.go:201]
W0923 12:44:39.743472 4228 out.go:270] X Exiting due to K8S_UNHEALTHY_CONTROL_PLANE: wait 6m0s for node: wait for healthy API server: controlPlane never updated to v1.20.0
X Exiting due to K8S_UNHEALTHY_CONTROL_PLANE: wait 6m0s for node: wait for healthy API server: controlPlane never updated to v1.20.0
W0923 12:44:39.743472 4228 out.go:270] * Suggestion: Control Plane could not update, try minikube delete --all --purge
* Suggestion: Control Plane could not update, try minikube delete --all --purge
W0923 12:44:39.743472 4228 out.go:270] * Related issue: https://github.com/kubernetes/minikube/issues/11417
* Related issue: https://github.com/kubernetes/minikube/issues/11417
W0923 12:44:39.743472 4228 out.go:270] *
*
W0923 12:44:39.745491 4228 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0923 12:44:39.750477 4228 out.go:201]
** /stderr **
start_stop_delete_test.go:259: failed to start minikube post-stop. args "out/minikube-windows-amd64.exe start -p old-k8s-version-694600 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --kubernetes-version=v1.20.0": exit status 102
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:230: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/SecondStart]: docker inspect <======
helpers_test.go:231: (dbg) Run: docker inspect old-k8s-version-694600
helpers_test.go:235: (dbg) docker inspect old-k8s-version-694600:
-- stdout --
[
{
"Id": "441bc2f7b5adfb2cfb4dc936c5a158e90a684418ff594a104d03ebca9fdc4c1a",
"Created": "2024-09-23T12:33:49.012189383Z",
"Path": "/usr/local/bin/entrypoint",
"Args": [
"/sbin/init"
],
"State": {
"Status": "running",
"Running": true,
"Paused": false,
"Restarting": false,
"OOMKilled": false,
"Dead": false,
"Pid": 303759,
"ExitCode": 0,
"Error": "",
"StartedAt": "2024-09-23T12:37:52.038740944Z",
"FinishedAt": "2024-09-23T12:37:48.135536288Z"
},
"Image": "sha256:d94335c0cd164ddebb3c5158e317bcf6d2e08dc08f448d25251f425acb842829",
"ResolvConfPath": "/var/lib/docker/containers/441bc2f7b5adfb2cfb4dc936c5a158e90a684418ff594a104d03ebca9fdc4c1a/resolv.conf",
"HostnamePath": "/var/lib/docker/containers/441bc2f7b5adfb2cfb4dc936c5a158e90a684418ff594a104d03ebca9fdc4c1a/hostname",
"HostsPath": "/var/lib/docker/containers/441bc2f7b5adfb2cfb4dc936c5a158e90a684418ff594a104d03ebca9fdc4c1a/hosts",
"LogPath": "/var/lib/docker/containers/441bc2f7b5adfb2cfb4dc936c5a158e90a684418ff594a104d03ebca9fdc4c1a/441bc2f7b5adfb2cfb4dc936c5a158e90a684418ff594a104d03ebca9fdc4c1a-json.log",
"Name": "/old-k8s-version-694600",
"RestartCount": 0,
"Driver": "overlay2",
"Platform": "linux",
"MountLabel": "",
"ProcessLabel": "",
"AppArmorProfile": "",
"ExecIDs": null,
"HostConfig": {
"Binds": [
"/lib/modules:/lib/modules:ro",
"old-k8s-version-694600:/var"
],
"ContainerIDFile": "",
"LogConfig": {
"Type": "json-file",
"Config": {}
},
"NetworkMode": "old-k8s-version-694600",
"PortBindings": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "0"
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "0"
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "0"
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "0"
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "0"
}
]
},
"RestartPolicy": {
"Name": "no",
"MaximumRetryCount": 0
},
"AutoRemove": false,
"VolumeDriver": "",
"VolumesFrom": null,
"ConsoleSize": [
0,
0
],
"CapAdd": null,
"CapDrop": null,
"CgroupnsMode": "host",
"Dns": [],
"DnsOptions": [],
"DnsSearch": [],
"ExtraHosts": null,
"GroupAdd": null,
"IpcMode": "private",
"Cgroup": "",
"Links": null,
"OomScoreAdj": 0,
"PidMode": "",
"Privileged": true,
"PublishAllPorts": false,
"ReadonlyRootfs": false,
"SecurityOpt": [
"seccomp=unconfined",
"apparmor=unconfined",
"label=disable"
],
"Tmpfs": {
"/run": "",
"/tmp": ""
},
"UTSMode": "",
"UsernsMode": "",
"ShmSize": 67108864,
"Runtime": "runc",
"Isolation": "",
"CpuShares": 0,
"Memory": 2306867200,
"NanoCpus": 2000000000,
"CgroupParent": "",
"BlkioWeight": 0,
"BlkioWeightDevice": [],
"BlkioDeviceReadBps": [],
"BlkioDeviceWriteBps": [],
"BlkioDeviceReadIOps": [],
"BlkioDeviceWriteIOps": [],
"CpuPeriod": 0,
"CpuQuota": 0,
"CpuRealtimePeriod": 0,
"CpuRealtimeRuntime": 0,
"CpusetCpus": "",
"CpusetMems": "",
"Devices": [],
"DeviceCgroupRules": null,
"DeviceRequests": null,
"MemoryReservation": 0,
"MemorySwap": 2306867200,
"MemorySwappiness": null,
"OomKillDisable": false,
"PidsLimit": null,
"Ulimits": [],
"CpuCount": 0,
"CpuPercent": 0,
"IOMaximumIOps": 0,
"IOMaximumBandwidth": 0,
"MaskedPaths": null,
"ReadonlyPaths": null
},
"GraphDriver": {
"Data": {
"LowerDir": "/var/lib/docker/overlay2/3d1bb798fb4d7d4ab89e7033a82caba81dca0ab3456a03538588d0784a8ea824-init/diff:/var/lib/docker/overlay2/c7287d3444125b9a8090b921db98cb6ed8be2d7a048d39cf2a791cb2793d7251/diff",
"MergedDir": "/var/lib/docker/overlay2/3d1bb798fb4d7d4ab89e7033a82caba81dca0ab3456a03538588d0784a8ea824/merged",
"UpperDir": "/var/lib/docker/overlay2/3d1bb798fb4d7d4ab89e7033a82caba81dca0ab3456a03538588d0784a8ea824/diff",
"WorkDir": "/var/lib/docker/overlay2/3d1bb798fb4d7d4ab89e7033a82caba81dca0ab3456a03538588d0784a8ea824/work"
},
"Name": "overlay2"
},
"Mounts": [
{
"Type": "bind",
"Source": "/lib/modules",
"Destination": "/lib/modules",
"Mode": "ro",
"RW": false,
"Propagation": "rprivate"
},
{
"Type": "volume",
"Name": "old-k8s-version-694600",
"Source": "/var/lib/docker/volumes/old-k8s-version-694600/_data",
"Destination": "/var",
"Driver": "local",
"Mode": "z",
"RW": true,
"Propagation": ""
}
],
"Config": {
"Hostname": "old-k8s-version-694600",
"Domainname": "",
"User": "",
"AttachStdin": false,
"AttachStdout": false,
"AttachStderr": false,
"ExposedPorts": {
"22/tcp": {},
"2376/tcp": {},
"32443/tcp": {},
"5000/tcp": {},
"8443/tcp": {}
},
"Tty": true,
"OpenStdin": false,
"StdinOnce": false,
"Env": [
"container=docker",
"PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
],
"Cmd": null,
"Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726784731-19672@sha256:7f8c62ddb0100a5b958dd19c5b5478b8c7ef13da9a0a4d6c7d18f43544e0dbed",
"Volumes": null,
"WorkingDir": "/",
"Entrypoint": [
"/usr/local/bin/entrypoint",
"/sbin/init"
],
"OnBuild": null,
"Labels": {
"created_by.minikube.sigs.k8s.io": "true",
"mode.minikube.sigs.k8s.io": "old-k8s-version-694600",
"name.minikube.sigs.k8s.io": "old-k8s-version-694600",
"role.minikube.sigs.k8s.io": ""
},
"StopSignal": "SIGRTMIN+3"
},
"NetworkSettings": {
"Bridge": "",
"SandboxID": "85cd1bcfb9cdc758d88b41d131fef70a8ca59d5e8b8d5b89a82577316b86a82e",
"SandboxKey": "/var/run/docker/netns/85cd1bcfb9cd",
"Ports": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "60038"
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "60039"
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "60040"
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "60041"
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "60042"
}
]
},
"HairpinMode": false,
"LinkLocalIPv6Address": "",
"LinkLocalIPv6PrefixLen": 0,
"SecondaryIPAddresses": null,
"SecondaryIPv6Addresses": null,
"EndpointID": "",
"Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"IPAddress": "",
"IPPrefixLen": 0,
"IPv6Gateway": "",
"MacAddress": "",
"Networks": {
"old-k8s-version-694600": {
"IPAMConfig": {
"IPv4Address": "192.168.103.2"
},
"Links": null,
"Aliases": null,
"MacAddress": "02:42:c0:a8:67:02",
"DriverOpts": null,
"NetworkID": "15fe9a4473166025986c923d51f44c965b073feca0dd2650fd129e1c57b5f812",
"EndpointID": "c55be3cc11eaf7b3e39285fe3383483e186e0dafef4892fbe0ca13c52017c614",
"Gateway": "192.168.103.1",
"IPAddress": "192.168.103.2",
"IPPrefixLen": 24,
"IPv6Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"DNSNames": [
"old-k8s-version-694600",
"441bc2f7b5ad"
]
}
}
}
}
]
-- /stdout --
helpers_test.go:239: (dbg) Run: out/minikube-windows-amd64.exe status --format={{.Host}} -p old-k8s-version-694600 -n old-k8s-version-694600
helpers_test.go:239: (dbg) Done: out/minikube-windows-amd64.exe status --format={{.Host}} -p old-k8s-version-694600 -n old-k8s-version-694600: (1.2240958s)
helpers_test.go:244: <<< TestStartStop/group/old-k8s-version/serial/SecondStart FAILED: start of post-mortem logs <<<
helpers_test.go:245: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/SecondStart]: minikube logs <======
helpers_test.go:247: (dbg) Run: out/minikube-windows-amd64.exe -p old-k8s-version-694600 logs -n 25
helpers_test.go:247: (dbg) Done: out/minikube-windows-amd64.exe -p old-k8s-version-694600 logs -n 25: (2.9040335s)
helpers_test.go:252: TestStartStop/group/old-k8s-version/serial/SecondStart logs:
-- stdout --
==> Audit <==
|---------|------------------------------------------------------|-----------------------|-------------------|---------|---------------------|---------------------|
| Command | Args | Profile | User | Version | Start Time | End Time |
|---------|------------------------------------------------------|-----------------------|-------------------|---------|---------------------|---------------------|
| ssh | -p auto-579000 sudo systemctl | auto-579000 | minikube2\jenkins | v1.34.0 | 23 Sep 24 12:44 UTC | 23 Sep 24 12:44 UTC |
| | cat docker --no-pager | | | | | |
| ssh | -p auto-579000 sudo cat | auto-579000 | minikube2\jenkins | v1.34.0 | 23 Sep 24 12:44 UTC | 23 Sep 24 12:44 UTC |
| | /etc/docker/daemon.json | | | | | |
| ssh | -p auto-579000 sudo docker | auto-579000 | minikube2\jenkins | v1.34.0 | 23 Sep 24 12:44 UTC | 23 Sep 24 12:44 UTC |
| | system info | | | | | |
| ssh | -p auto-579000 sudo systemctl | auto-579000 | minikube2\jenkins | v1.34.0 | 23 Sep 24 12:44 UTC | 23 Sep 24 12:44 UTC |
| | status cri-docker --all --full | | | | | |
| | --no-pager | | | | | |
| ssh | -p auto-579000 sudo systemctl | auto-579000 | minikube2\jenkins | v1.34.0 | 23 Sep 24 12:44 UTC | 23 Sep 24 12:44 UTC |
| | cat cri-docker --no-pager | | | | | |
| ssh | -p auto-579000 sudo cat | auto-579000 | minikube2\jenkins | v1.34.0 | 23 Sep 24 12:44 UTC | 23 Sep 24 12:44 UTC |
| | /etc/systemd/system/cri-docker.service.d/10-cni.conf | | | | | |
| ssh | -p auto-579000 sudo cat | auto-579000 | minikube2\jenkins | v1.34.0 | 23 Sep 24 12:44 UTC | 23 Sep 24 12:44 UTC |
| | /usr/lib/systemd/system/cri-docker.service | | | | | |
| ssh | -p auto-579000 sudo | auto-579000 | minikube2\jenkins | v1.34.0 | 23 Sep 24 12:44 UTC | 23 Sep 24 12:44 UTC |
| | cri-dockerd --version | | | | | |
| ssh | -p auto-579000 sudo systemctl | auto-579000 | minikube2\jenkins | v1.34.0 | 23 Sep 24 12:44 UTC | 23 Sep 24 12:44 UTC |
| | status containerd --all --full | | | | | |
| | --no-pager | | | | | |
| image | embed-certs-648500 image list | embed-certs-648500 | minikube2\jenkins | v1.34.0 | 23 Sep 24 12:44 UTC | 23 Sep 24 12:44 UTC |
| | --format=json | | | | | |
| ssh | -p auto-579000 sudo systemctl | auto-579000 | minikube2\jenkins | v1.34.0 | 23 Sep 24 12:44 UTC | 23 Sep 24 12:44 UTC |
| | cat containerd --no-pager | | | | | |
| pause | -p embed-certs-648500 | embed-certs-648500 | minikube2\jenkins | v1.34.0 | 23 Sep 24 12:44 UTC | 23 Sep 24 12:44 UTC |
| | --alsologtostderr -v=1 | | | | | |
| ssh | -p auto-579000 sudo cat | auto-579000 | minikube2\jenkins | v1.34.0 | 23 Sep 24 12:44 UTC | 23 Sep 24 12:44 UTC |
| | /lib/systemd/system/containerd.service | | | | | |
| ssh | -p auto-579000 sudo cat | auto-579000 | minikube2\jenkins | v1.34.0 | 23 Sep 24 12:44 UTC | 23 Sep 24 12:44 UTC |
| | /etc/containerd/config.toml | | | | | |
| ssh | -p auto-579000 sudo containerd | auto-579000 | minikube2\jenkins | v1.34.0 | 23 Sep 24 12:44 UTC | 23 Sep 24 12:44 UTC |
| | config dump | | | | | |
| ssh | -p auto-579000 sudo systemctl | auto-579000 | minikube2\jenkins | v1.34.0 | 23 Sep 24 12:44 UTC | |
| | status crio --all --full | | | | | |
| | --no-pager | | | | | |
| unpause | -p embed-certs-648500 | embed-certs-648500 | minikube2\jenkins | v1.34.0 | 23 Sep 24 12:44 UTC | 23 Sep 24 12:44 UTC |
| | --alsologtostderr -v=1 | | | | | |
| ssh | -p auto-579000 sudo systemctl | auto-579000 | minikube2\jenkins | v1.34.0 | 23 Sep 24 12:44 UTC | 23 Sep 24 12:44 UTC |
| | cat crio --no-pager | | | | | |
| ssh | -p auto-579000 sudo find | auto-579000 | minikube2\jenkins | v1.34.0 | 23 Sep 24 12:44 UTC | 23 Sep 24 12:44 UTC |
| | /etc/crio -type f -exec sh -c | | | | | |
| | 'echo {}; cat {}' \; | | | | | |
| ssh | -p auto-579000 sudo crio | auto-579000 | minikube2\jenkins | v1.34.0 | 23 Sep 24 12:44 UTC | 23 Sep 24 12:44 UTC |
| | config | | | | | |
| delete | -p auto-579000 | auto-579000 | minikube2\jenkins | v1.34.0 | 23 Sep 24 12:44 UTC | 23 Sep 24 12:44 UTC |
| delete | -p embed-certs-648500 | embed-certs-648500 | minikube2\jenkins | v1.34.0 | 23 Sep 24 12:44 UTC | 23 Sep 24 12:44 UTC |
| start | -p custom-flannel-579000 | custom-flannel-579000 | minikube2\jenkins | v1.34.0 | 23 Sep 24 12:44 UTC | |
| | --memory=3072 --alsologtostderr | | | | | |
| | --wait=true --wait-timeout=15m | | | | | |
| | --cni=testdata\kube-flannel.yaml | | | | | |
| | --driver=docker | | | | | |
| delete | -p embed-certs-648500 | embed-certs-648500 | minikube2\jenkins | v1.34.0 | 23 Sep 24 12:44 UTC | 23 Sep 24 12:44 UTC |
| start | -p false-579000 --memory=3072 | false-579000 | minikube2\jenkins | v1.34.0 | 23 Sep 24 12:44 UTC | |
| | --alsologtostderr --wait=true | | | | | |
| | --wait-timeout=15m --cni=false | | | | | |
| | --driver=docker | | | | | |
|---------|------------------------------------------------------|-----------------------|-------------------|---------|---------------------|---------------------|
==> Last Start <==
Log file created at: 2024/09/23 12:44:31
Running on machine: minikube2
Binary: Built with gc go1.23.0 for windows/amd64
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
I0923 12:44:31.046186 6636 out.go:345] Setting OutFile to fd 2028 ...
I0923 12:44:31.124632 6636 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0923 12:44:31.124632 6636 out.go:358] Setting ErrFile to fd 1708...
I0923 12:44:31.124632 6636 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0923 12:44:31.149500 6636 out.go:352] Setting JSON to false
I0923 12:44:31.152592 6636 start.go:129] hostinfo: {"hostname":"minikube2","uptime":6338,"bootTime":1727089132,"procs":192,"os":"windows","platform":"Microsoft Windows 10 Enterprise N","platformFamily":"Standalone Workstation","platformVersion":"10.0.19045.4894 Build 19045.4894","kernelVersion":"10.0.19045.4894 Build 19045.4894","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"29dced62-21fb-45d8-a34e-472b66ced002"}
W0923 12:44:31.152592 6636 start.go:137] gopshost.Virtualization returned error: not implemented yet
I0923 12:44:27.167258 5956 pod_ready.go:103] pod "calico-kube-controllers-b8d8894fb-kf86t" in "kube-system" namespace has status "Ready":"False"
I0923 12:44:29.626316 5956 pod_ready.go:103] pod "calico-kube-controllers-b8d8894fb-kf86t" in "kube-system" namespace has status "Ready":"False"
I0923 12:44:31.243482 6636 out.go:177] * [false-579000] minikube v1.34.0 on Microsoft Windows 10 Enterprise N 10.0.19045.4894 Build 19045.4894
I0923 12:44:31.247862 6636 notify.go:220] Checking for updates...
I0923 12:44:31.252446 6636 out.go:177] - KUBECONFIG=C:\Users\jenkins.minikube2\minikube-integration\kubeconfig
I0923 12:44:31.260488 6636 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0923 12:44:31.267122 6636 out.go:177] - MINIKUBE_HOME=C:\Users\jenkins.minikube2\minikube-integration\.minikube
I0923 12:44:31.274857 6636 out.go:177] - MINIKUBE_LOCATION=19690
I0923 12:44:31.282498 6636 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0923 12:44:31.290643 6636 config.go:182] Loaded profile config "calico-579000": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.31.1
I0923 12:44:31.291215 6636 config.go:182] Loaded profile config "custom-flannel-579000": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.31.1
I0923 12:44:31.291930 6636 config.go:182] Loaded profile config "old-k8s-version-694600": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.20.0
I0923 12:44:31.292258 6636 driver.go:394] Setting default libvirt URI to qemu:///system
I0923 12:44:31.480645 6636 docker.go:123] docker version: linux-27.2.0:Docker Desktop 4.34.1 (166053)
I0923 12:44:31.489652 6636 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0923 12:44:31.879034 6636 info.go:266] docker info: {ID:e770b6ad-f18b-4184-94e7-b0fdb570deb0 Containers:2 ContainersRunning:2 ContainersPaused:0 ContainersStopped:0 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:79 OomKillDisable:true NGoroutines:89 SystemTime:2024-09-23 12:44:31.840560079 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:12 KernelVersion:5.15.153.1-microsoft-standard-WSL2 OperatingSystem:Docker Desktop OSType:linux Architecture:x86_64 Ind
exServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:16 MemTotal:33657536512 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy:http.docker.internal:3128 HTTPSProxy:http.docker.internal:3128 NoProxy:hubproxy.docker.internal Name:docker-desktop Labels:[com.docker.desktop.address=npipe://\\.\pipe\docker_cli] ExperimentalBuild:false ServerVersion:27.2.0 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:8fc6bcff51318944179630522a095cc9dbf9f353 Expected:8fc6bcff51318944179630522a095cc9dbf9f353} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0
Expected:de40ad0} SecurityOptions:[name=seccomp,profile=unconfined] ProductLicense: Warnings:[WARNING: No blkio throttle.read_bps_device support WARNING: No blkio throttle.write_bps_device support WARNING: No blkio throttle.read_iops_device support WARNING: No blkio throttle.write_iops_device support WARNING: daemon is not using the default seccomp profile] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:C:\Program Files\Docker\cli-plugins\docker-buildx.exe SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.16.2-desktop.1] map[Name:compose Path:C:\Program Files\Docker\cli-plugins\docker-compose.exe SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.2-desktop.2] map[Name:debug Path:C:\Program Files\Docker\cli-plugins\docker-debug.exe SchemaVersion:0.1.0 ShortDescription:Get a shell into any image or container Vendor:Docker Inc. Version:0.0.34] map[Name:desktop Path:C:\Program Files\Docker\cli-plugins\docker-desktop.exe Schema
Version:0.1.0 ShortDescription:Docker Desktop commands (Alpha) Vendor:Docker Inc. Version:v0.0.15] map[Name:dev Path:C:\Program Files\Docker\cli-plugins\docker-dev.exe SchemaVersion:0.1.0 ShortDescription:Docker Dev Environments Vendor:Docker Inc. Version:v0.1.2] map[Name:extension Path:C:\Program Files\Docker\cli-plugins\docker-extension.exe SchemaVersion:0.1.0 ShortDescription:Manages Docker extensions Vendor:Docker Inc. Version:v0.2.25] map[Name:feedback Path:C:\Program Files\Docker\cli-plugins\docker-feedback.exe SchemaVersion:0.1.0 ShortDescription:Provide feedback, right in your terminal! Vendor:Docker Inc. Version:v1.0.5] map[Name:init Path:C:\Program Files\Docker\cli-plugins\docker-init.exe SchemaVersion:0.1.0 ShortDescription:Creates Docker-related starter files for your project Vendor:Docker Inc. Version:v1.3.0] map[Name:sbom Path:C:\Program Files\Docker\cli-plugins\docker-sbom.exe SchemaVersion:0.1.0 ShortDescription:View the packaged-based Software Bill Of Materials (SBOM) for an image URL:https:/
/github.com/docker/sbom-cli-plugin Vendor:Anchore Inc. Version:0.6.0] map[Name:scout Path:C:\Program Files\Docker\cli-plugins\docker-scout.exe SchemaVersion:0.1.0 ShortDescription:Docker Scout Vendor:Docker Inc. Version:v1.13.0]] Warnings:<nil>}}
I0923 12:44:31.883032 6636 out.go:177] * Using the docker driver based on user configuration
I0923 12:44:31.891030 6636 start.go:297] selected driver: docker
I0923 12:44:31.891030 6636 start.go:901] validating driver "docker" against <nil>
I0923 12:44:31.891030 6636 start.go:912] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0923 12:44:31.966631 6636 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0923 12:44:32.344204 6636 info.go:266] docker info: {ID:e770b6ad-f18b-4184-94e7-b0fdb570deb0 Containers:2 ContainersRunning:2 ContainersPaused:0 ContainersStopped:0 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:80 OomKillDisable:true NGoroutines:89 SystemTime:2024-09-23 12:44:32.309756877 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:12 KernelVersion:5.15.153.1-microsoft-standard-WSL2 OperatingSystem:Docker Desktop OSType:linux Architecture:x86_64 Ind
exServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:16 MemTotal:33657536512 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy:http.docker.internal:3128 HTTPSProxy:http.docker.internal:3128 NoProxy:hubproxy.docker.internal Name:docker-desktop Labels:[com.docker.desktop.address=npipe://\\.\pipe\docker_cli] ExperimentalBuild:false ServerVersion:27.2.0 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:8fc6bcff51318944179630522a095cc9dbf9f353 Expected:8fc6bcff51318944179630522a095cc9dbf9f353} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0
Expected:de40ad0} SecurityOptions:[name=seccomp,profile=unconfined] ProductLicense: Warnings:[WARNING: No blkio throttle.read_bps_device support WARNING: No blkio throttle.write_bps_device support WARNING: No blkio throttle.read_iops_device support WARNING: No blkio throttle.write_iops_device support WARNING: daemon is not using the default seccomp profile] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:C:\Program Files\Docker\cli-plugins\docker-buildx.exe SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.16.2-desktop.1] map[Name:compose Path:C:\Program Files\Docker\cli-plugins\docker-compose.exe SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.2-desktop.2] map[Name:debug Path:C:\Program Files\Docker\cli-plugins\docker-debug.exe SchemaVersion:0.1.0 ShortDescription:Get a shell into any image or container Vendor:Docker Inc. Version:0.0.34] map[Name:desktop Path:C:\Program Files\Docker\cli-plugins\docker-desktop.exe Schema
Version:0.1.0 ShortDescription:Docker Desktop commands (Alpha) Vendor:Docker Inc. Version:v0.0.15] map[Name:dev Path:C:\Program Files\Docker\cli-plugins\docker-dev.exe SchemaVersion:0.1.0 ShortDescription:Docker Dev Environments Vendor:Docker Inc. Version:v0.1.2] map[Name:extension Path:C:\Program Files\Docker\cli-plugins\docker-extension.exe SchemaVersion:0.1.0 ShortDescription:Manages Docker extensions Vendor:Docker Inc. Version:v0.2.25] map[Name:feedback Path:C:\Program Files\Docker\cli-plugins\docker-feedback.exe SchemaVersion:0.1.0 ShortDescription:Provide feedback, right in your terminal! Vendor:Docker Inc. Version:v1.0.5] map[Name:init Path:C:\Program Files\Docker\cli-plugins\docker-init.exe SchemaVersion:0.1.0 ShortDescription:Creates Docker-related starter files for your project Vendor:Docker Inc. Version:v1.3.0] map[Name:sbom Path:C:\Program Files\Docker\cli-plugins\docker-sbom.exe SchemaVersion:0.1.0 ShortDescription:View the packaged-based Software Bill Of Materials (SBOM) for an image URL:https:/
/github.com/docker/sbom-cli-plugin Vendor:Anchore Inc. Version:0.6.0] map[Name:scout Path:C:\Program Files\Docker\cli-plugins\docker-scout.exe SchemaVersion:0.1.0 ShortDescription:Docker Scout Vendor:Docker Inc. Version:v1.13.0]] Warnings:<nil>}}
I0923 12:44:32.345207 6636 start_flags.go:310] no existing cluster config was found, will generate one from the flags
I0923 12:44:32.346377 6636 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0923 12:44:32.346377 6636 out.go:177] * Using Docker Desktop driver with root privileges
I0923 12:44:32.353249 6636 cni.go:84] Creating CNI manager for "false"
I0923 12:44:32.353249 6636 start.go:340] cluster config:
{Name:false-579000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726784731-19672@sha256:7f8c62ddb0100a5b958dd19c5b5478b8c7ef13da9a0a4d6c7d18f43544e0dbed Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.1 ClusterName:false-579000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:d
ocker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:false} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:C:\Users\jenkins.minikube2:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP
: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0923 12:44:32.358224 6636 out.go:177] * Starting "false-579000" primary control-plane node in "false-579000" cluster
I0923 12:44:32.365205 6636 cache.go:121] Beginning downloading kic base image for docker with docker
I0923 12:44:32.374244 6636 out.go:177] * Pulling base image v0.0.45-1726784731-19672 ...
I0923 12:44:32.380204 6636 preload.go:131] Checking if preload exists for k8s version v1.31.1 and runtime docker
I0923 12:44:32.380204 6636 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726784731-19672@sha256:7f8c62ddb0100a5b958dd19c5b5478b8c7ef13da9a0a4d6c7d18f43544e0dbed in local docker daemon
I0923 12:44:32.380204 6636 preload.go:146] Found local preload: C:\Users\jenkins.minikube2\minikube-integration\.minikube\cache\preloaded-tarball\preloaded-images-k8s-v18-v1.31.1-docker-overlay2-amd64.tar.lz4
I0923 12:44:32.380204 6636 cache.go:56] Caching tarball of preloaded images
I0923 12:44:32.381210 6636 preload.go:172] Found C:\Users\jenkins.minikube2\minikube-integration\.minikube\cache\preloaded-tarball\preloaded-images-k8s-v18-v1.31.1-docker-overlay2-amd64.tar.lz4 in cache, skipping download
I0923 12:44:32.381210 6636 cache.go:59] Finished verifying existence of preloaded tar for v1.31.1 on docker
I0923 12:44:32.381210 6636 profile.go:143] Saving config to C:\Users\jenkins.minikube2\minikube-integration\.minikube\profiles\false-579000\config.json ...
I0923 12:44:32.381210 6636 lock.go:35] WriteFile acquiring C:\Users\jenkins.minikube2\minikube-integration\.minikube\profiles\false-579000\config.json: {Name:mk009d7ac1de780cd68ca9916b7a5c638ffaa261 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0923 12:44:32.498347 6636 image.go:98] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726784731-19672@sha256:7f8c62ddb0100a5b958dd19c5b5478b8c7ef13da9a0a4d6c7d18f43544e0dbed in local docker daemon, skipping pull
I0923 12:44:32.498347 6636 cache.go:144] gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726784731-19672@sha256:7f8c62ddb0100a5b958dd19c5b5478b8c7ef13da9a0a4d6c7d18f43544e0dbed exists in daemon, skipping load
I0923 12:44:32.498347 6636 cache.go:194] Successfully downloaded all kic artifacts
I0923 12:44:32.498347 6636 start.go:360] acquireMachinesLock for false-579000: {Name:mk545e73c94d9a16da04c221b47ccd312103589d Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0923 12:44:32.498347 6636 start.go:364] duration metric: took 0s to acquireMachinesLock for "false-579000"
I0923 12:44:32.498347 6636 start.go:93] Provisioning new machine with config: &{Name:false-579000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726784731-19672@sha256:7f8c62ddb0100a5b958dd19c5b5478b8c7ef13da9a0a4d6c7d18f43544e0dbed Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.1 ClusterName:false-579000 Namespace:default APIServerHAVIP: APIServerName:minik
ubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:false} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:C:\Users\jenkins.minikube2:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetr
ics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:docker ControlPlane:true Worker:true}
I0923 12:44:32.498347 6636 start.go:125] createHost starting for "" (driver="docker")
I0923 12:44:30.035833 2288 out.go:235] * Creating docker container (CPUs=2, Memory=3072MB) ...
I0923 12:44:30.035833 2288 start.go:159] libmachine.API.Create for "custom-flannel-579000" (driver="docker")
I0923 12:44:30.035833 2288 client.go:168] LocalClient.Create starting
I0923 12:44:30.037421 2288 main.go:141] libmachine: Reading certificate data from C:\Users\jenkins.minikube2\minikube-integration\.minikube\certs\ca.pem
I0923 12:44:30.037421 2288 main.go:141] libmachine: Decoding PEM data...
I0923 12:44:30.037421 2288 main.go:141] libmachine: Parsing certificate...
I0923 12:44:30.037998 2288 main.go:141] libmachine: Reading certificate data from C:\Users\jenkins.minikube2\minikube-integration\.minikube\certs\cert.pem
I0923 12:44:30.038206 2288 main.go:141] libmachine: Decoding PEM data...
I0923 12:44:30.038206 2288 main.go:141] libmachine: Parsing certificate...
I0923 12:44:30.050926 2288 cli_runner.go:164] Run: docker network inspect custom-flannel-579000 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
W0923 12:44:30.132908 2288 cli_runner.go:211] docker network inspect custom-flannel-579000 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1
I0923 12:44:30.140904 2288 network_create.go:284] running [docker network inspect custom-flannel-579000] to gather additional debugging logs...
I0923 12:44:30.140904 2288 cli_runner.go:164] Run: docker network inspect custom-flannel-579000
W0923 12:44:30.217916 2288 cli_runner.go:211] docker network inspect custom-flannel-579000 returned with exit code 1
I0923 12:44:30.217916 2288 network_create.go:287] error running [docker network inspect custom-flannel-579000]: docker network inspect custom-flannel-579000: exit status 1
stdout:
[]
stderr:
Error response from daemon: network custom-flannel-579000 not found
I0923 12:44:30.217916 2288 network_create.go:289] output of [docker network inspect custom-flannel-579000]: -- stdout --
[]
-- /stdout --
** stderr **
Error response from daemon: network custom-flannel-579000 not found
** /stderr **
I0923 12:44:30.225912 2288 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I0923 12:44:30.318911 2288 network.go:209] skipping subnet 192.168.49.0/24 that is reserved: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:<nil>}
I0923 12:44:30.349359 2288 network.go:209] skipping subnet 192.168.58.0/24 that is reserved: &{IP:192.168.58.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.58.0/24 Gateway:192.168.58.1 ClientMin:192.168.58.2 ClientMax:192.168.58.254 Broadcast:192.168.58.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:<nil>}
I0923 12:44:30.371957 2288 network.go:206] using free private subnet 192.168.67.0/24: &{IP:192.168.67.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.67.0/24 Gateway:192.168.67.1 ClientMin:192.168.67.2 ClientMax:192.168.67.254 Broadcast:192.168.67.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc001636fc0}
I0923 12:44:30.372077 2288 network_create.go:124] attempt to create docker network custom-flannel-579000 192.168.67.0/24 with gateway 192.168.67.1 and MTU of 1500 ...
I0923 12:44:30.379715 2288 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.67.0/24 --gateway=192.168.67.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=custom-flannel-579000 custom-flannel-579000
W0923 12:44:30.471641 2288 cli_runner.go:211] docker network create --driver=bridge --subnet=192.168.67.0/24 --gateway=192.168.67.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=custom-flannel-579000 custom-flannel-579000 returned with exit code 1
W0923 12:44:30.471641 2288 network_create.go:149] failed to create docker network custom-flannel-579000 192.168.67.0/24 with gateway 192.168.67.1 and mtu of 1500: docker network create --driver=bridge --subnet=192.168.67.0/24 --gateway=192.168.67.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=custom-flannel-579000 custom-flannel-579000: exit status 1
stdout:
stderr:
Error response from daemon: invalid pool request: Pool overlaps with other one on this address space
W0923 12:44:30.471641 2288 network_create.go:116] failed to create docker network custom-flannel-579000 192.168.67.0/24, will retry: subnet is taken
I0923 12:44:30.505787 2288 network.go:209] skipping subnet 192.168.67.0/24 that is reserved: &{IP:192.168.67.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.67.0/24 Gateway:192.168.67.1 ClientMin:192.168.67.2 ClientMax:192.168.67.254 Broadcast:192.168.67.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:<nil>}
I0923 12:44:30.525789 2288 network.go:206] using free private subnet 192.168.76.0/24: &{IP:192.168.76.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.76.0/24 Gateway:192.168.76.1 ClientMin:192.168.76.2 ClientMax:192.168.76.254 Broadcast:192.168.76.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc0016376b0}
I0923 12:44:30.525789 2288 network_create.go:124] attempt to create docker network custom-flannel-579000 192.168.76.0/24 with gateway 192.168.76.1 and MTU of 1500 ...
I0923 12:44:30.532826 2288 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.76.0/24 --gateway=192.168.76.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=custom-flannel-579000 custom-flannel-579000
I0923 12:44:31.487663 2288 network_create.go:108] docker network custom-flannel-579000 192.168.76.0/24 created
I0923 12:44:31.487663 2288 kic.go:121] calculated static IP "192.168.76.2" for the "custom-flannel-579000" container
I0923 12:44:31.504652 2288 cli_runner.go:164] Run: docker ps -a --format {{.Names}}
I0923 12:44:31.603662 2288 cli_runner.go:164] Run: docker volume create custom-flannel-579000 --label name.minikube.sigs.k8s.io=custom-flannel-579000 --label created_by.minikube.sigs.k8s.io=true
I0923 12:44:31.706796 2288 oci.go:103] Successfully created a docker volume custom-flannel-579000
I0923 12:44:31.719800 2288 cli_runner.go:164] Run: docker run --rm --name custom-flannel-579000-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=custom-flannel-579000 --entrypoint /usr/bin/test -v custom-flannel-579000:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726784731-19672@sha256:7f8c62ddb0100a5b958dd19c5b5478b8c7ef13da9a0a4d6c7d18f43544e0dbed -d /var/lib
I0923 12:44:33.490099 2288 cli_runner.go:217] Completed: docker run --rm --name custom-flannel-579000-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=custom-flannel-579000 --entrypoint /usr/bin/test -v custom-flannel-579000:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726784731-19672@sha256:7f8c62ddb0100a5b958dd19c5b5478b8c7ef13da9a0a4d6c7d18f43544e0dbed -d /var/lib: (1.7702849s)
I0923 12:44:33.490099 2288 oci.go:107] Successfully prepared a docker volume custom-flannel-579000
I0923 12:44:33.490099 2288 preload.go:131] Checking if preload exists for k8s version v1.31.1 and runtime docker
I0923 12:44:33.490099 2288 kic.go:194] Starting extracting preloaded images to volume ...
I0923 12:44:33.499079 2288 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v C:\Users\jenkins.minikube2\minikube-integration\.minikube\cache\preloaded-tarball\preloaded-images-k8s-v18-v1.31.1-docker-overlay2-amd64.tar.lz4:/preloaded.tar:ro -v custom-flannel-579000:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726784731-19672@sha256:7f8c62ddb0100a5b958dd19c5b5478b8c7ef13da9a0a4d6c7d18f43544e0dbed -I lz4 -xf /preloaded.tar -C /extractDir
I0923 12:44:32.505346 6636 out.go:235] * Creating docker container (CPUs=2, Memory=3072MB) ...
I0923 12:44:32.505346 6636 start.go:159] libmachine.API.Create for "false-579000" (driver="docker")
I0923 12:44:32.505346 6636 client.go:168] LocalClient.Create starting
I0923 12:44:32.506366 6636 main.go:141] libmachine: Reading certificate data from C:\Users\jenkins.minikube2\minikube-integration\.minikube\certs\ca.pem
I0923 12:44:32.506366 6636 main.go:141] libmachine: Decoding PEM data...
I0923 12:44:32.506366 6636 main.go:141] libmachine: Parsing certificate...
I0923 12:44:32.506366 6636 main.go:141] libmachine: Reading certificate data from C:\Users\jenkins.minikube2\minikube-integration\.minikube\certs\cert.pem
I0923 12:44:32.507371 6636 main.go:141] libmachine: Decoding PEM data...
I0923 12:44:32.507371 6636 main.go:141] libmachine: Parsing certificate...
I0923 12:44:32.519353 6636 cli_runner.go:164] Run: docker network inspect false-579000 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
W0923 12:44:32.597449 6636 cli_runner.go:211] docker network inspect false-579000 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1
I0923 12:44:32.606354 6636 network_create.go:284] running [docker network inspect false-579000] to gather additional debugging logs...
I0923 12:44:32.606354 6636 cli_runner.go:164] Run: docker network inspect false-579000
W0923 12:44:32.689358 6636 cli_runner.go:211] docker network inspect false-579000 returned with exit code 1
I0923 12:44:32.689358 6636 network_create.go:287] error running [docker network inspect false-579000]: docker network inspect false-579000: exit status 1
stdout:
[]
stderr:
Error response from daemon: network false-579000 not found
I0923 12:44:32.689358 6636 network_create.go:289] output of [docker network inspect false-579000]: -- stdout --
[]
-- /stdout --
** stderr **
Error response from daemon: network false-579000 not found
** /stderr **
I0923 12:44:32.698352 6636 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I0923 12:44:32.808872 6636 network.go:209] skipping subnet 192.168.49.0/24 that is reserved: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:<nil>}
I0923 12:44:32.841107 6636 network.go:209] skipping subnet 192.168.58.0/24 that is reserved: &{IP:192.168.58.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.58.0/24 Gateway:192.168.58.1 ClientMin:192.168.58.2 ClientMax:192.168.58.254 Broadcast:192.168.58.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:<nil>}
I0923 12:44:32.872425 6636 network.go:209] skipping subnet 192.168.67.0/24 that is reserved: &{IP:192.168.67.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.67.0/24 Gateway:192.168.67.1 ClientMin:192.168.67.2 ClientMax:192.168.67.254 Broadcast:192.168.67.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:<nil>}
I0923 12:44:32.903033 6636 network.go:209] skipping subnet 192.168.76.0/24 that is reserved: &{IP:192.168.76.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.76.0/24 Gateway:192.168.76.1 ClientMin:192.168.76.2 ClientMax:192.168.76.254 Broadcast:192.168.76.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:<nil>}
I0923 12:44:32.929030 6636 network.go:206] using free private subnet 192.168.85.0/24: &{IP:192.168.85.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.85.0/24 Gateway:192.168.85.1 ClientMin:192.168.85.2 ClientMax:192.168.85.254 Broadcast:192.168.85.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc0016b60f0}
I0923 12:44:32.929030 6636 network_create.go:124] attempt to create docker network false-579000 192.168.85.0/24 with gateway 192.168.85.1 and MTU of 1500 ...
I0923 12:44:32.937012 6636 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.85.0/24 --gateway=192.168.85.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=false-579000 false-579000
I0923 12:44:33.447068 6636 network_create.go:108] docker network false-579000 192.168.85.0/24 created
I0923 12:44:33.447068 6636 kic.go:121] calculated static IP "192.168.85.2" for the "false-579000" container
I0923 12:44:33.469579 6636 cli_runner.go:164] Run: docker ps -a --format {{.Names}}
I0923 12:44:33.556078 6636 cli_runner.go:164] Run: docker volume create false-579000 --label name.minikube.sigs.k8s.io=false-579000 --label created_by.minikube.sigs.k8s.io=true
I0923 12:44:33.646013 6636 oci.go:103] Successfully created a docker volume false-579000
I0923 12:44:33.656339 6636 cli_runner.go:164] Run: docker run --rm --name false-579000-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=false-579000 --entrypoint /usr/bin/test -v false-579000:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726784731-19672@sha256:7f8c62ddb0100a5b958dd19c5b5478b8c7ef13da9a0a4d6c7d18f43544e0dbed -d /var/lib
I0923 12:44:31.626577 5956 pod_ready.go:103] pod "calico-kube-controllers-b8d8894fb-kf86t" in "kube-system" namespace has status "Ready":"False"
I0923 12:44:33.121648 5956 pod_ready.go:93] pod "calico-kube-controllers-b8d8894fb-kf86t" in "kube-system" namespace has status "Ready":"True"
I0923 12:44:33.121867 5956 pod_ready.go:82] duration metric: took 1m18.0179683s for pod "calico-kube-controllers-b8d8894fb-kf86t" in "kube-system" namespace to be "Ready" ...
I0923 12:44:33.121867 5956 pod_ready.go:79] waiting up to 15m0s for pod "calico-node-sf6t5" in "kube-system" namespace to be "Ready" ...
I0923 12:44:33.138382 5956 pod_ready.go:93] pod "calico-node-sf6t5" in "kube-system" namespace has status "Ready":"True"
I0923 12:44:33.138382 5956 pod_ready.go:82] duration metric: took 16.5146ms for pod "calico-node-sf6t5" in "kube-system" namespace to be "Ready" ...
I0923 12:44:33.138382 5956 pod_ready.go:79] waiting up to 15m0s for pod "coredns-7c65d6cfc9-n4q8p" in "kube-system" namespace to be "Ready" ...
I0923 12:44:33.151340 5956 pod_ready.go:93] pod "coredns-7c65d6cfc9-n4q8p" in "kube-system" namespace has status "Ready":"True"
I0923 12:44:33.151340 5956 pod_ready.go:82] duration metric: took 12.9581ms for pod "coredns-7c65d6cfc9-n4q8p" in "kube-system" namespace to be "Ready" ...
I0923 12:44:33.151340 5956 pod_ready.go:79] waiting up to 15m0s for pod "coredns-7c65d6cfc9-pb4h7" in "kube-system" namespace to be "Ready" ...
I0923 12:44:33.161984 5956 pod_ready.go:98] error getting pod "coredns-7c65d6cfc9-pb4h7" in "kube-system" namespace (skipping!): pods "coredns-7c65d6cfc9-pb4h7" not found
I0923 12:44:33.162237 5956 pod_ready.go:82] duration metric: took 10.7728ms for pod "coredns-7c65d6cfc9-pb4h7" in "kube-system" namespace to be "Ready" ...
E0923 12:44:33.162367 5956 pod_ready.go:67] WaitExtra: waitPodCondition: error getting pod "coredns-7c65d6cfc9-pb4h7" in "kube-system" namespace (skipping!): pods "coredns-7c65d6cfc9-pb4h7" not found
I0923 12:44:33.162367 5956 pod_ready.go:79] waiting up to 15m0s for pod "etcd-calico-579000" in "kube-system" namespace to be "Ready" ...
I0923 12:44:33.181974 5956 pod_ready.go:93] pod "etcd-calico-579000" in "kube-system" namespace has status "Ready":"True"
I0923 12:44:33.182057 5956 pod_ready.go:82] duration metric: took 19.5873ms for pod "etcd-calico-579000" in "kube-system" namespace to be "Ready" ...
I0923 12:44:33.182057 5956 pod_ready.go:79] waiting up to 15m0s for pod "kube-apiserver-calico-579000" in "kube-system" namespace to be "Ready" ...
I0923 12:44:33.312842 5956 pod_ready.go:93] pod "kube-apiserver-calico-579000" in "kube-system" namespace has status "Ready":"True"
I0923 12:44:33.312842 5956 pod_ready.go:82] duration metric: took 130.7836ms for pod "kube-apiserver-calico-579000" in "kube-system" namespace to be "Ready" ...
I0923 12:44:33.312842 5956 pod_ready.go:79] waiting up to 15m0s for pod "kube-controller-manager-calico-579000" in "kube-system" namespace to be "Ready" ...
I0923 12:44:33.713331 5956 pod_ready.go:93] pod "kube-controller-manager-calico-579000" in "kube-system" namespace has status "Ready":"True"
I0923 12:44:33.713331 5956 pod_ready.go:82] duration metric: took 400.4858ms for pod "kube-controller-manager-calico-579000" in "kube-system" namespace to be "Ready" ...
I0923 12:44:33.713331 5956 pod_ready.go:79] waiting up to 15m0s for pod "kube-proxy-wfz6t" in "kube-system" namespace to be "Ready" ...
I0923 12:44:34.114437 5956 pod_ready.go:93] pod "kube-proxy-wfz6t" in "kube-system" namespace has status "Ready":"True"
I0923 12:44:34.114437 5956 pod_ready.go:82] duration metric: took 401.1029ms for pod "kube-proxy-wfz6t" in "kube-system" namespace to be "Ready" ...
I0923 12:44:34.114437 5956 pod_ready.go:79] waiting up to 15m0s for pod "kube-scheduler-calico-579000" in "kube-system" namespace to be "Ready" ...
I0923 12:44:34.513750 5956 pod_ready.go:93] pod "kube-scheduler-calico-579000" in "kube-system" namespace has status "Ready":"True"
I0923 12:44:34.513750 5956 pod_ready.go:82] duration metric: took 399.3101ms for pod "kube-scheduler-calico-579000" in "kube-system" namespace to be "Ready" ...
I0923 12:44:34.513750 5956 pod_ready.go:39] duration metric: took 1m19.4298591s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0923 12:44:34.513750 5956 api_server.go:52] waiting for apiserver process to appear ...
I0923 12:44:34.528506 5956 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
I0923 12:44:34.588477 5956 logs.go:276] 1 containers: [304a451854d7]
I0923 12:44:34.599462 5956 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
I0923 12:44:34.651476 5956 logs.go:276] 1 containers: [31a58c1516b6]
I0923 12:44:34.665477 5956 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
I0923 12:44:34.709462 5956 logs.go:276] 1 containers: [ece3446fb1e3]
I0923 12:44:34.717465 5956 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
I0923 12:44:34.763211 5956 logs.go:276] 1 containers: [a2fd13638bdf]
I0923 12:44:34.772364 5956 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
I0923 12:44:34.821122 5956 logs.go:276] 1 containers: [c3cf061d5f5f]
I0923 12:44:34.829851 5956 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
I0923 12:44:34.874625 5956 logs.go:276] 1 containers: [6ea5e8ad224d]
I0923 12:44:34.882639 5956 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
I0923 12:44:34.931642 5956 logs.go:276] 0 containers: []
W0923 12:44:34.931642 5956 logs.go:278] No container was found matching "kindnet"
I0923 12:44:34.931642 5956 logs.go:123] Gathering logs for kube-apiserver [304a451854d7] ...
I0923 12:44:34.931642 5956 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 304a451854d7"
I0923 12:44:35.007824 5956 logs.go:123] Gathering logs for coredns [ece3446fb1e3] ...
I0923 12:44:35.007824 5956 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ece3446fb1e3"
I0923 12:44:35.075871 5956 logs.go:123] Gathering logs for kube-proxy [c3cf061d5f5f] ...
I0923 12:44:35.075871 5956 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c3cf061d5f5f"
I0923 12:44:35.126640 5956 logs.go:123] Gathering logs for kubelet ...
I0923 12:44:35.126640 5956 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I0923 12:44:35.340646 5956 logs.go:123] Gathering logs for dmesg ...
I0923 12:44:35.341310 5956 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0923 12:44:35.380161 5956 logs.go:123] Gathering logs for describe nodes ...
I0923 12:44:35.380161 5956 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.31.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0923 12:44:35.594831 5956 logs.go:123] Gathering logs for Docker ...
I0923 12:44:35.594831 5956 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
I0923 12:44:35.759529 5956 logs.go:123] Gathering logs for container status ...
I0923 12:44:35.759529 5956 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0923 12:44:35.886235 5956 logs.go:123] Gathering logs for etcd [31a58c1516b6] ...
I0923 12:44:35.886766 5956 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 31a58c1516b6"
I0923 12:44:35.991835 5956 logs.go:123] Gathering logs for kube-scheduler [a2fd13638bdf] ...
I0923 12:44:35.991835 5956 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a2fd13638bdf"
I0923 12:44:36.101663 5956 logs.go:123] Gathering logs for kube-controller-manager [6ea5e8ad224d] ...
I0923 12:44:36.101663 5956 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 6ea5e8ad224d"
I0923 12:44:39.717477 4228 api_server.go:253] Checking apiserver healthz at https://127.0.0.1:60042/healthz ...
I0923 12:44:39.735476 4228 api_server.go:279] https://127.0.0.1:60042/healthz returned 200:
ok
I0923 12:44:39.739491 4228 out.go:201]
W0923 12:44:39.743472 4228 out.go:270] X Exiting due to K8S_UNHEALTHY_CONTROL_PLANE: wait 6m0s for node: wait for healthy API server: controlPlane never updated to v1.20.0
W0923 12:44:39.743472 4228 out.go:270] * Suggestion: Control Plane could not update, try minikube delete --all --purge
W0923 12:44:39.743472 4228 out.go:270] * Related issue: https://github.com/kubernetes/minikube/issues/11417
W0923 12:44:39.743472 4228 out.go:270] *
W0923 12:44:39.745491 4228 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0923 12:44:39.750477 4228 out.go:201]
I0923 12:44:36.584602 6636 cli_runner.go:217] Completed: docker run --rm --name false-579000-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=false-579000 --entrypoint /usr/bin/test -v false-579000:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726784731-19672@sha256:7f8c62ddb0100a5b958dd19c5b5478b8c7ef13da9a0a4d6c7d18f43544e0dbed -d /var/lib: (2.9281637s)
I0923 12:44:36.584816 6636 oci.go:107] Successfully prepared a docker volume false-579000
I0923 12:44:36.584816 6636 preload.go:131] Checking if preload exists for k8s version v1.31.1 and runtime docker
I0923 12:44:36.584816 6636 kic.go:194] Starting extracting preloaded images to volume ...
I0923 12:44:36.595266 6636 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v C:\Users\jenkins.minikube2\minikube-integration\.minikube\cache\preloaded-tarball\preloaded-images-k8s-v18-v1.31.1-docker-overlay2-amd64.tar.lz4:/preloaded.tar:ro -v false-579000:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726784731-19672@sha256:7f8c62ddb0100a5b958dd19c5b5478b8c7ef13da9a0a4d6c7d18f43544e0dbed -I lz4 -xf /preloaded.tar -C /extractDir
I0923 12:44:38.729951 5956 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0923 12:44:38.758665 5956 api_server.go:72] duration metric: took 1m27.274971s to wait for apiserver process to appear ...
I0923 12:44:38.758665 5956 api_server.go:88] waiting for apiserver healthz status ...
I0923 12:44:38.766661 5956 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
I0923 12:44:38.824745 5956 logs.go:276] 1 containers: [304a451854d7]
I0923 12:44:38.836701 5956 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
I0923 12:44:38.886693 5956 logs.go:276] 1 containers: [31a58c1516b6]
I0923 12:44:38.894687 5956 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
I0923 12:44:38.943699 5956 logs.go:276] 1 containers: [ece3446fb1e3]
I0923 12:44:38.952690 5956 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
I0923 12:44:38.996675 5956 logs.go:276] 1 containers: [a2fd13638bdf]
I0923 12:44:39.004690 5956 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
I0923 12:44:39.052594 5956 logs.go:276] 1 containers: [c3cf061d5f5f]
I0923 12:44:39.062509 5956 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
I0923 12:44:39.115317 5956 logs.go:276] 1 containers: [6ea5e8ad224d]
I0923 12:44:39.123323 5956 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
I0923 12:44:39.175693 5956 logs.go:276] 0 containers: []
W0923 12:44:39.175693 5956 logs.go:278] No container was found matching "kindnet"
I0923 12:44:39.175801 5956 logs.go:123] Gathering logs for etcd [31a58c1516b6] ...
I0923 12:44:39.175801 5956 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 31a58c1516b6"
I0923 12:44:39.253811 5956 logs.go:123] Gathering logs for coredns [ece3446fb1e3] ...
I0923 12:44:39.253811 5956 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ece3446fb1e3"
I0923 12:44:39.299804 5956 logs.go:123] Gathering logs for kube-scheduler [a2fd13638bdf] ...
I0923 12:44:39.299804 5956 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a2fd13638bdf"
I0923 12:44:39.358864 5956 logs.go:123] Gathering logs for Docker ...
I0923 12:44:39.358864 5956 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
I0923 12:44:39.452567 5956 logs.go:123] Gathering logs for container status ...
I0923 12:44:39.452567 5956 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0923 12:44:39.544732 5956 logs.go:123] Gathering logs for kubelet ...
I0923 12:44:39.544732 5956 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I0923 12:44:39.715479 5956 logs.go:123] Gathering logs for dmesg ...
I0923 12:44:39.715479 5956 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0923 12:44:39.750477 5956 logs.go:123] Gathering logs for describe nodes ...
I0923 12:44:39.750477 5956 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.31.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0923 12:44:39.980880 5956 logs.go:123] Gathering logs for kube-apiserver [304a451854d7] ...
I0923 12:44:39.980880 5956 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 304a451854d7"
I0923 12:44:40.051011 5956 logs.go:123] Gathering logs for kube-proxy [c3cf061d5f5f] ...
I0923 12:44:40.051011 5956 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c3cf061d5f5f"
I0923 12:44:40.114379 5956 logs.go:123] Gathering logs for kube-controller-manager [6ea5e8ad224d] ...
I0923 12:44:40.114379 5956 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 6ea5e8ad224d"
==> Docker <==
Sep 23 12:39:53 old-k8s-version-694600 dockerd[1463]: time="2024-09-23T12:39:53.002022937Z" level=warning msg="reference for unknown type: application/vnd.docker.distribution.manifest.v1+prettyjws" digest="sha256:5d99aa1120524c801bc8c1a7077e8f5ec122ba16b6dda1a5d3826057f67b9bcb" remote="registry.k8s.io/echoserver:1.4" spanID=bc562c3ebf8ea584 traceID=12bda907be02af66096253dac142f012
Sep 23 12:39:53 old-k8s-version-694600 dockerd[1463]: time="2024-09-23T12:39:53.248475389Z" level=warning msg="Error persisting manifest" digest="sha256:5d99aa1120524c801bc8c1a7077e8f5ec122ba16b6dda1a5d3826057f67b9bcb" error="error committing manifest to content store: commit failed: unexpected commit digest sha256:eaee4c452b076cdb05b391ed7e75e1ad0aca136665875ab5d7e2f3d9f4675769, expected sha256:5d99aa1120524c801bc8c1a7077e8f5ec122ba16b6dda1a5d3826057f67b9bcb: failed precondition" remote="registry.k8s.io/echoserver:1.4" spanID=bc562c3ebf8ea584 traceID=12bda907be02af66096253dac142f012
Sep 23 12:39:53 old-k8s-version-694600 dockerd[1463]: time="2024-09-23T12:39:53.248806723Z" level=warning msg="[DEPRECATION NOTICE] Docker Image Format v1 and Docker Image manifest version 2, schema 1 support is disabled by default and will be removed in an upcoming release. Suggest the author of registry.k8s.io/echoserver:1.4 to upgrade the image to the OCI Format or Docker Image manifest v2, schema 2. More information at https://docs.docker.com/go/deprecated-image-specs/" digest="sha256:5d99aa1120524c801bc8c1a7077e8f5ec122ba16b6dda1a5d3826057f67b9bcb" remote="registry.k8s.io/echoserver:1.4" spanID=bc562c3ebf8ea584 traceID=12bda907be02af66096253dac142f012
Sep 23 12:39:53 old-k8s-version-694600 dockerd[1463]: time="2024-09-23T12:39:53.248880330Z" level=info msg="Attempting next endpoint for pull after error: [DEPRECATION NOTICE] Docker Image Format v1 and Docker Image manifest version 2, schema 1 support is disabled by default and will be removed in an upcoming release. Suggest the author of registry.k8s.io/echoserver:1.4 to upgrade the image to the OCI Format or Docker Image manifest v2, schema 2. More information at https://docs.docker.com/go/deprecated-image-specs/" spanID=bc562c3ebf8ea584 traceID=12bda907be02af66096253dac142f012
Sep 23 12:40:20 old-k8s-version-694600 dockerd[1463]: time="2024-09-23T12:40:20.721922709Z" level=warning msg="Error getting v2 registry: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.65.254:53: no such host" spanID=0511e714d25fde9c traceID=8cc1750be37c17cfd19d9306a6749264
Sep 23 12:40:20 old-k8s-version-694600 dockerd[1463]: time="2024-09-23T12:40:20.722091930Z" level=info msg="Attempting next endpoint for pull after error: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.65.254:53: no such host" spanID=0511e714d25fde9c traceID=8cc1750be37c17cfd19d9306a6749264
Sep 23 12:40:20 old-k8s-version-694600 dockerd[1463]: time="2024-09-23T12:40:20.731374200Z" level=error msg="Handler for POST /v1.40/images/create returned error: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.65.254:53: no such host" spanID=0511e714d25fde9c traceID=8cc1750be37c17cfd19d9306a6749264
Sep 23 12:40:21 old-k8s-version-694600 dockerd[1463]: time="2024-09-23T12:40:21.920562328Z" level=warning msg="reference for unknown type: application/vnd.docker.distribution.manifest.v1+prettyjws" digest="sha256:5d99aa1120524c801bc8c1a7077e8f5ec122ba16b6dda1a5d3826057f67b9bcb" remote="registry.k8s.io/echoserver:1.4" spanID=9f7d1066657fa13c traceID=18a61b7ffc3f4ad288dc273093ad6774
Sep 23 12:40:22 old-k8s-version-694600 dockerd[1463]: time="2024-09-23T12:40:22.117986602Z" level=warning msg="Error persisting manifest" digest="sha256:5d99aa1120524c801bc8c1a7077e8f5ec122ba16b6dda1a5d3826057f67b9bcb" error="error committing manifest to content store: commit failed: unexpected commit digest sha256:eaee4c452b076cdb05b391ed7e75e1ad0aca136665875ab5d7e2f3d9f4675769, expected sha256:5d99aa1120524c801bc8c1a7077e8f5ec122ba16b6dda1a5d3826057f67b9bcb: failed precondition" remote="registry.k8s.io/echoserver:1.4" spanID=9f7d1066657fa13c traceID=18a61b7ffc3f4ad288dc273093ad6774
Sep 23 12:40:22 old-k8s-version-694600 dockerd[1463]: time="2024-09-23T12:40:22.118278039Z" level=warning msg="[DEPRECATION NOTICE] Docker Image Format v1 and Docker Image manifest version 2, schema 1 support is disabled by default and will be removed in an upcoming release. Suggest the author of registry.k8s.io/echoserver:1.4 to upgrade the image to the OCI Format or Docker Image manifest v2, schema 2. More information at https://docs.docker.com/go/deprecated-image-specs/" digest="sha256:5d99aa1120524c801bc8c1a7077e8f5ec122ba16b6dda1a5d3826057f67b9bcb" remote="registry.k8s.io/echoserver:1.4" spanID=9f7d1066657fa13c traceID=18a61b7ffc3f4ad288dc273093ad6774
Sep 23 12:40:22 old-k8s-version-694600 dockerd[1463]: time="2024-09-23T12:40:22.118338946Z" level=info msg="Attempting next endpoint for pull after error: [DEPRECATION NOTICE] Docker Image Format v1 and Docker Image manifest version 2, schema 1 support is disabled by default and will be removed in an upcoming release. Suggest the author of registry.k8s.io/echoserver:1.4 to upgrade the image to the OCI Format or Docker Image manifest v2, schema 2. More information at https://docs.docker.com/go/deprecated-image-specs/" spanID=9f7d1066657fa13c traceID=18a61b7ffc3f4ad288dc273093ad6774
Sep 23 12:41:02 old-k8s-version-694600 dockerd[1463]: time="2024-09-23T12:41:02.938691674Z" level=warning msg="reference for unknown type: application/vnd.docker.distribution.manifest.v1+prettyjws" digest="sha256:5d99aa1120524c801bc8c1a7077e8f5ec122ba16b6dda1a5d3826057f67b9bcb" remote="registry.k8s.io/echoserver:1.4" spanID=37571850597be17c traceID=25654037f3c9a76c504a593287c44d1d
Sep 23 12:41:03 old-k8s-version-694600 dockerd[1463]: time="2024-09-23T12:41:03.157051582Z" level=warning msg="Error persisting manifest" digest="sha256:5d99aa1120524c801bc8c1a7077e8f5ec122ba16b6dda1a5d3826057f67b9bcb" error="error committing manifest to content store: commit failed: unexpected commit digest sha256:eaee4c452b076cdb05b391ed7e75e1ad0aca136665875ab5d7e2f3d9f4675769, expected sha256:5d99aa1120524c801bc8c1a7077e8f5ec122ba16b6dda1a5d3826057f67b9bcb: failed precondition" remote="registry.k8s.io/echoserver:1.4" spanID=37571850597be17c traceID=25654037f3c9a76c504a593287c44d1d
Sep 23 12:41:03 old-k8s-version-694600 dockerd[1463]: time="2024-09-23T12:41:03.157259303Z" level=warning msg="[DEPRECATION NOTICE] Docker Image Format v1 and Docker Image manifest version 2, schema 1 support is disabled by default and will be removed in an upcoming release. Suggest the author of registry.k8s.io/echoserver:1.4 to upgrade the image to the OCI Format or Docker Image manifest v2, schema 2. More information at https://docs.docker.com/go/deprecated-image-specs/" digest="sha256:5d99aa1120524c801bc8c1a7077e8f5ec122ba16b6dda1a5d3826057f67b9bcb" remote="registry.k8s.io/echoserver:1.4" spanID=37571850597be17c traceID=25654037f3c9a76c504a593287c44d1d
Sep 23 12:41:03 old-k8s-version-694600 dockerd[1463]: time="2024-09-23T12:41:03.157330211Z" level=info msg="Attempting next endpoint for pull after error: [DEPRECATION NOTICE] Docker Image Format v1 and Docker Image manifest version 2, schema 1 support is disabled by default and will be removed in an upcoming release. Suggest the author of registry.k8s.io/echoserver:1.4 to upgrade the image to the OCI Format or Docker Image manifest v2, schema 2. More information at https://docs.docker.com/go/deprecated-image-specs/" spanID=37571850597be17c traceID=25654037f3c9a76c504a593287c44d1d
Sep 23 12:41:43 old-k8s-version-694600 dockerd[1463]: time="2024-09-23T12:41:43.753529874Z" level=warning msg="Error getting v2 registry: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.65.254:53: no such host" spanID=19660d6f5b03a159 traceID=756b1e3e87026f4d85c5bf8100661067
Sep 23 12:41:43 old-k8s-version-694600 dockerd[1463]: time="2024-09-23T12:41:43.754006225Z" level=info msg="Attempting next endpoint for pull after error: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.65.254:53: no such host" spanID=19660d6f5b03a159 traceID=756b1e3e87026f4d85c5bf8100661067
Sep 23 12:41:43 old-k8s-version-694600 dockerd[1463]: time="2024-09-23T12:41:43.765698958Z" level=error msg="Handler for POST /v1.40/images/create returned error: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.65.254:53: no such host" spanID=19660d6f5b03a159 traceID=756b1e3e87026f4d85c5bf8100661067
Sep 23 12:42:30 old-k8s-version-694600 dockerd[1463]: time="2024-09-23T12:42:30.984759571Z" level=warning msg="reference for unknown type: application/vnd.docker.distribution.manifest.v1+prettyjws" digest="sha256:5d99aa1120524c801bc8c1a7077e8f5ec122ba16b6dda1a5d3826057f67b9bcb" remote="registry.k8s.io/echoserver:1.4" spanID=960a87225918c6d7 traceID=6ce7b0164d1c4b176fe2ef17e8d2ae86
Sep 23 12:42:31 old-k8s-version-694600 dockerd[1463]: time="2024-09-23T12:42:31.206225404Z" level=warning msg="Error persisting manifest" digest="sha256:5d99aa1120524c801bc8c1a7077e8f5ec122ba16b6dda1a5d3826057f67b9bcb" error="error committing manifest to content store: commit failed: unexpected commit digest sha256:eaee4c452b076cdb05b391ed7e75e1ad0aca136665875ab5d7e2f3d9f4675769, expected sha256:5d99aa1120524c801bc8c1a7077e8f5ec122ba16b6dda1a5d3826057f67b9bcb: failed precondition" remote="registry.k8s.io/echoserver:1.4" spanID=960a87225918c6d7 traceID=6ce7b0164d1c4b176fe2ef17e8d2ae86
Sep 23 12:42:31 old-k8s-version-694600 dockerd[1463]: time="2024-09-23T12:42:31.206563840Z" level=warning msg="[DEPRECATION NOTICE] Docker Image Format v1 and Docker Image manifest version 2, schema 1 support is disabled by default and will be removed in an upcoming release. Suggest the author of registry.k8s.io/echoserver:1.4 to upgrade the image to the OCI Format or Docker Image manifest v2, schema 2. More information at https://docs.docker.com/go/deprecated-image-specs/" digest="sha256:5d99aa1120524c801bc8c1a7077e8f5ec122ba16b6dda1a5d3826057f67b9bcb" remote="registry.k8s.io/echoserver:1.4" spanID=960a87225918c6d7 traceID=6ce7b0164d1c4b176fe2ef17e8d2ae86
Sep 23 12:42:31 old-k8s-version-694600 dockerd[1463]: time="2024-09-23T12:42:31.206610445Z" level=info msg="Attempting next endpoint for pull after error: [DEPRECATION NOTICE] Docker Image Format v1 and Docker Image manifest version 2, schema 1 support is disabled by default and will be removed in an upcoming release. Suggest the author of registry.k8s.io/echoserver:1.4 to upgrade the image to the OCI Format or Docker Image manifest v2, schema 2. More information at https://docs.docker.com/go/deprecated-image-specs/" spanID=960a87225918c6d7 traceID=6ce7b0164d1c4b176fe2ef17e8d2ae86
Sep 23 12:44:27 old-k8s-version-694600 dockerd[1463]: time="2024-09-23T12:44:27.784911457Z" level=warning msg="Error getting v2 registry: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.65.254:53: no such host" spanID=44f694be499ca448 traceID=2b4b3935b7906c7e4fe7cbd2308f2815
Sep 23 12:44:27 old-k8s-version-694600 dockerd[1463]: time="2024-09-23T12:44:27.785164886Z" level=info msg="Attempting next endpoint for pull after error: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.65.254:53: no such host" spanID=44f694be499ca448 traceID=2b4b3935b7906c7e4fe7cbd2308f2815
Sep 23 12:44:28 old-k8s-version-694600 dockerd[1463]: time="2024-09-23T12:44:28.019769303Z" level=error msg="Handler for POST /v1.40/images/create returned error: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.65.254:53: no such host" spanID=44f694be499ca448 traceID=2b4b3935b7906c7e4fe7cbd2308f2815
==> container status <==
CONTAINER IMAGE CREATED STATE NAME ATTEMPT POD ID POD
5eb85a2791fd2 kubernetesui/dashboard@sha256:2e500d29e9d5f4a086b908eb8dfe7ecac57d2ab09d65b24f588b1d449841ef93 5 minutes ago Running kubernetes-dashboard 0 2231baebe0719 kubernetes-dashboard-cd95d586-bk8ls
4b8130a0a6312 6e38f40d628db 5 minutes ago Running storage-provisioner 2 5764a6a5e43b2 storage-provisioner
ac17c0c4ecffd bfe3a36ebd252 5 minutes ago Running coredns 1 3b9e6eff3f245 coredns-74ff55c5b-xs5mb
f00486aecb7f9 56cc512116c8f 5 minutes ago Running busybox 1 35bbd70f3d721 busybox
ae76dbbad5dfb 10cc881966cfd 5 minutes ago Running kube-proxy 1 1942f04a6c93b kube-proxy-nf8m5
9420ceb6a8a95 6e38f40d628db 5 minutes ago Exited storage-provisioner 1 5764a6a5e43b2 storage-provisioner
cbaa7f55c1cfa b9fa1895dcaa6 6 minutes ago Running kube-controller-manager 1 ba583445183ed kube-controller-manager-old-k8s-version-694600
6f9ee2379541c 3138b6e3d4712 6 minutes ago Running kube-scheduler 1 7d0f4c0e596e1 kube-scheduler-old-k8s-version-694600
bf2bddf93da4e ca9843d3b5454 6 minutes ago Running kube-apiserver 1 fc9afd6fdf377 kube-apiserver-old-k8s-version-694600
db948e782f564 0369cf4303ffd 6 minutes ago Running etcd 1 2fcc4d1621a29 etcd-old-k8s-version-694600
de69ff0211204 gcr.io/k8s-minikube/busybox@sha256:2d03e6ceeb99250061dd110530b0ece7998cd84121f952adef120ea7c5a6f00e 7 minutes ago Exited busybox 0 6f4e6b8c18962 busybox
db8367477ac16 bfe3a36ebd252 9 minutes ago Exited coredns 0 05f0b9906b1e6 coredns-74ff55c5b-xs5mb
606305ef153c6 10cc881966cfd 9 minutes ago Exited kube-proxy 0 1bafd44ddcbc5 kube-proxy-nf8m5
1382815ffdc3c b9fa1895dcaa6 9 minutes ago Exited kube-controller-manager 0 4aabd63d6307e kube-controller-manager-old-k8s-version-694600
99e36abc5feb2 ca9843d3b5454 9 minutes ago Exited kube-apiserver 0 687e3798a5269 kube-apiserver-old-k8s-version-694600
585ea5a5976b2 3138b6e3d4712 9 minutes ago Exited kube-scheduler 0 9764f5228cb61 kube-scheduler-old-k8s-version-694600
a7d64ac5d6857 0369cf4303ffd 9 minutes ago Exited etcd 0 7c33b44d00927 etcd-old-k8s-version-694600
==> coredns [ac17c0c4ecff] <==
I0923 12:39:17.546271 1 trace.go:116] Trace[2019727887]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125 (started: 2024-09-23 12:38:56.503685023 +0000 UTC m=+0.206425646) (total time: 21.046126661s):
Trace[2019727887]: [21.046126661s] [21.046126661s] END
E0923 12:39:17.546415 1 reflector.go:178] pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125: Failed to list *v1.Endpoints: Get "https://10.96.0.1:443/api/v1/endpoints?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: connect: connection refused
I0923 12:39:17.546350 1 trace.go:116] Trace[1427131847]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125 (started: 2024-09-23 12:38:56.502243282 +0000 UTC m=+0.204983905) (total time: 21.047731719s):
Trace[1427131847]: [21.047731719s] [21.047731719s] END
E0923 12:39:17.546448 1 reflector.go:178] pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125: Failed to list *v1.Namespace: Get "https://10.96.0.1:443/api/v1/namespaces?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: connect: connection refused
I0923 12:39:17.546832 1 trace.go:116] Trace[911902081]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125 (started: 2024-09-23 12:38:56.503192975 +0000 UTC m=+0.205933498) (total time: 21.047007149s):
Trace[911902081]: [21.047007149s] [21.047007149s] END
E0923 12:39:17.547446 1 reflector.go:178] pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125: Failed to list *v1.Service: Get "https://10.96.0.1:443/api/v1/services?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: connect: connection refused
[INFO] plugin/ready: Still waiting on: "kubernetes"
.:53
[INFO] plugin/reload: Running configuration MD5 = 512bc0e06a520fa44f35dc15de10fdd6
CoreDNS-1.7.0
linux/amd64, go1.14.4, f59c03d
[INFO] 127.0.0.1:55870 - 60746 "HINFO IN 2807392057809506795.3253440671122845835. udp 57 false 512" NXDOMAIN qr,rd,ra 57 0.069371227s
[INFO] plugin/ready: Still waiting on: "kubernetes"
[INFO] plugin/ready: Still waiting on: "kubernetes"
==> coredns [db8367477ac1] <==
I0923 12:35:46.530145 1 trace.go:116] Trace[2019727887]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125 (started: 2024-09-23 12:35:25.505087803 +0000 UTC m=+0.163205329) (total time: 21.027387842s):
Trace[2019727887]: [21.027387842s] [21.027387842s] END
E0923 12:35:46.530193 1 reflector.go:178] pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125: Failed to list *v1.Service: Get "https://10.96.0.1:443/api/v1/services?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: connect: connection refused
I0923 12:35:46.530489 1 trace.go:116] Trace[939984059]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125 (started: 2024-09-23 12:35:25.505202515 +0000 UTC m=+0.163320041) (total time: 21.02788489s):
Trace[939984059]: [21.02788489s] [21.02788489s] END
E0923 12:35:46.530507 1 reflector.go:178] pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125: Failed to list *v1.Endpoints: Get "https://10.96.0.1:443/api/v1/endpoints?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: connect: connection refused
I0923 12:35:46.534782 1 trace.go:116] Trace[1474941318]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125 (started: 2024-09-23 12:35:25.505087903 +0000 UTC m=+0.163205529) (total time: 21.03227772s):
Trace[1474941318]: [21.03227772s] [21.03227772s] END
E0923 12:35:46.534890 1 reflector.go:178] pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125: Failed to list *v1.Namespace: Get "https://10.96.0.1:443/api/v1/namespaces?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: connect: connection refused
E0923 12:37:37.391017 1 reflector.go:382] pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125: Failed to watch *v1.Namespace: Get "https://10.96.0.1:443/api/v1/namespaces?allowWatchBookmarks=true&resourceVersion=201&timeout=6m5s&timeoutSeconds=365&watch=true": dial tcp 10.96.0.1:443: connect: connection refused
E0923 12:37:37.486487 1 reflector.go:382] pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125: Failed to watch *v1.Endpoints: Get "https://10.96.0.1:443/api/v1/endpoints?allowWatchBookmarks=true&resourceVersion=615&timeout=6m27s&timeoutSeconds=387&watch=true": dial tcp 10.96.0.1:443: connect: connection refused
E0923 12:37:37.390610 1 reflector.go:382] pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125: Failed to watch *v1.Service: Get "https://10.96.0.1:443/api/v1/services?allowWatchBookmarks=true&resourceVersion=599&timeout=8m23s&timeoutSeconds=503&watch=true": dial tcp 10.96.0.1:443: connect: connection refused
.:53
[INFO] plugin/reload: Running configuration MD5 = db32ca3650231d74073ff4cf814959a7
CoreDNS-1.7.0
linux/amd64, go1.14.4, f59c03d
[INFO] plugin/ready: Still waiting on: "kubernetes"
[INFO] plugin/ready: Still waiting on: "kubernetes"
[INFO] Reloading
[INFO] plugin/health: Going into lameduck mode for 5s
[INFO] plugin/reload: Running configuration MD5 = 512bc0e06a520fa44f35dc15de10fdd6
[INFO] Reloading complete
[INFO] 127.0.0.1:57367 - 41141 "HINFO IN 3182396505344991187.8908902117498816762. udp 57 false 512" NXDOMAIN qr,rd,ra 57 0.06826722s
[INFO] SIGTERM: Shutting down servers then terminating
[INFO] plugin/health: Going into lameduck mode for 5s
==> describe nodes <==
Name: old-k8s-version-694600
Roles: control-plane,master
Labels: beta.kubernetes.io/arch=amd64
beta.kubernetes.io/os=linux
kubernetes.io/arch=amd64
kubernetes.io/hostname=old-k8s-version-694600
kubernetes.io/os=linux
minikube.k8s.io/commit=30f673d6edb6d12f8aba2f7e30667ea1b6d205d1
minikube.k8s.io/name=old-k8s-version-694600
minikube.k8s.io/primary=true
minikube.k8s.io/updated_at=2024_09_23T12_35_04_0700
minikube.k8s.io/version=v1.34.0
node-role.kubernetes.io/control-plane=
node-role.kubernetes.io/master=
Annotations: kubeadm.alpha.kubernetes.io/cri-socket: /var/run/dockershim.sock
node.alpha.kubernetes.io/ttl: 0
volumes.kubernetes.io/controller-managed-attach-detach: true
CreationTimestamp: Mon, 23 Sep 2024 12:35:00 +0000
Taints: <none>
Unschedulable: false
Lease:
HolderIdentity: old-k8s-version-694600
AcquireTime: <unset>
RenewTime: Mon, 23 Sep 2024 12:44:41 +0000
Conditions:
Type Status LastHeartbeatTime LastTransitionTime Reason Message
---- ------ ----------------- ------------------ ------ -------
MemoryPressure False Mon, 23 Sep 2024 12:40:10 +0000 Mon, 23 Sep 2024 12:34:54 +0000 KubeletHasSufficientMemory kubelet has sufficient memory available
DiskPressure False Mon, 23 Sep 2024 12:40:10 +0000 Mon, 23 Sep 2024 12:34:54 +0000 KubeletHasNoDiskPressure kubelet has no disk pressure
PIDPressure False Mon, 23 Sep 2024 12:40:10 +0000 Mon, 23 Sep 2024 12:34:54 +0000 KubeletHasSufficientPID kubelet has sufficient PID available
Ready True Mon, 23 Sep 2024 12:40:10 +0000 Mon, 23 Sep 2024 12:35:16 +0000 KubeletReady kubelet is posting ready status
Addresses:
InternalIP: 192.168.103.2
Hostname: old-k8s-version-694600
Capacity:
cpu: 16
ephemeral-storage: 1055762868Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
memory: 32868688Ki
pods: 110
Allocatable:
cpu: 16
ephemeral-storage: 1055762868Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
memory: 32868688Ki
pods: 110
System Info:
Machine ID: 0959204301484a7d80d5c5d7316e5e8f
System UUID: 0959204301484a7d80d5c5d7316e5e8f
Boot ID: 39082465-ae0b-4792-bc81-a99f7997c7d1
Kernel Version: 5.15.153.1-microsoft-standard-WSL2
OS Image: Ubuntu 22.04.5 LTS
Operating System: linux
Architecture: amd64
Container Runtime Version: docker://27.3.0
Kubelet Version: v1.20.0
Kube-Proxy Version: v1.20.0
PodCIDR: 10.244.0.0/24
PodCIDRs: 10.244.0.0/24
Non-terminated Pods: (11 in total)
Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits AGE
--------- ---- ------------ ---------- --------------- ------------- ---
default busybox 0 (0%) 0 (0%) 0 (0%) 0 (0%) 7m26s
kube-system coredns-74ff55c5b-xs5mb 100m (0%) 0 (0%) 70Mi (0%) 170Mi (0%) 9m24s
kube-system etcd-old-k8s-version-694600 100m (0%) 0 (0%) 100Mi (0%) 0 (0%) 9m37s
kube-system kube-apiserver-old-k8s-version-694600 250m (1%) 0 (0%) 0 (0%) 0 (0%) 9m37s
kube-system kube-controller-manager-old-k8s-version-694600 200m (1%) 0 (0%) 0 (0%) 0 (0%) 9m37s
kube-system kube-proxy-nf8m5 0 (0%) 0 (0%) 0 (0%) 0 (0%) 9m23s
kube-system kube-scheduler-old-k8s-version-694600 100m (0%) 0 (0%) 0 (0%) 0 (0%) 9m37s
kube-system metrics-server-9975d5f86-vmdbz 100m (0%) 0 (0%) 200Mi (0%) 0 (0%) 7m7s
kube-system storage-provisioner 0 (0%) 0 (0%) 0 (0%) 0 (0%) 9m19s
kubernetes-dashboard dashboard-metrics-scraper-8d5bb5db8-2qtq6 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m30s
kubernetes-dashboard kubernetes-dashboard-cd95d586-bk8ls 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m30s
Allocated resources:
(Total limits may be over 100 percent, i.e., overcommitted.)
Resource Requests Limits
-------- -------- ------
cpu 850m (5%) 0 (0%)
memory 370Mi (1%) 170Mi (0%)
ephemeral-storage 100Mi (0%) 0 (0%)
hugepages-1Gi 0 (0%) 0 (0%)
hugepages-2Mi 0 (0%) 0 (0%)
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal NodeHasSufficientMemory 9m55s (x6 over 9m56s) kubelet Node old-k8s-version-694600 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 9m55s (x6 over 9m56s) kubelet Node old-k8s-version-694600 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 9m55s (x5 over 9m56s) kubelet Node old-k8s-version-694600 status is now: NodeHasSufficientPID
Normal Starting 9m38s kubelet Starting kubelet.
Normal NodeHasSufficientMemory 9m37s kubelet Node old-k8s-version-694600 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 9m37s kubelet Node old-k8s-version-694600 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 9m37s kubelet Node old-k8s-version-694600 status is now: NodeHasSufficientPID
Normal NodeNotReady 9m37s kubelet Node old-k8s-version-694600 status is now: NodeNotReady
Normal NodeAllocatableEnforced 9m37s kubelet Updated Node Allocatable limit across pods
Normal NodeReady 9m27s kubelet Node old-k8s-version-694600 status is now: NodeReady
Normal Starting 9m18s kube-proxy Starting kube-proxy.
Normal Starting 6m9s kubelet Starting kubelet.
Normal NodeAllocatableEnforced 6m9s kubelet Updated Node Allocatable limit across pods
Normal NodeHasSufficientMemory 6m8s (x8 over 6m9s) kubelet Node old-k8s-version-694600 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 6m8s (x7 over 6m9s) kubelet Node old-k8s-version-694600 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 6m8s (x8 over 6m9s) kubelet Node old-k8s-version-694600 status is now: NodeHasSufficientPID
Normal Starting 5m47s kube-proxy Starting kube-proxy.
==> dmesg <==
[ +8.880856] tmpfs: Unknown parameter 'noswap'
[ +15.816418] tmpfs: Unknown parameter 'noswap'
[ +9.927202] tmpfs: Unknown parameter 'noswap'
[Sep23 12:34] tmpfs: Unknown parameter 'noswap'
[ +40.486929] tmpfs: Unknown parameter 'noswap'
[ +10.134368] tmpfs: Unknown parameter 'noswap'
[Sep23 12:35] tmpfs: Unknown parameter 'noswap'
[ +9.222755] tmpfs: Unknown parameter 'noswap'
[ +8.102585] tmpfs: Unknown parameter 'noswap'
[ +11.051964] tmpfs: Unknown parameter 'noswap'
[Sep23 12:36] tmpfs: Unknown parameter 'noswap'
[ +6.170726] tmpfs: Unknown parameter 'noswap'
[ +8.104595] tmpfs: Unknown parameter 'noswap'
[ +17.643986] tmpfs: Unknown parameter 'noswap'
[ +3.828445] hrtimer: interrupt took 1048310 ns
[Sep23 12:37] tmpfs: Unknown parameter 'noswap'
[Sep23 12:38] tmpfs: Unknown parameter 'noswap'
[Sep23 12:39] tmpfs: Unknown parameter 'noswap'
[Sep23 12:41] tmpfs: Unknown parameter 'noswap'
[ +24.182596] tmpfs: Unknown parameter 'noswap'
[Sep23 12:42] tmpfs: Unknown parameter 'noswap'
[ +11.312667] tmpfs: Unknown parameter 'noswap'
[ +13.937764] tmpfs: Unknown parameter 'noswap'
[Sep23 12:43] tmpfs: Unknown parameter 'noswap'
[Sep23 12:44] tmpfs: Unknown parameter 'noswap'
==> etcd [a7d64ac5d685] <==
2024-09-23 12:36:58.487486 W | etcdserver: read-only range request "key:\"/registry/certificatesigningrequests/\" range_end:\"/registry/certificatesigningrequests0\" count_only:true " with result "range_response_count:0 size:7" took too long (373.57181ms) to execute
2024-09-23 12:36:58.487879 W | etcdserver: read-only range request "key:\"/registry/ingressclasses/\" range_end:\"/registry/ingressclasses0\" count_only:true " with result "range_response_count:0 size:5" took too long (260.861311ms) to execute
2024-09-23 12:36:58.781329 W | etcdserver: read-only range request "key:\"/registry/health\" " with result "range_response_count:0 size:5" took too long (133.643592ms) to execute
2024-09-23 12:37:00.882977 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-09-23 12:37:10.866923 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-09-23 12:37:16.391073 W | etcdserver: read-only range request "key:\"/registry/events/\" range_end:\"/registry/events0\" count_only:true " with result "range_response_count:0 size:7" took too long (183.501048ms) to execute
2024-09-23 12:37:18.255244 W | etcdserver: request "header:<ID:13873780788406946430 username:\"kube-apiserver-etcd-client\" auth_revision:1 > txn:<compare:<target:MOD key:\"/registry/pods/default/busybox\" mod_revision:558 > success:<request_put:<key:\"/registry/pods/default/busybox\" value_size:1171 >> failure:<request_range:<key:\"/registry/pods/default/busybox\" > >>" with result "size:16" took too long (179.155412ms) to execute
2024-09-23 12:37:18.256254 W | etcdserver: read-only range request "key:\"/registry/pods/default/\" range_end:\"/registry/pods/default0\" " with result "range_response_count:1 size:1224" took too long (430.927025ms) to execute
2024-09-23 12:37:18.575635 W | etcdserver: read-only range request "key:\"/registry/pods/default/busybox\" " with result "range_response_count:1 size:1224" took too long (306.562021ms) to execute
2024-09-23 12:37:18.575759 W | etcdserver: request "header:<ID:13873780788406946436 username:\"kube-apiserver-etcd-client\" auth_revision:1 > lease_grant:<ttl:3660-second id:4089921ee0a28a83>" with result "size:41" took too long (127.568625ms) to execute
2024-09-23 12:37:20.866839 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-09-23 12:37:20.890744 W | etcdserver: read-only range request "key:\"/registry/health\" " with result "range_response_count:0 size:5" took too long (1.466957185s) to execute
2024-09-23 12:37:20.891021 W | etcdserver: read-only range request "key:\"/registry/health\" " with result "range_response_count:0 size:5" took too long (1.260751153s) to execute
2024-09-23 12:37:20.891130 W | etcdserver: read-only range request "key:\"/registry/services/endpoints/kube-system/k8s.io-minikube-hostpath\" " with result "range_response_count:1 size:1120" took too long (610.652793ms) to execute
2024-09-23 12:37:20.891289 W | etcdserver: read-only range request "key:\"/registry/pods/default/\" range_end:\"/registry/pods/default0\" " with result "range_response_count:1 size:2100" took too long (2.080161836s) to execute
2024-09-23 12:37:21.019263 W | etcdserver: read-only range request "key:\"/registry/health\" " with result "range_response_count:0 size:5" took too long (101.120967ms) to execute
2024-09-23 12:37:24.993541 W | etcdserver: read-only range request "key:\"/registry/pods/default/\" range_end:\"/registry/pods/default0\" " with result "range_response_count:1 size:2100" took too long (183.080326ms) to execute
2024-09-23 12:37:26.746030 W | etcdserver: read-only range request "key:\"/registry/health\" " with result "range_response_count:0 size:5" took too long (112.258444ms) to execute
2024-09-23 12:37:26.746213 W | etcdserver: read-only range request "key:\"/registry/replicasets/\" range_end:\"/registry/replicasets0\" count_only:true " with result "range_response_count:0 size:7" took too long (143.591365ms) to execute
2024-09-23 12:37:30.870269 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-09-23 12:37:37.584104 W | etcdserver: request "header:<ID:13873780788406946598 username:\"kube-apiserver-etcd-client\" auth_revision:1 > txn:<compare:<target:MOD key:\"/registry/masterleases/192.168.103.2\" mod_revision:576 > success:<request_delete_range:<key:\"/registry/masterleases/192.168.103.2\" > > failure:<request_range:<key:\"/registry/masterleases/192.168.103.2\" > >>" with result "size:18" took too long (100.286584ms) to execute
2024-09-23 12:37:37.587002 N | pkg/osutil: received terminated signal, shutting down...
WARNING: 2024/09/23 12:37:37 grpc: addrConn.createTransport failed to connect to {192.168.103.2:2379 <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 192.168.103.2:2379: connect: connection refused". Reconnecting...
WARNING: 2024/09/23 12:37:37 grpc: addrConn.createTransport failed to connect to {127.0.0.1:2379 <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
2024-09-23 12:37:37.598556 I | etcdserver: skipped leadership transfer for single voting member cluster
==> etcd [db948e782f56] <==
2024-09-23 12:42:26.898801 W | etcdserver: read-only range request "key:\"/registry/services/endpoints/default/kubernetes\" " with result "range_response_count:1 size:421" took too long (362.989716ms) to execute
2024-09-23 12:42:26.899299 W | etcdserver: read-only range request "key:\"/registry/csinodes/\" range_end:\"/registry/csinodes0\" count_only:true " with result "range_response_count:0 size:7" took too long (260.876795ms) to execute
2024-09-23 12:42:27.755182 W | etcdserver: read-only range request "key:\"/registry/pods/kube-system/metrics-server-9975d5f86-vmdbz\" " with result "range_response_count:1 size:4053" took too long (302.92782ms) to execute
2024-09-23 12:42:29.743944 W | etcdserver: read-only range request "key:\"/registry/pods/kube-system/metrics-server-9975d5f86-vmdbz\" " with result "range_response_count:1 size:4053" took too long (291.150663ms) to execute
2024-09-23 12:42:34.741498 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-09-23 12:42:44.738517 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-09-23 12:42:54.738641 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-09-23 12:43:04.738358 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-09-23 12:43:14.735509 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-09-23 12:43:24.735720 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-09-23 12:43:28.289937 W | etcdserver: read-only range request "key:\"/registry/health\" " with result "range_response_count:0 size:5" took too long (173.385974ms) to execute
2024-09-23 12:43:30.293137 W | etcdserver: read-only range request "key:\"/registry/health\" " with result "range_response_count:0 size:5" took too long (177.952971ms) to execute
2024-09-23 12:43:31.257353 W | etcdserver: read-only range request "key:\"/registry/health\" " with result "range_response_count:0 size:5" took too long (141.01765ms) to execute
2024-09-23 12:43:32.227591 W | etcdserver: read-only range request "key:\"/registry/health\" " with result "range_response_count:0 size:5" took too long (107.212171ms) to execute
2024-09-23 12:43:34.736330 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-09-23 12:43:44.732619 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-09-23 12:43:54.733711 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-09-23 12:44:04.733322 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-09-23 12:44:14.729878 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-09-23 12:44:24.730063 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-09-23 12:44:31.287729 W | etcdserver: read-only range request "key:\"/registry/health\" " with result "range_response_count:0 size:5" took too long (181.134904ms) to execute
2024-09-23 12:44:34.730511 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-09-23 12:44:37.018414 W | etcdserver: read-only range request "key:\"/registry/runtimeclasses/\" range_end:\"/registry/runtimeclasses0\" count_only:true " with result "range_response_count:0 size:5" took too long (136.239764ms) to execute
2024-09-23 12:44:39.074303 W | etcdserver: read-only range request "key:\"/registry/certificatesigningrequests/\" range_end:\"/registry/certificatesigningrequests0\" count_only:true " with result "range_response_count:0 size:7" took too long (136.978037ms) to execute
2024-09-23 12:44:41.586250 W | etcdserver: read-only range request "key:\"/registry/health\" " with result "range_response_count:0 size:5" took too long (246.69888ms) to execute
==> kernel <==
12:44:43 up 1:45, 0 users, load average: 9.06, 7.75, 6.66
Linux old-k8s-version-694600 5.15.153.1-microsoft-standard-WSL2 #1 SMP Fri Mar 29 23:14:13 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
PRETTY_NAME="Ubuntu 22.04.5 LTS"
==> kube-apiserver [99e36abc5feb] <==
W0923 12:37:37.597328 1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
I0923 12:37:37.597336 1 clientconn.go:897] blockingPicker: the picked transport is not ready, loop back to repick
I0923 12:37:37.597373 1 clientconn.go:897] blockingPicker: the picked transport is not ready, loop back to repick
W0923 12:37:37.597287 1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
I0923 12:37:37.597393 1 clientconn.go:897] blockingPicker: the picked transport is not ready, loop back to repick
I0923 12:37:37.597481 1 clientconn.go:897] blockingPicker: the picked transport is not ready, loop back to repick
W0923 12:37:37.595662 1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0923 12:37:37.597560 1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0923 12:37:37.597143 1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0923 12:37:37.597600 1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0923 12:37:37.597680 1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0923 12:37:37.597719 1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0923 12:37:37.597771 1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0923 12:37:37.597778 1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0923 12:37:37.597203 1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0923 12:37:37.597379 1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0923 12:37:37.597846 1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0923 12:37:37.598059 1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0923 12:37:37.598087 1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0923 12:37:37.598090 1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0923 12:37:37.598131 1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0923 12:37:37.598132 1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0923 12:37:37.598358 1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
I0923 12:37:37.682891 1 clientconn.go:897] blockingPicker: the picked transport is not ready, loop back to repick
W0923 12:37:37.683227 1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
==> kube-apiserver [bf2bddf93da4] <==
I0923 12:42:00.952359 1 trace.go:205] Trace[1637081081]: "Get" url:/api/v1/namespaces/kube-system/pods/metrics-server-9975d5f86-vmdbz,user-agent:minikube-windows-amd64.exe/v0.0.0 (windows/amd64) kubernetes/$Format,client:192.168.103.1 (23-Sep-2024 12:41:59.026) (total time: 1926ms):
Trace[1637081081]: ---"About to write a response" 1925ms (12:42:00.951)
Trace[1637081081]: [1.926127301s] [1.926127301s] END
I0923 12:42:00.952089 1 trace.go:205] Trace[1857767128]: "Patch" url:/api/v1/namespaces/kube-system/pods/metrics-server-9975d5f86-vmdbz/status,user-agent:kubelet/v1.20.0 (linux/amd64) kubernetes/af46c47,client:192.168.103.2 (23-Sep-2024 12:41:59.021) (total time: 1930ms):
Trace[1857767128]: ---"Object stored in database" 1926ms (12:42:00.951)
Trace[1857767128]: [1.930792493s] [1.930792493s] END
I0923 12:42:07.015302 1 client.go:360] parsed scheme: "passthrough"
I0923 12:42:07.015810 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0923 12:42:07.015832 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0923 12:42:44.363954 1 client.go:360] parsed scheme: "passthrough"
I0923 12:42:44.364087 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0923 12:42:44.364099 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0923 12:43:27.106987 1 client.go:360] parsed scheme: "passthrough"
I0923 12:43:27.107047 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0923 12:43:27.107181 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
W0923 12:43:49.163439 1 handler_proxy.go:102] no RequestInfo found in the context
E0923 12:43:49.163659 1 controller.go:116] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
I0923 12:43:49.163680 1 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
I0923 12:44:01.866384 1 client.go:360] parsed scheme: "passthrough"
I0923 12:44:01.866742 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0923 12:44:01.866765 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0923 12:44:32.734531 1 client.go:360] parsed scheme: "passthrough"
I0923 12:44:32.734664 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0923 12:44:32.734676 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
==> kube-controller-manager [1382815ffdc3] <==
I0923 12:35:19.930676 1 shared_informer.go:247] Caches are synced for ReplicationController
I0923 12:35:19.932257 1 shared_informer.go:247] Caches are synced for expand
I0923 12:35:19.996577 1 shared_informer.go:247] Caches are synced for attach detach
I0923 12:35:19.997383 1 shared_informer.go:247] Caches are synced for disruption
I0923 12:35:19.997402 1 disruption.go:339] Sending events to api server.
I0923 12:35:20.023443 1 event.go:291] "Event occurred" object="kube-system/coredns-74ff55c5b" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: coredns-74ff55c5b-xs5mb"
I0923 12:35:20.025170 1 range_allocator.go:373] Set node old-k8s-version-694600 PodCIDR to [10.244.0.0/24]
E0923 12:35:20.025866 1 clusterroleaggregation_controller.go:181] edit failed with : Operation cannot be fulfilled on clusterroles.rbac.authorization.k8s.io "edit": the object has been modified; please apply your changes to the latest version and try again
I0923 12:35:20.096592 1 shared_informer.go:247] Caches are synced for daemon sets
I0923 12:35:20.096945 1 shared_informer.go:247] Caches are synced for stateful set
I0923 12:35:20.196735 1 shared_informer.go:247] Caches are synced for resource quota
I0923 12:35:20.196869 1 shared_informer.go:247] Caches are synced for resource quota
I0923 12:35:20.221687 1 event.go:291] "Event occurred" object="kube-system/coredns-74ff55c5b" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: coredns-74ff55c5b-hq2qr"
I0923 12:35:20.332984 1 shared_informer.go:240] Waiting for caches to sync for garbage collector
I0923 12:35:20.420702 1 event.go:291] "Event occurred" object="kube-system/kube-proxy" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: kube-proxy-nf8m5"
I0923 12:35:20.696758 1 shared_informer.go:247] Caches are synced for garbage collector
I0923 12:35:20.696795 1 garbagecollector.go:151] Garbage collector: all resource monitors have synced. Proceeding to collect garbage
I0923 12:35:20.696803 1 shared_informer.go:247] Caches are synced for garbage collector
E0923 12:35:20.819398 1 daemon_controller.go:320] kube-system/kube-proxy failed with : error storing status for daemon set &v1.DaemonSet{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"kube-proxy", GenerateName:"", Namespace:"kube-system", SelfLink:"", UID:"2b6c202d-36a5-4109-9fad-cb7be142714d", ResourceVersion:"261", Generation:1, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:63862691704, loc:(*time.Location)(0x6f2f340)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"k8s-app":"kube-proxy"}, Annotations:map[string]string{"deprecated.daemonset.template.generation":"1"}, OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry{v1.ManagedFieldsEntry{Manager:"kubeadm", Operation:"Update", APIVersion:"apps/v1", Time:(*v1.Time)(0xc0017de000), FieldsType:"FieldsV1", FieldsV1:(*v1.FieldsV1)(0xc0017de020)}}}, Spec:v1.DaemonSetSpec{Selector:(*v1.
LabelSelector)(0xc0017de040), Template:v1.PodTemplateSpec{ObjectMeta:v1.ObjectMeta{Name:"", GenerateName:"", Namespace:"", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"k8s-app":"kube-proxy"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v1.PodSpec{Volumes:[]v1.Volume{v1.Volume{Name:"kube-proxy", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(nil), EmptyDir:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.Gl
usterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil), AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(0xc001788380), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeSource)(nil), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil), Ephemeral:(*v1.EphemeralVolumeSource)(nil)}}, v1.Volume{Name:"xtables-lock", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(0xc0017de
060), EmptyDir:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.GlusterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil), AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(nil), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeS
ource)(nil), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil), Ephemeral:(*v1.EphemeralVolumeSource)(nil)}}, v1.Volume{Name:"lib-modules", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(0xc0017de080), EmptyDir:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.GlusterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil),
AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(nil), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeSource)(nil), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil), Ephemeral:(*v1.EphemeralVolumeSource)(nil)}}}, InitContainers:[]v1.Container(nil), Containers:[]v1.Container{v1.Container{Name:"kube-proxy", Image:"k8s.gcr.io/kube-proxy:v1.20.0", Command:[]string{"/usr/local/bin/kube-proxy", "--config=/var/lib/kube-proxy/config.conf", "--hostname-override=$(NODE_NAME)"}, Args:[]string(nil), WorkingDir:"", Ports:[]v1.ContainerPort(nil), EnvFrom:[]v1.EnvFromSource(nil), Env:[]v1.EnvVar{v1.EnvVar{Name:"NODE_NAME", Value:"", ValueFrom:(*v1.EnvVarSource)(0xc001532f40)}}, Resources:v1.R
esourceRequirements{Limits:v1.ResourceList(nil), Requests:v1.ResourceList(nil)}, VolumeMounts:[]v1.VolumeMount{v1.VolumeMount{Name:"kube-proxy", ReadOnly:false, MountPath:"/var/lib/kube-proxy", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}, v1.VolumeMount{Name:"xtables-lock", ReadOnly:false, MountPath:"/run/xtables.lock", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}, v1.VolumeMount{Name:"lib-modules", ReadOnly:true, MountPath:"/lib/modules", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}}, VolumeDevices:[]v1.VolumeDevice(nil), LivenessProbe:(*v1.Probe)(nil), ReadinessProbe:(*v1.Probe)(nil), StartupProbe:(*v1.Probe)(nil), Lifecycle:(*v1.Lifecycle)(nil), TerminationMessagePath:"/dev/termination-log", TerminationMessagePolicy:"File", ImagePullPolicy:"IfNotPresent", SecurityContext:(*v1.SecurityContext)(0xc001105680), Stdin:false, StdinOnce:false, TTY:false}}, EphemeralContainers:[]v1.EphemeralContainer(nil), RestartPo
licy:"Always", TerminationGracePeriodSeconds:(*int64)(0xc000dff358), ActiveDeadlineSeconds:(*int64)(nil), DNSPolicy:"ClusterFirst", NodeSelector:map[string]string{"kubernetes.io/os":"linux"}, ServiceAccountName:"kube-proxy", DeprecatedServiceAccount:"kube-proxy", AutomountServiceAccountToken:(*bool)(nil), NodeName:"", HostNetwork:true, HostPID:false, HostIPC:false, ShareProcessNamespace:(*bool)(nil), SecurityContext:(*v1.PodSecurityContext)(0xc0001dd9d0), ImagePullSecrets:[]v1.LocalObjectReference(nil), Hostname:"", Subdomain:"", Affinity:(*v1.Affinity)(nil), SchedulerName:"default-scheduler", Tolerations:[]v1.Toleration{v1.Toleration{Key:"CriticalAddonsOnly", Operator:"Exists", Value:"", Effect:"", TolerationSeconds:(*int64)(nil)}, v1.Toleration{Key:"", Operator:"Exists", Value:"", Effect:"", TolerationSeconds:(*int64)(nil)}}, HostAliases:[]v1.HostAlias(nil), PriorityClassName:"system-node-critical", Priority:(*int32)(nil), DNSConfig:(*v1.PodDNSConfig)(nil), ReadinessGates:[]v1.PodReadinessGate(nil), Runtime
ClassName:(*string)(nil), EnableServiceLinks:(*bool)(nil), PreemptionPolicy:(*v1.PreemptionPolicy)(nil), Overhead:v1.ResourceList(nil), TopologySpreadConstraints:[]v1.TopologySpreadConstraint(nil), SetHostnameAsFQDN:(*bool)(nil)}}, UpdateStrategy:v1.DaemonSetUpdateStrategy{Type:"RollingUpdate", RollingUpdate:(*v1.RollingUpdateDaemonSet)(0xc001d001b8)}, MinReadySeconds:0, RevisionHistoryLimit:(*int32)(0xc000dff3a8)}, Status:v1.DaemonSetStatus{CurrentNumberScheduled:0, NumberMisscheduled:0, DesiredNumberScheduled:0, NumberReady:0, ObservedGeneration:0, UpdatedNumberScheduled:0, NumberAvailable:0, NumberUnavailable:0, CollisionCount:(*int32)(nil), Conditions:[]v1.DaemonSetCondition(nil)}}: Operation cannot be fulfilled on daemonsets.apps "kube-proxy": the object has been modified; please apply your changes to the latest version and try again
I0923 12:35:23.914448 1 event.go:291] "Event occurred" object="kube-system/coredns" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled down replica set coredns-74ff55c5b to 1"
I0923 12:35:24.000086 1 event.go:291] "Event occurred" object="kube-system/coredns-74ff55c5b" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulDelete" message="Deleted pod: coredns-74ff55c5b-hq2qr"
I0923 12:37:35.034368 1 event.go:291] "Event occurred" object="kube-system/metrics-server" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled up replica set metrics-server-9975d5f86 to 1"
E0923 12:37:35.203717 1 clusterroleaggregation_controller.go:181] view failed with : Operation cannot be fulfilled on clusterroles.rbac.authorization.k8s.io "view": the object has been modified; please apply your changes to the latest version and try again
E0923 12:37:35.212382 1 clusterroleaggregation_controller.go:181] edit failed with : Operation cannot be fulfilled on clusterroles.rbac.authorization.k8s.io "edit": the object has been modified; please apply your changes to the latest version and try again
I0923 12:37:36.104870 1 event.go:291] "Event occurred" object="kube-system/metrics-server-9975d5f86" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: metrics-server-9975d5f86-vmdbz"
==> kube-controller-manager [cbaa7f55c1cf] <==
W0923 12:40:18.897660 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0923 12:40:44.993960 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0923 12:40:50.545613 1 request.go:655] Throttling request took 1.047890828s, request: GET:https://192.168.103.2:8443/apis/certificates.k8s.io/v1beta1?timeout=32s
W0923 12:40:51.398118 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0923 12:41:15.498107 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0923 12:41:23.046632 1 request.go:655] Throttling request took 1.047369935s, request: GET:https://192.168.103.2:8443/apis/apiregistration.k8s.io/v1?timeout=32s
W0923 12:41:23.899779 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0923 12:41:45.998856 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0923 12:41:55.548510 1 request.go:655] Throttling request took 1.045758368s, request: GET:https://192.168.103.2:8443/apis/batch/v1beta1?timeout=32s
W0923 12:41:56.400880 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0923 12:42:16.499484 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0923 12:42:28.049181 1 request.go:655] Throttling request took 1.048254497s, request: GET:https://192.168.103.2:8443/apis/apiextensions.k8s.io/v1beta1?timeout=32s
W0923 12:42:28.900788 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0923 12:42:47.000297 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0923 12:43:00.549058 1 request.go:655] Throttling request took 1.047411611s, request: GET:https://192.168.103.2:8443/apis/storage.k8s.io/v1?timeout=32s
W0923 12:43:01.401271 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0923 12:43:17.502457 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0923 12:43:33.049267 1 request.go:655] Throttling request took 1.046138671s, request: GET:https://192.168.103.2:8443/apis/scheduling.k8s.io/v1?timeout=32s
W0923 12:43:33.901416 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0923 12:43:48.001962 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0923 12:44:05.546282 1 request.go:655] Throttling request took 1.047758077s, request: GET:https://192.168.103.2:8443/apis/coordination.k8s.io/v1beta1?timeout=32s
W0923 12:44:06.398643 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0923 12:44:18.502602 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0923 12:44:38.046563 1 request.go:655] Throttling request took 1.047457714s, request: GET:https://192.168.103.2:8443/apis/node.k8s.io/v1beta1?timeout=32s
W0923 12:44:38.898375 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
==> kube-proxy [606305ef153c] <==
I0923 12:35:25.507474 1 node.go:172] Successfully retrieved node IP: 192.168.103.2
I0923 12:35:25.508427 1 server_others.go:142] kube-proxy node IP is an IPv4 address (192.168.103.2), assume IPv4 operation
W0923 12:35:25.637020 1 server_others.go:578] Unknown proxy mode "", assuming iptables proxy
I0923 12:35:25.637805 1 server_others.go:185] Using iptables Proxier.
I0923 12:35:25.638659 1 server.go:650] Version: v1.20.0
I0923 12:35:25.639899 1 config.go:224] Starting endpoint slice config controller
I0923 12:35:25.640179 1 shared_informer.go:240] Waiting for caches to sync for endpoint slice config
I0923 12:35:25.640499 1 config.go:315] Starting service config controller
I0923 12:35:25.640515 1 shared_informer.go:240] Waiting for caches to sync for service config
I0923 12:35:25.740888 1 shared_informer.go:247] Caches are synced for service config
I0923 12:35:25.741005 1 shared_informer.go:247] Caches are synced for endpoint slice config
==> kube-proxy [ae76dbbad5df] <==
I0923 12:38:56.715301 1 node.go:172] Successfully retrieved node IP: 192.168.103.2
I0923 12:38:56.715579 1 server_others.go:142] kube-proxy node IP is an IPv4 address (192.168.103.2), assume IPv4 operation
W0923 12:38:56.879551 1 server_others.go:578] Unknown proxy mode "", assuming iptables proxy
I0923 12:38:56.879829 1 server_others.go:185] Using iptables Proxier.
I0923 12:38:56.881218 1 server.go:650] Version: v1.20.0
I0923 12:38:56.882632 1 config.go:224] Starting endpoint slice config controller
I0923 12:38:56.882679 1 shared_informer.go:240] Waiting for caches to sync for endpoint slice config
I0923 12:38:56.882721 1 config.go:315] Starting service config controller
I0923 12:38:56.882733 1 shared_informer.go:240] Waiting for caches to sync for service config
I0923 12:38:56.983351 1 shared_informer.go:247] Caches are synced for service config
I0923 12:38:56.983559 1 shared_informer.go:247] Caches are synced for endpoint slice config
==> kube-scheduler [585ea5a5976b] <==
E0923 12:35:00.408550 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
E0923 12:35:00.408561 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
E0923 12:35:00.409090 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
E0923 12:35:00.408622 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
E0923 12:35:00.408844 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
E0923 12:35:00.408966 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
E0923 12:35:00.408978 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
E0923 12:35:00.409192 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
E0923 12:35:00.409207 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
E0923 12:35:00.409218 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1beta1.PodDisruptionBudget: failed to list *v1beta1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
E0923 12:35:00.409921 1 reflector.go:138] k8s.io/apiserver/pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
E0923 12:35:00.409971 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
E0923 12:35:01.392177 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
E0923 12:35:01.420481 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
E0923 12:35:01.502671 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
E0923 12:35:01.504118 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1beta1.PodDisruptionBudget: failed to list *v1beta1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
E0923 12:35:01.560604 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
E0923 12:35:01.648084 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
E0923 12:35:01.698181 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
E0923 12:35:01.698597 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
E0923 12:35:01.810202 1 reflector.go:138] k8s.io/apiserver/pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
E0923 12:35:01.840140 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
E0923 12:35:01.862857 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
E0923 12:35:01.998411 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
I0923 12:35:04.304374 1 shared_informer.go:247] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
==> kube-scheduler [6f9ee2379541] <==
I0923 12:38:43.380649 1 serving.go:331] Generated self-signed cert in-memory
W0923 12:38:48.380628 1 requestheader_controller.go:193] Unable to get configmap/extension-apiserver-authentication in kube-system. Usually fixed by 'kubectl create rolebinding -n kube-system ROLEBINDING_NAME --role=extension-apiserver-authentication-reader --serviceaccount=YOUR_NS:YOUR_SA'
W0923 12:38:48.380817 1 authentication.go:332] Error looking up in-cluster authentication configuration: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot get resource "configmaps" in API group "" in the namespace "kube-system"
W0923 12:38:48.380840 1 authentication.go:333] Continuing without authentication configuration. This may treat all requests as anonymous.
W0923 12:38:48.380847 1 authentication.go:334] To require authentication configuration lookup to succeed, set --authentication-tolerate-lookup-failure=false
I0923 12:38:48.593186 1 secure_serving.go:197] Serving securely on 127.0.0.1:10259
I0923 12:38:48.677902 1 configmap_cafile_content.go:202] Starting client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0923 12:38:48.677941 1 shared_informer.go:240] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0923 12:38:48.677978 1 tlsconfig.go:240] Starting DynamicServingCertificateController
I0923 12:38:48.978485 1 shared_informer.go:247] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
==> kubelet <==
Sep 23 12:42:39 old-k8s-version-694600 kubelet[1893]: E0923 12:42:39.657460 1893 pod_workers.go:191] Error syncing pod ae849738-e0cf-4a30-9b07-5cddd83db4b6 ("metrics-server-9975d5f86-vmdbz_kube-system(ae849738-e0cf-4a30-9b07-5cddd83db4b6)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Sep 23 12:42:45 old-k8s-version-694600 kubelet[1893]: E0923 12:42:45.658547 1893 pod_workers.go:191] Error syncing pod ed366f72-9f74-45c1-9866-9faee4d9ffb0 ("dashboard-metrics-scraper-8d5bb5db8-2qtq6_kubernetes-dashboard(ed366f72-9f74-45c1-9866-9faee4d9ffb0)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
Sep 23 12:42:51 old-k8s-version-694600 kubelet[1893]: E0923 12:42:51.656478 1893 pod_workers.go:191] Error syncing pod ae849738-e0cf-4a30-9b07-5cddd83db4b6 ("metrics-server-9975d5f86-vmdbz_kube-system(ae849738-e0cf-4a30-9b07-5cddd83db4b6)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Sep 23 12:42:58 old-k8s-version-694600 kubelet[1893]: E0923 12:42:58.657078 1893 pod_workers.go:191] Error syncing pod ed366f72-9f74-45c1-9866-9faee4d9ffb0 ("dashboard-metrics-scraper-8d5bb5db8-2qtq6_kubernetes-dashboard(ed366f72-9f74-45c1-9866-9faee4d9ffb0)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
Sep 23 12:43:06 old-k8s-version-694600 kubelet[1893]: E0923 12:43:06.656952 1893 pod_workers.go:191] Error syncing pod ae849738-e0cf-4a30-9b07-5cddd83db4b6 ("metrics-server-9975d5f86-vmdbz_kube-system(ae849738-e0cf-4a30-9b07-5cddd83db4b6)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Sep 23 12:43:09 old-k8s-version-694600 kubelet[1893]: E0923 12:43:09.654057 1893 pod_workers.go:191] Error syncing pod ed366f72-9f74-45c1-9866-9faee4d9ffb0 ("dashboard-metrics-scraper-8d5bb5db8-2qtq6_kubernetes-dashboard(ed366f72-9f74-45c1-9866-9faee4d9ffb0)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
Sep 23 12:43:17 old-k8s-version-694600 kubelet[1893]: E0923 12:43:17.656711 1893 pod_workers.go:191] Error syncing pod ae849738-e0cf-4a30-9b07-5cddd83db4b6 ("metrics-server-9975d5f86-vmdbz_kube-system(ae849738-e0cf-4a30-9b07-5cddd83db4b6)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Sep 23 12:43:22 old-k8s-version-694600 kubelet[1893]: E0923 12:43:22.657075 1893 pod_workers.go:191] Error syncing pod ed366f72-9f74-45c1-9866-9faee4d9ffb0 ("dashboard-metrics-scraper-8d5bb5db8-2qtq6_kubernetes-dashboard(ed366f72-9f74-45c1-9866-9faee4d9ffb0)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
Sep 23 12:43:31 old-k8s-version-694600 kubelet[1893]: E0923 12:43:31.654949 1893 pod_workers.go:191] Error syncing pod ae849738-e0cf-4a30-9b07-5cddd83db4b6 ("metrics-server-9975d5f86-vmdbz_kube-system(ae849738-e0cf-4a30-9b07-5cddd83db4b6)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Sep 23 12:43:34 old-k8s-version-694600 kubelet[1893]: E0923 12:43:34.668314 1893 pod_workers.go:191] Error syncing pod ed366f72-9f74-45c1-9866-9faee4d9ffb0 ("dashboard-metrics-scraper-8d5bb5db8-2qtq6_kubernetes-dashboard(ed366f72-9f74-45c1-9866-9faee4d9ffb0)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
Sep 23 12:43:34 old-k8s-version-694600 kubelet[1893]: W0923 12:43:34.680215 1893 sysinfo.go:203] Nodes topology is not available, providing CPU topology
Sep 23 12:43:34 old-k8s-version-694600 kubelet[1893]: W0923 12:43:34.681934 1893 sysfs.go:348] unable to read /sys/devices/system/cpu/cpu0/online: open /sys/devices/system/cpu/cpu0/online: no such file or directory
Sep 23 12:43:46 old-k8s-version-694600 kubelet[1893]: E0923 12:43:46.652277 1893 pod_workers.go:191] Error syncing pod ae849738-e0cf-4a30-9b07-5cddd83db4b6 ("metrics-server-9975d5f86-vmdbz_kube-system(ae849738-e0cf-4a30-9b07-5cddd83db4b6)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Sep 23 12:43:48 old-k8s-version-694600 kubelet[1893]: E0923 12:43:48.653714 1893 pod_workers.go:191] Error syncing pod ed366f72-9f74-45c1-9866-9faee4d9ffb0 ("dashboard-metrics-scraper-8d5bb5db8-2qtq6_kubernetes-dashboard(ed366f72-9f74-45c1-9866-9faee4d9ffb0)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
Sep 23 12:44:00 old-k8s-version-694600 kubelet[1893]: E0923 12:44:00.654685 1893 pod_workers.go:191] Error syncing pod ae849738-e0cf-4a30-9b07-5cddd83db4b6 ("metrics-server-9975d5f86-vmdbz_kube-system(ae849738-e0cf-4a30-9b07-5cddd83db4b6)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Sep 23 12:44:02 old-k8s-version-694600 kubelet[1893]: E0923 12:44:02.652220 1893 pod_workers.go:191] Error syncing pod ed366f72-9f74-45c1-9866-9faee4d9ffb0 ("dashboard-metrics-scraper-8d5bb5db8-2qtq6_kubernetes-dashboard(ed366f72-9f74-45c1-9866-9faee4d9ffb0)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
Sep 23 12:44:13 old-k8s-version-694600 kubelet[1893]: E0923 12:44:13.649211 1893 pod_workers.go:191] Error syncing pod ae849738-e0cf-4a30-9b07-5cddd83db4b6 ("metrics-server-9975d5f86-vmdbz_kube-system(ae849738-e0cf-4a30-9b07-5cddd83db4b6)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Sep 23 12:44:15 old-k8s-version-694600 kubelet[1893]: E0923 12:44:15.648344 1893 pod_workers.go:191] Error syncing pod ed366f72-9f74-45c1-9866-9faee4d9ffb0 ("dashboard-metrics-scraper-8d5bb5db8-2qtq6_kubernetes-dashboard(ed366f72-9f74-45c1-9866-9faee4d9ffb0)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
Sep 23 12:44:28 old-k8s-version-694600 kubelet[1893]: E0923 12:44:28.020956 1893 remote_image.go:113] PullImage "fake.domain/registry.k8s.io/echoserver:1.4" from image service failed: rpc error: code = Unknown desc = Error response from daemon: Get "https://fake.domain/v2/": dial tcp: lookup fake.domain on 192.168.65.254:53: no such host
Sep 23 12:44:28 old-k8s-version-694600 kubelet[1893]: E0923 12:44:28.021097 1893 kuberuntime_image.go:51] Pull image "fake.domain/registry.k8s.io/echoserver:1.4" failed: rpc error: code = Unknown desc = Error response from daemon: Get "https://fake.domain/v2/": dial tcp: lookup fake.domain on 192.168.65.254:53: no such host
Sep 23 12:44:28 old-k8s-version-694600 kubelet[1893]: E0923 12:44:28.021280 1893 kuberuntime_manager.go:829] container &Container{Name:metrics-server,Image:fake.domain/registry.k8s.io/echoserver:1.4,Command:[],Args:[--cert-dir=/tmp --secure-port=4443 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --kubelet-use-node-status-port --metric-resolution=60s --kubelet-insecure-tls],WorkingDir:,Ports:[]ContainerPort{ContainerPort{Name:https,HostPort:0,ContainerPort:4443,Protocol:TCP,HostIP:,},},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{cpu: {{100 -3} {<nil>} 100m DecimalSI},memory: {{209715200 0} {<nil>} BinarySI},},},VolumeMounts:[]VolumeMount{VolumeMount{Name:tmp-dir,ReadOnly:false,MountPath:/tmp,SubPath:,MountPropagation:nil,SubPathExpr:,},VolumeMount{Name:metrics-server-token-ghn8r,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,},},LivenessProbe:&Probe{Handler:Handler{Exe
c:nil,HTTPGet:&HTTPGetAction{Path:/livez,Port:{1 0 https},Host:,Scheme:HTTPS,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,},InitialDelaySeconds:0,TimeoutSeconds:1,PeriodSeconds:10,SuccessThreshold:1,FailureThreshold:3,},ReadinessProbe:&Probe{Handler:Handler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/readyz,Port:{1 0 https},Host:,Scheme:HTTPS,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,},InitialDelaySeconds:0,TimeoutSeconds:1,PeriodSeconds:10,SuccessThreshold:1,FailureThreshold:3,},Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:nil,Privileged:nil,SELinuxOptions:nil,RunAsUser:*1000,RunAsNonRoot:*true,ReadOnlyRootFilesystem:*true,AllowPrivilegeEscalation:nil,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,} start failed in pod metrics-server-9975d5f86-vmdbz_kube-system(ae8497
38-e0cf-4a30-9b07-5cddd83db4b6): ErrImagePull: rpc error: code = Unknown desc = Error response from daemon: Get "https://fake.domain/v2/": dial tcp: lookup fake.domain on 192.168.65.254:53: no such host
Sep 23 12:44:28 old-k8s-version-694600 kubelet[1893]: E0923 12:44:28.021315 1893 pod_workers.go:191] Error syncing pod ae849738-e0cf-4a30-9b07-5cddd83db4b6 ("metrics-server-9975d5f86-vmdbz_kube-system(ae849738-e0cf-4a30-9b07-5cddd83db4b6)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = Error response from daemon: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.65.254:53: no such host"
Sep 23 12:44:29 old-k8s-version-694600 kubelet[1893]: E0923 12:44:29.649676 1893 pod_workers.go:191] Error syncing pod ed366f72-9f74-45c1-9866-9faee4d9ffb0 ("dashboard-metrics-scraper-8d5bb5db8-2qtq6_kubernetes-dashboard(ed366f72-9f74-45c1-9866-9faee4d9ffb0)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
Sep 23 12:44:39 old-k8s-version-694600 kubelet[1893]: E0923 12:44:39.645426 1893 pod_workers.go:191] Error syncing pod ae849738-e0cf-4a30-9b07-5cddd83db4b6 ("metrics-server-9975d5f86-vmdbz_kube-system(ae849738-e0cf-4a30-9b07-5cddd83db4b6)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Sep 23 12:44:41 old-k8s-version-694600 kubelet[1893]: E0923 12:44:41.668520 1893 pod_workers.go:191] Error syncing pod ed366f72-9f74-45c1-9866-9faee4d9ffb0 ("dashboard-metrics-scraper-8d5bb5db8-2qtq6_kubernetes-dashboard(ed366f72-9f74-45c1-9866-9faee4d9ffb0)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
==> kubernetes-dashboard [5eb85a2791fd] <==
2024/09/23 12:39:39 Using namespace: kubernetes-dashboard
2024/09/23 12:39:39 Using in-cluster config to connect to apiserver
2024/09/23 12:39:39 Using secret token for csrf signing
2024/09/23 12:39:39 Initializing csrf token from kubernetes-dashboard-csrf secret
2024/09/23 12:39:39 Empty token. Generating and storing in a secret kubernetes-dashboard-csrf
2024/09/23 12:39:39 Successful initial request to the apiserver, version: v1.20.0
2024/09/23 12:39:39 Generating JWE encryption key
2024/09/23 12:39:39 New synchronizer has been registered: kubernetes-dashboard-key-holder-kubernetes-dashboard. Starting
2024/09/23 12:39:39 Starting secret synchronizer for kubernetes-dashboard-key-holder in namespace kubernetes-dashboard
2024/09/23 12:39:40 Initializing JWE encryption key from synchronized object
2024/09/23 12:39:40 Creating in-cluster Sidecar client
2024/09/23 12:39:40 Serving insecurely on HTTP port: 9090
2024/09/23 12:39:40 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/09/23 12:40:10 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/09/23 12:40:40 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/09/23 12:41:10 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/09/23 12:41:40 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/09/23 12:42:10 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/09/23 12:42:40 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/09/23 12:43:10 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/09/23 12:43:40 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/09/23 12:44:10 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/09/23 12:44:40 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/09/23 12:39:39 Starting overwatch
==> storage-provisioner [4b8130a0a631] <==
I0923 12:39:31.497855 1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
I0923 12:39:31.575050 1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!
I0923 12:39:31.575114 1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...
I0923 12:39:49.074337 1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath
I0923 12:39:49.075691 1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_old-k8s-version-694600_3ce2ca5b-acf7-427e-8f5e-d77797b64e35!
I0923 12:39:49.075735 1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"a5e0b200-de87-4f47-a244-ebf98d0c4ab8", APIVersion:"v1", ResourceVersion:"822", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' old-k8s-version-694600_3ce2ca5b-acf7-427e-8f5e-d77797b64e35 became leader
I0923 12:39:49.177344 1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_old-k8s-version-694600_3ce2ca5b-acf7-427e-8f5e-d77797b64e35!
==> storage-provisioner [9420ceb6a8a9] <==
I0923 12:38:55.892618 1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
F0923 12:39:17.049535 1 main.go:39] error getting server version: Get "https://10.96.0.1:443/version?timeout=32s": dial tcp 10.96.0.1:443: connect: connection refused
-- /stdout --
helpers_test.go:254: (dbg) Run: out/minikube-windows-amd64.exe status --format={{.APIServer}} -p old-k8s-version-694600 -n old-k8s-version-694600
helpers_test.go:254: (dbg) Done: out/minikube-windows-amd64.exe status --format={{.APIServer}} -p old-k8s-version-694600 -n old-k8s-version-694600: (1.0016067s)
helpers_test.go:261: (dbg) Run: kubectl --context old-k8s-version-694600 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:272: non-running pods: metrics-server-9975d5f86-vmdbz dashboard-metrics-scraper-8d5bb5db8-2qtq6
helpers_test.go:274: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/SecondStart]: describe non-running pods <======
helpers_test.go:277: (dbg) Run: kubectl --context old-k8s-version-694600 describe pod metrics-server-9975d5f86-vmdbz dashboard-metrics-scraper-8d5bb5db8-2qtq6
helpers_test.go:277: (dbg) Non-zero exit: kubectl --context old-k8s-version-694600 describe pod metrics-server-9975d5f86-vmdbz dashboard-metrics-scraper-8d5bb5db8-2qtq6: exit status 1 (571.5259ms)
** stderr **
E0923 12:44:46.870530 1668 memcache.go:287] "Unhandled Error" err="couldn't get resource list for metrics.k8s.io/v1beta1: the server is currently unable to handle the request"
E0923 12:44:46.981543 1668 memcache.go:121] "Unhandled Error" err="couldn't get resource list for metrics.k8s.io/v1beta1: the server is currently unable to handle the request"
E0923 12:44:47.001538 1668 memcache.go:121] "Unhandled Error" err="couldn't get resource list for metrics.k8s.io/v1beta1: the server is currently unable to handle the request"
E0923 12:44:47.017542 1668 memcache.go:121] "Unhandled Error" err="couldn't get resource list for metrics.k8s.io/v1beta1: the server is currently unable to handle the request"
Error from server (NotFound): pods "metrics-server-9975d5f86-vmdbz" not found
Error from server (NotFound): pods "dashboard-metrics-scraper-8d5bb5db8-2qtq6" not found
** /stderr **
helpers_test.go:279: kubectl --context old-k8s-version-694600 describe pod metrics-server-9975d5f86-vmdbz dashboard-metrics-scraper-8d5bb5db8-2qtq6: exit status 1
--- FAIL: TestStartStop/group/old-k8s-version/serial/SecondStart (417.12s)