=== RUN TestStartStop/group/old-k8s-version/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run: out/minikube-windows-amd64.exe start -p old-k8s-version-606600 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --kubernetes-version=v1.20.0
start_stop_delete_test.go:256: (dbg) Non-zero exit: out/minikube-windows-amd64.exe start -p old-k8s-version-606600 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --kubernetes-version=v1.20.0: exit status 102 (6m53.7528142s)
-- stdout --
* [old-k8s-version-606600] minikube v1.33.1 on Microsoft Windows 10 Enterprise N 10.0.19045.4474 Build 19045.4474
- KUBECONFIG=C:\Users\jenkins.minikube4\minikube-integration\kubeconfig
- MINIKUBE_FORCE_SYSTEMD=
- MINIKUBE_HOME=C:\Users\jenkins.minikube4\minikube-integration\.minikube
- MINIKUBE_LOCATION=17779
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
* Kubernetes 1.30.1 is now available. If you would like to upgrade, specify: --kubernetes-version=v1.30.1
* Using the docker driver based on existing profile
* Starting "old-k8s-version-606600" primary control-plane node in "old-k8s-version-606600" cluster
* Pulling base image v0.0.44-1717668449-19038 ...
* Restarting existing docker container for "old-k8s-version-606600" ...
* Preparing Kubernetes v1.20.0 on Docker 26.1.4 ...
* Verifying Kubernetes components...
- Using image registry.k8s.io/echoserver:1.4
- Using image docker.io/kubernetesui/dashboard:v2.7.0
- Using image fake.domain/registry.k8s.io/echoserver:1.4
- Using image gcr.io/k8s-minikube/storage-provisioner:v5
* Some dashboard features require the metrics-server addon. To enable all features please run:
minikube -p old-k8s-version-606600 addons enable metrics-server
* Enabled addons: default-storageclass, storage-provisioner, metrics-server, dashboard
-- /stdout --
** stderr **
W0612 21:37:08.431789 5540 main.go:291] Unable to resolve the current Docker CLI context "default": context "default": context not found: open C:\Users\jenkins.minikube4\.docker\contexts\meta\37a8eec1ce19687d132fe29051dca629d164e2c4958ba141d5f4133a33f0688f\meta.json: The system cannot find the path specified.
I0612 21:37:08.527811 5540 out.go:291] Setting OutFile to fd 1648 ...
I0612 21:37:08.528792 5540 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0612 21:37:08.528792 5540 out.go:304] Setting ErrFile to fd 1608...
I0612 21:37:08.528792 5540 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0612 21:37:08.554820 5540 out.go:298] Setting JSON to false
I0612 21:37:08.558642 5540 start.go:129] hostinfo: {"hostname":"minikube4","uptime":38513,"bootTime":1718189714,"procs":207,"os":"windows","platform":"Microsoft Windows 10 Enterprise N","platformFamily":"Standalone Workstation","platformVersion":"10.0.19045.4474 Build 19045.4474","kernelVersion":"10.0.19045.4474 Build 19045.4474","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"df6bfb5f-73f2-4acb-9365-df7854ecbb28"}
W0612 21:37:08.558956 5540 start.go:137] gopshost.Virtualization returned error: not implemented yet
I0612 21:37:08.562838 5540 out.go:177] * [old-k8s-version-606600] minikube v1.33.1 on Microsoft Windows 10 Enterprise N 10.0.19045.4474 Build 19045.4474
I0612 21:37:08.565278 5540 notify.go:220] Checking for updates...
I0612 21:37:08.567406 5540 out.go:177] - KUBECONFIG=C:\Users\jenkins.minikube4\minikube-integration\kubeconfig
I0612 21:37:08.569529 5540 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0612 21:37:08.572566 5540 out.go:177] - MINIKUBE_HOME=C:\Users\jenkins.minikube4\minikube-integration\.minikube
I0612 21:37:08.575489 5540 out.go:177] - MINIKUBE_LOCATION=17779
I0612 21:37:08.578434 5540 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0612 21:37:08.583462 5540 config.go:182] Loaded profile config "old-k8s-version-606600": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.20.0
I0612 21:37:08.586669 5540 out.go:177] * Kubernetes 1.30.1 is now available. If you would like to upgrade, specify: --kubernetes-version=v1.30.1
I0612 21:37:08.588832 5540 driver.go:392] Setting default libvirt URI to qemu:///system
I0612 21:37:08.919856 5540 docker.go:122] docker version: linux-26.0.0:Docker Desktop 4.29.0 (145265)
I0612 21:37:08.933849 5540 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0612 21:37:09.331796 5540 info.go:266] docker info: {ID:a15b78d1-f772-48f7-bbf5-f8fe086f3f87 Containers:4 ContainersRunning:3 ContainersPaused:0 ContainersStopped:1 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:105 OomKillDisable:true NGoroutines:100 SystemTime:2024-06-12 21:37:09.284779591 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:14 KernelVersion:5.15.146.1-microsoft-standard-WSL2 OperatingSystem:Docker Desktop OSType:linux Architecture:x86_64 I
ndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:16 MemTotal:33657610240 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy:http.docker.internal:3128 HTTPSProxy:http.docker.internal:3128 NoProxy:hubproxy.docker.internal Name:docker-desktop Labels:[com.docker.desktop.address=npipe://\\.\pipe\docker_cli] ExperimentalBuild:false ServerVersion:26.0.0 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:ae07eda36dd25f8a1b98dfbf587313b99c0190bb Expected:ae07eda36dd25f8a1b98dfbf587313b99c0190bb} RuncCommit:{ID:v1.1.12-0-g51d5e94 Expected:v1.1.12-0-g51d5e94} InitCommit:{ID:de40ad
0 Expected:de40ad0} SecurityOptions:[name=seccomp,profile=unconfined] ProductLicense: Warnings:[WARNING: No blkio throttle.read_bps_device support WARNING: No blkio throttle.write_bps_device support WARNING: No blkio throttle.read_iops_device support WARNING: No blkio throttle.write_iops_device support WARNING: daemon is not using the default seccomp profile] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:C:\Program Files\Docker\cli-plugins\docker-buildx.exe SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.13.1-desktop.1] map[Name:compose Path:C:\Program Files\Docker\cli-plugins\docker-compose.exe SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.26.1-desktop.1] map[Name:debug Path:C:\Program Files\Docker\cli-plugins\docker-debug.exe SchemaVersion:0.1.0 ShortDescription:Get a shell into any image or container. Vendor:Docker Inc. Version:0.0.27] map[Name:dev Path:C:\Program Files\Docker\cli-plugins\docker-dev.exe SchemaVersi
on:0.1.0 ShortDescription:Docker Dev Environments Vendor:Docker Inc. Version:v0.1.2] map[Name:extension Path:C:\Program Files\Docker\cli-plugins\docker-extension.exe SchemaVersion:0.1.0 ShortDescription:Manages Docker extensions Vendor:Docker Inc. Version:v0.2.23] map[Name:feedback Path:C:\Program Files\Docker\cli-plugins\docker-feedback.exe SchemaVersion:0.1.0 ShortDescription:Provide feedback, right in your terminal! Vendor:Docker Inc. Version:v1.0.4] map[Name:init Path:C:\Program Files\Docker\cli-plugins\docker-init.exe SchemaVersion:0.1.0 ShortDescription:Creates Docker-related starter files for your project Vendor:Docker Inc. Version:v1.1.0] map[Name:sbom Path:C:\Program Files\Docker\cli-plugins\docker-sbom.exe SchemaVersion:0.1.0 ShortDescription:View the packaged-based Software Bill Of Materials (SBOM) for an image URL:https://github.com/docker/sbom-cli-plugin Vendor:Anchore Inc. Version:0.6.0] map[Name:scout Path:C:\Program Files\Docker\cli-plugins\docker-scout.exe SchemaVersion:0.1.0 ShortDescription
:Docker Scout Vendor:Docker Inc. Version:v1.6.3]] Warnings:<nil>}}
I0612 21:37:09.339794 5540 out.go:177] * Using the docker driver based on existing profile
I0612 21:37:09.347785 5540 start.go:297] selected driver: docker
I0612 21:37:09.348782 5540 start.go:901] validating driver "docker" against &{Name:old-k8s-version-606600 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1717668449-19038@sha256:30d191eb345232f513c52f7ac036e7a34a8cc441d88353f92985384bcddf00d6 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-606600 Namespace:default APIServerHAVIP: AP
IServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountSt
ring:C:\Users\jenkins.minikube4:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0612 21:37:09.348782 5540 start.go:912] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0612 21:37:09.435493 5540 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0612 21:37:09.868693 5540 info.go:266] docker info: {ID:a15b78d1-f772-48f7-bbf5-f8fe086f3f87 Containers:4 ContainersRunning:3 ContainersPaused:0 ContainersStopped:1 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:105 OomKillDisable:true NGoroutines:100 SystemTime:2024-06-12 21:37:09.821867254 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:14 KernelVersion:5.15.146.1-microsoft-standard-WSL2 OperatingSystem:Docker Desktop OSType:linux Architecture:x86_64 I
ndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:16 MemTotal:33657610240 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy:http.docker.internal:3128 HTTPSProxy:http.docker.internal:3128 NoProxy:hubproxy.docker.internal Name:docker-desktop Labels:[com.docker.desktop.address=npipe://\\.\pipe\docker_cli] ExperimentalBuild:false ServerVersion:26.0.0 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:ae07eda36dd25f8a1b98dfbf587313b99c0190bb Expected:ae07eda36dd25f8a1b98dfbf587313b99c0190bb} RuncCommit:{ID:v1.1.12-0-g51d5e94 Expected:v1.1.12-0-g51d5e94} InitCommit:{ID:de40ad
0 Expected:de40ad0} SecurityOptions:[name=seccomp,profile=unconfined] ProductLicense: Warnings:[WARNING: No blkio throttle.read_bps_device support WARNING: No blkio throttle.write_bps_device support WARNING: No blkio throttle.read_iops_device support WARNING: No blkio throttle.write_iops_device support WARNING: daemon is not using the default seccomp profile] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:C:\Program Files\Docker\cli-plugins\docker-buildx.exe SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.13.1-desktop.1] map[Name:compose Path:C:\Program Files\Docker\cli-plugins\docker-compose.exe SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.26.1-desktop.1] map[Name:debug Path:C:\Program Files\Docker\cli-plugins\docker-debug.exe SchemaVersion:0.1.0 ShortDescription:Get a shell into any image or container. Vendor:Docker Inc. Version:0.0.27] map[Name:dev Path:C:\Program Files\Docker\cli-plugins\docker-dev.exe SchemaVersi
on:0.1.0 ShortDescription:Docker Dev Environments Vendor:Docker Inc. Version:v0.1.2] map[Name:extension Path:C:\Program Files\Docker\cli-plugins\docker-extension.exe SchemaVersion:0.1.0 ShortDescription:Manages Docker extensions Vendor:Docker Inc. Version:v0.2.23] map[Name:feedback Path:C:\Program Files\Docker\cli-plugins\docker-feedback.exe SchemaVersion:0.1.0 ShortDescription:Provide feedback, right in your terminal! Vendor:Docker Inc. Version:v1.0.4] map[Name:init Path:C:\Program Files\Docker\cli-plugins\docker-init.exe SchemaVersion:0.1.0 ShortDescription:Creates Docker-related starter files for your project Vendor:Docker Inc. Version:v1.1.0] map[Name:sbom Path:C:\Program Files\Docker\cli-plugins\docker-sbom.exe SchemaVersion:0.1.0 ShortDescription:View the packaged-based Software Bill Of Materials (SBOM) for an image URL:https://github.com/docker/sbom-cli-plugin Vendor:Anchore Inc. Version:0.6.0] map[Name:scout Path:C:\Program Files\Docker\cli-plugins\docker-scout.exe SchemaVersion:0.1.0 ShortDescription
:Docker Scout Vendor:Docker Inc. Version:v1.6.3]] Warnings:<nil>}}
I0612 21:37:09.869686 5540 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0612 21:37:09.869686 5540 cni.go:84] Creating CNI manager for ""
I0612 21:37:09.869686 5540 cni.go:162] CNI unnecessary in this configuration, recommending no CNI
I0612 21:37:09.869686 5540 start.go:340] cluster config:
{Name:old-k8s-version-606600 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1717668449-19038@sha256:30d191eb345232f513c52f7ac036e7a34a8cc441d88353f92985384bcddf00d6 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-606600 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local
ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:C:\Users\jenkins.minikube4:/minikube-host Mount9PVersion:9p2000.L MountGID:
docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0612 21:37:09.873696 5540 out.go:177] * Starting "old-k8s-version-606600" primary control-plane node in "old-k8s-version-606600" cluster
I0612 21:37:09.876686 5540 cache.go:121] Beginning downloading kic base image for docker with docker
I0612 21:37:09.877689 5540 out.go:177] * Pulling base image v0.0.44-1717668449-19038 ...
I0612 21:37:09.881319 5540 preload.go:132] Checking if preload exists for k8s version v1.20.0 and runtime docker
I0612 21:37:09.881319 5540 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1717668449-19038@sha256:30d191eb345232f513c52f7ac036e7a34a8cc441d88353f92985384bcddf00d6 in local docker daemon
I0612 21:37:09.881319 5540 preload.go:147] Found local preload: C:\Users\jenkins.minikube4\minikube-integration\.minikube\cache\preloaded-tarball\preloaded-images-k8s-v18-v1.20.0-docker-overlay2-amd64.tar.lz4
I0612 21:37:09.881319 5540 cache.go:56] Caching tarball of preloaded images
I0612 21:37:09.881319 5540 preload.go:173] Found C:\Users\jenkins.minikube4\minikube-integration\.minikube\cache\preloaded-tarball\preloaded-images-k8s-v18-v1.20.0-docker-overlay2-amd64.tar.lz4 in cache, skipping download
I0612 21:37:09.881319 5540 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on docker
I0612 21:37:09.881319 5540 profile.go:143] Saving config to C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\old-k8s-version-606600\config.json ...
I0612 21:37:10.105152 5540 image.go:83] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1717668449-19038@sha256:30d191eb345232f513c52f7ac036e7a34a8cc441d88353f92985384bcddf00d6 in local docker daemon, skipping pull
I0612 21:37:10.105152 5540 cache.go:144] gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1717668449-19038@sha256:30d191eb345232f513c52f7ac036e7a34a8cc441d88353f92985384bcddf00d6 exists in daemon, skipping load
I0612 21:37:10.105152 5540 cache.go:194] Successfully downloaded all kic artifacts
I0612 21:37:10.105152 5540 start.go:360] acquireMachinesLock for old-k8s-version-606600: {Name:mk7b56f48d51697c2655a0e3865bda4f9feaae19 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0612 21:37:10.105853 5540 start.go:364] duration metric: took 700.7µs to acquireMachinesLock for "old-k8s-version-606600"
I0612 21:37:10.106084 5540 start.go:96] Skipping create...Using existing machine configuration
I0612 21:37:10.106173 5540 fix.go:54] fixHost starting:
I0612 21:37:10.136307 5540 cli_runner.go:164] Run: docker container inspect old-k8s-version-606600 --format={{.State.Status}}
I0612 21:37:10.308493 5540 fix.go:112] recreateIfNeeded on old-k8s-version-606600: state=Stopped err=<nil>
W0612 21:37:10.308493 5540 fix.go:138] unexpected machine state, will restart: <nil>
I0612 21:37:10.312027 5540 out.go:177] * Restarting existing docker container for "old-k8s-version-606600" ...
I0612 21:37:10.327919 5540 cli_runner.go:164] Run: docker start old-k8s-version-606600
I0612 21:37:11.411081 5540 cli_runner.go:217] Completed: docker start old-k8s-version-606600: (1.0831125s)
I0612 21:37:11.428073 5540 cli_runner.go:164] Run: docker container inspect old-k8s-version-606600 --format={{.State.Status}}
I0612 21:37:11.650589 5540 kic.go:430] container "old-k8s-version-606600" state is running.
I0612 21:37:11.672526 5540 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-606600
I0612 21:37:11.903637 5540 profile.go:143] Saving config to C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\old-k8s-version-606600\config.json ...
I0612 21:37:11.906801 5540 machine.go:94] provisionDockerMachine start ...
I0612 21:37:11.925664 5540 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-606600
I0612 21:37:12.173684 5540 main.go:141] libmachine: Using SSH client type: native
I0612 21:37:12.174661 5540 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x6ca540] 0x6cd120 <nil> [] 0s} 127.0.0.1 55192 <nil> <nil>}
I0612 21:37:12.174661 5540 main.go:141] libmachine: About to run SSH command:
hostname
I0612 21:37:12.177654 5540 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: EOF
I0612 21:37:15.404326 5540 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-606600
I0612 21:37:15.404326 5540 ubuntu.go:169] provisioning hostname "old-k8s-version-606600"
I0612 21:37:15.421315 5540 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-606600
I0612 21:37:15.628347 5540 main.go:141] libmachine: Using SSH client type: native
I0612 21:37:15.629337 5540 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x6ca540] 0x6cd120 <nil> [] 0s} 127.0.0.1 55192 <nil> <nil>}
I0612 21:37:15.629337 5540 main.go:141] libmachine: About to run SSH command:
sudo hostname old-k8s-version-606600 && echo "old-k8s-version-606600" | sudo tee /etc/hostname
I0612 21:37:15.870329 5540 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-606600
I0612 21:37:15.879336 5540 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-606600
I0612 21:37:16.118130 5540 main.go:141] libmachine: Using SSH client type: native
I0612 21:37:16.118130 5540 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x6ca540] 0x6cd120 <nil> [] 0s} 127.0.0.1 55192 <nil> <nil>}
I0612 21:37:16.118130 5540 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-606600' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-606600/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-606600' | sudo tee -a /etc/hosts;
fi
fi
I0612 21:37:16.353138 5540 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0612 21:37:16.353138 5540 ubuntu.go:175] set auth options {CertDir:C:\Users\jenkins.minikube4\minikube-integration\.minikube CaCertPath:C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\ca.pem CaPrivateKeyPath:C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:C:\Users\jenkins.minikube4\minikube-integration\.minikube\machines\server.pem ServerKeyPath:C:\Users\jenkins.minikube4\minikube-integration\.minikube\machines\server-key.pem ClientKeyPath:C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\cert.pem ServerCertSANs:[] StorePath:C:\Users\jenkins.minikube4\minikube-integration\.minikube}
I0612 21:37:16.353138 5540 ubuntu.go:177] setting up certificates
I0612 21:37:16.353138 5540 provision.go:84] configureAuth start
I0612 21:37:16.362131 5540 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-606600
I0612 21:37:16.594395 5540 provision.go:143] copyHostCerts
I0612 21:37:16.597392 5540 exec_runner.go:144] found C:\Users\jenkins.minikube4\minikube-integration\.minikube/ca.pem, removing ...
I0612 21:37:16.597392 5540 exec_runner.go:203] rm: C:\Users\jenkins.minikube4\minikube-integration\.minikube\ca.pem
I0612 21:37:16.597392 5540 exec_runner.go:151] cp: C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\ca.pem --> C:\Users\jenkins.minikube4\minikube-integration\.minikube/ca.pem (1082 bytes)
I0612 21:37:16.601864 5540 exec_runner.go:144] found C:\Users\jenkins.minikube4\minikube-integration\.minikube/cert.pem, removing ...
I0612 21:37:16.601864 5540 exec_runner.go:203] rm: C:\Users\jenkins.minikube4\minikube-integration\.minikube\cert.pem
I0612 21:37:16.602611 5540 exec_runner.go:151] cp: C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\cert.pem --> C:\Users\jenkins.minikube4\minikube-integration\.minikube/cert.pem (1123 bytes)
I0612 21:37:16.604183 5540 exec_runner.go:144] found C:\Users\jenkins.minikube4\minikube-integration\.minikube/key.pem, removing ...
I0612 21:37:16.604324 5540 exec_runner.go:203] rm: C:\Users\jenkins.minikube4\minikube-integration\.minikube\key.pem
I0612 21:37:16.604760 5540 exec_runner.go:151] cp: C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\key.pem --> C:\Users\jenkins.minikube4\minikube-integration\.minikube/key.pem (1679 bytes)
I0612 21:37:16.606395 5540 provision.go:117] generating server cert: C:\Users\jenkins.minikube4\minikube-integration\.minikube\machines\server.pem ca-key=C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\ca.pem private-key=C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\ca-key.pem org=jenkins.old-k8s-version-606600 san=[127.0.0.1 192.168.76.2 localhost minikube old-k8s-version-606600]
I0612 21:37:16.829020 5540 provision.go:177] copyRemoteCerts
I0612 21:37:16.844024 5540 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0612 21:37:16.855038 5540 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-606600
I0612 21:37:17.113495 5540 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:55192 SSHKeyPath:C:\Users\jenkins.minikube4\minikube-integration\.minikube\machines\old-k8s-version-606600\id_rsa Username:docker}
I0612 21:37:17.269904 5540 ssh_runner.go:362] scp C:\Users\jenkins.minikube4\minikube-integration\.minikube\machines\server.pem --> /etc/docker/server.pem (1233 bytes)
I0612 21:37:17.329436 5540 ssh_runner.go:362] scp C:\Users\jenkins.minikube4\minikube-integration\.minikube\machines\server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I0612 21:37:17.374765 5540 ssh_runner.go:362] scp C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\ca.pem --> /etc/docker/ca.pem (1082 bytes)
I0612 21:37:17.444004 5540 provision.go:87] duration metric: took 1.0908159s to configureAuth
I0612 21:37:17.445004 5540 ubuntu.go:193] setting minikube options for container-runtime
I0612 21:37:17.445004 5540 config.go:182] Loaded profile config "old-k8s-version-606600": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.20.0
I0612 21:37:17.454999 5540 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-606600
I0612 21:37:17.662874 5540 main.go:141] libmachine: Using SSH client type: native
I0612 21:37:17.663877 5540 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x6ca540] 0x6cd120 <nil> [] 0s} 127.0.0.1 55192 <nil> <nil>}
I0612 21:37:17.663877 5540 main.go:141] libmachine: About to run SSH command:
df --output=fstype / | tail -n 1
I0612 21:37:17.884640 5540 main.go:141] libmachine: SSH cmd err, output: <nil>: overlay
I0612 21:37:17.884640 5540 ubuntu.go:71] root file system type: overlay
I0612 21:37:17.884640 5540 provision.go:314] Updating docker unit: /lib/systemd/system/docker.service ...
I0612 21:37:17.905649 5540 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-606600
I0612 21:37:18.107813 5540 main.go:141] libmachine: Using SSH client type: native
I0612 21:37:18.107813 5540 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x6ca540] 0x6cd120 <nil> [] 0s} 127.0.0.1 55192 <nil> <nil>}
I0612 21:37:18.108809 5540 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /lib/systemd/system && printf %s "[Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
BindsTo=containerd.service
After=network-online.target firewalld.service containerd.service
Wants=network-online.target
Requires=docker.socket
StartLimitBurst=3
StartLimitIntervalSec=60
[Service]
Type=notify
Restart=on-failure
# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
# The base configuration already specifies an 'ExecStart=...' command. The first directive
# here is to clear out that command inherited from the base configuration. Without this,
# the command from the base configuration and the command specified here are treated as
# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
# will catch this invalid input and refuse to start the service with an error like:
# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
ExecStart=
ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12
ExecReload=/bin/kill -s HUP \$MAINPID
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
LimitNOFILE=infinity
LimitNPROC=infinity
LimitCORE=infinity
# Uncomment TasksMax if your systemd version supports it.
# Only systemd 226 and above support this version.
TasksMax=infinity
TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
# kill only the docker process, not all processes in the cgroup
KillMode=process
[Install]
WantedBy=multi-user.target
" | sudo tee /lib/systemd/system/docker.service.new
I0612 21:37:18.344882 5540 main.go:141] libmachine: SSH cmd err, output: <nil>: [Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
BindsTo=containerd.service
After=network-online.target firewalld.service containerd.service
Wants=network-online.target
Requires=docker.socket
StartLimitBurst=3
StartLimitIntervalSec=60
[Service]
Type=notify
Restart=on-failure
# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
# The base configuration already specifies an 'ExecStart=...' command. The first directive
# here is to clear out that command inherited from the base configuration. Without this,
# the command from the base configuration and the command specified here are treated as
# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
# will catch this invalid input and refuse to start the service with an error like:
# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
ExecStart=
ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12
ExecReload=/bin/kill -s HUP $MAINPID
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
LimitNOFILE=infinity
LimitNPROC=infinity
LimitCORE=infinity
# Uncomment TasksMax if your systemd version supports it.
# Only systemd 226 and above support this version.
TasksMax=infinity
TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
# kill only the docker process, not all processes in the cgroup
KillMode=process
[Install]
WantedBy=multi-user.target
I0612 21:37:18.359854 5540 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-606600
I0612 21:37:18.553440 5540 main.go:141] libmachine: Using SSH client type: native
I0612 21:37:18.554180 5540 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x6ca540] 0x6cd120 <nil> [] 0s} 127.0.0.1 55192 <nil> <nil>}
I0612 21:37:18.554180 5540 main.go:141] libmachine: About to run SSH command:
sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }
I0612 21:37:18.770750 5540 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0612 21:37:18.770750 5540 machine.go:97] duration metric: took 6.8627907s to provisionDockerMachine
I0612 21:37:18.770750 5540 start.go:293] postStartSetup for "old-k8s-version-606600" (driver="docker")
I0612 21:37:18.770750 5540 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0612 21:37:18.785855 5540 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0612 21:37:18.802507 5540 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-606600
I0612 21:37:18.983152 5540 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:55192 SSHKeyPath:C:\Users\jenkins.minikube4\minikube-integration\.minikube\machines\old-k8s-version-606600\id_rsa Username:docker}
I0612 21:37:19.151495 5540 ssh_runner.go:195] Run: cat /etc/os-release
I0612 21:37:19.159494 5540 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I0612 21:37:19.159494 5540 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
I0612 21:37:19.159494 5540 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
I0612 21:37:19.159494 5540 info.go:137] Remote host: Ubuntu 22.04.4 LTS
I0612 21:37:19.159494 5540 filesync.go:126] Scanning C:\Users\jenkins.minikube4\minikube-integration\.minikube\addons for local assets ...
I0612 21:37:19.159494 5540 filesync.go:126] Scanning C:\Users\jenkins.minikube4\minikube-integration\.minikube\files for local assets ...
I0612 21:37:19.160497 5540 filesync.go:149] local asset: C:\Users\jenkins.minikube4\minikube-integration\.minikube\files\etc\ssl\certs\60002.pem -> 60002.pem in /etc/ssl/certs
I0612 21:37:19.172503 5540 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0612 21:37:19.191339 5540 ssh_runner.go:362] scp C:\Users\jenkins.minikube4\minikube-integration\.minikube\files\etc\ssl\certs\60002.pem --> /etc/ssl/certs/60002.pem (1708 bytes)
I0612 21:37:19.251968 5540 start.go:296] duration metric: took 481.1957ms for postStartSetup
I0612 21:37:19.263960 5540 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I0612 21:37:19.272965 5540 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-606600
I0612 21:37:19.464452 5540 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:55192 SSHKeyPath:C:\Users\jenkins.minikube4\minikube-integration\.minikube\machines\old-k8s-version-606600\id_rsa Username:docker}
I0612 21:37:19.617634 5540 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
I0612 21:37:19.641603 5540 fix.go:56] duration metric: took 9.53499s for fixHost
I0612 21:37:19.641603 5540 start.go:83] releasing machines lock for "old-k8s-version-606600", held for 9.5353104s
I0612 21:37:19.652633 5540 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-606600
I0612 21:37:19.850052 5540 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0612 21:37:19.861051 5540 ssh_runner.go:195] Run: cat /version.json
I0612 21:37:19.862048 5540 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-606600
I0612 21:37:19.870057 5540 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-606600
I0612 21:37:20.062390 5540 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:55192 SSHKeyPath:C:\Users\jenkins.minikube4\minikube-integration\.minikube\machines\old-k8s-version-606600\id_rsa Username:docker}
I0612 21:37:20.076644 5540 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:55192 SSHKeyPath:C:\Users\jenkins.minikube4\minikube-integration\.minikube\machines\old-k8s-version-606600\id_rsa Username:docker}
I0612 21:37:20.399840 5540 ssh_runner.go:195] Run: systemctl --version
I0612 21:37:20.431508 5540 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
I0612 21:37:20.463968 5540 ssh_runner.go:195] Run: sudo find \etc\cni\net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "grep -q loopback {} && ( grep -q name {} || sudo sed -i '/"type": "loopback"/i \ \ \ \ "name": "loopback",' {} ) && sudo sed -i 's|"cniVersion": ".*"|"cniVersion": "1.0.0"|g' {}" ;
W0612 21:37:20.486994 5540 start.go:438] unable to name loopback interface in configureRuntimes: unable to patch loopback cni config "/etc/cni/net.d/*loopback.conf*": sudo find \etc\cni\net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "grep -q loopback {} && ( grep -q name {} || sudo sed -i '/"type": "loopback"/i \ \ \ \ "name": "loopback",' {} ) && sudo sed -i 's|"cniVersion": ".*"|"cniVersion": "1.0.0"|g' {}" ;: Process exited with status 1
stdout:
stderr:
find: '\\etc\\cni\\net.d': No such file or directory
I0612 21:37:20.501955 5540 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *bridge* -not -name *podman* -not -name *.mk_disabled -printf "%p, " -exec sh -c "sudo sed -i -r -e '/"dst": ".*:.*"/d' -e 's|^(.*)"dst": (.*)[,*]$|\1"dst": \2|g' -e '/"subnet": ".*:.*"/d' -e 's|^(.*)"subnet": ".*"(.*)[,*]$|\1"subnet": "10.244.0.0/16"\2|g' {}" ;
I0612 21:37:20.554422 5540 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *podman* -not -name *.mk_disabled -printf "%p, " -exec sh -c "sudo sed -i -r -e 's|^(.*)"subnet": ".*"(.*)$|\1"subnet": "10.244.0.0/16"\2|g' -e 's|^(.*)"gateway": ".*"(.*)$|\1"gateway": "10.244.0.1"\2|g' {}" ;
I0612 21:37:20.598342 5540 cni.go:308] configured [/etc/cni/net.d/100-crio-bridge.conf, /etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I0612 21:37:20.598342 5540 start.go:494] detecting cgroup driver to use...
I0612 21:37:20.598426 5540 detect.go:196] detected "cgroupfs" cgroup driver on host os
I0612 21:37:20.598876 5540 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///run/containerd/containerd.sock
" | sudo tee /etc/crictl.yaml"
I0612 21:37:20.658095 5540 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.2"|' /etc/containerd/config.toml"
I0612 21:37:20.704019 5540 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"
I0612 21:37:20.736882 5540 containerd.go:146] configuring containerd to use "cgroupfs" as cgroup driver...
I0612 21:37:20.748420 5540 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"
I0612 21:37:20.781432 5540 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0612 21:37:20.828669 5540 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"
I0612 21:37:20.870272 5540 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0612 21:37:20.908261 5540 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0612 21:37:20.952789 5540 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"
I0612 21:37:21.004089 5540 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0612 21:37:21.050755 5540 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0612 21:37:21.101857 5540 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0612 21:37:21.289593 5540 ssh_runner.go:195] Run: sudo systemctl restart containerd
I0612 21:37:21.497426 5540 start.go:494] detecting cgroup driver to use...
I0612 21:37:21.497517 5540 detect.go:196] detected "cgroupfs" cgroup driver on host os
I0612 21:37:21.519112 5540 ssh_runner.go:195] Run: sudo systemctl cat docker.service
I0612 21:37:21.549209 5540 cruntime.go:279] skipping containerd shutdown because we are bound to it
I0612 21:37:21.564213 5540 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
I0612 21:37:21.592268 5540 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/dockershim.sock
" | sudo tee /etc/crictl.yaml"
I0612 21:37:21.668011 5540 ssh_runner.go:195] Run: which cri-dockerd
I0612 21:37:21.717053 5540 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/cri-docker.service.d
I0612 21:37:21.745053 5540 ssh_runner.go:362] scp memory --> /etc/systemd/system/cri-docker.service.d/10-cni.conf (189 bytes)
I0612 21:37:21.808524 5540 ssh_runner.go:195] Run: sudo systemctl unmask docker.service
I0612 21:37:22.113194 5540 ssh_runner.go:195] Run: sudo systemctl enable docker.socket
I0612 21:37:22.336254 5540 docker.go:574] configuring docker to use "cgroupfs" as cgroup driver...
I0612 21:37:22.336254 5540 ssh_runner.go:362] scp memory --> /etc/docker/daemon.json (130 bytes)
I0612 21:37:22.387418 5540 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0612 21:37:22.562959 5540 ssh_runner.go:195] Run: sudo systemctl restart docker
I0612 21:37:23.456714 5540 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}
I0612 21:37:23.549050 5540 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}
I0612 21:37:23.628534 5540 out.go:204] * Preparing Kubernetes v1.20.0 on Docker 26.1.4 ...
I0612 21:37:23.644543 5540 cli_runner.go:164] Run: docker exec -t old-k8s-version-606600 dig +short host.docker.internal
I0612 21:37:23.979523 5540 network.go:96] got host ip for mount in container by digging dns: 192.168.65.254
I0612 21:37:23.995628 5540 ssh_runner.go:195] Run: grep 192.168.65.254 host.minikube.internal$ /etc/hosts
I0612 21:37:24.007523 5540 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.65.254 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0612 21:37:24.041545 5540 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "8443/tcp") 0).HostPort}}'" old-k8s-version-606600
I0612 21:37:24.214535 5540 kubeadm.go:877] updating cluster {Name:old-k8s-version-606600 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1717668449-19038@sha256:30d191eb345232f513c52f7ac036e7a34a8cc441d88353f92985384bcddf00d6 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-606600 Namespace:default APIServerHAVIP: APIServerName:minik
ubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:C:\Users\jen
kins.minikube4:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0612 21:37:24.214535 5540 preload.go:132] Checking if preload exists for k8s version v1.20.0 and runtime docker
I0612 21:37:24.224658 5540 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}
I0612 21:37:24.266842 5540 docker.go:685] Got preloaded images: -- stdout --
gcr.io/k8s-minikube/storage-provisioner:v5
k8s.gcr.io/kube-proxy:v1.20.0
k8s.gcr.io/kube-scheduler:v1.20.0
k8s.gcr.io/kube-apiserver:v1.20.0
k8s.gcr.io/kube-controller-manager:v1.20.0
k8s.gcr.io/etcd:3.4.13-0
k8s.gcr.io/coredns:1.7.0
k8s.gcr.io/pause:3.2
gcr.io/k8s-minikube/busybox:1.28.4-glibc
-- /stdout --
I0612 21:37:24.266842 5540 docker.go:691] registry.k8s.io/kube-apiserver:v1.20.0 wasn't preloaded
I0612 21:37:24.289318 5540 ssh_runner.go:195] Run: sudo cat /var/lib/docker/image/overlay2/repositories.json
I0612 21:37:24.342452 5540 ssh_runner.go:195] Run: which lz4
I0612 21:37:24.369977 5540 ssh_runner.go:195] Run: stat -c "%s %y" /preloaded.tar.lz4
I0612 21:37:24.376971 5540 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%s %y" /preloaded.tar.lz4: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/preloaded.tar.lz4': No such file or directory
I0612 21:37:24.377978 5540 ssh_runner.go:362] scp C:\Users\jenkins.minikube4\minikube-integration\.minikube\cache\preloaded-tarball\preloaded-images-k8s-v18-v1.20.0-docker-overlay2-amd64.tar.lz4 --> /preloaded.tar.lz4 (401930599 bytes)
I0612 21:37:39.677686 5540 docker.go:649] duration metric: took 15.3193342s to copy over tarball
I0612 21:37:39.693000 5540 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4
I0612 21:37:44.979538 5540 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (5.2862379s)
I0612 21:37:44.979538 5540 ssh_runner.go:146] rm: /preloaded.tar.lz4
I0612 21:37:45.087876 5540 ssh_runner.go:195] Run: sudo cat /var/lib/docker/image/overlay2/repositories.json
I0612 21:37:45.112236 5540 ssh_runner.go:362] scp memory --> /var/lib/docker/image/overlay2/repositories.json (2824 bytes)
I0612 21:37:45.166626 5540 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0612 21:37:45.343975 5540 ssh_runner.go:195] Run: sudo systemctl restart docker
I0612 21:37:55.024226 5540 ssh_runner.go:235] Completed: sudo systemctl restart docker: (9.6798038s)
I0612 21:37:55.040824 5540 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}
I0612 21:37:55.083489 5540 docker.go:685] Got preloaded images: -- stdout --
gcr.io/k8s-minikube/storage-provisioner:v5
k8s.gcr.io/kube-proxy:v1.20.0
k8s.gcr.io/kube-controller-manager:v1.20.0
k8s.gcr.io/kube-apiserver:v1.20.0
k8s.gcr.io/kube-scheduler:v1.20.0
k8s.gcr.io/etcd:3.4.13-0
k8s.gcr.io/coredns:1.7.0
k8s.gcr.io/pause:3.2
gcr.io/k8s-minikube/busybox:1.28.4-glibc
-- /stdout --
I0612 21:37:55.083489 5540 docker.go:691] registry.k8s.io/kube-apiserver:v1.20.0 wasn't preloaded
I0612 21:37:55.083489 5540 cache_images.go:88] LoadCachedImages start: [registry.k8s.io/kube-apiserver:v1.20.0 registry.k8s.io/kube-controller-manager:v1.20.0 registry.k8s.io/kube-scheduler:v1.20.0 registry.k8s.io/kube-proxy:v1.20.0 registry.k8s.io/pause:3.2 registry.k8s.io/etcd:3.4.13-0 registry.k8s.io/coredns:1.7.0 gcr.io/k8s-minikube/storage-provisioner:v5]
I0612 21:37:55.103635 5540 image.go:134] retrieving image: registry.k8s.io/kube-controller-manager:v1.20.0
I0612 21:37:55.111631 5540 image.go:134] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v5
I0612 21:37:55.113639 5540 image.go:134] retrieving image: registry.k8s.io/etcd:3.4.13-0
I0612 21:37:55.115625 5540 image.go:134] retrieving image: registry.k8s.io/kube-apiserver:v1.20.0
I0612 21:37:55.118633 5540 image.go:134] retrieving image: registry.k8s.io/coredns:1.7.0
I0612 21:37:55.119643 5540 image.go:134] retrieving image: registry.k8s.io/pause:3.2
I0612 21:37:55.121643 5540 image.go:134] retrieving image: registry.k8s.io/kube-scheduler:v1.20.0
I0612 21:37:55.127666 5540 image.go:134] retrieving image: registry.k8s.io/kube-proxy:v1.20.0
I0612 21:37:55.132405 5540 image.go:177] daemon lookup for gcr.io/k8s-minikube/storage-provisioner:v5: Error response from daemon: No such image: gcr.io/k8s-minikube/storage-provisioner:v5
I0612 21:37:55.133616 5540 image.go:177] daemon lookup for registry.k8s.io/kube-controller-manager:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.20.0
I0612 21:37:55.142648 5540 image.go:177] daemon lookup for registry.k8s.io/pause:3.2: Error response from daemon: No such image: registry.k8s.io/pause:3.2
I0612 21:37:55.142648 5540 image.go:177] daemon lookup for registry.k8s.io/coredns:1.7.0: Error response from daemon: No such image: registry.k8s.io/coredns:1.7.0
I0612 21:37:55.144727 5540 image.go:177] daemon lookup for registry.k8s.io/kube-apiserver:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.20.0
I0612 21:37:55.145615 5540 image.go:177] daemon lookup for registry.k8s.io/kube-scheduler:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.20.0
I0612 21:37:55.145615 5540 image.go:177] daemon lookup for registry.k8s.io/etcd:3.4.13-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.4.13-0
I0612 21:37:55.153622 5540 image.go:177] daemon lookup for registry.k8s.io/kube-proxy:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.20.0
W0612 21:37:55.255071 5540 image.go:187] authn lookup for gcr.io/k8s-minikube/storage-provisioner:v5 (trying anon): error getting credentials - err: exit status 1, out: `error getting credentials - err: exit status 1, out: `A specified logon session does not exist. It may already have been terminated.``
W0612 21:37:55.366602 5540 image.go:187] authn lookup for registry.k8s.io/kube-controller-manager:v1.20.0 (trying anon): error getting credentials - err: exit status 1, out: `error getting credentials - err: exit status 1, out: `A specified logon session does not exist. It may already have been terminated.``
W0612 21:37:55.477607 5540 image.go:187] authn lookup for registry.k8s.io/pause:3.2 (trying anon): error getting credentials - err: exit status 1, out: `error getting credentials - err: exit status 1, out: `A specified logon session does not exist. It may already have been terminated.``
W0612 21:37:55.591580 5540 image.go:187] authn lookup for registry.k8s.io/coredns:1.7.0 (trying anon): error getting credentials - err: exit status 1, out: `error getting credentials - err: exit status 1, out: `A specified logon session does not exist. It may already have been terminated.``
I0612 21:37:55.616849 5540 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} gcr.io/k8s-minikube/storage-provisioner:v5
W0612 21:37:55.702944 5540 image.go:187] authn lookup for registry.k8s.io/kube-apiserver:v1.20.0 (trying anon): error getting credentials - err: exit status 1, out: `error getting credentials - err: exit status 1, out: `A specified logon session does not exist. It may already have been terminated.``
I0612 21:37:55.768018 5540 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/kube-controller-manager:v1.20.0
I0612 21:37:55.791021 5540 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/pause:3.2
I0612 21:37:55.827017 5540 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/coredns:1.7.0
I0612 21:37:55.829022 5540 cache_images.go:116] "registry.k8s.io/kube-controller-manager:v1.20.0" needs transfer: "registry.k8s.io/kube-controller-manager:v1.20.0" does not exist at hash "b9fa1895dcaa6d3dd241d6d9340e939ca30fc0946464ec9f205a8cbe738a8080" in container runtime
I0612 21:37:55.829022 5540 localpath.go:146] windows sanitize: C:\Users\jenkins.minikube4\minikube-integration\.minikube\cache\images\amd64\registry.k8s.io\kube-controller-manager:v1.20.0 -> C:\Users\jenkins.minikube4\minikube-integration\.minikube\cache\images\amd64\registry.k8s.io\kube-controller-manager_v1.20.0
I0612 21:37:55.829022 5540 docker.go:337] Removing image: registry.k8s.io/kube-controller-manager:v1.20.0
I0612 21:37:55.841017 5540 ssh_runner.go:195] Run: docker rmi registry.k8s.io/kube-controller-manager:v1.20.0
W0612 21:37:55.845027 5540 image.go:187] authn lookup for registry.k8s.io/kube-scheduler:v1.20.0 (trying anon): error getting credentials - err: exit status 1, out: `error getting credentials - err: exit status 1, out: `A specified logon session does not exist. It may already have been terminated.``
I0612 21:37:55.856022 5540 cache_images.go:116] "registry.k8s.io/pause:3.2" needs transfer: "registry.k8s.io/pause:3.2" does not exist at hash "80d28bedfe5dec59da9ebf8e6260224ac9008ab5c11dbbe16ee3ba3e4439ac2c" in container runtime
I0612 21:37:55.856022 5540 localpath.go:146] windows sanitize: C:\Users\jenkins.minikube4\minikube-integration\.minikube\cache\images\amd64\registry.k8s.io\pause:3.2 -> C:\Users\jenkins.minikube4\minikube-integration\.minikube\cache\images\amd64\registry.k8s.io\pause_3.2
I0612 21:37:55.856022 5540 docker.go:337] Removing image: registry.k8s.io/pause:3.2
I0612 21:37:55.871023 5540 ssh_runner.go:195] Run: docker rmi registry.k8s.io/pause:3.2
I0612 21:37:55.902294 5540 cache_images.go:116] "registry.k8s.io/coredns:1.7.0" needs transfer: "registry.k8s.io/coredns:1.7.0" does not exist at hash "bfe3a36ebd2528b454be6aebece806db5b40407b833e2af9617bf39afaff8c16" in container runtime
I0612 21:37:55.902425 5540 localpath.go:146] windows sanitize: C:\Users\jenkins.minikube4\minikube-integration\.minikube\cache\images\amd64\registry.k8s.io\coredns:1.7.0 -> C:\Users\jenkins.minikube4\minikube-integration\.minikube\cache\images\amd64\registry.k8s.io\coredns_1.7.0
I0612 21:37:55.902552 5540 docker.go:337] Removing image: registry.k8s.io/coredns:1.7.0
I0612 21:37:55.910366 5540 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/kube-apiserver:v1.20.0
I0612 21:37:55.918170 5540 cache_images.go:286] Loading image from: C:\Users\jenkins.minikube4\minikube-integration\.minikube\cache\images\amd64\registry.k8s.io\kube-controller-manager_v1.20.0
I0612 21:37:55.921171 5540 ssh_runner.go:195] Run: docker rmi registry.k8s.io/coredns:1.7.0
W0612 21:37:55.951160 5540 image.go:187] authn lookup for registry.k8s.io/etcd:3.4.13-0 (trying anon): error getting credentials - err: exit status 1, out: `error getting credentials - err: exit status 1, out: `A specified logon session does not exist. It may already have been terminated.``
I0612 21:37:56.000779 5540 cache_images.go:286] Loading image from: C:\Users\jenkins.minikube4\minikube-integration\.minikube\cache\images\amd64\registry.k8s.io\pause_3.2
I0612 21:37:56.000779 5540 cache_images.go:116] "registry.k8s.io/kube-apiserver:v1.20.0" needs transfer: "registry.k8s.io/kube-apiserver:v1.20.0" does not exist at hash "ca9843d3b545457f24b012d6d579ba85f132f2406aa171ad84d53caa55e5de99" in container runtime
I0612 21:37:56.001369 5540 localpath.go:146] windows sanitize: C:\Users\jenkins.minikube4\minikube-integration\.minikube\cache\images\amd64\registry.k8s.io\kube-apiserver:v1.20.0 -> C:\Users\jenkins.minikube4\minikube-integration\.minikube\cache\images\amd64\registry.k8s.io\kube-apiserver_v1.20.0
I0612 21:37:56.001369 5540 docker.go:337] Removing image: registry.k8s.io/kube-apiserver:v1.20.0
I0612 21:37:56.010144 5540 cache_images.go:286] Loading image from: C:\Users\jenkins.minikube4\minikube-integration\.minikube\cache\images\amd64\registry.k8s.io\coredns_1.7.0
I0612 21:37:56.024155 5540 ssh_runner.go:195] Run: docker rmi registry.k8s.io/kube-apiserver:v1.20.0
I0612 21:37:56.040139 5540 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/kube-scheduler:v1.20.0
I0612 21:37:56.070132 5540 cache_images.go:286] Loading image from: C:\Users\jenkins.minikube4\minikube-integration\.minikube\cache\images\amd64\registry.k8s.io\kube-apiserver_v1.20.0
W0612 21:37:56.077132 5540 image.go:187] authn lookup for registry.k8s.io/kube-proxy:v1.20.0 (trying anon): error getting credentials - err: exit status 1, out: `error getting credentials - err: exit status 1, out: `A specified logon session does not exist. It may already have been terminated.``
I0612 21:37:56.087165 5540 cache_images.go:116] "registry.k8s.io/kube-scheduler:v1.20.0" needs transfer: "registry.k8s.io/kube-scheduler:v1.20.0" does not exist at hash "3138b6e3d471224fd516f758f3b53309219bcb6824e07686b3cd60d78012c899" in container runtime
I0612 21:37:56.087165 5540 localpath.go:146] windows sanitize: C:\Users\jenkins.minikube4\minikube-integration\.minikube\cache\images\amd64\registry.k8s.io\kube-scheduler:v1.20.0 -> C:\Users\jenkins.minikube4\minikube-integration\.minikube\cache\images\amd64\registry.k8s.io\kube-scheduler_v1.20.0
I0612 21:37:56.087165 5540 docker.go:337] Removing image: registry.k8s.io/kube-scheduler:v1.20.0
I0612 21:37:56.105127 5540 ssh_runner.go:195] Run: docker rmi registry.k8s.io/kube-scheduler:v1.20.0
I0612 21:37:56.136731 5540 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/etcd:3.4.13-0
I0612 21:37:56.151746 5540 cache_images.go:286] Loading image from: C:\Users\jenkins.minikube4\minikube-integration\.minikube\cache\images\amd64\registry.k8s.io\kube-scheduler_v1.20.0
I0612 21:37:56.191992 5540 cache_images.go:116] "registry.k8s.io/etcd:3.4.13-0" needs transfer: "registry.k8s.io/etcd:3.4.13-0" does not exist at hash "0369cf4303ffdb467dc219990960a9baa8512a54b0ad9283eaf55bd6c0adb934" in container runtime
I0612 21:37:56.191992 5540 localpath.go:146] windows sanitize: C:\Users\jenkins.minikube4\minikube-integration\.minikube\cache\images\amd64\registry.k8s.io\etcd:3.4.13-0 -> C:\Users\jenkins.minikube4\minikube-integration\.minikube\cache\images\amd64\registry.k8s.io\etcd_3.4.13-0
I0612 21:37:56.191992 5540 docker.go:337] Removing image: registry.k8s.io/etcd:3.4.13-0
I0612 21:37:56.215290 5540 ssh_runner.go:195] Run: docker rmi registry.k8s.io/etcd:3.4.13-0
I0612 21:37:56.270093 5540 cache_images.go:286] Loading image from: C:\Users\jenkins.minikube4\minikube-integration\.minikube\cache\images\amd64\registry.k8s.io\etcd_3.4.13-0
I0612 21:37:56.294111 5540 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/kube-proxy:v1.20.0
I0612 21:37:56.341489 5540 cache_images.go:116] "registry.k8s.io/kube-proxy:v1.20.0" needs transfer: "registry.k8s.io/kube-proxy:v1.20.0" does not exist at hash "10cc881966cfd9287656c2fce1f144625602653d1e8b011487a7a71feb100bdc" in container runtime
I0612 21:37:56.341489 5540 localpath.go:146] windows sanitize: C:\Users\jenkins.minikube4\minikube-integration\.minikube\cache\images\amd64\registry.k8s.io\kube-proxy:v1.20.0 -> C:\Users\jenkins.minikube4\minikube-integration\.minikube\cache\images\amd64\registry.k8s.io\kube-proxy_v1.20.0
I0612 21:37:56.341489 5540 docker.go:337] Removing image: registry.k8s.io/kube-proxy:v1.20.0
I0612 21:37:56.351482 5540 ssh_runner.go:195] Run: docker rmi registry.k8s.io/kube-proxy:v1.20.0
I0612 21:37:56.399529 5540 cache_images.go:286] Loading image from: C:\Users\jenkins.minikube4\minikube-integration\.minikube\cache\images\amd64\registry.k8s.io\kube-proxy_v1.20.0
I0612 21:37:56.399529 5540 cache_images.go:92] duration metric: took 1.3159784s to LoadCachedImages
W0612 21:37:56.399529 5540 out.go:239] X Unable to load cached images: loading cached images: CreateFile C:\Users\jenkins.minikube4\minikube-integration\.minikube\cache\images\amd64\registry.k8s.io\kube-controller-manager_v1.20.0: The system cannot find the file specified.
X Unable to load cached images: loading cached images: CreateFile C:\Users\jenkins.minikube4\minikube-integration\.minikube\cache\images\amd64\registry.k8s.io\kube-controller-manager_v1.20.0: The system cannot find the file specified.
I0612 21:37:56.399529 5540 kubeadm.go:928] updating node { 192.168.76.2 8443 v1.20.0 docker true true} ...
I0612 21:37:56.399529 5540 kubeadm.go:940] kubelet [Unit]
Wants=docker.socket
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.20.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=docker --hostname-override=old-k8s-version-606600 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.76.2
[Install]
config:
{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-606600 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0612 21:37:56.418598 5540 ssh_runner.go:195] Run: docker info --format {{.CgroupDriver}}
I0612 21:37:56.559012 5540 cni.go:84] Creating CNI manager for ""
I0612 21:37:56.559012 5540 cni.go:162] CNI unnecessary in this configuration, recommending no CNI
I0612 21:37:56.559012 5540 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0612 21:37:56.559012 5540 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.76.2 APIServerPort:8443 KubernetesVersion:v1.20.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-606600 NodeName:old-k8s-version-606600 DNSDomain:cluster.local CRISocket:/var/run/dockershim.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.76.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.76.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticP
odPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
I0612 21:37:56.559987 5540 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta2
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.76.2
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /var/run/dockershim.sock
name: "old-k8s-version-606600"
kubeletExtraArgs:
node-ip: 192.168.76.2
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta2
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.76.2"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.20.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0612 21:37:56.572694 5540 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.20.0
I0612 21:37:56.606992 5540 binaries.go:44] Found k8s binaries, skipping transfer
I0612 21:37:56.635350 5540 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0612 21:37:56.655363 5540 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (348 bytes)
I0612 21:37:56.706250 5540 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0612 21:37:56.748684 5540 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2118 bytes)
I0612 21:37:56.821110 5540 ssh_runner.go:195] Run: grep 192.168.76.2 control-plane.minikube.internal$ /etc/hosts
I0612 21:37:56.836581 5540 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.76.2 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0612 21:37:56.868441 5540 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0612 21:37:57.070827 5540 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0612 21:37:57.118299 5540 certs.go:68] Setting up C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\old-k8s-version-606600 for IP: 192.168.76.2
I0612 21:37:57.118299 5540 certs.go:194] generating shared ca certs ...
I0612 21:37:57.118299 5540 certs.go:226] acquiring lock for ca certs: {Name:mk92285f7546e1a5b3c3b23dab6135aa5a99cd14 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0612 21:37:57.119288 5540 certs.go:235] skipping valid "minikubeCA" ca cert: C:\Users\jenkins.minikube4\minikube-integration\.minikube\ca.key
I0612 21:37:57.119288 5540 certs.go:235] skipping valid "proxyClientCA" ca cert: C:\Users\jenkins.minikube4\minikube-integration\.minikube\proxy-client-ca.key
I0612 21:37:57.119288 5540 certs.go:256] generating profile certs ...
I0612 21:37:57.120281 5540 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\old-k8s-version-606600\client.key
I0612 21:37:57.120281 5540 certs.go:359] skipping valid signed profile cert regeneration for "minikube": C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\old-k8s-version-606600\apiserver.key.57aa1d39
I0612 21:37:57.121292 5540 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\old-k8s-version-606600\proxy-client.key
I0612 21:37:57.123294 5540 certs.go:484] found cert: C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\6000.pem (1338 bytes)
W0612 21:37:57.123294 5540 certs.go:480] ignoring C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\6000_empty.pem, impossibly tiny 0 bytes
I0612 21:37:57.124288 5540 certs.go:484] found cert: C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\ca-key.pem (1679 bytes)
I0612 21:37:57.124288 5540 certs.go:484] found cert: C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\ca.pem (1082 bytes)
I0612 21:37:57.124288 5540 certs.go:484] found cert: C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\cert.pem (1123 bytes)
I0612 21:37:57.125302 5540 certs.go:484] found cert: C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\key.pem (1679 bytes)
I0612 21:37:57.125302 5540 certs.go:484] found cert: C:\Users\jenkins.minikube4\minikube-integration\.minikube\files\etc\ssl\certs\60002.pem (1708 bytes)
I0612 21:37:57.126292 5540 ssh_runner.go:362] scp C:\Users\jenkins.minikube4\minikube-integration\.minikube\ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0612 21:37:57.199628 5540 ssh_runner.go:362] scp C:\Users\jenkins.minikube4\minikube-integration\.minikube\ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
I0612 21:37:57.255630 5540 ssh_runner.go:362] scp C:\Users\jenkins.minikube4\minikube-integration\.minikube\proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0612 21:37:57.411713 5540 ssh_runner.go:362] scp C:\Users\jenkins.minikube4\minikube-integration\.minikube\proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I0612 21:37:57.502682 5540 ssh_runner.go:362] scp C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\old-k8s-version-606600\apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
I0612 21:37:57.630680 5540 ssh_runner.go:362] scp C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\old-k8s-version-606600\apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I0612 21:37:57.720681 5540 ssh_runner.go:362] scp C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\old-k8s-version-606600\proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0612 21:37:57.825688 5540 ssh_runner.go:362] scp C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\old-k8s-version-606600\proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
I0612 21:37:57.930823 5540 ssh_runner.go:362] scp C:\Users\jenkins.minikube4\minikube-integration\.minikube\files\etc\ssl\certs\60002.pem --> /usr/share/ca-certificates/60002.pem (1708 bytes)
I0612 21:37:57.999982 5540 ssh_runner.go:362] scp C:\Users\jenkins.minikube4\minikube-integration\.minikube\ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0612 21:37:58.091972 5540 ssh_runner.go:362] scp C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\6000.pem --> /usr/share/ca-certificates/6000.pem (1338 bytes)
I0612 21:37:58.218129 5540 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0612 21:37:58.454978 5540 ssh_runner.go:195] Run: openssl version
I0612 21:37:58.521980 5540 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/6000.pem && ln -fs /usr/share/ca-certificates/6000.pem /etc/ssl/certs/6000.pem"
I0612 21:37:58.613981 5540 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/6000.pem
I0612 21:37:58.632994 5540 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Jun 12 20:25 /usr/share/ca-certificates/6000.pem
I0612 21:37:58.657037 5540 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/6000.pem
I0612 21:37:58.731001 5540 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/6000.pem /etc/ssl/certs/51391683.0"
I0612 21:37:58.829992 5540 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/60002.pem && ln -fs /usr/share/ca-certificates/60002.pem /etc/ssl/certs/60002.pem"
I0612 21:37:58.926020 5540 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/60002.pem
I0612 21:37:59.004515 5540 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Jun 12 20:25 /usr/share/ca-certificates/60002.pem
I0612 21:37:59.030531 5540 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/60002.pem
I0612 21:37:59.125535 5540 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/60002.pem /etc/ssl/certs/3ec20f2e.0"
I0612 21:37:59.238534 5540 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0612 21:37:59.344105 5540 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0612 21:37:59.395699 5540 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Jun 12 20:14 /usr/share/ca-certificates/minikubeCA.pem
I0612 21:37:59.419718 5540 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0612 21:37:59.465685 5540 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0612 21:37:59.542953 5540 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0612 21:37:59.617951 5540 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-etcd-client.crt -checkend 86400
I0612 21:37:59.674559 5540 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-kubelet-client.crt -checkend 86400
I0612 21:37:59.718545 5540 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/server.crt -checkend 86400
I0612 21:37:59.762551 5540 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/healthcheck-client.crt -checkend 86400
I0612 21:37:59.832556 5540 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/peer.crt -checkend 86400
I0612 21:37:59.925579 5540 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/front-proxy-client.crt -checkend 86400
I0612 21:37:59.986571 5540 kubeadm.go:391] StartCluster: {Name:old-k8s-version-606600 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1717668449-19038@sha256:30d191eb345232f513c52f7ac036e7a34a8cc441d88353f92985384bcddf00d6 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-606600 Namespace:default APIServerHAVIP: APIServerName:minikube
CA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:C:\Users\jenkin
s.minikube4:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0612 21:38:00.008559 5540 ssh_runner.go:195] Run: docker ps --filter status=paused --filter=name=k8s_.*_(kube-system)_ --format={{.ID}}
I0612 21:38:00.249585 5540 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
W0612 21:38:00.388594 5540 kubeadm.go:404] apiserver tunnel failed: apiserver port not set
I0612 21:38:00.388594 5540 kubeadm.go:407] found existing configuration files, will attempt cluster restart
I0612 21:38:00.388594 5540 kubeadm.go:587] restartPrimaryControlPlane start ...
I0612 21:38:00.414795 5540 ssh_runner.go:195] Run: sudo test -d /data/minikube
I0612 21:38:00.590297 5540 kubeadm.go:129] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1
stdout:
stderr:
I0612 21:38:00.610306 5540 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "8443/tcp") 0).HostPort}}'" old-k8s-version-606600
I0612 21:38:00.931272 5540 kubeconfig.go:47] verify endpoint returned: get endpoint: "old-k8s-version-606600" does not appear in C:\Users\jenkins.minikube4\minikube-integration\kubeconfig
I0612 21:38:00.933307 5540 kubeconfig.go:62] C:\Users\jenkins.minikube4\minikube-integration\kubeconfig needs updating (will repair): [kubeconfig missing "old-k8s-version-606600" cluster setting kubeconfig missing "old-k8s-version-606600" context setting]
I0612 21:38:00.935281 5540 lock.go:35] WriteFile acquiring C:\Users\jenkins.minikube4\minikube-integration\kubeconfig: {Name:mk97c09b788e5010ffd4c9dd9525f9245d5edd25 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0612 21:38:00.982274 5540 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new
I0612 21:38:01.010288 5540 kubeadm.go:624] The running cluster does not require reconfiguration: 127.0.0.1
I0612 21:38:01.010288 5540 kubeadm.go:591] duration metric: took 621.6659ms to restartPrimaryControlPlane
I0612 21:38:01.011321 5540 kubeadm.go:393] duration metric: took 1.0247029s to StartCluster
I0612 21:38:01.011321 5540 settings.go:142] acquiring lock: {Name:mk5d8710830d010adb6db61f855b0ef766a8622c Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0612 21:38:01.011321 5540 settings.go:150] Updating kubeconfig: C:\Users\jenkins.minikube4\minikube-integration\kubeconfig
I0612 21:38:01.016285 5540 lock.go:35] WriteFile acquiring C:\Users\jenkins.minikube4\minikube-integration\kubeconfig: {Name:mk97c09b788e5010ffd4c9dd9525f9245d5edd25 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0612 21:38:01.018300 5540 start.go:234] Will wait 6m0s for node &{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:docker ControlPlane:true Worker:true}
I0612 21:38:01.022307 5540 out.go:177] * Verifying Kubernetes components...
I0612 21:38:01.018300 5540 addons.go:507] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:true default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false]
I0612 21:38:01.018300 5540 config.go:182] Loaded profile config "old-k8s-version-606600": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.20.0
I0612 21:38:01.031286 5540 addons.go:69] Setting storage-provisioner=true in profile "old-k8s-version-606600"
I0612 21:38:01.031286 5540 addons.go:69] Setting default-storageclass=true in profile "old-k8s-version-606600"
I0612 21:38:01.031286 5540 addons.go:234] Setting addon storage-provisioner=true in "old-k8s-version-606600"
W0612 21:38:01.031286 5540 addons.go:243] addon storage-provisioner should already be in state true
I0612 21:38:01.031286 5540 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "old-k8s-version-606600"
I0612 21:38:01.031286 5540 host.go:66] Checking if "old-k8s-version-606600" exists ...
I0612 21:38:01.031286 5540 addons.go:69] Setting metrics-server=true in profile "old-k8s-version-606600"
I0612 21:38:01.031286 5540 addons.go:69] Setting dashboard=true in profile "old-k8s-version-606600"
I0612 21:38:01.032311 5540 addons.go:234] Setting addon dashboard=true in "old-k8s-version-606600"
I0612 21:38:01.032311 5540 addons.go:234] Setting addon metrics-server=true in "old-k8s-version-606600"
W0612 21:38:01.032311 5540 addons.go:243] addon metrics-server should already be in state true
W0612 21:38:01.032311 5540 addons.go:243] addon dashboard should already be in state true
I0612 21:38:01.032311 5540 host.go:66] Checking if "old-k8s-version-606600" exists ...
I0612 21:38:01.032311 5540 host.go:66] Checking if "old-k8s-version-606600" exists ...
I0612 21:38:01.061302 5540 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0612 21:38:01.075287 5540 cli_runner.go:164] Run: docker container inspect old-k8s-version-606600 --format={{.State.Status}}
I0612 21:38:01.076297 5540 cli_runner.go:164] Run: docker container inspect old-k8s-version-606600 --format={{.State.Status}}
I0612 21:38:01.077288 5540 cli_runner.go:164] Run: docker container inspect old-k8s-version-606600 --format={{.State.Status}}
I0612 21:38:01.078309 5540 cli_runner.go:164] Run: docker container inspect old-k8s-version-606600 --format={{.State.Status}}
I0612 21:38:01.384663 5540 out.go:177] - Using image registry.k8s.io/echoserver:1.4
I0612 21:38:01.390659 5540 out.go:177] - Using image docker.io/kubernetesui/dashboard:v2.7.0
I0612 21:38:01.397644 5540 addons.go:431] installing /etc/kubernetes/addons/dashboard-ns.yaml
I0612 21:38:01.397644 5540 ssh_runner.go:362] scp dashboard/dashboard-ns.yaml --> /etc/kubernetes/addons/dashboard-ns.yaml (759 bytes)
I0612 21:38:01.407676 5540 addons.go:234] Setting addon default-storageclass=true in "old-k8s-version-606600"
W0612 21:38:01.407676 5540 addons.go:243] addon default-storageclass should already be in state true
I0612 21:38:01.407676 5540 host.go:66] Checking if "old-k8s-version-606600" exists ...
I0612 21:38:01.422270 5540 out.go:177] - Using image fake.domain/registry.k8s.io/echoserver:1.4
I0612 21:38:01.418273 5540 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-606600
I0612 21:38:01.426268 5540 addons.go:431] installing /etc/kubernetes/addons/metrics-apiservice.yaml
I0612 21:38:01.426268 5540 ssh_runner.go:362] scp metrics-server/metrics-apiservice.yaml --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)
I0612 21:38:01.448265 5540 out.go:177] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
I0612 21:38:01.446270 5540 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-606600
I0612 21:38:01.450262 5540 addons.go:431] installing /etc/kubernetes/addons/storage-provisioner.yaml
I0612 21:38:01.450262 5540 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I0612 21:38:01.455266 5540 cli_runner.go:164] Run: docker container inspect old-k8s-version-606600 --format={{.State.Status}}
I0612 21:38:01.468298 5540 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-606600
I0612 21:38:01.731638 5540 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:55192 SSHKeyPath:C:\Users\jenkins.minikube4\minikube-integration\.minikube\machines\old-k8s-version-606600\id_rsa Username:docker}
I0612 21:38:01.762040 5540 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:55192 SSHKeyPath:C:\Users\jenkins.minikube4\minikube-integration\.minikube\machines\old-k8s-version-606600\id_rsa Username:docker}
I0612 21:38:01.776040 5540 addons.go:431] installing /etc/kubernetes/addons/storageclass.yaml
I0612 21:38:01.776040 5540 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I0612 21:38:01.793709 5540 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-606600
I0612 21:38:01.799348 5540 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:55192 SSHKeyPath:C:\Users\jenkins.minikube4\minikube-integration\.minikube\machines\old-k8s-version-606600\id_rsa Username:docker}
I0612 21:38:01.822358 5540 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0612 21:38:02.060750 5540 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:55192 SSHKeyPath:C:\Users\jenkins.minikube4\minikube-integration\.minikube\machines\old-k8s-version-606600\id_rsa Username:docker}
I0612 21:38:02.116353 5540 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "8443/tcp") 0).HostPort}}'" old-k8s-version-606600
I0612 21:38:02.357023 5540 node_ready.go:35] waiting up to 6m0s for node "old-k8s-version-606600" to be "Ready" ...
I0612 21:38:02.590058 5540 addons.go:431] installing /etc/kubernetes/addons/dashboard-clusterrole.yaml
I0612 21:38:02.590058 5540 ssh_runner.go:362] scp dashboard/dashboard-clusterrole.yaml --> /etc/kubernetes/addons/dashboard-clusterrole.yaml (1001 bytes)
I0612 21:38:02.602058 5540 addons.go:431] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
I0612 21:38:02.602058 5540 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1825 bytes)
I0612 21:38:02.713021 5540 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I0612 21:38:02.725023 5540 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
I0612 21:38:02.903049 5540 addons.go:431] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
I0612 21:38:02.903049 5540 ssh_runner.go:362] scp metrics-server/metrics-server-rbac.yaml --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)
I0612 21:38:02.989276 5540 addons.go:431] installing /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml
I0612 21:38:02.989276 5540 ssh_runner.go:362] scp dashboard/dashboard-clusterrolebinding.yaml --> /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml (1018 bytes)
I0612 21:38:03.198411 5540 addons.go:431] installing /etc/kubernetes/addons/metrics-server-service.yaml
I0612 21:38:03.198411 5540 ssh_runner.go:362] scp metrics-server/metrics-server-service.yaml --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)
I0612 21:38:03.290005 5540 addons.go:431] installing /etc/kubernetes/addons/dashboard-configmap.yaml
I0612 21:38:03.290005 5540 ssh_runner.go:362] scp dashboard/dashboard-configmap.yaml --> /etc/kubernetes/addons/dashboard-configmap.yaml (837 bytes)
I0612 21:38:03.419003 5540 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0612 21:38:03.588800 5540 addons.go:431] installing /etc/kubernetes/addons/dashboard-dp.yaml
I0612 21:38:03.588800 5540 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-dp.yaml (4201 bytes)
I0612 21:38:03.889077 5540 addons.go:431] installing /etc/kubernetes/addons/dashboard-role.yaml
I0612 21:38:03.889077 5540 ssh_runner.go:362] scp dashboard/dashboard-role.yaml --> /etc/kubernetes/addons/dashboard-role.yaml (1724 bytes)
I0612 21:38:04.085946 5540 addons.go:431] installing /etc/kubernetes/addons/dashboard-rolebinding.yaml
I0612 21:38:04.086097 5540 ssh_runner.go:362] scp dashboard/dashboard-rolebinding.yaml --> /etc/kubernetes/addons/dashboard-rolebinding.yaml (1046 bytes)
I0612 21:38:04.206693 5540 addons.go:431] installing /etc/kubernetes/addons/dashboard-sa.yaml
I0612 21:38:04.206693 5540 ssh_runner.go:362] scp dashboard/dashboard-sa.yaml --> /etc/kubernetes/addons/dashboard-sa.yaml (837 bytes)
I0612 21:38:04.399743 5540 addons.go:431] installing /etc/kubernetes/addons/dashboard-secret.yaml
I0612 21:38:04.399743 5540 ssh_runner.go:362] scp dashboard/dashboard-secret.yaml --> /etc/kubernetes/addons/dashboard-secret.yaml (1389 bytes)
I0612 21:38:04.601993 5540 addons.go:431] installing /etc/kubernetes/addons/dashboard-svc.yaml
I0612 21:38:04.601993 5540 ssh_runner.go:362] scp dashboard/dashboard-svc.yaml --> /etc/kubernetes/addons/dashboard-svc.yaml (1294 bytes)
I0612 21:38:04.726720 5540 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
I0612 21:38:12.091700 5540 node_ready.go:49] node "old-k8s-version-606600" has status "Ready":"True"
I0612 21:38:12.091700 5540 node_ready.go:38] duration metric: took 9.7342265s for node "old-k8s-version-606600" to be "Ready" ...
I0612 21:38:12.091700 5540 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0612 21:38:12.400713 5540 pod_ready.go:78] waiting up to 6m0s for pod "coredns-74ff55c5b-xnpzv" in "kube-system" namespace to be "Ready" ...
I0612 21:38:12.689040 5540 pod_ready.go:92] pod "coredns-74ff55c5b-xnpzv" in "kube-system" namespace has status "Ready":"True"
I0612 21:38:12.689155 5540 pod_ready.go:81] duration metric: took 288.4283ms for pod "coredns-74ff55c5b-xnpzv" in "kube-system" namespace to be "Ready" ...
I0612 21:38:12.689155 5540 pod_ready.go:78] waiting up to 6m0s for pod "etcd-old-k8s-version-606600" in "kube-system" namespace to be "Ready" ...
I0612 21:38:14.289794 5540 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: (11.5642356s)
I0612 21:38:14.797973 5540 pod_ready.go:102] pod "etcd-old-k8s-version-606600" in "kube-system" namespace has status "Ready":"False"
I0612 21:38:15.088942 5540 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: (12.3753479s)
I0612 21:38:15.399530 5540 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (11.9799728s)
I0612 21:38:15.399530 5540 addons.go:475] Verifying addon metrics-server=true in "old-k8s-version-606600"
I0612 21:38:15.787251 5540 pod_ready.go:92] pod "etcd-old-k8s-version-606600" in "kube-system" namespace has status "Ready":"True"
I0612 21:38:15.787370 5540 pod_ready.go:81] duration metric: took 3.0979533s for pod "etcd-old-k8s-version-606600" in "kube-system" namespace to be "Ready" ...
I0612 21:38:15.787405 5540 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-old-k8s-version-606600" in "kube-system" namespace to be "Ready" ...
I0612 21:38:17.097681 5540 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: (12.3703877s)
I0612 21:38:17.099686 5540 out.go:177] * Some dashboard features require the metrics-server addon. To enable all features please run:
minikube -p old-k8s-version-606600 addons enable metrics-server
I0612 21:38:17.107684 5540 out.go:177] * Enabled addons: default-storageclass, storage-provisioner, metrics-server, dashboard
I0612 21:38:17.117687 5540 addons.go:510] duration metric: took 16.0986413s for enable addons: enabled=[default-storageclass storage-provisioner metrics-server dashboard]
I0612 21:38:17.888859 5540 pod_ready.go:102] pod "kube-apiserver-old-k8s-version-606600" in "kube-system" namespace has status "Ready":"False"
I0612 21:38:20.314928 5540 pod_ready.go:102] pod "kube-apiserver-old-k8s-version-606600" in "kube-system" namespace has status "Ready":"False"
I0612 21:38:22.316117 5540 pod_ready.go:102] pod "kube-apiserver-old-k8s-version-606600" in "kube-system" namespace has status "Ready":"False"
I0612 21:38:23.314079 5540 pod_ready.go:92] pod "kube-apiserver-old-k8s-version-606600" in "kube-system" namespace has status "Ready":"True"
I0612 21:38:23.314079 5540 pod_ready.go:81] duration metric: took 7.5263263s for pod "kube-apiserver-old-k8s-version-606600" in "kube-system" namespace to be "Ready" ...
I0612 21:38:23.314079 5540 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-old-k8s-version-606600" in "kube-system" namespace to be "Ready" ...
I0612 21:38:25.337506 5540 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-606600" in "kube-system" namespace has status "Ready":"False"
I0612 21:38:27.343566 5540 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-606600" in "kube-system" namespace has status "Ready":"False"
I0612 21:38:29.838621 5540 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-606600" in "kube-system" namespace has status "Ready":"False"
I0612 21:38:31.839734 5540 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-606600" in "kube-system" namespace has status "Ready":"False"
I0612 21:38:33.985221 5540 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-606600" in "kube-system" namespace has status "Ready":"False"
I0612 21:38:36.382873 5540 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-606600" in "kube-system" namespace has status "Ready":"False"
I0612 21:38:38.844747 5540 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-606600" in "kube-system" namespace has status "Ready":"False"
I0612 21:38:41.343734 5540 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-606600" in "kube-system" namespace has status "Ready":"False"
I0612 21:38:43.839668 5540 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-606600" in "kube-system" namespace has status "Ready":"False"
I0612 21:38:46.334627 5540 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-606600" in "kube-system" namespace has status "Ready":"False"
I0612 21:38:48.834149 5540 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-606600" in "kube-system" namespace has status "Ready":"False"
I0612 21:38:51.508352 5540 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-606600" in "kube-system" namespace has status "Ready":"False"
I0612 21:38:53.884099 5540 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-606600" in "kube-system" namespace has status "Ready":"False"
I0612 21:38:55.891385 5540 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-606600" in "kube-system" namespace has status "Ready":"False"
I0612 21:38:58.334453 5540 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-606600" in "kube-system" namespace has status "Ready":"False"
I0612 21:39:00.401706 5540 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-606600" in "kube-system" namespace has status "Ready":"False"
I0612 21:39:02.843338 5540 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-606600" in "kube-system" namespace has status "Ready":"False"
I0612 21:39:04.849788 5540 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-606600" in "kube-system" namespace has status "Ready":"False"
I0612 21:39:07.344225 5540 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-606600" in "kube-system" namespace has status "Ready":"False"
I0612 21:39:09.850095 5540 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-606600" in "kube-system" namespace has status "Ready":"False"
I0612 21:39:12.355485 5540 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-606600" in "kube-system" namespace has status "Ready":"False"
I0612 21:39:14.844521 5540 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-606600" in "kube-system" namespace has status "Ready":"False"
I0612 21:39:17.348927 5540 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-606600" in "kube-system" namespace has status "Ready":"False"
I0612 21:39:19.840159 5540 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-606600" in "kube-system" namespace has status "Ready":"False"
I0612 21:39:22.347155 5540 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-606600" in "kube-system" namespace has status "Ready":"False"
I0612 21:39:24.842352 5540 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-606600" in "kube-system" namespace has status "Ready":"False"
I0612 21:39:26.843478 5540 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-606600" in "kube-system" namespace has status "Ready":"False"
I0612 21:39:29.337993 5540 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-606600" in "kube-system" namespace has status "Ready":"False"
I0612 21:39:31.347685 5540 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-606600" in "kube-system" namespace has status "Ready":"False"
I0612 21:39:33.842177 5540 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-606600" in "kube-system" namespace has status "Ready":"False"
I0612 21:39:36.338668 5540 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-606600" in "kube-system" namespace has status "Ready":"False"
I0612 21:39:37.347130 5540 pod_ready.go:92] pod "kube-controller-manager-old-k8s-version-606600" in "kube-system" namespace has status "Ready":"True"
I0612 21:39:37.347130 5540 pod_ready.go:81] duration metric: took 1m14.0296077s for pod "kube-controller-manager-old-k8s-version-606600" in "kube-system" namespace to be "Ready" ...
I0612 21:39:37.347666 5540 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-lrbxz" in "kube-system" namespace to be "Ready" ...
I0612 21:39:37.359583 5540 pod_ready.go:92] pod "kube-proxy-lrbxz" in "kube-system" namespace has status "Ready":"True"
I0612 21:39:37.359583 5540 pod_ready.go:81] duration metric: took 11.9163ms for pod "kube-proxy-lrbxz" in "kube-system" namespace to be "Ready" ...
I0612 21:39:37.359661 5540 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-old-k8s-version-606600" in "kube-system" namespace to be "Ready" ...
I0612 21:39:37.373484 5540 pod_ready.go:92] pod "kube-scheduler-old-k8s-version-606600" in "kube-system" namespace has status "Ready":"True"
I0612 21:39:37.373484 5540 pod_ready.go:81] duration metric: took 13.8223ms for pod "kube-scheduler-old-k8s-version-606600" in "kube-system" namespace to be "Ready" ...
I0612 21:39:37.373484 5540 pod_ready.go:78] waiting up to 6m0s for pod "metrics-server-9975d5f86-ltrjr" in "kube-system" namespace to be "Ready" ...
I0612 21:39:39.391717 5540 pod_ready.go:102] pod "metrics-server-9975d5f86-ltrjr" in "kube-system" namespace has status "Ready":"False"
I0612 21:39:41.402179 5540 pod_ready.go:102] pod "metrics-server-9975d5f86-ltrjr" in "kube-system" namespace has status "Ready":"False"
I0612 21:39:43.890906 5540 pod_ready.go:102] pod "metrics-server-9975d5f86-ltrjr" in "kube-system" namespace has status "Ready":"False"
I0612 21:39:45.891516 5540 pod_ready.go:102] pod "metrics-server-9975d5f86-ltrjr" in "kube-system" namespace has status "Ready":"False"
I0612 21:39:48.387043 5540 pod_ready.go:102] pod "metrics-server-9975d5f86-ltrjr" in "kube-system" namespace has status "Ready":"False"
I0612 21:39:50.403064 5540 pod_ready.go:102] pod "metrics-server-9975d5f86-ltrjr" in "kube-system" namespace has status "Ready":"False"
I0612 21:39:52.898887 5540 pod_ready.go:102] pod "metrics-server-9975d5f86-ltrjr" in "kube-system" namespace has status "Ready":"False"
I0612 21:39:55.400167 5540 pod_ready.go:102] pod "metrics-server-9975d5f86-ltrjr" in "kube-system" namespace has status "Ready":"False"
I0612 21:39:57.899110 5540 pod_ready.go:102] pod "metrics-server-9975d5f86-ltrjr" in "kube-system" namespace has status "Ready":"False"
I0612 21:40:00.410853 5540 pod_ready.go:102] pod "metrics-server-9975d5f86-ltrjr" in "kube-system" namespace has status "Ready":"False"
I0612 21:40:02.900772 5540 pod_ready.go:102] pod "metrics-server-9975d5f86-ltrjr" in "kube-system" namespace has status "Ready":"False"
I0612 21:40:04.909249 5540 pod_ready.go:102] pod "metrics-server-9975d5f86-ltrjr" in "kube-system" namespace has status "Ready":"False"
I0612 21:40:07.397170 5540 pod_ready.go:102] pod "metrics-server-9975d5f86-ltrjr" in "kube-system" namespace has status "Ready":"False"
I0612 21:40:09.896937 5540 pod_ready.go:102] pod "metrics-server-9975d5f86-ltrjr" in "kube-system" namespace has status "Ready":"False"
I0612 21:40:11.902368 5540 pod_ready.go:102] pod "metrics-server-9975d5f86-ltrjr" in "kube-system" namespace has status "Ready":"False"
I0612 21:40:14.403078 5540 pod_ready.go:102] pod "metrics-server-9975d5f86-ltrjr" in "kube-system" namespace has status "Ready":"False"
I0612 21:40:16.404999 5540 pod_ready.go:102] pod "metrics-server-9975d5f86-ltrjr" in "kube-system" namespace has status "Ready":"False"
I0612 21:40:18.904548 5540 pod_ready.go:102] pod "metrics-server-9975d5f86-ltrjr" in "kube-system" namespace has status "Ready":"False"
I0612 21:40:21.401043 5540 pod_ready.go:102] pod "metrics-server-9975d5f86-ltrjr" in "kube-system" namespace has status "Ready":"False"
I0612 21:40:23.900274 5540 pod_ready.go:102] pod "metrics-server-9975d5f86-ltrjr" in "kube-system" namespace has status "Ready":"False"
I0612 21:40:25.903170 5540 pod_ready.go:102] pod "metrics-server-9975d5f86-ltrjr" in "kube-system" namespace has status "Ready":"False"
I0612 21:40:28.398663 5540 pod_ready.go:102] pod "metrics-server-9975d5f86-ltrjr" in "kube-system" namespace has status "Ready":"False"
I0612 21:40:30.897967 5540 pod_ready.go:102] pod "metrics-server-9975d5f86-ltrjr" in "kube-system" namespace has status "Ready":"False"
I0612 21:40:32.898829 5540 pod_ready.go:102] pod "metrics-server-9975d5f86-ltrjr" in "kube-system" namespace has status "Ready":"False"
I0612 21:40:34.902439 5540 pod_ready.go:102] pod "metrics-server-9975d5f86-ltrjr" in "kube-system" namespace has status "Ready":"False"
I0612 21:40:36.905176 5540 pod_ready.go:102] pod "metrics-server-9975d5f86-ltrjr" in "kube-system" namespace has status "Ready":"False"
I0612 21:40:39.403951 5540 pod_ready.go:102] pod "metrics-server-9975d5f86-ltrjr" in "kube-system" namespace has status "Ready":"False"
I0612 21:40:41.905141 5540 pod_ready.go:102] pod "metrics-server-9975d5f86-ltrjr" in "kube-system" namespace has status "Ready":"False"
I0612 21:40:44.394595 5540 pod_ready.go:102] pod "metrics-server-9975d5f86-ltrjr" in "kube-system" namespace has status "Ready":"False"
I0612 21:40:46.396132 5540 pod_ready.go:102] pod "metrics-server-9975d5f86-ltrjr" in "kube-system" namespace has status "Ready":"False"
I0612 21:40:48.406007 5540 pod_ready.go:102] pod "metrics-server-9975d5f86-ltrjr" in "kube-system" namespace has status "Ready":"False"
I0612 21:40:50.895064 5540 pod_ready.go:102] pod "metrics-server-9975d5f86-ltrjr" in "kube-system" namespace has status "Ready":"False"
I0612 21:40:53.405871 5540 pod_ready.go:102] pod "metrics-server-9975d5f86-ltrjr" in "kube-system" namespace has status "Ready":"False"
I0612 21:40:55.899810 5540 pod_ready.go:102] pod "metrics-server-9975d5f86-ltrjr" in "kube-system" namespace has status "Ready":"False"
I0612 21:40:57.901208 5540 pod_ready.go:102] pod "metrics-server-9975d5f86-ltrjr" in "kube-system" namespace has status "Ready":"False"
I0612 21:41:00.400153 5540 pod_ready.go:102] pod "metrics-server-9975d5f86-ltrjr" in "kube-system" namespace has status "Ready":"False"
I0612 21:41:02.400447 5540 pod_ready.go:102] pod "metrics-server-9975d5f86-ltrjr" in "kube-system" namespace has status "Ready":"False"
I0612 21:41:04.902116 5540 pod_ready.go:102] pod "metrics-server-9975d5f86-ltrjr" in "kube-system" namespace has status "Ready":"False"
I0612 21:41:06.911285 5540 pod_ready.go:102] pod "metrics-server-9975d5f86-ltrjr" in "kube-system" namespace has status "Ready":"False"
I0612 21:41:09.399827 5540 pod_ready.go:102] pod "metrics-server-9975d5f86-ltrjr" in "kube-system" namespace has status "Ready":"False"
I0612 21:41:11.904393 5540 pod_ready.go:102] pod "metrics-server-9975d5f86-ltrjr" in "kube-system" namespace has status "Ready":"False"
I0612 21:41:13.909090 5540 pod_ready.go:102] pod "metrics-server-9975d5f86-ltrjr" in "kube-system" namespace has status "Ready":"False"
I0612 21:41:16.404922 5540 pod_ready.go:102] pod "metrics-server-9975d5f86-ltrjr" in "kube-system" namespace has status "Ready":"False"
I0612 21:41:18.895425 5540 pod_ready.go:102] pod "metrics-server-9975d5f86-ltrjr" in "kube-system" namespace has status "Ready":"False"
I0612 21:41:20.895919 5540 pod_ready.go:102] pod "metrics-server-9975d5f86-ltrjr" in "kube-system" namespace has status "Ready":"False"
I0612 21:41:22.906923 5540 pod_ready.go:102] pod "metrics-server-9975d5f86-ltrjr" in "kube-system" namespace has status "Ready":"False"
I0612 21:41:25.399361 5540 pod_ready.go:102] pod "metrics-server-9975d5f86-ltrjr" in "kube-system" namespace has status "Ready":"False"
I0612 21:41:27.897008 5540 pod_ready.go:102] pod "metrics-server-9975d5f86-ltrjr" in "kube-system" namespace has status "Ready":"False"
I0612 21:41:29.911902 5540 pod_ready.go:102] pod "metrics-server-9975d5f86-ltrjr" in "kube-system" namespace has status "Ready":"False"
I0612 21:41:32.412763 5540 pod_ready.go:102] pod "metrics-server-9975d5f86-ltrjr" in "kube-system" namespace has status "Ready":"False"
I0612 21:41:34.903090 5540 pod_ready.go:102] pod "metrics-server-9975d5f86-ltrjr" in "kube-system" namespace has status "Ready":"False"
I0612 21:41:36.909196 5540 pod_ready.go:102] pod "metrics-server-9975d5f86-ltrjr" in "kube-system" namespace has status "Ready":"False"
I0612 21:41:39.410541 5540 pod_ready.go:102] pod "metrics-server-9975d5f86-ltrjr" in "kube-system" namespace has status "Ready":"False"
I0612 21:41:41.901611 5540 pod_ready.go:102] pod "metrics-server-9975d5f86-ltrjr" in "kube-system" namespace has status "Ready":"False"
I0612 21:41:43.908026 5540 pod_ready.go:102] pod "metrics-server-9975d5f86-ltrjr" in "kube-system" namespace has status "Ready":"False"
I0612 21:41:46.404544 5540 pod_ready.go:102] pod "metrics-server-9975d5f86-ltrjr" in "kube-system" namespace has status "Ready":"False"
I0612 21:41:48.419658 5540 pod_ready.go:102] pod "metrics-server-9975d5f86-ltrjr" in "kube-system" namespace has status "Ready":"False"
I0612 21:41:50.905800 5540 pod_ready.go:102] pod "metrics-server-9975d5f86-ltrjr" in "kube-system" namespace has status "Ready":"False"
I0612 21:41:53.407266 5540 pod_ready.go:102] pod "metrics-server-9975d5f86-ltrjr" in "kube-system" namespace has status "Ready":"False"
I0612 21:41:55.418601 5540 pod_ready.go:102] pod "metrics-server-9975d5f86-ltrjr" in "kube-system" namespace has status "Ready":"False"
I0612 21:41:57.437323 5540 pod_ready.go:102] pod "metrics-server-9975d5f86-ltrjr" in "kube-system" namespace has status "Ready":"False"
I0612 21:41:59.896219 5540 pod_ready.go:102] pod "metrics-server-9975d5f86-ltrjr" in "kube-system" namespace has status "Ready":"False"
I0612 21:42:01.905765 5540 pod_ready.go:102] pod "metrics-server-9975d5f86-ltrjr" in "kube-system" namespace has status "Ready":"False"
I0612 21:42:04.403001 5540 pod_ready.go:102] pod "metrics-server-9975d5f86-ltrjr" in "kube-system" namespace has status "Ready":"False"
I0612 21:42:06.407551 5540 pod_ready.go:102] pod "metrics-server-9975d5f86-ltrjr" in "kube-system" namespace has status "Ready":"False"
I0612 21:42:08.901786 5540 pod_ready.go:102] pod "metrics-server-9975d5f86-ltrjr" in "kube-system" namespace has status "Ready":"False"
I0612 21:42:11.405772 5540 pod_ready.go:102] pod "metrics-server-9975d5f86-ltrjr" in "kube-system" namespace has status "Ready":"False"
I0612 21:42:13.910661 5540 pod_ready.go:102] pod "metrics-server-9975d5f86-ltrjr" in "kube-system" namespace has status "Ready":"False"
I0612 21:42:16.395552 5540 pod_ready.go:102] pod "metrics-server-9975d5f86-ltrjr" in "kube-system" namespace has status "Ready":"False"
I0612 21:42:18.400106 5540 pod_ready.go:102] pod "metrics-server-9975d5f86-ltrjr" in "kube-system" namespace has status "Ready":"False"
I0612 21:42:20.415272 5540 pod_ready.go:102] pod "metrics-server-9975d5f86-ltrjr" in "kube-system" namespace has status "Ready":"False"
I0612 21:42:22.909934 5540 pod_ready.go:102] pod "metrics-server-9975d5f86-ltrjr" in "kube-system" namespace has status "Ready":"False"
I0612 21:42:25.408477 5540 pod_ready.go:102] pod "metrics-server-9975d5f86-ltrjr" in "kube-system" namespace has status "Ready":"False"
I0612 21:42:27.908976 5540 pod_ready.go:102] pod "metrics-server-9975d5f86-ltrjr" in "kube-system" namespace has status "Ready":"False"
I0612 21:42:29.915818 5540 pod_ready.go:102] pod "metrics-server-9975d5f86-ltrjr" in "kube-system" namespace has status "Ready":"False"
I0612 21:42:32.403228 5540 pod_ready.go:102] pod "metrics-server-9975d5f86-ltrjr" in "kube-system" namespace has status "Ready":"False"
I0612 21:42:34.410962 5540 pod_ready.go:102] pod "metrics-server-9975d5f86-ltrjr" in "kube-system" namespace has status "Ready":"False"
I0612 21:42:36.907558 5540 pod_ready.go:102] pod "metrics-server-9975d5f86-ltrjr" in "kube-system" namespace has status "Ready":"False"
I0612 21:42:39.413048 5540 pod_ready.go:102] pod "metrics-server-9975d5f86-ltrjr" in "kube-system" namespace has status "Ready":"False"
I0612 21:42:41.418470 5540 pod_ready.go:102] pod "metrics-server-9975d5f86-ltrjr" in "kube-system" namespace has status "Ready":"False"
I0612 21:42:43.901565 5540 pod_ready.go:102] pod "metrics-server-9975d5f86-ltrjr" in "kube-system" namespace has status "Ready":"False"
I0612 21:42:46.409255 5540 pod_ready.go:102] pod "metrics-server-9975d5f86-ltrjr" in "kube-system" namespace has status "Ready":"False"
I0612 21:42:48.411072 5540 pod_ready.go:102] pod "metrics-server-9975d5f86-ltrjr" in "kube-system" namespace has status "Ready":"False"
I0612 21:42:50.413283 5540 pod_ready.go:102] pod "metrics-server-9975d5f86-ltrjr" in "kube-system" namespace has status "Ready":"False"
I0612 21:42:52.414751 5540 pod_ready.go:102] pod "metrics-server-9975d5f86-ltrjr" in "kube-system" namespace has status "Ready":"False"
I0612 21:42:54.713928 5540 pod_ready.go:102] pod "metrics-server-9975d5f86-ltrjr" in "kube-system" namespace has status "Ready":"False"
I0612 21:42:56.913298 5540 pod_ready.go:102] pod "metrics-server-9975d5f86-ltrjr" in "kube-system" namespace has status "Ready":"False"
I0612 21:42:59.412596 5540 pod_ready.go:102] pod "metrics-server-9975d5f86-ltrjr" in "kube-system" namespace has status "Ready":"False"
I0612 21:43:01.414873 5540 pod_ready.go:102] pod "metrics-server-9975d5f86-ltrjr" in "kube-system" namespace has status "Ready":"False"
I0612 21:43:03.905677 5540 pod_ready.go:102] pod "metrics-server-9975d5f86-ltrjr" in "kube-system" namespace has status "Ready":"False"
I0612 21:43:05.907800 5540 pod_ready.go:102] pod "metrics-server-9975d5f86-ltrjr" in "kube-system" namespace has status "Ready":"False"
I0612 21:43:07.908169 5540 pod_ready.go:102] pod "metrics-server-9975d5f86-ltrjr" in "kube-system" namespace has status "Ready":"False"
I0612 21:43:09.908393 5540 pod_ready.go:102] pod "metrics-server-9975d5f86-ltrjr" in "kube-system" namespace has status "Ready":"False"
I0612 21:43:12.414434 5540 pod_ready.go:102] pod "metrics-server-9975d5f86-ltrjr" in "kube-system" namespace has status "Ready":"False"
I0612 21:43:14.902131 5540 pod_ready.go:102] pod "metrics-server-9975d5f86-ltrjr" in "kube-system" namespace has status "Ready":"False"
I0612 21:43:16.904775 5540 pod_ready.go:102] pod "metrics-server-9975d5f86-ltrjr" in "kube-system" namespace has status "Ready":"False"
I0612 21:43:18.916084 5540 pod_ready.go:102] pod "metrics-server-9975d5f86-ltrjr" in "kube-system" namespace has status "Ready":"False"
I0612 21:43:21.406000 5540 pod_ready.go:102] pod "metrics-server-9975d5f86-ltrjr" in "kube-system" namespace has status "Ready":"False"
I0612 21:43:23.414917 5540 pod_ready.go:102] pod "metrics-server-9975d5f86-ltrjr" in "kube-system" namespace has status "Ready":"False"
I0612 21:43:25.913096 5540 pod_ready.go:102] pod "metrics-server-9975d5f86-ltrjr" in "kube-system" namespace has status "Ready":"False"
I0612 21:43:28.409443 5540 pod_ready.go:102] pod "metrics-server-9975d5f86-ltrjr" in "kube-system" namespace has status "Ready":"False"
I0612 21:43:30.418475 5540 pod_ready.go:102] pod "metrics-server-9975d5f86-ltrjr" in "kube-system" namespace has status "Ready":"False"
I0612 21:43:32.913059 5540 pod_ready.go:102] pod "metrics-server-9975d5f86-ltrjr" in "kube-system" namespace has status "Ready":"False"
I0612 21:43:35.407380 5540 pod_ready.go:102] pod "metrics-server-9975d5f86-ltrjr" in "kube-system" namespace has status "Ready":"False"
I0612 21:43:37.397593 5540 pod_ready.go:81] duration metric: took 4m0.0125914s for pod "metrics-server-9975d5f86-ltrjr" in "kube-system" namespace to be "Ready" ...
E0612 21:43:37.397593 5540 pod_ready.go:66] WaitExtra: waitPodCondition: context deadline exceeded
I0612 21:43:37.397593 5540 pod_ready.go:38] duration metric: took 5m25.2905551s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0612 21:43:37.397593 5540 api_server.go:52] waiting for apiserver process to appear ...
I0612 21:43:37.412569 5540 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
I0612 21:43:37.473891 5540 logs.go:276] 2 containers: [559ffac3c414 08372f67ca60]
I0612 21:43:37.486870 5540 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
I0612 21:43:37.538862 5540 logs.go:276] 2 containers: [48b924cc9ca8 d65a86407319]
I0612 21:43:37.553872 5540 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
I0612 21:43:37.600860 5540 logs.go:276] 2 containers: [78fd0bd54f7f b5adbbbe1b1d]
I0612 21:43:37.610858 5540 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
I0612 21:43:37.679150 5540 logs.go:276] 2 containers: [dc6968d98409 6dcf6b435dcb]
I0612 21:43:37.688184 5540 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
I0612 21:43:37.731537 5540 logs.go:276] 2 containers: [c87af550bb83 9bdf65930601]
I0612 21:43:37.740529 5540 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
I0612 21:43:37.792571 5540 logs.go:276] 2 containers: [6116c6070393 5491a5e5dcb9]
I0612 21:43:37.804550 5540 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
I0612 21:43:37.849101 5540 logs.go:276] 0 containers: []
W0612 21:43:37.849101 5540 logs.go:278] No container was found matching "kindnet"
I0612 21:43:37.868088 5540 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kubernetes-dashboard --format={{.ID}}
I0612 21:43:37.915701 5540 logs.go:276] 1 containers: [ed7189bae68d]
I0612 21:43:37.927688 5540 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
I0612 21:43:37.984327 5540 logs.go:276] 2 containers: [380c76a7ac65 3f440bc35ac0]
I0612 21:43:37.984327 5540 logs.go:123] Gathering logs for coredns [78fd0bd54f7f] ...
I0612 21:43:37.985483 5540 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 78fd0bd54f7f"
I0612 21:43:38.043037 5540 logs.go:123] Gathering logs for kube-scheduler [dc6968d98409] ...
I0612 21:43:38.043037 5540 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 dc6968d98409"
I0612 21:43:38.103058 5540 logs.go:123] Gathering logs for kube-controller-manager [5491a5e5dcb9] ...
I0612 21:43:38.103058 5540 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5491a5e5dcb9"
I0612 21:43:38.182836 5540 logs.go:123] Gathering logs for kubernetes-dashboard [ed7189bae68d] ...
I0612 21:43:38.182836 5540 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ed7189bae68d"
I0612 21:43:38.236968 5540 logs.go:123] Gathering logs for kube-apiserver [559ffac3c414] ...
I0612 21:43:38.236968 5540 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 559ffac3c414"
I0612 21:43:38.331716 5540 logs.go:123] Gathering logs for kube-apiserver [08372f67ca60] ...
I0612 21:43:38.331796 5540 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 08372f67ca60"
I0612 21:43:38.431593 5540 logs.go:123] Gathering logs for etcd [d65a86407319] ...
I0612 21:43:38.431593 5540 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d65a86407319"
I0612 21:43:38.503261 5540 logs.go:123] Gathering logs for storage-provisioner [380c76a7ac65] ...
I0612 21:43:38.503261 5540 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 380c76a7ac65"
I0612 21:43:38.571139 5540 logs.go:123] Gathering logs for Docker ...
I0612 21:43:38.571139 5540 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
I0612 21:43:38.632061 5540 logs.go:123] Gathering logs for describe nodes ...
I0612 21:43:38.632061 5540 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0612 21:43:38.889375 5540 logs.go:123] Gathering logs for etcd [48b924cc9ca8] ...
I0612 21:43:38.889375 5540 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 48b924cc9ca8"
I0612 21:43:38.964870 5540 logs.go:123] Gathering logs for coredns [b5adbbbe1b1d] ...
I0612 21:43:38.964870 5540 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b5adbbbe1b1d"
I0612 21:43:39.027557 5540 logs.go:123] Gathering logs for kube-proxy [9bdf65930601] ...
I0612 21:43:39.027557 5540 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 9bdf65930601"
I0612 21:43:39.089085 5540 logs.go:123] Gathering logs for kubelet ...
I0612 21:43:39.089085 5540 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
W0612 21:43:39.203925 5540 logs.go:138] Found kubelet problem: Jun 12 21:38:18 old-k8s-version-606600 kubelet[1666]: E0612 21:38:18.108202 1666 pod_workers.go:191] Error syncing pod cbdf526e-ee8e-4fbf-83b1-066d29ec1239 ("metrics-server-9975d5f86-ltrjr_kube-system(cbdf526e-ee8e-4fbf-83b1-066d29ec1239)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = Error response from daemon: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.65.254:53: no such host"
W0612 21:43:39.204924 5540 logs.go:138] Found kubelet problem: Jun 12 21:38:18 old-k8s-version-606600 kubelet[1666]: E0612 21:38:18.197645 1666 pod_workers.go:191] Error syncing pod cbdf526e-ee8e-4fbf-83b1-066d29ec1239 ("metrics-server-9975d5f86-ltrjr_kube-system(cbdf526e-ee8e-4fbf-83b1-066d29ec1239)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0612 21:43:39.205934 5540 logs.go:138] Found kubelet problem: Jun 12 21:38:19 old-k8s-version-606600 kubelet[1666]: E0612 21:38:19.232272 1666 pod_workers.go:191] Error syncing pod cbdf526e-ee8e-4fbf-83b1-066d29ec1239 ("metrics-server-9975d5f86-ltrjr_kube-system(cbdf526e-ee8e-4fbf-83b1-066d29ec1239)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0612 21:43:39.206922 5540 logs.go:138] Found kubelet problem: Jun 12 21:38:34 old-k8s-version-606600 kubelet[1666]: E0612 21:38:34.085575 1666 reflector.go:138] object-"kubernetes-dashboard"/"kubernetes-dashboard-token-zgnbp": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kubernetes-dashboard-token-zgnbp" is forbidden: User "system:node:old-k8s-version-606600" cannot list resource "secrets" in API group "" in the namespace "kubernetes-dashboard": no relationship found between node 'old-k8s-version-606600' and this object
W0612 21:43:39.209921 5540 logs.go:138] Found kubelet problem: Jun 12 21:38:34 old-k8s-version-606600 kubelet[1666]: E0612 21:38:34.495556 1666 pod_workers.go:191] Error syncing pod cbdf526e-ee8e-4fbf-83b1-066d29ec1239 ("metrics-server-9975d5f86-ltrjr_kube-system(cbdf526e-ee8e-4fbf-83b1-066d29ec1239)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = Error response from daemon: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.65.254:53: no such host"
W0612 21:43:39.212925 5540 logs.go:138] Found kubelet problem: Jun 12 21:38:37 old-k8s-version-606600 kubelet[1666]: E0612 21:38:37.256650 1666 pod_workers.go:191] Error syncing pod 7700737f-ee51-48c5-9fc0-24437fe76fbf ("dashboard-metrics-scraper-8d5bb5db8-qrxqz_kubernetes-dashboard(7700737f-ee51-48c5-9fc0-24437fe76fbf)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ErrImagePull: "rpc error: code = Unknown desc = [DEPRECATION NOTICE] Docker Image Format v1 and Docker Image manifest version 2, schema 1 support is disabled by default and will be removed in an upcoming release. Suggest the author of registry.k8s.io/echoserver:1.4 to upgrade the image to the OCI Format or Docker Image manifest v2, schema 2. More information at https://docs.docker.com/go/deprecated-image-specs/"
W0612 21:43:39.213942 5540 logs.go:138] Found kubelet problem: Jun 12 21:38:37 old-k8s-version-606600 kubelet[1666]: E0612 21:38:37.889727 1666 pod_workers.go:191] Error syncing pod 7700737f-ee51-48c5-9fc0-24437fe76fbf ("dashboard-metrics-scraper-8d5bb5db8-qrxqz_kubernetes-dashboard(7700737f-ee51-48c5-9fc0-24437fe76fbf)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0612 21:43:39.214499 5540 logs.go:138] Found kubelet problem: Jun 12 21:38:38 old-k8s-version-606600 kubelet[1666]: E0612 21:38:38.912678 1666 pod_workers.go:191] Error syncing pod 7700737f-ee51-48c5-9fc0-24437fe76fbf ("dashboard-metrics-scraper-8d5bb5db8-qrxqz_kubernetes-dashboard(7700737f-ee51-48c5-9fc0-24437fe76fbf)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0612 21:43:39.215390 5540 logs.go:138] Found kubelet problem: Jun 12 21:38:39 old-k8s-version-606600 kubelet[1666]: E0612 21:38:39.950470 1666 pod_workers.go:191] Error syncing pod 12c0e34d-3bef-4207-9e19-43c91aea19c2 ("storage-provisioner_kube-system(12c0e34d-3bef-4207-9e19-43c91aea19c2)"), skipping: failed to "StartContainer" for "storage-provisioner" with CrashLoopBackOff: "back-off 10s restarting failed container=storage-provisioner pod=storage-provisioner_kube-system(12c0e34d-3bef-4207-9e19-43c91aea19c2)"
W0612 21:43:39.215556 5540 logs.go:138] Found kubelet problem: Jun 12 21:38:45 old-k8s-version-606600 kubelet[1666]: E0612 21:38:45.301360 1666 pod_workers.go:191] Error syncing pod cbdf526e-ee8e-4fbf-83b1-066d29ec1239 ("metrics-server-9975d5f86-ltrjr_kube-system(cbdf526e-ee8e-4fbf-83b1-066d29ec1239)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0612 21:43:39.218389 5540 logs.go:138] Found kubelet problem: Jun 12 21:39:00 old-k8s-version-606600 kubelet[1666]: E0612 21:39:00.285017 1666 pod_workers.go:191] Error syncing pod 7700737f-ee51-48c5-9fc0-24437fe76fbf ("dashboard-metrics-scraper-8d5bb5db8-qrxqz_kubernetes-dashboard(7700737f-ee51-48c5-9fc0-24437fe76fbf)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ErrImagePull: "rpc error: code = Unknown desc = [DEPRECATION NOTICE] Docker Image Format v1 and Docker Image manifest version 2, schema 1 support is disabled by default and will be removed in an upcoming release. Suggest the author of registry.k8s.io/echoserver:1.4 to upgrade the image to the OCI Format or Docker Image manifest v2, schema 2. More information at https://docs.docker.com/go/deprecated-image-specs/"
W0612 21:43:39.220383 5540 logs.go:138] Found kubelet problem: Jun 12 21:39:00 old-k8s-version-606600 kubelet[1666]: E0612 21:39:00.377954 1666 pod_workers.go:191] Error syncing pod cbdf526e-ee8e-4fbf-83b1-066d29ec1239 ("metrics-server-9975d5f86-ltrjr_kube-system(cbdf526e-ee8e-4fbf-83b1-066d29ec1239)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = Error response from daemon: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.65.254:53: no such host"
W0612 21:43:39.220383 5540 logs.go:138] Found kubelet problem: Jun 12 21:39:12 old-k8s-version-606600 kubelet[1666]: E0612 21:39:12.297156 1666 pod_workers.go:191] Error syncing pod 7700737f-ee51-48c5-9fc0-24437fe76fbf ("dashboard-metrics-scraper-8d5bb5db8-qrxqz_kubernetes-dashboard(7700737f-ee51-48c5-9fc0-24437fe76fbf)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0612 21:43:39.221388 5540 logs.go:138] Found kubelet problem: Jun 12 21:39:12 old-k8s-version-606600 kubelet[1666]: E0612 21:39:12.297233 1666 pod_workers.go:191] Error syncing pod cbdf526e-ee8e-4fbf-83b1-066d29ec1239 ("metrics-server-9975d5f86-ltrjr_kube-system(cbdf526e-ee8e-4fbf-83b1-066d29ec1239)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0612 21:43:39.221388 5540 logs.go:138] Found kubelet problem: Jun 12 21:39:23 old-k8s-version-606600 kubelet[1666]: E0612 21:39:23.296706 1666 pod_workers.go:191] Error syncing pod cbdf526e-ee8e-4fbf-83b1-066d29ec1239 ("metrics-server-9975d5f86-ltrjr_kube-system(cbdf526e-ee8e-4fbf-83b1-066d29ec1239)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0612 21:43:39.223396 5540 logs.go:138] Found kubelet problem: Jun 12 21:39:27 old-k8s-version-606600 kubelet[1666]: E0612 21:39:27.717082 1666 pod_workers.go:191] Error syncing pod 7700737f-ee51-48c5-9fc0-24437fe76fbf ("dashboard-metrics-scraper-8d5bb5db8-qrxqz_kubernetes-dashboard(7700737f-ee51-48c5-9fc0-24437fe76fbf)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ErrImagePull: "rpc error: code = Unknown desc = [DEPRECATION NOTICE] Docker Image Format v1 and Docker Image manifest version 2, schema 1 support is disabled by default and will be removed in an upcoming release. Suggest the author of registry.k8s.io/echoserver:1.4 to upgrade the image to the OCI Format or Docker Image manifest v2, schema 2. More information at https://docs.docker.com/go/deprecated-image-specs/"
W0612 21:43:39.223396 5540 logs.go:138] Found kubelet problem: Jun 12 21:39:34 old-k8s-version-606600 kubelet[1666]: E0612 21:39:34.293373 1666 pod_workers.go:191] Error syncing pod cbdf526e-ee8e-4fbf-83b1-066d29ec1239 ("metrics-server-9975d5f86-ltrjr_kube-system(cbdf526e-ee8e-4fbf-83b1-066d29ec1239)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0612 21:43:39.223396 5540 logs.go:138] Found kubelet problem: Jun 12 21:39:42 old-k8s-version-606600 kubelet[1666]: E0612 21:39:42.310173 1666 pod_workers.go:191] Error syncing pod 7700737f-ee51-48c5-9fc0-24437fe76fbf ("dashboard-metrics-scraper-8d5bb5db8-qrxqz_kubernetes-dashboard(7700737f-ee51-48c5-9fc0-24437fe76fbf)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0612 21:43:39.226381 5540 logs.go:138] Found kubelet problem: Jun 12 21:39:45 old-k8s-version-606600 kubelet[1666]: E0612 21:39:45.350617 1666 pod_workers.go:191] Error syncing pod cbdf526e-ee8e-4fbf-83b1-066d29ec1239 ("metrics-server-9975d5f86-ltrjr_kube-system(cbdf526e-ee8e-4fbf-83b1-066d29ec1239)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = Error response from daemon: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.65.254:53: no such host"
W0612 21:43:39.226381 5540 logs.go:138] Found kubelet problem: Jun 12 21:39:53 old-k8s-version-606600 kubelet[1666]: E0612 21:39:53.294158 1666 pod_workers.go:191] Error syncing pod 7700737f-ee51-48c5-9fc0-24437fe76fbf ("dashboard-metrics-scraper-8d5bb5db8-qrxqz_kubernetes-dashboard(7700737f-ee51-48c5-9fc0-24437fe76fbf)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0612 21:43:39.226381 5540 logs.go:138] Found kubelet problem: Jun 12 21:39:59 old-k8s-version-606600 kubelet[1666]: E0612 21:39:59.289780 1666 pod_workers.go:191] Error syncing pod cbdf526e-ee8e-4fbf-83b1-066d29ec1239 ("metrics-server-9975d5f86-ltrjr_kube-system(cbdf526e-ee8e-4fbf-83b1-066d29ec1239)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0612 21:43:39.226381 5540 logs.go:138] Found kubelet problem: Jun 12 21:40:06 old-k8s-version-606600 kubelet[1666]: E0612 21:40:06.290907 1666 pod_workers.go:191] Error syncing pod 7700737f-ee51-48c5-9fc0-24437fe76fbf ("dashboard-metrics-scraper-8d5bb5db8-qrxqz_kubernetes-dashboard(7700737f-ee51-48c5-9fc0-24437fe76fbf)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0612 21:43:39.226381 5540 logs.go:138] Found kubelet problem: Jun 12 21:40:14 old-k8s-version-606600 kubelet[1666]: E0612 21:40:14.295198 1666 pod_workers.go:191] Error syncing pod cbdf526e-ee8e-4fbf-83b1-066d29ec1239 ("metrics-server-9975d5f86-ltrjr_kube-system(cbdf526e-ee8e-4fbf-83b1-066d29ec1239)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0612 21:43:39.230396 5540 logs.go:138] Found kubelet problem: Jun 12 21:40:20 old-k8s-version-606600 kubelet[1666]: E0612 21:40:20.713009 1666 pod_workers.go:191] Error syncing pod 7700737f-ee51-48c5-9fc0-24437fe76fbf ("dashboard-metrics-scraper-8d5bb5db8-qrxqz_kubernetes-dashboard(7700737f-ee51-48c5-9fc0-24437fe76fbf)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ErrImagePull: "rpc error: code = Unknown desc = [DEPRECATION NOTICE] Docker Image Format v1 and Docker Image manifest version 2, schema 1 support is disabled by default and will be removed in an upcoming release. Suggest the author of registry.k8s.io/echoserver:1.4 to upgrade the image to the OCI Format or Docker Image manifest v2, schema 2. More information at https://docs.docker.com/go/deprecated-image-specs/"
W0612 21:43:39.230396 5540 logs.go:138] Found kubelet problem: Jun 12 21:40:27 old-k8s-version-606600 kubelet[1666]: E0612 21:40:27.292602 1666 pod_workers.go:191] Error syncing pod cbdf526e-ee8e-4fbf-83b1-066d29ec1239 ("metrics-server-9975d5f86-ltrjr_kube-system(cbdf526e-ee8e-4fbf-83b1-066d29ec1239)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0612 21:43:39.231376 5540 logs.go:138] Found kubelet problem: Jun 12 21:40:35 old-k8s-version-606600 kubelet[1666]: E0612 21:40:35.288460 1666 pod_workers.go:191] Error syncing pod 7700737f-ee51-48c5-9fc0-24437fe76fbf ("dashboard-metrics-scraper-8d5bb5db8-qrxqz_kubernetes-dashboard(7700737f-ee51-48c5-9fc0-24437fe76fbf)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0612 21:43:39.231376 5540 logs.go:138] Found kubelet problem: Jun 12 21:40:38 old-k8s-version-606600 kubelet[1666]: E0612 21:40:38.288195 1666 pod_workers.go:191] Error syncing pod cbdf526e-ee8e-4fbf-83b1-066d29ec1239 ("metrics-server-9975d5f86-ltrjr_kube-system(cbdf526e-ee8e-4fbf-83b1-066d29ec1239)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0612 21:43:39.231376 5540 logs.go:138] Found kubelet problem: Jun 12 21:40:48 old-k8s-version-606600 kubelet[1666]: E0612 21:40:48.304887 1666 pod_workers.go:191] Error syncing pod 7700737f-ee51-48c5-9fc0-24437fe76fbf ("dashboard-metrics-scraper-8d5bb5db8-qrxqz_kubernetes-dashboard(7700737f-ee51-48c5-9fc0-24437fe76fbf)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0612 21:43:39.231376 5540 logs.go:138] Found kubelet problem: Jun 12 21:40:49 old-k8s-version-606600 kubelet[1666]: E0612 21:40:49.287899 1666 pod_workers.go:191] Error syncing pod cbdf526e-ee8e-4fbf-83b1-066d29ec1239 ("metrics-server-9975d5f86-ltrjr_kube-system(cbdf526e-ee8e-4fbf-83b1-066d29ec1239)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0612 21:43:39.231376 5540 logs.go:138] Found kubelet problem: Jun 12 21:41:00 old-k8s-version-606600 kubelet[1666]: E0612 21:41:00.286411 1666 pod_workers.go:191] Error syncing pod cbdf526e-ee8e-4fbf-83b1-066d29ec1239 ("metrics-server-9975d5f86-ltrjr_kube-system(cbdf526e-ee8e-4fbf-83b1-066d29ec1239)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0612 21:43:39.232377 5540 logs.go:138] Found kubelet problem: Jun 12 21:41:03 old-k8s-version-606600 kubelet[1666]: E0612 21:41:03.286078 1666 pod_workers.go:191] Error syncing pod 7700737f-ee51-48c5-9fc0-24437fe76fbf ("dashboard-metrics-scraper-8d5bb5db8-qrxqz_kubernetes-dashboard(7700737f-ee51-48c5-9fc0-24437fe76fbf)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0612 21:43:39.234376 5540 logs.go:138] Found kubelet problem: Jun 12 21:41:12 old-k8s-version-606600 kubelet[1666]: E0612 21:41:12.338980 1666 pod_workers.go:191] Error syncing pod cbdf526e-ee8e-4fbf-83b1-066d29ec1239 ("metrics-server-9975d5f86-ltrjr_kube-system(cbdf526e-ee8e-4fbf-83b1-066d29ec1239)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = Error response from daemon: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.65.254:53: no such host"
W0612 21:43:39.235522 5540 logs.go:138] Found kubelet problem: Jun 12 21:41:16 old-k8s-version-606600 kubelet[1666]: E0612 21:41:16.369660 1666 pod_workers.go:191] Error syncing pod 7700737f-ee51-48c5-9fc0-24437fe76fbf ("dashboard-metrics-scraper-8d5bb5db8-qrxqz_kubernetes-dashboard(7700737f-ee51-48c5-9fc0-24437fe76fbf)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0612 21:43:39.236501 5540 logs.go:138] Found kubelet problem: Jun 12 21:41:25 old-k8s-version-606600 kubelet[1666]: E0612 21:41:25.285535 1666 pod_workers.go:191] Error syncing pod cbdf526e-ee8e-4fbf-83b1-066d29ec1239 ("metrics-server-9975d5f86-ltrjr_kube-system(cbdf526e-ee8e-4fbf-83b1-066d29ec1239)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0612 21:43:39.236766 5540 logs.go:138] Found kubelet problem: Jun 12 21:41:29 old-k8s-version-606600 kubelet[1666]: E0612 21:41:29.282908 1666 pod_workers.go:191] Error syncing pod 7700737f-ee51-48c5-9fc0-24437fe76fbf ("dashboard-metrics-scraper-8d5bb5db8-qrxqz_kubernetes-dashboard(7700737f-ee51-48c5-9fc0-24437fe76fbf)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0612 21:43:39.236982 5540 logs.go:138] Found kubelet problem: Jun 12 21:41:37 old-k8s-version-606600 kubelet[1666]: E0612 21:41:37.281613 1666 pod_workers.go:191] Error syncing pod cbdf526e-ee8e-4fbf-83b1-066d29ec1239 ("metrics-server-9975d5f86-ltrjr_kube-system(cbdf526e-ee8e-4fbf-83b1-066d29ec1239)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0612 21:43:39.240034 5540 logs.go:138] Found kubelet problem: Jun 12 21:41:46 old-k8s-version-606600 kubelet[1666]: E0612 21:41:46.818084 1666 pod_workers.go:191] Error syncing pod 7700737f-ee51-48c5-9fc0-24437fe76fbf ("dashboard-metrics-scraper-8d5bb5db8-qrxqz_kubernetes-dashboard(7700737f-ee51-48c5-9fc0-24437fe76fbf)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ErrImagePull: "rpc error: code = Unknown desc = [DEPRECATION NOTICE] Docker Image Format v1 and Docker Image manifest version 2, schema 1 support is disabled by default and will be removed in an upcoming release. Suggest the author of registry.k8s.io/echoserver:1.4 to upgrade the image to the OCI Format or Docker Image manifest v2, schema 2. More information at https://docs.docker.com/go/deprecated-image-specs/"
W0612 21:43:39.240573 5540 logs.go:138] Found kubelet problem: Jun 12 21:41:49 old-k8s-version-606600 kubelet[1666]: E0612 21:41:49.282375 1666 pod_workers.go:191] Error syncing pod cbdf526e-ee8e-4fbf-83b1-066d29ec1239 ("metrics-server-9975d5f86-ltrjr_kube-system(cbdf526e-ee8e-4fbf-83b1-066d29ec1239)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0612 21:43:39.240987 5540 logs.go:138] Found kubelet problem: Jun 12 21:41:58 old-k8s-version-606600 kubelet[1666]: E0612 21:41:58.301867 1666 pod_workers.go:191] Error syncing pod 7700737f-ee51-48c5-9fc0-24437fe76fbf ("dashboard-metrics-scraper-8d5bb5db8-qrxqz_kubernetes-dashboard(7700737f-ee51-48c5-9fc0-24437fe76fbf)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0612 21:43:39.240987 5540 logs.go:138] Found kubelet problem: Jun 12 21:42:04 old-k8s-version-606600 kubelet[1666]: E0612 21:42:04.282322 1666 pod_workers.go:191] Error syncing pod cbdf526e-ee8e-4fbf-83b1-066d29ec1239 ("metrics-server-9975d5f86-ltrjr_kube-system(cbdf526e-ee8e-4fbf-83b1-066d29ec1239)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0612 21:43:39.241699 5540 logs.go:138] Found kubelet problem: Jun 12 21:42:11 old-k8s-version-606600 kubelet[1666]: E0612 21:42:11.278999 1666 pod_workers.go:191] Error syncing pod 7700737f-ee51-48c5-9fc0-24437fe76fbf ("dashboard-metrics-scraper-8d5bb5db8-qrxqz_kubernetes-dashboard(7700737f-ee51-48c5-9fc0-24437fe76fbf)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0612 21:43:39.242142 5540 logs.go:138] Found kubelet problem: Jun 12 21:42:17 old-k8s-version-606600 kubelet[1666]: E0612 21:42:17.277966 1666 pod_workers.go:191] Error syncing pod cbdf526e-ee8e-4fbf-83b1-066d29ec1239 ("metrics-server-9975d5f86-ltrjr_kube-system(cbdf526e-ee8e-4fbf-83b1-066d29ec1239)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0612 21:43:39.242597 5540 logs.go:138] Found kubelet problem: Jun 12 21:42:23 old-k8s-version-606600 kubelet[1666]: E0612 21:42:23.279178 1666 pod_workers.go:191] Error syncing pod 7700737f-ee51-48c5-9fc0-24437fe76fbf ("dashboard-metrics-scraper-8d5bb5db8-qrxqz_kubernetes-dashboard(7700737f-ee51-48c5-9fc0-24437fe76fbf)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0612 21:43:39.242597 5540 logs.go:138] Found kubelet problem: Jun 12 21:42:31 old-k8s-version-606600 kubelet[1666]: E0612 21:42:31.276919 1666 pod_workers.go:191] Error syncing pod cbdf526e-ee8e-4fbf-83b1-066d29ec1239 ("metrics-server-9975d5f86-ltrjr_kube-system(cbdf526e-ee8e-4fbf-83b1-066d29ec1239)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0612 21:43:39.242597 5540 logs.go:138] Found kubelet problem: Jun 12 21:42:34 old-k8s-version-606600 kubelet[1666]: E0612 21:42:34.277134 1666 pod_workers.go:191] Error syncing pod 7700737f-ee51-48c5-9fc0-24437fe76fbf ("dashboard-metrics-scraper-8d5bb5db8-qrxqz_kubernetes-dashboard(7700737f-ee51-48c5-9fc0-24437fe76fbf)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0612 21:43:39.242597 5540 logs.go:138] Found kubelet problem: Jun 12 21:42:44 old-k8s-version-606600 kubelet[1666]: E0612 21:42:44.277354 1666 pod_workers.go:191] Error syncing pod cbdf526e-ee8e-4fbf-83b1-066d29ec1239 ("metrics-server-9975d5f86-ltrjr_kube-system(cbdf526e-ee8e-4fbf-83b1-066d29ec1239)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0612 21:43:39.242597 5540 logs.go:138] Found kubelet problem: Jun 12 21:42:49 old-k8s-version-606600 kubelet[1666]: E0612 21:42:49.279624 1666 pod_workers.go:191] Error syncing pod 7700737f-ee51-48c5-9fc0-24437fe76fbf ("dashboard-metrics-scraper-8d5bb5db8-qrxqz_kubernetes-dashboard(7700737f-ee51-48c5-9fc0-24437fe76fbf)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0612 21:43:39.243583 5540 logs.go:138] Found kubelet problem: Jun 12 21:42:59 old-k8s-version-606600 kubelet[1666]: E0612 21:42:59.280403 1666 pod_workers.go:191] Error syncing pod cbdf526e-ee8e-4fbf-83b1-066d29ec1239 ("metrics-server-9975d5f86-ltrjr_kube-system(cbdf526e-ee8e-4fbf-83b1-066d29ec1239)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0612 21:43:39.243583 5540 logs.go:138] Found kubelet problem: Jun 12 21:43:04 old-k8s-version-606600 kubelet[1666]: E0612 21:43:04.308191 1666 pod_workers.go:191] Error syncing pod 7700737f-ee51-48c5-9fc0-24437fe76fbf ("dashboard-metrics-scraper-8d5bb5db8-qrxqz_kubernetes-dashboard(7700737f-ee51-48c5-9fc0-24437fe76fbf)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0612 21:43:39.244580 5540 logs.go:138] Found kubelet problem: Jun 12 21:43:10 old-k8s-version-606600 kubelet[1666]: E0612 21:43:10.273566 1666 pod_workers.go:191] Error syncing pod cbdf526e-ee8e-4fbf-83b1-066d29ec1239 ("metrics-server-9975d5f86-ltrjr_kube-system(cbdf526e-ee8e-4fbf-83b1-066d29ec1239)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0612 21:43:39.244580 5540 logs.go:138] Found kubelet problem: Jun 12 21:43:17 old-k8s-version-606600 kubelet[1666]: E0612 21:43:17.271765 1666 pod_workers.go:191] Error syncing pod 7700737f-ee51-48c5-9fc0-24437fe76fbf ("dashboard-metrics-scraper-8d5bb5db8-qrxqz_kubernetes-dashboard(7700737f-ee51-48c5-9fc0-24437fe76fbf)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0612 21:43:39.244580 5540 logs.go:138] Found kubelet problem: Jun 12 21:43:24 old-k8s-version-606600 kubelet[1666]: E0612 21:43:24.272689 1666 pod_workers.go:191] Error syncing pod cbdf526e-ee8e-4fbf-83b1-066d29ec1239 ("metrics-server-9975d5f86-ltrjr_kube-system(cbdf526e-ee8e-4fbf-83b1-066d29ec1239)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0612 21:43:39.244580 5540 logs.go:138] Found kubelet problem: Jun 12 21:43:32 old-k8s-version-606600 kubelet[1666]: E0612 21:43:32.269407 1666 pod_workers.go:191] Error syncing pod 7700737f-ee51-48c5-9fc0-24437fe76fbf ("dashboard-metrics-scraper-8d5bb5db8-qrxqz_kubernetes-dashboard(7700737f-ee51-48c5-9fc0-24437fe76fbf)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0612 21:43:39.244580 5540 logs.go:138] Found kubelet problem: Jun 12 21:43:38 old-k8s-version-606600 kubelet[1666]: E0612 21:43:38.270486 1666 pod_workers.go:191] Error syncing pod cbdf526e-ee8e-4fbf-83b1-066d29ec1239 ("metrics-server-9975d5f86-ltrjr_kube-system(cbdf526e-ee8e-4fbf-83b1-066d29ec1239)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
I0612 21:43:39.244580 5540 logs.go:123] Gathering logs for dmesg ...
I0612 21:43:39.245580 5540 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0612 21:43:39.279938 5540 logs.go:123] Gathering logs for kube-controller-manager [6116c6070393] ...
I0612 21:43:39.279938 5540 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 6116c6070393"
I0612 21:43:39.359195 5540 logs.go:123] Gathering logs for storage-provisioner [3f440bc35ac0] ...
I0612 21:43:39.359195 5540 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 3f440bc35ac0"
I0612 21:43:39.412949 5540 logs.go:123] Gathering logs for container status ...
I0612 21:43:39.412949 5540 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0612 21:43:39.532262 5540 logs.go:123] Gathering logs for kube-scheduler [6dcf6b435dcb] ...
I0612 21:43:39.532262 5540 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 6dcf6b435dcb"
I0612 21:43:39.610353 5540 logs.go:123] Gathering logs for kube-proxy [c87af550bb83] ...
I0612 21:43:39.610353 5540 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c87af550bb83"
I0612 21:43:39.673064 5540 out.go:304] Setting ErrFile to fd 1608...
I0612 21:43:39.673064 5540 out.go:338] TERM=,COLORTERM=, which probably does not support color
W0612 21:43:39.673064 5540 out.go:239] X Problems detected in kubelet:
X Problems detected in kubelet:
W0612 21:43:39.673064 5540 out.go:239] Jun 12 21:43:10 old-k8s-version-606600 kubelet[1666]: E0612 21:43:10.273566 1666 pod_workers.go:191] Error syncing pod cbdf526e-ee8e-4fbf-83b1-066d29ec1239 ("metrics-server-9975d5f86-ltrjr_kube-system(cbdf526e-ee8e-4fbf-83b1-066d29ec1239)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Jun 12 21:43:10 old-k8s-version-606600 kubelet[1666]: E0612 21:43:10.273566 1666 pod_workers.go:191] Error syncing pod cbdf526e-ee8e-4fbf-83b1-066d29ec1239 ("metrics-server-9975d5f86-ltrjr_kube-system(cbdf526e-ee8e-4fbf-83b1-066d29ec1239)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0612 21:43:39.673064 5540 out.go:239] Jun 12 21:43:17 old-k8s-version-606600 kubelet[1666]: E0612 21:43:17.271765 1666 pod_workers.go:191] Error syncing pod 7700737f-ee51-48c5-9fc0-24437fe76fbf ("dashboard-metrics-scraper-8d5bb5db8-qrxqz_kubernetes-dashboard(7700737f-ee51-48c5-9fc0-24437fe76fbf)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
Jun 12 21:43:17 old-k8s-version-606600 kubelet[1666]: E0612 21:43:17.271765 1666 pod_workers.go:191] Error syncing pod 7700737f-ee51-48c5-9fc0-24437fe76fbf ("dashboard-metrics-scraper-8d5bb5db8-qrxqz_kubernetes-dashboard(7700737f-ee51-48c5-9fc0-24437fe76fbf)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0612 21:43:39.673064 5540 out.go:239] Jun 12 21:43:24 old-k8s-version-606600 kubelet[1666]: E0612 21:43:24.272689 1666 pod_workers.go:191] Error syncing pod cbdf526e-ee8e-4fbf-83b1-066d29ec1239 ("metrics-server-9975d5f86-ltrjr_kube-system(cbdf526e-ee8e-4fbf-83b1-066d29ec1239)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Jun 12 21:43:24 old-k8s-version-606600 kubelet[1666]: E0612 21:43:24.272689 1666 pod_workers.go:191] Error syncing pod cbdf526e-ee8e-4fbf-83b1-066d29ec1239 ("metrics-server-9975d5f86-ltrjr_kube-system(cbdf526e-ee8e-4fbf-83b1-066d29ec1239)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0612 21:43:39.673064 5540 out.go:239] Jun 12 21:43:32 old-k8s-version-606600 kubelet[1666]: E0612 21:43:32.269407 1666 pod_workers.go:191] Error syncing pod 7700737f-ee51-48c5-9fc0-24437fe76fbf ("dashboard-metrics-scraper-8d5bb5db8-qrxqz_kubernetes-dashboard(7700737f-ee51-48c5-9fc0-24437fe76fbf)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
Jun 12 21:43:32 old-k8s-version-606600 kubelet[1666]: E0612 21:43:32.269407 1666 pod_workers.go:191] Error syncing pod 7700737f-ee51-48c5-9fc0-24437fe76fbf ("dashboard-metrics-scraper-8d5bb5db8-qrxqz_kubernetes-dashboard(7700737f-ee51-48c5-9fc0-24437fe76fbf)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0612 21:43:39.673064 5540 out.go:239] Jun 12 21:43:38 old-k8s-version-606600 kubelet[1666]: E0612 21:43:38.270486 1666 pod_workers.go:191] Error syncing pod cbdf526e-ee8e-4fbf-83b1-066d29ec1239 ("metrics-server-9975d5f86-ltrjr_kube-system(cbdf526e-ee8e-4fbf-83b1-066d29ec1239)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Jun 12 21:43:38 old-k8s-version-606600 kubelet[1666]: E0612 21:43:38.270486 1666 pod_workers.go:191] Error syncing pod cbdf526e-ee8e-4fbf-83b1-066d29ec1239 ("metrics-server-9975d5f86-ltrjr_kube-system(cbdf526e-ee8e-4fbf-83b1-066d29ec1239)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
I0612 21:43:39.673064 5540 out.go:304] Setting ErrFile to fd 1608...
I0612 21:43:39.674067 5540 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0612 21:43:49.698780 5540 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0612 21:43:49.729251 5540 api_server.go:72] duration metric: took 5m48.6945134s to wait for apiserver process to appear ...
I0612 21:43:49.729251 5540 api_server.go:88] waiting for apiserver healthz status ...
I0612 21:43:49.741940 5540 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
I0612 21:43:49.794503 5540 logs.go:276] 2 containers: [559ffac3c414 08372f67ca60]
I0612 21:43:49.803495 5540 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
I0612 21:43:49.863871 5540 logs.go:276] 2 containers: [48b924cc9ca8 d65a86407319]
I0612 21:43:49.879866 5540 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
I0612 21:43:49.936663 5540 logs.go:276] 2 containers: [78fd0bd54f7f b5adbbbe1b1d]
I0612 21:43:49.945694 5540 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
I0612 21:43:49.998681 5540 logs.go:276] 2 containers: [dc6968d98409 6dcf6b435dcb]
I0612 21:43:50.008690 5540 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
I0612 21:43:50.063514 5540 logs.go:276] 2 containers: [c87af550bb83 9bdf65930601]
I0612 21:43:50.080336 5540 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
I0612 21:43:50.124684 5540 logs.go:276] 2 containers: [6116c6070393 5491a5e5dcb9]
I0612 21:43:50.136933 5540 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
I0612 21:43:50.191900 5540 logs.go:276] 0 containers: []
W0612 21:43:50.191900 5540 logs.go:278] No container was found matching "kindnet"
I0612 21:43:50.200918 5540 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
I0612 21:43:50.245616 5540 logs.go:276] 2 containers: [380c76a7ac65 3f440bc35ac0]
I0612 21:43:50.269864 5540 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kubernetes-dashboard --format={{.ID}}
I0612 21:43:50.322137 5540 logs.go:276] 1 containers: [ed7189bae68d]
I0612 21:43:50.322312 5540 logs.go:123] Gathering logs for kube-scheduler [6dcf6b435dcb] ...
I0612 21:43:50.322312 5540 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 6dcf6b435dcb"
I0612 21:43:50.382144 5540 logs.go:123] Gathering logs for storage-provisioner [3f440bc35ac0] ...
I0612 21:43:50.382144 5540 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 3f440bc35ac0"
I0612 21:43:50.423259 5540 logs.go:123] Gathering logs for container status ...
I0612 21:43:50.423259 5540 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0612 21:43:50.545402 5540 logs.go:123] Gathering logs for kubelet ...
I0612 21:43:50.545402 5540 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
W0612 21:43:50.667055 5540 logs.go:138] Found kubelet problem: Jun 12 21:38:18 old-k8s-version-606600 kubelet[1666]: E0612 21:38:18.108202 1666 pod_workers.go:191] Error syncing pod cbdf526e-ee8e-4fbf-83b1-066d29ec1239 ("metrics-server-9975d5f86-ltrjr_kube-system(cbdf526e-ee8e-4fbf-83b1-066d29ec1239)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = Error response from daemon: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.65.254:53: no such host"
W0612 21:43:50.668068 5540 logs.go:138] Found kubelet problem: Jun 12 21:38:18 old-k8s-version-606600 kubelet[1666]: E0612 21:38:18.197645 1666 pod_workers.go:191] Error syncing pod cbdf526e-ee8e-4fbf-83b1-066d29ec1239 ("metrics-server-9975d5f86-ltrjr_kube-system(cbdf526e-ee8e-4fbf-83b1-066d29ec1239)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0612 21:43:50.669051 5540 logs.go:138] Found kubelet problem: Jun 12 21:38:19 old-k8s-version-606600 kubelet[1666]: E0612 21:38:19.232272 1666 pod_workers.go:191] Error syncing pod cbdf526e-ee8e-4fbf-83b1-066d29ec1239 ("metrics-server-9975d5f86-ltrjr_kube-system(cbdf526e-ee8e-4fbf-83b1-066d29ec1239)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0612 21:43:50.671050 5540 logs.go:138] Found kubelet problem: Jun 12 21:38:34 old-k8s-version-606600 kubelet[1666]: E0612 21:38:34.085575 1666 reflector.go:138] object-"kubernetes-dashboard"/"kubernetes-dashboard-token-zgnbp": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kubernetes-dashboard-token-zgnbp" is forbidden: User "system:node:old-k8s-version-606600" cannot list resource "secrets" in API group "" in the namespace "kubernetes-dashboard": no relationship found between node 'old-k8s-version-606600' and this object
W0612 21:43:50.676043 5540 logs.go:138] Found kubelet problem: Jun 12 21:38:34 old-k8s-version-606600 kubelet[1666]: E0612 21:38:34.495556 1666 pod_workers.go:191] Error syncing pod cbdf526e-ee8e-4fbf-83b1-066d29ec1239 ("metrics-server-9975d5f86-ltrjr_kube-system(cbdf526e-ee8e-4fbf-83b1-066d29ec1239)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = Error response from daemon: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.65.254:53: no such host"
W0612 21:43:50.683041 5540 logs.go:138] Found kubelet problem: Jun 12 21:38:37 old-k8s-version-606600 kubelet[1666]: E0612 21:38:37.256650 1666 pod_workers.go:191] Error syncing pod 7700737f-ee51-48c5-9fc0-24437fe76fbf ("dashboard-metrics-scraper-8d5bb5db8-qrxqz_kubernetes-dashboard(7700737f-ee51-48c5-9fc0-24437fe76fbf)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ErrImagePull: "rpc error: code = Unknown desc = [DEPRECATION NOTICE] Docker Image Format v1 and Docker Image manifest version 2, schema 1 support is disabled by default and will be removed in an upcoming release. Suggest the author of registry.k8s.io/echoserver:1.4 to upgrade the image to the OCI Format or Docker Image manifest v2, schema 2. More information at https://docs.docker.com/go/deprecated-image-specs/"
W0612 21:43:50.684040 5540 logs.go:138] Found kubelet problem: Jun 12 21:38:37 old-k8s-version-606600 kubelet[1666]: E0612 21:38:37.889727 1666 pod_workers.go:191] Error syncing pod 7700737f-ee51-48c5-9fc0-24437fe76fbf ("dashboard-metrics-scraper-8d5bb5db8-qrxqz_kubernetes-dashboard(7700737f-ee51-48c5-9fc0-24437fe76fbf)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0612 21:43:50.684040 5540 logs.go:138] Found kubelet problem: Jun 12 21:38:38 old-k8s-version-606600 kubelet[1666]: E0612 21:38:38.912678 1666 pod_workers.go:191] Error syncing pod 7700737f-ee51-48c5-9fc0-24437fe76fbf ("dashboard-metrics-scraper-8d5bb5db8-qrxqz_kubernetes-dashboard(7700737f-ee51-48c5-9fc0-24437fe76fbf)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0612 21:43:50.686031 5540 logs.go:138] Found kubelet problem: Jun 12 21:38:39 old-k8s-version-606600 kubelet[1666]: E0612 21:38:39.950470 1666 pod_workers.go:191] Error syncing pod 12c0e34d-3bef-4207-9e19-43c91aea19c2 ("storage-provisioner_kube-system(12c0e34d-3bef-4207-9e19-43c91aea19c2)"), skipping: failed to "StartContainer" for "storage-provisioner" with CrashLoopBackOff: "back-off 10s restarting failed container=storage-provisioner pod=storage-provisioner_kube-system(12c0e34d-3bef-4207-9e19-43c91aea19c2)"
W0612 21:43:50.686031 5540 logs.go:138] Found kubelet problem: Jun 12 21:38:45 old-k8s-version-606600 kubelet[1666]: E0612 21:38:45.301360 1666 pod_workers.go:191] Error syncing pod cbdf526e-ee8e-4fbf-83b1-066d29ec1239 ("metrics-server-9975d5f86-ltrjr_kube-system(cbdf526e-ee8e-4fbf-83b1-066d29ec1239)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0612 21:43:50.692034 5540 logs.go:138] Found kubelet problem: Jun 12 21:39:00 old-k8s-version-606600 kubelet[1666]: E0612 21:39:00.285017 1666 pod_workers.go:191] Error syncing pod 7700737f-ee51-48c5-9fc0-24437fe76fbf ("dashboard-metrics-scraper-8d5bb5db8-qrxqz_kubernetes-dashboard(7700737f-ee51-48c5-9fc0-24437fe76fbf)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ErrImagePull: "rpc error: code = Unknown desc = [DEPRECATION NOTICE] Docker Image Format v1 and Docker Image manifest version 2, schema 1 support is disabled by default and will be removed in an upcoming release. Suggest the author of registry.k8s.io/echoserver:1.4 to upgrade the image to the OCI Format or Docker Image manifest v2, schema 2. More information at https://docs.docker.com/go/deprecated-image-specs/"
W0612 21:43:50.695641 5540 logs.go:138] Found kubelet problem: Jun 12 21:39:00 old-k8s-version-606600 kubelet[1666]: E0612 21:39:00.377954 1666 pod_workers.go:191] Error syncing pod cbdf526e-ee8e-4fbf-83b1-066d29ec1239 ("metrics-server-9975d5f86-ltrjr_kube-system(cbdf526e-ee8e-4fbf-83b1-066d29ec1239)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = Error response from daemon: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.65.254:53: no such host"
W0612 21:43:50.695641 5540 logs.go:138] Found kubelet problem: Jun 12 21:39:12 old-k8s-version-606600 kubelet[1666]: E0612 21:39:12.297156 1666 pod_workers.go:191] Error syncing pod 7700737f-ee51-48c5-9fc0-24437fe76fbf ("dashboard-metrics-scraper-8d5bb5db8-qrxqz_kubernetes-dashboard(7700737f-ee51-48c5-9fc0-24437fe76fbf)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0612 21:43:50.696642 5540 logs.go:138] Found kubelet problem: Jun 12 21:39:12 old-k8s-version-606600 kubelet[1666]: E0612 21:39:12.297233 1666 pod_workers.go:191] Error syncing pod cbdf526e-ee8e-4fbf-83b1-066d29ec1239 ("metrics-server-9975d5f86-ltrjr_kube-system(cbdf526e-ee8e-4fbf-83b1-066d29ec1239)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0612 21:43:50.696642 5540 logs.go:138] Found kubelet problem: Jun 12 21:39:23 old-k8s-version-606600 kubelet[1666]: E0612 21:39:23.296706 1666 pod_workers.go:191] Error syncing pod cbdf526e-ee8e-4fbf-83b1-066d29ec1239 ("metrics-server-9975d5f86-ltrjr_kube-system(cbdf526e-ee8e-4fbf-83b1-066d29ec1239)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0612 21:43:50.700674 5540 logs.go:138] Found kubelet problem: Jun 12 21:39:27 old-k8s-version-606600 kubelet[1666]: E0612 21:39:27.717082 1666 pod_workers.go:191] Error syncing pod 7700737f-ee51-48c5-9fc0-24437fe76fbf ("dashboard-metrics-scraper-8d5bb5db8-qrxqz_kubernetes-dashboard(7700737f-ee51-48c5-9fc0-24437fe76fbf)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ErrImagePull: "rpc error: code = Unknown desc = [DEPRECATION NOTICE] Docker Image Format v1 and Docker Image manifest version 2, schema 1 support is disabled by default and will be removed in an upcoming release. Suggest the author of registry.k8s.io/echoserver:1.4 to upgrade the image to the OCI Format or Docker Image manifest v2, schema 2. More information at https://docs.docker.com/go/deprecated-image-specs/"
W0612 21:43:50.700674 5540 logs.go:138] Found kubelet problem: Jun 12 21:39:34 old-k8s-version-606600 kubelet[1666]: E0612 21:39:34.293373 1666 pod_workers.go:191] Error syncing pod cbdf526e-ee8e-4fbf-83b1-066d29ec1239 ("metrics-server-9975d5f86-ltrjr_kube-system(cbdf526e-ee8e-4fbf-83b1-066d29ec1239)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0612 21:43:50.701637 5540 logs.go:138] Found kubelet problem: Jun 12 21:39:42 old-k8s-version-606600 kubelet[1666]: E0612 21:39:42.310173 1666 pod_workers.go:191] Error syncing pod 7700737f-ee51-48c5-9fc0-24437fe76fbf ("dashboard-metrics-scraper-8d5bb5db8-qrxqz_kubernetes-dashboard(7700737f-ee51-48c5-9fc0-24437fe76fbf)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0612 21:43:50.704640 5540 logs.go:138] Found kubelet problem: Jun 12 21:39:45 old-k8s-version-606600 kubelet[1666]: E0612 21:39:45.350617 1666 pod_workers.go:191] Error syncing pod cbdf526e-ee8e-4fbf-83b1-066d29ec1239 ("metrics-server-9975d5f86-ltrjr_kube-system(cbdf526e-ee8e-4fbf-83b1-066d29ec1239)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = Error response from daemon: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.65.254:53: no such host"
W0612 21:43:50.705639 5540 logs.go:138] Found kubelet problem: Jun 12 21:39:53 old-k8s-version-606600 kubelet[1666]: E0612 21:39:53.294158 1666 pod_workers.go:191] Error syncing pod 7700737f-ee51-48c5-9fc0-24437fe76fbf ("dashboard-metrics-scraper-8d5bb5db8-qrxqz_kubernetes-dashboard(7700737f-ee51-48c5-9fc0-24437fe76fbf)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0612 21:43:50.705639 5540 logs.go:138] Found kubelet problem: Jun 12 21:39:59 old-k8s-version-606600 kubelet[1666]: E0612 21:39:59.289780 1666 pod_workers.go:191] Error syncing pod cbdf526e-ee8e-4fbf-83b1-066d29ec1239 ("metrics-server-9975d5f86-ltrjr_kube-system(cbdf526e-ee8e-4fbf-83b1-066d29ec1239)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0612 21:43:50.705639 5540 logs.go:138] Found kubelet problem: Jun 12 21:40:06 old-k8s-version-606600 kubelet[1666]: E0612 21:40:06.290907 1666 pod_workers.go:191] Error syncing pod 7700737f-ee51-48c5-9fc0-24437fe76fbf ("dashboard-metrics-scraper-8d5bb5db8-qrxqz_kubernetes-dashboard(7700737f-ee51-48c5-9fc0-24437fe76fbf)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0612 21:43:50.706634 5540 logs.go:138] Found kubelet problem: Jun 12 21:40:14 old-k8s-version-606600 kubelet[1666]: E0612 21:40:14.295198 1666 pod_workers.go:191] Error syncing pod cbdf526e-ee8e-4fbf-83b1-066d29ec1239 ("metrics-server-9975d5f86-ltrjr_kube-system(cbdf526e-ee8e-4fbf-83b1-066d29ec1239)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0612 21:43:50.708640 5540 logs.go:138] Found kubelet problem: Jun 12 21:40:20 old-k8s-version-606600 kubelet[1666]: E0612 21:40:20.713009 1666 pod_workers.go:191] Error syncing pod 7700737f-ee51-48c5-9fc0-24437fe76fbf ("dashboard-metrics-scraper-8d5bb5db8-qrxqz_kubernetes-dashboard(7700737f-ee51-48c5-9fc0-24437fe76fbf)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ErrImagePull: "rpc error: code = Unknown desc = [DEPRECATION NOTICE] Docker Image Format v1 and Docker Image manifest version 2, schema 1 support is disabled by default and will be removed in an upcoming release. Suggest the author of registry.k8s.io/echoserver:1.4 to upgrade the image to the OCI Format or Docker Image manifest v2, schema 2. More information at https://docs.docker.com/go/deprecated-image-specs/"
W0612 21:43:50.708640 5540 logs.go:138] Found kubelet problem: Jun 12 21:40:27 old-k8s-version-606600 kubelet[1666]: E0612 21:40:27.292602 1666 pod_workers.go:191] Error syncing pod cbdf526e-ee8e-4fbf-83b1-066d29ec1239 ("metrics-server-9975d5f86-ltrjr_kube-system(cbdf526e-ee8e-4fbf-83b1-066d29ec1239)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0612 21:43:50.708640 5540 logs.go:138] Found kubelet problem: Jun 12 21:40:35 old-k8s-version-606600 kubelet[1666]: E0612 21:40:35.288460 1666 pod_workers.go:191] Error syncing pod 7700737f-ee51-48c5-9fc0-24437fe76fbf ("dashboard-metrics-scraper-8d5bb5db8-qrxqz_kubernetes-dashboard(7700737f-ee51-48c5-9fc0-24437fe76fbf)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0612 21:43:50.709640 5540 logs.go:138] Found kubelet problem: Jun 12 21:40:38 old-k8s-version-606600 kubelet[1666]: E0612 21:40:38.288195 1666 pod_workers.go:191] Error syncing pod cbdf526e-ee8e-4fbf-83b1-066d29ec1239 ("metrics-server-9975d5f86-ltrjr_kube-system(cbdf526e-ee8e-4fbf-83b1-066d29ec1239)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0612 21:43:50.709640 5540 logs.go:138] Found kubelet problem: Jun 12 21:40:48 old-k8s-version-606600 kubelet[1666]: E0612 21:40:48.304887 1666 pod_workers.go:191] Error syncing pod 7700737f-ee51-48c5-9fc0-24437fe76fbf ("dashboard-metrics-scraper-8d5bb5db8-qrxqz_kubernetes-dashboard(7700737f-ee51-48c5-9fc0-24437fe76fbf)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0612 21:43:50.709640 5540 logs.go:138] Found kubelet problem: Jun 12 21:40:49 old-k8s-version-606600 kubelet[1666]: E0612 21:40:49.287899 1666 pod_workers.go:191] Error syncing pod cbdf526e-ee8e-4fbf-83b1-066d29ec1239 ("metrics-server-9975d5f86-ltrjr_kube-system(cbdf526e-ee8e-4fbf-83b1-066d29ec1239)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0612 21:43:50.709640 5540 logs.go:138] Found kubelet problem: Jun 12 21:41:00 old-k8s-version-606600 kubelet[1666]: E0612 21:41:00.286411 1666 pod_workers.go:191] Error syncing pod cbdf526e-ee8e-4fbf-83b1-066d29ec1239 ("metrics-server-9975d5f86-ltrjr_kube-system(cbdf526e-ee8e-4fbf-83b1-066d29ec1239)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0612 21:43:50.709640 5540 logs.go:138] Found kubelet problem: Jun 12 21:41:03 old-k8s-version-606600 kubelet[1666]: E0612 21:41:03.286078 1666 pod_workers.go:191] Error syncing pod 7700737f-ee51-48c5-9fc0-24437fe76fbf ("dashboard-metrics-scraper-8d5bb5db8-qrxqz_kubernetes-dashboard(7700737f-ee51-48c5-9fc0-24437fe76fbf)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0612 21:43:50.711645 5540 logs.go:138] Found kubelet problem: Jun 12 21:41:12 old-k8s-version-606600 kubelet[1666]: E0612 21:41:12.338980 1666 pod_workers.go:191] Error syncing pod cbdf526e-ee8e-4fbf-83b1-066d29ec1239 ("metrics-server-9975d5f86-ltrjr_kube-system(cbdf526e-ee8e-4fbf-83b1-066d29ec1239)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = Error response from daemon: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.65.254:53: no such host"
W0612 21:43:50.712644 5540 logs.go:138] Found kubelet problem: Jun 12 21:41:16 old-k8s-version-606600 kubelet[1666]: E0612 21:41:16.369660 1666 pod_workers.go:191] Error syncing pod 7700737f-ee51-48c5-9fc0-24437fe76fbf ("dashboard-metrics-scraper-8d5bb5db8-qrxqz_kubernetes-dashboard(7700737f-ee51-48c5-9fc0-24437fe76fbf)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0612 21:43:50.712644 5540 logs.go:138] Found kubelet problem: Jun 12 21:41:25 old-k8s-version-606600 kubelet[1666]: E0612 21:41:25.285535 1666 pod_workers.go:191] Error syncing pod cbdf526e-ee8e-4fbf-83b1-066d29ec1239 ("metrics-server-9975d5f86-ltrjr_kube-system(cbdf526e-ee8e-4fbf-83b1-066d29ec1239)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0612 21:43:50.712644 5540 logs.go:138] Found kubelet problem: Jun 12 21:41:29 old-k8s-version-606600 kubelet[1666]: E0612 21:41:29.282908 1666 pod_workers.go:191] Error syncing pod 7700737f-ee51-48c5-9fc0-24437fe76fbf ("dashboard-metrics-scraper-8d5bb5db8-qrxqz_kubernetes-dashboard(7700737f-ee51-48c5-9fc0-24437fe76fbf)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0612 21:43:50.713633 5540 logs.go:138] Found kubelet problem: Jun 12 21:41:37 old-k8s-version-606600 kubelet[1666]: E0612 21:41:37.281613 1666 pod_workers.go:191] Error syncing pod cbdf526e-ee8e-4fbf-83b1-066d29ec1239 ("metrics-server-9975d5f86-ltrjr_kube-system(cbdf526e-ee8e-4fbf-83b1-066d29ec1239)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0612 21:43:50.722531 5540 logs.go:138] Found kubelet problem: Jun 12 21:41:46 old-k8s-version-606600 kubelet[1666]: E0612 21:41:46.818084 1666 pod_workers.go:191] Error syncing pod 7700737f-ee51-48c5-9fc0-24437fe76fbf ("dashboard-metrics-scraper-8d5bb5db8-qrxqz_kubernetes-dashboard(7700737f-ee51-48c5-9fc0-24437fe76fbf)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ErrImagePull: "rpc error: code = Unknown desc = [DEPRECATION NOTICE] Docker Image Format v1 and Docker Image manifest version 2, schema 1 support is disabled by default and will be removed in an upcoming release. Suggest the author of registry.k8s.io/echoserver:1.4 to upgrade the image to the OCI Format or Docker Image manifest v2, schema 2. More information at https://docs.docker.com/go/deprecated-image-specs/"
W0612 21:43:50.723389 5540 logs.go:138] Found kubelet problem: Jun 12 21:41:49 old-k8s-version-606600 kubelet[1666]: E0612 21:41:49.282375 1666 pod_workers.go:191] Error syncing pod cbdf526e-ee8e-4fbf-83b1-066d29ec1239 ("metrics-server-9975d5f86-ltrjr_kube-system(cbdf526e-ee8e-4fbf-83b1-066d29ec1239)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0612 21:43:50.723579 5540 logs.go:138] Found kubelet problem: Jun 12 21:41:58 old-k8s-version-606600 kubelet[1666]: E0612 21:41:58.301867 1666 pod_workers.go:191] Error syncing pod 7700737f-ee51-48c5-9fc0-24437fe76fbf ("dashboard-metrics-scraper-8d5bb5db8-qrxqz_kubernetes-dashboard(7700737f-ee51-48c5-9fc0-24437fe76fbf)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0612 21:43:50.724286 5540 logs.go:138] Found kubelet problem: Jun 12 21:42:04 old-k8s-version-606600 kubelet[1666]: E0612 21:42:04.282322 1666 pod_workers.go:191] Error syncing pod cbdf526e-ee8e-4fbf-83b1-066d29ec1239 ("metrics-server-9975d5f86-ltrjr_kube-system(cbdf526e-ee8e-4fbf-83b1-066d29ec1239)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0612 21:43:50.724705 5540 logs.go:138] Found kubelet problem: Jun 12 21:42:11 old-k8s-version-606600 kubelet[1666]: E0612 21:42:11.278999 1666 pod_workers.go:191] Error syncing pod 7700737f-ee51-48c5-9fc0-24437fe76fbf ("dashboard-metrics-scraper-8d5bb5db8-qrxqz_kubernetes-dashboard(7700737f-ee51-48c5-9fc0-24437fe76fbf)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0612 21:43:50.725186 5540 logs.go:138] Found kubelet problem: Jun 12 21:42:17 old-k8s-version-606600 kubelet[1666]: E0612 21:42:17.277966 1666 pod_workers.go:191] Error syncing pod cbdf526e-ee8e-4fbf-83b1-066d29ec1239 ("metrics-server-9975d5f86-ltrjr_kube-system(cbdf526e-ee8e-4fbf-83b1-066d29ec1239)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0612 21:43:50.725574 5540 logs.go:138] Found kubelet problem: Jun 12 21:42:23 old-k8s-version-606600 kubelet[1666]: E0612 21:42:23.279178 1666 pod_workers.go:191] Error syncing pod 7700737f-ee51-48c5-9fc0-24437fe76fbf ("dashboard-metrics-scraper-8d5bb5db8-qrxqz_kubernetes-dashboard(7700737f-ee51-48c5-9fc0-24437fe76fbf)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0612 21:43:50.725986 5540 logs.go:138] Found kubelet problem: Jun 12 21:42:31 old-k8s-version-606600 kubelet[1666]: E0612 21:42:31.276919 1666 pod_workers.go:191] Error syncing pod cbdf526e-ee8e-4fbf-83b1-066d29ec1239 ("metrics-server-9975d5f86-ltrjr_kube-system(cbdf526e-ee8e-4fbf-83b1-066d29ec1239)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0612 21:43:50.726352 5540 logs.go:138] Found kubelet problem: Jun 12 21:42:34 old-k8s-version-606600 kubelet[1666]: E0612 21:42:34.277134 1666 pod_workers.go:191] Error syncing pod 7700737f-ee51-48c5-9fc0-24437fe76fbf ("dashboard-metrics-scraper-8d5bb5db8-qrxqz_kubernetes-dashboard(7700737f-ee51-48c5-9fc0-24437fe76fbf)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0612 21:43:50.726794 5540 logs.go:138] Found kubelet problem: Jun 12 21:42:44 old-k8s-version-606600 kubelet[1666]: E0612 21:42:44.277354 1666 pod_workers.go:191] Error syncing pod cbdf526e-ee8e-4fbf-83b1-066d29ec1239 ("metrics-server-9975d5f86-ltrjr_kube-system(cbdf526e-ee8e-4fbf-83b1-066d29ec1239)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0612 21:43:50.727145 5540 logs.go:138] Found kubelet problem: Jun 12 21:42:49 old-k8s-version-606600 kubelet[1666]: E0612 21:42:49.279624 1666 pod_workers.go:191] Error syncing pod 7700737f-ee51-48c5-9fc0-24437fe76fbf ("dashboard-metrics-scraper-8d5bb5db8-qrxqz_kubernetes-dashboard(7700737f-ee51-48c5-9fc0-24437fe76fbf)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0612 21:43:50.727730 5540 logs.go:138] Found kubelet problem: Jun 12 21:42:59 old-k8s-version-606600 kubelet[1666]: E0612 21:42:59.280403 1666 pod_workers.go:191] Error syncing pod cbdf526e-ee8e-4fbf-83b1-066d29ec1239 ("metrics-server-9975d5f86-ltrjr_kube-system(cbdf526e-ee8e-4fbf-83b1-066d29ec1239)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0612 21:43:50.727730 5540 logs.go:138] Found kubelet problem: Jun 12 21:43:04 old-k8s-version-606600 kubelet[1666]: E0612 21:43:04.308191 1666 pod_workers.go:191] Error syncing pod 7700737f-ee51-48c5-9fc0-24437fe76fbf ("dashboard-metrics-scraper-8d5bb5db8-qrxqz_kubernetes-dashboard(7700737f-ee51-48c5-9fc0-24437fe76fbf)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0612 21:43:50.728263 5540 logs.go:138] Found kubelet problem: Jun 12 21:43:10 old-k8s-version-606600 kubelet[1666]: E0612 21:43:10.273566 1666 pod_workers.go:191] Error syncing pod cbdf526e-ee8e-4fbf-83b1-066d29ec1239 ("metrics-server-9975d5f86-ltrjr_kube-system(cbdf526e-ee8e-4fbf-83b1-066d29ec1239)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0612 21:43:50.728467 5540 logs.go:138] Found kubelet problem: Jun 12 21:43:17 old-k8s-version-606600 kubelet[1666]: E0612 21:43:17.271765 1666 pod_workers.go:191] Error syncing pod 7700737f-ee51-48c5-9fc0-24437fe76fbf ("dashboard-metrics-scraper-8d5bb5db8-qrxqz_kubernetes-dashboard(7700737f-ee51-48c5-9fc0-24437fe76fbf)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0612 21:43:50.728467 5540 logs.go:138] Found kubelet problem: Jun 12 21:43:24 old-k8s-version-606600 kubelet[1666]: E0612 21:43:24.272689 1666 pod_workers.go:191] Error syncing pod cbdf526e-ee8e-4fbf-83b1-066d29ec1239 ("metrics-server-9975d5f86-ltrjr_kube-system(cbdf526e-ee8e-4fbf-83b1-066d29ec1239)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0612 21:43:50.728467 5540 logs.go:138] Found kubelet problem: Jun 12 21:43:32 old-k8s-version-606600 kubelet[1666]: E0612 21:43:32.269407 1666 pod_workers.go:191] Error syncing pod 7700737f-ee51-48c5-9fc0-24437fe76fbf ("dashboard-metrics-scraper-8d5bb5db8-qrxqz_kubernetes-dashboard(7700737f-ee51-48c5-9fc0-24437fe76fbf)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0612 21:43:50.728467 5540 logs.go:138] Found kubelet problem: Jun 12 21:43:38 old-k8s-version-606600 kubelet[1666]: E0612 21:43:38.270486 1666 pod_workers.go:191] Error syncing pod cbdf526e-ee8e-4fbf-83b1-066d29ec1239 ("metrics-server-9975d5f86-ltrjr_kube-system(cbdf526e-ee8e-4fbf-83b1-066d29ec1239)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0612 21:43:50.729316 5540 logs.go:138] Found kubelet problem: Jun 12 21:43:46 old-k8s-version-606600 kubelet[1666]: E0612 21:43:46.270393 1666 pod_workers.go:191] Error syncing pod 7700737f-ee51-48c5-9fc0-24437fe76fbf ("dashboard-metrics-scraper-8d5bb5db8-qrxqz_kubernetes-dashboard(7700737f-ee51-48c5-9fc0-24437fe76fbf)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
I0612 21:43:50.729316 5540 logs.go:123] Gathering logs for describe nodes ...
I0612 21:43:50.729316 5540 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0612 21:43:51.007056 5540 logs.go:123] Gathering logs for kube-apiserver [08372f67ca60] ...
I0612 21:43:51.007286 5540 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 08372f67ca60"
I0612 21:43:51.111276 5540 logs.go:123] Gathering logs for etcd [d65a86407319] ...
I0612 21:43:51.111276 5540 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d65a86407319"
I0612 21:43:51.177308 5540 logs.go:123] Gathering logs for kubernetes-dashboard [ed7189bae68d] ...
I0612 21:43:51.177308 5540 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ed7189bae68d"
I0612 21:43:51.234681 5540 logs.go:123] Gathering logs for Docker ...
I0612 21:43:51.234681 5540 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
I0612 21:43:51.294684 5540 logs.go:123] Gathering logs for kube-scheduler [dc6968d98409] ...
I0612 21:43:51.294684 5540 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 dc6968d98409"
I0612 21:43:51.348008 5540 logs.go:123] Gathering logs for kube-proxy [c87af550bb83] ...
I0612 21:43:51.348008 5540 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c87af550bb83"
I0612 21:43:51.402988 5540 logs.go:123] Gathering logs for kube-proxy [9bdf65930601] ...
I0612 21:43:51.402988 5540 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 9bdf65930601"
I0612 21:43:51.466980 5540 logs.go:123] Gathering logs for kube-controller-manager [6116c6070393] ...
I0612 21:43:51.466980 5540 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 6116c6070393"
I0612 21:43:51.553849 5540 logs.go:123] Gathering logs for kube-controller-manager [5491a5e5dcb9] ...
I0612 21:43:51.553849 5540 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5491a5e5dcb9"
I0612 21:43:51.633858 5540 logs.go:123] Gathering logs for dmesg ...
I0612 21:43:51.633858 5540 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0612 21:43:51.661851 5540 logs.go:123] Gathering logs for etcd [48b924cc9ca8] ...
I0612 21:43:51.661851 5540 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 48b924cc9ca8"
I0612 21:43:51.732551 5540 logs.go:123] Gathering logs for coredns [b5adbbbe1b1d] ...
I0612 21:43:51.732551 5540 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b5adbbbe1b1d"
I0612 21:43:51.777558 5540 logs.go:123] Gathering logs for storage-provisioner [380c76a7ac65] ...
I0612 21:43:51.777558 5540 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 380c76a7ac65"
I0612 21:43:51.824457 5540 logs.go:123] Gathering logs for kube-apiserver [559ffac3c414] ...
I0612 21:43:51.824457 5540 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 559ffac3c414"
I0612 21:43:51.898707 5540 logs.go:123] Gathering logs for coredns [78fd0bd54f7f] ...
I0612 21:43:51.898707 5540 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 78fd0bd54f7f"
I0612 21:43:51.949732 5540 out.go:304] Setting ErrFile to fd 1608...
I0612 21:43:51.949732 5540 out.go:338] TERM=,COLORTERM=, which probably does not support color
W0612 21:43:51.949732 5540 out.go:239] X Problems detected in kubelet:
X Problems detected in kubelet:
W0612 21:43:51.949732 5540 out.go:239] Jun 12 21:43:17 old-k8s-version-606600 kubelet[1666]: E0612 21:43:17.271765 1666 pod_workers.go:191] Error syncing pod 7700737f-ee51-48c5-9fc0-24437fe76fbf ("dashboard-metrics-scraper-8d5bb5db8-qrxqz_kubernetes-dashboard(7700737f-ee51-48c5-9fc0-24437fe76fbf)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
Jun 12 21:43:17 old-k8s-version-606600 kubelet[1666]: E0612 21:43:17.271765 1666 pod_workers.go:191] Error syncing pod 7700737f-ee51-48c5-9fc0-24437fe76fbf ("dashboard-metrics-scraper-8d5bb5db8-qrxqz_kubernetes-dashboard(7700737f-ee51-48c5-9fc0-24437fe76fbf)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0612 21:43:51.949732 5540 out.go:239] Jun 12 21:43:24 old-k8s-version-606600 kubelet[1666]: E0612 21:43:24.272689 1666 pod_workers.go:191] Error syncing pod cbdf526e-ee8e-4fbf-83b1-066d29ec1239 ("metrics-server-9975d5f86-ltrjr_kube-system(cbdf526e-ee8e-4fbf-83b1-066d29ec1239)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Jun 12 21:43:24 old-k8s-version-606600 kubelet[1666]: E0612 21:43:24.272689 1666 pod_workers.go:191] Error syncing pod cbdf526e-ee8e-4fbf-83b1-066d29ec1239 ("metrics-server-9975d5f86-ltrjr_kube-system(cbdf526e-ee8e-4fbf-83b1-066d29ec1239)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0612 21:43:51.949732 5540 out.go:239] Jun 12 21:43:32 old-k8s-version-606600 kubelet[1666]: E0612 21:43:32.269407 1666 pod_workers.go:191] Error syncing pod 7700737f-ee51-48c5-9fc0-24437fe76fbf ("dashboard-metrics-scraper-8d5bb5db8-qrxqz_kubernetes-dashboard(7700737f-ee51-48c5-9fc0-24437fe76fbf)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
Jun 12 21:43:32 old-k8s-version-606600 kubelet[1666]: E0612 21:43:32.269407 1666 pod_workers.go:191] Error syncing pod 7700737f-ee51-48c5-9fc0-24437fe76fbf ("dashboard-metrics-scraper-8d5bb5db8-qrxqz_kubernetes-dashboard(7700737f-ee51-48c5-9fc0-24437fe76fbf)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0612 21:43:51.949732 5540 out.go:239] Jun 12 21:43:38 old-k8s-version-606600 kubelet[1666]: E0612 21:43:38.270486 1666 pod_workers.go:191] Error syncing pod cbdf526e-ee8e-4fbf-83b1-066d29ec1239 ("metrics-server-9975d5f86-ltrjr_kube-system(cbdf526e-ee8e-4fbf-83b1-066d29ec1239)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Jun 12 21:43:38 old-k8s-version-606600 kubelet[1666]: E0612 21:43:38.270486 1666 pod_workers.go:191] Error syncing pod cbdf526e-ee8e-4fbf-83b1-066d29ec1239 ("metrics-server-9975d5f86-ltrjr_kube-system(cbdf526e-ee8e-4fbf-83b1-066d29ec1239)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0612 21:43:51.949732 5540 out.go:239] Jun 12 21:43:46 old-k8s-version-606600 kubelet[1666]: E0612 21:43:46.270393 1666 pod_workers.go:191] Error syncing pod 7700737f-ee51-48c5-9fc0-24437fe76fbf ("dashboard-metrics-scraper-8d5bb5db8-qrxqz_kubernetes-dashboard(7700737f-ee51-48c5-9fc0-24437fe76fbf)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
Jun 12 21:43:46 old-k8s-version-606600 kubelet[1666]: E0612 21:43:46.270393 1666 pod_workers.go:191] Error syncing pod 7700737f-ee51-48c5-9fc0-24437fe76fbf ("dashboard-metrics-scraper-8d5bb5db8-qrxqz_kubernetes-dashboard(7700737f-ee51-48c5-9fc0-24437fe76fbf)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
I0612 21:43:51.949732 5540 out.go:304] Setting ErrFile to fd 1608...
I0612 21:43:51.949732 5540 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0612 21:44:01.971066 5540 api_server.go:253] Checking apiserver healthz at https://127.0.0.1:55191/healthz ...
I0612 21:44:02.002693 5540 api_server.go:279] https://127.0.0.1:55191/healthz returned 200:
ok
I0612 21:44:02.004714 5540 out.go:177]
W0612 21:44:02.006688 5540 out.go:239] X Exiting due to K8S_UNHEALTHY_CONTROL_PLANE: wait 6m0s for node: wait for healthy API server: controlPlane never updated to v1.20.0
X Exiting due to K8S_UNHEALTHY_CONTROL_PLANE: wait 6m0s for node: wait for healthy API server: controlPlane never updated to v1.20.0
W0612 21:44:02.006688 5540 out.go:239] * Suggestion: Control Plane could not update, try minikube delete --all --purge
* Suggestion: Control Plane could not update, try minikube delete --all --purge
W0612 21:44:02.007686 5540 out.go:239] * Related issue: https://github.com/kubernetes/minikube/issues/11417
* Related issue: https://github.com/kubernetes/minikube/issues/11417
W0612 21:44:02.007686 5540 out.go:239] *
*
W0612 21:44:02.008687 5540 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0612 21:44:02.010686 5540 out.go:177]
** /stderr **
start_stop_delete_test.go:259: failed to start minikube post-stop. args "out/minikube-windows-amd64.exe start -p old-k8s-version-606600 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --kubernetes-version=v1.20.0": exit status 102
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:230: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/SecondStart]: docker inspect <======
helpers_test.go:231: (dbg) Run: docker inspect old-k8s-version-606600
helpers_test.go:235: (dbg) docker inspect old-k8s-version-606600:
-- stdout --
[
{
"Id": "1ba9dbd45afa24b53d3131db6d1e6fbcba4f920123be4f7f74fe913c0e17aa27",
"Created": "2024-06-12T21:33:32.931755437Z",
"Path": "/usr/local/bin/entrypoint",
"Args": [
"/sbin/init"
],
"State": {
"Status": "running",
"Running": true,
"Paused": false,
"Restarting": false,
"OOMKilled": false,
"Dead": false,
"Pid": 290924,
"ExitCode": 0,
"Error": "",
"StartedAt": "2024-06-12T21:37:11.349642094Z",
"FinishedAt": "2024-06-12T21:37:05.950102087Z"
},
"Image": "sha256:f638882822564b2652a249029be66208d7c8545016c767a03adc3c12b54cbad8",
"ResolvConfPath": "/var/lib/docker/containers/1ba9dbd45afa24b53d3131db6d1e6fbcba4f920123be4f7f74fe913c0e17aa27/resolv.conf",
"HostnamePath": "/var/lib/docker/containers/1ba9dbd45afa24b53d3131db6d1e6fbcba4f920123be4f7f74fe913c0e17aa27/hostname",
"HostsPath": "/var/lib/docker/containers/1ba9dbd45afa24b53d3131db6d1e6fbcba4f920123be4f7f74fe913c0e17aa27/hosts",
"LogPath": "/var/lib/docker/containers/1ba9dbd45afa24b53d3131db6d1e6fbcba4f920123be4f7f74fe913c0e17aa27/1ba9dbd45afa24b53d3131db6d1e6fbcba4f920123be4f7f74fe913c0e17aa27-json.log",
"Name": "/old-k8s-version-606600",
"RestartCount": 0,
"Driver": "overlay2",
"Platform": "linux",
"MountLabel": "",
"ProcessLabel": "",
"AppArmorProfile": "",
"ExecIDs": null,
"HostConfig": {
"Binds": [
"/lib/modules:/lib/modules:ro",
"old-k8s-version-606600:/var"
],
"ContainerIDFile": "",
"LogConfig": {
"Type": "json-file",
"Config": {}
},
"NetworkMode": "old-k8s-version-606600",
"PortBindings": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "0"
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "0"
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "0"
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "0"
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "0"
}
]
},
"RestartPolicy": {
"Name": "no",
"MaximumRetryCount": 0
},
"AutoRemove": false,
"VolumeDriver": "",
"VolumesFrom": null,
"ConsoleSize": [
0,
0
],
"CapAdd": null,
"CapDrop": null,
"CgroupnsMode": "host",
"Dns": [],
"DnsOptions": [],
"DnsSearch": [],
"ExtraHosts": null,
"GroupAdd": null,
"IpcMode": "private",
"Cgroup": "",
"Links": null,
"OomScoreAdj": 0,
"PidMode": "",
"Privileged": true,
"PublishAllPorts": false,
"ReadonlyRootfs": false,
"SecurityOpt": [
"seccomp=unconfined",
"apparmor=unconfined",
"label=disable"
],
"Tmpfs": {
"/run": "",
"/tmp": ""
},
"UTSMode": "",
"UsernsMode": "",
"ShmSize": 67108864,
"Runtime": "runc",
"Isolation": "",
"CpuShares": 0,
"Memory": 2306867200,
"NanoCpus": 2000000000,
"CgroupParent": "",
"BlkioWeight": 0,
"BlkioWeightDevice": [],
"BlkioDeviceReadBps": [],
"BlkioDeviceWriteBps": [],
"BlkioDeviceReadIOps": [],
"BlkioDeviceWriteIOps": [],
"CpuPeriod": 0,
"CpuQuota": 0,
"CpuRealtimePeriod": 0,
"CpuRealtimeRuntime": 0,
"CpusetCpus": "",
"CpusetMems": "",
"Devices": [],
"DeviceCgroupRules": null,
"DeviceRequests": null,
"MemoryReservation": 0,
"MemorySwap": 2306867200,
"MemorySwappiness": null,
"OomKillDisable": false,
"PidsLimit": null,
"Ulimits": [],
"CpuCount": 0,
"CpuPercent": 0,
"IOMaximumIOps": 0,
"IOMaximumBandwidth": 0,
"MaskedPaths": null,
"ReadonlyPaths": null
},
"GraphDriver": {
"Data": {
"LowerDir": "/var/lib/docker/overlay2/1339204f77c4513a9d8bad61d58b8570c8b95976162ae319b9a8a3e511b84186-init/diff:/var/lib/docker/overlay2/cd57f78aaff40a22f73ba0d879d13e774a95dc875058a0c07807b1713e13d304/diff",
"MergedDir": "/var/lib/docker/overlay2/1339204f77c4513a9d8bad61d58b8570c8b95976162ae319b9a8a3e511b84186/merged",
"UpperDir": "/var/lib/docker/overlay2/1339204f77c4513a9d8bad61d58b8570c8b95976162ae319b9a8a3e511b84186/diff",
"WorkDir": "/var/lib/docker/overlay2/1339204f77c4513a9d8bad61d58b8570c8b95976162ae319b9a8a3e511b84186/work"
},
"Name": "overlay2"
},
"Mounts": [
{
"Type": "volume",
"Name": "old-k8s-version-606600",
"Source": "/var/lib/docker/volumes/old-k8s-version-606600/_data",
"Destination": "/var",
"Driver": "local",
"Mode": "z",
"RW": true,
"Propagation": ""
},
{
"Type": "bind",
"Source": "/lib/modules",
"Destination": "/lib/modules",
"Mode": "ro",
"RW": false,
"Propagation": "rprivate"
}
],
"Config": {
"Hostname": "old-k8s-version-606600",
"Domainname": "",
"User": "",
"AttachStdin": false,
"AttachStdout": false,
"AttachStderr": false,
"ExposedPorts": {
"22/tcp": {},
"2376/tcp": {},
"32443/tcp": {},
"5000/tcp": {},
"8443/tcp": {}
},
"Tty": true,
"OpenStdin": false,
"StdinOnce": false,
"Env": [
"container=docker",
"PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
],
"Cmd": null,
"Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1717668449-19038@sha256:30d191eb345232f513c52f7ac036e7a34a8cc441d88353f92985384bcddf00d6",
"Volumes": null,
"WorkingDir": "/",
"Entrypoint": [
"/usr/local/bin/entrypoint",
"/sbin/init"
],
"OnBuild": null,
"Labels": {
"created_by.minikube.sigs.k8s.io": "true",
"mode.minikube.sigs.k8s.io": "old-k8s-version-606600",
"name.minikube.sigs.k8s.io": "old-k8s-version-606600",
"role.minikube.sigs.k8s.io": ""
},
"StopSignal": "SIGRTMIN+3"
},
"NetworkSettings": {
"Bridge": "",
"SandboxID": "f2f970eabddfc3cf72addd903da23a21015fd660351e303d2deed90630a21b1d",
"SandboxKey": "/var/run/docker/netns/f2f970eabddf",
"Ports": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "55192"
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "55193"
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "55194"
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "55190"
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "55191"
}
]
},
"HairpinMode": false,
"LinkLocalIPv6Address": "",
"LinkLocalIPv6PrefixLen": 0,
"SecondaryIPAddresses": null,
"SecondaryIPv6Addresses": null,
"EndpointID": "",
"Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"IPAddress": "",
"IPPrefixLen": 0,
"IPv6Gateway": "",
"MacAddress": "",
"Networks": {
"old-k8s-version-606600": {
"IPAMConfig": {
"IPv4Address": "192.168.76.2"
},
"Links": null,
"Aliases": null,
"MacAddress": "02:42:c0:a8:4c:02",
"NetworkID": "a0326e96a44dbc55c2ff95583a790ec670f89a7bd01e826ff4e2fe52c06ecd0b",
"EndpointID": "7fa8e62cdc14327feace438e0a3114bffb7a8df1d2a062b01f3437106f649035",
"Gateway": "192.168.76.1",
"IPAddress": "192.168.76.2",
"IPPrefixLen": 24,
"IPv6Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"DriverOpts": null,
"DNSNames": [
"old-k8s-version-606600",
"1ba9dbd45afa"
]
}
}
}
}
]
-- /stdout --
helpers_test.go:239: (dbg) Run: out/minikube-windows-amd64.exe status --format={{.Host}} -p old-k8s-version-606600 -n old-k8s-version-606600
helpers_test.go:239: (dbg) Done: out/minikube-windows-amd64.exe status --format={{.Host}} -p old-k8s-version-606600 -n old-k8s-version-606600: (1.709703s)
helpers_test.go:244: <<< TestStartStop/group/old-k8s-version/serial/SecondStart FAILED: start of post-mortem logs <<<
helpers_test.go:245: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/SecondStart]: minikube logs <======
helpers_test.go:247: (dbg) Run: out/minikube-windows-amd64.exe -p old-k8s-version-606600 logs -n 25
helpers_test.go:247: (dbg) Done: out/minikube-windows-amd64.exe -p old-k8s-version-606600 logs -n 25: (4.0987862s)
helpers_test.go:252: TestStartStop/group/old-k8s-version/serial/SecondStart logs:
-- stdout --
==> Audit <==
|---------|--------------------------------------------------------|------------------------------|-------------------|---------|---------------------|---------------------|
| Command | Args | Profile | User | Version | Start Time | End Time |
|---------|--------------------------------------------------------|------------------------------|-------------------|---------|---------------------|---------------------|
| image | embed-certs-591400 image list | embed-certs-591400 | minikube4\jenkins | v1.33.1 | 12 Jun 24 21:41 UTC | 12 Jun 24 21:41 UTC |
| | --format=json | | | | | |
| pause | -p embed-certs-591400 | embed-certs-591400 | minikube4\jenkins | v1.33.1 | 12 Jun 24 21:41 UTC | 12 Jun 24 21:41 UTC |
| | --alsologtostderr -v=1 | | | | | |
| unpause | -p embed-certs-591400 | embed-certs-591400 | minikube4\jenkins | v1.33.1 | 12 Jun 24 21:41 UTC | 12 Jun 24 21:41 UTC |
| | --alsologtostderr -v=1 | | | | | |
| delete | -p embed-certs-591400 | embed-certs-591400 | minikube4\jenkins | v1.33.1 | 12 Jun 24 21:41 UTC | 12 Jun 24 21:41 UTC |
| delete | -p embed-certs-591400 | embed-certs-591400 | minikube4\jenkins | v1.33.1 | 12 Jun 24 21:41 UTC | 12 Jun 24 21:41 UTC |
| start | -p newest-cni-074000 --memory=2200 --alsologtostderr | newest-cni-074000 | minikube4\jenkins | v1.33.1 | 12 Jun 24 21:41 UTC | 12 Jun 24 21:42 UTC |
| | --wait=apiserver,system_pods,default_sa | | | | | |
| | --feature-gates ServerSideApply=true | | | | | |
| | --network-plugin=cni | | | | | |
| | --extra-config=kubeadm.pod-network-cidr=10.42.0.0/16 | | | | | |
| | --driver=docker --kubernetes-version=v1.30.1 | | | | | |
| image | no-preload-966000 image list | no-preload-966000 | minikube4\jenkins | v1.33.1 | 12 Jun 24 21:41 UTC | 12 Jun 24 21:41 UTC |
| | --format=json | | | | | |
| pause | -p no-preload-966000 | no-preload-966000 | minikube4\jenkins | v1.33.1 | 12 Jun 24 21:41 UTC | 12 Jun 24 21:41 UTC |
| | --alsologtostderr -v=1 | | | | | |
| unpause | -p no-preload-966000 | no-preload-966000 | minikube4\jenkins | v1.33.1 | 12 Jun 24 21:41 UTC | 12 Jun 24 21:42 UTC |
| | --alsologtostderr -v=1 | | | | | |
| delete | -p no-preload-966000 | no-preload-966000 | minikube4\jenkins | v1.33.1 | 12 Jun 24 21:42 UTC | 12 Jun 24 21:42 UTC |
| delete | -p no-preload-966000 | no-preload-966000 | minikube4\jenkins | v1.33.1 | 12 Jun 24 21:42 UTC | 12 Jun 24 21:42 UTC |
| start | -p auto-796900 --memory=3072 | auto-796900 | minikube4\jenkins | v1.33.1 | 12 Jun 24 21:42 UTC | |
| | --alsologtostderr --wait=true | | | | | |
| | --wait-timeout=15m | | | | | |
| | --driver=docker | | | | | |
| image | default-k8s-diff-port-668700 | default-k8s-diff-port-668700 | minikube4\jenkins | v1.33.1 | 12 Jun 24 21:42 UTC | 12 Jun 24 21:42 UTC |
| | image list --format=json | | | | | |
| pause | -p | default-k8s-diff-port-668700 | minikube4\jenkins | v1.33.1 | 12 Jun 24 21:42 UTC | 12 Jun 24 21:42 UTC |
| | default-k8s-diff-port-668700 | | | | | |
| | --alsologtostderr -v=1 | | | | | |
| unpause | -p | default-k8s-diff-port-668700 | minikube4\jenkins | v1.33.1 | 12 Jun 24 21:42 UTC | 12 Jun 24 21:42 UTC |
| | default-k8s-diff-port-668700 | | | | | |
| | --alsologtostderr -v=1 | | | | | |
| delete | -p | default-k8s-diff-port-668700 | minikube4\jenkins | v1.33.1 | 12 Jun 24 21:42 UTC | 12 Jun 24 21:42 UTC |
| | default-k8s-diff-port-668700 | | | | | |
| delete | -p | default-k8s-diff-port-668700 | minikube4\jenkins | v1.33.1 | 12 Jun 24 21:42 UTC | 12 Jun 24 21:42 UTC |
| | default-k8s-diff-port-668700 | | | | | |
| start | -p kindnet-796900 | kindnet-796900 | minikube4\jenkins | v1.33.1 | 12 Jun 24 21:42 UTC | |
| | --memory=3072 | | | | | |
| | --alsologtostderr --wait=true | | | | | |
| | --wait-timeout=15m | | | | | |
| | --cni=kindnet --driver=docker | | | | | |
| addons | enable metrics-server -p newest-cni-074000 | newest-cni-074000 | minikube4\jenkins | v1.33.1 | 12 Jun 24 21:42 UTC | 12 Jun 24 21:43 UTC |
| | --images=MetricsServer=registry.k8s.io/echoserver:1.4 | | | | | |
| | --registries=MetricsServer=fake.domain | | | | | |
| stop | -p newest-cni-074000 | newest-cni-074000 | minikube4\jenkins | v1.33.1 | 12 Jun 24 21:43 UTC | 12 Jun 24 21:43 UTC |
| | --alsologtostderr -v=3 | | | | | |
| addons | enable dashboard -p newest-cni-074000 | newest-cni-074000 | minikube4\jenkins | v1.33.1 | 12 Jun 24 21:43 UTC | 12 Jun 24 21:43 UTC |
| | --images=MetricsScraper=registry.k8s.io/echoserver:1.4 | | | | | |
| start | -p newest-cni-074000 --memory=2200 --alsologtostderr | newest-cni-074000 | minikube4\jenkins | v1.33.1 | 12 Jun 24 21:43 UTC | 12 Jun 24 21:43 UTC |
| | --wait=apiserver,system_pods,default_sa | | | | | |
| | --feature-gates ServerSideApply=true | | | | | |
| | --network-plugin=cni | | | | | |
| | --extra-config=kubeadm.pod-network-cidr=10.42.0.0/16 | | | | | |
| | --driver=docker --kubernetes-version=v1.30.1 | | | | | |
| image | newest-cni-074000 image list | newest-cni-074000 | minikube4\jenkins | v1.33.1 | 12 Jun 24 21:43 UTC | 12 Jun 24 21:43 UTC |
| | --format=json | | | | | |
| pause | -p newest-cni-074000 | newest-cni-074000 | minikube4\jenkins | v1.33.1 | 12 Jun 24 21:43 UTC | 12 Jun 24 21:43 UTC |
| | --alsologtostderr -v=1 | | | | | |
| unpause | -p newest-cni-074000 | newest-cni-074000 | minikube4\jenkins | v1.33.1 | 12 Jun 24 21:43 UTC | 12 Jun 24 21:44 UTC |
| | --alsologtostderr -v=1 | | | | | |
|---------|--------------------------------------------------------|------------------------------|-------------------|---------|---------------------|---------------------|
==> Last Start <==
Log file created at: 2024/06/12 21:43:16
Running on machine: minikube4
Binary: Built with gc go1.22.3 for windows/amd64
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
I0612 21:43:16.446550 10648 out.go:291] Setting OutFile to fd 1924 ...
I0612 21:43:16.446550 10648 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0612 21:43:16.446550 10648 out.go:304] Setting ErrFile to fd 1960...
I0612 21:43:16.446550 10648 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0612 21:43:16.483552 10648 out.go:298] Setting JSON to false
I0612 21:43:16.488584 10648 start.go:129] hostinfo: {"hostname":"minikube4","uptime":38881,"bootTime":1718189714,"procs":209,"os":"windows","platform":"Microsoft Windows 10 Enterprise N","platformFamily":"Standalone Workstation","platformVersion":"10.0.19045.4474 Build 19045.4474","kernelVersion":"10.0.19045.4474 Build 19045.4474","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"df6bfb5f-73f2-4acb-9365-df7854ecbb28"}
W0612 21:43:16.488584 10648 start.go:137] gopshost.Virtualization returned error: not implemented yet
I0612 21:43:16.492543 10648 out.go:177] * [newest-cni-074000] minikube v1.33.1 on Microsoft Windows 10 Enterprise N 10.0.19045.4474 Build 19045.4474
I0612 21:43:16.496542 10648 notify.go:220] Checking for updates...
I0612 21:43:16.498599 10648 out.go:177] - KUBECONFIG=C:\Users\jenkins.minikube4\minikube-integration\kubeconfig
I0612 21:43:16.500534 10648 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0612 21:43:16.502534 10648 out.go:177] - MINIKUBE_HOME=C:\Users\jenkins.minikube4\minikube-integration\.minikube
I0612 21:43:16.504530 10648 out.go:177] - MINIKUBE_LOCATION=17779
I0612 21:43:16.508532 10648 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0612 21:43:16.512534 10648 config.go:182] Loaded profile config "newest-cni-074000": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.30.1
I0612 21:43:16.513555 10648 driver.go:392] Setting default libvirt URI to qemu:///system
I0612 21:43:16.832767 10648 docker.go:122] docker version: linux-26.0.0:Docker Desktop 4.29.0 (145265)
I0612 21:43:16.844762 10648 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0612 21:43:17.261554 10648 info.go:266] docker info: {ID:a15b78d1-f772-48f7-bbf5-f8fe086f3f87 Containers:4 ContainersRunning:3 ContainersPaused:0 ContainersStopped:1 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:103 OomKillDisable:true NGoroutines:97 SystemTime:2024-06-12 21:43:17.215296366 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:14 KernelVersion:5.15.146.1-microsoft-standard-WSL2 OperatingSystem:Docker Desktop OSType:linux Architecture:x86_64 In
dexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:16 MemTotal:33657610240 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy:http.docker.internal:3128 HTTPSProxy:http.docker.internal:3128 NoProxy:hubproxy.docker.internal Name:docker-desktop Labels:[com.docker.desktop.address=npipe://\\.\pipe\docker_cli] ExperimentalBuild:false ServerVersion:26.0.0 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:ae07eda36dd25f8a1b98dfbf587313b99c0190bb Expected:ae07eda36dd25f8a1b98dfbf587313b99c0190bb} RuncCommit:{ID:v1.1.12-0-g51d5e94 Expected:v1.1.12-0-g51d5e94} InitCommit:{ID:de40ad0
Expected:de40ad0} SecurityOptions:[name=seccomp,profile=unconfined] ProductLicense: Warnings:[WARNING: No blkio throttle.read_bps_device support WARNING: No blkio throttle.write_bps_device support WARNING: No blkio throttle.read_iops_device support WARNING: No blkio throttle.write_iops_device support WARNING: daemon is not using the default seccomp profile] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:C:\Program Files\Docker\cli-plugins\docker-buildx.exe SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.13.1-desktop.1] map[Name:compose Path:C:\Program Files\Docker\cli-plugins\docker-compose.exe SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.26.1-desktop.1] map[Name:debug Path:C:\Program Files\Docker\cli-plugins\docker-debug.exe SchemaVersion:0.1.0 ShortDescription:Get a shell into any image or container. Vendor:Docker Inc. Version:0.0.27] map[Name:dev Path:C:\Program Files\Docker\cli-plugins\docker-dev.exe SchemaVersio
n:0.1.0 ShortDescription:Docker Dev Environments Vendor:Docker Inc. Version:v0.1.2] map[Name:extension Path:C:\Program Files\Docker\cli-plugins\docker-extension.exe SchemaVersion:0.1.0 ShortDescription:Manages Docker extensions Vendor:Docker Inc. Version:v0.2.23] map[Name:feedback Path:C:\Program Files\Docker\cli-plugins\docker-feedback.exe SchemaVersion:0.1.0 ShortDescription:Provide feedback, right in your terminal! Vendor:Docker Inc. Version:v1.0.4] map[Name:init Path:C:\Program Files\Docker\cli-plugins\docker-init.exe SchemaVersion:0.1.0 ShortDescription:Creates Docker-related starter files for your project Vendor:Docker Inc. Version:v1.1.0] map[Name:sbom Path:C:\Program Files\Docker\cli-plugins\docker-sbom.exe SchemaVersion:0.1.0 ShortDescription:View the packaged-based Software Bill Of Materials (SBOM) for an image URL:https://github.com/docker/sbom-cli-plugin Vendor:Anchore Inc. Version:0.6.0] map[Name:scout Path:C:\Program Files\Docker\cli-plugins\docker-scout.exe SchemaVersion:0.1.0 ShortDescription:
Docker Scout Vendor:Docker Inc. Version:v1.6.3]] Warnings:<nil>}}
I0612 21:43:17.266553 10648 out.go:177] * Using the docker driver based on existing profile
I0612 21:43:17.268563 10648 start.go:297] selected driver: docker
I0612 21:43:17.268563 10648 start.go:901] validating driver "docker" against &{Name:newest-cni-074000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1717668449-19038@sha256:30d191eb345232f513c52f7ac036e7a34a8cc441d88353f92985384bcddf00d6 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.1 ClusterName:newest-cni-074000 Namespace:default APIServerHAVIP: APIServerNa
me:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates:ServerSideApply=true ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:kubeadm Key:pod-network-cidr Value:10.42.0.0/16}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.94.2 Port:8443 KubernetesVersion:v1.30.1 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:false default_sa:true extra:false kubelet:false node_ready:false system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiN
odeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:C:\Users\jenkins.minikube4:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0612 21:43:17.268563 10648 start.go:912] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0612 21:43:17.345214 10648 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0612 21:43:17.716833 10648 info.go:266] docker info: {ID:a15b78d1-f772-48f7-bbf5-f8fe086f3f87 Containers:4 ContainersRunning:3 ContainersPaused:0 ContainersStopped:1 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:103 OomKillDisable:true NGoroutines:97 SystemTime:2024-06-12 21:43:17.656411002 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:14 KernelVersion:5.15.146.1-microsoft-standard-WSL2 OperatingSystem:Docker Desktop OSType:linux Architecture:x86_64 In
dexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:16 MemTotal:33657610240 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy:http.docker.internal:3128 HTTPSProxy:http.docker.internal:3128 NoProxy:hubproxy.docker.internal Name:docker-desktop Labels:[com.docker.desktop.address=npipe://\\.\pipe\docker_cli] ExperimentalBuild:false ServerVersion:26.0.0 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:ae07eda36dd25f8a1b98dfbf587313b99c0190bb Expected:ae07eda36dd25f8a1b98dfbf587313b99c0190bb} RuncCommit:{ID:v1.1.12-0-g51d5e94 Expected:v1.1.12-0-g51d5e94} InitCommit:{ID:de40ad0
Expected:de40ad0} SecurityOptions:[name=seccomp,profile=unconfined] ProductLicense: Warnings:[WARNING: No blkio throttle.read_bps_device support WARNING: No blkio throttle.write_bps_device support WARNING: No blkio throttle.read_iops_device support WARNING: No blkio throttle.write_iops_device support WARNING: daemon is not using the default seccomp profile] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:C:\Program Files\Docker\cli-plugins\docker-buildx.exe SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.13.1-desktop.1] map[Name:compose Path:C:\Program Files\Docker\cli-plugins\docker-compose.exe SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.26.1-desktop.1] map[Name:debug Path:C:\Program Files\Docker\cli-plugins\docker-debug.exe SchemaVersion:0.1.0 ShortDescription:Get a shell into any image or container. Vendor:Docker Inc. Version:0.0.27] map[Name:dev Path:C:\Program Files\Docker\cli-plugins\docker-dev.exe SchemaVersio
n:0.1.0 ShortDescription:Docker Dev Environments Vendor:Docker Inc. Version:v0.1.2] map[Name:extension Path:C:\Program Files\Docker\cli-plugins\docker-extension.exe SchemaVersion:0.1.0 ShortDescription:Manages Docker extensions Vendor:Docker Inc. Version:v0.2.23] map[Name:feedback Path:C:\Program Files\Docker\cli-plugins\docker-feedback.exe SchemaVersion:0.1.0 ShortDescription:Provide feedback, right in your terminal! Vendor:Docker Inc. Version:v1.0.4] map[Name:init Path:C:\Program Files\Docker\cli-plugins\docker-init.exe SchemaVersion:0.1.0 ShortDescription:Creates Docker-related starter files for your project Vendor:Docker Inc. Version:v1.1.0] map[Name:sbom Path:C:\Program Files\Docker\cli-plugins\docker-sbom.exe SchemaVersion:0.1.0 ShortDescription:View the packaged-based Software Bill Of Materials (SBOM) for an image URL:https://github.com/docker/sbom-cli-plugin Vendor:Anchore Inc. Version:0.6.0] map[Name:scout Path:C:\Program Files\Docker\cli-plugins\docker-scout.exe SchemaVersion:0.1.0 ShortDescription:
Docker Scout Vendor:Docker Inc. Version:v1.6.3]] Warnings:<nil>}}
I0612 21:43:17.717870 10648 start_flags.go:966] Waiting for components: map[apiserver:true apps_running:false default_sa:true extra:false kubelet:false node_ready:false system_pods:true]
I0612 21:43:17.717870 10648 cni.go:84] Creating CNI manager for ""
I0612 21:43:17.717958 10648 cni.go:158] "docker" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
I0612 21:43:17.718087 10648 start.go:340] cluster config:
{Name:newest-cni-074000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1717668449-19038@sha256:30d191eb345232f513c52f7ac036e7a34a8cc441d88353f92985384bcddf00d6 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.1 ClusterName:newest-cni-074000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local Containe
rRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates:ServerSideApply=true ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:kubeadm Key:pod-network-cidr Value:10.42.0.0/16}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.94.2 Port:8443 KubernetesVersion:v1.30.1 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:false default_sa:true extra:false kubelet:false node_ready:false system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountStrin
g:C:\Users\jenkins.minikube4:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0612 21:43:17.721502 10648 out.go:177] * Starting "newest-cni-074000" primary control-plane node in "newest-cni-074000" cluster
I0612 21:43:17.726013 10648 cache.go:121] Beginning downloading kic base image for docker with docker
I0612 21:43:17.728597 10648 out.go:177] * Pulling base image v0.0.44-1717668449-19038 ...
I0612 21:43:17.730597 10648 preload.go:132] Checking if preload exists for k8s version v1.30.1 and runtime docker
I0612 21:43:17.730597 10648 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1717668449-19038@sha256:30d191eb345232f513c52f7ac036e7a34a8cc441d88353f92985384bcddf00d6 in local docker daemon
I0612 21:43:17.730597 10648 preload.go:147] Found local preload: C:\Users\jenkins.minikube4\minikube-integration\.minikube\cache\preloaded-tarball\preloaded-images-k8s-v18-v1.30.1-docker-overlay2-amd64.tar.lz4
I0612 21:43:17.730597 10648 cache.go:56] Caching tarball of preloaded images
I0612 21:43:17.730597 10648 preload.go:173] Found C:\Users\jenkins.minikube4\minikube-integration\.minikube\cache\preloaded-tarball\preloaded-images-k8s-v18-v1.30.1-docker-overlay2-amd64.tar.lz4 in cache, skipping download
I0612 21:43:17.730597 10648 cache.go:59] Finished verifying existence of preloaded tar for v1.30.1 on docker
I0612 21:43:17.731602 10648 profile.go:143] Saving config to C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\newest-cni-074000\config.json ...
I0612 21:43:17.931767 10648 image.go:83] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1717668449-19038@sha256:30d191eb345232f513c52f7ac036e7a34a8cc441d88353f92985384bcddf00d6 in local docker daemon, skipping pull
I0612 21:43:17.931767 10648 cache.go:144] gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1717668449-19038@sha256:30d191eb345232f513c52f7ac036e7a34a8cc441d88353f92985384bcddf00d6 exists in daemon, skipping load
I0612 21:43:17.931767 10648 cache.go:194] Successfully downloaded all kic artifacts
I0612 21:43:17.931767 10648 start.go:360] acquireMachinesLock for newest-cni-074000: {Name:mk5749928e45e0fac5f0ced989d9344825dea19b Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0612 21:43:17.931767 10648 start.go:364] duration metric: took 0s to acquireMachinesLock for "newest-cni-074000"
I0612 21:43:17.931767 10648 start.go:96] Skipping create...Using existing machine configuration
I0612 21:43:17.931767 10648 fix.go:54] fixHost starting:
I0612 21:43:17.950774 10648 cli_runner.go:164] Run: docker container inspect newest-cni-074000 --format={{.State.Status}}
I0612 21:43:18.124458 10648 fix.go:112] recreateIfNeeded on newest-cni-074000: state=Stopped err=<nil>
W0612 21:43:18.124572 10648 fix.go:138] unexpected machine state, will restart: <nil>
I0612 21:43:18.127076 10648 out.go:177] * Restarting existing docker container for "newest-cni-074000" ...
I0612 21:43:14.902131 5540 pod_ready.go:102] pod "metrics-server-9975d5f86-ltrjr" in "kube-system" namespace has status "Ready":"False"
I0612 21:43:16.904775 5540 pod_ready.go:102] pod "metrics-server-9975d5f86-ltrjr" in "kube-system" namespace has status "Ready":"False"
I0612 21:43:15.901794 6548 out.go:204] * Preparing Kubernetes v1.30.1 on Docker 26.1.4 ...
I0612 21:43:15.912795 6548 cli_runner.go:164] Run: docker exec -t kindnet-796900 dig +short host.docker.internal
I0612 21:43:16.220813 6548 network.go:96] got host ip for mount in container by digging dns: 192.168.65.254
I0612 21:43:16.232814 6548 ssh_runner.go:195] Run: grep 192.168.65.254 host.minikube.internal$ /etc/hosts
I0612 21:43:16.244816 6548 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.65.254 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0612 21:43:16.297540 6548 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "8443/tcp") 0).HostPort}}'" kindnet-796900
I0612 21:43:16.475545 6548 kubeadm.go:877] updating cluster {Name:kindnet-796900 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1717668449-19038@sha256:30d191eb345232f513c52f7ac036e7a34a8cc441d88353f92985384bcddf00d6 Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.1 ClusterName:kindnet-796900 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServer
Names:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:kindnet} Nodes:[{Name: IP:192.168.121.2 Port:8443 KubernetesVersion:v1.30.1 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:C:\Users\jenkins.minikube4:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableM
etrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0612 21:43:16.475545 6548 preload.go:132] Checking if preload exists for k8s version v1.30.1 and runtime docker
I0612 21:43:16.490533 6548 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}
I0612 21:43:16.534532 6548 docker.go:685] Got preloaded images: -- stdout --
registry.k8s.io/kube-apiserver:v1.30.1
registry.k8s.io/kube-controller-manager:v1.30.1
registry.k8s.io/kube-scheduler:v1.30.1
registry.k8s.io/kube-proxy:v1.30.1
registry.k8s.io/etcd:3.5.12-0
registry.k8s.io/coredns/coredns:v1.11.1
registry.k8s.io/pause:3.9
gcr.io/k8s-minikube/storage-provisioner:v5
-- /stdout --
I0612 21:43:16.534532 6548 docker.go:615] Images already preloaded, skipping extraction
I0612 21:43:16.543539 6548 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}
I0612 21:43:16.602352 6548 docker.go:685] Got preloaded images: -- stdout --
registry.k8s.io/kube-apiserver:v1.30.1
registry.k8s.io/kube-scheduler:v1.30.1
registry.k8s.io/kube-controller-manager:v1.30.1
registry.k8s.io/kube-proxy:v1.30.1
registry.k8s.io/etcd:3.5.12-0
registry.k8s.io/coredns/coredns:v1.11.1
registry.k8s.io/pause:3.9
gcr.io/k8s-minikube/storage-provisioner:v5
-- /stdout --
I0612 21:43:16.602352 6548 cache_images.go:84] Images are preloaded, skipping loading
I0612 21:43:16.602352 6548 kubeadm.go:928] updating node { 192.168.121.2 8443 v1.30.1 docker true true} ...
I0612 21:43:16.602352 6548 kubeadm.go:940] kubelet [Unit]
Wants=docker.socket
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.30.1/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=kindnet-796900 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.121.2
[Install]
config:
{KubernetesVersion:v1.30.1 ClusterName:kindnet-796900 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:kindnet}
I0612 21:43:16.612348 6548 ssh_runner.go:195] Run: docker info --format {{.CgroupDriver}}
I0612 21:43:16.727230 6548 cni.go:84] Creating CNI manager for "kindnet"
I0612 21:43:16.728230 6548 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0612 21:43:16.728230 6548 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.121.2 APIServerPort:8443 KubernetesVersion:v1.30.1 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:kindnet-796900 NodeName:kindnet-796900 DNSDomain:cluster.local CRISocket:/var/run/cri-dockerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.121.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.121.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/
kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///var/run/cri-dockerd.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
I0612 21:43:16.728230 6548 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta3
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.121.2
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: unix:///var/run/cri-dockerd.sock
name: "kindnet-796900"
kubeletExtraArgs:
node-ip: 192.168.121.2
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta3
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.121.2"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.30.1
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
containerRuntimeEndpoint: unix:///var/run/cri-dockerd.sock
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%!"(MISSING)
nodefs.inodesFree: "0%!"(MISSING)
imagefs.available: "0%!"(MISSING)
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0612 21:43:16.740230 6548 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.30.1
I0612 21:43:16.761251 6548 binaries.go:44] Found k8s binaries, skipping transfer
I0612 21:43:16.782238 6548 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0612 21:43:16.810782 6548 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (314 bytes)
I0612 21:43:16.848765 6548 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0612 21:43:16.899822 6548 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2159 bytes)
I0612 21:43:16.958604 6548 ssh_runner.go:195] Run: grep 192.168.121.2 control-plane.minikube.internal$ /etc/hosts
I0612 21:43:16.968590 6548 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.121.2 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0612 21:43:17.028603 6548 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0612 21:43:17.228559 6548 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0612 21:43:17.262559 6548 certs.go:68] Setting up C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\kindnet-796900 for IP: 192.168.121.2
I0612 21:43:17.262559 6548 certs.go:194] generating shared ca certs ...
I0612 21:43:17.262559 6548 certs.go:226] acquiring lock for ca certs: {Name:mk92285f7546e1a5b3c3b23dab6135aa5a99cd14 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0612 21:43:17.263556 6548 certs.go:235] skipping valid "minikubeCA" ca cert: C:\Users\jenkins.minikube4\minikube-integration\.minikube\ca.key
I0612 21:43:17.263556 6548 certs.go:235] skipping valid "proxyClientCA" ca cert: C:\Users\jenkins.minikube4\minikube-integration\.minikube\proxy-client-ca.key
I0612 21:43:17.263556 6548 certs.go:256] generating profile certs ...
I0612 21:43:17.265582 6548 certs.go:363] generating signed profile cert for "minikube-user": C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\kindnet-796900\client.key
I0612 21:43:17.265582 6548 crypto.go:68] Generating cert C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\kindnet-796900\client.crt with IP's: []
I0612 21:43:17.657004 6548 crypto.go:156] Writing cert to C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\kindnet-796900\client.crt ...
I0612 21:43:17.658020 6548 lock.go:35] WriteFile acquiring C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\kindnet-796900\client.crt: {Name:mkfe60d997b31963f2353324aea086a5d27fd639 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0612 21:43:17.659006 6548 crypto.go:164] Writing key to C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\kindnet-796900\client.key ...
I0612 21:43:17.659006 6548 lock.go:35] WriteFile acquiring C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\kindnet-796900\client.key: {Name:mk4ecea1eabceb9b84600e9e1e840e7e73102a8a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0612 21:43:17.661001 6548 certs.go:363] generating signed profile cert for "minikube": C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\kindnet-796900\apiserver.key.88108a83
I0612 21:43:17.661001 6548 crypto.go:68] Generating cert C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\kindnet-796900\apiserver.crt.88108a83 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.121.2]
I0612 21:43:17.877600 6548 crypto.go:156] Writing cert to C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\kindnet-796900\apiserver.crt.88108a83 ...
I0612 21:43:17.877600 6548 lock.go:35] WriteFile acquiring C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\kindnet-796900\apiserver.crt.88108a83: {Name:mk06087717385612a7171477d60b3d9658b4a863 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0612 21:43:17.879466 6548 crypto.go:164] Writing key to C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\kindnet-796900\apiserver.key.88108a83 ...
I0612 21:43:17.879466 6548 lock.go:35] WriteFile acquiring C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\kindnet-796900\apiserver.key.88108a83: {Name:mkac11f093617e6d31b004fe84bde33541da70a8 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0612 21:43:17.880466 6548 certs.go:381] copying C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\kindnet-796900\apiserver.crt.88108a83 -> C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\kindnet-796900\apiserver.crt
I0612 21:43:17.895950 6548 certs.go:385] copying C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\kindnet-796900\apiserver.key.88108a83 -> C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\kindnet-796900\apiserver.key
I0612 21:43:17.897787 6548 certs.go:363] generating signed profile cert for "aggregator": C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\kindnet-796900\proxy-client.key
I0612 21:43:17.897787 6548 crypto.go:68] Generating cert C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\kindnet-796900\proxy-client.crt with IP's: []
I0612 21:43:18.107461 6548 crypto.go:156] Writing cert to C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\kindnet-796900\proxy-client.crt ...
I0612 21:43:18.107461 6548 lock.go:35] WriteFile acquiring C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\kindnet-796900\proxy-client.crt: {Name:mk1a3864c33f297df4da92c938b2ab56806a5292 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0612 21:43:18.108453 6548 crypto.go:164] Writing key to C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\kindnet-796900\proxy-client.key ...
I0612 21:43:18.108453 6548 lock.go:35] WriteFile acquiring C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\kindnet-796900\proxy-client.key: {Name:mk6ff3906c6db7a77c40fdc6659fa63c82fa0c76 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0612 21:43:18.121622 6548 certs.go:484] found cert: C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\6000.pem (1338 bytes)
W0612 21:43:18.122436 6548 certs.go:480] ignoring C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\6000_empty.pem, impossibly tiny 0 bytes
I0612 21:43:18.122436 6548 certs.go:484] found cert: C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\ca-key.pem (1679 bytes)
I0612 21:43:18.122436 6548 certs.go:484] found cert: C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\ca.pem (1082 bytes)
I0612 21:43:18.123126 6548 certs.go:484] found cert: C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\cert.pem (1123 bytes)
I0612 21:43:18.123445 6548 certs.go:484] found cert: C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\key.pem (1679 bytes)
I0612 21:43:18.123912 6548 certs.go:484] found cert: C:\Users\jenkins.minikube4\minikube-integration\.minikube\files\etc\ssl\certs\60002.pem (1708 bytes)
I0612 21:43:18.125436 6548 ssh_runner.go:362] scp C:\Users\jenkins.minikube4\minikube-integration\.minikube\ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0612 21:43:18.176078 6548 ssh_runner.go:362] scp C:\Users\jenkins.minikube4\minikube-integration\.minikube\ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
I0612 21:43:18.231549 6548 ssh_runner.go:362] scp C:\Users\jenkins.minikube4\minikube-integration\.minikube\proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0612 21:43:18.294075 6548 ssh_runner.go:362] scp C:\Users\jenkins.minikube4\minikube-integration\.minikube\proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I0612 21:43:18.357545 6548 ssh_runner.go:362] scp C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\kindnet-796900\apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1419 bytes)
I0612 21:43:18.416744 6548 ssh_runner.go:362] scp C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\kindnet-796900\apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
I0612 21:43:18.468859 6548 ssh_runner.go:362] scp C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\kindnet-796900\proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0612 21:43:18.524589 6548 ssh_runner.go:362] scp C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\kindnet-796900\proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I0612 21:43:18.578438 6548 ssh_runner.go:362] scp C:\Users\jenkins.minikube4\minikube-integration\.minikube\files\etc\ssl\certs\60002.pem --> /usr/share/ca-certificates/60002.pem (1708 bytes)
I0612 21:43:18.626500 6548 ssh_runner.go:362] scp C:\Users\jenkins.minikube4\minikube-integration\.minikube\ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0612 21:43:18.762190 6548 ssh_runner.go:362] scp C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\6000.pem --> /usr/share/ca-certificates/6000.pem (1338 bytes)
I0612 21:43:18.887663 6548 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0612 21:43:18.945016 6548 ssh_runner.go:195] Run: openssl version
I0612 21:43:18.986421 6548 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/60002.pem && ln -fs /usr/share/ca-certificates/60002.pem /etc/ssl/certs/60002.pem"
I0612 21:43:19.023017 6548 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/60002.pem
I0612 21:43:19.038543 6548 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Jun 12 20:25 /usr/share/ca-certificates/60002.pem
I0612 21:43:19.068639 6548 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/60002.pem
I0612 21:43:19.102658 6548 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/60002.pem /etc/ssl/certs/3ec20f2e.0"
I0612 21:43:19.140661 6548 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0612 21:43:19.192032 6548 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0612 21:43:19.205043 6548 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Jun 12 20:14 /usr/share/ca-certificates/minikubeCA.pem
I0612 21:43:19.225043 6548 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0612 21:43:19.263048 6548 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0612 21:43:18.139082 10648 cli_runner.go:164] Run: docker start newest-cni-074000
I0612 21:43:18.923030 10648 cli_runner.go:164] Run: docker container inspect newest-cni-074000 --format={{.State.Status}}
I0612 21:43:19.126652 10648 kic.go:430] container "newest-cni-074000" state is running.
I0612 21:43:19.146667 10648 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" newest-cni-074000
I0612 21:43:19.363036 10648 profile.go:143] Saving config to C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\newest-cni-074000\config.json ...
I0612 21:43:19.365046 10648 machine.go:94] provisionDockerMachine start ...
I0612 21:43:19.377036 10648 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" newest-cni-074000
I0612 21:43:19.578068 10648 main.go:141] libmachine: Using SSH client type: native
I0612 21:43:19.578068 10648 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x6ca540] 0x6cd120 <nil> [] 0s} 127.0.0.1 55598 <nil> <nil>}
I0612 21:43:19.578068 10648 main.go:141] libmachine: About to run SSH command:
hostname
I0612 21:43:19.581069 10648 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: EOF
I0612 21:43:18.916084 5540 pod_ready.go:102] pod "metrics-server-9975d5f86-ltrjr" in "kube-system" namespace has status "Ready":"False"
I0612 21:43:21.406000 5540 pod_ready.go:102] pod "metrics-server-9975d5f86-ltrjr" in "kube-system" namespace has status "Ready":"False"
I0612 21:43:23.414917 5540 pod_ready.go:102] pod "metrics-server-9975d5f86-ltrjr" in "kube-system" namespace has status "Ready":"False"
I0612 21:43:19.314046 6548 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/6000.pem && ln -fs /usr/share/ca-certificates/6000.pem /etc/ssl/certs/6000.pem"
I0612 21:43:19.349033 6548 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/6000.pem
I0612 21:43:19.363036 6548 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Jun 12 20:25 /usr/share/ca-certificates/6000.pem
I0612 21:43:19.383045 6548 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/6000.pem
I0612 21:43:19.415062 6548 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/6000.pem /etc/ssl/certs/51391683.0"
I0612 21:43:19.450044 6548 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0612 21:43:19.462052 6548 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I0612 21:43:19.462052 6548 kubeadm.go:391] StartCluster: {Name:kindnet-796900 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1717668449-19038@sha256:30d191eb345232f513c52f7ac036e7a34a8cc441d88353f92985384bcddf00d6 Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.1 ClusterName:kindnet-796900 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNam
es:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:kindnet} Nodes:[{Name: IP:192.168.121.2 Port:8443 KubernetesVersion:v1.30.1 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:C:\Users\jenkins.minikube4:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetr
ics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0612 21:43:19.479053 6548 ssh_runner.go:195] Run: docker ps --filter status=paused --filter=name=k8s_.*_(kube-system)_ --format={{.ID}}
I0612 21:43:19.546053 6548 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0612 21:43:19.594076 6548 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0612 21:43:19.616499 6548 kubeadm.go:213] ignoring SystemVerification for kubeadm because of docker driver
I0612 21:43:19.640765 6548 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0612 21:43:19.668668 6548 kubeadm.go:154] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0612 21:43:19.668668 6548 kubeadm.go:156] found existing configuration files:
I0612 21:43:19.691688 6548 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0612 21:43:19.712790 6548 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0612 21:43:19.727421 6548 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0612 21:43:19.770368 6548 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0612 21:43:19.800810 6548 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0612 21:43:19.820398 6548 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0612 21:43:19.869910 6548 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0612 21:43:19.894586 6548 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0612 21:43:19.911578 6548 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0612 21:43:19.953038 6548 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0612 21:43:19.983983 6548 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0612 21:43:19.999976 6548 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0612 21:43:20.018457 6548 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.30.1:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
I0612 21:43:20.204384 6548 kubeadm.go:309] [WARNING Swap]: swap is supported for cgroup v2 only; the NodeSwap feature gate of the kubelet is beta but disabled by default
I0612 21:43:20.405991 6548 kubeadm.go:309] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0612 21:43:22.800112 10648 main.go:141] libmachine: SSH cmd err, output: <nil>: newest-cni-074000
I0612 21:43:22.800112 10648 ubuntu.go:169] provisioning hostname "newest-cni-074000"
I0612 21:43:22.809118 10648 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" newest-cni-074000
I0612 21:43:22.996828 10648 main.go:141] libmachine: Using SSH client type: native
I0612 21:43:22.996828 10648 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x6ca540] 0x6cd120 <nil> [] 0s} 127.0.0.1 55598 <nil> <nil>}
I0612 21:43:22.996828 10648 main.go:141] libmachine: About to run SSH command:
sudo hostname newest-cni-074000 && echo "newest-cni-074000" | sudo tee /etc/hostname
I0612 21:43:23.222188 10648 main.go:141] libmachine: SSH cmd err, output: <nil>: newest-cni-074000
I0612 21:43:23.233021 10648 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" newest-cni-074000
I0612 21:43:23.435911 10648 main.go:141] libmachine: Using SSH client type: native
I0612 21:43:23.436912 10648 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x6ca540] 0x6cd120 <nil> [] 0s} 127.0.0.1 55598 <nil> <nil>}
I0612 21:43:23.436912 10648 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\snewest-cni-074000' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 newest-cni-074000/g' /etc/hosts;
else
echo '127.0.1.1 newest-cni-074000' | sudo tee -a /etc/hosts;
fi
fi
I0612 21:43:23.644311 10648 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0612 21:43:23.644401 10648 ubuntu.go:175] set auth options {CertDir:C:\Users\jenkins.minikube4\minikube-integration\.minikube CaCertPath:C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\ca.pem CaPrivateKeyPath:C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:C:\Users\jenkins.minikube4\minikube-integration\.minikube\machines\server.pem ServerKeyPath:C:\Users\jenkins.minikube4\minikube-integration\.minikube\machines\server-key.pem ClientKeyPath:C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\cert.pem ServerCertSANs:[] StorePath:C:\Users\jenkins.minikube4\minikube-integration\.minikube}
I0612 21:43:23.644401 10648 ubuntu.go:177] setting up certificates
I0612 21:43:23.644401 10648 provision.go:84] configureAuth start
I0612 21:43:23.661494 10648 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" newest-cni-074000
I0612 21:43:23.855864 10648 provision.go:143] copyHostCerts
I0612 21:43:23.855864 10648 exec_runner.go:144] found C:\Users\jenkins.minikube4\minikube-integration\.minikube/ca.pem, removing ...
I0612 21:43:23.855864 10648 exec_runner.go:203] rm: C:\Users\jenkins.minikube4\minikube-integration\.minikube\ca.pem
I0612 21:43:23.856861 10648 exec_runner.go:151] cp: C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\ca.pem --> C:\Users\jenkins.minikube4\minikube-integration\.minikube/ca.pem (1082 bytes)
I0612 21:43:23.857865 10648 exec_runner.go:144] found C:\Users\jenkins.minikube4\minikube-integration\.minikube/cert.pem, removing ...
I0612 21:43:23.857865 10648 exec_runner.go:203] rm: C:\Users\jenkins.minikube4\minikube-integration\.minikube\cert.pem
I0612 21:43:23.857865 10648 exec_runner.go:151] cp: C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\cert.pem --> C:\Users\jenkins.minikube4\minikube-integration\.minikube/cert.pem (1123 bytes)
I0612 21:43:23.858866 10648 exec_runner.go:144] found C:\Users\jenkins.minikube4\minikube-integration\.minikube/key.pem, removing ...
I0612 21:43:23.858866 10648 exec_runner.go:203] rm: C:\Users\jenkins.minikube4\minikube-integration\.minikube\key.pem
I0612 21:43:23.859864 10648 exec_runner.go:151] cp: C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\key.pem --> C:\Users\jenkins.minikube4\minikube-integration\.minikube/key.pem (1679 bytes)
I0612 21:43:23.860886 10648 provision.go:117] generating server cert: C:\Users\jenkins.minikube4\minikube-integration\.minikube\machines\server.pem ca-key=C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\ca.pem private-key=C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\ca-key.pem org=jenkins.newest-cni-074000 san=[127.0.0.1 192.168.94.2 localhost minikube newest-cni-074000]
I0612 21:43:24.282762 10648 provision.go:177] copyRemoteCerts
I0612 21:43:24.304481 10648 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0612 21:43:24.319986 10648 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" newest-cni-074000
I0612 21:43:24.517080 10648 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:55598 SSHKeyPath:C:\Users\jenkins.minikube4\minikube-integration\.minikube\machines\newest-cni-074000\id_rsa Username:docker}
I0612 21:43:24.650646 10648 ssh_runner.go:362] scp C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\ca.pem --> /etc/docker/ca.pem (1082 bytes)
I0612 21:43:24.710429 10648 ssh_runner.go:362] scp C:\Users\jenkins.minikube4\minikube-integration\.minikube\machines\server.pem --> /etc/docker/server.pem (1220 bytes)
I0612 21:43:24.767030 10648 ssh_runner.go:362] scp C:\Users\jenkins.minikube4\minikube-integration\.minikube\machines\server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I0612 21:43:24.824667 10648 provision.go:87] duration metric: took 1.1800569s to configureAuth
I0612 21:43:24.824667 10648 ubuntu.go:193] setting minikube options for container-runtime
I0612 21:43:24.825251 10648 config.go:182] Loaded profile config "newest-cni-074000": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.30.1
I0612 21:43:24.839234 10648 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" newest-cni-074000
I0612 21:43:25.023411 10648 main.go:141] libmachine: Using SSH client type: native
I0612 21:43:25.024391 10648 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x6ca540] 0x6cd120 <nil> [] 0s} 127.0.0.1 55598 <nil> <nil>}
I0612 21:43:25.024391 10648 main.go:141] libmachine: About to run SSH command:
df --output=fstype / | tail -n 1
I0612 21:43:25.234294 10648 main.go:141] libmachine: SSH cmd err, output: <nil>: overlay
I0612 21:43:25.234346 10648 ubuntu.go:71] root file system type: overlay
I0612 21:43:25.234600 10648 provision.go:314] Updating docker unit: /lib/systemd/system/docker.service ...
I0612 21:43:25.247408 10648 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" newest-cni-074000
I0612 21:43:25.451918 10648 main.go:141] libmachine: Using SSH client type: native
I0612 21:43:25.451918 10648 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x6ca540] 0x6cd120 <nil> [] 0s} 127.0.0.1 55598 <nil> <nil>}
I0612 21:43:25.451918 10648 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /lib/systemd/system && printf %!s(MISSING) "[Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
BindsTo=containerd.service
After=network-online.target firewalld.service containerd.service
Wants=network-online.target
Requires=docker.socket
StartLimitBurst=3
StartLimitIntervalSec=60
[Service]
Type=notify
Restart=on-failure
# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
# The base configuration already specifies an 'ExecStart=...' command. The first directive
# here is to clear out that command inherited from the base configuration. Without this,
# the command from the base configuration and the command specified here are treated as
# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
# will catch this invalid input and refuse to start the service with an error like:
# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
ExecStart=
ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12
ExecReload=/bin/kill -s HUP \$MAINPID
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
LimitNOFILE=infinity
LimitNPROC=infinity
LimitCORE=infinity
# Uncomment TasksMax if your systemd version supports it.
# Only systemd 226 and above support this version.
TasksMax=infinity
TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
# kill only the docker process, not all processes in the cgroup
KillMode=process
[Install]
WantedBy=multi-user.target
" | sudo tee /lib/systemd/system/docker.service.new
I0612 21:43:25.686870 10648 main.go:141] libmachine: SSH cmd err, output: <nil>: [Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
BindsTo=containerd.service
After=network-online.target firewalld.service containerd.service
Wants=network-online.target
Requires=docker.socket
StartLimitBurst=3
StartLimitIntervalSec=60
[Service]
Type=notify
Restart=on-failure
# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
# The base configuration already specifies an 'ExecStart=...' command. The first directive
# here is to clear out that command inherited from the base configuration. Without this,
# the command from the base configuration and the command specified here are treated as
# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
# will catch this invalid input and refuse to start the service with an error like:
# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
ExecStart=
ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12
ExecReload=/bin/kill -s HUP $MAINPID
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
LimitNOFILE=infinity
LimitNPROC=infinity
LimitCORE=infinity
# Uncomment TasksMax if your systemd version supports it.
# Only systemd 226 and above support this version.
TasksMax=infinity
TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
# kill only the docker process, not all processes in the cgroup
KillMode=process
[Install]
WantedBy=multi-user.target
I0612 21:43:25.700879 10648 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" newest-cni-074000
I0612 21:43:25.879358 10648 main.go:141] libmachine: Using SSH client type: native
I0612 21:43:25.880367 10648 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x6ca540] 0x6cd120 <nil> [] 0s} 127.0.0.1 55598 <nil> <nil>}
I0612 21:43:25.880367 10648 main.go:141] libmachine: About to run SSH command:
sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }
I0612 21:43:26.094633 10648 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0612 21:43:26.095317 10648 machine.go:97] duration metric: took 6.7292668s to provisionDockerMachine
I0612 21:43:26.095317 10648 start.go:293] postStartSetup for "newest-cni-074000" (driver="docker")
I0612 21:43:26.095317 10648 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0612 21:43:26.113337 10648 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0612 21:43:26.123327 10648 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" newest-cni-074000
I0612 21:43:26.311439 10648 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:55598 SSHKeyPath:C:\Users\jenkins.minikube4\minikube-integration\.minikube\machines\newest-cni-074000\id_rsa Username:docker}
I0612 21:43:26.672813 7884 kubeadm.go:309] [init] Using Kubernetes version: v1.30.1
I0612 21:43:26.672813 7884 kubeadm.go:309] [preflight] Running pre-flight checks
I0612 21:43:26.672813 7884 kubeadm.go:309] [preflight] Pulling images required for setting up a Kubernetes cluster
I0612 21:43:26.673777 7884 kubeadm.go:309] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0612 21:43:26.673777 7884 kubeadm.go:309] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0612 21:43:26.673777 7884 kubeadm.go:309] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0612 21:43:26.676752 7884 out.go:204] - Generating certificates and keys ...
I0612 21:43:26.676752 7884 kubeadm.go:309] [certs] Using existing ca certificate authority
I0612 21:43:26.677775 7884 kubeadm.go:309] [certs] Using existing apiserver certificate and key on disk
I0612 21:43:26.677775 7884 kubeadm.go:309] [certs] Generating "apiserver-kubelet-client" certificate and key
I0612 21:43:26.677775 7884 kubeadm.go:309] [certs] Generating "front-proxy-ca" certificate and key
I0612 21:43:26.677775 7884 kubeadm.go:309] [certs] Generating "front-proxy-client" certificate and key
I0612 21:43:26.677775 7884 kubeadm.go:309] [certs] Generating "etcd/ca" certificate and key
I0612 21:43:26.678785 7884 kubeadm.go:309] [certs] Generating "etcd/server" certificate and key
I0612 21:43:26.678785 7884 kubeadm.go:309] [certs] etcd/server serving cert is signed for DNS names [auto-796900 localhost] and IPs [192.168.112.2 127.0.0.1 ::1]
I0612 21:43:26.678785 7884 kubeadm.go:309] [certs] Generating "etcd/peer" certificate and key
I0612 21:43:26.678785 7884 kubeadm.go:309] [certs] etcd/peer serving cert is signed for DNS names [auto-796900 localhost] and IPs [192.168.112.2 127.0.0.1 ::1]
I0612 21:43:26.679749 7884 kubeadm.go:309] [certs] Generating "etcd/healthcheck-client" certificate and key
I0612 21:43:26.679749 7884 kubeadm.go:309] [certs] Generating "apiserver-etcd-client" certificate and key
I0612 21:43:26.679749 7884 kubeadm.go:309] [certs] Generating "sa" key and public key
I0612 21:43:26.679749 7884 kubeadm.go:309] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0612 21:43:26.679749 7884 kubeadm.go:309] [kubeconfig] Writing "admin.conf" kubeconfig file
I0612 21:43:26.680749 7884 kubeadm.go:309] [kubeconfig] Writing "super-admin.conf" kubeconfig file
I0612 21:43:26.680749 7884 kubeadm.go:309] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0612 21:43:26.680749 7884 kubeadm.go:309] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0612 21:43:26.680749 7884 kubeadm.go:309] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0612 21:43:26.680749 7884 kubeadm.go:309] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0612 21:43:26.681753 7884 kubeadm.go:309] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0612 21:43:26.686202 7884 out.go:204] - Booting up control plane ...
I0612 21:43:26.686202 7884 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0612 21:43:26.686756 7884 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0612 21:43:26.686756 7884 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0612 21:43:26.686756 7884 kubeadm.go:309] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0612 21:43:26.687754 7884 kubeadm.go:309] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0612 21:43:26.687754 7884 kubeadm.go:309] [kubelet-start] Starting the kubelet
I0612 21:43:26.687754 7884 kubeadm.go:309] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests"
I0612 21:43:26.687754 7884 kubeadm.go:309] [kubelet-check] Waiting for a healthy kubelet. This can take up to 4m0s
I0612 21:43:26.688744 7884 kubeadm.go:309] [kubelet-check] The kubelet is healthy after 1.506572898s
I0612 21:43:26.688744 7884 kubeadm.go:309] [api-check] Waiting for a healthy API server. This can take up to 4m0s
I0612 21:43:26.688744 7884 kubeadm.go:309] [api-check] The API server is healthy after 9.503648669s
I0612 21:43:26.688744 7884 kubeadm.go:309] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace
I0612 21:43:26.688744 7884 kubeadm.go:309] [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster
I0612 21:43:26.688744 7884 kubeadm.go:309] [upload-certs] Skipping phase. Please see --upload-certs
I0612 21:43:26.689746 7884 kubeadm.go:309] [mark-control-plane] Marking the node auto-796900 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]
I0612 21:43:26.689746 7884 kubeadm.go:309] [bootstrap-token] Using token: ouvnw4.qsvwdul85v4ld2a5
I0612 21:43:26.691758 7884 out.go:204] - Configuring RBAC rules ...
I0612 21:43:26.691758 7884 kubeadm.go:309] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles
I0612 21:43:26.691758 7884 kubeadm.go:309] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes
I0612 21:43:26.692754 7884 kubeadm.go:309] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials
I0612 21:43:26.692754 7884 kubeadm.go:309] [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token
I0612 21:43:26.692754 7884 kubeadm.go:309] [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster
I0612 21:43:26.692754 7884 kubeadm.go:309] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace
I0612 21:43:26.693745 7884 kubeadm.go:309] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key
I0612 21:43:26.693745 7884 kubeadm.go:309] [addons] Applied essential addon: CoreDNS
I0612 21:43:26.693745 7884 kubeadm.go:309] [addons] Applied essential addon: kube-proxy
I0612 21:43:26.693745 7884 kubeadm.go:309]
I0612 21:43:26.693745 7884 kubeadm.go:309] Your Kubernetes control-plane has initialized successfully!
I0612 21:43:26.693745 7884 kubeadm.go:309]
I0612 21:43:26.693745 7884 kubeadm.go:309] To start using your cluster, you need to run the following as a regular user:
I0612 21:43:26.693745 7884 kubeadm.go:309]
I0612 21:43:26.693745 7884 kubeadm.go:309] mkdir -p $HOME/.kube
I0612 21:43:26.694743 7884 kubeadm.go:309] sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config
I0612 21:43:26.694743 7884 kubeadm.go:309] sudo chown $(id -u):$(id -g) $HOME/.kube/config
I0612 21:43:26.694743 7884 kubeadm.go:309]
I0612 21:43:26.694743 7884 kubeadm.go:309] Alternatively, if you are the root user, you can run:
I0612 21:43:26.694743 7884 kubeadm.go:309]
I0612 21:43:26.694743 7884 kubeadm.go:309] export KUBECONFIG=/etc/kubernetes/admin.conf
I0612 21:43:26.694743 7884 kubeadm.go:309]
I0612 21:43:26.694743 7884 kubeadm.go:309] You should now deploy a pod network to the cluster.
I0612 21:43:26.694743 7884 kubeadm.go:309] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:
I0612 21:43:26.695743 7884 kubeadm.go:309] https://kubernetes.io/docs/concepts/cluster-administration/addons/
I0612 21:43:26.695743 7884 kubeadm.go:309]
I0612 21:43:26.695743 7884 kubeadm.go:309] You can now join any number of control-plane nodes by copying certificate authorities
I0612 21:43:26.695743 7884 kubeadm.go:309] and service account keys on each node and then running the following as root:
I0612 21:43:26.695743 7884 kubeadm.go:309]
I0612 21:43:26.695743 7884 kubeadm.go:309] kubeadm join control-plane.minikube.internal:8443 --token ouvnw4.qsvwdul85v4ld2a5 \
I0612 21:43:26.695743 7884 kubeadm.go:309] --discovery-token-ca-cert-hash sha256:d3e1d8f0c562b67cbe33b6d209756a1fd624c8baad08c702c70b38fe31217116 \
I0612 21:43:26.695743 7884 kubeadm.go:309] --control-plane
I0612 21:43:26.695743 7884 kubeadm.go:309]
I0612 21:43:26.696744 7884 kubeadm.go:309] Then you can join any number of worker nodes by running the following on each as root:
I0612 21:43:26.696744 7884 kubeadm.go:309]
I0612 21:43:26.696744 7884 kubeadm.go:309] kubeadm join control-plane.minikube.internal:8443 --token ouvnw4.qsvwdul85v4ld2a5 \
I0612 21:43:26.696744 7884 kubeadm.go:309] --discovery-token-ca-cert-hash sha256:d3e1d8f0c562b67cbe33b6d209756a1fd624c8baad08c702c70b38fe31217116
I0612 21:43:26.696744 7884 cni.go:84] Creating CNI manager for ""
I0612 21:43:26.696744 7884 cni.go:158] "docker" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
I0612 21:43:26.698814 7884 out.go:177] * Configuring bridge CNI (Container Networking Interface) ...
I0612 21:43:25.913096 5540 pod_ready.go:102] pod "metrics-server-9975d5f86-ltrjr" in "kube-system" namespace has status "Ready":"False"
I0612 21:43:28.409443 5540 pod_ready.go:102] pod "metrics-server-9975d5f86-ltrjr" in "kube-system" namespace has status "Ready":"False"
I0612 21:43:26.715742 7884 ssh_runner.go:195] Run: sudo mkdir -p /etc/cni/net.d
I0612 21:43:26.776770 7884 ssh_runner.go:362] scp memory --> /etc/cni/net.d/1-k8s.conflist (496 bytes)
I0612 21:43:26.951270 7884 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
I0612 21:43:26.976283 7884 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.1/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig
I0612 21:43:26.977288 7884 ops.go:34] apiserver oom_adj: -16
I0612 21:43:26.977288 7884 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes auto-796900 minikube.k8s.io/updated_at=2024_06_12T21_43_26_0700 minikube.k8s.io/version=v1.33.1 minikube.k8s.io/commit=8d282d3acc6cc32dfd3bc1bc39edde8a887b9d79 minikube.k8s.io/name=auto-796900 minikube.k8s.io/primary=true
I0612 21:43:27.474362 7884 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0612 21:43:27.967424 7884 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0612 21:43:28.492410 7884 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0612 21:43:28.988182 7884 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0612 21:43:29.482586 7884 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0612 21:43:29.984534 7884 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0612 21:43:30.481855 7884 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0612 21:43:30.975301 7884 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0612 21:43:26.478278 10648 ssh_runner.go:195] Run: cat /etc/os-release
I0612 21:43:26.489068 10648 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I0612 21:43:26.489068 10648 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
I0612 21:43:26.489068 10648 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
I0612 21:43:26.489068 10648 info.go:137] Remote host: Ubuntu 22.04.4 LTS
I0612 21:43:26.489068 10648 filesync.go:126] Scanning C:\Users\jenkins.minikube4\minikube-integration\.minikube\addons for local assets ...
I0612 21:43:26.489068 10648 filesync.go:126] Scanning C:\Users\jenkins.minikube4\minikube-integration\.minikube\files for local assets ...
I0612 21:43:26.490078 10648 filesync.go:149] local asset: C:\Users\jenkins.minikube4\minikube-integration\.minikube\files\etc\ssl\certs\60002.pem -> 60002.pem in /etc/ssl/certs
I0612 21:43:26.502072 10648 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0612 21:43:26.519073 10648 ssh_runner.go:362] scp C:\Users\jenkins.minikube4\minikube-integration\.minikube\files\etc\ssl\certs\60002.pem --> /etc/ssl/certs/60002.pem (1708 bytes)
I0612 21:43:26.581819 10648 start.go:296] duration metric: took 486.4786ms for postStartSetup
I0612 21:43:26.597743 10648 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I0612 21:43:26.608741 10648 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" newest-cni-074000
I0612 21:43:26.798225 10648 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:55598 SSHKeyPath:C:\Users\jenkins.minikube4\minikube-integration\.minikube\machines\newest-cni-074000\id_rsa Username:docker}
I0612 21:43:26.935274 10648 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
I0612 21:43:26.946278 10648 fix.go:56] duration metric: took 9.0140823s for fixHost
I0612 21:43:26.946278 10648 start.go:83] releasing machines lock for "newest-cni-074000", held for 9.0140823s
I0612 21:43:26.970271 10648 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" newest-cni-074000
I0612 21:43:27.166467 10648 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0612 21:43:27.176340 10648 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" newest-cni-074000
I0612 21:43:27.182369 10648 ssh_runner.go:195] Run: cat /version.json
I0612 21:43:27.194359 10648 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" newest-cni-074000
I0612 21:43:27.401374 10648 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:55598 SSHKeyPath:C:\Users\jenkins.minikube4\minikube-integration\.minikube\machines\newest-cni-074000\id_rsa Username:docker}
I0612 21:43:27.427357 10648 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:55598 SSHKeyPath:C:\Users\jenkins.minikube4\minikube-integration\.minikube\machines\newest-cni-074000\id_rsa Username:docker}
I0612 21:43:27.735949 10648 ssh_runner.go:195] Run: systemctl --version
I0612 21:43:27.765742 10648 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
I0612 21:43:27.792769 10648 ssh_runner.go:195] Run: sudo find \etc\cni\net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "grep -q loopback {} && ( grep -q name {} || sudo sed -i '/"type": "loopback"/i \ \ \ \ "name": "loopback",' {} ) && sudo sed -i 's|"cniVersion": ".*"|"cniVersion": "1.0.0"|g' {}" ;
W0612 21:43:27.820379 10648 start.go:438] unable to name loopback interface in configureRuntimes: unable to patch loopback cni config "/etc/cni/net.d/*loopback.conf*": sudo find \etc\cni\net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "grep -q loopback {} && ( grep -q name {} || sudo sed -i '/"type": "loopback"/i \ \ \ \ "name": "loopback",' {} ) && sudo sed -i 's|"cniVersion": ".*"|"cniVersion": "1.0.0"|g' {}" ;: Process exited with status 1
stdout:
stderr:
find: '\\etc\\cni\\net.d': No such file or directory
I0612 21:43:27.833378 10648 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0612 21:43:27.858708 10648 cni.go:259] no active bridge cni configs found in "/etc/cni/net.d" - nothing to disable
I0612 21:43:27.858911 10648 start.go:494] detecting cgroup driver to use...
I0612 21:43:27.858911 10648 detect.go:196] detected "cgroupfs" cgroup driver on host os
I0612 21:43:27.859493 10648 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///run/containerd/containerd.sock
" | sudo tee /etc/crictl.yaml"
I0612 21:43:27.908784 10648 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.9"|' /etc/containerd/config.toml"
I0612 21:43:27.945418 10648 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"
I0612 21:43:27.971422 10648 containerd.go:146] configuring containerd to use "cgroupfs" as cgroup driver...
I0612 21:43:27.983422 10648 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"
I0612 21:43:28.019557 10648 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0612 21:43:28.058428 10648 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"
I0612 21:43:28.098965 10648 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0612 21:43:28.137651 10648 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0612 21:43:28.174314 10648 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"
I0612 21:43:28.219916 10648 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *enable_unprivileged_ports = .*/d' /etc/containerd/config.toml"
I0612 21:43:28.261285 10648 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)\[plugins."io.containerd.grpc.v1.cri"\]|&\n\1 enable_unprivileged_ports = true|' /etc/containerd/config.toml"
I0612 21:43:28.307371 10648 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0612 21:43:28.343798 10648 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0612 21:43:28.382234 10648 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0612 21:43:28.599984 10648 ssh_runner.go:195] Run: sudo systemctl restart containerd
I0612 21:43:28.793274 10648 start.go:494] detecting cgroup driver to use...
I0612 21:43:28.793274 10648 detect.go:196] detected "cgroupfs" cgroup driver on host os
I0612 21:43:28.807659 10648 ssh_runner.go:195] Run: sudo systemctl cat docker.service
I0612 21:43:28.831687 10648 cruntime.go:279] skipping containerd shutdown because we are bound to it
I0612 21:43:28.845674 10648 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
I0612 21:43:28.880307 10648 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/cri-dockerd.sock
" | sudo tee /etc/crictl.yaml"
I0612 21:43:28.933182 10648 ssh_runner.go:195] Run: which cri-dockerd
I0612 21:43:28.977191 10648 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/cri-docker.service.d
I0612 21:43:29.000708 10648 ssh_runner.go:362] scp memory --> /etc/systemd/system/cri-docker.service.d/10-cni.conf (189 bytes)
I0612 21:43:29.054053 10648 ssh_runner.go:195] Run: sudo systemctl unmask docker.service
I0612 21:43:29.244302 10648 ssh_runner.go:195] Run: sudo systemctl enable docker.socket
I0612 21:43:29.480143 10648 docker.go:574] configuring docker to use "cgroupfs" as cgroup driver...
I0612 21:43:29.480567 10648 ssh_runner.go:362] scp memory --> /etc/docker/daemon.json (130 bytes)
I0612 21:43:29.538571 10648 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0612 21:43:29.742233 10648 ssh_runner.go:195] Run: sudo systemctl restart docker
I0612 21:43:30.618432 10648 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service cri-docker.socket
I0612 21:43:30.661211 10648 ssh_runner.go:195] Run: sudo systemctl stop cri-docker.socket
I0612 21:43:30.708466 10648 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service cri-docker.service
I0612 21:43:30.744462 10648 ssh_runner.go:195] Run: sudo systemctl unmask cri-docker.socket
I0612 21:43:30.917703 10648 ssh_runner.go:195] Run: sudo systemctl enable cri-docker.socket
I0612 21:43:31.097965 10648 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0612 21:43:31.290841 10648 ssh_runner.go:195] Run: sudo systemctl restart cri-docker.socket
I0612 21:43:31.343045 10648 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service cri-docker.service
I0612 21:43:31.391233 10648 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0612 21:43:31.564099 10648 ssh_runner.go:195] Run: sudo systemctl restart cri-docker.service
I0612 21:43:31.737505 10648 start.go:541] Will wait 60s for socket path /var/run/cri-dockerd.sock
I0612 21:43:31.750415 10648 ssh_runner.go:195] Run: stat /var/run/cri-dockerd.sock
I0612 21:43:31.769811 10648 start.go:562] Will wait 60s for crictl version
I0612 21:43:31.782887 10648 ssh_runner.go:195] Run: which crictl
I0612 21:43:31.807882 10648 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0612 21:43:31.886514 10648 start.go:578] Version: 0.1.0
RuntimeName: docker
RuntimeVersion: 26.1.4
RuntimeApiVersion: v1
I0612 21:43:31.901511 10648 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}
I0612 21:43:31.966538 10648 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}
I0612 21:43:32.043000 10648 out.go:204] * Preparing Kubernetes v1.30.1 on Docker 26.1.4 ...
I0612 21:43:32.054008 10648 cli_runner.go:164] Run: docker exec -t newest-cni-074000 dig +short host.docker.internal
I0612 21:43:32.343857 10648 network.go:96] got host ip for mount in container by digging dns: 192.168.65.254
I0612 21:43:32.358795 10648 ssh_runner.go:195] Run: grep 192.168.65.254 host.minikube.internal$ /etc/hosts
I0612 21:43:32.369795 10648 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.65.254 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0612 21:43:32.407014 10648 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "8443/tcp") 0).HostPort}}'" newest-cni-074000
I0612 21:43:32.583418 10648 out.go:177] - kubeadm.pod-network-cidr=10.42.0.0/16
I0612 21:43:30.418475 5540 pod_ready.go:102] pod "metrics-server-9975d5f86-ltrjr" in "kube-system" namespace has status "Ready":"False"
I0612 21:43:32.913059 5540 pod_ready.go:102] pod "metrics-server-9975d5f86-ltrjr" in "kube-system" namespace has status "Ready":"False"
I0612 21:43:32.586416 10648 kubeadm.go:877] updating cluster {Name:newest-cni-074000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1717668449-19038@sha256:30d191eb345232f513c52f7ac036e7a34a8cc441d88353f92985384bcddf00d6 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.1 ClusterName:newest-cni-074000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA API
ServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates:ServerSideApply=true ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:kubeadm Key:pod-network-cidr Value:10.42.0.0/16}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.94.2 Port:8443 KubernetesVersion:v1.30.1 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:false default_sa:true extra:false kubelet:false node_ready:false system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:fals
e ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:C:\Users\jenkins.minikube4:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0612 21:43:32.586416 10648 preload.go:132] Checking if preload exists for k8s version v1.30.1 and runtime docker
I0612 21:43:32.595417 10648 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}
I0612 21:43:32.638217 10648 docker.go:685] Got preloaded images: -- stdout --
registry.k8s.io/kube-apiserver:v1.30.1
registry.k8s.io/kube-scheduler:v1.30.1
registry.k8s.io/kube-controller-manager:v1.30.1
registry.k8s.io/kube-proxy:v1.30.1
registry.k8s.io/etcd:3.5.12-0
registry.k8s.io/coredns/coredns:v1.11.1
registry.k8s.io/pause:3.9
gcr.io/k8s-minikube/storage-provisioner:v5
-- /stdout --
I0612 21:43:32.638217 10648 docker.go:615] Images already preloaded, skipping extraction
I0612 21:43:32.646195 10648 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}
I0612 21:43:32.693416 10648 docker.go:685] Got preloaded images: -- stdout --
registry.k8s.io/kube-apiserver:v1.30.1
registry.k8s.io/kube-controller-manager:v1.30.1
registry.k8s.io/kube-scheduler:v1.30.1
registry.k8s.io/kube-proxy:v1.30.1
registry.k8s.io/etcd:3.5.12-0
registry.k8s.io/coredns/coredns:v1.11.1
registry.k8s.io/pause:3.9
gcr.io/k8s-minikube/storage-provisioner:v5
-- /stdout --
I0612 21:43:32.693416 10648 cache_images.go:84] Images are preloaded, skipping loading
I0612 21:43:32.693416 10648 kubeadm.go:928] updating node { 192.168.94.2 8443 v1.30.1 docker true true} ...
I0612 21:43:32.693416 10648 kubeadm.go:940] kubelet [Unit]
Wants=docker.socket
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.30.1/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --feature-gates=ServerSideApply=true --hostname-override=newest-cni-074000 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.94.2
[Install]
config:
{KubernetesVersion:v1.30.1 ClusterName:newest-cni-074000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates:ServerSideApply=true ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:kubeadm Key:pod-network-cidr Value:10.42.0.0/16}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0612 21:43:32.704398 10648 ssh_runner.go:195] Run: docker info --format {{.CgroupDriver}}
I0612 21:43:32.815237 10648 cni.go:84] Creating CNI manager for ""
I0612 21:43:32.815237 10648 cni.go:158] "docker" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
I0612 21:43:32.815237 10648 kubeadm.go:84] Using pod CIDR: 10.42.0.0/16
I0612 21:43:32.815237 10648 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.42.0.0/16 AdvertiseAddress:192.168.94.2 APIServerPort:8443 KubernetesVersion:v1.30.1 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:newest-cni-074000 NodeName:newest-cni-074000 DNSDomain:cluster.local CRISocket:/var/run/cri-dockerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota feature-gates:ServerSideApply=true] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.94.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true feature-gates:ServerSideApply=true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[feature-gates:ServerSideApply=true leader-elect:false] Pairs:map[]}] FeatureArgs:map[
] NodeIP:192.168.94.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///var/run/cri-dockerd.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
I0612 21:43:32.816235 10648 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta3
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.94.2
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: unix:///var/run/cri-dockerd.sock
name: "newest-cni-074000"
kubeletExtraArgs:
node-ip: 192.168.94.2
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta3
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.94.2"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
feature-gates: "ServerSideApply=true"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
feature-gates: "ServerSideApply=true"
leader-elect: "false"
scheduler:
extraArgs:
feature-gates: "ServerSideApply=true"
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.30.1
networking:
dnsDomain: cluster.local
podSubnet: "10.42.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
containerRuntimeEndpoint: unix:///var/run/cri-dockerd.sock
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%!"(MISSING)
nodefs.inodesFree: "0%!"(MISSING)
imagefs.available: "0%!"(MISSING)
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.42.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0612 21:43:32.827236 10648 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.30.1
I0612 21:43:32.853173 10648 binaries.go:44] Found k8s binaries, skipping transfer
I0612 21:43:32.870074 10648 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0612 21:43:32.892028 10648 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (353 bytes)
I0612 21:43:32.931035 10648 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0612 21:43:32.970048 10648 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2283 bytes)
I0612 21:43:33.020846 10648 ssh_runner.go:195] Run: grep 192.168.94.2 control-plane.minikube.internal$ /etc/hosts
I0612 21:43:33.032050 10648 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.94.2 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0612 21:43:33.081046 10648 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0612 21:43:33.277682 10648 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0612 21:43:33.311860 10648 certs.go:68] Setting up C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\newest-cni-074000 for IP: 192.168.94.2
I0612 21:43:33.311969 10648 certs.go:194] generating shared ca certs ...
I0612 21:43:33.312025 10648 certs.go:226] acquiring lock for ca certs: {Name:mk92285f7546e1a5b3c3b23dab6135aa5a99cd14 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0612 21:43:33.313074 10648 certs.go:235] skipping valid "minikubeCA" ca cert: C:\Users\jenkins.minikube4\minikube-integration\.minikube\ca.key
I0612 21:43:33.313658 10648 certs.go:235] skipping valid "proxyClientCA" ca cert: C:\Users\jenkins.minikube4\minikube-integration\.minikube\proxy-client-ca.key
I0612 21:43:33.314948 10648 certs.go:256] generating profile certs ...
I0612 21:43:33.316004 10648 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\newest-cni-074000\client.key
I0612 21:43:33.316595 10648 certs.go:359] skipping valid signed profile cert regeneration for "minikube": C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\newest-cni-074000\apiserver.key.6666ef88
I0612 21:43:33.317107 10648 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\newest-cni-074000\proxy-client.key
I0612 21:43:33.319447 10648 certs.go:484] found cert: C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\6000.pem (1338 bytes)
W0612 21:43:33.319982 10648 certs.go:480] ignoring C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\6000_empty.pem, impossibly tiny 0 bytes
I0612 21:43:33.320106 10648 certs.go:484] found cert: C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\ca-key.pem (1679 bytes)
I0612 21:43:33.320509 10648 certs.go:484] found cert: C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\ca.pem (1082 bytes)
I0612 21:43:33.320910 10648 certs.go:484] found cert: C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\cert.pem (1123 bytes)
I0612 21:43:33.321187 10648 certs.go:484] found cert: C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\key.pem (1679 bytes)
I0612 21:43:33.321876 10648 certs.go:484] found cert: C:\Users\jenkins.minikube4\minikube-integration\.minikube\files\etc\ssl\certs\60002.pem (1708 bytes)
I0612 21:43:33.323782 10648 ssh_runner.go:362] scp C:\Users\jenkins.minikube4\minikube-integration\.minikube\ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0612 21:43:33.387171 10648 ssh_runner.go:362] scp C:\Users\jenkins.minikube4\minikube-integration\.minikube\ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
I0612 21:43:33.452989 10648 ssh_runner.go:362] scp C:\Users\jenkins.minikube4\minikube-integration\.minikube\proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0612 21:43:33.523130 10648 ssh_runner.go:362] scp C:\Users\jenkins.minikube4\minikube-integration\.minikube\proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I0612 21:43:33.668197 10648 ssh_runner.go:362] scp C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\newest-cni-074000\apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1424 bytes)
I0612 21:43:33.857790 10648 ssh_runner.go:362] scp C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\newest-cni-074000\apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I0612 21:43:33.971249 10648 ssh_runner.go:362] scp C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\newest-cni-074000\proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0612 21:43:34.083749 10648 ssh_runner.go:362] scp C:\Users\jenkins.minikube4\minikube-integration\.minikube\profiles\newest-cni-074000\proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I0612 21:43:34.161946 10648 ssh_runner.go:362] scp C:\Users\jenkins.minikube4\minikube-integration\.minikube\ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0612 21:43:34.215740 10648 ssh_runner.go:362] scp C:\Users\jenkins.minikube4\minikube-integration\.minikube\certs\6000.pem --> /usr/share/ca-certificates/6000.pem (1338 bytes)
I0612 21:43:34.265603 10648 ssh_runner.go:362] scp C:\Users\jenkins.minikube4\minikube-integration\.minikube\files\etc\ssl\certs\60002.pem --> /usr/share/ca-certificates/60002.pem (1708 bytes)
I0612 21:43:34.322738 10648 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0612 21:43:34.381810 10648 ssh_runner.go:195] Run: openssl version
I0612 21:43:34.419812 10648 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0612 21:43:34.467066 10648 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0612 21:43:34.479086 10648 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Jun 12 20:14 /usr/share/ca-certificates/minikubeCA.pem
I0612 21:43:34.498078 10648 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0612 21:43:34.532059 10648 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0612 21:43:34.580088 10648 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/6000.pem && ln -fs /usr/share/ca-certificates/6000.pem /etc/ssl/certs/6000.pem"
I0612 21:43:34.624086 10648 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/6000.pem
I0612 21:43:34.639085 10648 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Jun 12 20:25 /usr/share/ca-certificates/6000.pem
I0612 21:43:34.657067 10648 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/6000.pem
I0612 21:43:34.692443 10648 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/6000.pem /etc/ssl/certs/51391683.0"
I0612 21:43:34.730438 10648 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/60002.pem && ln -fs /usr/share/ca-certificates/60002.pem /etc/ssl/certs/60002.pem"
I0612 21:43:34.774182 10648 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/60002.pem
I0612 21:43:34.790204 10648 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Jun 12 20:25 /usr/share/ca-certificates/60002.pem
I0612 21:43:34.815181 10648 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/60002.pem
I0612 21:43:34.894873 10648 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/60002.pem /etc/ssl/certs/3ec20f2e.0"
I0612 21:43:34.998868 10648 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0612 21:43:35.094872 10648 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-etcd-client.crt -checkend 86400
I0612 21:43:35.187022 10648 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-kubelet-client.crt -checkend 86400
I0612 21:43:35.299436 10648 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/server.crt -checkend 86400
I0612 21:43:35.381055 10648 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/healthcheck-client.crt -checkend 86400
I0612 21:43:35.417386 10648 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/peer.crt -checkend 86400
I0612 21:43:35.499373 10648 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/front-proxy-client.crt -checkend 86400
I0612 21:43:35.563926 10648 kubeadm.go:391] StartCluster: {Name:newest-cni-074000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1717668449-19038@sha256:30d191eb345232f513c52f7ac036e7a34a8cc441d88353f92985384bcddf00d6 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.1 ClusterName:newest-cni-074000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APISer
verNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates:ServerSideApply=true ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:kubeadm Key:pod-network-cidr Value:10.42.0.0/16}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.94.2 Port:8443 KubernetesVersion:v1.30.1 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:false default_sa:true extra:false kubelet:false node_ready:false system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false E
xtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:C:\Users\jenkins.minikube4:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0612 21:43:35.577572 10648 ssh_runner.go:195] Run: docker ps --filter status=paused --filter=name=k8s_.*_(kube-system)_ --format={{.ID}}
I0612 21:43:35.694527 10648 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
W0612 21:43:35.764616 10648 kubeadm.go:404] apiserver tunnel failed: apiserver port not set
I0612 21:43:35.764616 10648 kubeadm.go:407] found existing configuration files, will attempt cluster restart
I0612 21:43:35.764616 10648 kubeadm.go:587] restartPrimaryControlPlane start ...
I0612 21:43:35.787636 10648 ssh_runner.go:195] Run: sudo test -d /data/minikube
I0612 21:43:35.871285 10648 kubeadm.go:129] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1
stdout:
stderr:
I0612 21:43:35.886159 10648 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "8443/tcp") 0).HostPort}}'" newest-cni-074000
I0612 21:43:36.093881 10648 kubeconfig.go:47] verify endpoint returned: get endpoint: "newest-cni-074000" does not appear in C:\Users\jenkins.minikube4\minikube-integration\kubeconfig
I0612 21:43:36.093881 10648 kubeconfig.go:62] C:\Users\jenkins.minikube4\minikube-integration\kubeconfig needs updating (will repair): [kubeconfig missing "newest-cni-074000" cluster setting kubeconfig missing "newest-cni-074000" context setting]
I0612 21:43:36.094868 10648 lock.go:35] WriteFile acquiring C:\Users\jenkins.minikube4\minikube-integration\kubeconfig: {Name:mk97c09b788e5010ffd4c9dd9525f9245d5edd25 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0612 21:43:36.136697 10648 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new
I0612 21:43:36.184732 10648 kubeadm.go:624] The running cluster does not require reconfiguration: 127.0.0.1
I0612 21:43:36.184732 10648 kubeadm.go:591] duration metric: took 420.096ms to restartPrimaryControlPlane
I0612 21:43:36.184732 10648 kubeadm.go:393] duration metric: took 620.7764ms to StartCluster
I0612 21:43:36.184732 10648 settings.go:142] acquiring lock: {Name:mk5d8710830d010adb6db61f855b0ef766a8622c Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0612 21:43:36.185730 10648 settings.go:150] Updating kubeconfig: C:\Users\jenkins.minikube4\minikube-integration\kubeconfig
I0612 21:43:36.187762 10648 lock.go:35] WriteFile acquiring C:\Users\jenkins.minikube4\minikube-integration\kubeconfig: {Name:mk97c09b788e5010ffd4c9dd9525f9245d5edd25 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0612 21:43:36.188737 10648 start.go:234] Will wait 6m0s for node &{Name: IP:192.168.94.2 Port:8443 KubernetesVersion:v1.30.1 ContainerRuntime:docker ControlPlane:true Worker:true}
I0612 21:43:36.193731 10648 out.go:177] * Verifying Kubernetes components...
I0612 21:43:36.188737 10648 addons.go:507] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:true default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false]
I0612 21:43:36.189732 10648 config.go:182] Loaded profile config "newest-cni-074000": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.30.1
I0612 21:43:31.482481 7884 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0612 21:43:31.984811 7884 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0612 21:43:32.477019 7884 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0612 21:43:32.979069 7884 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0612 21:43:33.482241 7884 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0612 21:43:33.984258 7884 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0612 21:43:34.483088 7884 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0612 21:43:34.986908 7884 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0612 21:43:35.491404 7884 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0612 21:43:35.976869 7884 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0612 21:43:36.193731 10648 addons.go:69] Setting storage-provisioner=true in profile "newest-cni-074000"
I0612 21:43:36.195737 10648 addons.go:234] Setting addon storage-provisioner=true in "newest-cni-074000"
I0612 21:43:36.193731 10648 addons.go:69] Setting default-storageclass=true in profile "newest-cni-074000"
I0612 21:43:36.193731 10648 addons.go:69] Setting metrics-server=true in profile "newest-cni-074000"
I0612 21:43:36.193731 10648 addons.go:69] Setting dashboard=true in profile "newest-cni-074000"
W0612 21:43:36.195737 10648 addons.go:243] addon storage-provisioner should already be in state true
I0612 21:43:36.195737 10648 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "newest-cni-074000"
I0612 21:43:36.195737 10648 addons.go:234] Setting addon dashboard=true in "newest-cni-074000"
W0612 21:43:36.195737 10648 addons.go:243] addon dashboard should already be in state true
I0612 21:43:36.195737 10648 addons.go:234] Setting addon metrics-server=true in "newest-cni-074000"
I0612 21:43:36.195737 10648 host.go:66] Checking if "newest-cni-074000" exists ...
I0612 21:43:36.195737 10648 host.go:66] Checking if "newest-cni-074000" exists ...
W0612 21:43:36.195737 10648 addons.go:243] addon metrics-server should already be in state true
I0612 21:43:36.195737 10648 host.go:66] Checking if "newest-cni-074000" exists ...
I0612 21:43:36.223069 10648 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0612 21:43:36.232065 10648 cli_runner.go:164] Run: docker container inspect newest-cni-074000 --format={{.State.Status}}
I0612 21:43:36.233064 10648 cli_runner.go:164] Run: docker container inspect newest-cni-074000 --format={{.State.Status}}
I0612 21:43:36.234075 10648 cli_runner.go:164] Run: docker container inspect newest-cni-074000 --format={{.State.Status}}
I0612 21:43:36.237071 10648 cli_runner.go:164] Run: docker container inspect newest-cni-074000 --format={{.State.Status}}
I0612 21:43:36.482767 10648 out.go:177] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
I0612 21:43:36.480744 10648 out.go:177] - Using image fake.domain/registry.k8s.io/echoserver:1.4
I0612 21:43:36.483789 10648 addons.go:234] Setting addon default-storageclass=true in "newest-cni-074000"
W0612 21:43:36.489741 10648 addons.go:243] addon default-storageclass should already be in state true
I0612 21:43:36.489741 10648 addons.go:431] installing /etc/kubernetes/addons/storage-provisioner.yaml
I0612 21:43:36.487780 10648 addons.go:431] installing /etc/kubernetes/addons/metrics-apiservice.yaml
I0612 21:43:36.493747 10648 out.go:177] - Using image docker.io/kubernetesui/dashboard:v2.7.0
I0612 21:43:36.489741 10648 host.go:66] Checking if "newest-cni-074000" exists ...
I0612 21:43:36.489741 10648 ssh_runner.go:362] scp metrics-server/metrics-apiservice.yaml --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)
I0612 21:43:36.489741 10648 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I0612 21:43:36.497749 10648 out.go:177] - Using image registry.k8s.io/echoserver:1.4
I0612 21:43:35.407380 5540 pod_ready.go:102] pod "metrics-server-9975d5f86-ltrjr" in "kube-system" namespace has status "Ready":"False"
I0612 21:43:37.397593 5540 pod_ready.go:81] duration metric: took 4m0.0125914s for pod "metrics-server-9975d5f86-ltrjr" in "kube-system" namespace to be "Ready" ...
E0612 21:43:37.397593 5540 pod_ready.go:66] WaitExtra: waitPodCondition: context deadline exceeded
I0612 21:43:37.397593 5540 pod_ready.go:38] duration metric: took 5m25.2905551s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0612 21:43:37.397593 5540 api_server.go:52] waiting for apiserver process to appear ...
I0612 21:43:37.412569 5540 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
I0612 21:43:37.473891 5540 logs.go:276] 2 containers: [559ffac3c414 08372f67ca60]
I0612 21:43:37.486870 5540 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
I0612 21:43:37.538862 5540 logs.go:276] 2 containers: [48b924cc9ca8 d65a86407319]
I0612 21:43:37.553872 5540 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
I0612 21:43:37.600860 5540 logs.go:276] 2 containers: [78fd0bd54f7f b5adbbbe1b1d]
I0612 21:43:37.610858 5540 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
I0612 21:43:37.679150 5540 logs.go:276] 2 containers: [dc6968d98409 6dcf6b435dcb]
I0612 21:43:37.688184 5540 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
I0612 21:43:37.731537 5540 logs.go:276] 2 containers: [c87af550bb83 9bdf65930601]
I0612 21:43:37.740529 5540 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
I0612 21:43:37.792571 5540 logs.go:276] 2 containers: [6116c6070393 5491a5e5dcb9]
I0612 21:43:37.804550 5540 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
I0612 21:43:37.849101 5540 logs.go:276] 0 containers: []
W0612 21:43:37.849101 5540 logs.go:278] No container was found matching "kindnet"
I0612 21:43:37.868088 5540 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kubernetes-dashboard --format={{.ID}}
I0612 21:43:37.915701 5540 logs.go:276] 1 containers: [ed7189bae68d]
I0612 21:43:37.927688 5540 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
I0612 21:43:37.984327 5540 logs.go:276] 2 containers: [380c76a7ac65 3f440bc35ac0]
I0612 21:43:37.984327 5540 logs.go:123] Gathering logs for coredns [78fd0bd54f7f] ...
I0612 21:43:37.985483 5540 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 78fd0bd54f7f"
I0612 21:43:38.043037 5540 logs.go:123] Gathering logs for kube-scheduler [dc6968d98409] ...
I0612 21:43:38.043037 5540 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 dc6968d98409"
I0612 21:43:38.103058 5540 logs.go:123] Gathering logs for kube-controller-manager [5491a5e5dcb9] ...
I0612 21:43:38.103058 5540 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5491a5e5dcb9"
I0612 21:43:38.182836 5540 logs.go:123] Gathering logs for kubernetes-dashboard [ed7189bae68d] ...
I0612 21:43:38.182836 5540 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ed7189bae68d"
I0612 21:43:38.236968 5540 logs.go:123] Gathering logs for kube-apiserver [559ffac3c414] ...
I0612 21:43:38.236968 5540 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 559ffac3c414"
I0612 21:43:38.331716 5540 logs.go:123] Gathering logs for kube-apiserver [08372f67ca60] ...
I0612 21:43:38.331796 5540 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 08372f67ca60"
I0612 21:43:38.431593 5540 logs.go:123] Gathering logs for etcd [d65a86407319] ...
I0612 21:43:38.431593 5540 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d65a86407319"
I0612 21:43:38.503261 5540 logs.go:123] Gathering logs for storage-provisioner [380c76a7ac65] ...
I0612 21:43:38.503261 5540 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 380c76a7ac65"
I0612 21:43:36.489741 7884 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0612 21:43:36.978949 7884 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0612 21:43:37.482843 7884 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0612 21:43:37.988304 7884 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0612 21:43:38.478065 7884 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0612 21:43:38.976848 7884 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0612 21:43:39.484891 7884 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0612 21:43:39.693058 7884 kubeadm.go:1107] duration metric: took 12.741182s to wait for elevateKubeSystemPrivileges
W0612 21:43:39.693058 7884 kubeadm.go:286] apiserver tunnel failed: apiserver port not set
I0612 21:43:39.693058 7884 kubeadm.go:393] duration metric: took 32.6953833s to StartCluster
I0612 21:43:39.693058 7884 settings.go:142] acquiring lock: {Name:mk5d8710830d010adb6db61f855b0ef766a8622c Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0612 21:43:39.693058 7884 settings.go:150] Updating kubeconfig: C:\Users\jenkins.minikube4\minikube-integration\kubeconfig
I0612 21:43:39.696062 7884 lock.go:35] WriteFile acquiring C:\Users\jenkins.minikube4\minikube-integration\kubeconfig: {Name:mk97c09b788e5010ffd4c9dd9525f9245d5edd25 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0612 21:43:39.698051 7884 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.30.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"
I0612 21:43:39.698051 7884 start.go:234] Will wait 15m0s for node &{Name: IP:192.168.112.2 Port:8443 KubernetesVersion:v1.30.1 ContainerRuntime:docker ControlPlane:true Worker:true}
I0612 21:43:39.702055 7884 out.go:177] * Verifying Kubernetes components...
I0612 21:43:39.698051 7884 addons.go:507] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false]
I0612 21:43:39.699051 7884 config.go:182] Loaded profile config "auto-796900": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.30.1
I0612 21:43:39.708059 7884 addons.go:69] Setting storage-provisioner=true in profile "auto-796900"
I0612 21:43:39.708059 7884 addons.go:69] Setting default-storageclass=true in profile "auto-796900"
I0612 21:43:39.708059 7884 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "auto-796900"
I0612 21:43:39.708059 7884 addons.go:234] Setting addon storage-provisioner=true in "auto-796900"
I0612 21:43:39.708059 7884 host.go:66] Checking if "auto-796900" exists ...
I0612 21:43:39.728050 7884 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0612 21:43:39.738051 7884 cli_runner.go:164] Run: docker container inspect auto-796900 --format={{.State.Status}}
I0612 21:43:39.739058 7884 cli_runner.go:164] Run: docker container inspect auto-796900 --format={{.State.Status}}
I0612 21:43:39.977920 7884 out.go:177] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
I0612 21:43:40.257524 6548 kubeadm.go:309] [init] Using Kubernetes version: v1.30.1
I0612 21:43:40.257524 6548 kubeadm.go:309] [preflight] Running pre-flight checks
I0612 21:43:40.257524 6548 kubeadm.go:309] [preflight] Pulling images required for setting up a Kubernetes cluster
I0612 21:43:40.257524 6548 kubeadm.go:309] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0612 21:43:40.257524 6548 kubeadm.go:309] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0612 21:43:40.257524 6548 kubeadm.go:309] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0612 21:43:40.261514 6548 out.go:204] - Generating certificates and keys ...
I0612 21:43:40.261514 6548 kubeadm.go:309] [certs] Using existing ca certificate authority
I0612 21:43:40.261514 6548 kubeadm.go:309] [certs] Using existing apiserver certificate and key on disk
I0612 21:43:40.261514 6548 kubeadm.go:309] [certs] Generating "apiserver-kubelet-client" certificate and key
I0612 21:43:40.261514 6548 kubeadm.go:309] [certs] Generating "front-proxy-ca" certificate and key
I0612 21:43:40.261514 6548 kubeadm.go:309] [certs] Generating "front-proxy-client" certificate and key
I0612 21:43:40.262537 6548 kubeadm.go:309] [certs] Generating "etcd/ca" certificate and key
I0612 21:43:40.262537 6548 kubeadm.go:309] [certs] Generating "etcd/server" certificate and key
I0612 21:43:40.262537 6548 kubeadm.go:309] [certs] etcd/server serving cert is signed for DNS names [kindnet-796900 localhost] and IPs [192.168.121.2 127.0.0.1 ::1]
I0612 21:43:40.262537 6548 kubeadm.go:309] [certs] Generating "etcd/peer" certificate and key
I0612 21:43:40.262537 6548 kubeadm.go:309] [certs] etcd/peer serving cert is signed for DNS names [kindnet-796900 localhost] and IPs [192.168.121.2 127.0.0.1 ::1]
I0612 21:43:40.262537 6548 kubeadm.go:309] [certs] Generating "etcd/healthcheck-client" certificate and key
I0612 21:43:40.263508 6548 kubeadm.go:309] [certs] Generating "apiserver-etcd-client" certificate and key
I0612 21:43:40.263508 6548 kubeadm.go:309] [certs] Generating "sa" key and public key
I0612 21:43:40.263508 6548 kubeadm.go:309] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0612 21:43:40.263508 6548 kubeadm.go:309] [kubeconfig] Writing "admin.conf" kubeconfig file
I0612 21:43:40.263508 6548 kubeadm.go:309] [kubeconfig] Writing "super-admin.conf" kubeconfig file
I0612 21:43:40.263508 6548 kubeadm.go:309] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0612 21:43:40.264521 6548 kubeadm.go:309] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0612 21:43:40.264521 6548 kubeadm.go:309] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0612 21:43:40.264521 6548 kubeadm.go:309] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0612 21:43:40.264521 6548 kubeadm.go:309] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0612 21:43:40.267514 6548 out.go:204] - Booting up control plane ...
I0612 21:43:40.268519 6548 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0612 21:43:40.270156 6548 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0612 21:43:40.270156 6548 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0612 21:43:40.270156 6548 kubeadm.go:309] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0612 21:43:40.270156 6548 kubeadm.go:309] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0612 21:43:40.270156 6548 kubeadm.go:309] [kubelet-start] Starting the kubelet
I0612 21:43:40.271121 6548 kubeadm.go:309] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests"
I0612 21:43:40.271121 6548 kubeadm.go:309] [kubelet-check] Waiting for a healthy kubelet. This can take up to 4m0s
I0612 21:43:40.271121 6548 kubeadm.go:309] [kubelet-check] The kubelet is healthy after 1.004267766s
I0612 21:43:40.271121 6548 kubeadm.go:309] [api-check] Waiting for a healthy API server. This can take up to 4m0s
I0612 21:43:40.271121 6548 kubeadm.go:309] [api-check] The API server is healthy after 11.004074754s
I0612 21:43:40.271121 6548 kubeadm.go:309] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace
I0612 21:43:40.271121 6548 kubeadm.go:309] [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster
I0612 21:43:40.272123 6548 kubeadm.go:309] [upload-certs] Skipping phase. Please see --upload-certs
I0612 21:43:40.272123 6548 kubeadm.go:309] [mark-control-plane] Marking the node kindnet-796900 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]
I0612 21:43:40.272123 6548 kubeadm.go:309] [bootstrap-token] Using token: wtjz33.tavt9ij9a6nq8b3k
I0612 21:43:40.274568 6548 out.go:204] - Configuring RBAC rules ...
I0612 21:43:40.275124 6548 kubeadm.go:309] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles
I0612 21:43:40.275124 6548 kubeadm.go:309] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes
I0612 21:43:40.275124 6548 kubeadm.go:309] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials
I0612 21:43:40.277126 6548 kubeadm.go:309] [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token
I0612 21:43:40.277126 6548 kubeadm.go:309] [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster
I0612 21:43:40.277126 6548 kubeadm.go:309] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace
I0612 21:43:40.277126 6548 kubeadm.go:309] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key
I0612 21:43:40.277126 6548 kubeadm.go:309] [addons] Applied essential addon: CoreDNS
I0612 21:43:40.277126 6548 kubeadm.go:309] [addons] Applied essential addon: kube-proxy
I0612 21:43:40.277126 6548 kubeadm.go:309]
I0612 21:43:40.278123 6548 kubeadm.go:309] Your Kubernetes control-plane has initialized successfully!
I0612 21:43:40.278123 6548 kubeadm.go:309]
I0612 21:43:40.278123 6548 kubeadm.go:309] To start using your cluster, you need to run the following as a regular user:
I0612 21:43:40.278123 6548 kubeadm.go:309]
I0612 21:43:40.279122 6548 kubeadm.go:309] mkdir -p $HOME/.kube
I0612 21:43:40.279122 6548 kubeadm.go:309] sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config
I0612 21:43:40.279122 6548 kubeadm.go:309] sudo chown $(id -u):$(id -g) $HOME/.kube/config
I0612 21:43:40.279122 6548 kubeadm.go:309]
I0612 21:43:40.279122 6548 kubeadm.go:309] Alternatively, if you are the root user, you can run:
I0612 21:43:40.279122 6548 kubeadm.go:309]
I0612 21:43:40.280126 6548 kubeadm.go:309] export KUBECONFIG=/etc/kubernetes/admin.conf
I0612 21:43:40.280126 6548 kubeadm.go:309]
I0612 21:43:40.280126 6548 kubeadm.go:309] You should now deploy a pod network to the cluster.
I0612 21:43:40.280126 6548 kubeadm.go:309] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:
I0612 21:43:40.280126 6548 kubeadm.go:309] https://kubernetes.io/docs/concepts/cluster-administration/addons/
I0612 21:43:40.280126 6548 kubeadm.go:309]
I0612 21:43:40.280126 6548 kubeadm.go:309] You can now join any number of control-plane nodes by copying certificate authorities
I0612 21:43:40.280126 6548 kubeadm.go:309] and service account keys on each node and then running the following as root:
I0612 21:43:40.280126 6548 kubeadm.go:309]
I0612 21:43:40.281121 6548 kubeadm.go:309] kubeadm join control-plane.minikube.internal:8443 --token wtjz33.tavt9ij9a6nq8b3k \
I0612 21:43:40.281121 6548 kubeadm.go:309] --discovery-token-ca-cert-hash sha256:d3e1d8f0c562b67cbe33b6d209756a1fd624c8baad08c702c70b38fe31217116 \
I0612 21:43:40.281121 6548 kubeadm.go:309] --control-plane
I0612 21:43:40.281121 6548 kubeadm.go:309]
I0612 21:43:40.281121 6548 kubeadm.go:309] Then you can join any number of worker nodes by running the following on each as root:
I0612 21:43:40.281121 6548 kubeadm.go:309]
I0612 21:43:40.281121 6548 kubeadm.go:309] kubeadm join control-plane.minikube.internal:8443 --token wtjz33.tavt9ij9a6nq8b3k \
I0612 21:43:40.281121 6548 kubeadm.go:309] --discovery-token-ca-cert-hash sha256:d3e1d8f0c562b67cbe33b6d209756a1fd624c8baad08c702c70b38fe31217116
I0612 21:43:40.281121 6548 cni.go:84] Creating CNI manager for "kindnet"
I0612 21:43:40.285133 6548 out.go:177] * Configuring CNI (Container Networking Interface) ...
I0612 21:43:39.981923 7884 addons.go:431] installing /etc/kubernetes/addons/storage-provisioner.yaml
I0612 21:43:39.981923 7884 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I0612 21:43:39.998911 7884 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" auto-796900
I0612 21:43:39.999927 7884 addons.go:234] Setting addon default-storageclass=true in "auto-796900"
I0612 21:43:39.999927 7884 host.go:66] Checking if "auto-796900" exists ...
I0612 21:43:40.022909 7884 cli_runner.go:164] Run: docker container inspect auto-796900 --format={{.State.Status}}
I0612 21:43:40.194367 7884 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.30.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^ forward . \/etc\/resolv.conf.*/i \ hosts {\n 192.168.65.254 host.minikube.internal\n fallthrough\n }' -e '/^ errors *$/i \ log' | sudo /var/lib/minikube/binaries/v1.30.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"
I0612 21:43:40.223357 7884 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:55531 SSHKeyPath:C:\Users\jenkins.minikube4\minikube-integration\.minikube\machines\auto-796900\id_rsa Username:docker}
I0612 21:43:40.263508 7884 addons.go:431] installing /etc/kubernetes/addons/storageclass.yaml
I0612 21:43:40.263508 7884 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I0612 21:43:40.279122 7884 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" auto-796900
I0612 21:43:40.401921 7884 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0612 21:43:40.504623 7884 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:55531 SSHKeyPath:C:\Users\jenkins.minikube4\minikube-integration\.minikube\machines\auto-796900\id_rsa Username:docker}
I0612 21:43:40.795827 7884 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I0612 21:43:41.019024 7884 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.1/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
I0612 21:43:36.500747 10648 addons.go:431] installing /etc/kubernetes/addons/dashboard-ns.yaml
I0612 21:43:36.500747 10648 ssh_runner.go:362] scp dashboard/dashboard-ns.yaml --> /etc/kubernetes/addons/dashboard-ns.yaml (759 bytes)
I0612 21:43:36.509751 10648 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" newest-cni-074000
I0612 21:43:36.510741 10648 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" newest-cni-074000
I0612 21:43:36.517754 10648 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" newest-cni-074000
I0612 21:43:36.529755 10648 cli_runner.go:164] Run: docker container inspect newest-cni-074000 --format={{.State.Status}}
I0612 21:43:36.761776 10648 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:55598 SSHKeyPath:C:\Users\jenkins.minikube4\minikube-integration\.minikube\machines\newest-cni-074000\id_rsa Username:docker}
I0612 21:43:36.761776 10648 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:55598 SSHKeyPath:C:\Users\jenkins.minikube4\minikube-integration\.minikube\machines\newest-cni-074000\id_rsa Username:docker}
I0612 21:43:36.778758 10648 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:55598 SSHKeyPath:C:\Users\jenkins.minikube4\minikube-integration\.minikube\machines\newest-cni-074000\id_rsa Username:docker}
I0612 21:43:36.790752 10648 addons.go:431] installing /etc/kubernetes/addons/storageclass.yaml
I0612 21:43:36.790752 10648 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I0612 21:43:36.799765 10648 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" newest-cni-074000
I0612 21:43:37.043952 10648 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:55598 SSHKeyPath:C:\Users\jenkins.minikube4\minikube-integration\.minikube\machines\newest-cni-074000\id_rsa Username:docker}
I0612 21:43:37.080948 10648 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0612 21:43:37.268631 10648 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "8443/tcp") 0).HostPort}}'" newest-cni-074000
I0612 21:43:37.284663 10648 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I0612 21:43:37.362563 10648 addons.go:431] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
I0612 21:43:37.362563 10648 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1825 bytes)
I0612 21:43:37.475870 10648 addons.go:431] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
I0612 21:43:37.475870 10648 ssh_runner.go:362] scp metrics-server/metrics-server-rbac.yaml --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)
I0612 21:43:37.501843 10648 api_server.go:52] waiting for apiserver process to appear ...
I0612 21:43:37.521987 10648 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0612 21:43:37.574856 10648 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.1/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
I0612 21:43:37.672174 10648 addons.go:431] installing /etc/kubernetes/addons/dashboard-clusterrole.yaml
I0612 21:43:37.672174 10648 ssh_runner.go:362] scp dashboard/dashboard-clusterrole.yaml --> /etc/kubernetes/addons/dashboard-clusterrole.yaml (1001 bytes)
I0612 21:43:37.749558 10648 addons.go:431] installing /etc/kubernetes/addons/metrics-server-service.yaml
I0612 21:43:37.749558 10648 ssh_runner.go:362] scp metrics-server/metrics-server-service.yaml --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)
I0612 21:43:37.869080 10648 addons.go:431] installing /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml
I0612 21:43:37.869080 10648 ssh_runner.go:362] scp dashboard/dashboard-clusterrolebinding.yaml --> /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml (1018 bytes)
I0612 21:43:37.973320 10648 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.1/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0612 21:43:38.057056 10648 addons.go:431] installing /etc/kubernetes/addons/dashboard-configmap.yaml
I0612 21:43:38.057056 10648 ssh_runner.go:362] scp dashboard/dashboard-configmap.yaml --> /etc/kubernetes/addons/dashboard-configmap.yaml (837 bytes)
I0612 21:43:38.251991 10648 addons.go:431] installing /etc/kubernetes/addons/dashboard-dp.yaml
I0612 21:43:38.251991 10648 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-dp.yaml (4201 bytes)
I0612 21:43:38.374606 10648 addons.go:431] installing /etc/kubernetes/addons/dashboard-role.yaml
I0612 21:43:38.374606 10648 ssh_runner.go:362] scp dashboard/dashboard-role.yaml --> /etc/kubernetes/addons/dashboard-role.yaml (1724 bytes)
I0612 21:43:38.566059 10648 addons.go:431] installing /etc/kubernetes/addons/dashboard-rolebinding.yaml
I0612 21:43:38.566059 10648 ssh_runner.go:362] scp dashboard/dashboard-rolebinding.yaml --> /etc/kubernetes/addons/dashboard-rolebinding.yaml (1046 bytes)
I0612 21:43:38.674274 10648 addons.go:431] installing /etc/kubernetes/addons/dashboard-sa.yaml
I0612 21:43:38.674274 10648 ssh_runner.go:362] scp dashboard/dashboard-sa.yaml --> /etc/kubernetes/addons/dashboard-sa.yaml (837 bytes)
I0612 21:43:38.774287 10648 addons.go:431] installing /etc/kubernetes/addons/dashboard-secret.yaml
I0612 21:43:38.774287 10648 ssh_runner.go:362] scp dashboard/dashboard-secret.yaml --> /etc/kubernetes/addons/dashboard-secret.yaml (1389 bytes)
I0612 21:43:38.880374 10648 addons.go:431] installing /etc/kubernetes/addons/dashboard-svc.yaml
I0612 21:43:38.880374 10648 ssh_runner.go:362] scp dashboard/dashboard-svc.yaml --> /etc/kubernetes/addons/dashboard-svc.yaml (1294 bytes)
I0612 21:43:38.999867 10648 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.1/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
I0612 21:43:41.584149 7884 ssh_runner.go:235] Completed: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.30.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^ forward . \/etc\/resolv.conf.*/i \ hosts {\n 192.168.65.254 host.minikube.internal\n fallthrough\n }' -e '/^ errors *$/i \ log' | sudo /var/lib/minikube/binaries/v1.30.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -": (1.3897156s)
I0612 21:43:41.584149 7884 start.go:946] {"host.minikube.internal": 192.168.65.254} host record injected into CoreDNS's ConfigMap
I0612 21:43:41.585144 7884 ssh_runner.go:235] Completed: sudo systemctl start kubelet: (1.1831675s)
I0612 21:43:41.602252 7884 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "8443/tcp") 0).HostPort}}'" auto-796900
I0612 21:43:41.863258 7884 node_ready.go:35] waiting up to 15m0s for node "auto-796900" to be "Ready" ...
I0612 21:43:41.892485 7884 node_ready.go:49] node "auto-796900" has status "Ready":"True"
I0612 21:43:41.892623 7884 node_ready.go:38] duration metric: took 29.3643ms for node "auto-796900" to be "Ready" ...
I0612 21:43:41.892623 7884 pod_ready.go:35] extra waiting up to 15m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0612 21:43:41.978808 7884 pod_ready.go:78] waiting up to 15m0s for pod "coredns-7db6d8ff4d-qhkh2" in "kube-system" namespace to be "Ready" ...
I0612 21:43:42.154876 7884 kapi.go:248] "coredns" deployment in "kube-system" namespace and "auto-796900" context rescaled to 1 replicas
I0612 21:43:42.889894 7884 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: (2.0939672s)
I0612 21:43:42.889894 7884 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.1/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: (1.8697814s)
I0612 21:43:42.980163 7884 out.go:177] * Enabled addons: storage-provisioner, default-storageclass
I0612 21:43:38.571139 5540 logs.go:123] Gathering logs for Docker ...
I0612 21:43:38.571139 5540 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
I0612 21:43:38.632061 5540 logs.go:123] Gathering logs for describe nodes ...
I0612 21:43:38.632061 5540 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0612 21:43:38.889375 5540 logs.go:123] Gathering logs for etcd [48b924cc9ca8] ...
I0612 21:43:38.889375 5540 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 48b924cc9ca8"
I0612 21:43:38.964870 5540 logs.go:123] Gathering logs for coredns [b5adbbbe1b1d] ...
I0612 21:43:38.964870 5540 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b5adbbbe1b1d"
I0612 21:43:39.027557 5540 logs.go:123] Gathering logs for kube-proxy [9bdf65930601] ...
I0612 21:43:39.027557 5540 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 9bdf65930601"
I0612 21:43:39.089085 5540 logs.go:123] Gathering logs for kubelet ...
I0612 21:43:39.089085 5540 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
W0612 21:43:39.203925 5540 logs.go:138] Found kubelet problem: Jun 12 21:38:18 old-k8s-version-606600 kubelet[1666]: E0612 21:38:18.108202 1666 pod_workers.go:191] Error syncing pod cbdf526e-ee8e-4fbf-83b1-066d29ec1239 ("metrics-server-9975d5f86-ltrjr_kube-system(cbdf526e-ee8e-4fbf-83b1-066d29ec1239)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = Error response from daemon: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.65.254:53: no such host"
W0612 21:43:39.204924 5540 logs.go:138] Found kubelet problem: Jun 12 21:38:18 old-k8s-version-606600 kubelet[1666]: E0612 21:38:18.197645 1666 pod_workers.go:191] Error syncing pod cbdf526e-ee8e-4fbf-83b1-066d29ec1239 ("metrics-server-9975d5f86-ltrjr_kube-system(cbdf526e-ee8e-4fbf-83b1-066d29ec1239)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0612 21:43:39.205934 5540 logs.go:138] Found kubelet problem: Jun 12 21:38:19 old-k8s-version-606600 kubelet[1666]: E0612 21:38:19.232272 1666 pod_workers.go:191] Error syncing pod cbdf526e-ee8e-4fbf-83b1-066d29ec1239 ("metrics-server-9975d5f86-ltrjr_kube-system(cbdf526e-ee8e-4fbf-83b1-066d29ec1239)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0612 21:43:39.206922 5540 logs.go:138] Found kubelet problem: Jun 12 21:38:34 old-k8s-version-606600 kubelet[1666]: E0612 21:38:34.085575 1666 reflector.go:138] object-"kubernetes-dashboard"/"kubernetes-dashboard-token-zgnbp": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kubernetes-dashboard-token-zgnbp" is forbidden: User "system:node:old-k8s-version-606600" cannot list resource "secrets" in API group "" in the namespace "kubernetes-dashboard": no relationship found between node 'old-k8s-version-606600' and this object
W0612 21:43:39.209921 5540 logs.go:138] Found kubelet problem: Jun 12 21:38:34 old-k8s-version-606600 kubelet[1666]: E0612 21:38:34.495556 1666 pod_workers.go:191] Error syncing pod cbdf526e-ee8e-4fbf-83b1-066d29ec1239 ("metrics-server-9975d5f86-ltrjr_kube-system(cbdf526e-ee8e-4fbf-83b1-066d29ec1239)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = Error response from daemon: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.65.254:53: no such host"
W0612 21:43:39.212925 5540 logs.go:138] Found kubelet problem: Jun 12 21:38:37 old-k8s-version-606600 kubelet[1666]: E0612 21:38:37.256650 1666 pod_workers.go:191] Error syncing pod 7700737f-ee51-48c5-9fc0-24437fe76fbf ("dashboard-metrics-scraper-8d5bb5db8-qrxqz_kubernetes-dashboard(7700737f-ee51-48c5-9fc0-24437fe76fbf)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ErrImagePull: "rpc error: code = Unknown desc = [DEPRECATION NOTICE] Docker Image Format v1 and Docker Image manifest version 2, schema 1 support is disabled by default and will be removed in an upcoming release. Suggest the author of registry.k8s.io/echoserver:1.4 to upgrade the image to the OCI Format or Docker Image manifest v2, schema 2. More information at https://docs.docker.com/go/deprecated-image-specs/"
W0612 21:43:39.213942 5540 logs.go:138] Found kubelet problem: Jun 12 21:38:37 old-k8s-version-606600 kubelet[1666]: E0612 21:38:37.889727 1666 pod_workers.go:191] Error syncing pod 7700737f-ee51-48c5-9fc0-24437fe76fbf ("dashboard-metrics-scraper-8d5bb5db8-qrxqz_kubernetes-dashboard(7700737f-ee51-48c5-9fc0-24437fe76fbf)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0612 21:43:39.214499 5540 logs.go:138] Found kubelet problem: Jun 12 21:38:38 old-k8s-version-606600 kubelet[1666]: E0612 21:38:38.912678 1666 pod_workers.go:191] Error syncing pod 7700737f-ee51-48c5-9fc0-24437fe76fbf ("dashboard-metrics-scraper-8d5bb5db8-qrxqz_kubernetes-dashboard(7700737f-ee51-48c5-9fc0-24437fe76fbf)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0612 21:43:39.215390 5540 logs.go:138] Found kubelet problem: Jun 12 21:38:39 old-k8s-version-606600 kubelet[1666]: E0612 21:38:39.950470 1666 pod_workers.go:191] Error syncing pod 12c0e34d-3bef-4207-9e19-43c91aea19c2 ("storage-provisioner_kube-system(12c0e34d-3bef-4207-9e19-43c91aea19c2)"), skipping: failed to "StartContainer" for "storage-provisioner" with CrashLoopBackOff: "back-off 10s restarting failed container=storage-provisioner pod=storage-provisioner_kube-system(12c0e34d-3bef-4207-9e19-43c91aea19c2)"
W0612 21:43:39.215556 5540 logs.go:138] Found kubelet problem: Jun 12 21:38:45 old-k8s-version-606600 kubelet[1666]: E0612 21:38:45.301360 1666 pod_workers.go:191] Error syncing pod cbdf526e-ee8e-4fbf-83b1-066d29ec1239 ("metrics-server-9975d5f86-ltrjr_kube-system(cbdf526e-ee8e-4fbf-83b1-066d29ec1239)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0612 21:43:39.218389 5540 logs.go:138] Found kubelet problem: Jun 12 21:39:00 old-k8s-version-606600 kubelet[1666]: E0612 21:39:00.285017 1666 pod_workers.go:191] Error syncing pod 7700737f-ee51-48c5-9fc0-24437fe76fbf ("dashboard-metrics-scraper-8d5bb5db8-qrxqz_kubernetes-dashboard(7700737f-ee51-48c5-9fc0-24437fe76fbf)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ErrImagePull: "rpc error: code = Unknown desc = [DEPRECATION NOTICE] Docker Image Format v1 and Docker Image manifest version 2, schema 1 support is disabled by default and will be removed in an upcoming release. Suggest the author of registry.k8s.io/echoserver:1.4 to upgrade the image to the OCI Format or Docker Image manifest v2, schema 2. More information at https://docs.docker.com/go/deprecated-image-specs/"
W0612 21:43:39.220383 5540 logs.go:138] Found kubelet problem: Jun 12 21:39:00 old-k8s-version-606600 kubelet[1666]: E0612 21:39:00.377954 1666 pod_workers.go:191] Error syncing pod cbdf526e-ee8e-4fbf-83b1-066d29ec1239 ("metrics-server-9975d5f86-ltrjr_kube-system(cbdf526e-ee8e-4fbf-83b1-066d29ec1239)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = Error response from daemon: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.65.254:53: no such host"
W0612 21:43:39.220383 5540 logs.go:138] Found kubelet problem: Jun 12 21:39:12 old-k8s-version-606600 kubelet[1666]: E0612 21:39:12.297156 1666 pod_workers.go:191] Error syncing pod 7700737f-ee51-48c5-9fc0-24437fe76fbf ("dashboard-metrics-scraper-8d5bb5db8-qrxqz_kubernetes-dashboard(7700737f-ee51-48c5-9fc0-24437fe76fbf)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0612 21:43:39.221388 5540 logs.go:138] Found kubelet problem: Jun 12 21:39:12 old-k8s-version-606600 kubelet[1666]: E0612 21:39:12.297233 1666 pod_workers.go:191] Error syncing pod cbdf526e-ee8e-4fbf-83b1-066d29ec1239 ("metrics-server-9975d5f86-ltrjr_kube-system(cbdf526e-ee8e-4fbf-83b1-066d29ec1239)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0612 21:43:39.221388 5540 logs.go:138] Found kubelet problem: Jun 12 21:39:23 old-k8s-version-606600 kubelet[1666]: E0612 21:39:23.296706 1666 pod_workers.go:191] Error syncing pod cbdf526e-ee8e-4fbf-83b1-066d29ec1239 ("metrics-server-9975d5f86-ltrjr_kube-system(cbdf526e-ee8e-4fbf-83b1-066d29ec1239)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0612 21:43:39.223396 5540 logs.go:138] Found kubelet problem: Jun 12 21:39:27 old-k8s-version-606600 kubelet[1666]: E0612 21:39:27.717082 1666 pod_workers.go:191] Error syncing pod 7700737f-ee51-48c5-9fc0-24437fe76fbf ("dashboard-metrics-scraper-8d5bb5db8-qrxqz_kubernetes-dashboard(7700737f-ee51-48c5-9fc0-24437fe76fbf)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ErrImagePull: "rpc error: code = Unknown desc = [DEPRECATION NOTICE] Docker Image Format v1 and Docker Image manifest version 2, schema 1 support is disabled by default and will be removed in an upcoming release. Suggest the author of registry.k8s.io/echoserver:1.4 to upgrade the image to the OCI Format or Docker Image manifest v2, schema 2. More information at https://docs.docker.com/go/deprecated-image-specs/"
W0612 21:43:39.223396 5540 logs.go:138] Found kubelet problem: Jun 12 21:39:34 old-k8s-version-606600 kubelet[1666]: E0612 21:39:34.293373 1666 pod_workers.go:191] Error syncing pod cbdf526e-ee8e-4fbf-83b1-066d29ec1239 ("metrics-server-9975d5f86-ltrjr_kube-system(cbdf526e-ee8e-4fbf-83b1-066d29ec1239)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0612 21:43:39.223396 5540 logs.go:138] Found kubelet problem: Jun 12 21:39:42 old-k8s-version-606600 kubelet[1666]: E0612 21:39:42.310173 1666 pod_workers.go:191] Error syncing pod 7700737f-ee51-48c5-9fc0-24437fe76fbf ("dashboard-metrics-scraper-8d5bb5db8-qrxqz_kubernetes-dashboard(7700737f-ee51-48c5-9fc0-24437fe76fbf)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0612 21:43:39.226381 5540 logs.go:138] Found kubelet problem: Jun 12 21:39:45 old-k8s-version-606600 kubelet[1666]: E0612 21:39:45.350617 1666 pod_workers.go:191] Error syncing pod cbdf526e-ee8e-4fbf-83b1-066d29ec1239 ("metrics-server-9975d5f86-ltrjr_kube-system(cbdf526e-ee8e-4fbf-83b1-066d29ec1239)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = Error response from daemon: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.65.254:53: no such host"
W0612 21:43:39.226381 5540 logs.go:138] Found kubelet problem: Jun 12 21:39:53 old-k8s-version-606600 kubelet[1666]: E0612 21:39:53.294158 1666 pod_workers.go:191] Error syncing pod 7700737f-ee51-48c5-9fc0-24437fe76fbf ("dashboard-metrics-scraper-8d5bb5db8-qrxqz_kubernetes-dashboard(7700737f-ee51-48c5-9fc0-24437fe76fbf)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0612 21:43:39.226381 5540 logs.go:138] Found kubelet problem: Jun 12 21:39:59 old-k8s-version-606600 kubelet[1666]: E0612 21:39:59.289780 1666 pod_workers.go:191] Error syncing pod cbdf526e-ee8e-4fbf-83b1-066d29ec1239 ("metrics-server-9975d5f86-ltrjr_kube-system(cbdf526e-ee8e-4fbf-83b1-066d29ec1239)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0612 21:43:39.226381 5540 logs.go:138] Found kubelet problem: Jun 12 21:40:06 old-k8s-version-606600 kubelet[1666]: E0612 21:40:06.290907 1666 pod_workers.go:191] Error syncing pod 7700737f-ee51-48c5-9fc0-24437fe76fbf ("dashboard-metrics-scraper-8d5bb5db8-qrxqz_kubernetes-dashboard(7700737f-ee51-48c5-9fc0-24437fe76fbf)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0612 21:43:39.226381 5540 logs.go:138] Found kubelet problem: Jun 12 21:40:14 old-k8s-version-606600 kubelet[1666]: E0612 21:40:14.295198 1666 pod_workers.go:191] Error syncing pod cbdf526e-ee8e-4fbf-83b1-066d29ec1239 ("metrics-server-9975d5f86-ltrjr_kube-system(cbdf526e-ee8e-4fbf-83b1-066d29ec1239)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0612 21:43:39.230396 5540 logs.go:138] Found kubelet problem: Jun 12 21:40:20 old-k8s-version-606600 kubelet[1666]: E0612 21:40:20.713009 1666 pod_workers.go:191] Error syncing pod 7700737f-ee51-48c5-9fc0-24437fe76fbf ("dashboard-metrics-scraper-8d5bb5db8-qrxqz_kubernetes-dashboard(7700737f-ee51-48c5-9fc0-24437fe76fbf)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ErrImagePull: "rpc error: code = Unknown desc = [DEPRECATION NOTICE] Docker Image Format v1 and Docker Image manifest version 2, schema 1 support is disabled by default and will be removed in an upcoming release. Suggest the author of registry.k8s.io/echoserver:1.4 to upgrade the image to the OCI Format or Docker Image manifest v2, schema 2. More information at https://docs.docker.com/go/deprecated-image-specs/"
W0612 21:43:39.230396 5540 logs.go:138] Found kubelet problem: Jun 12 21:40:27 old-k8s-version-606600 kubelet[1666]: E0612 21:40:27.292602 1666 pod_workers.go:191] Error syncing pod cbdf526e-ee8e-4fbf-83b1-066d29ec1239 ("metrics-server-9975d5f86-ltrjr_kube-system(cbdf526e-ee8e-4fbf-83b1-066d29ec1239)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0612 21:43:39.231376 5540 logs.go:138] Found kubelet problem: Jun 12 21:40:35 old-k8s-version-606600 kubelet[1666]: E0612 21:40:35.288460 1666 pod_workers.go:191] Error syncing pod 7700737f-ee51-48c5-9fc0-24437fe76fbf ("dashboard-metrics-scraper-8d5bb5db8-qrxqz_kubernetes-dashboard(7700737f-ee51-48c5-9fc0-24437fe76fbf)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0612 21:43:39.231376 5540 logs.go:138] Found kubelet problem: Jun 12 21:40:38 old-k8s-version-606600 kubelet[1666]: E0612 21:40:38.288195 1666 pod_workers.go:191] Error syncing pod cbdf526e-ee8e-4fbf-83b1-066d29ec1239 ("metrics-server-9975d5f86-ltrjr_kube-system(cbdf526e-ee8e-4fbf-83b1-066d29ec1239)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0612 21:43:39.231376 5540 logs.go:138] Found kubelet problem: Jun 12 21:40:48 old-k8s-version-606600 kubelet[1666]: E0612 21:40:48.304887 1666 pod_workers.go:191] Error syncing pod 7700737f-ee51-48c5-9fc0-24437fe76fbf ("dashboard-metrics-scraper-8d5bb5db8-qrxqz_kubernetes-dashboard(7700737f-ee51-48c5-9fc0-24437fe76fbf)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0612 21:43:39.231376 5540 logs.go:138] Found kubelet problem: Jun 12 21:40:49 old-k8s-version-606600 kubelet[1666]: E0612 21:40:49.287899 1666 pod_workers.go:191] Error syncing pod cbdf526e-ee8e-4fbf-83b1-066d29ec1239 ("metrics-server-9975d5f86-ltrjr_kube-system(cbdf526e-ee8e-4fbf-83b1-066d29ec1239)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0612 21:43:39.231376 5540 logs.go:138] Found kubelet problem: Jun 12 21:41:00 old-k8s-version-606600 kubelet[1666]: E0612 21:41:00.286411 1666 pod_workers.go:191] Error syncing pod cbdf526e-ee8e-4fbf-83b1-066d29ec1239 ("metrics-server-9975d5f86-ltrjr_kube-system(cbdf526e-ee8e-4fbf-83b1-066d29ec1239)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0612 21:43:39.232377 5540 logs.go:138] Found kubelet problem: Jun 12 21:41:03 old-k8s-version-606600 kubelet[1666]: E0612 21:41:03.286078 1666 pod_workers.go:191] Error syncing pod 7700737f-ee51-48c5-9fc0-24437fe76fbf ("dashboard-metrics-scraper-8d5bb5db8-qrxqz_kubernetes-dashboard(7700737f-ee51-48c5-9fc0-24437fe76fbf)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0612 21:43:39.234376 5540 logs.go:138] Found kubelet problem: Jun 12 21:41:12 old-k8s-version-606600 kubelet[1666]: E0612 21:41:12.338980 1666 pod_workers.go:191] Error syncing pod cbdf526e-ee8e-4fbf-83b1-066d29ec1239 ("metrics-server-9975d5f86-ltrjr_kube-system(cbdf526e-ee8e-4fbf-83b1-066d29ec1239)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = Error response from daemon: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.65.254:53: no such host"
W0612 21:43:39.235522 5540 logs.go:138] Found kubelet problem: Jun 12 21:41:16 old-k8s-version-606600 kubelet[1666]: E0612 21:41:16.369660 1666 pod_workers.go:191] Error syncing pod 7700737f-ee51-48c5-9fc0-24437fe76fbf ("dashboard-metrics-scraper-8d5bb5db8-qrxqz_kubernetes-dashboard(7700737f-ee51-48c5-9fc0-24437fe76fbf)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0612 21:43:39.236501 5540 logs.go:138] Found kubelet problem: Jun 12 21:41:25 old-k8s-version-606600 kubelet[1666]: E0612 21:41:25.285535 1666 pod_workers.go:191] Error syncing pod cbdf526e-ee8e-4fbf-83b1-066d29ec1239 ("metrics-server-9975d5f86-ltrjr_kube-system(cbdf526e-ee8e-4fbf-83b1-066d29ec1239)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0612 21:43:39.236766 5540 logs.go:138] Found kubelet problem: Jun 12 21:41:29 old-k8s-version-606600 kubelet[1666]: E0612 21:41:29.282908 1666 pod_workers.go:191] Error syncing pod 7700737f-ee51-48c5-9fc0-24437fe76fbf ("dashboard-metrics-scraper-8d5bb5db8-qrxqz_kubernetes-dashboard(7700737f-ee51-48c5-9fc0-24437fe76fbf)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0612 21:43:39.236982 5540 logs.go:138] Found kubelet problem: Jun 12 21:41:37 old-k8s-version-606600 kubelet[1666]: E0612 21:41:37.281613 1666 pod_workers.go:191] Error syncing pod cbdf526e-ee8e-4fbf-83b1-066d29ec1239 ("metrics-server-9975d5f86-ltrjr_kube-system(cbdf526e-ee8e-4fbf-83b1-066d29ec1239)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0612 21:43:39.240034 5540 logs.go:138] Found kubelet problem: Jun 12 21:41:46 old-k8s-version-606600 kubelet[1666]: E0612 21:41:46.818084 1666 pod_workers.go:191] Error syncing pod 7700737f-ee51-48c5-9fc0-24437fe76fbf ("dashboard-metrics-scraper-8d5bb5db8-qrxqz_kubernetes-dashboard(7700737f-ee51-48c5-9fc0-24437fe76fbf)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ErrImagePull: "rpc error: code = Unknown desc = [DEPRECATION NOTICE] Docker Image Format v1 and Docker Image manifest version 2, schema 1 support is disabled by default and will be removed in an upcoming release. Suggest the author of registry.k8s.io/echoserver:1.4 to upgrade the image to the OCI Format or Docker Image manifest v2, schema 2. More information at https://docs.docker.com/go/deprecated-image-specs/"
W0612 21:43:39.240573 5540 logs.go:138] Found kubelet problem: Jun 12 21:41:49 old-k8s-version-606600 kubelet[1666]: E0612 21:41:49.282375 1666 pod_workers.go:191] Error syncing pod cbdf526e-ee8e-4fbf-83b1-066d29ec1239 ("metrics-server-9975d5f86-ltrjr_kube-system(cbdf526e-ee8e-4fbf-83b1-066d29ec1239)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0612 21:43:39.240987 5540 logs.go:138] Found kubelet problem: Jun 12 21:41:58 old-k8s-version-606600 kubelet[1666]: E0612 21:41:58.301867 1666 pod_workers.go:191] Error syncing pod 7700737f-ee51-48c5-9fc0-24437fe76fbf ("dashboard-metrics-scraper-8d5bb5db8-qrxqz_kubernetes-dashboard(7700737f-ee51-48c5-9fc0-24437fe76fbf)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0612 21:43:39.240987 5540 logs.go:138] Found kubelet problem: Jun 12 21:42:04 old-k8s-version-606600 kubelet[1666]: E0612 21:42:04.282322 1666 pod_workers.go:191] Error syncing pod cbdf526e-ee8e-4fbf-83b1-066d29ec1239 ("metrics-server-9975d5f86-ltrjr_kube-system(cbdf526e-ee8e-4fbf-83b1-066d29ec1239)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0612 21:43:39.241699 5540 logs.go:138] Found kubelet problem: Jun 12 21:42:11 old-k8s-version-606600 kubelet[1666]: E0612 21:42:11.278999 1666 pod_workers.go:191] Error syncing pod 7700737f-ee51-48c5-9fc0-24437fe76fbf ("dashboard-metrics-scraper-8d5bb5db8-qrxqz_kubernetes-dashboard(7700737f-ee51-48c5-9fc0-24437fe76fbf)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0612 21:43:39.242142 5540 logs.go:138] Found kubelet problem: Jun 12 21:42:17 old-k8s-version-606600 kubelet[1666]: E0612 21:42:17.277966 1666 pod_workers.go:191] Error syncing pod cbdf526e-ee8e-4fbf-83b1-066d29ec1239 ("metrics-server-9975d5f86-ltrjr_kube-system(cbdf526e-ee8e-4fbf-83b1-066d29ec1239)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0612 21:43:39.242597 5540 logs.go:138] Found kubelet problem: Jun 12 21:42:23 old-k8s-version-606600 kubelet[1666]: E0612 21:42:23.279178 1666 pod_workers.go:191] Error syncing pod 7700737f-ee51-48c5-9fc0-24437fe76fbf ("dashboard-metrics-scraper-8d5bb5db8-qrxqz_kubernetes-dashboard(7700737f-ee51-48c5-9fc0-24437fe76fbf)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0612 21:43:39.242597 5540 logs.go:138] Found kubelet problem: Jun 12 21:42:31 old-k8s-version-606600 kubelet[1666]: E0612 21:42:31.276919 1666 pod_workers.go:191] Error syncing pod cbdf526e-ee8e-4fbf-83b1-066d29ec1239 ("metrics-server-9975d5f86-ltrjr_kube-system(cbdf526e-ee8e-4fbf-83b1-066d29ec1239)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0612 21:43:39.242597 5540 logs.go:138] Found kubelet problem: Jun 12 21:42:34 old-k8s-version-606600 kubelet[1666]: E0612 21:42:34.277134 1666 pod_workers.go:191] Error syncing pod 7700737f-ee51-48c5-9fc0-24437fe76fbf ("dashboard-metrics-scraper-8d5bb5db8-qrxqz_kubernetes-dashboard(7700737f-ee51-48c5-9fc0-24437fe76fbf)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0612 21:43:39.242597 5540 logs.go:138] Found kubelet problem: Jun 12 21:42:44 old-k8s-version-606600 kubelet[1666]: E0612 21:42:44.277354 1666 pod_workers.go:191] Error syncing pod cbdf526e-ee8e-4fbf-83b1-066d29ec1239 ("metrics-server-9975d5f86-ltrjr_kube-system(cbdf526e-ee8e-4fbf-83b1-066d29ec1239)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0612 21:43:39.242597 5540 logs.go:138] Found kubelet problem: Jun 12 21:42:49 old-k8s-version-606600 kubelet[1666]: E0612 21:42:49.279624 1666 pod_workers.go:191] Error syncing pod 7700737f-ee51-48c5-9fc0-24437fe76fbf ("dashboard-metrics-scraper-8d5bb5db8-qrxqz_kubernetes-dashboard(7700737f-ee51-48c5-9fc0-24437fe76fbf)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0612 21:43:39.243583 5540 logs.go:138] Found kubelet problem: Jun 12 21:42:59 old-k8s-version-606600 kubelet[1666]: E0612 21:42:59.280403 1666 pod_workers.go:191] Error syncing pod cbdf526e-ee8e-4fbf-83b1-066d29ec1239 ("metrics-server-9975d5f86-ltrjr_kube-system(cbdf526e-ee8e-4fbf-83b1-066d29ec1239)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0612 21:43:39.243583 5540 logs.go:138] Found kubelet problem: Jun 12 21:43:04 old-k8s-version-606600 kubelet[1666]: E0612 21:43:04.308191 1666 pod_workers.go:191] Error syncing pod 7700737f-ee51-48c5-9fc0-24437fe76fbf ("dashboard-metrics-scraper-8d5bb5db8-qrxqz_kubernetes-dashboard(7700737f-ee51-48c5-9fc0-24437fe76fbf)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0612 21:43:39.244580 5540 logs.go:138] Found kubelet problem: Jun 12 21:43:10 old-k8s-version-606600 kubelet[1666]: E0612 21:43:10.273566 1666 pod_workers.go:191] Error syncing pod cbdf526e-ee8e-4fbf-83b1-066d29ec1239 ("metrics-server-9975d5f86-ltrjr_kube-system(cbdf526e-ee8e-4fbf-83b1-066d29ec1239)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0612 21:43:39.244580 5540 logs.go:138] Found kubelet problem: Jun 12 21:43:17 old-k8s-version-606600 kubelet[1666]: E0612 21:43:17.271765 1666 pod_workers.go:191] Error syncing pod 7700737f-ee51-48c5-9fc0-24437fe76fbf ("dashboard-metrics-scraper-8d5bb5db8-qrxqz_kubernetes-dashboard(7700737f-ee51-48c5-9fc0-24437fe76fbf)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0612 21:43:39.244580 5540 logs.go:138] Found kubelet problem: Jun 12 21:43:24 old-k8s-version-606600 kubelet[1666]: E0612 21:43:24.272689 1666 pod_workers.go:191] Error syncing pod cbdf526e-ee8e-4fbf-83b1-066d29ec1239 ("metrics-server-9975d5f86-ltrjr_kube-system(cbdf526e-ee8e-4fbf-83b1-066d29ec1239)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0612 21:43:39.244580 5540 logs.go:138] Found kubelet problem: Jun 12 21:43:32 old-k8s-version-606600 kubelet[1666]: E0612 21:43:32.269407 1666 pod_workers.go:191] Error syncing pod 7700737f-ee51-48c5-9fc0-24437fe76fbf ("dashboard-metrics-scraper-8d5bb5db8-qrxqz_kubernetes-dashboard(7700737f-ee51-48c5-9fc0-24437fe76fbf)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0612 21:43:39.244580 5540 logs.go:138] Found kubelet problem: Jun 12 21:43:38 old-k8s-version-606600 kubelet[1666]: E0612 21:43:38.270486 1666 pod_workers.go:191] Error syncing pod cbdf526e-ee8e-4fbf-83b1-066d29ec1239 ("metrics-server-9975d5f86-ltrjr_kube-system(cbdf526e-ee8e-4fbf-83b1-066d29ec1239)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
I0612 21:43:39.244580 5540 logs.go:123] Gathering logs for dmesg ...
I0612 21:43:39.245580 5540 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0612 21:43:39.279938 5540 logs.go:123] Gathering logs for kube-controller-manager [6116c6070393] ...
I0612 21:43:39.279938 5540 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 6116c6070393"
I0612 21:43:39.359195 5540 logs.go:123] Gathering logs for storage-provisioner [3f440bc35ac0] ...
I0612 21:43:39.359195 5540 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 3f440bc35ac0"
I0612 21:43:39.412949 5540 logs.go:123] Gathering logs for container status ...
I0612 21:43:39.412949 5540 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0612 21:43:39.532262 5540 logs.go:123] Gathering logs for kube-scheduler [6dcf6b435dcb] ...
I0612 21:43:39.532262 5540 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 6dcf6b435dcb"
I0612 21:43:39.610353 5540 logs.go:123] Gathering logs for kube-proxy [c87af550bb83] ...
I0612 21:43:39.610353 5540 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c87af550bb83"
I0612 21:43:39.673064 5540 out.go:304] Setting ErrFile to fd 1608...
I0612 21:43:39.673064 5540 out.go:338] TERM=,COLORTERM=, which probably does not support color
W0612 21:43:39.673064 5540 out.go:239] X Problems detected in kubelet:
W0612 21:43:39.673064 5540 out.go:239] Jun 12 21:43:10 old-k8s-version-606600 kubelet[1666]: E0612 21:43:10.273566 1666 pod_workers.go:191] Error syncing pod cbdf526e-ee8e-4fbf-83b1-066d29ec1239 ("metrics-server-9975d5f86-ltrjr_kube-system(cbdf526e-ee8e-4fbf-83b1-066d29ec1239)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0612 21:43:39.673064 5540 out.go:239] Jun 12 21:43:17 old-k8s-version-606600 kubelet[1666]: E0612 21:43:17.271765 1666 pod_workers.go:191] Error syncing pod 7700737f-ee51-48c5-9fc0-24437fe76fbf ("dashboard-metrics-scraper-8d5bb5db8-qrxqz_kubernetes-dashboard(7700737f-ee51-48c5-9fc0-24437fe76fbf)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0612 21:43:39.673064 5540 out.go:239] Jun 12 21:43:24 old-k8s-version-606600 kubelet[1666]: E0612 21:43:24.272689 1666 pod_workers.go:191] Error syncing pod cbdf526e-ee8e-4fbf-83b1-066d29ec1239 ("metrics-server-9975d5f86-ltrjr_kube-system(cbdf526e-ee8e-4fbf-83b1-066d29ec1239)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0612 21:43:39.673064 5540 out.go:239] Jun 12 21:43:32 old-k8s-version-606600 kubelet[1666]: E0612 21:43:32.269407 1666 pod_workers.go:191] Error syncing pod 7700737f-ee51-48c5-9fc0-24437fe76fbf ("dashboard-metrics-scraper-8d5bb5db8-qrxqz_kubernetes-dashboard(7700737f-ee51-48c5-9fc0-24437fe76fbf)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0612 21:43:39.673064 5540 out.go:239] Jun 12 21:43:38 old-k8s-version-606600 kubelet[1666]: E0612 21:43:38.270486 1666 pod_workers.go:191] Error syncing pod cbdf526e-ee8e-4fbf-83b1-066d29ec1239 ("metrics-server-9975d5f86-ltrjr_kube-system(cbdf526e-ee8e-4fbf-83b1-066d29ec1239)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
I0612 21:43:39.673064 5540 out.go:304] Setting ErrFile to fd 1608...
I0612 21:43:39.674067 5540 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0612 21:43:40.317852 6548 ssh_runner.go:195] Run: stat /opt/cni/bin/portmap
I0612 21:43:40.373936 6548 cni.go:182] applying CNI manifest using /var/lib/minikube/binaries/v1.30.1/kubectl ...
I0612 21:43:40.373936 6548 ssh_runner.go:362] scp memory --> /var/tmp/minikube/cni.yaml (2438 bytes)
I0612 21:43:40.430916 6548 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.1/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml
I0612 21:43:41.415770 6548 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
I0612 21:43:41.432802 6548 ops.go:34] apiserver oom_adj: -16
I0612 21:43:41.434774 6548 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.1/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig
I0612 21:43:41.436777 6548 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes kindnet-796900 minikube.k8s.io/updated_at=2024_06_12T21_43_41_0700 minikube.k8s.io/version=v1.33.1 minikube.k8s.io/commit=8d282d3acc6cc32dfd3bc1bc39edde8a887b9d79 minikube.k8s.io/name=kindnet-796900 minikube.k8s.io/primary=true
I0612 21:43:41.930790 6548 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0612 21:43:42.442400 6548 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0612 21:43:42.942472 6548 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0612 21:43:43.445319 6548 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0612 21:43:43.933320 6548 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0612 21:43:42.986172 7884 addons.go:510] duration metric: took 3.2879646s for enable addons: enabled=[storage-provisioner default-storageclass]
I0612 21:43:44.001209 7884 pod_ready.go:102] pod "coredns-7db6d8ff4d-qhkh2" in "kube-system" namespace has status "Ready":"False"
I0612 21:43:46.010205 7884 pod_ready.go:102] pod "coredns-7db6d8ff4d-qhkh2" in "kube-system" namespace has status "Ready":"False"
I0612 21:43:44.440197 6548 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0612 21:43:44.942009 6548 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0612 21:43:45.437596 6548 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0612 21:43:45.939971 6548 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0612 21:43:46.446117 6548 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0612 21:43:46.944918 6548 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0612 21:43:47.434390 6548 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0612 21:43:47.939278 6548 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0612 21:43:48.446587 6548 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0612 21:43:48.969575 6548 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0612 21:43:48.850168 10648 ssh_runner.go:235] Completed: sudo pgrep -xnf kube-apiserver.*minikube.*: (11.327642s)
I0612 21:43:48.850168 10648 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.1/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: (11.2747762s)
I0612 21:43:48.850253 10648 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: (11.5649547s)
I0612 21:43:48.850253 10648 api_server.go:72] duration metric: took 12.6599188s to wait for apiserver process to appear ...
I0612 21:43:48.850253 10648 api_server.go:88] waiting for apiserver healthz status ...
I0612 21:43:48.850491 10648 api_server.go:253] Checking apiserver healthz at https://127.0.0.1:55597/healthz ...
I0612 21:43:48.961585 10648 api_server.go:279] https://127.0.0.1:55597/healthz returned 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[+]poststarthook/scheduling/bootstrap-system-priority-classes ok
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/start-system-namespaces-controller ok
[+]poststarthook/bootstrap-controller ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/apiservice-discovery-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
healthz check failed
W0612 21:43:48.961585 10648 api_server.go:103] status: https://127.0.0.1:55597/healthz returned error 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[+]poststarthook/scheduling/bootstrap-system-priority-classes ok
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/start-system-namespaces-controller ok
[+]poststarthook/bootstrap-controller ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/apiservice-discovery-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
healthz check failed
I0612 21:43:49.352974 10648 api_server.go:253] Checking apiserver healthz at https://127.0.0.1:55597/healthz ...
I0612 21:43:49.368906 10648 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.1/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (11.3950435s)
I0612 21:43:49.368906 10648 addons.go:475] Verifying addon metrics-server=true in "newest-cni-074000"
I0612 21:43:49.373033 10648 api_server.go:279] https://127.0.0.1:55597/healthz returned 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[+]poststarthook/scheduling/bootstrap-system-priority-classes ok
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/start-system-namespaces-controller ok
[+]poststarthook/bootstrap-controller ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/apiservice-discovery-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
healthz check failed
W0612 21:43:49.373033 10648 api_server.go:103] status: https://127.0.0.1:55597/healthz returned error 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/start-service-ip-repair-controllers ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[+]poststarthook/scheduling/bootstrap-system-priority-classes ok
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/start-system-namespaces-controller ok
[+]poststarthook/bootstrap-controller ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/apiservice-discovery-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
healthz check failed
I0612 21:43:49.856032 10648 api_server.go:253] Checking apiserver healthz at https://127.0.0.1:55597/healthz ...
I0612 21:43:49.872861 10648 api_server.go:279] https://127.0.0.1:55597/healthz returned 200:
ok
I0612 21:43:49.949687 10648 api_server.go:141] control plane version: v1.30.1
I0612 21:43:49.949687 10648 api_server.go:131] duration metric: took 1.0993816s to wait for apiserver health ...
I0612 21:43:49.949687 10648 system_pods.go:43] waiting for kube-system pods to appear ...
I0612 21:43:49.970672 10648 system_pods.go:59] 8 kube-system pods found
I0612 21:43:49.970672 10648 system_pods.go:61] "coredns-7db6d8ff4d-rzswh" [dcf89a5b-48bc-4d34-b2d3-900baadc510d] Running / Ready:ContainersNotReady (containers with unready status: [coredns]) / ContainersReady:ContainersNotReady (containers with unready status: [coredns])
I0612 21:43:49.970672 10648 system_pods.go:61] "etcd-newest-cni-074000" [1deb7336-80ba-4be1-a653-9b4a377bb591] Running / Ready:ContainersNotReady (containers with unready status: [etcd]) / ContainersReady:ContainersNotReady (containers with unready status: [etcd])
I0612 21:43:49.970672 10648 system_pods.go:61] "kube-apiserver-newest-cni-074000" [79fb543a-2700-41d6-8631-654ba229610d] Running / Ready:ContainersNotReady (containers with unready status: [kube-apiserver]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-apiserver])
I0612 21:43:49.970672 10648 system_pods.go:61] "kube-controller-manager-newest-cni-074000" [5a59d1c6-eccd-4475-b58d-5a9ba10dce56] Running / Ready:ContainersNotReady (containers with unready status: [kube-controller-manager]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-controller-manager])
I0612 21:43:49.970672 10648 system_pods.go:61] "kube-proxy-ngll2" [16e3a72e-13b9-4fb6-a973-ac005260a3cd] Running / Ready:ContainersNotReady (containers with unready status: [kube-proxy]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-proxy])
I0612 21:43:49.970672 10648 system_pods.go:61] "kube-scheduler-newest-cni-074000" [705f44da-cb71-4935-94c7-911a020a42c6] Running / Ready:ContainersNotReady (containers with unready status: [kube-scheduler]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-scheduler])
I0612 21:43:49.970672 10648 system_pods.go:61] "metrics-server-569cc877fc-9hwwf" [1524c1c5-20e3-4220-b6bd-fc9cee439d0e] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0612 21:43:49.970672 10648 system_pods.go:61] "storage-provisioner" [f012c152-b590-420d-be1c-1842b7020ca3] Running / Ready:ContainersNotReady (containers with unready status: [storage-provisioner]) / ContainersReady:ContainersNotReady (containers with unready status: [storage-provisioner])
I0612 21:43:49.970672 10648 system_pods.go:74] duration metric: took 20.9845ms to wait for pod list to return data ...
I0612 21:43:49.970672 10648 default_sa.go:34] waiting for default service account to be created ...
I0612 21:43:49.978688 10648 default_sa.go:45] found service account: "default"
I0612 21:43:49.978688 10648 default_sa.go:55] duration metric: took 8.0152ms for default service account to be created ...
I0612 21:43:49.978688 10648 kubeadm.go:576] duration metric: took 13.7883001s to wait for: map[apiserver:true apps_running:false default_sa:true extra:false kubelet:false node_ready:false system_pods:true]
I0612 21:43:49.979738 10648 node_conditions.go:102] verifying NodePressure condition ...
I0612 21:43:50.070341 10648 node_conditions.go:122] node storage ephemeral capacity is 1055762868Ki
I0612 21:43:50.070341 10648 node_conditions.go:123] node cpu capacity is 16
I0612 21:43:50.071371 10648 node_conditions.go:105] duration metric: took 91.6286ms to run NodePressure ...
I0612 21:43:50.071371 10648 start.go:240] waiting for startup goroutines ...
I0612 21:43:50.359622 10648 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.1/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: (11.3591536s)
I0612 21:43:50.362158 10648 out.go:177] * Some dashboard features require the metrics-server addon. To enable all features please run:
minikube -p newest-cni-074000 addons enable metrics-server
I0612 21:43:50.364166 10648 out.go:177] * Enabled addons: storage-provisioner, default-storageclass, metrics-server, dashboard
I0612 21:43:50.369160 10648 addons.go:510] duration metric: took 14.1797474s for enable addons: enabled=[storage-provisioner default-storageclass metrics-server dashboard]
I0612 21:43:50.370151 10648 start.go:245] waiting for cluster config update ...
I0612 21:43:50.370151 10648 start.go:254] writing updated cluster config ...
I0612 21:43:50.390152 10648 ssh_runner.go:195] Run: rm -f paused
I0612 21:43:50.644020 10648 start.go:600] kubectl: 1.30.2, cluster: 1.30.1 (minor skew: 0)
I0612 21:43:50.647026 10648 out.go:177] * Done! kubectl is now configured to use "newest-cni-074000" cluster and "default" namespace by default
I0612 21:43:48.511202 7884 pod_ready.go:102] pod "coredns-7db6d8ff4d-qhkh2" in "kube-system" namespace has status "Ready":"False"
I0612 21:43:51.009274 7884 pod_ready.go:102] pod "coredns-7db6d8ff4d-qhkh2" in "kube-system" namespace has status "Ready":"False"
I0612 21:43:49.698780 5540 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0612 21:43:49.729251 5540 api_server.go:72] duration metric: took 5m48.6945134s to wait for apiserver process to appear ...
I0612 21:43:49.729251 5540 api_server.go:88] waiting for apiserver healthz status ...
I0612 21:43:49.741940 5540 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
I0612 21:43:49.794503 5540 logs.go:276] 2 containers: [559ffac3c414 08372f67ca60]
I0612 21:43:49.803495 5540 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
I0612 21:43:49.863871 5540 logs.go:276] 2 containers: [48b924cc9ca8 d65a86407319]
I0612 21:43:49.879866 5540 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
I0612 21:43:49.936663 5540 logs.go:276] 2 containers: [78fd0bd54f7f b5adbbbe1b1d]
I0612 21:43:49.945694 5540 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
I0612 21:43:49.998681 5540 logs.go:276] 2 containers: [dc6968d98409 6dcf6b435dcb]
I0612 21:43:50.008690 5540 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
I0612 21:43:50.063514 5540 logs.go:276] 2 containers: [c87af550bb83 9bdf65930601]
I0612 21:43:50.080336 5540 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
I0612 21:43:50.124684 5540 logs.go:276] 2 containers: [6116c6070393 5491a5e5dcb9]
I0612 21:43:50.136933 5540 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
I0612 21:43:50.191900 5540 logs.go:276] 0 containers: []
W0612 21:43:50.191900 5540 logs.go:278] No container was found matching "kindnet"
I0612 21:43:50.200918 5540 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
I0612 21:43:50.245616 5540 logs.go:276] 2 containers: [380c76a7ac65 3f440bc35ac0]
I0612 21:43:50.269864 5540 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kubernetes-dashboard --format={{.ID}}
I0612 21:43:50.322137 5540 logs.go:276] 1 containers: [ed7189bae68d]
I0612 21:43:50.322312 5540 logs.go:123] Gathering logs for kube-scheduler [6dcf6b435dcb] ...
I0612 21:43:50.322312 5540 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 6dcf6b435dcb"
I0612 21:43:50.382144 5540 logs.go:123] Gathering logs for storage-provisioner [3f440bc35ac0] ...
I0612 21:43:50.382144 5540 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 3f440bc35ac0"
I0612 21:43:50.423259 5540 logs.go:123] Gathering logs for container status ...
I0612 21:43:50.423259 5540 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0612 21:43:50.545402 5540 logs.go:123] Gathering logs for kubelet ...
I0612 21:43:50.545402 5540 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
W0612 21:43:50.667055 5540 logs.go:138] Found kubelet problem: Jun 12 21:38:18 old-k8s-version-606600 kubelet[1666]: E0612 21:38:18.108202 1666 pod_workers.go:191] Error syncing pod cbdf526e-ee8e-4fbf-83b1-066d29ec1239 ("metrics-server-9975d5f86-ltrjr_kube-system(cbdf526e-ee8e-4fbf-83b1-066d29ec1239)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = Error response from daemon: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.65.254:53: no such host"
W0612 21:43:50.668068 5540 logs.go:138] Found kubelet problem: Jun 12 21:38:18 old-k8s-version-606600 kubelet[1666]: E0612 21:38:18.197645 1666 pod_workers.go:191] Error syncing pod cbdf526e-ee8e-4fbf-83b1-066d29ec1239 ("metrics-server-9975d5f86-ltrjr_kube-system(cbdf526e-ee8e-4fbf-83b1-066d29ec1239)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0612 21:43:50.669051 5540 logs.go:138] Found kubelet problem: Jun 12 21:38:19 old-k8s-version-606600 kubelet[1666]: E0612 21:38:19.232272 1666 pod_workers.go:191] Error syncing pod cbdf526e-ee8e-4fbf-83b1-066d29ec1239 ("metrics-server-9975d5f86-ltrjr_kube-system(cbdf526e-ee8e-4fbf-83b1-066d29ec1239)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0612 21:43:50.671050 5540 logs.go:138] Found kubelet problem: Jun 12 21:38:34 old-k8s-version-606600 kubelet[1666]: E0612 21:38:34.085575 1666 reflector.go:138] object-"kubernetes-dashboard"/"kubernetes-dashboard-token-zgnbp": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kubernetes-dashboard-token-zgnbp" is forbidden: User "system:node:old-k8s-version-606600" cannot list resource "secrets" in API group "" in the namespace "kubernetes-dashboard": no relationship found between node 'old-k8s-version-606600' and this object
W0612 21:43:50.676043 5540 logs.go:138] Found kubelet problem: Jun 12 21:38:34 old-k8s-version-606600 kubelet[1666]: E0612 21:38:34.495556 1666 pod_workers.go:191] Error syncing pod cbdf526e-ee8e-4fbf-83b1-066d29ec1239 ("metrics-server-9975d5f86-ltrjr_kube-system(cbdf526e-ee8e-4fbf-83b1-066d29ec1239)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = Error response from daemon: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.65.254:53: no such host"
W0612 21:43:50.683041 5540 logs.go:138] Found kubelet problem: Jun 12 21:38:37 old-k8s-version-606600 kubelet[1666]: E0612 21:38:37.256650 1666 pod_workers.go:191] Error syncing pod 7700737f-ee51-48c5-9fc0-24437fe76fbf ("dashboard-metrics-scraper-8d5bb5db8-qrxqz_kubernetes-dashboard(7700737f-ee51-48c5-9fc0-24437fe76fbf)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ErrImagePull: "rpc error: code = Unknown desc = [DEPRECATION NOTICE] Docker Image Format v1 and Docker Image manifest version 2, schema 1 support is disabled by default and will be removed in an upcoming release. Suggest the author of registry.k8s.io/echoserver:1.4 to upgrade the image to the OCI Format or Docker Image manifest v2, schema 2. More information at https://docs.docker.com/go/deprecated-image-specs/"
W0612 21:43:50.684040 5540 logs.go:138] Found kubelet problem: Jun 12 21:38:37 old-k8s-version-606600 kubelet[1666]: E0612 21:38:37.889727 1666 pod_workers.go:191] Error syncing pod 7700737f-ee51-48c5-9fc0-24437fe76fbf ("dashboard-metrics-scraper-8d5bb5db8-qrxqz_kubernetes-dashboard(7700737f-ee51-48c5-9fc0-24437fe76fbf)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0612 21:43:50.684040 5540 logs.go:138] Found kubelet problem: Jun 12 21:38:38 old-k8s-version-606600 kubelet[1666]: E0612 21:38:38.912678 1666 pod_workers.go:191] Error syncing pod 7700737f-ee51-48c5-9fc0-24437fe76fbf ("dashboard-metrics-scraper-8d5bb5db8-qrxqz_kubernetes-dashboard(7700737f-ee51-48c5-9fc0-24437fe76fbf)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0612 21:43:50.686031 5540 logs.go:138] Found kubelet problem: Jun 12 21:38:39 old-k8s-version-606600 kubelet[1666]: E0612 21:38:39.950470 1666 pod_workers.go:191] Error syncing pod 12c0e34d-3bef-4207-9e19-43c91aea19c2 ("storage-provisioner_kube-system(12c0e34d-3bef-4207-9e19-43c91aea19c2)"), skipping: failed to "StartContainer" for "storage-provisioner" with CrashLoopBackOff: "back-off 10s restarting failed container=storage-provisioner pod=storage-provisioner_kube-system(12c0e34d-3bef-4207-9e19-43c91aea19c2)"
W0612 21:43:50.686031 5540 logs.go:138] Found kubelet problem: Jun 12 21:38:45 old-k8s-version-606600 kubelet[1666]: E0612 21:38:45.301360 1666 pod_workers.go:191] Error syncing pod cbdf526e-ee8e-4fbf-83b1-066d29ec1239 ("metrics-server-9975d5f86-ltrjr_kube-system(cbdf526e-ee8e-4fbf-83b1-066d29ec1239)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0612 21:43:50.692034 5540 logs.go:138] Found kubelet problem: Jun 12 21:39:00 old-k8s-version-606600 kubelet[1666]: E0612 21:39:00.285017 1666 pod_workers.go:191] Error syncing pod 7700737f-ee51-48c5-9fc0-24437fe76fbf ("dashboard-metrics-scraper-8d5bb5db8-qrxqz_kubernetes-dashboard(7700737f-ee51-48c5-9fc0-24437fe76fbf)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ErrImagePull: "rpc error: code = Unknown desc = [DEPRECATION NOTICE] Docker Image Format v1 and Docker Image manifest version 2, schema 1 support is disabled by default and will be removed in an upcoming release. Suggest the author of registry.k8s.io/echoserver:1.4 to upgrade the image to the OCI Format or Docker Image manifest v2, schema 2. More information at https://docs.docker.com/go/deprecated-image-specs/"
W0612 21:43:50.695641 5540 logs.go:138] Found kubelet problem: Jun 12 21:39:00 old-k8s-version-606600 kubelet[1666]: E0612 21:39:00.377954 1666 pod_workers.go:191] Error syncing pod cbdf526e-ee8e-4fbf-83b1-066d29ec1239 ("metrics-server-9975d5f86-ltrjr_kube-system(cbdf526e-ee8e-4fbf-83b1-066d29ec1239)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = Error response from daemon: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.65.254:53: no such host"
W0612 21:43:50.695641 5540 logs.go:138] Found kubelet problem: Jun 12 21:39:12 old-k8s-version-606600 kubelet[1666]: E0612 21:39:12.297156 1666 pod_workers.go:191] Error syncing pod 7700737f-ee51-48c5-9fc0-24437fe76fbf ("dashboard-metrics-scraper-8d5bb5db8-qrxqz_kubernetes-dashboard(7700737f-ee51-48c5-9fc0-24437fe76fbf)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0612 21:43:50.696642 5540 logs.go:138] Found kubelet problem: Jun 12 21:39:12 old-k8s-version-606600 kubelet[1666]: E0612 21:39:12.297233 1666 pod_workers.go:191] Error syncing pod cbdf526e-ee8e-4fbf-83b1-066d29ec1239 ("metrics-server-9975d5f86-ltrjr_kube-system(cbdf526e-ee8e-4fbf-83b1-066d29ec1239)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0612 21:43:50.696642 5540 logs.go:138] Found kubelet problem: Jun 12 21:39:23 old-k8s-version-606600 kubelet[1666]: E0612 21:39:23.296706 1666 pod_workers.go:191] Error syncing pod cbdf526e-ee8e-4fbf-83b1-066d29ec1239 ("metrics-server-9975d5f86-ltrjr_kube-system(cbdf526e-ee8e-4fbf-83b1-066d29ec1239)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0612 21:43:50.700674 5540 logs.go:138] Found kubelet problem: Jun 12 21:39:27 old-k8s-version-606600 kubelet[1666]: E0612 21:39:27.717082 1666 pod_workers.go:191] Error syncing pod 7700737f-ee51-48c5-9fc0-24437fe76fbf ("dashboard-metrics-scraper-8d5bb5db8-qrxqz_kubernetes-dashboard(7700737f-ee51-48c5-9fc0-24437fe76fbf)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ErrImagePull: "rpc error: code = Unknown desc = [DEPRECATION NOTICE] Docker Image Format v1 and Docker Image manifest version 2, schema 1 support is disabled by default and will be removed in an upcoming release. Suggest the author of registry.k8s.io/echoserver:1.4 to upgrade the image to the OCI Format or Docker Image manifest v2, schema 2. More information at https://docs.docker.com/go/deprecated-image-specs/"
W0612 21:43:50.700674 5540 logs.go:138] Found kubelet problem: Jun 12 21:39:34 old-k8s-version-606600 kubelet[1666]: E0612 21:39:34.293373 1666 pod_workers.go:191] Error syncing pod cbdf526e-ee8e-4fbf-83b1-066d29ec1239 ("metrics-server-9975d5f86-ltrjr_kube-system(cbdf526e-ee8e-4fbf-83b1-066d29ec1239)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0612 21:43:50.701637 5540 logs.go:138] Found kubelet problem: Jun 12 21:39:42 old-k8s-version-606600 kubelet[1666]: E0612 21:39:42.310173 1666 pod_workers.go:191] Error syncing pod 7700737f-ee51-48c5-9fc0-24437fe76fbf ("dashboard-metrics-scraper-8d5bb5db8-qrxqz_kubernetes-dashboard(7700737f-ee51-48c5-9fc0-24437fe76fbf)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0612 21:43:50.704640 5540 logs.go:138] Found kubelet problem: Jun 12 21:39:45 old-k8s-version-606600 kubelet[1666]: E0612 21:39:45.350617 1666 pod_workers.go:191] Error syncing pod cbdf526e-ee8e-4fbf-83b1-066d29ec1239 ("metrics-server-9975d5f86-ltrjr_kube-system(cbdf526e-ee8e-4fbf-83b1-066d29ec1239)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = Error response from daemon: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.65.254:53: no such host"
W0612 21:43:50.705639 5540 logs.go:138] Found kubelet problem: Jun 12 21:39:53 old-k8s-version-606600 kubelet[1666]: E0612 21:39:53.294158 1666 pod_workers.go:191] Error syncing pod 7700737f-ee51-48c5-9fc0-24437fe76fbf ("dashboard-metrics-scraper-8d5bb5db8-qrxqz_kubernetes-dashboard(7700737f-ee51-48c5-9fc0-24437fe76fbf)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0612 21:43:50.705639 5540 logs.go:138] Found kubelet problem: Jun 12 21:39:59 old-k8s-version-606600 kubelet[1666]: E0612 21:39:59.289780 1666 pod_workers.go:191] Error syncing pod cbdf526e-ee8e-4fbf-83b1-066d29ec1239 ("metrics-server-9975d5f86-ltrjr_kube-system(cbdf526e-ee8e-4fbf-83b1-066d29ec1239)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0612 21:43:50.705639 5540 logs.go:138] Found kubelet problem: Jun 12 21:40:06 old-k8s-version-606600 kubelet[1666]: E0612 21:40:06.290907 1666 pod_workers.go:191] Error syncing pod 7700737f-ee51-48c5-9fc0-24437fe76fbf ("dashboard-metrics-scraper-8d5bb5db8-qrxqz_kubernetes-dashboard(7700737f-ee51-48c5-9fc0-24437fe76fbf)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0612 21:43:50.706634 5540 logs.go:138] Found kubelet problem: Jun 12 21:40:14 old-k8s-version-606600 kubelet[1666]: E0612 21:40:14.295198 1666 pod_workers.go:191] Error syncing pod cbdf526e-ee8e-4fbf-83b1-066d29ec1239 ("metrics-server-9975d5f86-ltrjr_kube-system(cbdf526e-ee8e-4fbf-83b1-066d29ec1239)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0612 21:43:50.708640 5540 logs.go:138] Found kubelet problem: Jun 12 21:40:20 old-k8s-version-606600 kubelet[1666]: E0612 21:40:20.713009 1666 pod_workers.go:191] Error syncing pod 7700737f-ee51-48c5-9fc0-24437fe76fbf ("dashboard-metrics-scraper-8d5bb5db8-qrxqz_kubernetes-dashboard(7700737f-ee51-48c5-9fc0-24437fe76fbf)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ErrImagePull: "rpc error: code = Unknown desc = [DEPRECATION NOTICE] Docker Image Format v1 and Docker Image manifest version 2, schema 1 support is disabled by default and will be removed in an upcoming release. Suggest the author of registry.k8s.io/echoserver:1.4 to upgrade the image to the OCI Format or Docker Image manifest v2, schema 2. More information at https://docs.docker.com/go/deprecated-image-specs/"
W0612 21:43:50.708640 5540 logs.go:138] Found kubelet problem: Jun 12 21:40:27 old-k8s-version-606600 kubelet[1666]: E0612 21:40:27.292602 1666 pod_workers.go:191] Error syncing pod cbdf526e-ee8e-4fbf-83b1-066d29ec1239 ("metrics-server-9975d5f86-ltrjr_kube-system(cbdf526e-ee8e-4fbf-83b1-066d29ec1239)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0612 21:43:50.708640 5540 logs.go:138] Found kubelet problem: Jun 12 21:40:35 old-k8s-version-606600 kubelet[1666]: E0612 21:40:35.288460 1666 pod_workers.go:191] Error syncing pod 7700737f-ee51-48c5-9fc0-24437fe76fbf ("dashboard-metrics-scraper-8d5bb5db8-qrxqz_kubernetes-dashboard(7700737f-ee51-48c5-9fc0-24437fe76fbf)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0612 21:43:50.709640 5540 logs.go:138] Found kubelet problem: Jun 12 21:40:38 old-k8s-version-606600 kubelet[1666]: E0612 21:40:38.288195 1666 pod_workers.go:191] Error syncing pod cbdf526e-ee8e-4fbf-83b1-066d29ec1239 ("metrics-server-9975d5f86-ltrjr_kube-system(cbdf526e-ee8e-4fbf-83b1-066d29ec1239)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0612 21:43:50.709640 5540 logs.go:138] Found kubelet problem: Jun 12 21:40:48 old-k8s-version-606600 kubelet[1666]: E0612 21:40:48.304887 1666 pod_workers.go:191] Error syncing pod 7700737f-ee51-48c5-9fc0-24437fe76fbf ("dashboard-metrics-scraper-8d5bb5db8-qrxqz_kubernetes-dashboard(7700737f-ee51-48c5-9fc0-24437fe76fbf)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0612 21:43:50.709640 5540 logs.go:138] Found kubelet problem: Jun 12 21:40:49 old-k8s-version-606600 kubelet[1666]: E0612 21:40:49.287899 1666 pod_workers.go:191] Error syncing pod cbdf526e-ee8e-4fbf-83b1-066d29ec1239 ("metrics-server-9975d5f86-ltrjr_kube-system(cbdf526e-ee8e-4fbf-83b1-066d29ec1239)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0612 21:43:50.709640 5540 logs.go:138] Found kubelet problem: Jun 12 21:41:00 old-k8s-version-606600 kubelet[1666]: E0612 21:41:00.286411 1666 pod_workers.go:191] Error syncing pod cbdf526e-ee8e-4fbf-83b1-066d29ec1239 ("metrics-server-9975d5f86-ltrjr_kube-system(cbdf526e-ee8e-4fbf-83b1-066d29ec1239)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0612 21:43:50.709640 5540 logs.go:138] Found kubelet problem: Jun 12 21:41:03 old-k8s-version-606600 kubelet[1666]: E0612 21:41:03.286078 1666 pod_workers.go:191] Error syncing pod 7700737f-ee51-48c5-9fc0-24437fe76fbf ("dashboard-metrics-scraper-8d5bb5db8-qrxqz_kubernetes-dashboard(7700737f-ee51-48c5-9fc0-24437fe76fbf)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0612 21:43:50.711645 5540 logs.go:138] Found kubelet problem: Jun 12 21:41:12 old-k8s-version-606600 kubelet[1666]: E0612 21:41:12.338980 1666 pod_workers.go:191] Error syncing pod cbdf526e-ee8e-4fbf-83b1-066d29ec1239 ("metrics-server-9975d5f86-ltrjr_kube-system(cbdf526e-ee8e-4fbf-83b1-066d29ec1239)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = Error response from daemon: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.65.254:53: no such host"
W0612 21:43:50.712644 5540 logs.go:138] Found kubelet problem: Jun 12 21:41:16 old-k8s-version-606600 kubelet[1666]: E0612 21:41:16.369660 1666 pod_workers.go:191] Error syncing pod 7700737f-ee51-48c5-9fc0-24437fe76fbf ("dashboard-metrics-scraper-8d5bb5db8-qrxqz_kubernetes-dashboard(7700737f-ee51-48c5-9fc0-24437fe76fbf)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0612 21:43:50.712644 5540 logs.go:138] Found kubelet problem: Jun 12 21:41:25 old-k8s-version-606600 kubelet[1666]: E0612 21:41:25.285535 1666 pod_workers.go:191] Error syncing pod cbdf526e-ee8e-4fbf-83b1-066d29ec1239 ("metrics-server-9975d5f86-ltrjr_kube-system(cbdf526e-ee8e-4fbf-83b1-066d29ec1239)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0612 21:43:50.712644 5540 logs.go:138] Found kubelet problem: Jun 12 21:41:29 old-k8s-version-606600 kubelet[1666]: E0612 21:41:29.282908 1666 pod_workers.go:191] Error syncing pod 7700737f-ee51-48c5-9fc0-24437fe76fbf ("dashboard-metrics-scraper-8d5bb5db8-qrxqz_kubernetes-dashboard(7700737f-ee51-48c5-9fc0-24437fe76fbf)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0612 21:43:50.713633 5540 logs.go:138] Found kubelet problem: Jun 12 21:41:37 old-k8s-version-606600 kubelet[1666]: E0612 21:41:37.281613 1666 pod_workers.go:191] Error syncing pod cbdf526e-ee8e-4fbf-83b1-066d29ec1239 ("metrics-server-9975d5f86-ltrjr_kube-system(cbdf526e-ee8e-4fbf-83b1-066d29ec1239)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0612 21:43:50.722531 5540 logs.go:138] Found kubelet problem: Jun 12 21:41:46 old-k8s-version-606600 kubelet[1666]: E0612 21:41:46.818084 1666 pod_workers.go:191] Error syncing pod 7700737f-ee51-48c5-9fc0-24437fe76fbf ("dashboard-metrics-scraper-8d5bb5db8-qrxqz_kubernetes-dashboard(7700737f-ee51-48c5-9fc0-24437fe76fbf)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ErrImagePull: "rpc error: code = Unknown desc = [DEPRECATION NOTICE] Docker Image Format v1 and Docker Image manifest version 2, schema 1 support is disabled by default and will be removed in an upcoming release. Suggest the author of registry.k8s.io/echoserver:1.4 to upgrade the image to the OCI Format or Docker Image manifest v2, schema 2. More information at https://docs.docker.com/go/deprecated-image-specs/"
W0612 21:43:50.723389 5540 logs.go:138] Found kubelet problem: Jun 12 21:41:49 old-k8s-version-606600 kubelet[1666]: E0612 21:41:49.282375 1666 pod_workers.go:191] Error syncing pod cbdf526e-ee8e-4fbf-83b1-066d29ec1239 ("metrics-server-9975d5f86-ltrjr_kube-system(cbdf526e-ee8e-4fbf-83b1-066d29ec1239)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0612 21:43:50.723579 5540 logs.go:138] Found kubelet problem: Jun 12 21:41:58 old-k8s-version-606600 kubelet[1666]: E0612 21:41:58.301867 1666 pod_workers.go:191] Error syncing pod 7700737f-ee51-48c5-9fc0-24437fe76fbf ("dashboard-metrics-scraper-8d5bb5db8-qrxqz_kubernetes-dashboard(7700737f-ee51-48c5-9fc0-24437fe76fbf)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0612 21:43:50.724286 5540 logs.go:138] Found kubelet problem: Jun 12 21:42:04 old-k8s-version-606600 kubelet[1666]: E0612 21:42:04.282322 1666 pod_workers.go:191] Error syncing pod cbdf526e-ee8e-4fbf-83b1-066d29ec1239 ("metrics-server-9975d5f86-ltrjr_kube-system(cbdf526e-ee8e-4fbf-83b1-066d29ec1239)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0612 21:43:50.724705 5540 logs.go:138] Found kubelet problem: Jun 12 21:42:11 old-k8s-version-606600 kubelet[1666]: E0612 21:42:11.278999 1666 pod_workers.go:191] Error syncing pod 7700737f-ee51-48c5-9fc0-24437fe76fbf ("dashboard-metrics-scraper-8d5bb5db8-qrxqz_kubernetes-dashboard(7700737f-ee51-48c5-9fc0-24437fe76fbf)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0612 21:43:50.725186 5540 logs.go:138] Found kubelet problem: Jun 12 21:42:17 old-k8s-version-606600 kubelet[1666]: E0612 21:42:17.277966 1666 pod_workers.go:191] Error syncing pod cbdf526e-ee8e-4fbf-83b1-066d29ec1239 ("metrics-server-9975d5f86-ltrjr_kube-system(cbdf526e-ee8e-4fbf-83b1-066d29ec1239)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0612 21:43:50.725574 5540 logs.go:138] Found kubelet problem: Jun 12 21:42:23 old-k8s-version-606600 kubelet[1666]: E0612 21:42:23.279178 1666 pod_workers.go:191] Error syncing pod 7700737f-ee51-48c5-9fc0-24437fe76fbf ("dashboard-metrics-scraper-8d5bb5db8-qrxqz_kubernetes-dashboard(7700737f-ee51-48c5-9fc0-24437fe76fbf)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0612 21:43:50.725986 5540 logs.go:138] Found kubelet problem: Jun 12 21:42:31 old-k8s-version-606600 kubelet[1666]: E0612 21:42:31.276919 1666 pod_workers.go:191] Error syncing pod cbdf526e-ee8e-4fbf-83b1-066d29ec1239 ("metrics-server-9975d5f86-ltrjr_kube-system(cbdf526e-ee8e-4fbf-83b1-066d29ec1239)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0612 21:43:50.726352 5540 logs.go:138] Found kubelet problem: Jun 12 21:42:34 old-k8s-version-606600 kubelet[1666]: E0612 21:42:34.277134 1666 pod_workers.go:191] Error syncing pod 7700737f-ee51-48c5-9fc0-24437fe76fbf ("dashboard-metrics-scraper-8d5bb5db8-qrxqz_kubernetes-dashboard(7700737f-ee51-48c5-9fc0-24437fe76fbf)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0612 21:43:50.726794 5540 logs.go:138] Found kubelet problem: Jun 12 21:42:44 old-k8s-version-606600 kubelet[1666]: E0612 21:42:44.277354 1666 pod_workers.go:191] Error syncing pod cbdf526e-ee8e-4fbf-83b1-066d29ec1239 ("metrics-server-9975d5f86-ltrjr_kube-system(cbdf526e-ee8e-4fbf-83b1-066d29ec1239)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0612 21:43:50.727145 5540 logs.go:138] Found kubelet problem: Jun 12 21:42:49 old-k8s-version-606600 kubelet[1666]: E0612 21:42:49.279624 1666 pod_workers.go:191] Error syncing pod 7700737f-ee51-48c5-9fc0-24437fe76fbf ("dashboard-metrics-scraper-8d5bb5db8-qrxqz_kubernetes-dashboard(7700737f-ee51-48c5-9fc0-24437fe76fbf)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0612 21:43:50.727730 5540 logs.go:138] Found kubelet problem: Jun 12 21:42:59 old-k8s-version-606600 kubelet[1666]: E0612 21:42:59.280403 1666 pod_workers.go:191] Error syncing pod cbdf526e-ee8e-4fbf-83b1-066d29ec1239 ("metrics-server-9975d5f86-ltrjr_kube-system(cbdf526e-ee8e-4fbf-83b1-066d29ec1239)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0612 21:43:50.727730 5540 logs.go:138] Found kubelet problem: Jun 12 21:43:04 old-k8s-version-606600 kubelet[1666]: E0612 21:43:04.308191 1666 pod_workers.go:191] Error syncing pod 7700737f-ee51-48c5-9fc0-24437fe76fbf ("dashboard-metrics-scraper-8d5bb5db8-qrxqz_kubernetes-dashboard(7700737f-ee51-48c5-9fc0-24437fe76fbf)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0612 21:43:50.728263 5540 logs.go:138] Found kubelet problem: Jun 12 21:43:10 old-k8s-version-606600 kubelet[1666]: E0612 21:43:10.273566 1666 pod_workers.go:191] Error syncing pod cbdf526e-ee8e-4fbf-83b1-066d29ec1239 ("metrics-server-9975d5f86-ltrjr_kube-system(cbdf526e-ee8e-4fbf-83b1-066d29ec1239)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0612 21:43:50.728467 5540 logs.go:138] Found kubelet problem: Jun 12 21:43:17 old-k8s-version-606600 kubelet[1666]: E0612 21:43:17.271765 1666 pod_workers.go:191] Error syncing pod 7700737f-ee51-48c5-9fc0-24437fe76fbf ("dashboard-metrics-scraper-8d5bb5db8-qrxqz_kubernetes-dashboard(7700737f-ee51-48c5-9fc0-24437fe76fbf)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0612 21:43:50.728467 5540 logs.go:138] Found kubelet problem: Jun 12 21:43:24 old-k8s-version-606600 kubelet[1666]: E0612 21:43:24.272689 1666 pod_workers.go:191] Error syncing pod cbdf526e-ee8e-4fbf-83b1-066d29ec1239 ("metrics-server-9975d5f86-ltrjr_kube-system(cbdf526e-ee8e-4fbf-83b1-066d29ec1239)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0612 21:43:50.728467 5540 logs.go:138] Found kubelet problem: Jun 12 21:43:32 old-k8s-version-606600 kubelet[1666]: E0612 21:43:32.269407 1666 pod_workers.go:191] Error syncing pod 7700737f-ee51-48c5-9fc0-24437fe76fbf ("dashboard-metrics-scraper-8d5bb5db8-qrxqz_kubernetes-dashboard(7700737f-ee51-48c5-9fc0-24437fe76fbf)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0612 21:43:50.728467 5540 logs.go:138] Found kubelet problem: Jun 12 21:43:38 old-k8s-version-606600 kubelet[1666]: E0612 21:43:38.270486 1666 pod_workers.go:191] Error syncing pod cbdf526e-ee8e-4fbf-83b1-066d29ec1239 ("metrics-server-9975d5f86-ltrjr_kube-system(cbdf526e-ee8e-4fbf-83b1-066d29ec1239)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0612 21:43:50.729316 5540 logs.go:138] Found kubelet problem: Jun 12 21:43:46 old-k8s-version-606600 kubelet[1666]: E0612 21:43:46.270393 1666 pod_workers.go:191] Error syncing pod 7700737f-ee51-48c5-9fc0-24437fe76fbf ("dashboard-metrics-scraper-8d5bb5db8-qrxqz_kubernetes-dashboard(7700737f-ee51-48c5-9fc0-24437fe76fbf)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
I0612 21:43:50.729316 5540 logs.go:123] Gathering logs for describe nodes ...
I0612 21:43:50.729316 5540 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0612 21:43:51.007056 5540 logs.go:123] Gathering logs for kube-apiserver [08372f67ca60] ...
I0612 21:43:51.007286 5540 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 08372f67ca60"
I0612 21:43:51.111276 5540 logs.go:123] Gathering logs for etcd [d65a86407319] ...
I0612 21:43:51.111276 5540 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 d65a86407319"
I0612 21:43:51.177308 5540 logs.go:123] Gathering logs for kubernetes-dashboard [ed7189bae68d] ...
I0612 21:43:51.177308 5540 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 ed7189bae68d"
I0612 21:43:51.234681 5540 logs.go:123] Gathering logs for Docker ...
I0612 21:43:51.234681 5540 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
I0612 21:43:51.294684 5540 logs.go:123] Gathering logs for kube-scheduler [dc6968d98409] ...
I0612 21:43:51.294684 5540 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 dc6968d98409"
I0612 21:43:51.348008 5540 logs.go:123] Gathering logs for kube-proxy [c87af550bb83] ...
I0612 21:43:51.348008 5540 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c87af550bb83"
I0612 21:43:51.402988 5540 logs.go:123] Gathering logs for kube-proxy [9bdf65930601] ...
I0612 21:43:51.402988 5540 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 9bdf65930601"
I0612 21:43:51.466980 5540 logs.go:123] Gathering logs for kube-controller-manager [6116c6070393] ...
I0612 21:43:51.466980 5540 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 6116c6070393"
I0612 21:43:51.553849 5540 logs.go:123] Gathering logs for kube-controller-manager [5491a5e5dcb9] ...
I0612 21:43:51.553849 5540 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 5491a5e5dcb9"
I0612 21:43:51.633858 5540 logs.go:123] Gathering logs for dmesg ...
I0612 21:43:51.633858 5540 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0612 21:43:51.661851 5540 logs.go:123] Gathering logs for etcd [48b924cc9ca8] ...
I0612 21:43:51.661851 5540 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 48b924cc9ca8"
I0612 21:43:51.732551 5540 logs.go:123] Gathering logs for coredns [b5adbbbe1b1d] ...
I0612 21:43:51.732551 5540 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 b5adbbbe1b1d"
I0612 21:43:51.777558 5540 logs.go:123] Gathering logs for storage-provisioner [380c76a7ac65] ...
I0612 21:43:51.777558 5540 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 380c76a7ac65"
I0612 21:43:51.824457 5540 logs.go:123] Gathering logs for kube-apiserver [559ffac3c414] ...
I0612 21:43:51.824457 5540 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 559ffac3c414"
I0612 21:43:51.898707 5540 logs.go:123] Gathering logs for coredns [78fd0bd54f7f] ...
I0612 21:43:51.898707 5540 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 78fd0bd54f7f"
I0612 21:43:51.949732 5540 out.go:304] Setting ErrFile to fd 1608...
I0612 21:43:51.949732 5540 out.go:338] TERM=,COLORTERM=, which probably does not support color
W0612 21:43:51.949732 5540 out.go:239] X Problems detected in kubelet:
W0612 21:43:51.949732 5540 out.go:239] Jun 12 21:43:17 old-k8s-version-606600 kubelet[1666]: E0612 21:43:17.271765 1666 pod_workers.go:191] Error syncing pod 7700737f-ee51-48c5-9fc0-24437fe76fbf ("dashboard-metrics-scraper-8d5bb5db8-qrxqz_kubernetes-dashboard(7700737f-ee51-48c5-9fc0-24437fe76fbf)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0612 21:43:51.949732 5540 out.go:239] Jun 12 21:43:24 old-k8s-version-606600 kubelet[1666]: E0612 21:43:24.272689 1666 pod_workers.go:191] Error syncing pod cbdf526e-ee8e-4fbf-83b1-066d29ec1239 ("metrics-server-9975d5f86-ltrjr_kube-system(cbdf526e-ee8e-4fbf-83b1-066d29ec1239)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0612 21:43:51.949732 5540 out.go:239] Jun 12 21:43:32 old-k8s-version-606600 kubelet[1666]: E0612 21:43:32.269407 1666 pod_workers.go:191] Error syncing pod 7700737f-ee51-48c5-9fc0-24437fe76fbf ("dashboard-metrics-scraper-8d5bb5db8-qrxqz_kubernetes-dashboard(7700737f-ee51-48c5-9fc0-24437fe76fbf)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
W0612 21:43:51.949732 5540 out.go:239] Jun 12 21:43:38 old-k8s-version-606600 kubelet[1666]: E0612 21:43:38.270486 1666 pod_workers.go:191] Error syncing pod cbdf526e-ee8e-4fbf-83b1-066d29ec1239 ("metrics-server-9975d5f86-ltrjr_kube-system(cbdf526e-ee8e-4fbf-83b1-066d29ec1239)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0612 21:43:51.949732 5540 out.go:239] Jun 12 21:43:46 old-k8s-version-606600 kubelet[1666]: E0612 21:43:46.270393 1666 pod_workers.go:191] Error syncing pod 7700737f-ee51-48c5-9fc0-24437fe76fbf ("dashboard-metrics-scraper-8d5bb5db8-qrxqz_kubernetes-dashboard(7700737f-ee51-48c5-9fc0-24437fe76fbf)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
I0612 21:43:51.949732 5540 out.go:304] Setting ErrFile to fd 1608...
I0612 21:43:51.949732 5540 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0612 21:43:49.446589 6548 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0612 21:43:49.936663 6548 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0612 21:43:50.439247 6548 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0612 21:43:50.939260 6548 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0612 21:43:51.441985 6548 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0612 21:43:51.932710 6548 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0612 21:43:52.438300 6548 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0612 21:43:52.939091 6548 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0612 21:43:53.446191 6548 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0612 21:43:54.154340 6548 kubeadm.go:1107] duration metric: took 12.7379634s to wait for elevateKubeSystemPrivileges
W0612 21:43:54.154340 6548 kubeadm.go:286] apiserver tunnel failed: apiserver port not set
I0612 21:43:54.154340 6548 kubeadm.go:393] duration metric: took 34.6906359s to StartCluster
I0612 21:43:54.154340 6548 settings.go:142] acquiring lock: {Name:mk5d8710830d010adb6db61f855b0ef766a8622c Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0612 21:43:54.154340 6548 settings.go:150] Updating kubeconfig: C:\Users\jenkins.minikube4\minikube-integration\kubeconfig
I0612 21:43:54.158033 6548 lock.go:35] WriteFile acquiring C:\Users\jenkins.minikube4\minikube-integration\kubeconfig: {Name:mk97c09b788e5010ffd4c9dd9525f9245d5edd25 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0612 21:43:54.159034 6548 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.30.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"
I0612 21:43:54.159034 6548 addons.go:507] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false]
I0612 21:43:54.159034 6548 addons.go:69] Setting storage-provisioner=true in profile "kindnet-796900"
I0612 21:43:54.159034 6548 start.go:234] Will wait 15m0s for node &{Name: IP:192.168.121.2 Port:8443 KubernetesVersion:v1.30.1 ContainerRuntime:docker ControlPlane:true Worker:true}
I0612 21:43:54.160034 6548 addons.go:234] Setting addon storage-provisioner=true in "kindnet-796900"
I0612 21:43:54.167030 6548 out.go:177] * Verifying Kubernetes components...
I0612 21:43:54.160034 6548 addons.go:69] Setting default-storageclass=true in profile "kindnet-796900"
I0612 21:43:54.160034 6548 host.go:66] Checking if "kindnet-796900" exists ...
I0612 21:43:54.160034 6548 config.go:182] Loaded profile config "kindnet-796900": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.30.1
I0612 21:43:54.168038 6548 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "kindnet-796900"
I0612 21:43:54.187274 6548 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0612 21:43:54.194015 6548 cli_runner.go:164] Run: docker container inspect kindnet-796900 --format={{.State.Status}}
I0612 21:43:54.199014 6548 cli_runner.go:164] Run: docker container inspect kindnet-796900 --format={{.State.Status}}
I0612 21:43:54.424609 6548 addons.go:234] Setting addon default-storageclass=true in "kindnet-796900"
I0612 21:43:54.424609 6548 host.go:66] Checking if "kindnet-796900" exists ...
I0612 21:43:54.438671 6548 out.go:177] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
I0612 21:43:53.010299 7884 pod_ready.go:102] pod "coredns-7db6d8ff4d-qhkh2" in "kube-system" namespace has status "Ready":"False"
I0612 21:43:54.998583 7884 pod_ready.go:97] pod "coredns-7db6d8ff4d-qhkh2" in "kube-system" namespace has status phase "Succeeded" (skipping!): {Phase:Succeeded Conditions:[{Type:PodReadyToStartContainers Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2024-06-12 21:43:54 +0000 UTC Reason: Message:} {Type:Initialized Status:True LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2024-06-12 21:43:40 +0000 UTC Reason:PodCompleted Message:} {Type:Ready Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2024-06-12 21:43:40 +0000 UTC Reason:PodCompleted Message:} {Type:ContainersReady Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2024-06-12 21:43:40 +0000 UTC Reason:PodCompleted Message:} {Type:PodScheduled Status:True LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2024-06-12 21:43:40 +0000 UTC Reason: Message:}] Message: Reason: NominatedNodeName: HostIP:192.168.112.2 HostIPs:[{IP:192.168.112
.2}] PodIP: PodIPs:[] StartTime:2024-06-12 21:43:40 +0000 UTC InitContainerStatuses:[] ContainerStatuses:[{Name:coredns State:{Waiting:nil Running:nil Terminated:&ContainerStateTerminated{ExitCode:0,Signal:0,Reason:Completed,Message:,StartedAt:2024-06-12 21:43:43 +0000 UTC,FinishedAt:2024-06-12 21:43:53 +0000 UTC,ContainerID:docker://5a84c8806a6e20b4b95e6e6da56b7cc808980fbd7ba803baadc1af31e3564a59,}} LastTerminationState:{Waiting:nil Running:nil Terminated:nil} Ready:false RestartCount:0 Image:registry.k8s.io/coredns/coredns:v1.11.1 ImageID:docker-pullable://registry.k8s.io/coredns/coredns@sha256:1eeb4c7316bacb1d4c8ead65571cd92dd21e27359f0d4917f1a5822a73b75db1 ContainerID:docker://5a84c8806a6e20b4b95e6e6da56b7cc808980fbd7ba803baadc1af31e3564a59 Started:0xc00241e780 AllocatedResources:map[] Resources:nil VolumeMounts:[]}] QOSClass:Burstable EphemeralContainerStatuses:[] Resize: ResourceClaimStatuses:[]}
I0612 21:43:54.998583 7884 pod_ready.go:81] duration metric: took 13.0191551s for pod "coredns-7db6d8ff4d-qhkh2" in "kube-system" namespace to be "Ready" ...
E0612 21:43:54.998583 7884 pod_ready.go:66] WaitExtra: waitPodCondition: pod "coredns-7db6d8ff4d-qhkh2" in "kube-system" namespace has status phase "Succeeded" (skipping!): {Phase:Succeeded Conditions:[{Type:PodReadyToStartContainers Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2024-06-12 21:43:54 +0000 UTC Reason: Message:} {Type:Initialized Status:True LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2024-06-12 21:43:40 +0000 UTC Reason:PodCompleted Message:} {Type:Ready Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2024-06-12 21:43:40 +0000 UTC Reason:PodCompleted Message:} {Type:ContainersReady Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2024-06-12 21:43:40 +0000 UTC Reason:PodCompleted Message:} {Type:PodScheduled Status:True LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2024-06-12 21:43:40 +0000 UTC Reason: Message:}] Message: Reason: NominatedNodeName: HostIP:192.168.1
12.2 HostIPs:[{IP:192.168.112.2}] PodIP: PodIPs:[] StartTime:2024-06-12 21:43:40 +0000 UTC InitContainerStatuses:[] ContainerStatuses:[{Name:coredns State:{Waiting:nil Running:nil Terminated:&ContainerStateTerminated{ExitCode:0,Signal:0,Reason:Completed,Message:,StartedAt:2024-06-12 21:43:43 +0000 UTC,FinishedAt:2024-06-12 21:43:53 +0000 UTC,ContainerID:docker://5a84c8806a6e20b4b95e6e6da56b7cc808980fbd7ba803baadc1af31e3564a59,}} LastTerminationState:{Waiting:nil Running:nil Terminated:nil} Ready:false RestartCount:0 Image:registry.k8s.io/coredns/coredns:v1.11.1 ImageID:docker-pullable://registry.k8s.io/coredns/coredns@sha256:1eeb4c7316bacb1d4c8ead65571cd92dd21e27359f0d4917f1a5822a73b75db1 ContainerID:docker://5a84c8806a6e20b4b95e6e6da56b7cc808980fbd7ba803baadc1af31e3564a59 Started:0xc00241e780 AllocatedResources:map[] Resources:nil VolumeMounts:[]}] QOSClass:Burstable EphemeralContainerStatuses:[] Resize: ResourceClaimStatuses:[]}
I0612 21:43:54.999932 7884 pod_ready.go:78] waiting up to 15m0s for pod "coredns-7db6d8ff4d-vpkhp" in "kube-system" namespace to be "Ready" ...
I0612 21:43:54.440672 6548 addons.go:431] installing /etc/kubernetes/addons/storage-provisioner.yaml
I0612 21:43:54.440672 6548 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I0612 21:43:54.455540 6548 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kindnet-796900
I0612 21:43:54.457683 6548 cli_runner.go:164] Run: docker container inspect kindnet-796900 --format={{.State.Status}}
I0612 21:43:54.677317 6548 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.30.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^ forward . \/etc\/resolv.conf.*/i \ hosts {\n 192.168.65.254 host.minikube.internal\n fallthrough\n }' -e '/^ errors *$/i \ log' | sudo /var/lib/minikube/binaries/v1.30.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"
I0612 21:43:54.678339 6548 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:55561 SSHKeyPath:C:\Users\jenkins.minikube4\minikube-integration\.minikube\machines\kindnet-796900\id_rsa Username:docker}
I0612 21:43:54.692315 6548 addons.go:431] installing /etc/kubernetes/addons/storageclass.yaml
I0612 21:43:54.692315 6548 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I0612 21:43:54.709293 6548 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kindnet-796900
I0612 21:43:54.778316 6548 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0612 21:43:54.925963 6548 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:55561 SSHKeyPath:C:\Users\jenkins.minikube4\minikube-integration\.minikube\machines\kindnet-796900\id_rsa Username:docker}
I0612 21:43:55.079908 6548 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I0612 21:43:55.365679 6548 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.1/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
I0612 21:43:55.662057 6548 start.go:946] {"host.minikube.internal": 192.168.65.254} host record injected into CoreDNS's ConfigMap
I0612 21:43:55.674055 6548 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "8443/tcp") 0).HostPort}}'" kindnet-796900
I0612 21:43:55.865722 6548 node_ready.go:35] waiting up to 15m0s for node "kindnet-796900" to be "Ready" ...
I0612 21:43:55.953146 6548 node_ready.go:49] node "kindnet-796900" has status "Ready":"True"
I0612 21:43:55.953146 6548 node_ready.go:38] duration metric: took 87.4191ms for node "kindnet-796900" to be "Ready" ...
I0612 21:43:55.953146 6548 pod_ready.go:35] extra waiting up to 15m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0612 21:43:55.977777 6548 pod_ready.go:78] waiting up to 15m0s for pod "coredns-7db6d8ff4d-2ldpl" in "kube-system" namespace to be "Ready" ...
I0612 21:43:56.251996 6548 kapi.go:248] "coredns" deployment in "kube-system" namespace and "kindnet-796900" context rescaled to 1 replicas
I0612 21:43:56.808358 6548 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.1/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: (1.4426101s)
I0612 21:43:56.808358 6548 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: (1.7283673s)
I0612 21:43:56.862939 6548 out.go:177] * Enabled addons: storage-provisioner, default-storageclass
I0612 21:43:56.866932 6548 addons.go:510] duration metric: took 2.7077687s for enable addons: enabled=[storage-provisioner default-storageclass]
I0612 21:43:58.060579 6548 pod_ready.go:102] pod "coredns-7db6d8ff4d-2ldpl" in "kube-system" namespace has status "Ready":"False"
I0612 21:43:57.028948 7884 pod_ready.go:102] pod "coredns-7db6d8ff4d-vpkhp" in "kube-system" namespace has status "Ready":"False"
I0612 21:43:59.530356 7884 pod_ready.go:102] pod "coredns-7db6d8ff4d-vpkhp" in "kube-system" namespace has status "Ready":"False"
I0612 21:44:01.971066 5540 api_server.go:253] Checking apiserver healthz at https://127.0.0.1:55191/healthz ...
I0612 21:44:02.002693 5540 api_server.go:279] https://127.0.0.1:55191/healthz returned 200:
ok
I0612 21:44:02.004714 5540 out.go:177]
W0612 21:44:02.006688 5540 out.go:239] X Exiting due to K8S_UNHEALTHY_CONTROL_PLANE: wait 6m0s for node: wait for healthy API server: controlPlane never updated to v1.20.0
W0612 21:44:02.006688 5540 out.go:239] * Suggestion: Control Plane could not update, try minikube delete --all --purge
W0612 21:44:02.007686 5540 out.go:239] * Related issue: https://github.com/kubernetes/minikube/issues/11417
W0612 21:44:02.007686 5540 out.go:239] *
W0612 21:44:02.008687 5540 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0612 21:44:02.010686 5540 out.go:177]
I0612 21:44:00.519168 6548 pod_ready.go:102] pod "coredns-7db6d8ff4d-2ldpl" in "kube-system" namespace has status "Ready":"False"
I0612 21:44:03.002864 6548 pod_ready.go:102] pod "coredns-7db6d8ff4d-2ldpl" in "kube-system" namespace has status "Ready":"False"
==> Docker <==
Jun 12 21:39:00 old-k8s-version-606600 dockerd[1307]: time="2024-06-12T21:39:00.271882393Z" level=info msg="Attempting next endpoint for pull after error: [DEPRECATION NOTICE] Docker Image Format v1 and Docker Image manifest version 2, schema 1 support is disabled by default and will be removed in an upcoming release. Suggest the author of registry.k8s.io/echoserver:1.4 to upgrade the image to the OCI Format or Docker Image manifest v2, schema 2. More information at https://docs.docker.com/go/deprecated-image-specs/" spanID=35a07ece712f9f4b traceID=dcd624c0856bc04ff4f4c81707218767
Jun 12 21:39:00 old-k8s-version-606600 dockerd[1307]: time="2024-06-12T21:39:00.326094378Z" level=warning msg="Error getting v2 registry: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.65.254:53: no such host" spanID=1ef7813f727772f8 traceID=aa54f686b2a286833ec2c1a8151629d9
Jun 12 21:39:00 old-k8s-version-606600 dockerd[1307]: time="2024-06-12T21:39:00.326265590Z" level=info msg="Attempting next endpoint for pull after error: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.65.254:53: no such host" spanID=1ef7813f727772f8 traceID=aa54f686b2a286833ec2c1a8151629d9
Jun 12 21:39:00 old-k8s-version-606600 dockerd[1307]: time="2024-06-12T21:39:00.334185872Z" level=error msg="Handler for POST /v1.40/images/create returned error: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.65.254:53: no such host" spanID=1ef7813f727772f8 traceID=aa54f686b2a286833ec2c1a8151629d9
Jun 12 21:39:27 old-k8s-version-606600 dockerd[1307]: time="2024-06-12T21:39:27.522212152Z" level=warning msg="reference for unknown type: application/vnd.docker.distribution.manifest.v1+prettyjws" digest="sha256:5d99aa1120524c801bc8c1a7077e8f5ec122ba16b6dda1a5d3826057f67b9bcb" remote="registry.k8s.io/echoserver:1.4" spanID=60a6305b80513658 traceID=0147e36c2dfce4727881cc9850e95462
Jun 12 21:39:27 old-k8s-version-606600 dockerd[1307]: time="2024-06-12T21:39:27.708916823Z" level=warning msg="Error persisting manifest" digest="sha256:5d99aa1120524c801bc8c1a7077e8f5ec122ba16b6dda1a5d3826057f67b9bcb" error="error committing manifest to content store: commit failed: unexpected commit digest sha256:eaee4c452b076cdb05b391ed7e75e1ad0aca136665875ab5d7e2f3d9f4675769, expected sha256:5d99aa1120524c801bc8c1a7077e8f5ec122ba16b6dda1a5d3826057f67b9bcb: failed precondition" remote="registry.k8s.io/echoserver:1.4" spanID=60a6305b80513658 traceID=0147e36c2dfce4727881cc9850e95462
Jun 12 21:39:27 old-k8s-version-606600 dockerd[1307]: time="2024-06-12T21:39:27.709034541Z" level=warning msg="[DEPRECATION NOTICE] Docker Image Format v1 and Docker Image manifest version 2, schema 1 support is disabled by default and will be removed in an upcoming release. Suggest the author of registry.k8s.io/echoserver:1.4 to upgrade the image to the OCI Format or Docker Image manifest v2, schema 2. More information at https://docs.docker.com/go/deprecated-image-specs/" digest="sha256:5d99aa1120524c801bc8c1a7077e8f5ec122ba16b6dda1a5d3826057f67b9bcb" remote="registry.k8s.io/echoserver:1.4" spanID=60a6305b80513658 traceID=0147e36c2dfce4727881cc9850e95462
Jun 12 21:39:27 old-k8s-version-606600 dockerd[1307]: time="2024-06-12T21:39:27.709075147Z" level=info msg="Attempting next endpoint for pull after error: [DEPRECATION NOTICE] Docker Image Format v1 and Docker Image manifest version 2, schema 1 support is disabled by default and will be removed in an upcoming release. Suggest the author of registry.k8s.io/echoserver:1.4 to upgrade the image to the OCI Format or Docker Image manifest v2, schema 2. More information at https://docs.docker.com/go/deprecated-image-specs/" spanID=60a6305b80513658 traceID=0147e36c2dfce4727881cc9850e95462
Jun 12 21:39:45 old-k8s-version-606600 dockerd[1307]: time="2024-06-12T21:39:45.341287946Z" level=warning msg="Error getting v2 registry: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.65.254:53: no such host" spanID=46ae3c44db4ddb3d traceID=48321a72d619418fb7666b06ea10afa9
Jun 12 21:39:45 old-k8s-version-606600 dockerd[1307]: time="2024-06-12T21:39:45.341468777Z" level=info msg="Attempting next endpoint for pull after error: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.65.254:53: no such host" spanID=46ae3c44db4ddb3d traceID=48321a72d619418fb7666b06ea10afa9
Jun 12 21:39:45 old-k8s-version-606600 dockerd[1307]: time="2024-06-12T21:39:45.348931861Z" level=error msg="Handler for POST /v1.40/images/create returned error: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.65.254:53: no such host" spanID=46ae3c44db4ddb3d traceID=48321a72d619418fb7666b06ea10afa9
Jun 12 21:40:20 old-k8s-version-606600 dockerd[1307]: time="2024-06-12T21:40:20.528230060Z" level=warning msg="reference for unknown type: application/vnd.docker.distribution.manifest.v1+prettyjws" digest="sha256:5d99aa1120524c801bc8c1a7077e8f5ec122ba16b6dda1a5d3826057f67b9bcb" remote="registry.k8s.io/echoserver:1.4" spanID=431bd73270e2291e traceID=9c28f83ee0b6ec13ded75544bc9d8dd9
Jun 12 21:40:20 old-k8s-version-606600 dockerd[1307]: time="2024-06-12T21:40:20.704365493Z" level=warning msg="Error persisting manifest" digest="sha256:5d99aa1120524c801bc8c1a7077e8f5ec122ba16b6dda1a5d3826057f67b9bcb" error="error committing manifest to content store: commit failed: unexpected commit digest sha256:eaee4c452b076cdb05b391ed7e75e1ad0aca136665875ab5d7e2f3d9f4675769, expected sha256:5d99aa1120524c801bc8c1a7077e8f5ec122ba16b6dda1a5d3826057f67b9bcb: failed precondition" remote="registry.k8s.io/echoserver:1.4" spanID=431bd73270e2291e traceID=9c28f83ee0b6ec13ded75544bc9d8dd9
Jun 12 21:40:20 old-k8s-version-606600 dockerd[1307]: time="2024-06-12T21:40:20.704565926Z" level=warning msg="[DEPRECATION NOTICE] Docker Image Format v1 and Docker Image manifest version 2, schema 1 support is disabled by default and will be removed in an upcoming release. Suggest the author of registry.k8s.io/echoserver:1.4 to upgrade the image to the OCI Format or Docker Image manifest v2, schema 2. More information at https://docs.docker.com/go/deprecated-image-specs/" digest="sha256:5d99aa1120524c801bc8c1a7077e8f5ec122ba16b6dda1a5d3826057f67b9bcb" remote="registry.k8s.io/echoserver:1.4" spanID=431bd73270e2291e traceID=9c28f83ee0b6ec13ded75544bc9d8dd9
Jun 12 21:40:20 old-k8s-version-606600 dockerd[1307]: time="2024-06-12T21:40:20.704636838Z" level=info msg="Attempting next endpoint for pull after error: [DEPRECATION NOTICE] Docker Image Format v1 and Docker Image manifest version 2, schema 1 support is disabled by default and will be removed in an upcoming release. Suggest the author of registry.k8s.io/echoserver:1.4 to upgrade the image to the OCI Format or Docker Image manifest v2, schema 2. More information at https://docs.docker.com/go/deprecated-image-specs/" spanID=431bd73270e2291e traceID=9c28f83ee0b6ec13ded75544bc9d8dd9
Jun 12 21:41:12 old-k8s-version-606600 dockerd[1307]: time="2024-06-12T21:41:12.328355957Z" level=warning msg="Error getting v2 registry: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.65.254:53: no such host" spanID=9c46d1fe5d856359 traceID=0761e2ccab3071b46cb74b30bcf09760
Jun 12 21:41:12 old-k8s-version-606600 dockerd[1307]: time="2024-06-12T21:41:12.328554389Z" level=info msg="Attempting next endpoint for pull after error: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.65.254:53: no such host" spanID=9c46d1fe5d856359 traceID=0761e2ccab3071b46cb74b30bcf09760
Jun 12 21:41:12 old-k8s-version-606600 dockerd[1307]: time="2024-06-12T21:41:12.337234474Z" level=error msg="Handler for POST /v1.40/images/create returned error: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.65.254:53: no such host" spanID=9c46d1fe5d856359 traceID=0761e2ccab3071b46cb74b30bcf09760
Jun 12 21:41:45 old-k8s-version-606600 dockerd[1307]: time="2024-06-12T21:41:45.000018620Z" level=warning msg="reference for unknown type: application/vnd.docker.distribution.manifest.v1+prettyjws" digest="sha256:5d99aa1120524c801bc8c1a7077e8f5ec122ba16b6dda1a5d3826057f67b9bcb" remote="registry.k8s.io/echoserver:1.4" spanID=c561fc1e6edbd2de traceID=4d4797e74c51813f6ee3953a3d39e1df
Jun 12 21:41:46 old-k8s-version-606600 dockerd[1307]: time="2024-06-12T21:41:46.654329557Z" level=warning msg="Error persisting manifest" digest="sha256:5d99aa1120524c801bc8c1a7077e8f5ec122ba16b6dda1a5d3826057f67b9bcb" error="error committing manifest to content store: commit failed: unexpected commit digest sha256:eaee4c452b076cdb05b391ed7e75e1ad0aca136665875ab5d7e2f3d9f4675769, expected sha256:5d99aa1120524c801bc8c1a7077e8f5ec122ba16b6dda1a5d3826057f67b9bcb: failed precondition" remote="registry.k8s.io/echoserver:1.4" spanID=c561fc1e6edbd2de traceID=4d4797e74c51813f6ee3953a3d39e1df
Jun 12 21:41:46 old-k8s-version-606600 dockerd[1307]: time="2024-06-12T21:41:46.654645907Z" level=warning msg="[DEPRECATION NOTICE] Docker Image Format v1 and Docker Image manifest version 2, schema 1 support is disabled by default and will be removed in an upcoming release. Suggest the author of registry.k8s.io/echoserver:1.4 to upgrade the image to the OCI Format or Docker Image manifest v2, schema 2. More information at https://docs.docker.com/go/deprecated-image-specs/" digest="sha256:5d99aa1120524c801bc8c1a7077e8f5ec122ba16b6dda1a5d3826057f67b9bcb" remote="registry.k8s.io/echoserver:1.4" spanID=c561fc1e6edbd2de traceID=4d4797e74c51813f6ee3953a3d39e1df
Jun 12 21:41:46 old-k8s-version-606600 dockerd[1307]: time="2024-06-12T21:41:46.654722519Z" level=info msg="Attempting next endpoint for pull after error: [DEPRECATION NOTICE] Docker Image Format v1 and Docker Image manifest version 2, schema 1 support is disabled by default and will be removed in an upcoming release. Suggest the author of registry.k8s.io/echoserver:1.4 to upgrade the image to the OCI Format or Docker Image manifest v2, schema 2. More information at https://docs.docker.com/go/deprecated-image-specs/" spanID=c561fc1e6edbd2de traceID=4d4797e74c51813f6ee3953a3d39e1df
Jun 12 21:44:03 old-k8s-version-606600 dockerd[1307]: time="2024-06-12T21:44:03.446591485Z" level=warning msg="Error getting v2 registry: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.65.254:53: no such host" spanID=a922001c36123603 traceID=a0c099299b155654b5e2cf0087e54557
Jun 12 21:44:03 old-k8s-version-606600 dockerd[1307]: time="2024-06-12T21:44:03.446722802Z" level=info msg="Attempting next endpoint for pull after error: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.65.254:53: no such host" spanID=a922001c36123603 traceID=a0c099299b155654b5e2cf0087e54557
Jun 12 21:44:03 old-k8s-version-606600 dockerd[1307]: time="2024-06-12T21:44:03.474292348Z" level=error msg="Handler for POST /v1.40/images/create returned error: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.65.254:53: no such host" spanID=a922001c36123603 traceID=a0c099299b155654b5e2cf0087e54557
==> container status <==
CONTAINER IMAGE CREATED STATE NAME ATTEMPT POD ID POD
ed7189bae68d4 kubernetesui/dashboard@sha256:2e500d29e9d5f4a086b908eb8dfe7ecac57d2ab09d65b24f588b1d449841ef93 5 minutes ago Running kubernetes-dashboard 0 5f642febc50af kubernetes-dashboard-cd95d586-cwjhq
380c76a7ac658 6e38f40d628db 5 minutes ago Running storage-provisioner 3 9bd611479bb3b storage-provisioner
78fd0bd54f7f9 bfe3a36ebd252 5 minutes ago Running coredns 1 6e46dfcaa7519 coredns-74ff55c5b-xnpzv
1e21bc0283ec4 56cc512116c8f 5 minutes ago Running busybox 1 a81ca61f81f75 busybox
c87af550bb83b 10cc881966cfd 5 minutes ago Running kube-proxy 1 db0d2e8a6baba kube-proxy-lrbxz
3f440bc35ac02 6e38f40d628db 5 minutes ago Exited storage-provisioner 2 9bd611479bb3b storage-provisioner
48b924cc9ca84 0369cf4303ffd 6 minutes ago Running etcd 1 02082220b5284 etcd-old-k8s-version-606600
dc6968d98409d 3138b6e3d4712 6 minutes ago Running kube-scheduler 1 aba1bf3c95240 kube-scheduler-old-k8s-version-606600
559ffac3c4145 ca9843d3b5454 6 minutes ago Running kube-apiserver 1 17870b13c332d kube-apiserver-old-k8s-version-606600
6116c6070393f b9fa1895dcaa6 6 minutes ago Running kube-controller-manager 1 3c0b5358498ab kube-controller-manager-old-k8s-version-606600
3d7e0d2d64939 gcr.io/k8s-minikube/busybox@sha256:2d03e6ceeb99250061dd110530b0ece7998cd84121f952adef120ea7c5a6f00e 7 minutes ago Exited busybox 0 548282b315c63 busybox
b5adbbbe1b1de bfe3a36ebd252 8 minutes ago Exited coredns 0 235302f29d4e7 coredns-74ff55c5b-xnpzv
9bdf659306014 10cc881966cfd 8 minutes ago Exited kube-proxy 0 e3dbc0d69d9f8 kube-proxy-lrbxz
d65a86407319f 0369cf4303ffd 9 minutes ago Exited etcd 0 dafb0c78f9a7d etcd-old-k8s-version-606600
5491a5e5dcb9c b9fa1895dcaa6 9 minutes ago Exited kube-controller-manager 0 b31ad680f5f9c kube-controller-manager-old-k8s-version-606600
6dcf6b435dcb7 3138b6e3d4712 9 minutes ago Exited kube-scheduler 0 37202ad135701 kube-scheduler-old-k8s-version-606600
08372f67ca60f ca9843d3b5454 9 minutes ago Exited kube-apiserver 0 0acadfac364a2 kube-apiserver-old-k8s-version-606600
==> coredns [78fd0bd54f7f] <==
I0612 21:38:39.836568 1 trace.go:116] Trace[2019727887]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125 (started: 2024-06-12 21:38:18.789241694 +0000 UTC m=+0.177195086) (total time: 21.048241584s):
Trace[2019727887]: [21.048241584s] [21.048241584s] END
E0612 21:38:39.836620 1 reflector.go:178] pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125: Failed to list *v1.Service: Get "https://10.96.0.1:443/api/v1/services?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: connect: connection refused
I0612 21:38:39.836692 1 trace.go:116] Trace[1427131847]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125 (started: 2024-06-12 21:38:18.789980418 +0000 UTC m=+0.177933810) (total time: 21.047545768s):
Trace[1427131847]: [21.047545768s] [21.047545768s] END
E0612 21:38:39.836701 1 reflector.go:178] pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125: Failed to list *v1.Endpoints: Get "https://10.96.0.1:443/api/v1/endpoints?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: connect: connection refused
I0612 21:38:39.837204 1 trace.go:116] Trace[911902081]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125 (started: 2024-06-12 21:38:18.790219457 +0000 UTC m=+0.178172849) (total time: 21.047998759s):
Trace[911902081]: [21.047998759s] [21.047998759s] END
E0612 21:38:39.837221 1 reflector.go:178] pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125: Failed to list *v1.Namespace: Get "https://10.96.0.1:443/api/v1/namespaces?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: connect: connection refused
.:53
[INFO] plugin/reload: Running configuration MD5 = 512bc0e06a520fa44f35dc15de10fdd6
CoreDNS-1.7.0
linux/amd64, go1.14.4, f59c03d
[INFO] 127.0.0.1:55678 - 35388 "HINFO IN 1165631274913403965.3887317084807361220. udp 57 false 512" NXDOMAIN qr,rd,ra 57 0.080986028s
[INFO] plugin/ready: Still waiting on: "kubernetes"
[INFO] plugin/ready: Still waiting on: "kubernetes"
==> coredns [b5adbbbe1b1d] <==
I0612 21:35:37.153914 1 trace.go:116] Trace[2019727887]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125 (started: 2024-06-12 21:35:16.116132563 +0000 UTC m=+0.187275615) (total time: 21.041726995s):
Trace[2019727887]: [21.041726995s] [21.041726995s] END
E0612 21:35:37.154059 1 reflector.go:178] pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125: Failed to list *v1.Namespace: Get "https://10.96.0.1:443/api/v1/namespaces?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: connect: connection refused
I0612 21:35:37.154471 1 trace.go:116] Trace[939984059]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125 (started: 2024-06-12 21:35:16.117445031 +0000 UTC m=+0.188588183) (total time: 21.041907714s):
Trace[939984059]: [21.041907714s] [21.041907714s] END
E0612 21:35:37.154565 1 reflector.go:178] pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125: Failed to list *v1.Service: Get "https://10.96.0.1:443/api/v1/services?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: connect: connection refused
I0612 21:35:37.166267 1 trace.go:116] Trace[1474941318]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125 (started: 2024-06-12 21:35:16.11673544 +0000 UTC m=+0.187878492) (total time: 21.054418684s):
Trace[1474941318]: [21.054418684s] [21.054418684s] END
E0612 21:35:37.166373 1 reflector.go:178] pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125: Failed to list *v1.Endpoints: Get "https://10.96.0.1:443/api/v1/endpoints?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: connect: connection refused
E0612 21:36:54.810624 1 reflector.go:382] pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125: Failed to watch *v1.Service: Get "https://10.96.0.1:443/api/v1/services?allowWatchBookmarks=true&resourceVersion=564&timeout=6m5s&timeoutSeconds=365&watch=true": dial tcp 10.96.0.1:443: connect: connection refused
E0612 21:36:54.811150 1 reflector.go:382] pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125: Failed to watch *v1.Endpoints: Get "https://10.96.0.1:443/api/v1/endpoints?allowWatchBookmarks=true&resourceVersion=578&timeout=8m23s&timeoutSeconds=503&watch=true": dial tcp 10.96.0.1:443: connect: connection refused
E0612 21:36:54.811217 1 reflector.go:382] pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125: Failed to watch *v1.Namespace: Get "https://10.96.0.1:443/api/v1/namespaces?allowWatchBookmarks=true&resourceVersion=200&timeout=6m27s&timeoutSeconds=387&watch=true": dial tcp 10.96.0.1:443: connect: connection refused
.:53
[INFO] plugin/reload: Running configuration MD5 = db32ca3650231d74073ff4cf814959a7
CoreDNS-1.7.0
linux/amd64, go1.14.4, f59c03d
[INFO] plugin/ready: Still waiting on: "kubernetes"
[INFO] plugin/ready: Still waiting on: "kubernetes"
[INFO] Reloading
[INFO] plugin/health: Going into lameduck mode for 5s
[INFO] plugin/reload: Running configuration MD5 = 512bc0e06a520fa44f35dc15de10fdd6
[INFO] Reloading complete
[INFO] SIGTERM: Shutting down servers then terminating
[INFO] plugin/health: Going into lameduck mode for 5s
==> describe nodes <==
Name: old-k8s-version-606600
Roles: control-plane,master
Labels: beta.kubernetes.io/arch=amd64
beta.kubernetes.io/os=linux
kubernetes.io/arch=amd64
kubernetes.io/hostname=old-k8s-version-606600
kubernetes.io/os=linux
minikube.k8s.io/commit=8d282d3acc6cc32dfd3bc1bc39edde8a887b9d79
minikube.k8s.io/name=old-k8s-version-606600
minikube.k8s.io/primary=true
minikube.k8s.io/updated_at=2024_06_12T21_34_53_0700
minikube.k8s.io/version=v1.33.1
node-role.kubernetes.io/control-plane=
node-role.kubernetes.io/master=
Annotations: kubeadm.alpha.kubernetes.io/cri-socket: /var/run/dockershim.sock
node.alpha.kubernetes.io/ttl: 0
volumes.kubernetes.io/controller-managed-attach-detach: true
CreationTimestamp: Wed, 12 Jun 2024 21:34:48 +0000
Taints: <none>
Unschedulable: false
Lease:
HolderIdentity: old-k8s-version-606600
AcquireTime: <unset>
RenewTime: Wed, 12 Jun 2024 21:44:04 +0000
Conditions:
Type Status LastHeartbeatTime LastTransitionTime Reason Message
---- ------ ----------------- ------------------ ------ -------
MemoryPressure False Wed, 12 Jun 2024 21:39:34 +0000 Wed, 12 Jun 2024 21:34:42 +0000 KubeletHasSufficientMemory kubelet has sufficient memory available
DiskPressure False Wed, 12 Jun 2024 21:39:34 +0000 Wed, 12 Jun 2024 21:34:42 +0000 KubeletHasNoDiskPressure kubelet has no disk pressure
PIDPressure False Wed, 12 Jun 2024 21:39:34 +0000 Wed, 12 Jun 2024 21:34:42 +0000 KubeletHasSufficientPID kubelet has sufficient PID available
Ready True Wed, 12 Jun 2024 21:39:34 +0000 Wed, 12 Jun 2024 21:35:05 +0000 KubeletReady kubelet is posting ready status
Addresses:
InternalIP: 192.168.76.2
Hostname: old-k8s-version-606600
Capacity:
cpu: 16
ephemeral-storage: 1055762868Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
memory: 32868760Ki
pods: 110
Allocatable:
cpu: 16
ephemeral-storage: 1055762868Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
memory: 32868760Ki
pods: 110
System Info:
Machine ID: b3ebf0449ca34a95b9c73383925bbf73
System UUID: b3ebf0449ca34a95b9c73383925bbf73
Boot ID: 8f0fcd94-548f-4ab2-b241-f8d2ddaef712
Kernel Version: 5.15.146.1-microsoft-standard-WSL2
OS Image: Ubuntu 22.04.4 LTS
Operating System: linux
Architecture: amd64
Container Runtime Version: docker://26.1.4
Kubelet Version: v1.20.0
Kube-Proxy Version: v1.20.0
PodCIDR: 10.244.0.0/24
PodCIDRs: 10.244.0.0/24
Non-terminated Pods: (11 in total)
Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits AGE
--------- ---- ------------ ---------- --------------- ------------- ---
default busybox 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 7m29s
kube-system coredns-74ff55c5b-xnpzv 100m (0%!)(MISSING) 0 (0%!)(MISSING) 70Mi (0%!)(MISSING) 170Mi (0%!)(MISSING) 9m
kube-system etcd-old-k8s-version-606600 100m (0%!)(MISSING) 0 (0%!)(MISSING) 100Mi (0%!)(MISSING) 0 (0%!)(MISSING) 9m11s
kube-system kube-apiserver-old-k8s-version-606600 250m (1%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 9m11s
kube-system kube-controller-manager-old-k8s-version-606600 200m (1%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 9m11s
kube-system kube-proxy-lrbxz 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 9m
kube-system kube-scheduler-old-k8s-version-606600 100m (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 9m11s
kube-system metrics-server-9975d5f86-ltrjr 100m (0%!)(MISSING) 0 (0%!)(MISSING) 200Mi (0%!)(MISSING) 0 (0%!)(MISSING) 7m15s
kube-system storage-provisioner 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 8m54s
kubernetes-dashboard dashboard-metrics-scraper-8d5bb5db8-qrxqz 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 5m34s
kubernetes-dashboard kubernetes-dashboard-cd95d586-cwjhq 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 5m34s
Allocated resources:
(Total limits may be over 100 percent, i.e., overcommitted.)
Resource Requests Limits
-------- -------- ------
cpu 850m (5%!)(MISSING) 0 (0%!)(MISSING)
memory 370Mi (1%!)(MISSING) 170Mi (0%!)(MISSING)
ephemeral-storage 100Mi (0%!)(MISSING) 0 (0%!)(MISSING)
hugepages-1Gi 0 (0%!)(MISSING) 0 (0%!)(MISSING)
hugepages-2Mi 0 (0%!)(MISSING) 0 (0%!)(MISSING)
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal NodeHasSufficientMemory 9m31s (x6 over 9m32s) kubelet Node old-k8s-version-606600 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 9m31s (x6 over 9m32s) kubelet Node old-k8s-version-606600 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 9m31s (x5 over 9m32s) kubelet Node old-k8s-version-606600 status is now: NodeHasSufficientPID
Normal Starting 9m13s kubelet Starting kubelet.
Normal NodeHasSufficientMemory 9m13s kubelet Node old-k8s-version-606600 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 9m13s kubelet Node old-k8s-version-606600 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 9m13s kubelet Node old-k8s-version-606600 status is now: NodeHasSufficientPID
Normal NodeAllocatableEnforced 9m12s kubelet Updated Node Allocatable limit across pods
Normal NodeReady 9m2s kubelet Node old-k8s-version-606600 status is now: NodeReady
Normal Starting 8m51s kube-proxy Starting kube-proxy.
Normal Starting 6m9s kubelet Starting kubelet.
Normal NodeHasSufficientMemory 6m9s (x8 over 6m9s) kubelet Node old-k8s-version-606600 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 6m9s (x7 over 6m9s) kubelet Node old-k8s-version-606600 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 6m9s (x8 over 6m9s) kubelet Node old-k8s-version-606600 status is now: NodeHasSufficientPID
Normal NodeAllocatableEnforced 6m9s kubelet Updated Node Allocatable limit across pods
Normal Starting 5m49s kube-proxy Starting kube-proxy.
==> dmesg <==
[Jun12 21:26] kmem.limit_in_bytes is deprecated and will be removed. Please report your usecase to linux-mm@kvack.org if you depend on this functionality.
==> etcd [48b924cc9ca8] <==
2024-06-12 21:41:49.257939 W | etcdserver: read-only range request "key:\"/registry/pods/kube-system/metrics-server-9975d5f86-ltrjr\" " with result "range_response_count:1 size:4052" took too long (355.65432ms) to execute
2024-06-12 21:41:49.517493 W | etcdserver: read-only range request "key:\"/registry/pods/kube-system/metrics-server-9975d5f86-ltrjr\" " with result "range_response_count:1 size:4052" took too long (122.871403ms) to execute
2024-06-12 21:41:49.862877 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-06-12 21:41:50.148983 W | etcdserver: read-only range request "key:\"/registry/pods/kube-system/metrics-server-9975d5f86-ltrjr\" " with result "range_response_count:1 size:4052" took too long (251.619062ms) to execute
2024-06-12 21:41:59.859193 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-06-12 21:42:09.858809 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-06-12 21:42:19.858641 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-06-12 21:42:26.038536 W | etcdserver: read-only range request "key:\"/registry/pods/kube-system/metrics-server-9975d5f86-ltrjr\" " with result "range_response_count:1 size:4052" took too long (141.546551ms) to execute
2024-06-12 21:42:26.038929 W | etcdserver: read-only range request "key:\"/registry/health\" " with result "range_response_count:0 size:5" took too long (198.409349ms) to execute
2024-06-12 21:42:29.871150 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-06-12 21:42:36.273052 W | etcdserver: read-only range request "key:\"/registry/pods/kube-system/metrics-server-9975d5f86-ltrjr\" " with result "range_response_count:1 size:4052" took too long (374.704389ms) to execute
2024-06-12 21:42:39.856252 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-06-12 21:42:49.855835 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-06-12 21:42:53.659165 W | etcdserver: read-only range request "key:\"/registry/configmaps/\" range_end:\"/registry/configmaps0\" count_only:true " with result "range_response_count:0 size:7" took too long (297.012103ms) to execute
2024-06-12 21:42:53.659879 W | etcdserver: read-only range request "key:\"/registry/pods/kube-system/metrics-server-9975d5f86-ltrjr\" " with result "range_response_count:1 size:4052" took too long (268.953548ms) to execute
2024-06-12 21:42:54.388099 W | etcdserver: read-only range request "key:\"/registry/services/endpoints/kube-system/k8s.io-minikube-hostpath\" " with result "range_response_count:1 size:1121" took too long (330.569012ms) to execute
2024-06-12 21:42:54.388261 W | etcdserver: read-only range request "key:\"/registry/minions/old-k8s-version-606600\" " with result "range_response_count:1 size:5495" took too long (469.015102ms) to execute
2024-06-12 21:42:54.710567 W | etcdserver: read-only range request "key:\"/registry/minions/old-k8s-version-606600\" " with result "range_response_count:1 size:5495" took too long (298.672962ms) to execute
2024-06-12 21:42:59.858022 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-06-12 21:43:09.852708 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-06-12 21:43:19.853605 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-06-12 21:43:29.849562 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-06-12 21:43:39.849841 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-06-12 21:43:49.849733 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-06-12 21:43:59.850118 I | etcdserver/api/etcdhttp: /health OK (status code 200)
==> etcd [d65a86407319] <==
2024-06-12 21:35:08.526791 W | etcdserver: read-only range request "key:\"/registry/clusterroles/admin\" " with result "range_response_count:1 size:3325" took too long (100.018266ms) to execute
2024-06-12 21:35:08.531222 W | etcdserver: read-only range request "key:\"/registry/daemonsets/kube-system/kube-proxy\" " with result "range_response_count:1 size:2887" took too long (104.03619ms) to execute
2024-06-12 21:35:08.729040 W | etcdserver: read-only range request "key:\"/registry/pods/kube-system/coredns-74ff55c5b-7rg9w\" " with result "range_response_count:1 size:3488" took too long (100.763562ms) to execute
2024-06-12 21:35:09.551229 W | etcdserver: request "header:<ID:15638345147502403026 username:\"kube-apiserver-etcd-client\" auth_revision:1 > txn:<compare:<target:MOD key:\"/registry/endpointslices/kube-system/kube-dns-bzhr6\" mod_revision:384 > success:<request_put:<key:\"/registry/endpointslices/kube-system/kube-dns-bzhr6\" value_size:1099 >> failure:<request_range:<key:\"/registry/endpointslices/kube-system/kube-dns-bzhr6\" > >>" with result "size:16" took too long (261.58297ms) to execute
2024-06-12 21:35:09.551574 W | etcdserver: read-only range request "key:\"/registry/health\" " with result "range_response_count:0 size:5" took too long (302.835559ms) to execute
2024-06-12 21:35:09.551785 W | etcdserver: read-only range request "key:\"/registry/configmaps/kube-system/coredns\" " with result "range_response_count:1 size:612" took too long (405.817511ms) to execute
2024-06-12 21:35:11.392781 W | etcdserver: read-only range request "key:\"/registry/health\" " with result "range_response_count:0 size:5" took too long (137.33424ms) to execute
2024-06-12 21:35:11.730706 W | etcdserver: read-only range request "key:\"/registry/services/endpoints/default/kubernetes\" " with result "range_response_count:1 size:420" took too long (335.655046ms) to execute
2024-06-12 21:35:14.831273 W | etcdserver: read-only range request "key:\"/registry/pods/kube-system/coredns-74ff55c5b-7rg9w\" " with result "range_response_count:1 size:4359" took too long (175.947484ms) to execute
2024-06-12 21:35:15.377566 W | etcdserver: read-only range request "key:\"/registry/health\" " with result "range_response_count:0 size:5" took too long (126.356934ms) to execute
2024-06-12 21:35:18.011751 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-06-12 21:35:28.007293 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-06-12 21:35:31.112353 W | etcdserver: request "header:<ID:15638345147502403228 username:\"kube-apiserver-etcd-client\" auth_revision:1 > txn:<compare:<target:MOD key:\"/registry/masterleases/192.168.76.2\" mod_revision:461 > success:<request_put:<key:\"/registry/masterleases/192.168.76.2\" value_size:67 lease:6414973110647627418 >> failure:<request_range:<key:\"/registry/masterleases/192.168.76.2\" > >>" with result "size:16" took too long (110.472343ms) to execute
2024-06-12 21:35:38.007140 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-06-12 21:35:48.007033 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-06-12 21:35:58.006906 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-06-12 21:36:08.006236 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-06-12 21:36:18.007364 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-06-12 21:36:28.008168 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-06-12 21:36:38.004782 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-06-12 21:36:48.002538 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-06-12 21:36:51.799352 W | etcdserver: read-only range request "key:\"/registry/limitranges/kube-system/\" range_end:\"/registry/limitranges/kube-system0\" " with result "range_response_count:0 size:5" took too long (104.714199ms) to execute
2024-06-12 21:36:55.008307 N | pkg/osutil: received terminated signal, shutting down...
WARNING: 2024/06/12 21:36:55 grpc: addrConn.createTransport failed to connect to {127.0.0.1:2379 <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
2024-06-12 21:36:55.019448 I | etcdserver: skipped leadership transfer for single voting member cluster
==> kernel <==
21:44:07 up 10:48, 0 users, load average: 7.50, 6.52, 5.84
Linux old-k8s-version-606600 5.15.146.1-microsoft-standard-WSL2 #1 SMP Thu Jan 11 04:09:03 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
PRETTY_NAME="Ubuntu 22.04.4 LTS"
==> kube-apiserver [08372f67ca60] <==
W0612 21:36:55.095684 1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
I0612 21:36:55.095720 1 clientconn.go:897] blockingPicker: the picked transport is not ready, loop back to repick
W0612 21:36:55.095753 1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0612 21:36:55.095768 1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
I0612 21:36:55.023898 1 clientconn.go:897] blockingPicker: the picked transport is not ready, loop back to repick
I0612 21:36:55.095790 1 clientconn.go:897] blockingPicker: the picked transport is not ready, loop back to repick
I0612 21:36:55.095862 1 clientconn.go:897] blockingPicker: the picked transport is not ready, loop back to repick
I0612 21:36:55.095904 1 clientconn.go:897] blockingPicker: the picked transport is not ready, loop back to repick
W0612 21:36:55.095940 1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0612 21:36:55.094496 1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0612 21:36:55.096248 1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
I0612 21:36:55.096477 1 clientconn.go:897] blockingPicker: the picked transport is not ready, loop back to repick
W0612 21:36:55.096589 1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0612 21:36:55.096609 1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0612 21:36:55.096707 1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
I0612 21:36:55.096748 1 clientconn.go:897] blockingPicker: the picked transport is not ready, loop back to repick
W0612 21:36:55.096776 1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0612 21:36:55.096846 1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0612 21:36:55.096868 1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0612 21:36:55.096916 1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0612 21:36:55.097029 1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0612 21:36:55.098027 1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0612 21:36:55.099551 1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0612 21:36:55.101317 1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
W0612 21:36:55.102994 1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379 <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
==> kube-apiserver [559ffac3c414] <==
I0612 21:41:29.772378 1 client.go:360] parsed scheme: "passthrough"
I0612 21:41:29.772526 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0612 21:41:29.772539 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0612 21:41:48.396884 1 trace.go:205] Trace[86768180]: "GuaranteedUpdate etcd3" type:*v1.Endpoints (12-Jun-2024 21:41:47.803) (total time: 593ms):
Trace[86768180]: ---"Transaction committed" 588ms (21:41:00.396)
Trace[86768180]: [593.632695ms] [593.632695ms] END
I0612 21:41:48.406331 1 trace.go:205] Trace[1213413513]: "Get" url:/api/v1/namespaces/kube-system/pods/metrics-server-9975d5f86-ltrjr,user-agent:minikube-windows-amd64.exe/v0.0.0 (windows/amd64) kubernetes/$Format,client:192.168.76.1 (12-Jun-2024 21:41:47.895) (total time: 510ms):
Trace[1213413513]: ---"About to write a response" 510ms (21:41:00.405)
Trace[1213413513]: [510.675407ms] [510.675407ms] END
I0612 21:42:10.042209 1 client.go:360] parsed scheme: "passthrough"
I0612 21:42:10.042380 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0612 21:42:10.042395 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0612 21:42:44.287799 1 client.go:360] parsed scheme: "passthrough"
I0612 21:42:44.287934 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0612 21:42:44.287954 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
W0612 21:43:13.167633 1 handler_proxy.go:102] no RequestInfo found in the context
E0612 21:43:13.167771 1 controller.go:116] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
I0612 21:43:13.167783 1 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
I0612 21:43:18.963496 1 client.go:360] parsed scheme: "passthrough"
I0612 21:43:18.963554 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0612 21:43:18.963566 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0612 21:43:59.699100 1 client.go:360] parsed scheme: "passthrough"
I0612 21:43:59.699314 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0612 21:43:59.699335 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
==> kube-controller-manager [5491a5e5dcb9] <==
I0612 21:35:07.604211 1 shared_informer.go:247] Caches are synced for endpoint_slice
I0612 21:35:07.629025 1 event.go:291] "Event occurred" object="kube-system/coredns" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled up replica set coredns-74ff55c5b to 2"
I0612 21:35:07.630087 1 range_allocator.go:373] Set node old-k8s-version-606600 PodCIDR to [10.244.0.0/24]
I0612 21:35:07.809137 1 shared_informer.go:247] Caches are synced for attach detach
I0612 21:35:07.827325 1 shared_informer.go:247] Caches are synced for stateful set
I0612 21:35:07.830453 1 shared_informer.go:247] Caches are synced for disruption
I0612 21:35:07.830480 1 disruption.go:339] Sending events to api server.
I0612 21:35:07.904105 1 shared_informer.go:247] Caches are synced for resource quota
I0612 21:35:07.906082 1 event.go:291] "Event occurred" object="kube-system/coredns-74ff55c5b" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: coredns-74ff55c5b-7rg9w"
I0612 21:35:07.908763 1 shared_informer.go:247] Caches are synced for resource quota
I0612 21:35:07.916240 1 shared_informer.go:240] Waiting for caches to sync for garbage collector
E0612 21:35:07.916503 1 clusterroleaggregation_controller.go:181] view failed with : Operation cannot be fulfilled on clusterroles.rbac.authorization.k8s.io "view": the object has been modified; please apply your changes to the latest version and try again
I0612 21:35:08.023505 1 event.go:291] "Event occurred" object="kube-system/coredns-74ff55c5b" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: coredns-74ff55c5b-xnpzv"
I0612 21:35:08.023905 1 event.go:291] "Event occurred" object="kube-system/kube-proxy" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: kube-proxy-lrbxz"
E0612 21:35:08.203407 1 clusterroleaggregation_controller.go:181] admin failed with : Operation cannot be fulfilled on clusterroles.rbac.authorization.k8s.io "admin": the object has been modified; please apply your changes to the latest version and try again
I0612 21:35:08.316952 1 shared_informer.go:247] Caches are synced for garbage collector
I0612 21:35:08.413522 1 shared_informer.go:247] Caches are synced for garbage collector
I0612 21:35:08.413554 1 garbagecollector.go:151] Garbage collector: all resource monitors have synced. Proceeding to collect garbage
E0612 21:35:08.534604 1 clusterroleaggregation_controller.go:181] admin failed with : Operation cannot be fulfilled on clusterroles.rbac.authorization.k8s.io "admin": the object has been modified; please apply your changes to the latest version and try again
E0612 21:35:08.618155 1 daemon_controller.go:320] kube-system/kube-proxy failed with : error storing status for daemon set &v1.DaemonSet{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"kube-proxy", GenerateName:"", Namespace:"kube-system", SelfLink:"", UID:"ca3decde-5875-4b14-a92f-02c2e93dde0f", ResourceVersion:"269", Generation:1, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:63853824893, loc:(*time.Location)(0x6f2f340)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"k8s-app":"kube-proxy"}, Annotations:map[string]string{"deprecated.daemonset.template.generation":"1"}, OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry{v1.ManagedFieldsEntry{Manager:"kubeadm", Operation:"Update", APIVersion:"apps/v1", Time:(*v1.Time)(0xc00061c640), FieldsType:"FieldsV1", FieldsV1:(*v1.FieldsV1)(0xc00061c6a0)}}}, Spec:v1.DaemonSetSpec{Selector:(*v1.
LabelSelector)(0xc00061c8e0), Template:v1.PodTemplateSpec{ObjectMeta:v1.ObjectMeta{Name:"", GenerateName:"", Namespace:"", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"k8s-app":"kube-proxy"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v1.PodSpec{Volumes:[]v1.Volume{v1.Volume{Name:"kube-proxy", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(nil), EmptyDir:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.Gl
usterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil), AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(0xc001ab5f80), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeSource)(nil), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil), Ephemeral:(*v1.EphemeralVolumeSource)(nil)}}, v1.Volume{Name:"xtables-lock", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(0xc00061c
940), EmptyDir:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.GlusterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil), AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(nil), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeS
ource)(nil), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil), Ephemeral:(*v1.EphemeralVolumeSource)(nil)}}, v1.Volume{Name:"lib-modules", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(0xc00061c9a0), EmptyDir:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.GlusterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil),
AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(nil), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeSource)(nil), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil), Ephemeral:(*v1.EphemeralVolumeSource)(nil)}}}, InitContainers:[]v1.Container(nil), Containers:[]v1.Container{v1.Container{Name:"kube-proxy", Image:"k8s.gcr.io/kube-proxy:v1.20.0", Command:[]string{"/usr/local/bin/kube-proxy", "--config=/var/lib/kube-proxy/config.conf", "--hostname-override=$(NODE_NAME)"}, Args:[]string(nil), WorkingDir:"", Ports:[]v1.ContainerPort(nil), EnvFrom:[]v1.EnvFromSource(nil), Env:[]v1.EnvVar{v1.EnvVar{Name:"NODE_NAME", Value:"", ValueFrom:(*v1.EnvVarSource)(0xc00061cae0)}}, Resources:v1.R
esourceRequirements{Limits:v1.ResourceList(nil), Requests:v1.ResourceList(nil)}, VolumeMounts:[]v1.VolumeMount{v1.VolumeMount{Name:"kube-proxy", ReadOnly:false, MountPath:"/var/lib/kube-proxy", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}, v1.VolumeMount{Name:"xtables-lock", ReadOnly:false, MountPath:"/run/xtables.lock", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}, v1.VolumeMount{Name:"lib-modules", ReadOnly:true, MountPath:"/lib/modules", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}}, VolumeDevices:[]v1.VolumeDevice(nil), LivenessProbe:(*v1.Probe)(nil), ReadinessProbe:(*v1.Probe)(nil), StartupProbe:(*v1.Probe)(nil), Lifecycle:(*v1.Lifecycle)(nil), TerminationMessagePath:"/dev/termination-log", TerminationMessagePolicy:"File", ImagePullPolicy:"IfNotPresent", SecurityContext:(*v1.SecurityContext)(0xc000c1d080), Stdin:false, StdinOnce:false, TTY:false}}, EphemeralContainers:[]v1.EphemeralContainer(nil), RestartPo
licy:"Always", TerminationGracePeriodSeconds:(*int64)(0xc0018ee5f8), ActiveDeadlineSeconds:(*int64)(nil), DNSPolicy:"ClusterFirst", NodeSelector:map[string]string{"kubernetes.io/os":"linux"}, ServiceAccountName:"kube-proxy", DeprecatedServiceAccount:"kube-proxy", AutomountServiceAccountToken:(*bool)(nil), NodeName:"", HostNetwork:true, HostPID:false, HostIPC:false, ShareProcessNamespace:(*bool)(nil), SecurityContext:(*v1.PodSecurityContext)(0xc000764620), ImagePullSecrets:[]v1.LocalObjectReference(nil), Hostname:"", Subdomain:"", Affinity:(*v1.Affinity)(nil), SchedulerName:"default-scheduler", Tolerations:[]v1.Toleration{v1.Toleration{Key:"CriticalAddonsOnly", Operator:"Exists", Value:"", Effect:"", TolerationSeconds:(*int64)(nil)}, v1.Toleration{Key:"", Operator:"Exists", Value:"", Effect:"", TolerationSeconds:(*int64)(nil)}}, HostAliases:[]v1.HostAlias(nil), PriorityClassName:"system-node-critical", Priority:(*int32)(nil), DNSConfig:(*v1.PodDNSConfig)(nil), ReadinessGates:[]v1.PodReadinessGate(nil), Runtime
ClassName:(*string)(nil), EnableServiceLinks:(*bool)(nil), PreemptionPolicy:(*v1.PreemptionPolicy)(nil), Overhead:v1.ResourceList(nil), TopologySpreadConstraints:[]v1.TopologySpreadConstraint(nil), SetHostnameAsFQDN:(*bool)(nil)}}, UpdateStrategy:v1.DaemonSetUpdateStrategy{Type:"RollingUpdate", RollingUpdate:(*v1.RollingUpdateDaemonSet)(0xc0005d7140)}, MinReadySeconds:0, RevisionHistoryLimit:(*int32)(0xc0018ee668)}, Status:v1.DaemonSetStatus{CurrentNumberScheduled:0, NumberMisscheduled:0, DesiredNumberScheduled:0, NumberReady:0, ObservedGeneration:0, UpdatedNumberScheduled:0, NumberAvailable:0, NumberUnavailable:0, CollisionCount:(*int32)(nil), Conditions:[]v1.DaemonSetCondition(nil)}}: Operation cannot be fulfilled on daemonsets.apps "kube-proxy": the object has been modified; please apply your changes to the latest version and try again
I0612 21:35:13.042223 1 event.go:291] "Event occurred" object="kube-system/coredns" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled down replica set coredns-74ff55c5b to 1"
I0612 21:35:13.104945 1 event.go:291] "Event occurred" object="kube-system/coredns-74ff55c5b" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulDelete" message="Deleted pod: coredns-74ff55c5b-7rg9w"
I0612 21:36:51.602048 1 event.go:291] "Event occurred" object="kube-system/metrics-server" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled up replica set metrics-server-9975d5f86 to 1"
E0612 21:36:51.907285 1 clusterroleaggregation_controller.go:181] edit failed with : Operation cannot be fulfilled on clusterroles.rbac.authorization.k8s.io "edit": the object has been modified; please apply your changes to the latest version and try again
I0612 21:36:52.817572 1 event.go:291] "Event occurred" object="kube-system/metrics-server-9975d5f86" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: metrics-server-9975d5f86-ltrjr"
==> kube-controller-manager [6116c6070393] <==
W0612 21:39:40.262879 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0612 21:40:05.581631 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0612 21:40:11.910644 1 request.go:655] Throttling request took 1.047915936s, request: GET:https://192.168.76.2:8443/apis/storage.k8s.io/v1beta1?timeout=32s
W0612 21:40:12.762394 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0612 21:40:36.081145 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0612 21:40:44.410312 1 request.go:655] Throttling request took 1.047208644s, request: GET:https://192.168.76.2:8443/apis/authentication.k8s.io/v1?timeout=32s
W0612 21:40:45.262159 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0612 21:41:06.581360 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0612 21:41:16.910096 1 request.go:655] Throttling request took 1.047749137s, request: GET:https://192.168.76.2:8443/apis/node.k8s.io/v1?timeout=32s
W0612 21:41:17.762581 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0612 21:41:37.082876 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0612 21:41:49.410617 1 request.go:655] Throttling request took 1.045818179s, request: GET:https://192.168.76.2:8443/apis/coordination.k8s.io/v1?timeout=32s
W0612 21:41:50.262982 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0612 21:42:07.583211 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0612 21:42:21.908710 1 request.go:655] Throttling request took 1.047382804s, request: GET:https://192.168.76.2:8443/apis/autoscaling/v2beta1?timeout=32s
W0612 21:42:22.761385 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0612 21:42:38.085920 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0612 21:42:54.409879 1 request.go:655] Throttling request took 1.046194494s, request: GET:https://192.168.76.2:8443/apis/storage.k8s.io/v1beta1?timeout=32s
W0612 21:42:55.263680 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0612 21:43:08.587001 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0612 21:43:26.913048 1 request.go:655] Throttling request took 1.046467069s, request: GET:https://192.168.76.2:8443/apis/flowcontrol.apiserver.k8s.io/v1beta1?timeout=32s
W0612 21:43:27.762324 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0612 21:43:39.091247 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0612 21:43:59.410018 1 request.go:655] Throttling request took 1.046119448s, request: GET:https://192.168.76.2:8443/apis/storage.k8s.io/v1?timeout=32s
W0612 21:44:00.263094 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
==> kube-proxy [9bdf65930601] <==
W0612 21:35:16.324014 1 proxier.go:651] Failed to read file /lib/modules/5.15.146.1-microsoft-standard-WSL2/modules.builtin with error open /lib/modules/5.15.146.1-microsoft-standard-WSL2/modules.builtin: no such file or directory. You can ignore this message when kube-proxy is running inside container without mounting /lib/modules
W0612 21:35:16.328304 1 proxier.go:661] Failed to load kernel module ip_vs with modprobe. You can ignore this message when kube-proxy is running inside container without mounting /lib/modules
W0612 21:35:16.332249 1 proxier.go:661] Failed to load kernel module ip_vs_rr with modprobe. You can ignore this message when kube-proxy is running inside container without mounting /lib/modules
W0612 21:35:16.335527 1 proxier.go:661] Failed to load kernel module ip_vs_wrr with modprobe. You can ignore this message when kube-proxy is running inside container without mounting /lib/modules
W0612 21:35:16.338526 1 proxier.go:661] Failed to load kernel module ip_vs_sh with modprobe. You can ignore this message when kube-proxy is running inside container without mounting /lib/modules
W0612 21:35:16.408678 1 proxier.go:661] Failed to load kernel module nf_conntrack with modprobe. You can ignore this message when kube-proxy is running inside container without mounting /lib/modules
I0612 21:35:16.429203 1 node.go:172] Successfully retrieved node IP: 192.168.76.2
I0612 21:35:16.429327 1 server_others.go:142] kube-proxy node IP is an IPv4 address (192.168.76.2), assume IPv4 operation
W0612 21:35:16.535614 1 server_others.go:578] Unknown proxy mode "", assuming iptables proxy
I0612 21:35:16.535883 1 server_others.go:185] Using iptables Proxier.
I0612 21:35:16.536413 1 server.go:650] Version: v1.20.0
I0612 21:35:16.540877 1 config.go:224] Starting endpoint slice config controller
I0612 21:35:16.540898 1 shared_informer.go:240] Waiting for caches to sync for endpoint slice config
I0612 21:35:16.540930 1 config.go:315] Starting service config controller
I0612 21:35:16.540936 1 shared_informer.go:240] Waiting for caches to sync for service config
I0612 21:35:16.642076 1 shared_informer.go:247] Caches are synced for endpoint slice config
I0612 21:35:16.642249 1 shared_informer.go:247] Caches are synced for service config
==> kube-proxy [c87af550bb83] <==
W0612 21:38:18.214326 1 proxier.go:651] Failed to read file /lib/modules/5.15.146.1-microsoft-standard-WSL2/modules.builtin with error open /lib/modules/5.15.146.1-microsoft-standard-WSL2/modules.builtin: no such file or directory. You can ignore this message when kube-proxy is running inside container without mounting /lib/modules
W0612 21:38:18.217513 1 proxier.go:661] Failed to load kernel module ip_vs with modprobe. You can ignore this message when kube-proxy is running inside container without mounting /lib/modules
W0612 21:38:18.284928 1 proxier.go:661] Failed to load kernel module ip_vs_rr with modprobe. You can ignore this message when kube-proxy is running inside container without mounting /lib/modules
W0612 21:38:18.289318 1 proxier.go:661] Failed to load kernel module ip_vs_wrr with modprobe. You can ignore this message when kube-proxy is running inside container without mounting /lib/modules
W0612 21:38:18.294154 1 proxier.go:661] Failed to load kernel module ip_vs_sh with modprobe. You can ignore this message when kube-proxy is running inside container without mounting /lib/modules
W0612 21:38:18.298027 1 proxier.go:661] Failed to load kernel module nf_conntrack with modprobe. You can ignore this message when kube-proxy is running inside container without mounting /lib/modules
I0612 21:38:18.403424 1 node.go:172] Successfully retrieved node IP: 192.168.76.2
I0612 21:38:18.403568 1 server_others.go:142] kube-proxy node IP is an IPv4 address (192.168.76.2), assume IPv4 operation
W0612 21:38:18.584959 1 server_others.go:578] Unknown proxy mode "", assuming iptables proxy
I0612 21:38:18.585193 1 server_others.go:185] Using iptables Proxier.
I0612 21:38:18.586111 1 server.go:650] Version: v1.20.0
I0612 21:38:18.587098 1 config.go:315] Starting service config controller
I0612 21:38:18.587124 1 shared_informer.go:240] Waiting for caches to sync for service config
I0612 21:38:18.587170 1 config.go:224] Starting endpoint slice config controller
I0612 21:38:18.587288 1 shared_informer.go:240] Waiting for caches to sync for endpoint slice config
I0612 21:38:18.687765 1 shared_informer.go:247] Caches are synced for endpoint slice config
I0612 21:38:18.687895 1 shared_informer.go:247] Caches are synced for service config
==> kube-scheduler [6dcf6b435dcb] <==
E0612 21:34:48.107542 1 reflector.go:138] k8s.io/apiserver/pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
E0612 21:34:48.109922 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
E0612 21:34:48.110011 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
E0612 21:34:48.110084 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
E0612 21:34:48.110295 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
E0612 21:34:48.110555 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
E0612 21:34:48.110641 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
E0612 21:34:48.110822 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1beta1.PodDisruptionBudget: failed to list *v1beta1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
E0612 21:34:48.111252 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
E0612 21:34:48.111251 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
E0612 21:34:48.111318 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
E0612 21:34:48.111365 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
E0612 21:34:48.984967 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
E0612 21:34:49.043934 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1beta1.PodDisruptionBudget: failed to list *v1beta1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
E0612 21:34:49.212732 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
E0612 21:34:49.223076 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
E0612 21:34:49.307203 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
E0612 21:34:49.315255 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
E0612 21:34:49.333775 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
E0612 21:34:49.352833 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
E0612 21:34:49.439060 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
E0612 21:34:49.443707 1 reflector.go:138] k8s.io/apiserver/pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
E0612 21:34:49.541293 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
E0612 21:34:49.675536 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
I0612 21:34:51.849296 1 shared_informer.go:247] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
==> kube-scheduler [dc6968d98409] <==
I0612 21:38:05.594326 1 serving.go:331] Generated self-signed cert in-memory
W0612 21:38:12.282754 1 requestheader_controller.go:193] Unable to get configmap/extension-apiserver-authentication in kube-system. Usually fixed by 'kubectl create rolebinding -n kube-system ROLEBINDING_NAME --role=extension-apiserver-authentication-reader --serviceaccount=YOUR_NS:YOUR_SA'
W0612 21:38:12.282930 1 authentication.go:332] Error looking up in-cluster authentication configuration: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot get resource "configmaps" in API group "" in the namespace "kube-system": RBAC: [clusterrole.rbac.authorization.k8s.io "system:kube-scheduler" not found, clusterrole.rbac.authorization.k8s.io "system:public-info-viewer" not found, clusterrole.rbac.authorization.k8s.io "system:basic-user" not found, clusterrole.rbac.authorization.k8s.io "system:volume-scheduler" not found, clusterrole.rbac.authorization.k8s.io "system:discovery" not found, role.rbac.authorization.k8s.io "system::leader-locking-kube-scheduler" not found, role.rbac.authorization.k8s.io "extension-apiserver-authentication-reader" not found]
W0612 21:38:12.282948 1 authentication.go:333] Continuing without authentication configuration. This may treat all requests as anonymous.
W0612 21:38:12.282957 1 authentication.go:334] To require authentication configuration lookup to succeed, set --authentication-tolerate-lookup-failure=false
I0612 21:38:12.494846 1 secure_serving.go:197] Serving securely on 127.0.0.1:10259
I0612 21:38:12.495027 1 configmap_cafile_content.go:202] Starting client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0612 21:38:12.495045 1 shared_informer.go:240] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0612 21:38:12.495070 1 tlsconfig.go:240] Starting DynamicServingCertificateController
I0612 21:38:12.698586 1 shared_informer.go:247] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
==> kubelet <==
Jun 12 21:41:58 old-k8s-version-606600 kubelet[1666]: E0612 21:41:58.301867 1666 pod_workers.go:191] Error syncing pod 7700737f-ee51-48c5-9fc0-24437fe76fbf ("dashboard-metrics-scraper-8d5bb5db8-qrxqz_kubernetes-dashboard(7700737f-ee51-48c5-9fc0-24437fe76fbf)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
Jun 12 21:42:04 old-k8s-version-606600 kubelet[1666]: E0612 21:42:04.282322 1666 pod_workers.go:191] Error syncing pod cbdf526e-ee8e-4fbf-83b1-066d29ec1239 ("metrics-server-9975d5f86-ltrjr_kube-system(cbdf526e-ee8e-4fbf-83b1-066d29ec1239)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Jun 12 21:42:11 old-k8s-version-606600 kubelet[1666]: E0612 21:42:11.278999 1666 pod_workers.go:191] Error syncing pod 7700737f-ee51-48c5-9fc0-24437fe76fbf ("dashboard-metrics-scraper-8d5bb5db8-qrxqz_kubernetes-dashboard(7700737f-ee51-48c5-9fc0-24437fe76fbf)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
Jun 12 21:42:17 old-k8s-version-606600 kubelet[1666]: E0612 21:42:17.277966 1666 pod_workers.go:191] Error syncing pod cbdf526e-ee8e-4fbf-83b1-066d29ec1239 ("metrics-server-9975d5f86-ltrjr_kube-system(cbdf526e-ee8e-4fbf-83b1-066d29ec1239)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Jun 12 21:42:23 old-k8s-version-606600 kubelet[1666]: E0612 21:42:23.279178 1666 pod_workers.go:191] Error syncing pod 7700737f-ee51-48c5-9fc0-24437fe76fbf ("dashboard-metrics-scraper-8d5bb5db8-qrxqz_kubernetes-dashboard(7700737f-ee51-48c5-9fc0-24437fe76fbf)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
Jun 12 21:42:31 old-k8s-version-606600 kubelet[1666]: E0612 21:42:31.276919 1666 pod_workers.go:191] Error syncing pod cbdf526e-ee8e-4fbf-83b1-066d29ec1239 ("metrics-server-9975d5f86-ltrjr_kube-system(cbdf526e-ee8e-4fbf-83b1-066d29ec1239)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Jun 12 21:42:34 old-k8s-version-606600 kubelet[1666]: E0612 21:42:34.277134 1666 pod_workers.go:191] Error syncing pod 7700737f-ee51-48c5-9fc0-24437fe76fbf ("dashboard-metrics-scraper-8d5bb5db8-qrxqz_kubernetes-dashboard(7700737f-ee51-48c5-9fc0-24437fe76fbf)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
Jun 12 21:42:44 old-k8s-version-606600 kubelet[1666]: E0612 21:42:44.277354 1666 pod_workers.go:191] Error syncing pod cbdf526e-ee8e-4fbf-83b1-066d29ec1239 ("metrics-server-9975d5f86-ltrjr_kube-system(cbdf526e-ee8e-4fbf-83b1-066d29ec1239)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Jun 12 21:42:49 old-k8s-version-606600 kubelet[1666]: E0612 21:42:49.279624 1666 pod_workers.go:191] Error syncing pod 7700737f-ee51-48c5-9fc0-24437fe76fbf ("dashboard-metrics-scraper-8d5bb5db8-qrxqz_kubernetes-dashboard(7700737f-ee51-48c5-9fc0-24437fe76fbf)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
Jun 12 21:42:58 old-k8s-version-606600 kubelet[1666]: W0612 21:42:58.391214 1666 sysinfo.go:203] Nodes topology is not available, providing CPU topology
Jun 12 21:42:58 old-k8s-version-606600 kubelet[1666]: W0612 21:42:58.392001 1666 sysfs.go:348] unable to read /sys/devices/system/cpu/cpu0/online: open /sys/devices/system/cpu/cpu0/online: no such file or directory
Jun 12 21:42:59 old-k8s-version-606600 kubelet[1666]: E0612 21:42:59.280403 1666 pod_workers.go:191] Error syncing pod cbdf526e-ee8e-4fbf-83b1-066d29ec1239 ("metrics-server-9975d5f86-ltrjr_kube-system(cbdf526e-ee8e-4fbf-83b1-066d29ec1239)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Jun 12 21:43:04 old-k8s-version-606600 kubelet[1666]: E0612 21:43:04.308191 1666 pod_workers.go:191] Error syncing pod 7700737f-ee51-48c5-9fc0-24437fe76fbf ("dashboard-metrics-scraper-8d5bb5db8-qrxqz_kubernetes-dashboard(7700737f-ee51-48c5-9fc0-24437fe76fbf)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
Jun 12 21:43:10 old-k8s-version-606600 kubelet[1666]: E0612 21:43:10.273566 1666 pod_workers.go:191] Error syncing pod cbdf526e-ee8e-4fbf-83b1-066d29ec1239 ("metrics-server-9975d5f86-ltrjr_kube-system(cbdf526e-ee8e-4fbf-83b1-066d29ec1239)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Jun 12 21:43:17 old-k8s-version-606600 kubelet[1666]: E0612 21:43:17.271765 1666 pod_workers.go:191] Error syncing pod 7700737f-ee51-48c5-9fc0-24437fe76fbf ("dashboard-metrics-scraper-8d5bb5db8-qrxqz_kubernetes-dashboard(7700737f-ee51-48c5-9fc0-24437fe76fbf)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
Jun 12 21:43:24 old-k8s-version-606600 kubelet[1666]: E0612 21:43:24.272689 1666 pod_workers.go:191] Error syncing pod cbdf526e-ee8e-4fbf-83b1-066d29ec1239 ("metrics-server-9975d5f86-ltrjr_kube-system(cbdf526e-ee8e-4fbf-83b1-066d29ec1239)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Jun 12 21:43:32 old-k8s-version-606600 kubelet[1666]: E0612 21:43:32.269407 1666 pod_workers.go:191] Error syncing pod 7700737f-ee51-48c5-9fc0-24437fe76fbf ("dashboard-metrics-scraper-8d5bb5db8-qrxqz_kubernetes-dashboard(7700737f-ee51-48c5-9fc0-24437fe76fbf)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
Jun 12 21:43:38 old-k8s-version-606600 kubelet[1666]: E0612 21:43:38.270486 1666 pod_workers.go:191] Error syncing pod cbdf526e-ee8e-4fbf-83b1-066d29ec1239 ("metrics-server-9975d5f86-ltrjr_kube-system(cbdf526e-ee8e-4fbf-83b1-066d29ec1239)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Jun 12 21:43:46 old-k8s-version-606600 kubelet[1666]: E0612 21:43:46.270393 1666 pod_workers.go:191] Error syncing pod 7700737f-ee51-48c5-9fc0-24437fe76fbf ("dashboard-metrics-scraper-8d5bb5db8-qrxqz_kubernetes-dashboard(7700737f-ee51-48c5-9fc0-24437fe76fbf)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
Jun 12 21:43:52 old-k8s-version-606600 kubelet[1666]: E0612 21:43:52.269665 1666 pod_workers.go:191] Error syncing pod cbdf526e-ee8e-4fbf-83b1-066d29ec1239 ("metrics-server-9975d5f86-ltrjr_kube-system(cbdf526e-ee8e-4fbf-83b1-066d29ec1239)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Jun 12 21:43:58 old-k8s-version-606600 kubelet[1666]: E0612 21:43:58.265146 1666 pod_workers.go:191] Error syncing pod 7700737f-ee51-48c5-9fc0-24437fe76fbf ("dashboard-metrics-scraper-8d5bb5db8-qrxqz_kubernetes-dashboard(7700737f-ee51-48c5-9fc0-24437fe76fbf)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with ImagePullBackOff: "Back-off pulling image \"registry.k8s.io/echoserver:1.4\""
Jun 12 21:44:03 old-k8s-version-606600 kubelet[1666]: E0612 21:44:03.475374 1666 remote_image.go:113] PullImage "fake.domain/registry.k8s.io/echoserver:1.4" from image service failed: rpc error: code = Unknown desc = Error response from daemon: Get "https://fake.domain/v2/": dial tcp: lookup fake.domain on 192.168.65.254:53: no such host
Jun 12 21:44:03 old-k8s-version-606600 kubelet[1666]: E0612 21:44:03.475551 1666 kuberuntime_image.go:51] Pull image "fake.domain/registry.k8s.io/echoserver:1.4" failed: rpc error: code = Unknown desc = Error response from daemon: Get "https://fake.domain/v2/": dial tcp: lookup fake.domain on 192.168.65.254:53: no such host
Jun 12 21:44:03 old-k8s-version-606600 kubelet[1666]: E0612 21:44:03.475765 1666 kuberuntime_manager.go:829] container &Container{Name:metrics-server,Image:fake.domain/registry.k8s.io/echoserver:1.4,Command:[],Args:[--cert-dir=/tmp --secure-port=4443 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --kubelet-use-node-status-port --metric-resolution=60s --kubelet-insecure-tls],WorkingDir:,Ports:[]ContainerPort{ContainerPort{Name:https,HostPort:0,ContainerPort:4443,Protocol:TCP,HostIP:,},},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{cpu: {{100 -3} {<nil>} 100m DecimalSI},memory: {{209715200 0} {<nil>} BinarySI},},},VolumeMounts:[]VolumeMount{VolumeMount{Name:tmp-dir,ReadOnly:false,MountPath:/tmp,SubPath:,MountPropagation:nil,SubPathExpr:,},VolumeMount{Name:metrics-server-token-4qkrt,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,},},LivenessProbe:&Probe{Handler:Handler{Exe
c:nil,HTTPGet:&HTTPGetAction{Path:/livez,Port:{1 0 https},Host:,Scheme:HTTPS,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,},InitialDelaySeconds:0,TimeoutSeconds:1,PeriodSeconds:10,SuccessThreshold:1,FailureThreshold:3,},ReadinessProbe:&Probe{Handler:Handler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/readyz,Port:{1 0 https},Host:,Scheme:HTTPS,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,},InitialDelaySeconds:0,TimeoutSeconds:1,PeriodSeconds:10,SuccessThreshold:1,FailureThreshold:3,},Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:nil,Privileged:nil,SELinuxOptions:nil,RunAsUser:*1000,RunAsNonRoot:*true,ReadOnlyRootFilesystem:*true,AllowPrivilegeEscalation:nil,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,} start failed in pod metrics-server-9975d5f86-ltrjr_kube-system(cbdf52
6e-ee8e-4fbf-83b1-066d29ec1239): ErrImagePull: rpc error: code = Unknown desc = Error response from daemon: Get "https://fake.domain/v2/": dial tcp: lookup fake.domain on 192.168.65.254:53: no such host
Jun 12 21:44:03 old-k8s-version-606600 kubelet[1666]: E0612 21:44:03.475824 1666 pod_workers.go:191] Error syncing pod cbdf526e-ee8e-4fbf-83b1-066d29ec1239 ("metrics-server-9975d5f86-ltrjr_kube-system(cbdf526e-ee8e-4fbf-83b1-066d29ec1239)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = Error response from daemon: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.65.254:53: no such host"
==> kubernetes-dashboard [ed7189bae68d] <==
2024/06/12 21:39:00 Starting overwatch
2024/06/12 21:39:00 Using namespace: kubernetes-dashboard
2024/06/12 21:39:00 Using in-cluster config to connect to apiserver
2024/06/12 21:39:00 Using secret token for csrf signing
2024/06/12 21:39:00 Initializing csrf token from kubernetes-dashboard-csrf secret
2024/06/12 21:39:00 Empty token. Generating and storing in a secret kubernetes-dashboard-csrf
2024/06/12 21:39:00 Successful initial request to the apiserver, version: v1.20.0
2024/06/12 21:39:00 Generating JWE encryption key
2024/06/12 21:39:00 New synchronizer has been registered: kubernetes-dashboard-key-holder-kubernetes-dashboard. Starting
2024/06/12 21:39:00 Starting secret synchronizer for kubernetes-dashboard-key-holder in namespace kubernetes-dashboard
2024/06/12 21:39:00 Initializing JWE encryption key from synchronized object
2024/06/12 21:39:00 Creating in-cluster Sidecar client
2024/06/12 21:39:00 Serving insecurely on HTTP port: 9090
2024/06/12 21:39:00 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/06/12 21:39:30 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/06/12 21:40:00 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/06/12 21:40:30 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/06/12 21:41:00 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/06/12 21:41:30 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/06/12 21:42:00 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/06/12 21:42:30 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/06/12 21:43:00 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/06/12 21:43:30 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/06/12 21:44:00 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
==> storage-provisioner [380c76a7ac65] <==
I0612 21:38:56.088943 1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
I0612 21:38:56.181094 1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!
I0612 21:38:56.181260 1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...
I0612 21:39:13.644499 1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath
I0612 21:39:13.644715 1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"8d5b85d4-0879-4862-b05e-a41708a2765c", APIVersion:"v1", ResourceVersion:"796", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' old-k8s-version-606600_644715c6-3e57-4797-aaab-66298ca83741 became leader
I0612 21:39:13.644784 1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_old-k8s-version-606600_644715c6-3e57-4797-aaab-66298ca83741!
I0612 21:39:13.745924 1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_old-k8s-version-606600_644715c6-3e57-4797-aaab-66298ca83741!
==> storage-provisioner [3f440bc35ac0] <==
I0612 21:38:17.788198 1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
F0612 21:38:38.847136 1 main.go:39] error getting server version: Get "https://10.96.0.1:443/version?timeout=32s": dial tcp 10.96.0.1:443: connect: connection refused
-- /stdout --
** stderr **
W0612 21:44:04.610933 7212 main.go:291] Unable to resolve the current Docker CLI context "default": context "default": context not found: open C:\Users\jenkins.minikube4\.docker\contexts\meta\37a8eec1ce19687d132fe29051dca629d164e2c4958ba141d5f4133a33f0688f\meta.json: The system cannot find the path specified.
** /stderr **
helpers_test.go:254: (dbg) Run: out/minikube-windows-amd64.exe status --format={{.APIServer}} -p old-k8s-version-606600 -n old-k8s-version-606600
helpers_test.go:254: (dbg) Done: out/minikube-windows-amd64.exe status --format={{.APIServer}} -p old-k8s-version-606600 -n old-k8s-version-606600: (1.4631468s)
helpers_test.go:261: (dbg) Run: kubectl --context old-k8s-version-606600 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:272: non-running pods: metrics-server-9975d5f86-ltrjr dashboard-metrics-scraper-8d5bb5db8-qrxqz
helpers_test.go:274: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/SecondStart]: describe non-running pods <======
helpers_test.go:277: (dbg) Run: kubectl --context old-k8s-version-606600 describe pod metrics-server-9975d5f86-ltrjr dashboard-metrics-scraper-8d5bb5db8-qrxqz
helpers_test.go:277: (dbg) Non-zero exit: kubectl --context old-k8s-version-606600 describe pod metrics-server-9975d5f86-ltrjr dashboard-metrics-scraper-8d5bb5db8-qrxqz: exit status 1 (488.625ms)
** stderr **
E0612 21:44:11.861047 13752 memcache.go:287] couldn't get resource list for metrics.k8s.io/v1beta1: the server is currently unable to handle the request
E0612 21:44:11.959745 13752 memcache.go:121] couldn't get resource list for metrics.k8s.io/v1beta1: the server is currently unable to handle the request
E0612 21:44:11.972483 13752 memcache.go:121] couldn't get resource list for metrics.k8s.io/v1beta1: the server is currently unable to handle the request
E0612 21:44:11.983435 13752 memcache.go:121] couldn't get resource list for metrics.k8s.io/v1beta1: the server is currently unable to handle the request
Error from server (NotFound): pods "metrics-server-9975d5f86-ltrjr" not found
Error from server (NotFound): pods "dashboard-metrics-scraper-8d5bb5db8-qrxqz" not found
** /stderr **
helpers_test.go:279: kubectl --context old-k8s-version-606600 describe pod metrics-server-9975d5f86-ltrjr dashboard-metrics-scraper-8d5bb5db8-qrxqz: exit status 1
--- FAIL: TestStartStop/group/old-k8s-version/serial/SecondStart (423.69s)