=== RUN TestStartStop/group/old-k8s-version/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run: out/minikube-linux-arm64 start -p old-k8s-version-745133 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --container-runtime=crio --kubernetes-version=v1.20.0
start_stop_delete_test.go:256: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p old-k8s-version-745133 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --container-runtime=crio --kubernetes-version=v1.20.0: exit status 102 (6m19.616302805s)
-- stdout --
* [old-k8s-version-745133] minikube v1.34.0 on Ubuntu 20.04 (arm64)
- MINIKUBE_LOCATION=19711
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/19711-553751/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/19711-553751/.minikube
- MINIKUBE_BIN=out/minikube-linux-arm64
- MINIKUBE_FORCE_SYSTEMD=
* Kubernetes 1.31.1 is now available. If you would like to upgrade, specify: --kubernetes-version=v1.31.1
* Using the docker driver based on existing profile
* Starting "old-k8s-version-745133" primary control-plane node in "old-k8s-version-745133" cluster
* Pulling base image v0.0.45-1727108449-19696 ...
* Restarting existing docker container for "old-k8s-version-745133" ...
* Preparing Kubernetes v1.20.0 on CRI-O 1.24.6 ...
* Verifying Kubernetes components...
- Using image docker.io/kubernetesui/dashboard:v2.7.0
- Using image gcr.io/k8s-minikube/storage-provisioner:v5
- Using image registry.k8s.io/echoserver:1.4
- Using image fake.domain/registry.k8s.io/echoserver:1.4
* Some dashboard features require the metrics-server addon. To enable all features please run:
minikube -p old-k8s-version-745133 addons enable metrics-server
* Enabled addons: storage-provisioner, metrics-server, dashboard, default-storageclass
-- /stdout --
** stderr **
I0927 01:38:30.792535 756367 out.go:345] Setting OutFile to fd 1 ...
I0927 01:38:30.792651 756367 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0927 01:38:30.792661 756367 out.go:358] Setting ErrFile to fd 2...
I0927 01:38:30.792666 756367 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0927 01:38:30.792921 756367 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19711-553751/.minikube/bin
I0927 01:38:30.793298 756367 out.go:352] Setting JSON to false
I0927 01:38:30.794204 756367 start.go:129] hostinfo: {"hostname":"ip-172-31-21-244","uptime":19254,"bootTime":1727381857,"procs":183,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1070-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"da8ac1fd-6236-412a-a346-95873c98230d"}
I0927 01:38:30.794276 756367 start.go:139] virtualization:
I0927 01:38:30.797721 756367 out.go:177] * [old-k8s-version-745133] minikube v1.34.0 on Ubuntu 20.04 (arm64)
I0927 01:38:30.801467 756367 out.go:177] - MINIKUBE_LOCATION=19711
I0927 01:38:30.801626 756367 notify.go:220] Checking for updates...
I0927 01:38:30.807240 756367 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0927 01:38:30.810187 756367 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/19711-553751/kubeconfig
I0927 01:38:30.812711 756367 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/19711-553751/.minikube
I0927 01:38:30.815379 756367 out.go:177] - MINIKUBE_BIN=out/minikube-linux-arm64
I0927 01:38:30.818124 756367 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0927 01:38:30.821074 756367 config.go:182] Loaded profile config "old-k8s-version-745133": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.20.0
I0927 01:38:30.823755 756367 out.go:177] * Kubernetes 1.31.1 is now available. If you would like to upgrade, specify: --kubernetes-version=v1.31.1
I0927 01:38:30.826362 756367 driver.go:394] Setting default libvirt URI to qemu:///system
I0927 01:38:30.873077 756367 docker.go:123] docker version: linux-27.3.1:Docker Engine - Community
I0927 01:38:30.873187 756367 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0927 01:38:30.952234 756367 info.go:266] docker info: {ID:5FDH:SA5P:5GCT:NLAS:B73P:SGDQ:PBG5:UBVH:UZY3:RXGO:CI7S:WAIH Containers:2 ContainersRunning:1 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:55 OomKillDisable:true NGoroutines:67 SystemTime:2024-09-27 01:38:30.937438012 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1070-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:a
arch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214835200 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-21-244 Labels:[] ExperimentalBuild:false ServerVersion:27.3.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c Expected:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c} RuncCommit:{ID:v1.1.14-0-g2c9f560 Expected:v1.1.14-0-g2c9f560} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:[WARNING: brid
ge-nf-call-iptables is disabled WARNING: bridge-nf-call-ip6tables is disabled] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.17.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.7]] Warnings:<nil>}}
I0927 01:38:30.952345 756367 docker.go:318] overlay module found
I0927 01:38:30.955416 756367 out.go:177] * Using the docker driver based on existing profile
I0927 01:38:30.958323 756367 start.go:297] selected driver: docker
I0927 01:38:30.958346 756367 start.go:901] validating driver "docker" against &{Name:old-k8s-version-745133 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-745133 Namespace:default APIServerHAVIP: AP
IServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountStr
ing:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0927 01:38:30.958458 756367 start.go:912] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0927 01:38:30.959163 756367 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0927 01:38:31.048042 756367 info.go:266] docker info: {ID:5FDH:SA5P:5GCT:NLAS:B73P:SGDQ:PBG5:UBVH:UZY3:RXGO:CI7S:WAIH Containers:2 ContainersRunning:1 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:55 OomKillDisable:true NGoroutines:67 SystemTime:2024-09-27 01:38:31.037698358 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1070-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:a
arch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214835200 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-21-244 Labels:[] ExperimentalBuild:false ServerVersion:27.3.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c Expected:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c} RuncCommit:{ID:v1.1.14-0-g2c9f560 Expected:v1.1.14-0-g2c9f560} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:[WARNING: brid
ge-nf-call-iptables is disabled WARNING: bridge-nf-call-ip6tables is disabled] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.17.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.7]] Warnings:<nil>}}
I0927 01:38:31.048432 756367 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0927 01:38:31.048454 756367 cni.go:84] Creating CNI manager for ""
I0927 01:38:31.048497 756367 cni.go:143] "docker" driver + "crio" runtime found, recommending kindnet
I0927 01:38:31.048531 756367 start.go:340] cluster config:
{Name:old-k8s-version-745133 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-745133 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local
ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP
: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0927 01:38:31.051279 756367 out.go:177] * Starting "old-k8s-version-745133" primary control-plane node in "old-k8s-version-745133" cluster
I0927 01:38:31.053760 756367 cache.go:121] Beginning downloading kic base image for docker with crio
I0927 01:38:31.056718 756367 out.go:177] * Pulling base image v0.0.45-1727108449-19696 ...
I0927 01:38:31.060437 756367 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0927 01:38:31.060502 756367 preload.go:146] Found local preload: /home/jenkins/minikube-integration/19711-553751/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-arm64.tar.lz4
I0927 01:38:31.060511 756367 cache.go:56] Caching tarball of preloaded images
I0927 01:38:31.060599 756367 preload.go:172] Found /home/jenkins/minikube-integration/19711-553751/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-arm64.tar.lz4 in cache, skipping download
I0927 01:38:31.060609 756367 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on crio
I0927 01:38:31.060715 756367 profile.go:143] Saving config to /home/jenkins/minikube-integration/19711-553751/.minikube/profiles/old-k8s-version-745133/config.json ...
I0927 01:38:31.060928 756367 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21 in local docker daemon
I0927 01:38:31.095476 756367 image.go:98] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21 in local docker daemon, skipping pull
I0927 01:38:31.095496 756367 cache.go:144] gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21 exists in daemon, skipping load
I0927 01:38:31.095511 756367 cache.go:194] Successfully downloaded all kic artifacts
I0927 01:38:31.095534 756367 start.go:360] acquireMachinesLock for old-k8s-version-745133: {Name:mk1dc62b74a6b6f0f0f4c7d69d36594586373035 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0927 01:38:31.095589 756367 start.go:364] duration metric: took 34.026µs to acquireMachinesLock for "old-k8s-version-745133"
I0927 01:38:31.095611 756367 start.go:96] Skipping create...Using existing machine configuration
I0927 01:38:31.095623 756367 fix.go:54] fixHost starting:
I0927 01:38:31.095884 756367 cli_runner.go:164] Run: docker container inspect old-k8s-version-745133 --format={{.State.Status}}
I0927 01:38:31.112123 756367 fix.go:112] recreateIfNeeded on old-k8s-version-745133: state=Stopped err=<nil>
W0927 01:38:31.112154 756367 fix.go:138] unexpected machine state, will restart: <nil>
I0927 01:38:31.114995 756367 out.go:177] * Restarting existing docker container for "old-k8s-version-745133" ...
I0927 01:38:31.117633 756367 cli_runner.go:164] Run: docker start old-k8s-version-745133
I0927 01:38:31.477261 756367 cli_runner.go:164] Run: docker container inspect old-k8s-version-745133 --format={{.State.Status}}
I0927 01:38:31.513306 756367 kic.go:430] container "old-k8s-version-745133" state is running.
I0927 01:38:31.513730 756367 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-745133
I0927 01:38:31.541314 756367 profile.go:143] Saving config to /home/jenkins/minikube-integration/19711-553751/.minikube/profiles/old-k8s-version-745133/config.json ...
I0927 01:38:31.541536 756367 machine.go:93] provisionDockerMachine start ...
I0927 01:38:31.541596 756367 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-745133
I0927 01:38:31.568274 756367 main.go:141] libmachine: Using SSH client type: native
I0927 01:38:31.568542 756367 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x413650] 0x415e90 <nil> [] 0s} 127.0.0.1 33791 <nil> <nil>}
I0927 01:38:31.568552 756367 main.go:141] libmachine: About to run SSH command:
hostname
I0927 01:38:31.569210 756367 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:56238->127.0.0.1:33791: read: connection reset by peer
I0927 01:38:34.738421 756367 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-745133
I0927 01:38:34.738443 756367 ubuntu.go:169] provisioning hostname "old-k8s-version-745133"
I0927 01:38:34.738511 756367 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-745133
I0927 01:38:34.796845 756367 main.go:141] libmachine: Using SSH client type: native
I0927 01:38:34.797095 756367 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x413650] 0x415e90 <nil> [] 0s} 127.0.0.1 33791 <nil> <nil>}
I0927 01:38:34.797107 756367 main.go:141] libmachine: About to run SSH command:
sudo hostname old-k8s-version-745133 && echo "old-k8s-version-745133" | sudo tee /etc/hostname
I0927 01:38:34.956689 756367 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-745133
I0927 01:38:34.956771 756367 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-745133
I0927 01:38:34.988239 756367 main.go:141] libmachine: Using SSH client type: native
I0927 01:38:34.988564 756367 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x413650] 0x415e90 <nil> [] 0s} 127.0.0.1 33791 <nil> <nil>}
I0927 01:38:34.988587 756367 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-745133' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-745133/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-745133' | sudo tee -a /etc/hosts;
fi
fi
I0927 01:38:35.129961 756367 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0927 01:38:35.130105 756367 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/19711-553751/.minikube CaCertPath:/home/jenkins/minikube-integration/19711-553751/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19711-553751/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19711-553751/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19711-553751/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19711-553751/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19711-553751/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19711-553751/.minikube}
I0927 01:38:35.130234 756367 ubuntu.go:177] setting up certificates
I0927 01:38:35.130252 756367 provision.go:84] configureAuth start
I0927 01:38:35.130401 756367 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-745133
I0927 01:38:35.154293 756367 provision.go:143] copyHostCerts
I0927 01:38:35.154369 756367 exec_runner.go:144] found /home/jenkins/minikube-integration/19711-553751/.minikube/key.pem, removing ...
I0927 01:38:35.154390 756367 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19711-553751/.minikube/key.pem
I0927 01:38:35.154467 756367 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19711-553751/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19711-553751/.minikube/key.pem (1675 bytes)
I0927 01:38:35.154580 756367 exec_runner.go:144] found /home/jenkins/minikube-integration/19711-553751/.minikube/ca.pem, removing ...
I0927 01:38:35.154592 756367 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19711-553751/.minikube/ca.pem
I0927 01:38:35.154621 756367 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19711-553751/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19711-553751/.minikube/ca.pem (1078 bytes)
I0927 01:38:35.154693 756367 exec_runner.go:144] found /home/jenkins/minikube-integration/19711-553751/.minikube/cert.pem, removing ...
I0927 01:38:35.154705 756367 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19711-553751/.minikube/cert.pem
I0927 01:38:35.154842 756367 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19711-553751/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19711-553751/.minikube/cert.pem (1123 bytes)
I0927 01:38:35.154921 756367 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19711-553751/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19711-553751/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19711-553751/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-745133 san=[127.0.0.1 192.168.76.2 localhost minikube old-k8s-version-745133]
I0927 01:38:35.653504 756367 provision.go:177] copyRemoteCerts
I0927 01:38:35.653623 756367 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0927 01:38:35.653707 756367 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-745133
I0927 01:38:35.669754 756367 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33791 SSHKeyPath:/home/jenkins/minikube-integration/19711-553751/.minikube/machines/old-k8s-version-745133/id_rsa Username:docker}
I0927 01:38:35.763854 756367 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19711-553751/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0927 01:38:35.788100 756367 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19711-553751/.minikube/machines/server.pem --> /etc/docker/server.pem (1233 bytes)
I0927 01:38:35.824120 756367 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19711-553751/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I0927 01:38:35.871229 756367 provision.go:87] duration metric: took 740.96195ms to configureAuth
I0927 01:38:35.871260 756367 ubuntu.go:193] setting minikube options for container-runtime
I0927 01:38:35.871462 756367 config.go:182] Loaded profile config "old-k8s-version-745133": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.20.0
I0927 01:38:35.871576 756367 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-745133
I0927 01:38:35.891631 756367 main.go:141] libmachine: Using SSH client type: native
I0927 01:38:35.891894 756367 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x413650] 0x415e90 <nil> [] 0s} 127.0.0.1 33791 <nil> <nil>}
I0927 01:38:35.891910 756367 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %s "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0927 01:38:36.255956 756367 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0927 01:38:36.255982 756367 machine.go:96] duration metric: took 4.714436747s to provisionDockerMachine
I0927 01:38:36.255995 756367 start.go:293] postStartSetup for "old-k8s-version-745133" (driver="docker")
I0927 01:38:36.256007 756367 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0927 01:38:36.256075 756367 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0927 01:38:36.256126 756367 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-745133
I0927 01:38:36.289392 756367 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33791 SSHKeyPath:/home/jenkins/minikube-integration/19711-553751/.minikube/machines/old-k8s-version-745133/id_rsa Username:docker}
I0927 01:38:36.384630 756367 ssh_runner.go:195] Run: cat /etc/os-release
I0927 01:38:36.388455 756367 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I0927 01:38:36.388491 756367 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
I0927 01:38:36.388501 756367 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
I0927 01:38:36.388508 756367 info.go:137] Remote host: Ubuntu 22.04.5 LTS
I0927 01:38:36.388519 756367 filesync.go:126] Scanning /home/jenkins/minikube-integration/19711-553751/.minikube/addons for local assets ...
I0927 01:38:36.388572 756367 filesync.go:126] Scanning /home/jenkins/minikube-integration/19711-553751/.minikube/files for local assets ...
I0927 01:38:36.388649 756367 filesync.go:149] local asset: /home/jenkins/minikube-integration/19711-553751/.minikube/files/etc/ssl/certs/5591582.pem -> 5591582.pem in /etc/ssl/certs
I0927 01:38:36.388751 756367 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0927 01:38:36.398056 756367 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19711-553751/.minikube/files/etc/ssl/certs/5591582.pem --> /etc/ssl/certs/5591582.pem (1708 bytes)
I0927 01:38:36.422064 756367 start.go:296] duration metric: took 166.052315ms for postStartSetup
I0927 01:38:36.422196 756367 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I0927 01:38:36.422266 756367 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-745133
I0927 01:38:36.440356 756367 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33791 SSHKeyPath:/home/jenkins/minikube-integration/19711-553751/.minikube/machines/old-k8s-version-745133/id_rsa Username:docker}
I0927 01:38:36.533176 756367 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
I0927 01:38:36.538143 756367 fix.go:56] duration metric: took 5.442518132s for fixHost
I0927 01:38:36.538167 756367 start.go:83] releasing machines lock for "old-k8s-version-745133", held for 5.442569692s
I0927 01:38:36.538236 756367 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-745133
I0927 01:38:36.565703 756367 ssh_runner.go:195] Run: cat /version.json
I0927 01:38:36.565759 756367 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-745133
I0927 01:38:36.565773 756367 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0927 01:38:36.565847 756367 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-745133
I0927 01:38:36.601640 756367 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33791 SSHKeyPath:/home/jenkins/minikube-integration/19711-553751/.minikube/machines/old-k8s-version-745133/id_rsa Username:docker}
I0927 01:38:36.602402 756367 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33791 SSHKeyPath:/home/jenkins/minikube-integration/19711-553751/.minikube/machines/old-k8s-version-745133/id_rsa Username:docker}
I0927 01:38:36.702529 756367 ssh_runner.go:195] Run: systemctl --version
I0927 01:38:36.837008 756367 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0927 01:38:36.997804 756367 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
I0927 01:38:37.002822 756367 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0927 01:38:37.012804 756367 cni.go:221] loopback cni configuration disabled: "/etc/cni/net.d/*loopback.conf*" found
I0927 01:38:37.012888 756367 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0927 01:38:37.024476 756367 cni.go:259] no active bridge cni configs found in "/etc/cni/net.d" - nothing to disable
I0927 01:38:37.024504 756367 start.go:495] detecting cgroup driver to use...
I0927 01:38:37.024547 756367 detect.go:187] detected "cgroupfs" cgroup driver on host os
I0927 01:38:37.024606 756367 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0927 01:38:37.040293 756367 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0927 01:38:37.056243 756367 docker.go:217] disabling cri-docker service (if available) ...
I0927 01:38:37.056324 756367 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0927 01:38:37.070937 756367 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0927 01:38:37.082845 756367 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0927 01:38:37.190782 756367 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0927 01:38:37.291082 756367 docker.go:233] disabling docker service ...
I0927 01:38:37.291162 756367 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0927 01:38:37.306050 756367 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0927 01:38:37.327846 756367 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0927 01:38:37.456667 756367 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0927 01:38:37.558394 756367 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0927 01:38:37.572230 756367 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0927 01:38:37.589299 756367 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.2" pause image...
I0927 01:38:37.589368 756367 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.2"|' /etc/crio/crio.conf.d/02-crio.conf"
I0927 01:38:37.599652 756367 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0927 01:38:37.599723 756367 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0927 01:38:37.609961 756367 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0927 01:38:37.620123 756367 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0927 01:38:37.630094 756367 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0927 01:38:37.639923 756367 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0927 01:38:37.649130 756367 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0927 01:38:37.658260 756367 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0927 01:38:37.760713 756367 ssh_runner.go:195] Run: sudo systemctl restart crio
I0927 01:38:38.425454 756367 start.go:542] Will wait 60s for socket path /var/run/crio/crio.sock
I0927 01:38:38.425560 756367 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0927 01:38:38.430395 756367 start.go:563] Will wait 60s for crictl version
I0927 01:38:38.430503 756367 ssh_runner.go:195] Run: which crictl
I0927 01:38:38.434135 756367 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0927 01:38:38.478583 756367 start.go:579] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.24.6
RuntimeApiVersion: v1
I0927 01:38:38.478704 756367 ssh_runner.go:195] Run: crio --version
I0927 01:38:38.525278 756367 ssh_runner.go:195] Run: crio --version
I0927 01:38:38.575705 756367 out.go:177] * Preparing Kubernetes v1.20.0 on CRI-O 1.24.6 ...
I0927 01:38:38.576873 756367 cli_runner.go:164] Run: docker network inspect old-k8s-version-745133 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I0927 01:38:38.595107 756367 ssh_runner.go:195] Run: grep 192.168.76.1 host.minikube.internal$ /etc/hosts
I0927 01:38:38.598870 756367 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.76.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0927 01:38:38.609698 756367 kubeadm.go:883] updating cluster {Name:old-k8s-version-745133 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-745133 Namespace:default APIServerHAVIP: APIServerName:minik
ubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins
:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0927 01:38:38.609826 756367 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0927 01:38:38.609889 756367 ssh_runner.go:195] Run: sudo crictl images --output json
I0927 01:38:38.675695 756367 crio.go:514] all images are preloaded for cri-o runtime.
I0927 01:38:38.675723 756367 crio.go:433] Images already preloaded, skipping extraction
I0927 01:38:38.675777 756367 ssh_runner.go:195] Run: sudo crictl images --output json
I0927 01:38:38.722855 756367 crio.go:514] all images are preloaded for cri-o runtime.
I0927 01:38:38.722882 756367 cache_images.go:84] Images are preloaded, skipping loading
I0927 01:38:38.722891 756367 kubeadm.go:934] updating node { 192.168.76.2 8443 v1.20.0 crio true true} ...
I0927 01:38:38.723002 756367 kubeadm.go:946] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.20.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --cgroups-per-qos=false --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///var/run/crio/crio.sock --enforce-node-allocatable= --hostname-override=old-k8s-version-745133 --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.76.2
[Install]
config:
{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-745133 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0927 01:38:38.723089 756367 ssh_runner.go:195] Run: crio config
I0927 01:38:38.808846 756367 cni.go:84] Creating CNI manager for ""
I0927 01:38:38.808923 756367 cni.go:143] "docker" driver + "crio" runtime found, recommending kindnet
I0927 01:38:38.808953 756367 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0927 01:38:38.808995 756367 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.76.2 APIServerPort:8443 KubernetesVersion:v1.20.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-745133 NodeName:old-k8s-version-745133 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.76.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.76.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPo
dPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
I0927 01:38:38.809159 756367 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta2
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.76.2
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /var/run/crio/crio.sock
name: "old-k8s-version-745133"
kubeletExtraArgs:
node-ip: 192.168.76.2
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta2
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.76.2"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.20.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0927 01:38:38.809248 756367 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.20.0
I0927 01:38:38.820790 756367 binaries.go:44] Found k8s binaries, skipping transfer
I0927 01:38:38.820907 756367 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0927 01:38:38.829540 756367 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (480 bytes)
I0927 01:38:38.847476 756367 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0927 01:38:38.876557 756367 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2117 bytes)
I0927 01:38:38.902384 756367 ssh_runner.go:195] Run: grep 192.168.76.2 control-plane.minikube.internal$ /etc/hosts
I0927 01:38:38.906213 756367 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.76.2 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0927 01:38:38.917552 756367 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0927 01:38:39.021462 756367 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0927 01:38:39.037690 756367 certs.go:68] Setting up /home/jenkins/minikube-integration/19711-553751/.minikube/profiles/old-k8s-version-745133 for IP: 192.168.76.2
I0927 01:38:39.037729 756367 certs.go:194] generating shared ca certs ...
I0927 01:38:39.037746 756367 certs.go:226] acquiring lock for ca certs: {Name:mkd73b356b28d0818fea73c44481b0cb2597afbb Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0927 01:38:39.037944 756367 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/19711-553751/.minikube/ca.key
I0927 01:38:39.038030 756367 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19711-553751/.minikube/proxy-client-ca.key
I0927 01:38:39.038046 756367 certs.go:256] generating profile certs ...
I0927 01:38:39.038177 756367 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/19711-553751/.minikube/profiles/old-k8s-version-745133/client.key
I0927 01:38:39.038286 756367 certs.go:359] skipping valid signed profile cert regeneration for "minikube": /home/jenkins/minikube-integration/19711-553751/.minikube/profiles/old-k8s-version-745133/apiserver.key.583406db
I0927 01:38:39.038360 756367 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/19711-553751/.minikube/profiles/old-k8s-version-745133/proxy-client.key
I0927 01:38:39.038510 756367 certs.go:484] found cert: /home/jenkins/minikube-integration/19711-553751/.minikube/certs/559158.pem (1338 bytes)
W0927 01:38:39.038567 756367 certs.go:480] ignoring /home/jenkins/minikube-integration/19711-553751/.minikube/certs/559158_empty.pem, impossibly tiny 0 bytes
I0927 01:38:39.038581 756367 certs.go:484] found cert: /home/jenkins/minikube-integration/19711-553751/.minikube/certs/ca-key.pem (1679 bytes)
I0927 01:38:39.038621 756367 certs.go:484] found cert: /home/jenkins/minikube-integration/19711-553751/.minikube/certs/ca.pem (1078 bytes)
I0927 01:38:39.038666 756367 certs.go:484] found cert: /home/jenkins/minikube-integration/19711-553751/.minikube/certs/cert.pem (1123 bytes)
I0927 01:38:39.038705 756367 certs.go:484] found cert: /home/jenkins/minikube-integration/19711-553751/.minikube/certs/key.pem (1675 bytes)
I0927 01:38:39.038802 756367 certs.go:484] found cert: /home/jenkins/minikube-integration/19711-553751/.minikube/files/etc/ssl/certs/5591582.pem (1708 bytes)
I0927 01:38:39.039569 756367 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19711-553751/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0927 01:38:39.095191 756367 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19711-553751/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
I0927 01:38:39.128291 756367 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19711-553751/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0927 01:38:39.210007 756367 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19711-553751/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
I0927 01:38:39.257289 756367 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19711-553751/.minikube/profiles/old-k8s-version-745133/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
I0927 01:38:39.283748 756367 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19711-553751/.minikube/profiles/old-k8s-version-745133/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
I0927 01:38:39.310189 756367 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19711-553751/.minikube/profiles/old-k8s-version-745133/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0927 01:38:39.337730 756367 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19711-553751/.minikube/profiles/old-k8s-version-745133/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
I0927 01:38:39.363604 756367 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19711-553751/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0927 01:38:39.390105 756367 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19711-553751/.minikube/certs/559158.pem --> /usr/share/ca-certificates/559158.pem (1338 bytes)
I0927 01:38:39.416466 756367 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19711-553751/.minikube/files/etc/ssl/certs/5591582.pem --> /usr/share/ca-certificates/5591582.pem (1708 bytes)
I0927 01:38:39.442404 756367 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0927 01:38:39.461566 756367 ssh_runner.go:195] Run: openssl version
I0927 01:38:39.467707 756367 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/559158.pem && ln -fs /usr/share/ca-certificates/559158.pem /etc/ssl/certs/559158.pem"
I0927 01:38:39.478048 756367 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/559158.pem
I0927 01:38:39.482154 756367 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Sep 27 00:53 /usr/share/ca-certificates/559158.pem
I0927 01:38:39.482250 756367 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/559158.pem
I0927 01:38:39.489813 756367 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/559158.pem /etc/ssl/certs/51391683.0"
I0927 01:38:39.500033 756367 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/5591582.pem && ln -fs /usr/share/ca-certificates/5591582.pem /etc/ssl/certs/5591582.pem"
I0927 01:38:39.510090 756367 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/5591582.pem
I0927 01:38:39.514132 756367 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Sep 27 00:53 /usr/share/ca-certificates/5591582.pem
I0927 01:38:39.514228 756367 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/5591582.pem
I0927 01:38:39.521610 756367 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/5591582.pem /etc/ssl/certs/3ec20f2e.0"
I0927 01:38:39.532164 756367 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0927 01:38:39.546657 756367 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0927 01:38:39.550990 756367 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Sep 27 00:34 /usr/share/ca-certificates/minikubeCA.pem
I0927 01:38:39.551107 756367 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0927 01:38:39.558286 756367 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0927 01:38:39.568014 756367 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0927 01:38:39.572326 756367 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-etcd-client.crt -checkend 86400
I0927 01:38:39.579767 756367 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-kubelet-client.crt -checkend 86400
I0927 01:38:39.587174 756367 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/server.crt -checkend 86400
I0927 01:38:39.594384 756367 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/healthcheck-client.crt -checkend 86400
I0927 01:38:39.601799 756367 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/peer.crt -checkend 86400
I0927 01:38:39.609144 756367 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/front-proxy-client.crt -checkend 86400
I0927 01:38:39.618881 756367 kubeadm.go:392] StartCluster: {Name:old-k8s-version-745133 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-745133 Namespace:default APIServerHAVIP: APIServerName:minikube
CA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/m
inikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0927 01:38:39.619000 756367 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I0927 01:38:39.619073 756367 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0927 01:38:39.689800 756367 cri.go:89] found id: ""
I0927 01:38:39.689878 756367 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0927 01:38:39.699548 756367 kubeadm.go:408] found existing configuration files, will attempt cluster restart
I0927 01:38:39.699570 756367 kubeadm.go:593] restartPrimaryControlPlane start ...
I0927 01:38:39.699635 756367 ssh_runner.go:195] Run: sudo test -d /data/minikube
I0927 01:38:39.708367 756367 kubeadm.go:130] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1
stdout:
stderr:
I0927 01:38:39.708855 756367 kubeconfig.go:47] verify endpoint returned: get endpoint: "old-k8s-version-745133" does not appear in /home/jenkins/minikube-integration/19711-553751/kubeconfig
I0927 01:38:39.708975 756367 kubeconfig.go:62] /home/jenkins/minikube-integration/19711-553751/kubeconfig needs updating (will repair): [kubeconfig missing "old-k8s-version-745133" cluster setting kubeconfig missing "old-k8s-version-745133" context setting]
I0927 01:38:39.709281 756367 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19711-553751/kubeconfig: {Name:mkc30ade55bf966f83b95c0af3746bfadfd3f379 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0927 01:38:39.711093 756367 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new
I0927 01:38:39.720052 756367 kubeadm.go:630] The running cluster does not require reconfiguration: 192.168.76.2
I0927 01:38:39.720087 756367 kubeadm.go:597] duration metric: took 20.510233ms to restartPrimaryControlPlane
I0927 01:38:39.720117 756367 kubeadm.go:394] duration metric: took 101.251649ms to StartCluster
I0927 01:38:39.720133 756367 settings.go:142] acquiring lock: {Name:mk5b1f005001018637d448709269193603885722 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0927 01:38:39.720196 756367 settings.go:150] Updating kubeconfig: /home/jenkins/minikube-integration/19711-553751/kubeconfig
I0927 01:38:39.720882 756367 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19711-553751/kubeconfig: {Name:mkc30ade55bf966f83b95c0af3746bfadfd3f379 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0927 01:38:39.721102 756367 start.go:235] Will wait 6m0s for node &{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}
I0927 01:38:39.721508 756367 config.go:182] Loaded profile config "old-k8s-version-745133": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.20.0
I0927 01:38:39.721508 756367 addons.go:507] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:true default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false]
I0927 01:38:39.721628 756367 addons.go:69] Setting storage-provisioner=true in profile "old-k8s-version-745133"
I0927 01:38:39.721647 756367 addons.go:234] Setting addon storage-provisioner=true in "old-k8s-version-745133"
W0927 01:38:39.721654 756367 addons.go:243] addon storage-provisioner should already be in state true
I0927 01:38:39.721684 756367 host.go:66] Checking if "old-k8s-version-745133" exists ...
I0927 01:38:39.721702 756367 addons.go:69] Setting default-storageclass=true in profile "old-k8s-version-745133"
I0927 01:38:39.721720 756367 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "old-k8s-version-745133"
I0927 01:38:39.722045 756367 cli_runner.go:164] Run: docker container inspect old-k8s-version-745133 --format={{.State.Status}}
I0927 01:38:39.722158 756367 cli_runner.go:164] Run: docker container inspect old-k8s-version-745133 --format={{.State.Status}}
I0927 01:38:39.722666 756367 addons.go:69] Setting dashboard=true in profile "old-k8s-version-745133"
I0927 01:38:39.722691 756367 addons.go:234] Setting addon dashboard=true in "old-k8s-version-745133"
W0927 01:38:39.722700 756367 addons.go:243] addon dashboard should already be in state true
I0927 01:38:39.722733 756367 host.go:66] Checking if "old-k8s-version-745133" exists ...
I0927 01:38:39.723262 756367 cli_runner.go:164] Run: docker container inspect old-k8s-version-745133 --format={{.State.Status}}
I0927 01:38:39.726129 756367 out.go:177] * Verifying Kubernetes components...
I0927 01:38:39.726408 756367 addons.go:69] Setting metrics-server=true in profile "old-k8s-version-745133"
I0927 01:38:39.726437 756367 addons.go:234] Setting addon metrics-server=true in "old-k8s-version-745133"
W0927 01:38:39.726445 756367 addons.go:243] addon metrics-server should already be in state true
I0927 01:38:39.726475 756367 host.go:66] Checking if "old-k8s-version-745133" exists ...
I0927 01:38:39.727887 756367 cli_runner.go:164] Run: docker container inspect old-k8s-version-745133 --format={{.State.Status}}
I0927 01:38:39.730898 756367 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0927 01:38:39.790349 756367 addons.go:234] Setting addon default-storageclass=true in "old-k8s-version-745133"
W0927 01:38:39.790372 756367 addons.go:243] addon default-storageclass should already be in state true
I0927 01:38:39.790398 756367 host.go:66] Checking if "old-k8s-version-745133" exists ...
I0927 01:38:39.794258 756367 cli_runner.go:164] Run: docker container inspect old-k8s-version-745133 --format={{.State.Status}}
I0927 01:38:39.804273 756367 out.go:177] - Using image docker.io/kubernetesui/dashboard:v2.7.0
I0927 01:38:39.804355 756367 out.go:177] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
I0927 01:38:39.805439 756367 out.go:177] - Using image registry.k8s.io/echoserver:1.4
I0927 01:38:39.805637 756367 addons.go:431] installing /etc/kubernetes/addons/storage-provisioner.yaml
I0927 01:38:39.805651 756367 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I0927 01:38:39.805711 756367 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-745133
I0927 01:38:39.806923 756367 addons.go:431] installing /etc/kubernetes/addons/dashboard-ns.yaml
I0927 01:38:39.806943 756367 ssh_runner.go:362] scp dashboard/dashboard-ns.yaml --> /etc/kubernetes/addons/dashboard-ns.yaml (759 bytes)
I0927 01:38:39.807004 756367 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-745133
I0927 01:38:39.818549 756367 out.go:177] - Using image fake.domain/registry.k8s.io/echoserver:1.4
I0927 01:38:39.823700 756367 addons.go:431] installing /etc/kubernetes/addons/metrics-apiservice.yaml
I0927 01:38:39.823728 756367 ssh_runner.go:362] scp metrics-server/metrics-apiservice.yaml --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)
I0927 01:38:39.823809 756367 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-745133
I0927 01:38:39.840518 756367 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33791 SSHKeyPath:/home/jenkins/minikube-integration/19711-553751/.minikube/machines/old-k8s-version-745133/id_rsa Username:docker}
I0927 01:38:39.866377 756367 addons.go:431] installing /etc/kubernetes/addons/storageclass.yaml
I0927 01:38:39.866401 756367 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I0927 01:38:39.866493 756367 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-745133
I0927 01:38:39.880465 756367 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33791 SSHKeyPath:/home/jenkins/minikube-integration/19711-553751/.minikube/machines/old-k8s-version-745133/id_rsa Username:docker}
I0927 01:38:39.886412 756367 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33791 SSHKeyPath:/home/jenkins/minikube-integration/19711-553751/.minikube/machines/old-k8s-version-745133/id_rsa Username:docker}
I0927 01:38:39.922810 756367 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33791 SSHKeyPath:/home/jenkins/minikube-integration/19711-553751/.minikube/machines/old-k8s-version-745133/id_rsa Username:docker}
I0927 01:38:39.985055 756367 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0927 01:38:40.003210 756367 node_ready.go:35] waiting up to 6m0s for node "old-k8s-version-745133" to be "Ready" ...
I0927 01:38:40.057844 756367 addons.go:431] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
I0927 01:38:40.057867 756367 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1825 bytes)
I0927 01:38:40.089867 756367 addons.go:431] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
I0927 01:38:40.089890 756367 ssh_runner.go:362] scp metrics-server/metrics-server-rbac.yaml --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)
I0927 01:38:40.107223 756367 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I0927 01:38:40.126433 756367 addons.go:431] installing /etc/kubernetes/addons/dashboard-clusterrole.yaml
I0927 01:38:40.126513 756367 ssh_runner.go:362] scp dashboard/dashboard-clusterrole.yaml --> /etc/kubernetes/addons/dashboard-clusterrole.yaml (1001 bytes)
I0927 01:38:40.144487 756367 addons.go:431] installing /etc/kubernetes/addons/metrics-server-service.yaml
I0927 01:38:40.144563 756367 ssh_runner.go:362] scp metrics-server/metrics-server-service.yaml --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)
I0927 01:38:40.161822 756367 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
I0927 01:38:40.225678 756367 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0927 01:38:40.243230 756367 addons.go:431] installing /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml
I0927 01:38:40.243307 756367 ssh_runner.go:362] scp dashboard/dashboard-clusterrolebinding.yaml --> /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml (1018 bytes)
I0927 01:38:40.390524 756367 addons.go:431] installing /etc/kubernetes/addons/dashboard-configmap.yaml
I0927 01:38:40.390599 756367 ssh_runner.go:362] scp dashboard/dashboard-configmap.yaml --> /etc/kubernetes/addons/dashboard-configmap.yaml (837 bytes)
W0927 01:38:40.427455 756367 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0927 01:38:40.427604 756367 retry.go:31] will retry after 212.02116ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0927 01:38:40.483903 756367 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0927 01:38:40.483981 756367 retry.go:31] will retry after 253.279228ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0927 01:38:40.488592 756367 addons.go:431] installing /etc/kubernetes/addons/dashboard-dp.yaml
I0927 01:38:40.488668 756367 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-dp.yaml (4201 bytes)
W0927 01:38:40.535237 756367 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0927 01:38:40.535319 756367 retry.go:31] will retry after 332.013907ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0927 01:38:40.548411 756367 addons.go:431] installing /etc/kubernetes/addons/dashboard-role.yaml
I0927 01:38:40.548490 756367 ssh_runner.go:362] scp dashboard/dashboard-role.yaml --> /etc/kubernetes/addons/dashboard-role.yaml (1724 bytes)
I0927 01:38:40.566752 756367 addons.go:431] installing /etc/kubernetes/addons/dashboard-rolebinding.yaml
I0927 01:38:40.566779 756367 ssh_runner.go:362] scp dashboard/dashboard-rolebinding.yaml --> /etc/kubernetes/addons/dashboard-rolebinding.yaml (1046 bytes)
I0927 01:38:40.588997 756367 addons.go:431] installing /etc/kubernetes/addons/dashboard-sa.yaml
I0927 01:38:40.589020 756367 ssh_runner.go:362] scp dashboard/dashboard-sa.yaml --> /etc/kubernetes/addons/dashboard-sa.yaml (837 bytes)
I0927 01:38:40.608532 756367 addons.go:431] installing /etc/kubernetes/addons/dashboard-secret.yaml
I0927 01:38:40.608557 756367 ssh_runner.go:362] scp dashboard/dashboard-secret.yaml --> /etc/kubernetes/addons/dashboard-secret.yaml (1389 bytes)
I0927 01:38:40.625938 756367 addons.go:431] installing /etc/kubernetes/addons/dashboard-svc.yaml
I0927 01:38:40.625964 756367 ssh_runner.go:362] scp dashboard/dashboard-svc.yaml --> /etc/kubernetes/addons/dashboard-svc.yaml (1294 bytes)
I0927 01:38:40.640081 756367 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
I0927 01:38:40.649208 756367 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
I0927 01:38:40.738401 756367 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W0927 01:38:40.829360 756367 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0927 01:38:40.829393 756367 retry.go:31] will retry after 235.98769ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0927 01:38:40.862769 756367 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0927 01:38:40.862803 756367 retry.go:31] will retry after 198.388278ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0927 01:38:40.868106 756367 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W0927 01:38:40.956412 756367 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0927 01:38:40.956447 756367 retry.go:31] will retry after 271.48785ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0927 01:38:41.022512 756367 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0927 01:38:41.022544 756367 retry.go:31] will retry after 324.210146ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0927 01:38:41.061843 756367 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
I0927 01:38:41.066141 756367 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
I0927 01:38:41.228450 756367 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W0927 01:38:41.275769 756367 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0927 01:38:41.275804 756367 retry.go:31] will retry after 357.305087ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0927 01:38:41.320398 756367 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0927 01:38:41.320433 756367 retry.go:31] will retry after 403.721821ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0927 01:38:41.347460 756367 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W0927 01:38:41.351011 756367 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0927 01:38:41.351039 756367 retry.go:31] will retry after 769.072146ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0927 01:38:41.449718 756367 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0927 01:38:41.449753 756367 retry.go:31] will retry after 699.483002ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0927 01:38:41.633714 756367 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0927 01:38:41.712477 756367 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0927 01:38:41.712561 756367 retry.go:31] will retry after 458.98365ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0927 01:38:41.724664 756367 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W0927 01:38:41.826725 756367 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0927 01:38:41.826808 756367 retry.go:31] will retry after 778.663686ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0927 01:38:42.004412 756367 node_ready.go:53] error getting node "old-k8s-version-745133": Get "https://192.168.76.2:8443/api/v1/nodes/old-k8s-version-745133": dial tcp 192.168.76.2:8443: connect: connection refused
I0927 01:38:42.120829 756367 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
I0927 01:38:42.149549 756367 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0927 01:38:42.172420 756367 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0927 01:38:42.348127 756367 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0927 01:38:42.348191 756367 retry.go:31] will retry after 829.830672ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0927 01:38:42.411576 756367 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0927 01:38:42.411634 756367 retry.go:31] will retry after 1.239024863s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0927 01:38:42.440968 756367 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0927 01:38:42.441013 756367 retry.go:31] will retry after 551.484749ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0927 01:38:42.605871 756367 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W0927 01:38:42.705900 756367 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0927 01:38:42.705935 756367 retry.go:31] will retry after 1.03805135s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0927 01:38:42.993542 756367 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0927 01:38:43.098373 756367 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0927 01:38:43.098417 756367 retry.go:31] will retry after 991.478041ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0927 01:38:43.178768 756367 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W0927 01:38:43.277045 756367 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0927 01:38:43.277130 756367 retry.go:31] will retry after 677.52818ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0927 01:38:43.651253 756367 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W0927 01:38:43.742670 756367 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0927 01:38:43.742709 756367 retry.go:31] will retry after 1.714090062s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0927 01:38:43.744979 756367 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W0927 01:38:43.846334 756367 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0927 01:38:43.846366 756367 retry.go:31] will retry after 2.639690146s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0927 01:38:43.955677 756367 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W0927 01:38:44.046124 756367 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0927 01:38:44.046210 756367 retry.go:31] will retry after 2.129902463s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0927 01:38:44.090450 756367 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0927 01:38:44.190771 756367 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0927 01:38:44.190852 756367 retry.go:31] will retry after 1.912602745s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0927 01:38:44.504822 756367 node_ready.go:53] error getting node "old-k8s-version-745133": Get "https://192.168.76.2:8443/api/v1/nodes/old-k8s-version-745133": dial tcp 192.168.76.2:8443: connect: connection refused
I0927 01:38:45.457714 756367 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W0927 01:38:45.573824 756367 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0927 01:38:45.573860 756367 retry.go:31] will retry after 2.755861707s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0927 01:38:46.104536 756367 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
I0927 01:38:46.177128 756367 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W0927 01:38:46.226609 756367 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0927 01:38:46.226640 756367 retry.go:31] will retry after 2.664547288s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0927 01:38:46.333171 756367 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0927 01:38:46.333209 756367 retry.go:31] will retry after 3.34269917s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0927 01:38:46.486597 756367 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W0927 01:38:46.586568 756367 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0927 01:38:46.586598 756367 retry.go:31] will retry after 3.343825659s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0927 01:38:47.004486 756367 node_ready.go:53] error getting node "old-k8s-version-745133": Get "https://192.168.76.2:8443/api/v1/nodes/old-k8s-version-745133": dial tcp 192.168.76.2:8443: connect: connection refused
I0927 01:38:48.330549 756367 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W0927 01:38:48.535048 756367 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0927 01:38:48.535083 756367 retry.go:31] will retry after 4.072773211s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0927 01:38:48.891435 756367 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
I0927 01:38:49.676739 756367 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
I0927 01:38:49.931312 756367 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
I0927 01:38:52.608682 756367 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0927 01:38:59.004610 756367 node_ready.go:53] error getting node "old-k8s-version-745133": Get "https://192.168.76.2:8443/api/v1/nodes/old-k8s-version-745133": net/http: TLS handshake timeout
I0927 01:38:59.068286 756367 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: (10.176800119s)
W0927 01:38:59.068341 756367 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
Unable to connect to the server: net/http: TLS handshake timeout
I0927 01:38:59.068360 756367 retry.go:31] will retry after 3.419371875s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
Unable to connect to the server: net/http: TLS handshake timeout
I0927 01:38:59.911914 756367 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: (10.235130517s)
W0927 01:38:59.911949 756367 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
Unable to connect to the server: net/http: TLS handshake timeout
I0927 01:38:59.911967 756367 retry.go:31] will retry after 3.332826058s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
Unable to connect to the server: net/http: TLS handshake timeout
I0927 01:39:00.337705 756367 node_ready.go:49] node "old-k8s-version-745133" has status "Ready":"True"
I0927 01:39:00.337734 756367 node_ready.go:38] duration metric: took 20.334478894s for node "old-k8s-version-745133" to be "Ready" ...
I0927 01:39:00.337746 756367 pod_ready.go:36] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0927 01:39:00.465149 756367 pod_ready.go:79] waiting up to 6m0s for pod "coredns-74ff55c5b-drjjb" in "kube-system" namespace to be "Ready" ...
I0927 01:39:00.740815 756367 pod_ready.go:93] pod "coredns-74ff55c5b-drjjb" in "kube-system" namespace has status "Ready":"True"
I0927 01:39:00.740841 756367 pod_ready.go:82] duration metric: took 269.275814ms for pod "coredns-74ff55c5b-drjjb" in "kube-system" namespace to be "Ready" ...
I0927 01:39:00.740853 756367 pod_ready.go:79] waiting up to 6m0s for pod "etcd-old-k8s-version-745133" in "kube-system" namespace to be "Ready" ...
I0927 01:39:00.892454 756367 pod_ready.go:93] pod "etcd-old-k8s-version-745133" in "kube-system" namespace has status "Ready":"True"
I0927 01:39:00.892525 756367 pod_ready.go:82] duration metric: took 151.66317ms for pod "etcd-old-k8s-version-745133" in "kube-system" namespace to be "Ready" ...
I0927 01:39:00.892555 756367 pod_ready.go:79] waiting up to 6m0s for pod "kube-apiserver-old-k8s-version-745133" in "kube-system" namespace to be "Ready" ...
I0927 01:39:00.981964 756367 pod_ready.go:93] pod "kube-apiserver-old-k8s-version-745133" in "kube-system" namespace has status "Ready":"True"
I0927 01:39:00.982037 756367 pod_ready.go:82] duration metric: took 89.459529ms for pod "kube-apiserver-old-k8s-version-745133" in "kube-system" namespace to be "Ready" ...
I0927 01:39:00.982080 756367 pod_ready.go:79] waiting up to 6m0s for pod "kube-controller-manager-old-k8s-version-745133" in "kube-system" namespace to be "Ready" ...
I0927 01:39:01.042886 756367 pod_ready.go:93] pod "kube-controller-manager-old-k8s-version-745133" in "kube-system" namespace has status "Ready":"True"
I0927 01:39:01.042962 756367 pod_ready.go:82] duration metric: took 60.854904ms for pod "kube-controller-manager-old-k8s-version-745133" in "kube-system" namespace to be "Ready" ...
I0927 01:39:01.043008 756367 pod_ready.go:79] waiting up to 6m0s for pod "kube-proxy-tvwdl" in "kube-system" namespace to be "Ready" ...
I0927 01:39:01.050840 756367 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: (11.119480907s)
I0927 01:39:01.114774 756367 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (8.506040947s)
I0927 01:39:01.114812 756367 addons.go:475] Verifying addon metrics-server=true in "old-k8s-version-745133"
I0927 01:39:02.487944 756367 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
I0927 01:39:03.080642 756367 pod_ready.go:103] pod "kube-proxy-tvwdl" in "kube-system" namespace has status "Ready":"False"
I0927 01:39:03.245473 756367 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
I0927 01:39:03.437236 756367 out.go:177] * Some dashboard features require the metrics-server addon. To enable all features please run:
minikube -p old-k8s-version-745133 addons enable metrics-server
I0927 01:39:03.588531 756367 out.go:177] * Enabled addons: storage-provisioner, metrics-server, dashboard, default-storageclass
I0927 01:39:03.590023 756367 addons.go:510] duration metric: took 23.868514437s for enable addons: enabled=[storage-provisioner metrics-server dashboard default-storageclass]
I0927 01:39:05.549293 756367 pod_ready.go:103] pod "kube-proxy-tvwdl" in "kube-system" namespace has status "Ready":"False"
I0927 01:39:07.049982 756367 pod_ready.go:93] pod "kube-proxy-tvwdl" in "kube-system" namespace has status "Ready":"True"
I0927 01:39:07.050053 756367 pod_ready.go:82] duration metric: took 6.007021862s for pod "kube-proxy-tvwdl" in "kube-system" namespace to be "Ready" ...
I0927 01:39:07.050081 756367 pod_ready.go:79] waiting up to 6m0s for pod "kube-scheduler-old-k8s-version-745133" in "kube-system" namespace to be "Ready" ...
I0927 01:39:09.059247 756367 pod_ready.go:103] pod "kube-scheduler-old-k8s-version-745133" in "kube-system" namespace has status "Ready":"False"
I0927 01:39:11.556193 756367 pod_ready.go:103] pod "kube-scheduler-old-k8s-version-745133" in "kube-system" namespace has status "Ready":"False"
I0927 01:39:13.556461 756367 pod_ready.go:103] pod "kube-scheduler-old-k8s-version-745133" in "kube-system" namespace has status "Ready":"False"
I0927 01:39:16.055723 756367 pod_ready.go:103] pod "kube-scheduler-old-k8s-version-745133" in "kube-system" namespace has status "Ready":"False"
I0927 01:39:18.057179 756367 pod_ready.go:103] pod "kube-scheduler-old-k8s-version-745133" in "kube-system" namespace has status "Ready":"False"
I0927 01:39:20.556931 756367 pod_ready.go:103] pod "kube-scheduler-old-k8s-version-745133" in "kube-system" namespace has status "Ready":"False"
I0927 01:39:22.562282 756367 pod_ready.go:103] pod "kube-scheduler-old-k8s-version-745133" in "kube-system" namespace has status "Ready":"False"
I0927 01:39:24.594163 756367 pod_ready.go:103] pod "kube-scheduler-old-k8s-version-745133" in "kube-system" namespace has status "Ready":"False"
I0927 01:39:27.063292 756367 pod_ready.go:103] pod "kube-scheduler-old-k8s-version-745133" in "kube-system" namespace has status "Ready":"False"
I0927 01:39:29.557030 756367 pod_ready.go:103] pod "kube-scheduler-old-k8s-version-745133" in "kube-system" namespace has status "Ready":"False"
I0927 01:39:32.056756 756367 pod_ready.go:103] pod "kube-scheduler-old-k8s-version-745133" in "kube-system" namespace has status "Ready":"False"
I0927 01:39:34.057336 756367 pod_ready.go:103] pod "kube-scheduler-old-k8s-version-745133" in "kube-system" namespace has status "Ready":"False"
I0927 01:39:36.058518 756367 pod_ready.go:103] pod "kube-scheduler-old-k8s-version-745133" in "kube-system" namespace has status "Ready":"False"
I0927 01:39:38.566951 756367 pod_ready.go:103] pod "kube-scheduler-old-k8s-version-745133" in "kube-system" namespace has status "Ready":"False"
I0927 01:39:41.056553 756367 pod_ready.go:103] pod "kube-scheduler-old-k8s-version-745133" in "kube-system" namespace has status "Ready":"False"
I0927 01:39:43.556559 756367 pod_ready.go:103] pod "kube-scheduler-old-k8s-version-745133" in "kube-system" namespace has status "Ready":"False"
I0927 01:39:46.056610 756367 pod_ready.go:103] pod "kube-scheduler-old-k8s-version-745133" in "kube-system" namespace has status "Ready":"False"
I0927 01:39:48.060648 756367 pod_ready.go:103] pod "kube-scheduler-old-k8s-version-745133" in "kube-system" namespace has status "Ready":"False"
I0927 01:39:50.067560 756367 pod_ready.go:103] pod "kube-scheduler-old-k8s-version-745133" in "kube-system" namespace has status "Ready":"False"
I0927 01:39:52.556434 756367 pod_ready.go:103] pod "kube-scheduler-old-k8s-version-745133" in "kube-system" namespace has status "Ready":"False"
I0927 01:39:55.057924 756367 pod_ready.go:103] pod "kube-scheduler-old-k8s-version-745133" in "kube-system" namespace has status "Ready":"False"
I0927 01:39:57.059910 756367 pod_ready.go:103] pod "kube-scheduler-old-k8s-version-745133" in "kube-system" namespace has status "Ready":"False"
I0927 01:39:59.557115 756367 pod_ready.go:103] pod "kube-scheduler-old-k8s-version-745133" in "kube-system" namespace has status "Ready":"False"
I0927 01:40:01.557789 756367 pod_ready.go:103] pod "kube-scheduler-old-k8s-version-745133" in "kube-system" namespace has status "Ready":"False"
I0927 01:40:03.559923 756367 pod_ready.go:103] pod "kube-scheduler-old-k8s-version-745133" in "kube-system" namespace has status "Ready":"False"
I0927 01:40:06.056636 756367 pod_ready.go:103] pod "kube-scheduler-old-k8s-version-745133" in "kube-system" namespace has status "Ready":"False"
I0927 01:40:08.057346 756367 pod_ready.go:103] pod "kube-scheduler-old-k8s-version-745133" in "kube-system" namespace has status "Ready":"False"
I0927 01:40:10.556242 756367 pod_ready.go:103] pod "kube-scheduler-old-k8s-version-745133" in "kube-system" namespace has status "Ready":"False"
I0927 01:40:12.556352 756367 pod_ready.go:103] pod "kube-scheduler-old-k8s-version-745133" in "kube-system" namespace has status "Ready":"False"
I0927 01:40:14.556505 756367 pod_ready.go:103] pod "kube-scheduler-old-k8s-version-745133" in "kube-system" namespace has status "Ready":"False"
I0927 01:40:16.558035 756367 pod_ready.go:103] pod "kube-scheduler-old-k8s-version-745133" in "kube-system" namespace has status "Ready":"False"
I0927 01:40:19.057804 756367 pod_ready.go:103] pod "kube-scheduler-old-k8s-version-745133" in "kube-system" namespace has status "Ready":"False"
I0927 01:40:21.556571 756367 pod_ready.go:103] pod "kube-scheduler-old-k8s-version-745133" in "kube-system" namespace has status "Ready":"False"
I0927 01:40:23.556806 756367 pod_ready.go:103] pod "kube-scheduler-old-k8s-version-745133" in "kube-system" namespace has status "Ready":"False"
I0927 01:40:26.056770 756367 pod_ready.go:103] pod "kube-scheduler-old-k8s-version-745133" in "kube-system" namespace has status "Ready":"False"
I0927 01:40:27.057249 756367 pod_ready.go:93] pod "kube-scheduler-old-k8s-version-745133" in "kube-system" namespace has status "Ready":"True"
I0927 01:40:27.057275 756367 pod_ready.go:82] duration metric: took 1m20.007171419s for pod "kube-scheduler-old-k8s-version-745133" in "kube-system" namespace to be "Ready" ...
I0927 01:40:27.057288 756367 pod_ready.go:79] waiting up to 6m0s for pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace to be "Ready" ...
I0927 01:40:29.065733 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:40:31.562875 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:40:33.563455 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:40:36.066295 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:40:38.563041 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:40:40.563941 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:40:43.064533 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:40:45.064689 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:40:47.563788 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:40:50.064619 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:40:52.563513 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:40:55.063431 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:40:57.566019 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:41:00.066276 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:41:02.563641 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:41:05.064215 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:41:07.065805 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:41:09.567334 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:41:12.063975 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:41:14.565667 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:41:17.063897 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:41:19.563290 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:41:22.064314 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:41:24.563394 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:41:27.062663 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:41:29.063595 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:41:31.562923 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:41:33.562977 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:41:36.063772 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:41:38.564170 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:41:41.063198 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:41:43.063908 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:41:45.065383 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:41:47.562925 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:41:49.564236 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:41:52.063522 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:41:54.064108 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:41:56.563250 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:41:58.564317 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:42:01.063874 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:42:03.562812 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:42:05.563181 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:42:07.563458 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:42:09.568052 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:42:12.064418 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:42:14.563145 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:42:17.064115 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:42:19.562933 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:42:21.563168 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:42:24.063568 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:42:26.064593 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:42:28.562897 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:42:30.562960 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:42:32.564141 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:42:35.063810 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:42:37.563916 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:42:40.063850 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:42:42.562665 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:42:44.563377 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:42:46.563810 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:42:49.064093 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:42:51.563284 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:42:53.563544 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:42:56.063585 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:42:58.068026 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:43:00.088088 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:43:02.124730 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:43:04.563544 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:43:06.564100 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:43:09.064077 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:43:11.064151 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:43:13.563466 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:43:16.063615 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:43:18.066965 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:43:20.069711 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:43:22.563100 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:43:24.563528 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:43:27.063842 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:43:29.064098 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:43:31.064496 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:43:33.564366 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:43:36.063123 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:43:38.063760 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:43:40.063959 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:43:42.564001 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:43:44.564177 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:43:47.063513 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:43:49.063777 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:43:51.064340 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:43:53.064600 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:43:55.564332 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:43:58.064170 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:44:00.065226 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:44:02.563727 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:44:04.564509 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:44:07.064530 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:44:09.563994 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:44:12.063999 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:44:14.563247 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:44:16.589478 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:44:19.064551 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:44:21.563101 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:44:23.563795 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:44:25.564112 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:44:27.057365 756367 pod_ready.go:82] duration metric: took 4m0.000050103s for pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace to be "Ready" ...
E0927 01:44:27.057440 756367 pod_ready.go:67] WaitExtra: waitPodCondition: context deadline exceeded
I0927 01:44:27.057470 756367 pod_ready.go:39] duration metric: took 5m26.719711701s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0927 01:44:27.057518 756367 api_server.go:52] waiting for apiserver process to appear ...
I0927 01:44:27.057586 756367 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I0927 01:44:27.057674 756367 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0927 01:44:27.114452 756367 cri.go:89] found id: "728631fe1253bab9992c7a58f88fca5a34491a3d06d1a6601e0e70566e7d10f4"
I0927 01:44:27.114473 756367 cri.go:89] found id: ""
I0927 01:44:27.114482 756367 logs.go:276] 1 containers: [728631fe1253bab9992c7a58f88fca5a34491a3d06d1a6601e0e70566e7d10f4]
I0927 01:44:27.114537 756367 ssh_runner.go:195] Run: which crictl
I0927 01:44:27.120741 756367 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I0927 01:44:27.120814 756367 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0927 01:44:27.166103 756367 cri.go:89] found id: "fbfae056e26dd1b15e6b109b732296bcb89c5db7fabc0f8958574a0fc1248e81"
I0927 01:44:27.166124 756367 cri.go:89] found id: ""
I0927 01:44:27.166132 756367 logs.go:276] 1 containers: [fbfae056e26dd1b15e6b109b732296bcb89c5db7fabc0f8958574a0fc1248e81]
I0927 01:44:27.166190 756367 ssh_runner.go:195] Run: which crictl
I0927 01:44:27.172322 756367 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I0927 01:44:27.172395 756367 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0927 01:44:27.223120 756367 cri.go:89] found id: "6a28aab70700044c53668d4eceed46b67fba50e2d134c97b4c5cdd9f83c81e4a"
I0927 01:44:27.223140 756367 cri.go:89] found id: ""
I0927 01:44:27.223148 756367 logs.go:276] 1 containers: [6a28aab70700044c53668d4eceed46b67fba50e2d134c97b4c5cdd9f83c81e4a]
I0927 01:44:27.223201 756367 ssh_runner.go:195] Run: which crictl
I0927 01:44:27.227267 756367 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I0927 01:44:27.227386 756367 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0927 01:44:27.286086 756367 cri.go:89] found id: "1399d95796260c7e27b7a91a70576c5a3e3bfcfee9fb91839ddfe1b01c5114c0"
I0927 01:44:27.286147 756367 cri.go:89] found id: ""
I0927 01:44:27.286169 756367 logs.go:276] 1 containers: [1399d95796260c7e27b7a91a70576c5a3e3bfcfee9fb91839ddfe1b01c5114c0]
I0927 01:44:27.286259 756367 ssh_runner.go:195] Run: which crictl
I0927 01:44:27.290363 756367 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I0927 01:44:27.290479 756367 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0927 01:44:27.347335 756367 cri.go:89] found id: "1f91c6f77f281dbe05880609e73acc353cb7ee468afa455c7d22c45e9428661e"
I0927 01:44:27.347409 756367 cri.go:89] found id: ""
I0927 01:44:27.347440 756367 logs.go:276] 1 containers: [1f91c6f77f281dbe05880609e73acc353cb7ee468afa455c7d22c45e9428661e]
I0927 01:44:27.347530 756367 ssh_runner.go:195] Run: which crictl
I0927 01:44:27.380567 756367 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I0927 01:44:27.380651 756367 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0927 01:44:27.427366 756367 cri.go:89] found id: "fd21817034d06ff8ec30b1fa5089ddfd190af71c8dfdcde0d32fd61181caafaa"
I0927 01:44:27.427387 756367 cri.go:89] found id: ""
I0927 01:44:27.427395 756367 logs.go:276] 1 containers: [fd21817034d06ff8ec30b1fa5089ddfd190af71c8dfdcde0d32fd61181caafaa]
I0927 01:44:27.427452 756367 ssh_runner.go:195] Run: which crictl
I0927 01:44:27.433497 756367 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I0927 01:44:27.433617 756367 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0927 01:44:27.485055 756367 cri.go:89] found id: "f74f5a74223b633c3ca99ac7465604311677c0c0b43adeacf4843a7ade66ca48"
I0927 01:44:27.485130 756367 cri.go:89] found id: ""
I0927 01:44:27.485154 756367 logs.go:276] 1 containers: [f74f5a74223b633c3ca99ac7465604311677c0c0b43adeacf4843a7ade66ca48]
I0927 01:44:27.485247 756367 ssh_runner.go:195] Run: which crictl
I0927 01:44:27.489063 756367 cri.go:54] listing CRI containers in root : {State:all Name:kubernetes-dashboard Namespaces:[]}
I0927 01:44:27.489133 756367 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
I0927 01:44:27.547438 756367 cri.go:89] found id: "7a82c31e2981413dba52726ae93a9b6786429d4055c821906975f6a58bb6787c"
I0927 01:44:27.547463 756367 cri.go:89] found id: ""
I0927 01:44:27.547471 756367 logs.go:276] 1 containers: [7a82c31e2981413dba52726ae93a9b6786429d4055c821906975f6a58bb6787c]
I0927 01:44:27.547523 756367 ssh_runner.go:195] Run: which crictl
I0927 01:44:27.551928 756367 cri.go:54] listing CRI containers in root : {State:all Name:storage-provisioner Namespaces:[]}
I0927 01:44:27.551996 756367 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
I0927 01:44:27.598982 756367 cri.go:89] found id: "138c41837cf0bbda88ce0b41c3d306956ef57ff9c2cb680fa71af1f16e609832"
I0927 01:44:27.599002 756367 cri.go:89] found id: ""
I0927 01:44:27.599009 756367 logs.go:276] 1 containers: [138c41837cf0bbda88ce0b41c3d306956ef57ff9c2cb680fa71af1f16e609832]
I0927 01:44:27.599063 756367 ssh_runner.go:195] Run: which crictl
I0927 01:44:27.609032 756367 logs.go:123] Gathering logs for kubelet ...
I0927 01:44:27.609060 756367 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
W0927 01:44:27.686472 756367 logs.go:138] Found kubelet problem: Sep 27 01:39:00 old-k8s-version-745133 kubelet[736]: E0927 01:39:00.276608 736 reflector.go:138] object-"kube-system"/"coredns": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "coredns" is forbidden: User "system:node:old-k8s-version-745133" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-745133' and this object
W0927 01:44:27.686776 756367 logs.go:138] Found kubelet problem: Sep 27 01:39:00 old-k8s-version-745133 kubelet[736]: E0927 01:39:00.277156 736 reflector.go:138] object-"kube-system"/"kube-proxy-token-mdl25": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kube-proxy-token-mdl25" is forbidden: User "system:node:old-k8s-version-745133" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-745133' and this object
W0927 01:44:27.687011 756367 logs.go:138] Found kubelet problem: Sep 27 01:39:00 old-k8s-version-745133 kubelet[736]: E0927 01:39:00.277414 736 reflector.go:138] object-"kube-system"/"kube-proxy": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-proxy" is forbidden: User "system:node:old-k8s-version-745133" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-745133' and this object
W0927 01:44:27.687250 756367 logs.go:138] Found kubelet problem: Sep 27 01:39:00 old-k8s-version-745133 kubelet[736]: E0927 01:39:00.277602 736 reflector.go:138] object-"kube-system"/"kindnet-token-jwlc6": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kindnet-token-jwlc6" is forbidden: User "system:node:old-k8s-version-745133" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-745133' and this object
W0927 01:44:27.687495 756367 logs.go:138] Found kubelet problem: Sep 27 01:39:00 old-k8s-version-745133 kubelet[736]: E0927 01:39:00.277796 736 reflector.go:138] object-"kube-system"/"coredns-token-k4cmv": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "coredns-token-k4cmv" is forbidden: User "system:node:old-k8s-version-745133" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-745133' and this object
W0927 01:44:27.687749 756367 logs.go:138] Found kubelet problem: Sep 27 01:39:00 old-k8s-version-745133 kubelet[736]: E0927 01:39:00.277995 736 reflector.go:138] object-"kube-system"/"storage-provisioner-token-tgp2f": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "storage-provisioner-token-tgp2f" is forbidden: User "system:node:old-k8s-version-745133" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-745133' and this object
W0927 01:44:27.687997 756367 logs.go:138] Found kubelet problem: Sep 27 01:39:00 old-k8s-version-745133 kubelet[736]: E0927 01:39:00.278201 736 reflector.go:138] object-"kube-system"/"metrics-server-token-9xfpw": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "metrics-server-token-9xfpw" is forbidden: User "system:node:old-k8s-version-745133" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-745133' and this object
W0927 01:44:27.688232 756367 logs.go:138] Found kubelet problem: Sep 27 01:39:00 old-k8s-version-745133 kubelet[736]: E0927 01:39:00.278383 736 reflector.go:138] object-"default"/"default-token-lm75v": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "default-token-lm75v" is forbidden: User "system:node:old-k8s-version-745133" cannot list resource "secrets" in API group "" in the namespace "default": no relationship found between node 'old-k8s-version-745133' and this object
W0927 01:44:27.697891 756367 logs.go:138] Found kubelet problem: Sep 27 01:39:03 old-k8s-version-745133 kubelet[736]: E0927 01:39:03.038144 736 pod_workers.go:191] Error syncing pod 249f17e8-637b-4946-8ed3-edff6860c82b ("metrics-server-9975d5f86-5bphl_kube-system(249f17e8-637b-4946-8ed3-edff6860c82b)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = pinging container registry fake.domain: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain: no such host"
W0927 01:44:27.698105 756367 logs.go:138] Found kubelet problem: Sep 27 01:39:03 old-k8s-version-745133 kubelet[736]: E0927 01:39:03.733711 736 pod_workers.go:191] Error syncing pod 249f17e8-637b-4946-8ed3-edff6860c82b ("metrics-server-9975d5f86-5bphl_kube-system(249f17e8-637b-4946-8ed3-edff6860c82b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0927 01:44:27.700305 756367 logs.go:138] Found kubelet problem: Sep 27 01:39:17 old-k8s-version-745133 kubelet[736]: E0927 01:39:17.695628 736 pod_workers.go:191] Error syncing pod 249f17e8-637b-4946-8ed3-edff6860c82b ("metrics-server-9975d5f86-5bphl_kube-system(249f17e8-637b-4946-8ed3-edff6860c82b)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = pinging container registry fake.domain: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain: no such host"
W0927 01:44:27.700757 756367 logs.go:138] Found kubelet problem: Sep 27 01:39:19 old-k8s-version-745133 kubelet[736]: E0927 01:39:19.799354 736 reflector.go:138] object-"kubernetes-dashboard"/"kubernetes-dashboard-token-hcwf2": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kubernetes-dashboard-token-hcwf2" is forbidden: User "system:node:old-k8s-version-745133" cannot list resource "secrets" in API group "" in the namespace "kubernetes-dashboard": no relationship found between node 'old-k8s-version-745133' and this object
W0927 01:44:27.703093 756367 logs.go:138] Found kubelet problem: Sep 27 01:39:28 old-k8s-version-745133 kubelet[736]: E0927 01:39:28.679675 736 pod_workers.go:191] Error syncing pod 249f17e8-637b-4946-8ed3-edff6860c82b ("metrics-server-9975d5f86-5bphl_kube-system(249f17e8-637b-4946-8ed3-edff6860c82b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0927 01:44:27.703606 756367 logs.go:138] Found kubelet problem: Sep 27 01:39:31 old-k8s-version-745133 kubelet[736]: E0927 01:39:31.971044 736 pod_workers.go:191] Error syncing pod 989e3cab-2430-4d81-91f7-b0098b27e30c ("dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"
W0927 01:44:27.704100 756367 logs.go:138] Found kubelet problem: Sep 27 01:39:32 old-k8s-version-745133 kubelet[736]: E0927 01:39:32.973106 736 pod_workers.go:191] Error syncing pod 989e3cab-2430-4d81-91f7-b0098b27e30c ("dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"
W0927 01:44:27.704469 756367 logs.go:138] Found kubelet problem: Sep 27 01:39:39 old-k8s-version-745133 kubelet[736]: E0927 01:39:39.607023 736 pod_workers.go:191] Error syncing pod 989e3cab-2430-4d81-91f7-b0098b27e30c ("dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"
W0927 01:44:27.706606 756367 logs.go:138] Found kubelet problem: Sep 27 01:39:43 old-k8s-version-745133 kubelet[736]: E0927 01:39:43.686128 736 pod_workers.go:191] Error syncing pod 249f17e8-637b-4946-8ed3-edff6860c82b ("metrics-server-9975d5f86-5bphl_kube-system(249f17e8-637b-4946-8ed3-edff6860c82b)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = pinging container registry fake.domain: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain: no such host"
W0927 01:44:27.707301 756367 logs.go:138] Found kubelet problem: Sep 27 01:39:55 old-k8s-version-745133 kubelet[736]: E0927 01:39:55.013155 736 pod_workers.go:191] Error syncing pod 989e3cab-2430-4d81-91f7-b0098b27e30c ("dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"
W0927 01:44:27.707523 756367 logs.go:138] Found kubelet problem: Sep 27 01:39:58 old-k8s-version-745133 kubelet[736]: E0927 01:39:58.675275 736 pod_workers.go:191] Error syncing pod 249f17e8-637b-4946-8ed3-edff6860c82b ("metrics-server-9975d5f86-5bphl_kube-system(249f17e8-637b-4946-8ed3-edff6860c82b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0927 01:44:27.707878 756367 logs.go:138] Found kubelet problem: Sep 27 01:39:59 old-k8s-version-745133 kubelet[736]: E0927 01:39:59.607420 736 pod_workers.go:191] Error syncing pod 989e3cab-2430-4d81-91f7-b0098b27e30c ("dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"
W0927 01:44:27.708088 756367 logs.go:138] Found kubelet problem: Sep 27 01:40:09 old-k8s-version-745133 kubelet[736]: E0927 01:40:09.675710 736 pod_workers.go:191] Error syncing pod 249f17e8-637b-4946-8ed3-edff6860c82b ("metrics-server-9975d5f86-5bphl_kube-system(249f17e8-637b-4946-8ed3-edff6860c82b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0927 01:44:27.708444 756367 logs.go:138] Found kubelet problem: Sep 27 01:40:11 old-k8s-version-745133 kubelet[736]: E0927 01:40:11.674655 736 pod_workers.go:191] Error syncing pod 989e3cab-2430-4d81-91f7-b0098b27e30c ("dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"
W0927 01:44:27.709077 756367 logs.go:138] Found kubelet problem: Sep 27 01:40:24 old-k8s-version-745133 kubelet[736]: E0927 01:40:24.053848 736 pod_workers.go:191] Error syncing pod 989e3cab-2430-4d81-91f7-b0098b27e30c ("dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"
W0927 01:44:27.711317 756367 logs.go:138] Found kubelet problem: Sep 27 01:40:24 old-k8s-version-745133 kubelet[736]: E0927 01:40:24.685441 736 pod_workers.go:191] Error syncing pod 249f17e8-637b-4946-8ed3-edff6860c82b ("metrics-server-9975d5f86-5bphl_kube-system(249f17e8-637b-4946-8ed3-edff6860c82b)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = pinging container registry fake.domain: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain: no such host"
W0927 01:44:27.711682 756367 logs.go:138] Found kubelet problem: Sep 27 01:40:29 old-k8s-version-745133 kubelet[736]: E0927 01:40:29.607048 736 pod_workers.go:191] Error syncing pod 989e3cab-2430-4d81-91f7-b0098b27e30c ("dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"
W0927 01:44:27.711894 756367 logs.go:138] Found kubelet problem: Sep 27 01:40:38 old-k8s-version-745133 kubelet[736]: E0927 01:40:38.675142 736 pod_workers.go:191] Error syncing pod 249f17e8-637b-4946-8ed3-edff6860c82b ("metrics-server-9975d5f86-5bphl_kube-system(249f17e8-637b-4946-8ed3-edff6860c82b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0927 01:44:27.712250 756367 logs.go:138] Found kubelet problem: Sep 27 01:40:43 old-k8s-version-745133 kubelet[736]: E0927 01:40:43.674664 736 pod_workers.go:191] Error syncing pod 989e3cab-2430-4d81-91f7-b0098b27e30c ("dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"
W0927 01:44:27.712463 756367 logs.go:138] Found kubelet problem: Sep 27 01:40:50 old-k8s-version-745133 kubelet[736]: E0927 01:40:50.675165 736 pod_workers.go:191] Error syncing pod 249f17e8-637b-4946-8ed3-edff6860c82b ("metrics-server-9975d5f86-5bphl_kube-system(249f17e8-637b-4946-8ed3-edff6860c82b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0927 01:44:27.712820 756367 logs.go:138] Found kubelet problem: Sep 27 01:40:57 old-k8s-version-745133 kubelet[736]: E0927 01:40:57.675462 736 pod_workers.go:191] Error syncing pod 989e3cab-2430-4d81-91f7-b0098b27e30c ("dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"
W0927 01:44:27.713034 756367 logs.go:138] Found kubelet problem: Sep 27 01:41:04 old-k8s-version-745133 kubelet[736]: E0927 01:41:04.679852 736 pod_workers.go:191] Error syncing pod 249f17e8-637b-4946-8ed3-edff6860c82b ("metrics-server-9975d5f86-5bphl_kube-system(249f17e8-637b-4946-8ed3-edff6860c82b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0927 01:44:27.713655 756367 logs.go:138] Found kubelet problem: Sep 27 01:41:11 old-k8s-version-745133 kubelet[736]: E0927 01:41:11.121508 736 pod_workers.go:191] Error syncing pod 989e3cab-2430-4d81-91f7-b0098b27e30c ("dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"
W0927 01:44:27.713899 756367 logs.go:138] Found kubelet problem: Sep 27 01:41:17 old-k8s-version-745133 kubelet[736]: E0927 01:41:17.676076 736 pod_workers.go:191] Error syncing pod 249f17e8-637b-4946-8ed3-edff6860c82b ("metrics-server-9975d5f86-5bphl_kube-system(249f17e8-637b-4946-8ed3-edff6860c82b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0927 01:44:27.714253 756367 logs.go:138] Found kubelet problem: Sep 27 01:41:19 old-k8s-version-745133 kubelet[736]: E0927 01:41:19.607004 736 pod_workers.go:191] Error syncing pod 989e3cab-2430-4d81-91f7-b0098b27e30c ("dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"
W0927 01:44:27.714545 756367 logs.go:138] Found kubelet problem: Sep 27 01:41:28 old-k8s-version-745133 kubelet[736]: E0927 01:41:28.675474 736 pod_workers.go:191] Error syncing pod 249f17e8-637b-4946-8ed3-edff6860c82b ("metrics-server-9975d5f86-5bphl_kube-system(249f17e8-637b-4946-8ed3-edff6860c82b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0927 01:44:27.714933 756367 logs.go:138] Found kubelet problem: Sep 27 01:41:33 old-k8s-version-745133 kubelet[736]: E0927 01:41:33.674670 736 pod_workers.go:191] Error syncing pod 989e3cab-2430-4d81-91f7-b0098b27e30c ("dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"
W0927 01:44:27.715143 756367 logs.go:138] Found kubelet problem: Sep 27 01:41:41 old-k8s-version-745133 kubelet[736]: E0927 01:41:41.675136 736 pod_workers.go:191] Error syncing pod 249f17e8-637b-4946-8ed3-edff6860c82b ("metrics-server-9975d5f86-5bphl_kube-system(249f17e8-637b-4946-8ed3-edff6860c82b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0927 01:44:27.715561 756367 logs.go:138] Found kubelet problem: Sep 27 01:41:46 old-k8s-version-745133 kubelet[736]: E0927 01:41:46.674672 736 pod_workers.go:191] Error syncing pod 989e3cab-2430-4d81-91f7-b0098b27e30c ("dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"
W0927 01:44:27.721157 756367 logs.go:138] Found kubelet problem: Sep 27 01:41:55 old-k8s-version-745133 kubelet[736]: E0927 01:41:55.687901 736 pod_workers.go:191] Error syncing pod 249f17e8-637b-4946-8ed3-edff6860c82b ("metrics-server-9975d5f86-5bphl_kube-system(249f17e8-637b-4946-8ed3-edff6860c82b)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = pinging container registry fake.domain: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain: no such host"
W0927 01:44:27.721536 756367 logs.go:138] Found kubelet problem: Sep 27 01:42:01 old-k8s-version-745133 kubelet[736]: E0927 01:42:01.675876 736 pod_workers.go:191] Error syncing pod 989e3cab-2430-4d81-91f7-b0098b27e30c ("dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"
W0927 01:44:27.721796 756367 logs.go:138] Found kubelet problem: Sep 27 01:42:10 old-k8s-version-745133 kubelet[736]: E0927 01:42:10.675343 736 pod_workers.go:191] Error syncing pod 249f17e8-637b-4946-8ed3-edff6860c82b ("metrics-server-9975d5f86-5bphl_kube-system(249f17e8-637b-4946-8ed3-edff6860c82b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0927 01:44:27.722157 756367 logs.go:138] Found kubelet problem: Sep 27 01:42:13 old-k8s-version-745133 kubelet[736]: E0927 01:42:13.675175 736 pod_workers.go:191] Error syncing pod 989e3cab-2430-4d81-91f7-b0098b27e30c ("dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"
W0927 01:44:27.722367 756367 logs.go:138] Found kubelet problem: Sep 27 01:42:22 old-k8s-version-745133 kubelet[736]: E0927 01:42:22.675195 736 pod_workers.go:191] Error syncing pod 249f17e8-637b-4946-8ed3-edff6860c82b ("metrics-server-9975d5f86-5bphl_kube-system(249f17e8-637b-4946-8ed3-edff6860c82b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0927 01:44:27.722740 756367 logs.go:138] Found kubelet problem: Sep 27 01:42:26 old-k8s-version-745133 kubelet[736]: E0927 01:42:26.674767 736 pod_workers.go:191] Error syncing pod 989e3cab-2430-4d81-91f7-b0098b27e30c ("dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"
W0927 01:44:27.722949 756367 logs.go:138] Found kubelet problem: Sep 27 01:42:33 old-k8s-version-745133 kubelet[736]: E0927 01:42:33.675487 736 pod_workers.go:191] Error syncing pod 249f17e8-637b-4946-8ed3-edff6860c82b ("metrics-server-9975d5f86-5bphl_kube-system(249f17e8-637b-4946-8ed3-edff6860c82b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0927 01:44:27.723571 756367 logs.go:138] Found kubelet problem: Sep 27 01:42:42 old-k8s-version-745133 kubelet[736]: E0927 01:42:42.264610 736 pod_workers.go:191] Error syncing pod 989e3cab-2430-4d81-91f7-b0098b27e30c ("dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"
W0927 01:44:27.723782 756367 logs.go:138] Found kubelet problem: Sep 27 01:42:47 old-k8s-version-745133 kubelet[736]: E0927 01:42:47.675472 736 pod_workers.go:191] Error syncing pod 249f17e8-637b-4946-8ed3-edff6860c82b ("metrics-server-9975d5f86-5bphl_kube-system(249f17e8-637b-4946-8ed3-edff6860c82b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0927 01:44:27.724146 756367 logs.go:138] Found kubelet problem: Sep 27 01:42:49 old-k8s-version-745133 kubelet[736]: E0927 01:42:49.615148 736 pod_workers.go:191] Error syncing pod 989e3cab-2430-4d81-91f7-b0098b27e30c ("dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"
W0927 01:44:27.724507 756367 logs.go:138] Found kubelet problem: Sep 27 01:43:01 old-k8s-version-745133 kubelet[736]: E0927 01:43:01.674781 736 pod_workers.go:191] Error syncing pod 989e3cab-2430-4d81-91f7-b0098b27e30c ("dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"
W0927 01:44:27.724717 756367 logs.go:138] Found kubelet problem: Sep 27 01:43:01 old-k8s-version-745133 kubelet[736]: E0927 01:43:01.675864 736 pod_workers.go:191] Error syncing pod 249f17e8-637b-4946-8ed3-edff6860c82b ("metrics-server-9975d5f86-5bphl_kube-system(249f17e8-637b-4946-8ed3-edff6860c82b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0927 01:44:27.724926 756367 logs.go:138] Found kubelet problem: Sep 27 01:43:13 old-k8s-version-745133 kubelet[736]: E0927 01:43:13.675722 736 pod_workers.go:191] Error syncing pod 249f17e8-637b-4946-8ed3-edff6860c82b ("metrics-server-9975d5f86-5bphl_kube-system(249f17e8-637b-4946-8ed3-edff6860c82b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0927 01:44:27.725397 756367 logs.go:138] Found kubelet problem: Sep 27 01:43:15 old-k8s-version-745133 kubelet[736]: E0927 01:43:15.674635 736 pod_workers.go:191] Error syncing pod 989e3cab-2430-4d81-91f7-b0098b27e30c ("dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"
W0927 01:44:27.725777 756367 logs.go:138] Found kubelet problem: Sep 27 01:43:26 old-k8s-version-745133 kubelet[736]: E0927 01:43:26.674663 736 pod_workers.go:191] Error syncing pod 989e3cab-2430-4d81-91f7-b0098b27e30c ("dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"
W0927 01:44:27.725988 756367 logs.go:138] Found kubelet problem: Sep 27 01:43:28 old-k8s-version-745133 kubelet[736]: E0927 01:43:28.675242 736 pod_workers.go:191] Error syncing pod 249f17e8-637b-4946-8ed3-edff6860c82b ("metrics-server-9975d5f86-5bphl_kube-system(249f17e8-637b-4946-8ed3-edff6860c82b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0927 01:44:27.726198 756367 logs.go:138] Found kubelet problem: Sep 27 01:43:39 old-k8s-version-745133 kubelet[736]: E0927 01:43:39.675681 736 pod_workers.go:191] Error syncing pod 249f17e8-637b-4946-8ed3-edff6860c82b ("metrics-server-9975d5f86-5bphl_kube-system(249f17e8-637b-4946-8ed3-edff6860c82b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0927 01:44:27.726553 756367 logs.go:138] Found kubelet problem: Sep 27 01:43:40 old-k8s-version-745133 kubelet[736]: E0927 01:43:40.674684 736 pod_workers.go:191] Error syncing pod 989e3cab-2430-4d81-91f7-b0098b27e30c ("dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"
W0927 01:44:27.727033 756367 logs.go:138] Found kubelet problem: Sep 27 01:43:50 old-k8s-version-745133 kubelet[736]: E0927 01:43:50.675166 736 pod_workers.go:191] Error syncing pod 249f17e8-637b-4946-8ed3-edff6860c82b ("metrics-server-9975d5f86-5bphl_kube-system(249f17e8-637b-4946-8ed3-edff6860c82b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0927 01:44:27.727415 756367 logs.go:138] Found kubelet problem: Sep 27 01:43:54 old-k8s-version-745133 kubelet[736]: E0927 01:43:54.675191 736 pod_workers.go:191] Error syncing pod 989e3cab-2430-4d81-91f7-b0098b27e30c ("dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"
W0927 01:44:27.727656 756367 logs.go:138] Found kubelet problem: Sep 27 01:44:02 old-k8s-version-745133 kubelet[736]: E0927 01:44:02.676623 736 pod_workers.go:191] Error syncing pod 249f17e8-637b-4946-8ed3-edff6860c82b ("metrics-server-9975d5f86-5bphl_kube-system(249f17e8-637b-4946-8ed3-edff6860c82b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0927 01:44:27.728017 756367 logs.go:138] Found kubelet problem: Sep 27 01:44:06 old-k8s-version-745133 kubelet[736]: E0927 01:44:06.674628 736 pod_workers.go:191] Error syncing pod 989e3cab-2430-4d81-91f7-b0098b27e30c ("dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"
W0927 01:44:27.728228 756367 logs.go:138] Found kubelet problem: Sep 27 01:44:17 old-k8s-version-745133 kubelet[736]: E0927 01:44:17.675590 736 pod_workers.go:191] Error syncing pod 249f17e8-637b-4946-8ed3-edff6860c82b ("metrics-server-9975d5f86-5bphl_kube-system(249f17e8-637b-4946-8ed3-edff6860c82b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0927 01:44:27.728616 756367 logs.go:138] Found kubelet problem: Sep 27 01:44:21 old-k8s-version-745133 kubelet[736]: E0927 01:44:21.674844 736 pod_workers.go:191] Error syncing pod 989e3cab-2430-4d81-91f7-b0098b27e30c ("dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"
I0927 01:44:27.728630 756367 logs.go:123] Gathering logs for kube-controller-manager [fd21817034d06ff8ec30b1fa5089ddfd190af71c8dfdcde0d32fd61181caafaa] ...
I0927 01:44:27.728645 756367 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 fd21817034d06ff8ec30b1fa5089ddfd190af71c8dfdcde0d32fd61181caafaa"
I0927 01:44:27.845793 756367 logs.go:123] Gathering logs for kindnet [f74f5a74223b633c3ca99ac7465604311677c0c0b43adeacf4843a7ade66ca48] ...
I0927 01:44:27.845828 756367 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 f74f5a74223b633c3ca99ac7465604311677c0c0b43adeacf4843a7ade66ca48"
I0927 01:44:27.929600 756367 logs.go:123] Gathering logs for kubernetes-dashboard [7a82c31e2981413dba52726ae93a9b6786429d4055c821906975f6a58bb6787c] ...
I0927 01:44:27.929628 756367 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 7a82c31e2981413dba52726ae93a9b6786429d4055c821906975f6a58bb6787c"
I0927 01:44:28.012427 756367 logs.go:123] Gathering logs for dmesg ...
I0927 01:44:28.012457 756367 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0927 01:44:28.034915 756367 logs.go:123] Gathering logs for CRI-O ...
I0927 01:44:28.034993 756367 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I0927 01:44:28.149972 756367 logs.go:123] Gathering logs for kube-apiserver [728631fe1253bab9992c7a58f88fca5a34491a3d06d1a6601e0e70566e7d10f4] ...
I0927 01:44:28.150052 756367 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 728631fe1253bab9992c7a58f88fca5a34491a3d06d1a6601e0e70566e7d10f4"
I0927 01:44:28.283007 756367 logs.go:123] Gathering logs for kube-scheduler [1399d95796260c7e27b7a91a70576c5a3e3bfcfee9fb91839ddfe1b01c5114c0] ...
I0927 01:44:28.283106 756367 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 1399d95796260c7e27b7a91a70576c5a3e3bfcfee9fb91839ddfe1b01c5114c0"
I0927 01:44:28.353690 756367 logs.go:123] Gathering logs for kube-proxy [1f91c6f77f281dbe05880609e73acc353cb7ee468afa455c7d22c45e9428661e] ...
I0927 01:44:28.353785 756367 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 1f91c6f77f281dbe05880609e73acc353cb7ee468afa455c7d22c45e9428661e"
I0927 01:44:28.428293 756367 logs.go:123] Gathering logs for container status ...
I0927 01:44:28.428328 756367 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0927 01:44:28.500951 756367 logs.go:123] Gathering logs for describe nodes ...
I0927 01:44:28.501042 756367 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0927 01:44:28.691339 756367 logs.go:123] Gathering logs for etcd [fbfae056e26dd1b15e6b109b732296bcb89c5db7fabc0f8958574a0fc1248e81] ...
I0927 01:44:28.691372 756367 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 fbfae056e26dd1b15e6b109b732296bcb89c5db7fabc0f8958574a0fc1248e81"
I0927 01:44:28.752406 756367 logs.go:123] Gathering logs for coredns [6a28aab70700044c53668d4eceed46b67fba50e2d134c97b4c5cdd9f83c81e4a] ...
I0927 01:44:28.752437 756367 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 6a28aab70700044c53668d4eceed46b67fba50e2d134c97b4c5cdd9f83c81e4a"
I0927 01:44:28.791959 756367 logs.go:123] Gathering logs for storage-provisioner [138c41837cf0bbda88ce0b41c3d306956ef57ff9c2cb680fa71af1f16e609832] ...
I0927 01:44:28.791991 756367 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 138c41837cf0bbda88ce0b41c3d306956ef57ff9c2cb680fa71af1f16e609832"
I0927 01:44:28.833586 756367 out.go:358] Setting ErrFile to fd 2...
I0927 01:44:28.833613 756367 out.go:392] TERM=,COLORTERM=, which probably does not support color
W0927 01:44:28.833684 756367 out.go:270] X Problems detected in kubelet:
X Problems detected in kubelet:
W0927 01:44:28.833702 756367 out.go:270] Sep 27 01:43:54 old-k8s-version-745133 kubelet[736]: E0927 01:43:54.675191 736 pod_workers.go:191] Error syncing pod 989e3cab-2430-4d81-91f7-b0098b27e30c ("dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"
Sep 27 01:43:54 old-k8s-version-745133 kubelet[736]: E0927 01:43:54.675191 736 pod_workers.go:191] Error syncing pod 989e3cab-2430-4d81-91f7-b0098b27e30c ("dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"
W0927 01:44:28.833710 756367 out.go:270] Sep 27 01:44:02 old-k8s-version-745133 kubelet[736]: E0927 01:44:02.676623 736 pod_workers.go:191] Error syncing pod 249f17e8-637b-4946-8ed3-edff6860c82b ("metrics-server-9975d5f86-5bphl_kube-system(249f17e8-637b-4946-8ed3-edff6860c82b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Sep 27 01:44:02 old-k8s-version-745133 kubelet[736]: E0927 01:44:02.676623 736 pod_workers.go:191] Error syncing pod 249f17e8-637b-4946-8ed3-edff6860c82b ("metrics-server-9975d5f86-5bphl_kube-system(249f17e8-637b-4946-8ed3-edff6860c82b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0927 01:44:28.833752 756367 out.go:270] Sep 27 01:44:06 old-k8s-version-745133 kubelet[736]: E0927 01:44:06.674628 736 pod_workers.go:191] Error syncing pod 989e3cab-2430-4d81-91f7-b0098b27e30c ("dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"
Sep 27 01:44:06 old-k8s-version-745133 kubelet[736]: E0927 01:44:06.674628 736 pod_workers.go:191] Error syncing pod 989e3cab-2430-4d81-91f7-b0098b27e30c ("dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"
W0927 01:44:28.833765 756367 out.go:270] Sep 27 01:44:17 old-k8s-version-745133 kubelet[736]: E0927 01:44:17.675590 736 pod_workers.go:191] Error syncing pod 249f17e8-637b-4946-8ed3-edff6860c82b ("metrics-server-9975d5f86-5bphl_kube-system(249f17e8-637b-4946-8ed3-edff6860c82b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Sep 27 01:44:17 old-k8s-version-745133 kubelet[736]: E0927 01:44:17.675590 736 pod_workers.go:191] Error syncing pod 249f17e8-637b-4946-8ed3-edff6860c82b ("metrics-server-9975d5f86-5bphl_kube-system(249f17e8-637b-4946-8ed3-edff6860c82b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0927 01:44:28.833773 756367 out.go:270] Sep 27 01:44:21 old-k8s-version-745133 kubelet[736]: E0927 01:44:21.674844 736 pod_workers.go:191] Error syncing pod 989e3cab-2430-4d81-91f7-b0098b27e30c ("dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"
Sep 27 01:44:21 old-k8s-version-745133 kubelet[736]: E0927 01:44:21.674844 736 pod_workers.go:191] Error syncing pod 989e3cab-2430-4d81-91f7-b0098b27e30c ("dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"
I0927 01:44:28.833795 756367 out.go:358] Setting ErrFile to fd 2...
I0927 01:44:28.833815 756367 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0927 01:44:38.835711 756367 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0927 01:44:38.852118 756367 api_server.go:72] duration metric: took 5m59.130981288s to wait for apiserver process to appear ...
I0927 01:44:38.852145 756367 api_server.go:88] waiting for apiserver healthz status ...
I0927 01:44:38.852204 756367 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I0927 01:44:38.852315 756367 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0927 01:44:38.922459 756367 cri.go:89] found id: "728631fe1253bab9992c7a58f88fca5a34491a3d06d1a6601e0e70566e7d10f4"
I0927 01:44:38.922483 756367 cri.go:89] found id: ""
I0927 01:44:38.922490 756367 logs.go:276] 1 containers: [728631fe1253bab9992c7a58f88fca5a34491a3d06d1a6601e0e70566e7d10f4]
I0927 01:44:38.922545 756367 ssh_runner.go:195] Run: which crictl
I0927 01:44:38.927062 756367 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I0927 01:44:38.927133 756367 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0927 01:44:38.981224 756367 cri.go:89] found id: "fbfae056e26dd1b15e6b109b732296bcb89c5db7fabc0f8958574a0fc1248e81"
I0927 01:44:38.981250 756367 cri.go:89] found id: ""
I0927 01:44:38.981259 756367 logs.go:276] 1 containers: [fbfae056e26dd1b15e6b109b732296bcb89c5db7fabc0f8958574a0fc1248e81]
I0927 01:44:38.981318 756367 ssh_runner.go:195] Run: which crictl
I0927 01:44:38.986555 756367 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I0927 01:44:38.986636 756367 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0927 01:44:39.039294 756367 cri.go:89] found id: "6a28aab70700044c53668d4eceed46b67fba50e2d134c97b4c5cdd9f83c81e4a"
I0927 01:44:39.039320 756367 cri.go:89] found id: ""
I0927 01:44:39.039328 756367 logs.go:276] 1 containers: [6a28aab70700044c53668d4eceed46b67fba50e2d134c97b4c5cdd9f83c81e4a]
I0927 01:44:39.039386 756367 ssh_runner.go:195] Run: which crictl
I0927 01:44:39.043454 756367 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I0927 01:44:39.043529 756367 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0927 01:44:39.104793 756367 cri.go:89] found id: "1399d95796260c7e27b7a91a70576c5a3e3bfcfee9fb91839ddfe1b01c5114c0"
I0927 01:44:39.104822 756367 cri.go:89] found id: ""
I0927 01:44:39.104831 756367 logs.go:276] 1 containers: [1399d95796260c7e27b7a91a70576c5a3e3bfcfee9fb91839ddfe1b01c5114c0]
I0927 01:44:39.104884 756367 ssh_runner.go:195] Run: which crictl
I0927 01:44:39.110103 756367 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I0927 01:44:39.110168 756367 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0927 01:44:39.174469 756367 cri.go:89] found id: "1f91c6f77f281dbe05880609e73acc353cb7ee468afa455c7d22c45e9428661e"
I0927 01:44:39.174497 756367 cri.go:89] found id: ""
I0927 01:44:39.174505 756367 logs.go:276] 1 containers: [1f91c6f77f281dbe05880609e73acc353cb7ee468afa455c7d22c45e9428661e]
I0927 01:44:39.174562 756367 ssh_runner.go:195] Run: which crictl
I0927 01:44:39.178544 756367 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I0927 01:44:39.178620 756367 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0927 01:44:39.229152 756367 cri.go:89] found id: "fd21817034d06ff8ec30b1fa5089ddfd190af71c8dfdcde0d32fd61181caafaa"
I0927 01:44:39.229176 756367 cri.go:89] found id: ""
I0927 01:44:39.229184 756367 logs.go:276] 1 containers: [fd21817034d06ff8ec30b1fa5089ddfd190af71c8dfdcde0d32fd61181caafaa]
I0927 01:44:39.229244 756367 ssh_runner.go:195] Run: which crictl
I0927 01:44:39.232807 756367 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I0927 01:44:39.232877 756367 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0927 01:44:39.273216 756367 cri.go:89] found id: "f74f5a74223b633c3ca99ac7465604311677c0c0b43adeacf4843a7ade66ca48"
I0927 01:44:39.273239 756367 cri.go:89] found id: ""
I0927 01:44:39.273247 756367 logs.go:276] 1 containers: [f74f5a74223b633c3ca99ac7465604311677c0c0b43adeacf4843a7ade66ca48]
I0927 01:44:39.273305 756367 ssh_runner.go:195] Run: which crictl
I0927 01:44:39.277150 756367 cri.go:54] listing CRI containers in root : {State:all Name:storage-provisioner Namespaces:[]}
I0927 01:44:39.277226 756367 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
I0927 01:44:39.315705 756367 cri.go:89] found id: "138c41837cf0bbda88ce0b41c3d306956ef57ff9c2cb680fa71af1f16e609832"
I0927 01:44:39.315727 756367 cri.go:89] found id: ""
I0927 01:44:39.315734 756367 logs.go:276] 1 containers: [138c41837cf0bbda88ce0b41c3d306956ef57ff9c2cb680fa71af1f16e609832]
I0927 01:44:39.315791 756367 ssh_runner.go:195] Run: which crictl
I0927 01:44:39.319422 756367 cri.go:54] listing CRI containers in root : {State:all Name:kubernetes-dashboard Namespaces:[]}
I0927 01:44:39.319493 756367 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
I0927 01:44:39.374266 756367 cri.go:89] found id: "7a82c31e2981413dba52726ae93a9b6786429d4055c821906975f6a58bb6787c"
I0927 01:44:39.374289 756367 cri.go:89] found id: ""
I0927 01:44:39.374297 756367 logs.go:276] 1 containers: [7a82c31e2981413dba52726ae93a9b6786429d4055c821906975f6a58bb6787c]
I0927 01:44:39.374359 756367 ssh_runner.go:195] Run: which crictl
I0927 01:44:39.378605 756367 logs.go:123] Gathering logs for kindnet [f74f5a74223b633c3ca99ac7465604311677c0c0b43adeacf4843a7ade66ca48] ...
I0927 01:44:39.378629 756367 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 f74f5a74223b633c3ca99ac7465604311677c0c0b43adeacf4843a7ade66ca48"
I0927 01:44:39.431823 756367 logs.go:123] Gathering logs for kubernetes-dashboard [7a82c31e2981413dba52726ae93a9b6786429d4055c821906975f6a58bb6787c] ...
I0927 01:44:39.431856 756367 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 7a82c31e2981413dba52726ae93a9b6786429d4055c821906975f6a58bb6787c"
I0927 01:44:39.476375 756367 logs.go:123] Gathering logs for container status ...
I0927 01:44:39.476405 756367 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0927 01:44:39.531425 756367 logs.go:123] Gathering logs for dmesg ...
I0927 01:44:39.531456 756367 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0927 01:44:39.548458 756367 logs.go:123] Gathering logs for kube-proxy [1f91c6f77f281dbe05880609e73acc353cb7ee468afa455c7d22c45e9428661e] ...
I0927 01:44:39.548489 756367 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 1f91c6f77f281dbe05880609e73acc353cb7ee468afa455c7d22c45e9428661e"
I0927 01:44:39.587845 756367 logs.go:123] Gathering logs for kube-apiserver [728631fe1253bab9992c7a58f88fca5a34491a3d06d1a6601e0e70566e7d10f4] ...
I0927 01:44:39.587877 756367 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 728631fe1253bab9992c7a58f88fca5a34491a3d06d1a6601e0e70566e7d10f4"
I0927 01:44:39.665236 756367 logs.go:123] Gathering logs for kube-scheduler [1399d95796260c7e27b7a91a70576c5a3e3bfcfee9fb91839ddfe1b01c5114c0] ...
I0927 01:44:39.665275 756367 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 1399d95796260c7e27b7a91a70576c5a3e3bfcfee9fb91839ddfe1b01c5114c0"
I0927 01:44:39.711276 756367 logs.go:123] Gathering logs for storage-provisioner [138c41837cf0bbda88ce0b41c3d306956ef57ff9c2cb680fa71af1f16e609832] ...
I0927 01:44:39.711308 756367 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 138c41837cf0bbda88ce0b41c3d306956ef57ff9c2cb680fa71af1f16e609832"
I0927 01:44:39.751909 756367 logs.go:123] Gathering logs for CRI-O ...
I0927 01:44:39.751939 756367 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I0927 01:44:39.832973 756367 logs.go:123] Gathering logs for etcd [fbfae056e26dd1b15e6b109b732296bcb89c5db7fabc0f8958574a0fc1248e81] ...
I0927 01:44:39.833012 756367 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 fbfae056e26dd1b15e6b109b732296bcb89c5db7fabc0f8958574a0fc1248e81"
I0927 01:44:39.887308 756367 logs.go:123] Gathering logs for coredns [6a28aab70700044c53668d4eceed46b67fba50e2d134c97b4c5cdd9f83c81e4a] ...
I0927 01:44:39.887339 756367 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 6a28aab70700044c53668d4eceed46b67fba50e2d134c97b4c5cdd9f83c81e4a"
I0927 01:44:39.928050 756367 logs.go:123] Gathering logs for kube-controller-manager [fd21817034d06ff8ec30b1fa5089ddfd190af71c8dfdcde0d32fd61181caafaa] ...
I0927 01:44:39.928079 756367 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 fd21817034d06ff8ec30b1fa5089ddfd190af71c8dfdcde0d32fd61181caafaa"
I0927 01:44:40.029021 756367 logs.go:123] Gathering logs for kubelet ...
I0927 01:44:40.029073 756367 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
W0927 01:44:40.096759 756367 logs.go:138] Found kubelet problem: Sep 27 01:39:00 old-k8s-version-745133 kubelet[736]: E0927 01:39:00.276608 736 reflector.go:138] object-"kube-system"/"coredns": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "coredns" is forbidden: User "system:node:old-k8s-version-745133" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-745133' and this object
W0927 01:44:40.097055 756367 logs.go:138] Found kubelet problem: Sep 27 01:39:00 old-k8s-version-745133 kubelet[736]: E0927 01:39:00.277156 736 reflector.go:138] object-"kube-system"/"kube-proxy-token-mdl25": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kube-proxy-token-mdl25" is forbidden: User "system:node:old-k8s-version-745133" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-745133' and this object
W0927 01:44:40.097340 756367 logs.go:138] Found kubelet problem: Sep 27 01:39:00 old-k8s-version-745133 kubelet[736]: E0927 01:39:00.277414 736 reflector.go:138] object-"kube-system"/"kube-proxy": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-proxy" is forbidden: User "system:node:old-k8s-version-745133" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-745133' and this object
W0927 01:44:40.097591 756367 logs.go:138] Found kubelet problem: Sep 27 01:39:00 old-k8s-version-745133 kubelet[736]: E0927 01:39:00.277602 736 reflector.go:138] object-"kube-system"/"kindnet-token-jwlc6": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kindnet-token-jwlc6" is forbidden: User "system:node:old-k8s-version-745133" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-745133' and this object
W0927 01:44:40.097838 756367 logs.go:138] Found kubelet problem: Sep 27 01:39:00 old-k8s-version-745133 kubelet[736]: E0927 01:39:00.277796 736 reflector.go:138] object-"kube-system"/"coredns-token-k4cmv": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "coredns-token-k4cmv" is forbidden: User "system:node:old-k8s-version-745133" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-745133' and this object
W0927 01:44:40.098101 756367 logs.go:138] Found kubelet problem: Sep 27 01:39:00 old-k8s-version-745133 kubelet[736]: E0927 01:39:00.277995 736 reflector.go:138] object-"kube-system"/"storage-provisioner-token-tgp2f": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "storage-provisioner-token-tgp2f" is forbidden: User "system:node:old-k8s-version-745133" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-745133' and this object
W0927 01:44:40.098367 756367 logs.go:138] Found kubelet problem: Sep 27 01:39:00 old-k8s-version-745133 kubelet[736]: E0927 01:39:00.278201 736 reflector.go:138] object-"kube-system"/"metrics-server-token-9xfpw": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "metrics-server-token-9xfpw" is forbidden: User "system:node:old-k8s-version-745133" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-745133' and this object
W0927 01:44:40.098599 756367 logs.go:138] Found kubelet problem: Sep 27 01:39:00 old-k8s-version-745133 kubelet[736]: E0927 01:39:00.278383 736 reflector.go:138] object-"default"/"default-token-lm75v": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "default-token-lm75v" is forbidden: User "system:node:old-k8s-version-745133" cannot list resource "secrets" in API group "" in the namespace "default": no relationship found between node 'old-k8s-version-745133' and this object
W0927 01:44:40.108947 756367 logs.go:138] Found kubelet problem: Sep 27 01:39:03 old-k8s-version-745133 kubelet[736]: E0927 01:39:03.038144 736 pod_workers.go:191] Error syncing pod 249f17e8-637b-4946-8ed3-edff6860c82b ("metrics-server-9975d5f86-5bphl_kube-system(249f17e8-637b-4946-8ed3-edff6860c82b)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = pinging container registry fake.domain: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain: no such host"
W0927 01:44:40.109179 756367 logs.go:138] Found kubelet problem: Sep 27 01:39:03 old-k8s-version-745133 kubelet[736]: E0927 01:39:03.733711 736 pod_workers.go:191] Error syncing pod 249f17e8-637b-4946-8ed3-edff6860c82b ("metrics-server-9975d5f86-5bphl_kube-system(249f17e8-637b-4946-8ed3-edff6860c82b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0927 01:44:40.111478 756367 logs.go:138] Found kubelet problem: Sep 27 01:39:17 old-k8s-version-745133 kubelet[736]: E0927 01:39:17.695628 736 pod_workers.go:191] Error syncing pod 249f17e8-637b-4946-8ed3-edff6860c82b ("metrics-server-9975d5f86-5bphl_kube-system(249f17e8-637b-4946-8ed3-edff6860c82b)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = pinging container registry fake.domain: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain: no such host"
W0927 01:44:40.111949 756367 logs.go:138] Found kubelet problem: Sep 27 01:39:19 old-k8s-version-745133 kubelet[736]: E0927 01:39:19.799354 736 reflector.go:138] object-"kubernetes-dashboard"/"kubernetes-dashboard-token-hcwf2": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kubernetes-dashboard-token-hcwf2" is forbidden: User "system:node:old-k8s-version-745133" cannot list resource "secrets" in API group "" in the namespace "kubernetes-dashboard": no relationship found between node 'old-k8s-version-745133' and this object
W0927 01:44:40.113700 756367 logs.go:138] Found kubelet problem: Sep 27 01:39:28 old-k8s-version-745133 kubelet[736]: E0927 01:39:28.679675 736 pod_workers.go:191] Error syncing pod 249f17e8-637b-4946-8ed3-edff6860c82b ("metrics-server-9975d5f86-5bphl_kube-system(249f17e8-637b-4946-8ed3-edff6860c82b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0927 01:44:40.114248 756367 logs.go:138] Found kubelet problem: Sep 27 01:39:31 old-k8s-version-745133 kubelet[736]: E0927 01:39:31.971044 736 pod_workers.go:191] Error syncing pod 989e3cab-2430-4d81-91f7-b0098b27e30c ("dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"
W0927 01:44:40.114769 756367 logs.go:138] Found kubelet problem: Sep 27 01:39:32 old-k8s-version-745133 kubelet[736]: E0927 01:39:32.973106 736 pod_workers.go:191] Error syncing pod 989e3cab-2430-4d81-91f7-b0098b27e30c ("dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"
W0927 01:44:40.115110 756367 logs.go:138] Found kubelet problem: Sep 27 01:39:39 old-k8s-version-745133 kubelet[736]: E0927 01:39:39.607023 736 pod_workers.go:191] Error syncing pod 989e3cab-2430-4d81-91f7-b0098b27e30c ("dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"
W0927 01:44:40.117338 756367 logs.go:138] Found kubelet problem: Sep 27 01:39:43 old-k8s-version-745133 kubelet[736]: E0927 01:39:43.686128 736 pod_workers.go:191] Error syncing pod 249f17e8-637b-4946-8ed3-edff6860c82b ("metrics-server-9975d5f86-5bphl_kube-system(249f17e8-637b-4946-8ed3-edff6860c82b)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = pinging container registry fake.domain: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain: no such host"
W0927 01:44:40.117990 756367 logs.go:138] Found kubelet problem: Sep 27 01:39:55 old-k8s-version-745133 kubelet[736]: E0927 01:39:55.013155 736 pod_workers.go:191] Error syncing pod 989e3cab-2430-4d81-91f7-b0098b27e30c ("dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"
W0927 01:44:40.118191 756367 logs.go:138] Found kubelet problem: Sep 27 01:39:58 old-k8s-version-745133 kubelet[736]: E0927 01:39:58.675275 736 pod_workers.go:191] Error syncing pod 249f17e8-637b-4946-8ed3-edff6860c82b ("metrics-server-9975d5f86-5bphl_kube-system(249f17e8-637b-4946-8ed3-edff6860c82b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0927 01:44:40.118552 756367 logs.go:138] Found kubelet problem: Sep 27 01:39:59 old-k8s-version-745133 kubelet[736]: E0927 01:39:59.607420 736 pod_workers.go:191] Error syncing pod 989e3cab-2430-4d81-91f7-b0098b27e30c ("dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"
W0927 01:44:40.118760 756367 logs.go:138] Found kubelet problem: Sep 27 01:40:09 old-k8s-version-745133 kubelet[736]: E0927 01:40:09.675710 736 pod_workers.go:191] Error syncing pod 249f17e8-637b-4946-8ed3-edff6860c82b ("metrics-server-9975d5f86-5bphl_kube-system(249f17e8-637b-4946-8ed3-edff6860c82b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0927 01:44:40.119110 756367 logs.go:138] Found kubelet problem: Sep 27 01:40:11 old-k8s-version-745133 kubelet[736]: E0927 01:40:11.674655 736 pod_workers.go:191] Error syncing pod 989e3cab-2430-4d81-91f7-b0098b27e30c ("dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"
W0927 01:44:40.119744 756367 logs.go:138] Found kubelet problem: Sep 27 01:40:24 old-k8s-version-745133 kubelet[736]: E0927 01:40:24.053848 736 pod_workers.go:191] Error syncing pod 989e3cab-2430-4d81-91f7-b0098b27e30c ("dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"
W0927 01:44:40.121980 756367 logs.go:138] Found kubelet problem: Sep 27 01:40:24 old-k8s-version-745133 kubelet[736]: E0927 01:40:24.685441 736 pod_workers.go:191] Error syncing pod 249f17e8-637b-4946-8ed3-edff6860c82b ("metrics-server-9975d5f86-5bphl_kube-system(249f17e8-637b-4946-8ed3-edff6860c82b)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = pinging container registry fake.domain: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain: no such host"
W0927 01:44:40.122341 756367 logs.go:138] Found kubelet problem: Sep 27 01:40:29 old-k8s-version-745133 kubelet[736]: E0927 01:40:29.607048 736 pod_workers.go:191] Error syncing pod 989e3cab-2430-4d81-91f7-b0098b27e30c ("dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"
W0927 01:44:40.122545 756367 logs.go:138] Found kubelet problem: Sep 27 01:40:38 old-k8s-version-745133 kubelet[736]: E0927 01:40:38.675142 736 pod_workers.go:191] Error syncing pod 249f17e8-637b-4946-8ed3-edff6860c82b ("metrics-server-9975d5f86-5bphl_kube-system(249f17e8-637b-4946-8ed3-edff6860c82b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0927 01:44:40.122921 756367 logs.go:138] Found kubelet problem: Sep 27 01:40:43 old-k8s-version-745133 kubelet[736]: E0927 01:40:43.674664 736 pod_workers.go:191] Error syncing pod 989e3cab-2430-4d81-91f7-b0098b27e30c ("dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"
W0927 01:44:40.123130 756367 logs.go:138] Found kubelet problem: Sep 27 01:40:50 old-k8s-version-745133 kubelet[736]: E0927 01:40:50.675165 736 pod_workers.go:191] Error syncing pod 249f17e8-637b-4946-8ed3-edff6860c82b ("metrics-server-9975d5f86-5bphl_kube-system(249f17e8-637b-4946-8ed3-edff6860c82b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0927 01:44:40.123528 756367 logs.go:138] Found kubelet problem: Sep 27 01:40:57 old-k8s-version-745133 kubelet[736]: E0927 01:40:57.675462 736 pod_workers.go:191] Error syncing pod 989e3cab-2430-4d81-91f7-b0098b27e30c ("dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"
W0927 01:44:40.123736 756367 logs.go:138] Found kubelet problem: Sep 27 01:41:04 old-k8s-version-745133 kubelet[736]: E0927 01:41:04.679852 736 pod_workers.go:191] Error syncing pod 249f17e8-637b-4946-8ed3-edff6860c82b ("metrics-server-9975d5f86-5bphl_kube-system(249f17e8-637b-4946-8ed3-edff6860c82b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0927 01:44:40.124391 756367 logs.go:138] Found kubelet problem: Sep 27 01:41:11 old-k8s-version-745133 kubelet[736]: E0927 01:41:11.121508 736 pod_workers.go:191] Error syncing pod 989e3cab-2430-4d81-91f7-b0098b27e30c ("dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"
W0927 01:44:40.124607 756367 logs.go:138] Found kubelet problem: Sep 27 01:41:17 old-k8s-version-745133 kubelet[736]: E0927 01:41:17.676076 736 pod_workers.go:191] Error syncing pod 249f17e8-637b-4946-8ed3-edff6860c82b ("metrics-server-9975d5f86-5bphl_kube-system(249f17e8-637b-4946-8ed3-edff6860c82b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0927 01:44:40.124961 756367 logs.go:138] Found kubelet problem: Sep 27 01:41:19 old-k8s-version-745133 kubelet[736]: E0927 01:41:19.607004 736 pod_workers.go:191] Error syncing pod 989e3cab-2430-4d81-91f7-b0098b27e30c ("dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"
W0927 01:44:40.125167 756367 logs.go:138] Found kubelet problem: Sep 27 01:41:28 old-k8s-version-745133 kubelet[736]: E0927 01:41:28.675474 736 pod_workers.go:191] Error syncing pod 249f17e8-637b-4946-8ed3-edff6860c82b ("metrics-server-9975d5f86-5bphl_kube-system(249f17e8-637b-4946-8ed3-edff6860c82b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0927 01:44:40.125540 756367 logs.go:138] Found kubelet problem: Sep 27 01:41:33 old-k8s-version-745133 kubelet[736]: E0927 01:41:33.674670 736 pod_workers.go:191] Error syncing pod 989e3cab-2430-4d81-91f7-b0098b27e30c ("dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"
W0927 01:44:40.125751 756367 logs.go:138] Found kubelet problem: Sep 27 01:41:41 old-k8s-version-745133 kubelet[736]: E0927 01:41:41.675136 736 pod_workers.go:191] Error syncing pod 249f17e8-637b-4946-8ed3-edff6860c82b ("metrics-server-9975d5f86-5bphl_kube-system(249f17e8-637b-4946-8ed3-edff6860c82b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0927 01:44:40.126107 756367 logs.go:138] Found kubelet problem: Sep 27 01:41:46 old-k8s-version-745133 kubelet[736]: E0927 01:41:46.674672 736 pod_workers.go:191] Error syncing pod 989e3cab-2430-4d81-91f7-b0098b27e30c ("dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"
W0927 01:44:40.128445 756367 logs.go:138] Found kubelet problem: Sep 27 01:41:55 old-k8s-version-745133 kubelet[736]: E0927 01:41:55.687901 736 pod_workers.go:191] Error syncing pod 249f17e8-637b-4946-8ed3-edff6860c82b ("metrics-server-9975d5f86-5bphl_kube-system(249f17e8-637b-4946-8ed3-edff6860c82b)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = pinging container registry fake.domain: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain: no such host"
W0927 01:44:40.128841 756367 logs.go:138] Found kubelet problem: Sep 27 01:42:01 old-k8s-version-745133 kubelet[736]: E0927 01:42:01.675876 736 pod_workers.go:191] Error syncing pod 989e3cab-2430-4d81-91f7-b0098b27e30c ("dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"
W0927 01:44:40.129096 756367 logs.go:138] Found kubelet problem: Sep 27 01:42:10 old-k8s-version-745133 kubelet[736]: E0927 01:42:10.675343 736 pod_workers.go:191] Error syncing pod 249f17e8-637b-4946-8ed3-edff6860c82b ("metrics-server-9975d5f86-5bphl_kube-system(249f17e8-637b-4946-8ed3-edff6860c82b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0927 01:44:40.129444 756367 logs.go:138] Found kubelet problem: Sep 27 01:42:13 old-k8s-version-745133 kubelet[736]: E0927 01:42:13.675175 736 pod_workers.go:191] Error syncing pod 989e3cab-2430-4d81-91f7-b0098b27e30c ("dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"
W0927 01:44:40.129653 756367 logs.go:138] Found kubelet problem: Sep 27 01:42:22 old-k8s-version-745133 kubelet[736]: E0927 01:42:22.675195 736 pod_workers.go:191] Error syncing pod 249f17e8-637b-4946-8ed3-edff6860c82b ("metrics-server-9975d5f86-5bphl_kube-system(249f17e8-637b-4946-8ed3-edff6860c82b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0927 01:44:40.130012 756367 logs.go:138] Found kubelet problem: Sep 27 01:42:26 old-k8s-version-745133 kubelet[736]: E0927 01:42:26.674767 736 pod_workers.go:191] Error syncing pod 989e3cab-2430-4d81-91f7-b0098b27e30c ("dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"
W0927 01:44:40.130224 756367 logs.go:138] Found kubelet problem: Sep 27 01:42:33 old-k8s-version-745133 kubelet[736]: E0927 01:42:33.675487 736 pod_workers.go:191] Error syncing pod 249f17e8-637b-4946-8ed3-edff6860c82b ("metrics-server-9975d5f86-5bphl_kube-system(249f17e8-637b-4946-8ed3-edff6860c82b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0927 01:44:40.130896 756367 logs.go:138] Found kubelet problem: Sep 27 01:42:42 old-k8s-version-745133 kubelet[736]: E0927 01:42:42.264610 736 pod_workers.go:191] Error syncing pod 989e3cab-2430-4d81-91f7-b0098b27e30c ("dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"
W0927 01:44:40.131105 756367 logs.go:138] Found kubelet problem: Sep 27 01:42:47 old-k8s-version-745133 kubelet[736]: E0927 01:42:47.675472 736 pod_workers.go:191] Error syncing pod 249f17e8-637b-4946-8ed3-edff6860c82b ("metrics-server-9975d5f86-5bphl_kube-system(249f17e8-637b-4946-8ed3-edff6860c82b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0927 01:44:40.131468 756367 logs.go:138] Found kubelet problem: Sep 27 01:42:49 old-k8s-version-745133 kubelet[736]: E0927 01:42:49.615148 736 pod_workers.go:191] Error syncing pod 989e3cab-2430-4d81-91f7-b0098b27e30c ("dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"
W0927 01:44:40.131829 756367 logs.go:138] Found kubelet problem: Sep 27 01:43:01 old-k8s-version-745133 kubelet[736]: E0927 01:43:01.674781 736 pod_workers.go:191] Error syncing pod 989e3cab-2430-4d81-91f7-b0098b27e30c ("dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"
W0927 01:44:40.132045 756367 logs.go:138] Found kubelet problem: Sep 27 01:43:01 old-k8s-version-745133 kubelet[736]: E0927 01:43:01.675864 736 pod_workers.go:191] Error syncing pod 249f17e8-637b-4946-8ed3-edff6860c82b ("metrics-server-9975d5f86-5bphl_kube-system(249f17e8-637b-4946-8ed3-edff6860c82b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0927 01:44:40.132240 756367 logs.go:138] Found kubelet problem: Sep 27 01:43:13 old-k8s-version-745133 kubelet[736]: E0927 01:43:13.675722 736 pod_workers.go:191] Error syncing pod 249f17e8-637b-4946-8ed3-edff6860c82b ("metrics-server-9975d5f86-5bphl_kube-system(249f17e8-637b-4946-8ed3-edff6860c82b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0927 01:44:40.132601 756367 logs.go:138] Found kubelet problem: Sep 27 01:43:15 old-k8s-version-745133 kubelet[736]: E0927 01:43:15.674635 736 pod_workers.go:191] Error syncing pod 989e3cab-2430-4d81-91f7-b0098b27e30c ("dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"
W0927 01:44:40.132997 756367 logs.go:138] Found kubelet problem: Sep 27 01:43:26 old-k8s-version-745133 kubelet[736]: E0927 01:43:26.674663 736 pod_workers.go:191] Error syncing pod 989e3cab-2430-4d81-91f7-b0098b27e30c ("dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"
W0927 01:44:40.133196 756367 logs.go:138] Found kubelet problem: Sep 27 01:43:28 old-k8s-version-745133 kubelet[736]: E0927 01:43:28.675242 736 pod_workers.go:191] Error syncing pod 249f17e8-637b-4946-8ed3-edff6860c82b ("metrics-server-9975d5f86-5bphl_kube-system(249f17e8-637b-4946-8ed3-edff6860c82b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0927 01:44:40.133410 756367 logs.go:138] Found kubelet problem: Sep 27 01:43:39 old-k8s-version-745133 kubelet[736]: E0927 01:43:39.675681 736 pod_workers.go:191] Error syncing pod 249f17e8-637b-4946-8ed3-edff6860c82b ("metrics-server-9975d5f86-5bphl_kube-system(249f17e8-637b-4946-8ed3-edff6860c82b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0927 01:44:40.133777 756367 logs.go:138] Found kubelet problem: Sep 27 01:43:40 old-k8s-version-745133 kubelet[736]: E0927 01:43:40.674684 736 pod_workers.go:191] Error syncing pod 989e3cab-2430-4d81-91f7-b0098b27e30c ("dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"
W0927 01:44:40.134273 756367 logs.go:138] Found kubelet problem: Sep 27 01:43:50 old-k8s-version-745133 kubelet[736]: E0927 01:43:50.675166 736 pod_workers.go:191] Error syncing pod 249f17e8-637b-4946-8ed3-edff6860c82b ("metrics-server-9975d5f86-5bphl_kube-system(249f17e8-637b-4946-8ed3-edff6860c82b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0927 01:44:40.134641 756367 logs.go:138] Found kubelet problem: Sep 27 01:43:54 old-k8s-version-745133 kubelet[736]: E0927 01:43:54.675191 736 pod_workers.go:191] Error syncing pod 989e3cab-2430-4d81-91f7-b0098b27e30c ("dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"
W0927 01:44:40.134858 756367 logs.go:138] Found kubelet problem: Sep 27 01:44:02 old-k8s-version-745133 kubelet[736]: E0927 01:44:02.676623 736 pod_workers.go:191] Error syncing pod 249f17e8-637b-4946-8ed3-edff6860c82b ("metrics-server-9975d5f86-5bphl_kube-system(249f17e8-637b-4946-8ed3-edff6860c82b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0927 01:44:40.135214 756367 logs.go:138] Found kubelet problem: Sep 27 01:44:06 old-k8s-version-745133 kubelet[736]: E0927 01:44:06.674628 736 pod_workers.go:191] Error syncing pod 989e3cab-2430-4d81-91f7-b0098b27e30c ("dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"
W0927 01:44:40.135431 756367 logs.go:138] Found kubelet problem: Sep 27 01:44:17 old-k8s-version-745133 kubelet[736]: E0927 01:44:17.675590 736 pod_workers.go:191] Error syncing pod 249f17e8-637b-4946-8ed3-edff6860c82b ("metrics-server-9975d5f86-5bphl_kube-system(249f17e8-637b-4946-8ed3-edff6860c82b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0927 01:44:40.135825 756367 logs.go:138] Found kubelet problem: Sep 27 01:44:21 old-k8s-version-745133 kubelet[736]: E0927 01:44:21.674844 736 pod_workers.go:191] Error syncing pod 989e3cab-2430-4d81-91f7-b0098b27e30c ("dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"
W0927 01:44:40.136054 756367 logs.go:138] Found kubelet problem: Sep 27 01:44:30 old-k8s-version-745133 kubelet[736]: E0927 01:44:30.675344 736 pod_workers.go:191] Error syncing pod 249f17e8-637b-4946-8ed3-edff6860c82b ("metrics-server-9975d5f86-5bphl_kube-system(249f17e8-637b-4946-8ed3-edff6860c82b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0927 01:44:40.136427 756367 logs.go:138] Found kubelet problem: Sep 27 01:44:34 old-k8s-version-745133 kubelet[736]: E0927 01:44:34.674650 736 pod_workers.go:191] Error syncing pod 989e3cab-2430-4d81-91f7-b0098b27e30c ("dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"
I0927 01:44:40.136460 756367 logs.go:123] Gathering logs for describe nodes ...
I0927 01:44:40.136492 756367 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0927 01:44:40.285959 756367 out.go:358] Setting ErrFile to fd 2...
I0927 01:44:40.285985 756367 out.go:392] TERM=,COLORTERM=, which probably does not support color
W0927 01:44:40.286068 756367 out.go:270] X Problems detected in kubelet:
X Problems detected in kubelet:
W0927 01:44:40.286083 756367 out.go:270] Sep 27 01:44:06 old-k8s-version-745133 kubelet[736]: E0927 01:44:06.674628 736 pod_workers.go:191] Error syncing pod 989e3cab-2430-4d81-91f7-b0098b27e30c ("dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"
Sep 27 01:44:06 old-k8s-version-745133 kubelet[736]: E0927 01:44:06.674628 736 pod_workers.go:191] Error syncing pod 989e3cab-2430-4d81-91f7-b0098b27e30c ("dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"
W0927 01:44:40.286120 756367 out.go:270] Sep 27 01:44:17 old-k8s-version-745133 kubelet[736]: E0927 01:44:17.675590 736 pod_workers.go:191] Error syncing pod 249f17e8-637b-4946-8ed3-edff6860c82b ("metrics-server-9975d5f86-5bphl_kube-system(249f17e8-637b-4946-8ed3-edff6860c82b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Sep 27 01:44:17 old-k8s-version-745133 kubelet[736]: E0927 01:44:17.675590 736 pod_workers.go:191] Error syncing pod 249f17e8-637b-4946-8ed3-edff6860c82b ("metrics-server-9975d5f86-5bphl_kube-system(249f17e8-637b-4946-8ed3-edff6860c82b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0927 01:44:40.286137 756367 out.go:270] Sep 27 01:44:21 old-k8s-version-745133 kubelet[736]: E0927 01:44:21.674844 736 pod_workers.go:191] Error syncing pod 989e3cab-2430-4d81-91f7-b0098b27e30c ("dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"
Sep 27 01:44:21 old-k8s-version-745133 kubelet[736]: E0927 01:44:21.674844 736 pod_workers.go:191] Error syncing pod 989e3cab-2430-4d81-91f7-b0098b27e30c ("dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"
W0927 01:44:40.286143 756367 out.go:270] Sep 27 01:44:30 old-k8s-version-745133 kubelet[736]: E0927 01:44:30.675344 736 pod_workers.go:191] Error syncing pod 249f17e8-637b-4946-8ed3-edff6860c82b ("metrics-server-9975d5f86-5bphl_kube-system(249f17e8-637b-4946-8ed3-edff6860c82b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Sep 27 01:44:30 old-k8s-version-745133 kubelet[736]: E0927 01:44:30.675344 736 pod_workers.go:191] Error syncing pod 249f17e8-637b-4946-8ed3-edff6860c82b ("metrics-server-9975d5f86-5bphl_kube-system(249f17e8-637b-4946-8ed3-edff6860c82b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0927 01:44:40.286152 756367 out.go:270] Sep 27 01:44:34 old-k8s-version-745133 kubelet[736]: E0927 01:44:34.674650 736 pod_workers.go:191] Error syncing pod 989e3cab-2430-4d81-91f7-b0098b27e30c ("dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"
Sep 27 01:44:34 old-k8s-version-745133 kubelet[736]: E0927 01:44:34.674650 736 pod_workers.go:191] Error syncing pod 989e3cab-2430-4d81-91f7-b0098b27e30c ("dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"
I0927 01:44:40.286163 756367 out.go:358] Setting ErrFile to fd 2...
I0927 01:44:40.286170 756367 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0927 01:44:50.288102 756367 api_server.go:253] Checking apiserver healthz at https://192.168.76.2:8443/healthz ...
I0927 01:44:50.299610 756367 api_server.go:279] https://192.168.76.2:8443/healthz returned 200:
ok
I0927 01:44:50.302485 756367 out.go:201]
W0927 01:44:50.305011 756367 out.go:270] X Exiting due to K8S_UNHEALTHY_CONTROL_PLANE: wait 6m0s for node: wait for healthy API server: controlPlane never updated to v1.20.0
X Exiting due to K8S_UNHEALTHY_CONTROL_PLANE: wait 6m0s for node: wait for healthy API server: controlPlane never updated to v1.20.0
W0927 01:44:50.305047 756367 out.go:270] * Suggestion: Control Plane could not update, try minikube delete --all --purge
* Suggestion: Control Plane could not update, try minikube delete --all --purge
W0927 01:44:50.305076 756367 out.go:270] * Related issue: https://github.com/kubernetes/minikube/issues/11417
* Related issue: https://github.com/kubernetes/minikube/issues/11417
W0927 01:44:50.305085 756367 out.go:270] *
*
W0927 01:44:50.305893 756367 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0927 01:44:50.309681 756367 out.go:201]
** /stderr **
start_stop_delete_test.go:259: failed to start minikube post-stop. args "out/minikube-linux-arm64 start -p old-k8s-version-745133 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --container-runtime=crio --kubernetes-version=v1.20.0": exit status 102
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:230: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/SecondStart]: docker inspect <======
helpers_test.go:231: (dbg) Run: docker inspect old-k8s-version-745133
helpers_test.go:235: (dbg) docker inspect old-k8s-version-745133:
-- stdout --
[
{
"Id": "1fb14722efe43a080319cb455e783513aeccc71eb22ae6ffe2a2fad7eb054cbd",
"Created": "2024-09-27T01:35:25.064266883Z",
"Path": "/usr/local/bin/entrypoint",
"Args": [
"/sbin/init"
],
"State": {
"Status": "running",
"Running": true,
"Paused": false,
"Restarting": false,
"OOMKilled": false,
"Dead": false,
"Pid": 756563,
"ExitCode": 0,
"Error": "",
"StartedAt": "2024-09-27T01:38:31.261910405Z",
"FinishedAt": "2024-09-27T01:38:28.876395785Z"
},
"Image": "sha256:62002f6a97ad1f6cd4117c29b1c488a6bf3b6255c8231f0d600b1bc7ba1bcfd6",
"ResolvConfPath": "/var/lib/docker/containers/1fb14722efe43a080319cb455e783513aeccc71eb22ae6ffe2a2fad7eb054cbd/resolv.conf",
"HostnamePath": "/var/lib/docker/containers/1fb14722efe43a080319cb455e783513aeccc71eb22ae6ffe2a2fad7eb054cbd/hostname",
"HostsPath": "/var/lib/docker/containers/1fb14722efe43a080319cb455e783513aeccc71eb22ae6ffe2a2fad7eb054cbd/hosts",
"LogPath": "/var/lib/docker/containers/1fb14722efe43a080319cb455e783513aeccc71eb22ae6ffe2a2fad7eb054cbd/1fb14722efe43a080319cb455e783513aeccc71eb22ae6ffe2a2fad7eb054cbd-json.log",
"Name": "/old-k8s-version-745133",
"RestartCount": 0,
"Driver": "overlay2",
"Platform": "linux",
"MountLabel": "",
"ProcessLabel": "",
"AppArmorProfile": "unconfined",
"ExecIDs": null,
"HostConfig": {
"Binds": [
"/lib/modules:/lib/modules:ro",
"old-k8s-version-745133:/var"
],
"ContainerIDFile": "",
"LogConfig": {
"Type": "json-file",
"Config": {}
},
"NetworkMode": "old-k8s-version-745133",
"PortBindings": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
]
},
"RestartPolicy": {
"Name": "no",
"MaximumRetryCount": 0
},
"AutoRemove": false,
"VolumeDriver": "",
"VolumesFrom": null,
"ConsoleSize": [
0,
0
],
"CapAdd": null,
"CapDrop": null,
"CgroupnsMode": "host",
"Dns": [],
"DnsOptions": [],
"DnsSearch": [],
"ExtraHosts": null,
"GroupAdd": null,
"IpcMode": "private",
"Cgroup": "",
"Links": null,
"OomScoreAdj": 0,
"PidMode": "",
"Privileged": true,
"PublishAllPorts": false,
"ReadonlyRootfs": false,
"SecurityOpt": [
"seccomp=unconfined",
"apparmor=unconfined",
"label=disable"
],
"Tmpfs": {
"/run": "",
"/tmp": ""
},
"UTSMode": "",
"UsernsMode": "",
"ShmSize": 67108864,
"Runtime": "runc",
"Isolation": "",
"CpuShares": 0,
"Memory": 2306867200,
"NanoCpus": 2000000000,
"CgroupParent": "",
"BlkioWeight": 0,
"BlkioWeightDevice": [],
"BlkioDeviceReadBps": [],
"BlkioDeviceWriteBps": [],
"BlkioDeviceReadIOps": [],
"BlkioDeviceWriteIOps": [],
"CpuPeriod": 0,
"CpuQuota": 0,
"CpuRealtimePeriod": 0,
"CpuRealtimeRuntime": 0,
"CpusetCpus": "",
"CpusetMems": "",
"Devices": [],
"DeviceCgroupRules": null,
"DeviceRequests": null,
"MemoryReservation": 0,
"MemorySwap": 4613734400,
"MemorySwappiness": null,
"OomKillDisable": false,
"PidsLimit": null,
"Ulimits": [],
"CpuCount": 0,
"CpuPercent": 0,
"IOMaximumIOps": 0,
"IOMaximumBandwidth": 0,
"MaskedPaths": null,
"ReadonlyPaths": null
},
"GraphDriver": {
"Data": {
"LowerDir": "/var/lib/docker/overlay2/8bd00b625bbb6997945479df7cdc39452a8ebf4d2a444713a51d41d8b0c82b9d-init/diff:/var/lib/docker/overlay2/e55adca0cb8a4469e5ee8e2f29139ff0ae0fed3b714ff629d2562144f224236f/diff",
"MergedDir": "/var/lib/docker/overlay2/8bd00b625bbb6997945479df7cdc39452a8ebf4d2a444713a51d41d8b0c82b9d/merged",
"UpperDir": "/var/lib/docker/overlay2/8bd00b625bbb6997945479df7cdc39452a8ebf4d2a444713a51d41d8b0c82b9d/diff",
"WorkDir": "/var/lib/docker/overlay2/8bd00b625bbb6997945479df7cdc39452a8ebf4d2a444713a51d41d8b0c82b9d/work"
},
"Name": "overlay2"
},
"Mounts": [
{
"Type": "bind",
"Source": "/lib/modules",
"Destination": "/lib/modules",
"Mode": "ro",
"RW": false,
"Propagation": "rprivate"
},
{
"Type": "volume",
"Name": "old-k8s-version-745133",
"Source": "/var/lib/docker/volumes/old-k8s-version-745133/_data",
"Destination": "/var",
"Driver": "local",
"Mode": "z",
"RW": true,
"Propagation": ""
}
],
"Config": {
"Hostname": "old-k8s-version-745133",
"Domainname": "",
"User": "",
"AttachStdin": false,
"AttachStdout": false,
"AttachStderr": false,
"ExposedPorts": {
"22/tcp": {},
"2376/tcp": {},
"32443/tcp": {},
"5000/tcp": {},
"8443/tcp": {}
},
"Tty": true,
"OpenStdin": false,
"StdinOnce": false,
"Env": [
"container=docker",
"PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
],
"Cmd": null,
"Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21",
"Volumes": null,
"WorkingDir": "/",
"Entrypoint": [
"/usr/local/bin/entrypoint",
"/sbin/init"
],
"OnBuild": null,
"Labels": {
"created_by.minikube.sigs.k8s.io": "true",
"mode.minikube.sigs.k8s.io": "old-k8s-version-745133",
"name.minikube.sigs.k8s.io": "old-k8s-version-745133",
"role.minikube.sigs.k8s.io": ""
},
"StopSignal": "SIGRTMIN+3"
},
"NetworkSettings": {
"Bridge": "",
"SandboxID": "4ef66e00abbceac5df55fa768e7140615a83b644288f2a6c80e0e29a25cd6c28",
"SandboxKey": "/var/run/docker/netns/4ef66e00abbc",
"Ports": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33791"
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33792"
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33795"
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33793"
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33794"
}
]
},
"HairpinMode": false,
"LinkLocalIPv6Address": "",
"LinkLocalIPv6PrefixLen": 0,
"SecondaryIPAddresses": null,
"SecondaryIPv6Addresses": null,
"EndpointID": "",
"Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"IPAddress": "",
"IPPrefixLen": 0,
"IPv6Gateway": "",
"MacAddress": "",
"Networks": {
"old-k8s-version-745133": {
"IPAMConfig": {
"IPv4Address": "192.168.76.2"
},
"Links": null,
"Aliases": null,
"MacAddress": "02:42:c0:a8:4c:02",
"DriverOpts": null,
"NetworkID": "9ae640e03652055bfc7013669fd70c59d93c7e909cf97d9a587545f2d16c1372",
"EndpointID": "e739956adfd474db77cac93206c7cf67c79864d07944336508476417b2709596",
"Gateway": "192.168.76.1",
"IPAddress": "192.168.76.2",
"IPPrefixLen": 24,
"IPv6Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"DNSNames": [
"old-k8s-version-745133",
"1fb14722efe4"
]
}
}
}
}
]
-- /stdout --
helpers_test.go:239: (dbg) Run: out/minikube-linux-arm64 status --format={{.Host}} -p old-k8s-version-745133 -n old-k8s-version-745133
helpers_test.go:244: <<< TestStartStop/group/old-k8s-version/serial/SecondStart FAILED: start of post-mortem logs <<<
helpers_test.go:245: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/SecondStart]: minikube logs <======
helpers_test.go:247: (dbg) Run: out/minikube-linux-arm64 -p old-k8s-version-745133 logs -n 25
helpers_test.go:247: (dbg) Done: out/minikube-linux-arm64 -p old-k8s-version-745133 logs -n 25: (1.878436505s)
helpers_test.go:252: TestStartStop/group/old-k8s-version/serial/SecondStart logs:
-- stdout --
==> Audit <==
|---------|--------------------------------------------------------|--------------------------|---------|---------|---------------------|---------------------|
| Command | Args | Profile | User | Version | Start Time | End Time |
|---------|--------------------------------------------------------|--------------------------|---------|---------|---------------------|---------------------|
| ssh | -p cilium-075073 sudo cat | cilium-075073 | jenkins | v1.34.0 | 27 Sep 24 01:34 UTC | |
| | /etc/containerd/config.toml | | | | | |
| ssh | -p cilium-075073 sudo | cilium-075073 | jenkins | v1.34.0 | 27 Sep 24 01:34 UTC | |
| | containerd config dump | | | | | |
| ssh | -p cilium-075073 sudo | cilium-075073 | jenkins | v1.34.0 | 27 Sep 24 01:34 UTC | |
| | systemctl status crio --all | | | | | |
| | --full --no-pager | | | | | |
| ssh | -p cilium-075073 sudo | cilium-075073 | jenkins | v1.34.0 | 27 Sep 24 01:34 UTC | |
| | systemctl cat crio --no-pager | | | | | |
| ssh | -p cilium-075073 sudo find | cilium-075073 | jenkins | v1.34.0 | 27 Sep 24 01:34 UTC | |
| | /etc/crio -type f -exec sh -c | | | | | |
| | 'echo {}; cat {}' \; | | | | | |
| ssh | -p cilium-075073 sudo crio | cilium-075073 | jenkins | v1.34.0 | 27 Sep 24 01:34 UTC | |
| | config | | | | | |
| delete | -p cilium-075073 | cilium-075073 | jenkins | v1.34.0 | 27 Sep 24 01:34 UTC | 27 Sep 24 01:34 UTC |
| start | -p cert-expiration-686343 | cert-expiration-686343 | jenkins | v1.34.0 | 27 Sep 24 01:34 UTC | 27 Sep 24 01:34 UTC |
| | --memory=2048 | | | | | |
| | --cert-expiration=3m | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=crio | | | | | |
| delete | -p force-systemd-env-980399 | force-systemd-env-980399 | jenkins | v1.34.0 | 27 Sep 24 01:34 UTC | 27 Sep 24 01:34 UTC |
| start | -p cert-options-617701 | cert-options-617701 | jenkins | v1.34.0 | 27 Sep 24 01:34 UTC | 27 Sep 24 01:35 UTC |
| | --memory=2048 | | | | | |
| | --apiserver-ips=127.0.0.1 | | | | | |
| | --apiserver-ips=192.168.15.15 | | | | | |
| | --apiserver-names=localhost | | | | | |
| | --apiserver-names=www.google.com | | | | | |
| | --apiserver-port=8555 | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=crio | | | | | |
| ssh | cert-options-617701 ssh | cert-options-617701 | jenkins | v1.34.0 | 27 Sep 24 01:35 UTC | 27 Sep 24 01:35 UTC |
| | openssl x509 -text -noout -in | | | | | |
| | /var/lib/minikube/certs/apiserver.crt | | | | | |
| ssh | -p cert-options-617701 -- sudo | cert-options-617701 | jenkins | v1.34.0 | 27 Sep 24 01:35 UTC | 27 Sep 24 01:35 UTC |
| | cat /etc/kubernetes/admin.conf | | | | | |
| delete | -p cert-options-617701 | cert-options-617701 | jenkins | v1.34.0 | 27 Sep 24 01:35 UTC | 27 Sep 24 01:35 UTC |
| start | -p old-k8s-version-745133 | old-k8s-version-745133 | jenkins | v1.34.0 | 27 Sep 24 01:35 UTC | 27 Sep 24 01:38 UTC |
| | --memory=2200 | | | | | |
| | --alsologtostderr --wait=true | | | | | |
| | --kvm-network=default | | | | | |
| | --kvm-qemu-uri=qemu:///system | | | | | |
| | --disable-driver-mounts | | | | | |
| | --keep-context=false | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=crio | | | | | |
| | --kubernetes-version=v1.20.0 | | | | | |
| start | -p cert-expiration-686343 | cert-expiration-686343 | jenkins | v1.34.0 | 27 Sep 24 01:37 UTC | 27 Sep 24 01:38 UTC |
| | --memory=2048 | | | | | |
| | --cert-expiration=8760h | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=crio | | | | | |
| delete | -p cert-expiration-686343 | cert-expiration-686343 | jenkins | v1.34.0 | 27 Sep 24 01:38 UTC | 27 Sep 24 01:38 UTC |
| start | -p no-preload-874305 | no-preload-874305 | jenkins | v1.34.0 | 27 Sep 24 01:38 UTC | 27 Sep 24 01:39 UTC |
| | --memory=2200 | | | | | |
| | --alsologtostderr | | | | | |
| | --wait=true --preload=false | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=crio | | | | | |
| | --kubernetes-version=v1.31.1 | | | | | |
| addons | enable metrics-server -p old-k8s-version-745133 | old-k8s-version-745133 | jenkins | v1.34.0 | 27 Sep 24 01:38 UTC | 27 Sep 24 01:38 UTC |
| | --images=MetricsServer=registry.k8s.io/echoserver:1.4 | | | | | |
| | --registries=MetricsServer=fake.domain | | | | | |
| stop | -p old-k8s-version-745133 | old-k8s-version-745133 | jenkins | v1.34.0 | 27 Sep 24 01:38 UTC | 27 Sep 24 01:38 UTC |
| | --alsologtostderr -v=3 | | | | | |
| addons | enable dashboard -p old-k8s-version-745133 | old-k8s-version-745133 | jenkins | v1.34.0 | 27 Sep 24 01:38 UTC | 27 Sep 24 01:38 UTC |
| | --images=MetricsScraper=registry.k8s.io/echoserver:1.4 | | | | | |
| start | -p old-k8s-version-745133 | old-k8s-version-745133 | jenkins | v1.34.0 | 27 Sep 24 01:38 UTC | |
| | --memory=2200 | | | | | |
| | --alsologtostderr --wait=true | | | | | |
| | --kvm-network=default | | | | | |
| | --kvm-qemu-uri=qemu:///system | | | | | |
| | --disable-driver-mounts | | | | | |
| | --keep-context=false | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=crio | | | | | |
| | --kubernetes-version=v1.20.0 | | | | | |
| addons | enable metrics-server -p no-preload-874305 | no-preload-874305 | jenkins | v1.34.0 | 27 Sep 24 01:39 UTC | 27 Sep 24 01:39 UTC |
| | --images=MetricsServer=registry.k8s.io/echoserver:1.4 | | | | | |
| | --registries=MetricsServer=fake.domain | | | | | |
| stop | -p no-preload-874305 | no-preload-874305 | jenkins | v1.34.0 | 27 Sep 24 01:39 UTC | 27 Sep 24 01:39 UTC |
| | --alsologtostderr -v=3 | | | | | |
| addons | enable dashboard -p no-preload-874305 | no-preload-874305 | jenkins | v1.34.0 | 27 Sep 24 01:39 UTC | 27 Sep 24 01:39 UTC |
| | --images=MetricsScraper=registry.k8s.io/echoserver:1.4 | | | | | |
| start | -p no-preload-874305 | no-preload-874305 | jenkins | v1.34.0 | 27 Sep 24 01:39 UTC | 27 Sep 24 01:44 UTC |
| | --memory=2200 | | | | | |
| | --alsologtostderr | | | | | |
| | --wait=true --preload=false | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=crio | | | | | |
| | --kubernetes-version=v1.31.1 | | | | | |
|---------|--------------------------------------------------------|--------------------------|---------|---------|---------------------|---------------------|
==> Last Start <==
Log file created at: 2024/09/27 01:39:49
Running on machine: ip-172-31-21-244
Binary: Built with gc go1.23.0 for linux/arm64
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
I0927 01:39:49.432202 760583 out.go:345] Setting OutFile to fd 1 ...
I0927 01:39:49.432403 760583 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0927 01:39:49.432416 760583 out.go:358] Setting ErrFile to fd 2...
I0927 01:39:49.432422 760583 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0927 01:39:49.432698 760583 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19711-553751/.minikube/bin
I0927 01:39:49.433086 760583 out.go:352] Setting JSON to false
I0927 01:39:49.434104 760583 start.go:129] hostinfo: {"hostname":"ip-172-31-21-244","uptime":19333,"bootTime":1727381857,"procs":210,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1070-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"da8ac1fd-6236-412a-a346-95873c98230d"}
I0927 01:39:49.434179 760583 start.go:139] virtualization:
I0927 01:39:49.438784 760583 out.go:177] * [no-preload-874305] minikube v1.34.0 on Ubuntu 20.04 (arm64)
I0927 01:39:49.441447 760583 notify.go:220] Checking for updates...
I0927 01:39:49.442342 760583 out.go:177] - MINIKUBE_LOCATION=19711
I0927 01:39:49.445712 760583 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0927 01:39:49.448323 760583 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/19711-553751/kubeconfig
I0927 01:39:49.450814 760583 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/19711-553751/.minikube
I0927 01:39:49.453320 760583 out.go:177] - MINIKUBE_BIN=out/minikube-linux-arm64
I0927 01:39:49.455825 760583 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0927 01:39:49.458935 760583 config.go:182] Loaded profile config "no-preload-874305": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.31.1
I0927 01:39:49.459662 760583 driver.go:394] Setting default libvirt URI to qemu:///system
I0927 01:39:49.488834 760583 docker.go:123] docker version: linux-27.3.1:Docker Engine - Community
I0927 01:39:49.488967 760583 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0927 01:39:49.548634 760583 info.go:266] docker info: {ID:5FDH:SA5P:5GCT:NLAS:B73P:SGDQ:PBG5:UBVH:UZY3:RXGO:CI7S:WAIH Containers:2 ContainersRunning:1 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:37 OomKillDisable:true NGoroutines:52 SystemTime:2024-09-27 01:39:49.538682777 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1070-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:a
arch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214835200 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-21-244 Labels:[] ExperimentalBuild:false ServerVersion:27.3.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c Expected:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c} RuncCommit:{ID:v1.1.14-0-g2c9f560 Expected:v1.1.14-0-g2c9f560} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:[WARNING: brid
ge-nf-call-iptables is disabled WARNING: bridge-nf-call-ip6tables is disabled] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.17.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.7]] Warnings:<nil>}}
I0927 01:39:49.548755 760583 docker.go:318] overlay module found
I0927 01:39:49.552368 760583 out.go:177] * Using the docker driver based on existing profile
I0927 01:39:49.555814 760583 start.go:297] selected driver: docker
I0927 01:39:49.555834 760583 start.go:901] validating driver "docker" against &{Name:no-preload-874305 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.1 ClusterName:no-preload-874305 Namespace:default APIServerHAVIP: APIServerNa
me:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home
/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0927 01:39:49.555985 760583 start.go:912] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0927 01:39:49.556645 760583 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0927 01:39:49.607384 760583 info.go:266] docker info: {ID:5FDH:SA5P:5GCT:NLAS:B73P:SGDQ:PBG5:UBVH:UZY3:RXGO:CI7S:WAIH Containers:2 ContainersRunning:1 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:37 OomKillDisable:true NGoroutines:52 SystemTime:2024-09-27 01:39:49.597598576 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1070-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:a
arch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214835200 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-21-244 Labels:[] ExperimentalBuild:false ServerVersion:27.3.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c Expected:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c} RuncCommit:{ID:v1.1.14-0-g2c9f560 Expected:v1.1.14-0-g2c9f560} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:[WARNING: brid
ge-nf-call-iptables is disabled WARNING: bridge-nf-call-ip6tables is disabled] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.17.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.7]] Warnings:<nil>}}
I0927 01:39:49.607782 760583 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0927 01:39:49.607809 760583 cni.go:84] Creating CNI manager for ""
I0927 01:39:49.607856 760583 cni.go:143] "docker" driver + "crio" runtime found, recommending kindnet
I0927 01:39:49.607896 760583 start.go:340] cluster config:
{Name:no-preload-874305 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.1 ClusterName:no-preload-874305 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local Containe
rRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMS
ize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0927 01:39:49.610816 760583 out.go:177] * Starting "no-preload-874305" primary control-plane node in "no-preload-874305" cluster
I0927 01:39:49.613661 760583 cache.go:121] Beginning downloading kic base image for docker with crio
I0927 01:39:49.616349 760583 out.go:177] * Pulling base image v0.0.45-1727108449-19696 ...
I0927 01:39:49.618897 760583 preload.go:131] Checking if preload exists for k8s version v1.31.1 and runtime crio
I0927 01:39:49.618984 760583 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21 in local docker daemon
I0927 01:39:49.619057 760583 profile.go:143] Saving config to /home/jenkins/minikube-integration/19711-553751/.minikube/profiles/no-preload-874305/config.json ...
I0927 01:39:49.619336 760583 cache.go:107] acquiring lock: {Name:mk287fddb7d994e156cef35db45336f739ba74e4 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0927 01:39:49.619413 760583 cache.go:115] /home/jenkins/minikube-integration/19711-553751/.minikube/cache/images/arm64/gcr.io/k8s-minikube/storage-provisioner_v5 exists
I0927 01:39:49.619421 760583 cache.go:96] cache image "gcr.io/k8s-minikube/storage-provisioner:v5" -> "/home/jenkins/minikube-integration/19711-553751/.minikube/cache/images/arm64/gcr.io/k8s-minikube/storage-provisioner_v5" took 90.148µs
I0927 01:39:49.619430 760583 cache.go:80] save to tar file gcr.io/k8s-minikube/storage-provisioner:v5 -> /home/jenkins/minikube-integration/19711-553751/.minikube/cache/images/arm64/gcr.io/k8s-minikube/storage-provisioner_v5 succeeded
I0927 01:39:49.619440 760583 cache.go:107] acquiring lock: {Name:mkb65f3b3b2406076523fec877261bcd2f104a13 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0927 01:39:49.619469 760583 cache.go:115] /home/jenkins/minikube-integration/19711-553751/.minikube/cache/images/arm64/registry.k8s.io/kube-apiserver_v1.31.1 exists
I0927 01:39:49.619474 760583 cache.go:96] cache image "registry.k8s.io/kube-apiserver:v1.31.1" -> "/home/jenkins/minikube-integration/19711-553751/.minikube/cache/images/arm64/registry.k8s.io/kube-apiserver_v1.31.1" took 35.757µs
I0927 01:39:49.619480 760583 cache.go:80] save to tar file registry.k8s.io/kube-apiserver:v1.31.1 -> /home/jenkins/minikube-integration/19711-553751/.minikube/cache/images/arm64/registry.k8s.io/kube-apiserver_v1.31.1 succeeded
I0927 01:39:49.619490 760583 cache.go:107] acquiring lock: {Name:mkeacc8440e23d159f75b969c4efd8945365fce8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0927 01:39:49.619515 760583 cache.go:115] /home/jenkins/minikube-integration/19711-553751/.minikube/cache/images/arm64/registry.k8s.io/kube-controller-manager_v1.31.1 exists
I0927 01:39:49.619519 760583 cache.go:96] cache image "registry.k8s.io/kube-controller-manager:v1.31.1" -> "/home/jenkins/minikube-integration/19711-553751/.minikube/cache/images/arm64/registry.k8s.io/kube-controller-manager_v1.31.1" took 31.663µs
I0927 01:39:49.619526 760583 cache.go:80] save to tar file registry.k8s.io/kube-controller-manager:v1.31.1 -> /home/jenkins/minikube-integration/19711-553751/.minikube/cache/images/arm64/registry.k8s.io/kube-controller-manager_v1.31.1 succeeded
I0927 01:39:49.619534 760583 cache.go:107] acquiring lock: {Name:mkc2b9c18d8a0b2eddde982edeb93c3ddd646e50 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0927 01:39:49.619562 760583 cache.go:115] /home/jenkins/minikube-integration/19711-553751/.minikube/cache/images/arm64/registry.k8s.io/kube-scheduler_v1.31.1 exists
I0927 01:39:49.619567 760583 cache.go:96] cache image "registry.k8s.io/kube-scheduler:v1.31.1" -> "/home/jenkins/minikube-integration/19711-553751/.minikube/cache/images/arm64/registry.k8s.io/kube-scheduler_v1.31.1" took 33.78µs
I0927 01:39:49.619574 760583 cache.go:80] save to tar file registry.k8s.io/kube-scheduler:v1.31.1 -> /home/jenkins/minikube-integration/19711-553751/.minikube/cache/images/arm64/registry.k8s.io/kube-scheduler_v1.31.1 succeeded
I0927 01:39:49.619591 760583 cache.go:107] acquiring lock: {Name:mk88b20634b405983ddbd1bb07b52ebc74d75efd Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0927 01:39:49.619616 760583 cache.go:115] /home/jenkins/minikube-integration/19711-553751/.minikube/cache/images/arm64/registry.k8s.io/kube-proxy_v1.31.1 exists
I0927 01:39:49.619621 760583 cache.go:96] cache image "registry.k8s.io/kube-proxy:v1.31.1" -> "/home/jenkins/minikube-integration/19711-553751/.minikube/cache/images/arm64/registry.k8s.io/kube-proxy_v1.31.1" took 38.736µs
I0927 01:39:49.619626 760583 cache.go:80] save to tar file registry.k8s.io/kube-proxy:v1.31.1 -> /home/jenkins/minikube-integration/19711-553751/.minikube/cache/images/arm64/registry.k8s.io/kube-proxy_v1.31.1 succeeded
I0927 01:39:49.619635 760583 cache.go:107] acquiring lock: {Name:mk3fb3ab1c8383c33142c34ae822518e58790cdd Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0927 01:39:49.619665 760583 cache.go:115] /home/jenkins/minikube-integration/19711-553751/.minikube/cache/images/arm64/registry.k8s.io/pause_3.10 exists
I0927 01:39:49.619670 760583 cache.go:96] cache image "registry.k8s.io/pause:3.10" -> "/home/jenkins/minikube-integration/19711-553751/.minikube/cache/images/arm64/registry.k8s.io/pause_3.10" took 35.79µs
I0927 01:39:49.619676 760583 cache.go:80] save to tar file registry.k8s.io/pause:3.10 -> /home/jenkins/minikube-integration/19711-553751/.minikube/cache/images/arm64/registry.k8s.io/pause_3.10 succeeded
I0927 01:39:49.619685 760583 cache.go:107] acquiring lock: {Name:mk553e852f036f5252f8d70bf3319da7e0cf5ed9 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0927 01:39:49.619708 760583 cache.go:115] /home/jenkins/minikube-integration/19711-553751/.minikube/cache/images/arm64/registry.k8s.io/etcd_3.5.15-0 exists
I0927 01:39:49.619713 760583 cache.go:96] cache image "registry.k8s.io/etcd:3.5.15-0" -> "/home/jenkins/minikube-integration/19711-553751/.minikube/cache/images/arm64/registry.k8s.io/etcd_3.5.15-0" took 29.168µs
I0927 01:39:49.619719 760583 cache.go:80] save to tar file registry.k8s.io/etcd:3.5.15-0 -> /home/jenkins/minikube-integration/19711-553751/.minikube/cache/images/arm64/registry.k8s.io/etcd_3.5.15-0 succeeded
I0927 01:39:49.619727 760583 cache.go:107] acquiring lock: {Name:mkdcbbf974f3e51ff7c8bb7e74b309002c26fad1 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0927 01:39:49.619752 760583 cache.go:115] /home/jenkins/minikube-integration/19711-553751/.minikube/cache/images/arm64/registry.k8s.io/coredns/coredns_v1.11.3 exists
I0927 01:39:49.619756 760583 cache.go:96] cache image "registry.k8s.io/coredns/coredns:v1.11.3" -> "/home/jenkins/minikube-integration/19711-553751/.minikube/cache/images/arm64/registry.k8s.io/coredns/coredns_v1.11.3" took 30.498µs
I0927 01:39:49.619762 760583 cache.go:80] save to tar file registry.k8s.io/coredns/coredns:v1.11.3 -> /home/jenkins/minikube-integration/19711-553751/.minikube/cache/images/arm64/registry.k8s.io/coredns/coredns_v1.11.3 succeeded
I0927 01:39:49.619771 760583 cache.go:87] Successfully saved all images to host disk.
I0927 01:39:49.639655 760583 image.go:98] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21 in local docker daemon, skipping pull
I0927 01:39:49.639679 760583 cache.go:144] gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21 exists in daemon, skipping load
I0927 01:39:49.639699 760583 cache.go:194] Successfully downloaded all kic artifacts
I0927 01:39:49.639726 760583 start.go:360] acquireMachinesLock for no-preload-874305: {Name:mk82c07c5f3bbfefcb29edf4c157dce4718ce2c8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0927 01:39:49.639791 760583 start.go:364] duration metric: took 44.298µs to acquireMachinesLock for "no-preload-874305"
I0927 01:39:49.639813 760583 start.go:96] Skipping create...Using existing machine configuration
I0927 01:39:49.639820 760583 fix.go:54] fixHost starting:
I0927 01:39:49.640078 760583 cli_runner.go:164] Run: docker container inspect no-preload-874305 --format={{.State.Status}}
I0927 01:39:49.656239 760583 fix.go:112] recreateIfNeeded on no-preload-874305: state=Stopped err=<nil>
W0927 01:39:49.656265 760583 fix.go:138] unexpected machine state, will restart: <nil>
I0927 01:39:49.660879 760583 out.go:177] * Restarting existing docker container for "no-preload-874305" ...
I0927 01:39:46.056610 756367 pod_ready.go:103] pod "kube-scheduler-old-k8s-version-745133" in "kube-system" namespace has status "Ready":"False"
I0927 01:39:48.060648 756367 pod_ready.go:103] pod "kube-scheduler-old-k8s-version-745133" in "kube-system" namespace has status "Ready":"False"
I0927 01:39:50.067560 756367 pod_ready.go:103] pod "kube-scheduler-old-k8s-version-745133" in "kube-system" namespace has status "Ready":"False"
I0927 01:39:49.663488 760583 cli_runner.go:164] Run: docker start no-preload-874305
I0927 01:39:49.948460 760583 cli_runner.go:164] Run: docker container inspect no-preload-874305 --format={{.State.Status}}
I0927 01:39:49.970297 760583 kic.go:430] container "no-preload-874305" state is running.
I0927 01:39:49.970856 760583 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" no-preload-874305
I0927 01:39:49.988592 760583 profile.go:143] Saving config to /home/jenkins/minikube-integration/19711-553751/.minikube/profiles/no-preload-874305/config.json ...
I0927 01:39:49.988833 760583 machine.go:93] provisionDockerMachine start ...
I0927 01:39:49.988902 760583 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-874305
I0927 01:39:50.020726 760583 main.go:141] libmachine: Using SSH client type: native
I0927 01:39:50.021095 760583 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x413650] 0x415e90 <nil> [] 0s} 127.0.0.1 33796 <nil> <nil>}
I0927 01:39:50.021115 760583 main.go:141] libmachine: About to run SSH command:
hostname
I0927 01:39:50.022500 760583 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:47788->127.0.0.1:33796: read: connection reset by peer
I0927 01:39:53.162365 760583 main.go:141] libmachine: SSH cmd err, output: <nil>: no-preload-874305
I0927 01:39:53.162389 760583 ubuntu.go:169] provisioning hostname "no-preload-874305"
I0927 01:39:53.162452 760583 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-874305
I0927 01:39:53.181425 760583 main.go:141] libmachine: Using SSH client type: native
I0927 01:39:53.181676 760583 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x413650] 0x415e90 <nil> [] 0s} 127.0.0.1 33796 <nil> <nil>}
I0927 01:39:53.181694 760583 main.go:141] libmachine: About to run SSH command:
sudo hostname no-preload-874305 && echo "no-preload-874305" | sudo tee /etc/hostname
I0927 01:39:53.323042 760583 main.go:141] libmachine: SSH cmd err, output: <nil>: no-preload-874305
I0927 01:39:53.323150 760583 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-874305
I0927 01:39:53.341889 760583 main.go:141] libmachine: Using SSH client type: native
I0927 01:39:53.342133 760583 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x413650] 0x415e90 <nil> [] 0s} 127.0.0.1 33796 <nil> <nil>}
I0927 01:39:53.342157 760583 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sno-preload-874305' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 no-preload-874305/g' /etc/hosts;
else
echo '127.0.1.1 no-preload-874305' | sudo tee -a /etc/hosts;
fi
fi
I0927 01:39:53.470934 760583 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0927 01:39:53.470959 760583 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/19711-553751/.minikube CaCertPath:/home/jenkins/minikube-integration/19711-553751/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19711-553751/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19711-553751/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19711-553751/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19711-553751/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19711-553751/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19711-553751/.minikube}
I0927 01:39:53.470992 760583 ubuntu.go:177] setting up certificates
I0927 01:39:53.471002 760583 provision.go:84] configureAuth start
I0927 01:39:53.471073 760583 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" no-preload-874305
I0927 01:39:53.489152 760583 provision.go:143] copyHostCerts
I0927 01:39:53.489221 760583 exec_runner.go:144] found /home/jenkins/minikube-integration/19711-553751/.minikube/ca.pem, removing ...
I0927 01:39:53.489239 760583 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19711-553751/.minikube/ca.pem
I0927 01:39:53.489315 760583 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19711-553751/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19711-553751/.minikube/ca.pem (1078 bytes)
I0927 01:39:53.489418 760583 exec_runner.go:144] found /home/jenkins/minikube-integration/19711-553751/.minikube/cert.pem, removing ...
I0927 01:39:53.489423 760583 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19711-553751/.minikube/cert.pem
I0927 01:39:53.489449 760583 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19711-553751/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19711-553751/.minikube/cert.pem (1123 bytes)
I0927 01:39:53.489507 760583 exec_runner.go:144] found /home/jenkins/minikube-integration/19711-553751/.minikube/key.pem, removing ...
I0927 01:39:53.489512 760583 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19711-553751/.minikube/key.pem
I0927 01:39:53.489535 760583 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19711-553751/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19711-553751/.minikube/key.pem (1675 bytes)
I0927 01:39:53.489588 760583 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19711-553751/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19711-553751/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19711-553751/.minikube/certs/ca-key.pem org=jenkins.no-preload-874305 san=[127.0.0.1 192.168.85.2 localhost minikube no-preload-874305]
I0927 01:39:54.143075 760583 provision.go:177] copyRemoteCerts
I0927 01:39:54.143195 760583 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0927 01:39:54.143269 760583 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-874305
I0927 01:39:54.161436 760583 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33796 SSHKeyPath:/home/jenkins/minikube-integration/19711-553751/.minikube/machines/no-preload-874305/id_rsa Username:docker}
I0927 01:39:54.255570 760583 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19711-553751/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I0927 01:39:54.280555 760583 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19711-553751/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0927 01:39:54.305959 760583 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19711-553751/.minikube/machines/server.pem --> /etc/docker/server.pem (1220 bytes)
I0927 01:39:54.331802 760583 provision.go:87] duration metric: took 860.787461ms to configureAuth
I0927 01:39:54.331828 760583 ubuntu.go:193] setting minikube options for container-runtime
I0927 01:39:54.332065 760583 config.go:182] Loaded profile config "no-preload-874305": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.31.1
I0927 01:39:54.332181 760583 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-874305
I0927 01:39:54.359508 760583 main.go:141] libmachine: Using SSH client type: native
I0927 01:39:54.359749 760583 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x413650] 0x415e90 <nil> [] 0s} 127.0.0.1 33796 <nil> <nil>}
I0927 01:39:54.359772 760583 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %s "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0927 01:39:52.556434 756367 pod_ready.go:103] pod "kube-scheduler-old-k8s-version-745133" in "kube-system" namespace has status "Ready":"False"
I0927 01:39:55.057924 756367 pod_ready.go:103] pod "kube-scheduler-old-k8s-version-745133" in "kube-system" namespace has status "Ready":"False"
I0927 01:39:54.771464 760583 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0927 01:39:54.771488 760583 machine.go:96] duration metric: took 4.78263821s to provisionDockerMachine
I0927 01:39:54.771500 760583 start.go:293] postStartSetup for "no-preload-874305" (driver="docker")
I0927 01:39:54.771512 760583 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0927 01:39:54.771592 760583 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0927 01:39:54.771632 760583 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-874305
I0927 01:39:54.793178 760583 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33796 SSHKeyPath:/home/jenkins/minikube-integration/19711-553751/.minikube/machines/no-preload-874305/id_rsa Username:docker}
I0927 01:39:54.888492 760583 ssh_runner.go:195] Run: cat /etc/os-release
I0927 01:39:54.891895 760583 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I0927 01:39:54.891931 760583 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
I0927 01:39:54.891943 760583 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
I0927 01:39:54.891950 760583 info.go:137] Remote host: Ubuntu 22.04.5 LTS
I0927 01:39:54.891962 760583 filesync.go:126] Scanning /home/jenkins/minikube-integration/19711-553751/.minikube/addons for local assets ...
I0927 01:39:54.892028 760583 filesync.go:126] Scanning /home/jenkins/minikube-integration/19711-553751/.minikube/files for local assets ...
I0927 01:39:54.892126 760583 filesync.go:149] local asset: /home/jenkins/minikube-integration/19711-553751/.minikube/files/etc/ssl/certs/5591582.pem -> 5591582.pem in /etc/ssl/certs
I0927 01:39:54.892237 760583 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0927 01:39:54.900866 760583 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19711-553751/.minikube/files/etc/ssl/certs/5591582.pem --> /etc/ssl/certs/5591582.pem (1708 bytes)
I0927 01:39:54.926153 760583 start.go:296] duration metric: took 154.6362ms for postStartSetup
I0927 01:39:54.926237 760583 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I0927 01:39:54.926281 760583 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-874305
I0927 01:39:54.944842 760583 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33796 SSHKeyPath:/home/jenkins/minikube-integration/19711-553751/.minikube/machines/no-preload-874305/id_rsa Username:docker}
I0927 01:39:55.040307 760583 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
I0927 01:39:55.045006 760583 fix.go:56] duration metric: took 5.405178101s for fixHost
I0927 01:39:55.045073 760583 start.go:83] releasing machines lock for "no-preload-874305", held for 5.405270054s
I0927 01:39:55.045180 760583 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" no-preload-874305
I0927 01:39:55.064151 760583 ssh_runner.go:195] Run: cat /version.json
I0927 01:39:55.064188 760583 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0927 01:39:55.064209 760583 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-874305
I0927 01:39:55.064264 760583 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-874305
I0927 01:39:55.085756 760583 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33796 SSHKeyPath:/home/jenkins/minikube-integration/19711-553751/.minikube/machines/no-preload-874305/id_rsa Username:docker}
I0927 01:39:55.093350 760583 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33796 SSHKeyPath:/home/jenkins/minikube-integration/19711-553751/.minikube/machines/no-preload-874305/id_rsa Username:docker}
I0927 01:39:55.321864 760583 ssh_runner.go:195] Run: systemctl --version
I0927 01:39:55.326319 760583 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0927 01:39:55.478214 760583 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
I0927 01:39:55.482895 760583 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0927 01:39:55.491833 760583 cni.go:221] loopback cni configuration disabled: "/etc/cni/net.d/*loopback.conf*" found
I0927 01:39:55.491913 760583 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0927 01:39:55.500841 760583 cni.go:259] no active bridge cni configs found in "/etc/cni/net.d" - nothing to disable
I0927 01:39:55.500865 760583 start.go:495] detecting cgroup driver to use...
I0927 01:39:55.500900 760583 detect.go:187] detected "cgroupfs" cgroup driver on host os
I0927 01:39:55.500948 760583 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0927 01:39:55.513081 760583 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0927 01:39:55.524877 760583 docker.go:217] disabling cri-docker service (if available) ...
I0927 01:39:55.524949 760583 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0927 01:39:55.538279 760583 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0927 01:39:55.549809 760583 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0927 01:39:55.634112 760583 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0927 01:39:55.725593 760583 docker.go:233] disabling docker service ...
I0927 01:39:55.725708 760583 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0927 01:39:55.738427 760583 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0927 01:39:55.751955 760583 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0927 01:39:55.833826 760583 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0927 01:39:55.918472 760583 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0927 01:39:55.929945 760583 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0927 01:39:55.947883 760583 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.10" pause image...
I0927 01:39:55.948003 760583 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.10"|' /etc/crio/crio.conf.d/02-crio.conf"
I0927 01:39:55.957585 760583 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0927 01:39:55.957697 760583 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0927 01:39:55.967782 760583 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0927 01:39:55.979683 760583 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0927 01:39:55.991131 760583 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0927 01:39:56.000969 760583 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *"net.ipv4.ip_unprivileged_port_start=.*"/d' /etc/crio/crio.conf.d/02-crio.conf"
I0927 01:39:56.012291 760583 ssh_runner.go:195] Run: sh -c "sudo grep -q "^ *default_sysctls" /etc/crio/crio.conf.d/02-crio.conf || sudo sed -i '/conmon_cgroup = .*/a default_sysctls = \[\n\]' /etc/crio/crio.conf.d/02-crio.conf"
I0927 01:39:56.023767 760583 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^default_sysctls *= *\[|&\n "net.ipv4.ip_unprivileged_port_start=0",|' /etc/crio/crio.conf.d/02-crio.conf"
I0927 01:39:56.033765 760583 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0927 01:39:56.042982 760583 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0927 01:39:56.051481 760583 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0927 01:39:56.137584 760583 ssh_runner.go:195] Run: sudo systemctl restart crio
I0927 01:39:56.248720 760583 start.go:542] Will wait 60s for socket path /var/run/crio/crio.sock
I0927 01:39:56.248824 760583 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0927 01:39:56.252650 760583 start.go:563] Will wait 60s for crictl version
I0927 01:39:56.252755 760583 ssh_runner.go:195] Run: which crictl
I0927 01:39:56.256204 760583 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0927 01:39:56.298432 760583 start.go:579] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.24.6
RuntimeApiVersion: v1
I0927 01:39:56.298522 760583 ssh_runner.go:195] Run: crio --version
I0927 01:39:56.345137 760583 ssh_runner.go:195] Run: crio --version
I0927 01:39:56.396102 760583 out.go:177] * Preparing Kubernetes v1.31.1 on CRI-O 1.24.6 ...
I0927 01:39:56.398840 760583 cli_runner.go:164] Run: docker network inspect no-preload-874305 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I0927 01:39:56.414688 760583 ssh_runner.go:195] Run: grep 192.168.85.1 host.minikube.internal$ /etc/hosts
I0927 01:39:56.418522 760583 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.85.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0927 01:39:56.429052 760583 kubeadm.go:883] updating cluster {Name:no-preload-874305 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.1 ClusterName:no-preload-874305 Namespace:default APIServerHAVIP: APIServerName:minikubeCA API
ServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikub
e-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0927 01:39:56.429182 760583 preload.go:131] Checking if preload exists for k8s version v1.31.1 and runtime crio
I0927 01:39:56.429224 760583 ssh_runner.go:195] Run: sudo crictl images --output json
I0927 01:39:56.474437 760583 crio.go:514] all images are preloaded for cri-o runtime.
I0927 01:39:56.474463 760583 cache_images.go:84] Images are preloaded, skipping loading
I0927 01:39:56.474471 760583 kubeadm.go:934] updating node { 192.168.85.2 8443 v1.31.1 crio true true} ...
I0927 01:39:56.474567 760583 kubeadm.go:946] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.31.1/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --cgroups-per-qos=false --config=/var/lib/kubelet/config.yaml --enforce-node-allocatable= --hostname-override=no-preload-874305 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.85.2
[Install]
config:
{KubernetesVersion:v1.31.1 ClusterName:no-preload-874305 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0927 01:39:56.474665 760583 ssh_runner.go:195] Run: crio config
I0927 01:39:56.529758 760583 cni.go:84] Creating CNI manager for ""
I0927 01:39:56.529788 760583 cni.go:143] "docker" driver + "crio" runtime found, recommending kindnet
I0927 01:39:56.529801 760583 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0927 01:39:56.529832 760583 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.85.2 APIServerPort:8443 KubernetesVersion:v1.31.1 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:no-preload-874305 NodeName:no-preload-874305 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.85.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.85.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc
/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///var/run/crio/crio.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
I0927 01:39:56.530023 760583 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta3
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.85.2
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: unix:///var/run/crio/crio.sock
name: "no-preload-874305"
kubeletExtraArgs:
node-ip: 192.168.85.2
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta3
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.85.2"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.31.1
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
containerRuntimeEndpoint: unix:///var/run/crio/crio.sock
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0927 01:39:56.530108 760583 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.31.1
I0927 01:39:56.543782 760583 binaries.go:44] Found k8s binaries, skipping transfer
I0927 01:39:56.543886 760583 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0927 01:39:56.555249 760583 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (367 bytes)
I0927 01:39:56.576584 760583 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0927 01:39:56.595680 760583 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2155 bytes)
I0927 01:39:56.614059 760583 ssh_runner.go:195] Run: grep 192.168.85.2 control-plane.minikube.internal$ /etc/hosts
I0927 01:39:56.618127 760583 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.85.2 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0927 01:39:56.629401 760583 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0927 01:39:56.718251 760583 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0927 01:39:56.732709 760583 certs.go:68] Setting up /home/jenkins/minikube-integration/19711-553751/.minikube/profiles/no-preload-874305 for IP: 192.168.85.2
I0927 01:39:56.732728 760583 certs.go:194] generating shared ca certs ...
I0927 01:39:56.732752 760583 certs.go:226] acquiring lock for ca certs: {Name:mkd73b356b28d0818fea73c44481b0cb2597afbb Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0927 01:39:56.732903 760583 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/19711-553751/.minikube/ca.key
I0927 01:39:56.732956 760583 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19711-553751/.minikube/proxy-client-ca.key
I0927 01:39:56.732969 760583 certs.go:256] generating profile certs ...
I0927 01:39:56.733077 760583 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/19711-553751/.minikube/profiles/no-preload-874305/client.key
I0927 01:39:56.733150 760583 certs.go:359] skipping valid signed profile cert regeneration for "minikube": /home/jenkins/minikube-integration/19711-553751/.minikube/profiles/no-preload-874305/apiserver.key.ab45eab7
I0927 01:39:56.733198 760583 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/19711-553751/.minikube/profiles/no-preload-874305/proxy-client.key
I0927 01:39:56.733309 760583 certs.go:484] found cert: /home/jenkins/minikube-integration/19711-553751/.minikube/certs/559158.pem (1338 bytes)
W0927 01:39:56.733341 760583 certs.go:480] ignoring /home/jenkins/minikube-integration/19711-553751/.minikube/certs/559158_empty.pem, impossibly tiny 0 bytes
I0927 01:39:56.733354 760583 certs.go:484] found cert: /home/jenkins/minikube-integration/19711-553751/.minikube/certs/ca-key.pem (1679 bytes)
I0927 01:39:56.733381 760583 certs.go:484] found cert: /home/jenkins/minikube-integration/19711-553751/.minikube/certs/ca.pem (1078 bytes)
I0927 01:39:56.733409 760583 certs.go:484] found cert: /home/jenkins/minikube-integration/19711-553751/.minikube/certs/cert.pem (1123 bytes)
I0927 01:39:56.733434 760583 certs.go:484] found cert: /home/jenkins/minikube-integration/19711-553751/.minikube/certs/key.pem (1675 bytes)
I0927 01:39:56.733482 760583 certs.go:484] found cert: /home/jenkins/minikube-integration/19711-553751/.minikube/files/etc/ssl/certs/5591582.pem (1708 bytes)
I0927 01:39:56.734177 760583 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19711-553751/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0927 01:39:56.759725 760583 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19711-553751/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
I0927 01:39:56.788950 760583 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19711-553751/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0927 01:39:56.818885 760583 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19711-553751/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
I0927 01:39:56.882678 760583 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19711-553751/.minikube/profiles/no-preload-874305/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1424 bytes)
I0927 01:39:56.919847 760583 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19711-553751/.minikube/profiles/no-preload-874305/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I0927 01:39:56.948201 760583 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19711-553751/.minikube/profiles/no-preload-874305/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0927 01:39:56.974025 760583 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19711-553751/.minikube/profiles/no-preload-874305/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
I0927 01:39:56.999723 760583 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19711-553751/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0927 01:39:57.024674 760583 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19711-553751/.minikube/certs/559158.pem --> /usr/share/ca-certificates/559158.pem (1338 bytes)
I0927 01:39:57.049437 760583 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19711-553751/.minikube/files/etc/ssl/certs/5591582.pem --> /usr/share/ca-certificates/5591582.pem (1708 bytes)
I0927 01:39:57.078543 760583 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0927 01:39:57.096926 760583 ssh_runner.go:195] Run: openssl version
I0927 01:39:57.103841 760583 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0927 01:39:57.113845 760583 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0927 01:39:57.117694 760583 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Sep 27 00:34 /usr/share/ca-certificates/minikubeCA.pem
I0927 01:39:57.117756 760583 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0927 01:39:57.124776 760583 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0927 01:39:57.133927 760583 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/559158.pem && ln -fs /usr/share/ca-certificates/559158.pem /etc/ssl/certs/559158.pem"
I0927 01:39:57.143005 760583 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/559158.pem
I0927 01:39:57.146615 760583 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Sep 27 00:53 /usr/share/ca-certificates/559158.pem
I0927 01:39:57.146819 760583 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/559158.pem
I0927 01:39:57.153745 760583 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/559158.pem /etc/ssl/certs/51391683.0"
I0927 01:39:57.162658 760583 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/5591582.pem && ln -fs /usr/share/ca-certificates/5591582.pem /etc/ssl/certs/5591582.pem"
I0927 01:39:57.172211 760583 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/5591582.pem
I0927 01:39:57.175809 760583 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Sep 27 00:53 /usr/share/ca-certificates/5591582.pem
I0927 01:39:57.175924 760583 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/5591582.pem
I0927 01:39:57.182775 760583 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/5591582.pem /etc/ssl/certs/3ec20f2e.0"
I0927 01:39:57.191625 760583 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0927 01:39:57.195387 760583 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-etcd-client.crt -checkend 86400
I0927 01:39:57.202285 760583 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-kubelet-client.crt -checkend 86400
I0927 01:39:57.209269 760583 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/server.crt -checkend 86400
I0927 01:39:57.216223 760583 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/healthcheck-client.crt -checkend 86400
I0927 01:39:57.223127 760583 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/peer.crt -checkend 86400
I0927 01:39:57.229901 760583 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/front-proxy-client.crt -checkend 86400
I0927 01:39:57.236817 760583 kubeadm.go:392] StartCluster: {Name:no-preload-874305 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.1 ClusterName:no-preload-874305 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APISer
verNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-h
ost Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0927 01:39:57.236919 760583 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I0927 01:39:57.237018 760583 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0927 01:39:57.282168 760583 cri.go:89] found id: ""
I0927 01:39:57.282240 760583 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0927 01:39:57.296589 760583 kubeadm.go:408] found existing configuration files, will attempt cluster restart
I0927 01:39:57.296608 760583 kubeadm.go:593] restartPrimaryControlPlane start ...
I0927 01:39:57.296659 760583 ssh_runner.go:195] Run: sudo test -d /data/minikube
I0927 01:39:57.308454 760583 kubeadm.go:130] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1
stdout:
stderr:
I0927 01:39:57.309065 760583 kubeconfig.go:47] verify endpoint returned: get endpoint: "no-preload-874305" does not appear in /home/jenkins/minikube-integration/19711-553751/kubeconfig
I0927 01:39:57.309380 760583 kubeconfig.go:62] /home/jenkins/minikube-integration/19711-553751/kubeconfig needs updating (will repair): [kubeconfig missing "no-preload-874305" cluster setting kubeconfig missing "no-preload-874305" context setting]
I0927 01:39:57.309817 760583 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19711-553751/kubeconfig: {Name:mkc30ade55bf966f83b95c0af3746bfadfd3f379 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0927 01:39:57.311292 760583 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new
I0927 01:39:57.323780 760583 kubeadm.go:630] The running cluster does not require reconfiguration: 192.168.85.2
I0927 01:39:57.323812 760583 kubeadm.go:597] duration metric: took 27.197867ms to restartPrimaryControlPlane
I0927 01:39:57.323821 760583 kubeadm.go:394] duration metric: took 87.013994ms to StartCluster
I0927 01:39:57.323837 760583 settings.go:142] acquiring lock: {Name:mk5b1f005001018637d448709269193603885722 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0927 01:39:57.323900 760583 settings.go:150] Updating kubeconfig: /home/jenkins/minikube-integration/19711-553751/kubeconfig
I0927 01:39:57.324880 760583 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19711-553751/kubeconfig: {Name:mkc30ade55bf966f83b95c0af3746bfadfd3f379 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0927 01:39:57.325061 760583 start.go:235] Will wait 6m0s for node &{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:crio ControlPlane:true Worker:true}
I0927 01:39:57.325407 760583 config.go:182] Loaded profile config "no-preload-874305": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.31.1
I0927 01:39:57.325453 760583 addons.go:507] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:true default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false]
I0927 01:39:57.325570 760583 addons.go:69] Setting storage-provisioner=true in profile "no-preload-874305"
I0927 01:39:57.325595 760583 addons.go:234] Setting addon storage-provisioner=true in "no-preload-874305"
W0927 01:39:57.325604 760583 addons.go:243] addon storage-provisioner should already be in state true
I0927 01:39:57.325626 760583 host.go:66] Checking if "no-preload-874305" exists ...
I0927 01:39:57.326172 760583 cli_runner.go:164] Run: docker container inspect no-preload-874305 --format={{.State.Status}}
I0927 01:39:57.326316 760583 addons.go:69] Setting default-storageclass=true in profile "no-preload-874305"
I0927 01:39:57.326340 760583 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "no-preload-874305"
I0927 01:39:57.326585 760583 cli_runner.go:164] Run: docker container inspect no-preload-874305 --format={{.State.Status}}
I0927 01:39:57.326652 760583 addons.go:69] Setting metrics-server=true in profile "no-preload-874305"
I0927 01:39:57.326668 760583 addons.go:234] Setting addon metrics-server=true in "no-preload-874305"
W0927 01:39:57.326674 760583 addons.go:243] addon metrics-server should already be in state true
I0927 01:39:57.326699 760583 host.go:66] Checking if "no-preload-874305" exists ...
I0927 01:39:57.327101 760583 cli_runner.go:164] Run: docker container inspect no-preload-874305 --format={{.State.Status}}
I0927 01:39:57.327831 760583 addons.go:69] Setting dashboard=true in profile "no-preload-874305"
I0927 01:39:57.327856 760583 addons.go:234] Setting addon dashboard=true in "no-preload-874305"
W0927 01:39:57.327864 760583 addons.go:243] addon dashboard should already be in state true
I0927 01:39:57.327886 760583 host.go:66] Checking if "no-preload-874305" exists ...
I0927 01:39:57.328284 760583 cli_runner.go:164] Run: docker container inspect no-preload-874305 --format={{.State.Status}}
I0927 01:39:57.331666 760583 out.go:177] * Verifying Kubernetes components...
I0927 01:39:57.334843 760583 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0927 01:39:57.385337 760583 out.go:177] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
I0927 01:39:57.388522 760583 addons.go:431] installing /etc/kubernetes/addons/storage-provisioner.yaml
I0927 01:39:57.388545 760583 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I0927 01:39:57.388608 760583 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-874305
I0927 01:39:57.395471 760583 out.go:177] - Using image fake.domain/registry.k8s.io/echoserver:1.4
I0927 01:39:57.395531 760583 out.go:177] - Using image docker.io/kubernetesui/dashboard:v2.7.0
I0927 01:39:57.398896 760583 out.go:177] - Using image registry.k8s.io/echoserver:1.4
I0927 01:39:57.398954 760583 addons.go:431] installing /etc/kubernetes/addons/metrics-apiservice.yaml
I0927 01:39:57.398971 760583 ssh_runner.go:362] scp metrics-server/metrics-apiservice.yaml --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)
I0927 01:39:57.399040 760583 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-874305
I0927 01:39:57.402079 760583 addons.go:431] installing /etc/kubernetes/addons/dashboard-ns.yaml
I0927 01:39:57.402104 760583 ssh_runner.go:362] scp dashboard/dashboard-ns.yaml --> /etc/kubernetes/addons/dashboard-ns.yaml (759 bytes)
I0927 01:39:57.402179 760583 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-874305
I0927 01:39:57.408670 760583 addons.go:234] Setting addon default-storageclass=true in "no-preload-874305"
W0927 01:39:57.408692 760583 addons.go:243] addon default-storageclass should already be in state true
I0927 01:39:57.408719 760583 host.go:66] Checking if "no-preload-874305" exists ...
I0927 01:39:57.409316 760583 cli_runner.go:164] Run: docker container inspect no-preload-874305 --format={{.State.Status}}
I0927 01:39:57.459027 760583 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33796 SSHKeyPath:/home/jenkins/minikube-integration/19711-553751/.minikube/machines/no-preload-874305/id_rsa Username:docker}
I0927 01:39:57.488269 760583 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33796 SSHKeyPath:/home/jenkins/minikube-integration/19711-553751/.minikube/machines/no-preload-874305/id_rsa Username:docker}
I0927 01:39:57.488402 760583 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33796 SSHKeyPath:/home/jenkins/minikube-integration/19711-553751/.minikube/machines/no-preload-874305/id_rsa Username:docker}
I0927 01:39:57.489371 760583 addons.go:431] installing /etc/kubernetes/addons/storageclass.yaml
I0927 01:39:57.489402 760583 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I0927 01:39:57.489462 760583 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-874305
I0927 01:39:57.518382 760583 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33796 SSHKeyPath:/home/jenkins/minikube-integration/19711-553751/.minikube/machines/no-preload-874305/id_rsa Username:docker}
I0927 01:39:57.716234 760583 addons.go:431] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
I0927 01:39:57.716305 760583 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1825 bytes)
I0927 01:39:57.775954 760583 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0927 01:39:57.780434 760583 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
I0927 01:39:57.803319 760583 addons.go:431] installing /etc/kubernetes/addons/dashboard-clusterrole.yaml
I0927 01:39:57.803346 760583 ssh_runner.go:362] scp dashboard/dashboard-clusterrole.yaml --> /etc/kubernetes/addons/dashboard-clusterrole.yaml (1001 bytes)
I0927 01:39:57.807662 760583 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I0927 01:39:57.823230 760583 addons.go:431] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
I0927 01:39:57.823258 760583 ssh_runner.go:362] scp metrics-server/metrics-server-rbac.yaml --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)
I0927 01:39:57.847328 760583 node_ready.go:35] waiting up to 6m0s for node "no-preload-874305" to be "Ready" ...
I0927 01:39:57.877088 760583 addons.go:431] installing /etc/kubernetes/addons/metrics-server-service.yaml
I0927 01:39:57.877154 760583 ssh_runner.go:362] scp metrics-server/metrics-server-service.yaml --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)
I0927 01:39:57.890050 760583 addons.go:431] installing /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml
I0927 01:39:57.890117 760583 ssh_runner.go:362] scp dashboard/dashboard-clusterrolebinding.yaml --> /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml (1018 bytes)
I0927 01:39:57.970531 760583 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0927 01:39:57.976239 760583 addons.go:431] installing /etc/kubernetes/addons/dashboard-configmap.yaml
I0927 01:39:57.976307 760583 ssh_runner.go:362] scp dashboard/dashboard-configmap.yaml --> /etc/kubernetes/addons/dashboard-configmap.yaml (837 bytes)
I0927 01:39:58.027457 760583 addons.go:431] installing /etc/kubernetes/addons/dashboard-dp.yaml
I0927 01:39:58.027535 760583 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-dp.yaml (4201 bytes)
W0927 01:39:58.071576 760583 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
error: error validating "/etc/kubernetes/addons/storageclass.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": dial tcp [::1]:8443: connect: connection refused; if you choose to ignore these errors, turn validation off with --validate=false
I0927 01:39:58.071678 760583 retry.go:31] will retry after 307.31133ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
error: error validating "/etc/kubernetes/addons/storageclass.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": dial tcp [::1]:8443: connect: connection refused; if you choose to ignore these errors, turn validation off with --validate=false
W0927 01:39:58.103084 760583 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
error: error validating "/etc/kubernetes/addons/storage-provisioner.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": dial tcp [::1]:8443: connect: connection refused; if you choose to ignore these errors, turn validation off with --validate=false
I0927 01:39:58.103171 760583 retry.go:31] will retry after 126.750889ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
error: error validating "/etc/kubernetes/addons/storage-provisioner.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": dial tcp [::1]:8443: connect: connection refused; if you choose to ignore these errors, turn validation off with --validate=false
I0927 01:39:58.110010 760583 addons.go:431] installing /etc/kubernetes/addons/dashboard-role.yaml
I0927 01:39:58.110085 760583 ssh_runner.go:362] scp dashboard/dashboard-role.yaml --> /etc/kubernetes/addons/dashboard-role.yaml (1724 bytes)
I0927 01:39:58.136581 760583 addons.go:431] installing /etc/kubernetes/addons/dashboard-rolebinding.yaml
I0927 01:39:58.136666 760583 ssh_runner.go:362] scp dashboard/dashboard-rolebinding.yaml --> /etc/kubernetes/addons/dashboard-rolebinding.yaml (1046 bytes)
W0927 01:39:58.187995 760583 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
error validating "/etc/kubernetes/addons/metrics-apiservice.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": dial tcp [::1]:8443: connect: connection refused; if you choose to ignore these errors, turn validation off with --validate=false
error validating "/etc/kubernetes/addons/metrics-server-deployment.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": dial tcp [::1]:8443: connect: connection refused; if you choose to ignore these errors, turn validation off with --validate=false
error validating "/etc/kubernetes/addons/metrics-server-rbac.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": dial tcp [::1]:8443: connect: connection refused; if you choose to ignore these errors, turn validation off with --validate=false
error validating "/etc/kubernetes/addons/metrics-server-service.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": dial tcp [::1]:8443: connect: connection refused; if you choose to ignore these errors, turn validation off with --validate=false
I0927 01:39:58.188078 760583 retry.go:31] will retry after 266.894234ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
error validating "/etc/kubernetes/addons/metrics-apiservice.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": dial tcp [::1]:8443: connect: connection refused; if you choose to ignore these errors, turn validation off with --validate=false
error validating "/etc/kubernetes/addons/metrics-server-deployment.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": dial tcp [::1]:8443: connect: connection refused; if you choose to ignore these errors, turn validation off with --validate=false
error validating "/etc/kubernetes/addons/metrics-server-rbac.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": dial tcp [::1]:8443: connect: connection refused; if you choose to ignore these errors, turn validation off with --validate=false
error validating "/etc/kubernetes/addons/metrics-server-service.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": dial tcp [::1]:8443: connect: connection refused; if you choose to ignore these errors, turn validation off with --validate=false
I0927 01:39:58.189743 760583 addons.go:431] installing /etc/kubernetes/addons/dashboard-sa.yaml
I0927 01:39:58.189802 760583 ssh_runner.go:362] scp dashboard/dashboard-sa.yaml --> /etc/kubernetes/addons/dashboard-sa.yaml (837 bytes)
I0927 01:39:58.227937 760583 addons.go:431] installing /etc/kubernetes/addons/dashboard-secret.yaml
I0927 01:39:58.228010 760583 ssh_runner.go:362] scp dashboard/dashboard-secret.yaml --> /etc/kubernetes/addons/dashboard-secret.yaml (1389 bytes)
I0927 01:39:58.230178 760583 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
I0927 01:39:58.263546 760583 addons.go:431] installing /etc/kubernetes/addons/dashboard-svc.yaml
I0927 01:39:58.263634 760583 ssh_runner.go:362] scp dashboard/dashboard-svc.yaml --> /etc/kubernetes/addons/dashboard-svc.yaml (1294 bytes)
I0927 01:39:58.303789 760583 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0927 01:39:58.359130 760583 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
error: error validating "/etc/kubernetes/addons/storage-provisioner.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": dial tcp [::1]:8443: connect: connection refused; if you choose to ignore these errors, turn validation off with --validate=false
I0927 01:39:58.359219 760583 retry.go:31] will retry after 231.162228ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
error: error validating "/etc/kubernetes/addons/storage-provisioner.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": dial tcp [::1]:8443: connect: connection refused; if you choose to ignore these errors, turn validation off with --validate=false
I0927 01:39:58.379431 760583 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
I0927 01:39:58.455850 760583 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0927 01:39:58.590529 760583 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
I0927 01:39:57.059910 756367 pod_ready.go:103] pod "kube-scheduler-old-k8s-version-745133" in "kube-system" namespace has status "Ready":"False"
I0927 01:39:59.557115 756367 pod_ready.go:103] pod "kube-scheduler-old-k8s-version-745133" in "kube-system" namespace has status "Ready":"False"
I0927 01:40:03.111742 760583 node_ready.go:49] node "no-preload-874305" has status "Ready":"True"
I0927 01:40:03.111766 760583 node_ready.go:38] duration metric: took 5.264368061s for node "no-preload-874305" to be "Ready" ...
I0927 01:40:03.111776 760583 pod_ready.go:36] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0927 01:40:03.533703 760583 pod_ready.go:79] waiting up to 6m0s for pod "coredns-7c65d6cfc9-5wdrw" in "kube-system" namespace to be "Ready" ...
I0927 01:40:03.755707 760583 pod_ready.go:93] pod "coredns-7c65d6cfc9-5wdrw" in "kube-system" namespace has status "Ready":"True"
I0927 01:40:03.755733 760583 pod_ready.go:82] duration metric: took 221.988714ms for pod "coredns-7c65d6cfc9-5wdrw" in "kube-system" namespace to be "Ready" ...
I0927 01:40:03.755748 760583 pod_ready.go:79] waiting up to 6m0s for pod "etcd-no-preload-874305" in "kube-system" namespace to be "Ready" ...
I0927 01:40:03.829904 760583 pod_ready.go:93] pod "etcd-no-preload-874305" in "kube-system" namespace has status "Ready":"True"
I0927 01:40:03.829975 760583 pod_ready.go:82] duration metric: took 74.21889ms for pod "etcd-no-preload-874305" in "kube-system" namespace to be "Ready" ...
I0927 01:40:03.830005 760583 pod_ready.go:79] waiting up to 6m0s for pod "kube-apiserver-no-preload-874305" in "kube-system" namespace to be "Ready" ...
I0927 01:40:03.899683 760583 pod_ready.go:93] pod "kube-apiserver-no-preload-874305" in "kube-system" namespace has status "Ready":"True"
I0927 01:40:03.899762 760583 pod_ready.go:82] duration metric: took 69.735167ms for pod "kube-apiserver-no-preload-874305" in "kube-system" namespace to be "Ready" ...
I0927 01:40:03.899790 760583 pod_ready.go:79] waiting up to 6m0s for pod "kube-controller-manager-no-preload-874305" in "kube-system" namespace to be "Ready" ...
I0927 01:40:03.970570 760583 pod_ready.go:93] pod "kube-controller-manager-no-preload-874305" in "kube-system" namespace has status "Ready":"True"
I0927 01:40:03.970642 760583 pod_ready.go:82] duration metric: took 70.815389ms for pod "kube-controller-manager-no-preload-874305" in "kube-system" namespace to be "Ready" ...
I0927 01:40:03.970670 760583 pod_ready.go:79] waiting up to 6m0s for pod "kube-proxy-mghm9" in "kube-system" namespace to be "Ready" ...
I0927 01:40:04.035941 760583 pod_ready.go:93] pod "kube-proxy-mghm9" in "kube-system" namespace has status "Ready":"True"
I0927 01:40:04.036019 760583 pod_ready.go:82] duration metric: took 65.326158ms for pod "kube-proxy-mghm9" in "kube-system" namespace to be "Ready" ...
I0927 01:40:04.036046 760583 pod_ready.go:79] waiting up to 6m0s for pod "kube-scheduler-no-preload-874305" in "kube-system" namespace to be "Ready" ...
I0927 01:40:04.237971 760583 pod_ready.go:93] pod "kube-scheduler-no-preload-874305" in "kube-system" namespace has status "Ready":"True"
I0927 01:40:04.238046 760583 pod_ready.go:82] duration metric: took 201.977697ms for pod "kube-scheduler-no-preload-874305" in "kube-system" namespace to be "Ready" ...
I0927 01:40:04.238074 760583 pod_ready.go:79] waiting up to 6m0s for pod "metrics-server-6867b74b74-t5lkb" in "kube-system" namespace to be "Ready" ...
I0927 01:40:05.251498 760583 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: (6.947609147s)
I0927 01:40:05.251728 760583 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: (6.872217876s)
I0927 01:40:05.251836 760583 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (6.795898035s)
I0927 01:40:05.251987 760583 addons.go:475] Verifying addon metrics-server=true in "no-preload-874305"
I0927 01:40:05.251884 760583 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: (6.66127771s)
I0927 01:40:05.254631 760583 out.go:177] * Some dashboard features require the metrics-server addon. To enable all features please run:
minikube -p no-preload-874305 addons enable metrics-server
I0927 01:40:05.268795 760583 out.go:177] * Enabled addons: metrics-server, storage-provisioner, dashboard, default-storageclass
I0927 01:40:01.557789 756367 pod_ready.go:103] pod "kube-scheduler-old-k8s-version-745133" in "kube-system" namespace has status "Ready":"False"
I0927 01:40:03.559923 756367 pod_ready.go:103] pod "kube-scheduler-old-k8s-version-745133" in "kube-system" namespace has status "Ready":"False"
I0927 01:40:05.271504 760583 addons.go:510] duration metric: took 7.946040441s for enable addons: enabled=[metrics-server storage-provisioner dashboard default-storageclass]
I0927 01:40:06.245246 760583 pod_ready.go:103] pod "metrics-server-6867b74b74-t5lkb" in "kube-system" namespace has status "Ready":"False"
I0927 01:40:08.246668 760583 pod_ready.go:103] pod "metrics-server-6867b74b74-t5lkb" in "kube-system" namespace has status "Ready":"False"
I0927 01:40:06.056636 756367 pod_ready.go:103] pod "kube-scheduler-old-k8s-version-745133" in "kube-system" namespace has status "Ready":"False"
I0927 01:40:08.057346 756367 pod_ready.go:103] pod "kube-scheduler-old-k8s-version-745133" in "kube-system" namespace has status "Ready":"False"
I0927 01:40:10.556242 756367 pod_ready.go:103] pod "kube-scheduler-old-k8s-version-745133" in "kube-system" namespace has status "Ready":"False"
I0927 01:40:10.247861 760583 pod_ready.go:103] pod "metrics-server-6867b74b74-t5lkb" in "kube-system" namespace has status "Ready":"False"
I0927 01:40:12.253586 760583 pod_ready.go:103] pod "metrics-server-6867b74b74-t5lkb" in "kube-system" namespace has status "Ready":"False"
I0927 01:40:12.556352 756367 pod_ready.go:103] pod "kube-scheduler-old-k8s-version-745133" in "kube-system" namespace has status "Ready":"False"
I0927 01:40:14.556505 756367 pod_ready.go:103] pod "kube-scheduler-old-k8s-version-745133" in "kube-system" namespace has status "Ready":"False"
I0927 01:40:14.745119 760583 pod_ready.go:103] pod "metrics-server-6867b74b74-t5lkb" in "kube-system" namespace has status "Ready":"False"
I0927 01:40:16.747653 760583 pod_ready.go:103] pod "metrics-server-6867b74b74-t5lkb" in "kube-system" namespace has status "Ready":"False"
I0927 01:40:19.249117 760583 pod_ready.go:103] pod "metrics-server-6867b74b74-t5lkb" in "kube-system" namespace has status "Ready":"False"
I0927 01:40:16.558035 756367 pod_ready.go:103] pod "kube-scheduler-old-k8s-version-745133" in "kube-system" namespace has status "Ready":"False"
I0927 01:40:19.057804 756367 pod_ready.go:103] pod "kube-scheduler-old-k8s-version-745133" in "kube-system" namespace has status "Ready":"False"
I0927 01:40:21.743856 760583 pod_ready.go:103] pod "metrics-server-6867b74b74-t5lkb" in "kube-system" namespace has status "Ready":"False"
I0927 01:40:23.745910 760583 pod_ready.go:103] pod "metrics-server-6867b74b74-t5lkb" in "kube-system" namespace has status "Ready":"False"
I0927 01:40:21.556571 756367 pod_ready.go:103] pod "kube-scheduler-old-k8s-version-745133" in "kube-system" namespace has status "Ready":"False"
I0927 01:40:23.556806 756367 pod_ready.go:103] pod "kube-scheduler-old-k8s-version-745133" in "kube-system" namespace has status "Ready":"False"
I0927 01:40:26.244896 760583 pod_ready.go:103] pod "metrics-server-6867b74b74-t5lkb" in "kube-system" namespace has status "Ready":"False"
I0927 01:40:28.744160 760583 pod_ready.go:103] pod "metrics-server-6867b74b74-t5lkb" in "kube-system" namespace has status "Ready":"False"
I0927 01:40:26.056770 756367 pod_ready.go:103] pod "kube-scheduler-old-k8s-version-745133" in "kube-system" namespace has status "Ready":"False"
I0927 01:40:27.057249 756367 pod_ready.go:93] pod "kube-scheduler-old-k8s-version-745133" in "kube-system" namespace has status "Ready":"True"
I0927 01:40:27.057275 756367 pod_ready.go:82] duration metric: took 1m20.007171419s for pod "kube-scheduler-old-k8s-version-745133" in "kube-system" namespace to be "Ready" ...
I0927 01:40:27.057288 756367 pod_ready.go:79] waiting up to 6m0s for pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace to be "Ready" ...
I0927 01:40:29.065733 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:40:31.244299 760583 pod_ready.go:103] pod "metrics-server-6867b74b74-t5lkb" in "kube-system" namespace has status "Ready":"False"
I0927 01:40:33.244963 760583 pod_ready.go:103] pod "metrics-server-6867b74b74-t5lkb" in "kube-system" namespace has status "Ready":"False"
I0927 01:40:31.562875 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:40:33.563455 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:40:35.744408 760583 pod_ready.go:103] pod "metrics-server-6867b74b74-t5lkb" in "kube-system" namespace has status "Ready":"False"
I0927 01:40:37.744641 760583 pod_ready.go:103] pod "metrics-server-6867b74b74-t5lkb" in "kube-system" namespace has status "Ready":"False"
I0927 01:40:36.066295 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:40:38.563041 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:40:40.563941 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:40:39.744709 760583 pod_ready.go:103] pod "metrics-server-6867b74b74-t5lkb" in "kube-system" namespace has status "Ready":"False"
I0927 01:40:42.244207 760583 pod_ready.go:103] pod "metrics-server-6867b74b74-t5lkb" in "kube-system" namespace has status "Ready":"False"
I0927 01:40:44.244259 760583 pod_ready.go:103] pod "metrics-server-6867b74b74-t5lkb" in "kube-system" namespace has status "Ready":"False"
I0927 01:40:43.064533 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:40:45.064689 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:40:46.744343 760583 pod_ready.go:103] pod "metrics-server-6867b74b74-t5lkb" in "kube-system" namespace has status "Ready":"False"
I0927 01:40:48.744706 760583 pod_ready.go:103] pod "metrics-server-6867b74b74-t5lkb" in "kube-system" namespace has status "Ready":"False"
I0927 01:40:47.563788 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:40:50.064619 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:40:51.244855 760583 pod_ready.go:103] pod "metrics-server-6867b74b74-t5lkb" in "kube-system" namespace has status "Ready":"False"
I0927 01:40:53.245125 760583 pod_ready.go:103] pod "metrics-server-6867b74b74-t5lkb" in "kube-system" namespace has status "Ready":"False"
I0927 01:40:52.563513 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:40:55.063431 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:40:55.744613 760583 pod_ready.go:103] pod "metrics-server-6867b74b74-t5lkb" in "kube-system" namespace has status "Ready":"False"
I0927 01:40:58.244399 760583 pod_ready.go:103] pod "metrics-server-6867b74b74-t5lkb" in "kube-system" namespace has status "Ready":"False"
I0927 01:40:57.566019 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:41:00.066276 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:41:00.245381 760583 pod_ready.go:103] pod "metrics-server-6867b74b74-t5lkb" in "kube-system" namespace has status "Ready":"False"
I0927 01:41:02.744575 760583 pod_ready.go:103] pod "metrics-server-6867b74b74-t5lkb" in "kube-system" namespace has status "Ready":"False"
I0927 01:41:02.563641 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:41:05.064215 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:41:05.245319 760583 pod_ready.go:103] pod "metrics-server-6867b74b74-t5lkb" in "kube-system" namespace has status "Ready":"False"
I0927 01:41:07.744824 760583 pod_ready.go:103] pod "metrics-server-6867b74b74-t5lkb" in "kube-system" namespace has status "Ready":"False"
I0927 01:41:07.065805 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:41:09.567334 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:41:10.244547 760583 pod_ready.go:103] pod "metrics-server-6867b74b74-t5lkb" in "kube-system" namespace has status "Ready":"False"
I0927 01:41:12.744331 760583 pod_ready.go:103] pod "metrics-server-6867b74b74-t5lkb" in "kube-system" namespace has status "Ready":"False"
I0927 01:41:12.063975 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:41:14.565667 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:41:14.744392 760583 pod_ready.go:103] pod "metrics-server-6867b74b74-t5lkb" in "kube-system" namespace has status "Ready":"False"
I0927 01:41:16.744766 760583 pod_ready.go:103] pod "metrics-server-6867b74b74-t5lkb" in "kube-system" namespace has status "Ready":"False"
I0927 01:41:19.244874 760583 pod_ready.go:103] pod "metrics-server-6867b74b74-t5lkb" in "kube-system" namespace has status "Ready":"False"
I0927 01:41:17.063897 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:41:19.563290 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:41:21.744416 760583 pod_ready.go:103] pod "metrics-server-6867b74b74-t5lkb" in "kube-system" namespace has status "Ready":"False"
I0927 01:41:23.744460 760583 pod_ready.go:103] pod "metrics-server-6867b74b74-t5lkb" in "kube-system" namespace has status "Ready":"False"
I0927 01:41:22.064314 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:41:24.563394 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:41:26.244482 760583 pod_ready.go:103] pod "metrics-server-6867b74b74-t5lkb" in "kube-system" namespace has status "Ready":"False"
I0927 01:41:28.744652 760583 pod_ready.go:103] pod "metrics-server-6867b74b74-t5lkb" in "kube-system" namespace has status "Ready":"False"
I0927 01:41:27.062663 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:41:29.063595 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:41:30.744835 760583 pod_ready.go:103] pod "metrics-server-6867b74b74-t5lkb" in "kube-system" namespace has status "Ready":"False"
I0927 01:41:33.245432 760583 pod_ready.go:103] pod "metrics-server-6867b74b74-t5lkb" in "kube-system" namespace has status "Ready":"False"
I0927 01:41:31.562923 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:41:33.562977 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:41:35.744065 760583 pod_ready.go:103] pod "metrics-server-6867b74b74-t5lkb" in "kube-system" namespace has status "Ready":"False"
I0927 01:41:37.748345 760583 pod_ready.go:103] pod "metrics-server-6867b74b74-t5lkb" in "kube-system" namespace has status "Ready":"False"
I0927 01:41:36.063772 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:41:38.564170 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:41:40.244648 760583 pod_ready.go:103] pod "metrics-server-6867b74b74-t5lkb" in "kube-system" namespace has status "Ready":"False"
I0927 01:41:42.245802 760583 pod_ready.go:103] pod "metrics-server-6867b74b74-t5lkb" in "kube-system" namespace has status "Ready":"False"
I0927 01:41:41.063198 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:41:43.063908 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:41:45.065383 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:41:44.744310 760583 pod_ready.go:103] pod "metrics-server-6867b74b74-t5lkb" in "kube-system" namespace has status "Ready":"False"
I0927 01:41:47.244995 760583 pod_ready.go:103] pod "metrics-server-6867b74b74-t5lkb" in "kube-system" namespace has status "Ready":"False"
I0927 01:41:49.245250 760583 pod_ready.go:103] pod "metrics-server-6867b74b74-t5lkb" in "kube-system" namespace has status "Ready":"False"
I0927 01:41:47.562925 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:41:49.564236 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:41:51.743817 760583 pod_ready.go:103] pod "metrics-server-6867b74b74-t5lkb" in "kube-system" namespace has status "Ready":"False"
I0927 01:41:54.245028 760583 pod_ready.go:103] pod "metrics-server-6867b74b74-t5lkb" in "kube-system" namespace has status "Ready":"False"
I0927 01:41:52.063522 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:41:54.064108 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:41:56.744679 760583 pod_ready.go:103] pod "metrics-server-6867b74b74-t5lkb" in "kube-system" namespace has status "Ready":"False"
I0927 01:41:59.243704 760583 pod_ready.go:103] pod "metrics-server-6867b74b74-t5lkb" in "kube-system" namespace has status "Ready":"False"
I0927 01:41:56.563250 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:41:58.564317 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:42:01.248635 760583 pod_ready.go:103] pod "metrics-server-6867b74b74-t5lkb" in "kube-system" namespace has status "Ready":"False"
I0927 01:42:03.744172 760583 pod_ready.go:103] pod "metrics-server-6867b74b74-t5lkb" in "kube-system" namespace has status "Ready":"False"
I0927 01:42:01.063874 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:42:03.562812 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:42:05.563181 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:42:06.243849 760583 pod_ready.go:103] pod "metrics-server-6867b74b74-t5lkb" in "kube-system" namespace has status "Ready":"False"
I0927 01:42:08.244123 760583 pod_ready.go:103] pod "metrics-server-6867b74b74-t5lkb" in "kube-system" namespace has status "Ready":"False"
I0927 01:42:07.563458 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:42:09.568052 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:42:10.744407 760583 pod_ready.go:103] pod "metrics-server-6867b74b74-t5lkb" in "kube-system" namespace has status "Ready":"False"
I0927 01:42:13.244608 760583 pod_ready.go:103] pod "metrics-server-6867b74b74-t5lkb" in "kube-system" namespace has status "Ready":"False"
I0927 01:42:12.064418 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:42:14.563145 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:42:15.744169 760583 pod_ready.go:103] pod "metrics-server-6867b74b74-t5lkb" in "kube-system" namespace has status "Ready":"False"
I0927 01:42:17.744755 760583 pod_ready.go:103] pod "metrics-server-6867b74b74-t5lkb" in "kube-system" namespace has status "Ready":"False"
I0927 01:42:17.064115 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:42:19.562933 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:42:20.245386 760583 pod_ready.go:103] pod "metrics-server-6867b74b74-t5lkb" in "kube-system" namespace has status "Ready":"False"
I0927 01:42:22.744832 760583 pod_ready.go:103] pod "metrics-server-6867b74b74-t5lkb" in "kube-system" namespace has status "Ready":"False"
I0927 01:42:21.563168 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:42:24.063568 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:42:25.244597 760583 pod_ready.go:103] pod "metrics-server-6867b74b74-t5lkb" in "kube-system" namespace has status "Ready":"False"
I0927 01:42:27.743578 760583 pod_ready.go:103] pod "metrics-server-6867b74b74-t5lkb" in "kube-system" namespace has status "Ready":"False"
I0927 01:42:26.064593 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:42:28.562897 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:42:30.562960 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:42:29.743961 760583 pod_ready.go:103] pod "metrics-server-6867b74b74-t5lkb" in "kube-system" namespace has status "Ready":"False"
I0927 01:42:31.744079 760583 pod_ready.go:103] pod "metrics-server-6867b74b74-t5lkb" in "kube-system" namespace has status "Ready":"False"
I0927 01:42:34.243858 760583 pod_ready.go:103] pod "metrics-server-6867b74b74-t5lkb" in "kube-system" namespace has status "Ready":"False"
I0927 01:42:32.564141 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:42:35.063810 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:42:36.244504 760583 pod_ready.go:103] pod "metrics-server-6867b74b74-t5lkb" in "kube-system" namespace has status "Ready":"False"
I0927 01:42:38.744787 760583 pod_ready.go:103] pod "metrics-server-6867b74b74-t5lkb" in "kube-system" namespace has status "Ready":"False"
I0927 01:42:37.563916 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:42:40.063850 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:42:41.244100 760583 pod_ready.go:103] pod "metrics-server-6867b74b74-t5lkb" in "kube-system" namespace has status "Ready":"False"
I0927 01:42:43.244511 760583 pod_ready.go:103] pod "metrics-server-6867b74b74-t5lkb" in "kube-system" namespace has status "Ready":"False"
I0927 01:42:42.562665 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:42:44.563377 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:42:45.244693 760583 pod_ready.go:103] pod "metrics-server-6867b74b74-t5lkb" in "kube-system" namespace has status "Ready":"False"
I0927 01:42:47.743863 760583 pod_ready.go:103] pod "metrics-server-6867b74b74-t5lkb" in "kube-system" namespace has status "Ready":"False"
I0927 01:42:46.563810 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:42:49.064093 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:42:49.743914 760583 pod_ready.go:103] pod "metrics-server-6867b74b74-t5lkb" in "kube-system" namespace has status "Ready":"False"
I0927 01:42:52.243861 760583 pod_ready.go:103] pod "metrics-server-6867b74b74-t5lkb" in "kube-system" namespace has status "Ready":"False"
I0927 01:42:54.244684 760583 pod_ready.go:103] pod "metrics-server-6867b74b74-t5lkb" in "kube-system" namespace has status "Ready":"False"
I0927 01:42:51.563284 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:42:53.563544 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:42:56.744390 760583 pod_ready.go:103] pod "metrics-server-6867b74b74-t5lkb" in "kube-system" namespace has status "Ready":"False"
I0927 01:42:59.244065 760583 pod_ready.go:103] pod "metrics-server-6867b74b74-t5lkb" in "kube-system" namespace has status "Ready":"False"
I0927 01:42:56.063585 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:42:58.068026 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:43:00.088088 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:43:01.245202 760583 pod_ready.go:103] pod "metrics-server-6867b74b74-t5lkb" in "kube-system" namespace has status "Ready":"False"
I0927 01:43:03.247924 760583 pod_ready.go:103] pod "metrics-server-6867b74b74-t5lkb" in "kube-system" namespace has status "Ready":"False"
I0927 01:43:02.124730 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:43:04.563544 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:43:05.744349 760583 pod_ready.go:103] pod "metrics-server-6867b74b74-t5lkb" in "kube-system" namespace has status "Ready":"False"
I0927 01:43:08.243974 760583 pod_ready.go:103] pod "metrics-server-6867b74b74-t5lkb" in "kube-system" namespace has status "Ready":"False"
I0927 01:43:06.564100 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:43:09.064077 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:43:10.244981 760583 pod_ready.go:103] pod "metrics-server-6867b74b74-t5lkb" in "kube-system" namespace has status "Ready":"False"
I0927 01:43:12.743877 760583 pod_ready.go:103] pod "metrics-server-6867b74b74-t5lkb" in "kube-system" namespace has status "Ready":"False"
I0927 01:43:11.064151 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:43:13.563466 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:43:14.745038 760583 pod_ready.go:103] pod "metrics-server-6867b74b74-t5lkb" in "kube-system" namespace has status "Ready":"False"
I0927 01:43:17.244194 760583 pod_ready.go:103] pod "metrics-server-6867b74b74-t5lkb" in "kube-system" namespace has status "Ready":"False"
I0927 01:43:16.063615 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:43:18.066965 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:43:20.069711 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:43:19.743841 760583 pod_ready.go:103] pod "metrics-server-6867b74b74-t5lkb" in "kube-system" namespace has status "Ready":"False"
I0927 01:43:21.744247 760583 pod_ready.go:103] pod "metrics-server-6867b74b74-t5lkb" in "kube-system" namespace has status "Ready":"False"
I0927 01:43:23.744326 760583 pod_ready.go:103] pod "metrics-server-6867b74b74-t5lkb" in "kube-system" namespace has status "Ready":"False"
I0927 01:43:22.563100 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:43:24.563528 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:43:26.244122 760583 pod_ready.go:103] pod "metrics-server-6867b74b74-t5lkb" in "kube-system" namespace has status "Ready":"False"
I0927 01:43:28.744658 760583 pod_ready.go:103] pod "metrics-server-6867b74b74-t5lkb" in "kube-system" namespace has status "Ready":"False"
I0927 01:43:27.063842 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:43:29.064098 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:43:31.244349 760583 pod_ready.go:103] pod "metrics-server-6867b74b74-t5lkb" in "kube-system" namespace has status "Ready":"False"
I0927 01:43:33.245189 760583 pod_ready.go:103] pod "metrics-server-6867b74b74-t5lkb" in "kube-system" namespace has status "Ready":"False"
I0927 01:43:31.064496 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:43:33.564366 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:43:35.743546 760583 pod_ready.go:103] pod "metrics-server-6867b74b74-t5lkb" in "kube-system" namespace has status "Ready":"False"
I0927 01:43:37.744304 760583 pod_ready.go:103] pod "metrics-server-6867b74b74-t5lkb" in "kube-system" namespace has status "Ready":"False"
I0927 01:43:36.063123 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:43:38.063760 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:43:40.063959 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:43:39.744382 760583 pod_ready.go:103] pod "metrics-server-6867b74b74-t5lkb" in "kube-system" namespace has status "Ready":"False"
I0927 01:43:42.244088 760583 pod_ready.go:103] pod "metrics-server-6867b74b74-t5lkb" in "kube-system" namespace has status "Ready":"False"
I0927 01:43:44.244452 760583 pod_ready.go:103] pod "metrics-server-6867b74b74-t5lkb" in "kube-system" namespace has status "Ready":"False"
I0927 01:43:42.564001 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:43:44.564177 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:43:46.744823 760583 pod_ready.go:103] pod "metrics-server-6867b74b74-t5lkb" in "kube-system" namespace has status "Ready":"False"
I0927 01:43:49.244570 760583 pod_ready.go:103] pod "metrics-server-6867b74b74-t5lkb" in "kube-system" namespace has status "Ready":"False"
I0927 01:43:47.063513 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:43:49.063777 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:43:51.744458 760583 pod_ready.go:103] pod "metrics-server-6867b74b74-t5lkb" in "kube-system" namespace has status "Ready":"False"
I0927 01:43:53.744487 760583 pod_ready.go:103] pod "metrics-server-6867b74b74-t5lkb" in "kube-system" namespace has status "Ready":"False"
I0927 01:43:51.064340 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:43:53.064600 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:43:55.564332 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:43:56.245083 760583 pod_ready.go:103] pod "metrics-server-6867b74b74-t5lkb" in "kube-system" namespace has status "Ready":"False"
I0927 01:43:58.745184 760583 pod_ready.go:103] pod "metrics-server-6867b74b74-t5lkb" in "kube-system" namespace has status "Ready":"False"
I0927 01:43:58.064170 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:44:00.065226 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:44:01.244567 760583 pod_ready.go:103] pod "metrics-server-6867b74b74-t5lkb" in "kube-system" namespace has status "Ready":"False"
I0927 01:44:03.744577 760583 pod_ready.go:103] pod "metrics-server-6867b74b74-t5lkb" in "kube-system" namespace has status "Ready":"False"
I0927 01:44:04.244654 760583 pod_ready.go:82] duration metric: took 4m0.006552829s for pod "metrics-server-6867b74b74-t5lkb" in "kube-system" namespace to be "Ready" ...
E0927 01:44:04.244682 760583 pod_ready.go:67] WaitExtra: waitPodCondition: context deadline exceeded
I0927 01:44:04.244692 760583 pod_ready.go:39] duration metric: took 4m1.132904912s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0927 01:44:04.244706 760583 api_server.go:52] waiting for apiserver process to appear ...
I0927 01:44:04.244735 760583 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I0927 01:44:04.244809 760583 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0927 01:44:04.286578 760583 cri.go:89] found id: "09dcb3356c6a19c4a374fc865a3369660b39e464338f69ef2b075183fc110f3e"
I0927 01:44:04.286604 760583 cri.go:89] found id: ""
I0927 01:44:04.286613 760583 logs.go:276] 1 containers: [09dcb3356c6a19c4a374fc865a3369660b39e464338f69ef2b075183fc110f3e]
I0927 01:44:04.286670 760583 ssh_runner.go:195] Run: which crictl
I0927 01:44:04.290915 760583 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I0927 01:44:04.290994 760583 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0927 01:44:04.331199 760583 cri.go:89] found id: "ba6bd8e0809785f219e889100450616432c1d9c8273b84573fff2275adc662c7"
I0927 01:44:04.331224 760583 cri.go:89] found id: ""
I0927 01:44:04.331232 760583 logs.go:276] 1 containers: [ba6bd8e0809785f219e889100450616432c1d9c8273b84573fff2275adc662c7]
I0927 01:44:04.331291 760583 ssh_runner.go:195] Run: which crictl
I0927 01:44:04.334983 760583 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I0927 01:44:04.335084 760583 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0927 01:44:04.381678 760583 cri.go:89] found id: "0a08936d04837493566357d0f9064f7ab2d4dd05c9200a34d3a391c374e5d142"
I0927 01:44:04.381702 760583 cri.go:89] found id: ""
I0927 01:44:04.381721 760583 logs.go:276] 1 containers: [0a08936d04837493566357d0f9064f7ab2d4dd05c9200a34d3a391c374e5d142]
I0927 01:44:04.381778 760583 ssh_runner.go:195] Run: which crictl
I0927 01:44:04.385542 760583 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I0927 01:44:04.385618 760583 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0927 01:44:04.425076 760583 cri.go:89] found id: "4e2c243d3f202b9ba2c3ed3fc36004a1a354f525c1af9a3a18e0e3869db55b31"
I0927 01:44:04.425097 760583 cri.go:89] found id: ""
I0927 01:44:04.425105 760583 logs.go:276] 1 containers: [4e2c243d3f202b9ba2c3ed3fc36004a1a354f525c1af9a3a18e0e3869db55b31]
I0927 01:44:04.425198 760583 ssh_runner.go:195] Run: which crictl
I0927 01:44:04.429023 760583 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I0927 01:44:04.429099 760583 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0927 01:44:02.563727 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:44:04.564509 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:44:04.495367 760583 cri.go:89] found id: "97f3f29a6087ab159457c975afe52b5df679696e2540a7475dd07cdd566a6421"
I0927 01:44:04.495390 760583 cri.go:89] found id: ""
I0927 01:44:04.495398 760583 logs.go:276] 1 containers: [97f3f29a6087ab159457c975afe52b5df679696e2540a7475dd07cdd566a6421]
I0927 01:44:04.495457 760583 ssh_runner.go:195] Run: which crictl
I0927 01:44:04.499012 760583 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I0927 01:44:04.499128 760583 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0927 01:44:04.548409 760583 cri.go:89] found id: "85064458a613d60c53b3ae0b7ee87b46ab9bf4d9c8e7335526ec77fdd90da0a1"
I0927 01:44:04.548441 760583 cri.go:89] found id: ""
I0927 01:44:04.548449 760583 logs.go:276] 1 containers: [85064458a613d60c53b3ae0b7ee87b46ab9bf4d9c8e7335526ec77fdd90da0a1]
I0927 01:44:04.548508 760583 ssh_runner.go:195] Run: which crictl
I0927 01:44:04.552448 760583 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I0927 01:44:04.552524 760583 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0927 01:44:04.596013 760583 cri.go:89] found id: "af121b47fb0451e00928c37c7ea5dbdc34876fc9c3f26bca2c8ccc33724b472f"
I0927 01:44:04.596078 760583 cri.go:89] found id: ""
I0927 01:44:04.596101 760583 logs.go:276] 1 containers: [af121b47fb0451e00928c37c7ea5dbdc34876fc9c3f26bca2c8ccc33724b472f]
I0927 01:44:04.596167 760583 ssh_runner.go:195] Run: which crictl
I0927 01:44:04.599905 760583 cri.go:54] listing CRI containers in root : {State:all Name:kubernetes-dashboard Namespaces:[]}
I0927 01:44:04.599987 760583 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
I0927 01:44:04.644039 760583 cri.go:89] found id: "4ed220057618f5e67044311ba1ef3a6e29470c322670689f1ccd2851aa044567"
I0927 01:44:04.644115 760583 cri.go:89] found id: ""
I0927 01:44:04.644131 760583 logs.go:276] 1 containers: [4ed220057618f5e67044311ba1ef3a6e29470c322670689f1ccd2851aa044567]
I0927 01:44:04.644191 760583 ssh_runner.go:195] Run: which crictl
I0927 01:44:04.648048 760583 cri.go:54] listing CRI containers in root : {State:all Name:storage-provisioner Namespaces:[]}
I0927 01:44:04.648125 760583 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
I0927 01:44:04.695451 760583 cri.go:89] found id: "81dfc52c2caedc6ccc568a3c88ce90a33e16b5fa1ad78c1ab5aacb0f6c1e296f"
I0927 01:44:04.695473 760583 cri.go:89] found id: "4fcb5b5f061ff6b3956e777a227057c550db431ed0232f4f4c4ea746b3f08257"
I0927 01:44:04.695478 760583 cri.go:89] found id: ""
I0927 01:44:04.695486 760583 logs.go:276] 2 containers: [81dfc52c2caedc6ccc568a3c88ce90a33e16b5fa1ad78c1ab5aacb0f6c1e296f 4fcb5b5f061ff6b3956e777a227057c550db431ed0232f4f4c4ea746b3f08257]
I0927 01:44:04.695544 760583 ssh_runner.go:195] Run: which crictl
I0927 01:44:04.699183 760583 ssh_runner.go:195] Run: which crictl
I0927 01:44:04.702594 760583 logs.go:123] Gathering logs for storage-provisioner [81dfc52c2caedc6ccc568a3c88ce90a33e16b5fa1ad78c1ab5aacb0f6c1e296f] ...
I0927 01:44:04.702619 760583 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 81dfc52c2caedc6ccc568a3c88ce90a33e16b5fa1ad78c1ab5aacb0f6c1e296f"
I0927 01:44:04.745458 760583 logs.go:123] Gathering logs for storage-provisioner [4fcb5b5f061ff6b3956e777a227057c550db431ed0232f4f4c4ea746b3f08257] ...
I0927 01:44:04.745492 760583 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 4fcb5b5f061ff6b3956e777a227057c550db431ed0232f4f4c4ea746b3f08257"
I0927 01:44:04.787899 760583 logs.go:123] Gathering logs for coredns [0a08936d04837493566357d0f9064f7ab2d4dd05c9200a34d3a391c374e5d142] ...
I0927 01:44:04.787925 760583 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 0a08936d04837493566357d0f9064f7ab2d4dd05c9200a34d3a391c374e5d142"
I0927 01:44:04.832075 760583 logs.go:123] Gathering logs for kube-scheduler [4e2c243d3f202b9ba2c3ed3fc36004a1a354f525c1af9a3a18e0e3869db55b31] ...
I0927 01:44:04.832105 760583 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 4e2c243d3f202b9ba2c3ed3fc36004a1a354f525c1af9a3a18e0e3869db55b31"
I0927 01:44:04.882054 760583 logs.go:123] Gathering logs for kubernetes-dashboard [4ed220057618f5e67044311ba1ef3a6e29470c322670689f1ccd2851aa044567] ...
I0927 01:44:04.882085 760583 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 4ed220057618f5e67044311ba1ef3a6e29470c322670689f1ccd2851aa044567"
I0927 01:44:04.920205 760583 logs.go:123] Gathering logs for etcd [ba6bd8e0809785f219e889100450616432c1d9c8273b84573fff2275adc662c7] ...
I0927 01:44:04.920235 760583 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 ba6bd8e0809785f219e889100450616432c1d9c8273b84573fff2275adc662c7"
I0927 01:44:04.971251 760583 logs.go:123] Gathering logs for kube-proxy [97f3f29a6087ab159457c975afe52b5df679696e2540a7475dd07cdd566a6421] ...
I0927 01:44:04.971284 760583 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 97f3f29a6087ab159457c975afe52b5df679696e2540a7475dd07cdd566a6421"
I0927 01:44:05.013337 760583 logs.go:123] Gathering logs for CRI-O ...
I0927 01:44:05.013365 760583 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I0927 01:44:05.092979 760583 logs.go:123] Gathering logs for dmesg ...
I0927 01:44:05.093018 760583 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0927 01:44:05.111247 760583 logs.go:123] Gathering logs for kube-apiserver [09dcb3356c6a19c4a374fc865a3369660b39e464338f69ef2b075183fc110f3e] ...
I0927 01:44:05.111276 760583 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 09dcb3356c6a19c4a374fc865a3369660b39e464338f69ef2b075183fc110f3e"
I0927 01:44:05.175272 760583 logs.go:123] Gathering logs for kube-controller-manager [85064458a613d60c53b3ae0b7ee87b46ab9bf4d9c8e7335526ec77fdd90da0a1] ...
I0927 01:44:05.175306 760583 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 85064458a613d60c53b3ae0b7ee87b46ab9bf4d9c8e7335526ec77fdd90da0a1"
I0927 01:44:05.254903 760583 logs.go:123] Gathering logs for kindnet [af121b47fb0451e00928c37c7ea5dbdc34876fc9c3f26bca2c8ccc33724b472f] ...
I0927 01:44:05.254980 760583 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 af121b47fb0451e00928c37c7ea5dbdc34876fc9c3f26bca2c8ccc33724b472f"
I0927 01:44:05.297002 760583 logs.go:123] Gathering logs for container status ...
I0927 01:44:05.297034 760583 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0927 01:44:05.344308 760583 logs.go:123] Gathering logs for kubelet ...
I0927 01:44:05.344335 760583 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
W0927 01:44:05.395357 760583 logs.go:138] Found kubelet problem: Sep 27 01:40:09 no-preload-874305 kubelet[744]: W0927 01:40:09.065999 744 reflector.go:561] object-"kubernetes-dashboard"/"kube-root-ca.crt": failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:no-preload-874305" cannot list resource "configmaps" in API group "" in the namespace "kubernetes-dashboard": no relationship found between node 'no-preload-874305' and this object
W0927 01:44:05.395640 760583 logs.go:138] Found kubelet problem: Sep 27 01:40:09 no-preload-874305 kubelet[744]: E0927 01:40:09.066042 744 reflector.go:158] "Unhandled Error" err="object-\"kubernetes-dashboard\"/\"kube-root-ca.crt\": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:no-preload-874305\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"kubernetes-dashboard\": no relationship found between node 'no-preload-874305' and this object" logger="UnhandledError"
I0927 01:44:05.437023 760583 logs.go:123] Gathering logs for describe nodes ...
I0927 01:44:05.437052 760583 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.31.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0927 01:44:05.580668 760583 out.go:358] Setting ErrFile to fd 2...
I0927 01:44:05.580697 760583 out.go:392] TERM=,COLORTERM=, which probably does not support color
W0927 01:44:05.580787 760583 out.go:270] X Problems detected in kubelet:
W0927 01:44:05.580804 760583 out.go:270] Sep 27 01:40:09 no-preload-874305 kubelet[744]: W0927 01:40:09.065999 744 reflector.go:561] object-"kubernetes-dashboard"/"kube-root-ca.crt": failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:no-preload-874305" cannot list resource "configmaps" in API group "" in the namespace "kubernetes-dashboard": no relationship found between node 'no-preload-874305' and this object
W0927 01:44:05.580811 760583 out.go:270] Sep 27 01:40:09 no-preload-874305 kubelet[744]: E0927 01:40:09.066042 744 reflector.go:158] "Unhandled Error" err="object-\"kubernetes-dashboard\"/\"kube-root-ca.crt\": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:no-preload-874305\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"kubernetes-dashboard\": no relationship found between node 'no-preload-874305' and this object" logger="UnhandledError"
I0927 01:44:05.580829 760583 out.go:358] Setting ErrFile to fd 2...
I0927 01:44:05.580835 760583 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0927 01:44:07.064530 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:44:09.563994 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:44:12.063999 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:44:14.563247 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:44:15.581701 760583 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0927 01:44:15.593283 760583 api_server.go:72] duration metric: took 4m18.268186516s to wait for apiserver process to appear ...
I0927 01:44:15.593309 760583 api_server.go:88] waiting for apiserver healthz status ...
I0927 01:44:15.593343 760583 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I0927 01:44:15.593403 760583 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0927 01:44:15.632173 760583 cri.go:89] found id: "09dcb3356c6a19c4a374fc865a3369660b39e464338f69ef2b075183fc110f3e"
I0927 01:44:15.632192 760583 cri.go:89] found id: ""
I0927 01:44:15.632199 760583 logs.go:276] 1 containers: [09dcb3356c6a19c4a374fc865a3369660b39e464338f69ef2b075183fc110f3e]
I0927 01:44:15.632257 760583 ssh_runner.go:195] Run: which crictl
I0927 01:44:15.635866 760583 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I0927 01:44:15.635934 760583 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0927 01:44:15.673475 760583 cri.go:89] found id: "ba6bd8e0809785f219e889100450616432c1d9c8273b84573fff2275adc662c7"
I0927 01:44:15.673498 760583 cri.go:89] found id: ""
I0927 01:44:15.673506 760583 logs.go:276] 1 containers: [ba6bd8e0809785f219e889100450616432c1d9c8273b84573fff2275adc662c7]
I0927 01:44:15.673614 760583 ssh_runner.go:195] Run: which crictl
I0927 01:44:15.678405 760583 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I0927 01:44:15.678478 760583 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0927 01:44:15.717347 760583 cri.go:89] found id: "0a08936d04837493566357d0f9064f7ab2d4dd05c9200a34d3a391c374e5d142"
I0927 01:44:15.717371 760583 cri.go:89] found id: ""
I0927 01:44:15.717379 760583 logs.go:276] 1 containers: [0a08936d04837493566357d0f9064f7ab2d4dd05c9200a34d3a391c374e5d142]
I0927 01:44:15.717438 760583 ssh_runner.go:195] Run: which crictl
I0927 01:44:15.720866 760583 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I0927 01:44:15.720934 760583 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0927 01:44:15.760518 760583 cri.go:89] found id: "4e2c243d3f202b9ba2c3ed3fc36004a1a354f525c1af9a3a18e0e3869db55b31"
I0927 01:44:15.760538 760583 cri.go:89] found id: ""
I0927 01:44:15.760546 760583 logs.go:276] 1 containers: [4e2c243d3f202b9ba2c3ed3fc36004a1a354f525c1af9a3a18e0e3869db55b31]
I0927 01:44:15.760601 760583 ssh_runner.go:195] Run: which crictl
I0927 01:44:15.763987 760583 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I0927 01:44:15.764054 760583 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0927 01:44:15.805594 760583 cri.go:89] found id: "97f3f29a6087ab159457c975afe52b5df679696e2540a7475dd07cdd566a6421"
I0927 01:44:15.805615 760583 cri.go:89] found id: ""
I0927 01:44:15.805623 760583 logs.go:276] 1 containers: [97f3f29a6087ab159457c975afe52b5df679696e2540a7475dd07cdd566a6421]
I0927 01:44:15.805681 760583 ssh_runner.go:195] Run: which crictl
I0927 01:44:15.809312 760583 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I0927 01:44:15.809380 760583 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0927 01:44:15.846913 760583 cri.go:89] found id: "85064458a613d60c53b3ae0b7ee87b46ab9bf4d9c8e7335526ec77fdd90da0a1"
I0927 01:44:15.846937 760583 cri.go:89] found id: ""
I0927 01:44:15.846946 760583 logs.go:276] 1 containers: [85064458a613d60c53b3ae0b7ee87b46ab9bf4d9c8e7335526ec77fdd90da0a1]
I0927 01:44:15.847001 760583 ssh_runner.go:195] Run: which crictl
I0927 01:44:15.850516 760583 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I0927 01:44:15.850606 760583 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0927 01:44:15.886460 760583 cri.go:89] found id: "af121b47fb0451e00928c37c7ea5dbdc34876fc9c3f26bca2c8ccc33724b472f"
I0927 01:44:15.886482 760583 cri.go:89] found id: ""
I0927 01:44:15.886490 760583 logs.go:276] 1 containers: [af121b47fb0451e00928c37c7ea5dbdc34876fc9c3f26bca2c8ccc33724b472f]
I0927 01:44:15.886559 760583 ssh_runner.go:195] Run: which crictl
I0927 01:44:15.889921 760583 cri.go:54] listing CRI containers in root : {State:all Name:kubernetes-dashboard Namespaces:[]}
I0927 01:44:15.890005 760583 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
I0927 01:44:15.928084 760583 cri.go:89] found id: "4ed220057618f5e67044311ba1ef3a6e29470c322670689f1ccd2851aa044567"
I0927 01:44:15.928105 760583 cri.go:89] found id: ""
I0927 01:44:15.928113 760583 logs.go:276] 1 containers: [4ed220057618f5e67044311ba1ef3a6e29470c322670689f1ccd2851aa044567]
I0927 01:44:15.928171 760583 ssh_runner.go:195] Run: which crictl
I0927 01:44:15.931779 760583 cri.go:54] listing CRI containers in root : {State:all Name:storage-provisioner Namespaces:[]}
I0927 01:44:15.931852 760583 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
I0927 01:44:15.987694 760583 cri.go:89] found id: "81dfc52c2caedc6ccc568a3c88ce90a33e16b5fa1ad78c1ab5aacb0f6c1e296f"
I0927 01:44:15.987716 760583 cri.go:89] found id: "4fcb5b5f061ff6b3956e777a227057c550db431ed0232f4f4c4ea746b3f08257"
I0927 01:44:15.987721 760583 cri.go:89] found id: ""
I0927 01:44:15.987728 760583 logs.go:276] 2 containers: [81dfc52c2caedc6ccc568a3c88ce90a33e16b5fa1ad78c1ab5aacb0f6c1e296f 4fcb5b5f061ff6b3956e777a227057c550db431ed0232f4f4c4ea746b3f08257]
I0927 01:44:15.987783 760583 ssh_runner.go:195] Run: which crictl
I0927 01:44:15.991356 760583 ssh_runner.go:195] Run: which crictl
I0927 01:44:15.995022 760583 logs.go:123] Gathering logs for kube-apiserver [09dcb3356c6a19c4a374fc865a3369660b39e464338f69ef2b075183fc110f3e] ...
I0927 01:44:15.995048 760583 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 09dcb3356c6a19c4a374fc865a3369660b39e464338f69ef2b075183fc110f3e"
I0927 01:44:16.049104 760583 logs.go:123] Gathering logs for kube-controller-manager [85064458a613d60c53b3ae0b7ee87b46ab9bf4d9c8e7335526ec77fdd90da0a1] ...
I0927 01:44:16.049139 760583 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 85064458a613d60c53b3ae0b7ee87b46ab9bf4d9c8e7335526ec77fdd90da0a1"
I0927 01:44:16.135902 760583 logs.go:123] Gathering logs for kindnet [af121b47fb0451e00928c37c7ea5dbdc34876fc9c3f26bca2c8ccc33724b472f] ...
I0927 01:44:16.135934 760583 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 af121b47fb0451e00928c37c7ea5dbdc34876fc9c3f26bca2c8ccc33724b472f"
I0927 01:44:16.179360 760583 logs.go:123] Gathering logs for storage-provisioner [4fcb5b5f061ff6b3956e777a227057c550db431ed0232f4f4c4ea746b3f08257] ...
I0927 01:44:16.179390 760583 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 4fcb5b5f061ff6b3956e777a227057c550db431ed0232f4f4c4ea746b3f08257"
I0927 01:44:16.215286 760583 logs.go:123] Gathering logs for CRI-O ...
I0927 01:44:16.215311 760583 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I0927 01:44:16.292979 760583 logs.go:123] Gathering logs for dmesg ...
I0927 01:44:16.293017 760583 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0927 01:44:16.309532 760583 logs.go:123] Gathering logs for etcd [ba6bd8e0809785f219e889100450616432c1d9c8273b84573fff2275adc662c7] ...
I0927 01:44:16.309570 760583 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 ba6bd8e0809785f219e889100450616432c1d9c8273b84573fff2275adc662c7"
I0927 01:44:16.363047 760583 logs.go:123] Gathering logs for kube-scheduler [4e2c243d3f202b9ba2c3ed3fc36004a1a354f525c1af9a3a18e0e3869db55b31] ...
I0927 01:44:16.363080 760583 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 4e2c243d3f202b9ba2c3ed3fc36004a1a354f525c1af9a3a18e0e3869db55b31"
I0927 01:44:16.424144 760583 logs.go:123] Gathering logs for kube-proxy [97f3f29a6087ab159457c975afe52b5df679696e2540a7475dd07cdd566a6421] ...
I0927 01:44:16.424174 760583 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 97f3f29a6087ab159457c975afe52b5df679696e2540a7475dd07cdd566a6421"
I0927 01:44:16.467818 760583 logs.go:123] Gathering logs for coredns [0a08936d04837493566357d0f9064f7ab2d4dd05c9200a34d3a391c374e5d142] ...
I0927 01:44:16.467896 760583 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 0a08936d04837493566357d0f9064f7ab2d4dd05c9200a34d3a391c374e5d142"
I0927 01:44:16.511519 760583 logs.go:123] Gathering logs for kubernetes-dashboard [4ed220057618f5e67044311ba1ef3a6e29470c322670689f1ccd2851aa044567] ...
I0927 01:44:16.511547 760583 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 4ed220057618f5e67044311ba1ef3a6e29470c322670689f1ccd2851aa044567"
I0927 01:44:16.567161 760583 logs.go:123] Gathering logs for kubelet ...
I0927 01:44:16.567187 760583 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
W0927 01:44:16.613215 760583 logs.go:138] Found kubelet problem: Sep 27 01:40:09 no-preload-874305 kubelet[744]: W0927 01:40:09.065999 744 reflector.go:561] object-"kubernetes-dashboard"/"kube-root-ca.crt": failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:no-preload-874305" cannot list resource "configmaps" in API group "" in the namespace "kubernetes-dashboard": no relationship found between node 'no-preload-874305' and this object
W0927 01:44:16.613492 760583 logs.go:138] Found kubelet problem: Sep 27 01:40:09 no-preload-874305 kubelet[744]: E0927 01:40:09.066042 744 reflector.go:158] "Unhandled Error" err="object-\"kubernetes-dashboard\"/\"kube-root-ca.crt\": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:no-preload-874305\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"kubernetes-dashboard\": no relationship found between node 'no-preload-874305' and this object" logger="UnhandledError"
I0927 01:44:16.656889 760583 logs.go:123] Gathering logs for describe nodes ...
I0927 01:44:16.656927 760583 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.31.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0927 01:44:16.779496 760583 logs.go:123] Gathering logs for storage-provisioner [81dfc52c2caedc6ccc568a3c88ce90a33e16b5fa1ad78c1ab5aacb0f6c1e296f] ...
I0927 01:44:16.779525 760583 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 81dfc52c2caedc6ccc568a3c88ce90a33e16b5fa1ad78c1ab5aacb0f6c1e296f"
I0927 01:44:16.823855 760583 logs.go:123] Gathering logs for container status ...
I0927 01:44:16.823887 760583 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0927 01:44:16.879353 760583 out.go:358] Setting ErrFile to fd 2...
I0927 01:44:16.879378 760583 out.go:392] TERM=,COLORTERM=, which probably does not support color
W0927 01:44:16.879458 760583 out.go:270] X Problems detected in kubelet:
W0927 01:44:16.879470 760583 out.go:270] Sep 27 01:40:09 no-preload-874305 kubelet[744]: W0927 01:40:09.065999 744 reflector.go:561] object-"kubernetes-dashboard"/"kube-root-ca.crt": failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:no-preload-874305" cannot list resource "configmaps" in API group "" in the namespace "kubernetes-dashboard": no relationship found between node 'no-preload-874305' and this object
W0927 01:44:16.879477 760583 out.go:270] Sep 27 01:40:09 no-preload-874305 kubelet[744]: E0927 01:40:09.066042 744 reflector.go:158] "Unhandled Error" err="object-\"kubernetes-dashboard\"/\"kube-root-ca.crt\": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:no-preload-874305\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"kubernetes-dashboard\": no relationship found between node 'no-preload-874305' and this object" logger="UnhandledError"
I0927 01:44:16.879597 760583 out.go:358] Setting ErrFile to fd 2...
I0927 01:44:16.879606 760583 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0927 01:44:16.589478 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:44:19.064551 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:44:21.563101 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:44:23.563795 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:44:25.564112 756367 pod_ready.go:103] pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace has status "Ready":"False"
I0927 01:44:26.880500 760583 api_server.go:253] Checking apiserver healthz at https://192.168.85.2:8443/healthz ...
I0927 01:44:26.888960 760583 api_server.go:279] https://192.168.85.2:8443/healthz returned 200:
ok
I0927 01:44:26.889921 760583 api_server.go:141] control plane version: v1.31.1
I0927 01:44:26.889943 760583 api_server.go:131] duration metric: took 11.296627418s to wait for apiserver health ...
I0927 01:44:26.889952 760583 system_pods.go:43] waiting for kube-system pods to appear ...
I0927 01:44:26.889973 760583 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I0927 01:44:26.890037 760583 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0927 01:44:26.928056 760583 cri.go:89] found id: "09dcb3356c6a19c4a374fc865a3369660b39e464338f69ef2b075183fc110f3e"
I0927 01:44:26.928075 760583 cri.go:89] found id: ""
I0927 01:44:26.928082 760583 logs.go:276] 1 containers: [09dcb3356c6a19c4a374fc865a3369660b39e464338f69ef2b075183fc110f3e]
I0927 01:44:26.928139 760583 ssh_runner.go:195] Run: which crictl
I0927 01:44:26.932211 760583 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I0927 01:44:26.932281 760583 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0927 01:44:26.983808 760583 cri.go:89] found id: "ba6bd8e0809785f219e889100450616432c1d9c8273b84573fff2275adc662c7"
I0927 01:44:26.983826 760583 cri.go:89] found id: ""
I0927 01:44:26.983834 760583 logs.go:276] 1 containers: [ba6bd8e0809785f219e889100450616432c1d9c8273b84573fff2275adc662c7]
I0927 01:44:26.983889 760583 ssh_runner.go:195] Run: which crictl
I0927 01:44:26.987698 760583 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I0927 01:44:26.987775 760583 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0927 01:44:27.026072 760583 cri.go:89] found id: "0a08936d04837493566357d0f9064f7ab2d4dd05c9200a34d3a391c374e5d142"
I0927 01:44:27.026096 760583 cri.go:89] found id: ""
I0927 01:44:27.026105 760583 logs.go:276] 1 containers: [0a08936d04837493566357d0f9064f7ab2d4dd05c9200a34d3a391c374e5d142]
I0927 01:44:27.026175 760583 ssh_runner.go:195] Run: which crictl
I0927 01:44:27.030228 760583 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I0927 01:44:27.030310 760583 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0927 01:44:27.084820 760583 cri.go:89] found id: "4e2c243d3f202b9ba2c3ed3fc36004a1a354f525c1af9a3a18e0e3869db55b31"
I0927 01:44:27.084843 760583 cri.go:89] found id: ""
I0927 01:44:27.084852 760583 logs.go:276] 1 containers: [4e2c243d3f202b9ba2c3ed3fc36004a1a354f525c1af9a3a18e0e3869db55b31]
I0927 01:44:27.084912 760583 ssh_runner.go:195] Run: which crictl
I0927 01:44:27.089536 760583 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I0927 01:44:27.089625 760583 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0927 01:44:27.150769 760583 cri.go:89] found id: "97f3f29a6087ab159457c975afe52b5df679696e2540a7475dd07cdd566a6421"
I0927 01:44:27.150794 760583 cri.go:89] found id: ""
I0927 01:44:27.150802 760583 logs.go:276] 1 containers: [97f3f29a6087ab159457c975afe52b5df679696e2540a7475dd07cdd566a6421]
I0927 01:44:27.150859 760583 ssh_runner.go:195] Run: which crictl
I0927 01:44:27.155318 760583 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I0927 01:44:27.155396 760583 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0927 01:44:27.214939 760583 cri.go:89] found id: "85064458a613d60c53b3ae0b7ee87b46ab9bf4d9c8e7335526ec77fdd90da0a1"
I0927 01:44:27.214963 760583 cri.go:89] found id: ""
I0927 01:44:27.214971 760583 logs.go:276] 1 containers: [85064458a613d60c53b3ae0b7ee87b46ab9bf4d9c8e7335526ec77fdd90da0a1]
I0927 01:44:27.215026 760583 ssh_runner.go:195] Run: which crictl
I0927 01:44:27.220857 760583 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I0927 01:44:27.220933 760583 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0927 01:44:27.278961 760583 cri.go:89] found id: "af121b47fb0451e00928c37c7ea5dbdc34876fc9c3f26bca2c8ccc33724b472f"
I0927 01:44:27.278988 760583 cri.go:89] found id: ""
I0927 01:44:27.278996 760583 logs.go:276] 1 containers: [af121b47fb0451e00928c37c7ea5dbdc34876fc9c3f26bca2c8ccc33724b472f]
I0927 01:44:27.279050 760583 ssh_runner.go:195] Run: which crictl
I0927 01:44:27.283928 760583 cri.go:54] listing CRI containers in root : {State:all Name:kubernetes-dashboard Namespaces:[]}
I0927 01:44:27.284002 760583 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
I0927 01:44:27.331343 760583 cri.go:89] found id: "4ed220057618f5e67044311ba1ef3a6e29470c322670689f1ccd2851aa044567"
I0927 01:44:27.331363 760583 cri.go:89] found id: ""
I0927 01:44:27.331372 760583 logs.go:276] 1 containers: [4ed220057618f5e67044311ba1ef3a6e29470c322670689f1ccd2851aa044567]
I0927 01:44:27.331425 760583 ssh_runner.go:195] Run: which crictl
I0927 01:44:27.335118 760583 cri.go:54] listing CRI containers in root : {State:all Name:storage-provisioner Namespaces:[]}
I0927 01:44:27.335228 760583 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
I0927 01:44:27.419376 760583 cri.go:89] found id: "81dfc52c2caedc6ccc568a3c88ce90a33e16b5fa1ad78c1ab5aacb0f6c1e296f"
I0927 01:44:27.419442 760583 cri.go:89] found id: "4fcb5b5f061ff6b3956e777a227057c550db431ed0232f4f4c4ea746b3f08257"
I0927 01:44:27.419462 760583 cri.go:89] found id: ""
I0927 01:44:27.419488 760583 logs.go:276] 2 containers: [81dfc52c2caedc6ccc568a3c88ce90a33e16b5fa1ad78c1ab5aacb0f6c1e296f 4fcb5b5f061ff6b3956e777a227057c550db431ed0232f4f4c4ea746b3f08257]
I0927 01:44:27.419572 760583 ssh_runner.go:195] Run: which crictl
I0927 01:44:27.423762 760583 ssh_runner.go:195] Run: which crictl
I0927 01:44:27.428154 760583 logs.go:123] Gathering logs for dmesg ...
I0927 01:44:27.428213 760583 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0927 01:44:27.447555 760583 logs.go:123] Gathering logs for describe nodes ...
I0927 01:44:27.447630 760583 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.31.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0927 01:44:27.604449 760583 logs.go:123] Gathering logs for kindnet [af121b47fb0451e00928c37c7ea5dbdc34876fc9c3f26bca2c8ccc33724b472f] ...
I0927 01:44:27.604480 760583 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 af121b47fb0451e00928c37c7ea5dbdc34876fc9c3f26bca2c8ccc33724b472f"
I0927 01:44:27.662509 760583 logs.go:123] Gathering logs for storage-provisioner [81dfc52c2caedc6ccc568a3c88ce90a33e16b5fa1ad78c1ab5aacb0f6c1e296f] ...
I0927 01:44:27.662539 760583 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 81dfc52c2caedc6ccc568a3c88ce90a33e16b5fa1ad78c1ab5aacb0f6c1e296f"
I0927 01:44:27.719957 760583 logs.go:123] Gathering logs for container status ...
I0927 01:44:27.719981 760583 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0927 01:44:27.800479 760583 logs.go:123] Gathering logs for coredns [0a08936d04837493566357d0f9064f7ab2d4dd05c9200a34d3a391c374e5d142] ...
I0927 01:44:27.800510 760583 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 0a08936d04837493566357d0f9064f7ab2d4dd05c9200a34d3a391c374e5d142"
I0927 01:44:27.863618 760583 logs.go:123] Gathering logs for kubelet ...
I0927 01:44:27.863773 760583 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
W0927 01:44:27.920634 760583 logs.go:138] Found kubelet problem: Sep 27 01:40:09 no-preload-874305 kubelet[744]: W0927 01:40:09.065999 744 reflector.go:561] object-"kubernetes-dashboard"/"kube-root-ca.crt": failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:no-preload-874305" cannot list resource "configmaps" in API group "" in the namespace "kubernetes-dashboard": no relationship found between node 'no-preload-874305' and this object
W0927 01:44:27.920893 760583 logs.go:138] Found kubelet problem: Sep 27 01:40:09 no-preload-874305 kubelet[744]: E0927 01:40:09.066042 744 reflector.go:158] "Unhandled Error" err="object-\"kubernetes-dashboard\"/\"kube-root-ca.crt\": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:no-preload-874305\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"kubernetes-dashboard\": no relationship found between node 'no-preload-874305' and this object" logger="UnhandledError"
I0927 01:44:27.987954 760583 logs.go:123] Gathering logs for kube-proxy [97f3f29a6087ab159457c975afe52b5df679696e2540a7475dd07cdd566a6421] ...
I0927 01:44:27.987995 760583 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 97f3f29a6087ab159457c975afe52b5df679696e2540a7475dd07cdd566a6421"
I0927 01:44:28.049357 760583 logs.go:123] Gathering logs for kubernetes-dashboard [4ed220057618f5e67044311ba1ef3a6e29470c322670689f1ccd2851aa044567] ...
I0927 01:44:28.049389 760583 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 4ed220057618f5e67044311ba1ef3a6e29470c322670689f1ccd2851aa044567"
I0927 01:44:28.109886 760583 logs.go:123] Gathering logs for storage-provisioner [4fcb5b5f061ff6b3956e777a227057c550db431ed0232f4f4c4ea746b3f08257] ...
I0927 01:44:28.109916 760583 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 4fcb5b5f061ff6b3956e777a227057c550db431ed0232f4f4c4ea746b3f08257"
I0927 01:44:28.167978 760583 logs.go:123] Gathering logs for CRI-O ...
I0927 01:44:28.168011 760583 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I0927 01:44:28.269689 760583 logs.go:123] Gathering logs for kube-apiserver [09dcb3356c6a19c4a374fc865a3369660b39e464338f69ef2b075183fc110f3e] ...
I0927 01:44:28.269725 760583 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 09dcb3356c6a19c4a374fc865a3369660b39e464338f69ef2b075183fc110f3e"
I0927 01:44:28.362483 760583 logs.go:123] Gathering logs for etcd [ba6bd8e0809785f219e889100450616432c1d9c8273b84573fff2275adc662c7] ...
I0927 01:44:28.362526 760583 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 ba6bd8e0809785f219e889100450616432c1d9c8273b84573fff2275adc662c7"
I0927 01:44:28.422457 760583 logs.go:123] Gathering logs for kube-scheduler [4e2c243d3f202b9ba2c3ed3fc36004a1a354f525c1af9a3a18e0e3869db55b31] ...
I0927 01:44:28.422497 760583 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 4e2c243d3f202b9ba2c3ed3fc36004a1a354f525c1af9a3a18e0e3869db55b31"
I0927 01:44:28.497166 760583 logs.go:123] Gathering logs for kube-controller-manager [85064458a613d60c53b3ae0b7ee87b46ab9bf4d9c8e7335526ec77fdd90da0a1] ...
I0927 01:44:28.497208 760583 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 85064458a613d60c53b3ae0b7ee87b46ab9bf4d9c8e7335526ec77fdd90da0a1"
I0927 01:44:28.612607 760583 out.go:358] Setting ErrFile to fd 2...
I0927 01:44:28.612645 760583 out.go:392] TERM=,COLORTERM=, which probably does not support color
W0927 01:44:28.612741 760583 out.go:270] X Problems detected in kubelet:
W0927 01:44:28.612770 760583 out.go:270] Sep 27 01:40:09 no-preload-874305 kubelet[744]: W0927 01:40:09.065999 744 reflector.go:561] object-"kubernetes-dashboard"/"kube-root-ca.crt": failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:no-preload-874305" cannot list resource "configmaps" in API group "" in the namespace "kubernetes-dashboard": no relationship found between node 'no-preload-874305' and this object
W0927 01:44:28.612907 760583 out.go:270] Sep 27 01:40:09 no-preload-874305 kubelet[744]: E0927 01:40:09.066042 744 reflector.go:158] "Unhandled Error" err="object-\"kubernetes-dashboard\"/\"kube-root-ca.crt\": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:no-preload-874305\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"kubernetes-dashboard\": no relationship found between node 'no-preload-874305' and this object" logger="UnhandledError"
I0927 01:44:28.612922 760583 out.go:358] Setting ErrFile to fd 2...
I0927 01:44:28.612931 760583 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0927 01:44:27.057365 756367 pod_ready.go:82] duration metric: took 4m0.000050103s for pod "metrics-server-9975d5f86-5bphl" in "kube-system" namespace to be "Ready" ...
E0927 01:44:27.057440 756367 pod_ready.go:67] WaitExtra: waitPodCondition: context deadline exceeded
I0927 01:44:27.057470 756367 pod_ready.go:39] duration metric: took 5m26.719711701s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0927 01:44:27.057518 756367 api_server.go:52] waiting for apiserver process to appear ...
I0927 01:44:27.057586 756367 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I0927 01:44:27.057674 756367 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0927 01:44:27.114452 756367 cri.go:89] found id: "728631fe1253bab9992c7a58f88fca5a34491a3d06d1a6601e0e70566e7d10f4"
I0927 01:44:27.114473 756367 cri.go:89] found id: ""
I0927 01:44:27.114482 756367 logs.go:276] 1 containers: [728631fe1253bab9992c7a58f88fca5a34491a3d06d1a6601e0e70566e7d10f4]
I0927 01:44:27.114537 756367 ssh_runner.go:195] Run: which crictl
I0927 01:44:27.120741 756367 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I0927 01:44:27.120814 756367 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0927 01:44:27.166103 756367 cri.go:89] found id: "fbfae056e26dd1b15e6b109b732296bcb89c5db7fabc0f8958574a0fc1248e81"
I0927 01:44:27.166124 756367 cri.go:89] found id: ""
I0927 01:44:27.166132 756367 logs.go:276] 1 containers: [fbfae056e26dd1b15e6b109b732296bcb89c5db7fabc0f8958574a0fc1248e81]
I0927 01:44:27.166190 756367 ssh_runner.go:195] Run: which crictl
I0927 01:44:27.172322 756367 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I0927 01:44:27.172395 756367 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0927 01:44:27.223120 756367 cri.go:89] found id: "6a28aab70700044c53668d4eceed46b67fba50e2d134c97b4c5cdd9f83c81e4a"
I0927 01:44:27.223140 756367 cri.go:89] found id: ""
I0927 01:44:27.223148 756367 logs.go:276] 1 containers: [6a28aab70700044c53668d4eceed46b67fba50e2d134c97b4c5cdd9f83c81e4a]
I0927 01:44:27.223201 756367 ssh_runner.go:195] Run: which crictl
I0927 01:44:27.227267 756367 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I0927 01:44:27.227386 756367 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0927 01:44:27.286086 756367 cri.go:89] found id: "1399d95796260c7e27b7a91a70576c5a3e3bfcfee9fb91839ddfe1b01c5114c0"
I0927 01:44:27.286147 756367 cri.go:89] found id: ""
I0927 01:44:27.286169 756367 logs.go:276] 1 containers: [1399d95796260c7e27b7a91a70576c5a3e3bfcfee9fb91839ddfe1b01c5114c0]
I0927 01:44:27.286259 756367 ssh_runner.go:195] Run: which crictl
I0927 01:44:27.290363 756367 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I0927 01:44:27.290479 756367 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0927 01:44:27.347335 756367 cri.go:89] found id: "1f91c6f77f281dbe05880609e73acc353cb7ee468afa455c7d22c45e9428661e"
I0927 01:44:27.347409 756367 cri.go:89] found id: ""
I0927 01:44:27.347440 756367 logs.go:276] 1 containers: [1f91c6f77f281dbe05880609e73acc353cb7ee468afa455c7d22c45e9428661e]
I0927 01:44:27.347530 756367 ssh_runner.go:195] Run: which crictl
I0927 01:44:27.380567 756367 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I0927 01:44:27.380651 756367 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0927 01:44:27.427366 756367 cri.go:89] found id: "fd21817034d06ff8ec30b1fa5089ddfd190af71c8dfdcde0d32fd61181caafaa"
I0927 01:44:27.427387 756367 cri.go:89] found id: ""
I0927 01:44:27.427395 756367 logs.go:276] 1 containers: [fd21817034d06ff8ec30b1fa5089ddfd190af71c8dfdcde0d32fd61181caafaa]
I0927 01:44:27.427452 756367 ssh_runner.go:195] Run: which crictl
I0927 01:44:27.433497 756367 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I0927 01:44:27.433617 756367 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0927 01:44:27.485055 756367 cri.go:89] found id: "f74f5a74223b633c3ca99ac7465604311677c0c0b43adeacf4843a7ade66ca48"
I0927 01:44:27.485130 756367 cri.go:89] found id: ""
I0927 01:44:27.485154 756367 logs.go:276] 1 containers: [f74f5a74223b633c3ca99ac7465604311677c0c0b43adeacf4843a7ade66ca48]
I0927 01:44:27.485247 756367 ssh_runner.go:195] Run: which crictl
I0927 01:44:27.489063 756367 cri.go:54] listing CRI containers in root : {State:all Name:kubernetes-dashboard Namespaces:[]}
I0927 01:44:27.489133 756367 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
I0927 01:44:27.547438 756367 cri.go:89] found id: "7a82c31e2981413dba52726ae93a9b6786429d4055c821906975f6a58bb6787c"
I0927 01:44:27.547463 756367 cri.go:89] found id: ""
I0927 01:44:27.547471 756367 logs.go:276] 1 containers: [7a82c31e2981413dba52726ae93a9b6786429d4055c821906975f6a58bb6787c]
I0927 01:44:27.547523 756367 ssh_runner.go:195] Run: which crictl
I0927 01:44:27.551928 756367 cri.go:54] listing CRI containers in root : {State:all Name:storage-provisioner Namespaces:[]}
I0927 01:44:27.551996 756367 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
I0927 01:44:27.598982 756367 cri.go:89] found id: "138c41837cf0bbda88ce0b41c3d306956ef57ff9c2cb680fa71af1f16e609832"
I0927 01:44:27.599002 756367 cri.go:89] found id: ""
I0927 01:44:27.599009 756367 logs.go:276] 1 containers: [138c41837cf0bbda88ce0b41c3d306956ef57ff9c2cb680fa71af1f16e609832]
I0927 01:44:27.599063 756367 ssh_runner.go:195] Run: which crictl
I0927 01:44:27.609032 756367 logs.go:123] Gathering logs for kubelet ...
I0927 01:44:27.609060 756367 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
W0927 01:44:27.686472 756367 logs.go:138] Found kubelet problem: Sep 27 01:39:00 old-k8s-version-745133 kubelet[736]: E0927 01:39:00.276608 736 reflector.go:138] object-"kube-system"/"coredns": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "coredns" is forbidden: User "system:node:old-k8s-version-745133" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-745133' and this object
W0927 01:44:27.686776 756367 logs.go:138] Found kubelet problem: Sep 27 01:39:00 old-k8s-version-745133 kubelet[736]: E0927 01:39:00.277156 736 reflector.go:138] object-"kube-system"/"kube-proxy-token-mdl25": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kube-proxy-token-mdl25" is forbidden: User "system:node:old-k8s-version-745133" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-745133' and this object
W0927 01:44:27.687011 756367 logs.go:138] Found kubelet problem: Sep 27 01:39:00 old-k8s-version-745133 kubelet[736]: E0927 01:39:00.277414 736 reflector.go:138] object-"kube-system"/"kube-proxy": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-proxy" is forbidden: User "system:node:old-k8s-version-745133" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-745133' and this object
W0927 01:44:27.687250 756367 logs.go:138] Found kubelet problem: Sep 27 01:39:00 old-k8s-version-745133 kubelet[736]: E0927 01:39:00.277602 736 reflector.go:138] object-"kube-system"/"kindnet-token-jwlc6": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kindnet-token-jwlc6" is forbidden: User "system:node:old-k8s-version-745133" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-745133' and this object
W0927 01:44:27.687495 756367 logs.go:138] Found kubelet problem: Sep 27 01:39:00 old-k8s-version-745133 kubelet[736]: E0927 01:39:00.277796 736 reflector.go:138] object-"kube-system"/"coredns-token-k4cmv": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "coredns-token-k4cmv" is forbidden: User "system:node:old-k8s-version-745133" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-745133' and this object
W0927 01:44:27.687749 756367 logs.go:138] Found kubelet problem: Sep 27 01:39:00 old-k8s-version-745133 kubelet[736]: E0927 01:39:00.277995 736 reflector.go:138] object-"kube-system"/"storage-provisioner-token-tgp2f": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "storage-provisioner-token-tgp2f" is forbidden: User "system:node:old-k8s-version-745133" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-745133' and this object
W0927 01:44:27.687997 756367 logs.go:138] Found kubelet problem: Sep 27 01:39:00 old-k8s-version-745133 kubelet[736]: E0927 01:39:00.278201 736 reflector.go:138] object-"kube-system"/"metrics-server-token-9xfpw": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "metrics-server-token-9xfpw" is forbidden: User "system:node:old-k8s-version-745133" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-745133' and this object
W0927 01:44:27.688232 756367 logs.go:138] Found kubelet problem: Sep 27 01:39:00 old-k8s-version-745133 kubelet[736]: E0927 01:39:00.278383 736 reflector.go:138] object-"default"/"default-token-lm75v": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "default-token-lm75v" is forbidden: User "system:node:old-k8s-version-745133" cannot list resource "secrets" in API group "" in the namespace "default": no relationship found between node 'old-k8s-version-745133' and this object
W0927 01:44:27.697891 756367 logs.go:138] Found kubelet problem: Sep 27 01:39:03 old-k8s-version-745133 kubelet[736]: E0927 01:39:03.038144 736 pod_workers.go:191] Error syncing pod 249f17e8-637b-4946-8ed3-edff6860c82b ("metrics-server-9975d5f86-5bphl_kube-system(249f17e8-637b-4946-8ed3-edff6860c82b)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = pinging container registry fake.domain: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain: no such host"
W0927 01:44:27.698105 756367 logs.go:138] Found kubelet problem: Sep 27 01:39:03 old-k8s-version-745133 kubelet[736]: E0927 01:39:03.733711 736 pod_workers.go:191] Error syncing pod 249f17e8-637b-4946-8ed3-edff6860c82b ("metrics-server-9975d5f86-5bphl_kube-system(249f17e8-637b-4946-8ed3-edff6860c82b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0927 01:44:27.700305 756367 logs.go:138] Found kubelet problem: Sep 27 01:39:17 old-k8s-version-745133 kubelet[736]: E0927 01:39:17.695628 736 pod_workers.go:191] Error syncing pod 249f17e8-637b-4946-8ed3-edff6860c82b ("metrics-server-9975d5f86-5bphl_kube-system(249f17e8-637b-4946-8ed3-edff6860c82b)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = pinging container registry fake.domain: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain: no such host"
W0927 01:44:27.700757 756367 logs.go:138] Found kubelet problem: Sep 27 01:39:19 old-k8s-version-745133 kubelet[736]: E0927 01:39:19.799354 736 reflector.go:138] object-"kubernetes-dashboard"/"kubernetes-dashboard-token-hcwf2": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kubernetes-dashboard-token-hcwf2" is forbidden: User "system:node:old-k8s-version-745133" cannot list resource "secrets" in API group "" in the namespace "kubernetes-dashboard": no relationship found between node 'old-k8s-version-745133' and this object
W0927 01:44:27.703093 756367 logs.go:138] Found kubelet problem: Sep 27 01:39:28 old-k8s-version-745133 kubelet[736]: E0927 01:39:28.679675 736 pod_workers.go:191] Error syncing pod 249f17e8-637b-4946-8ed3-edff6860c82b ("metrics-server-9975d5f86-5bphl_kube-system(249f17e8-637b-4946-8ed3-edff6860c82b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0927 01:44:27.703606 756367 logs.go:138] Found kubelet problem: Sep 27 01:39:31 old-k8s-version-745133 kubelet[736]: E0927 01:39:31.971044 736 pod_workers.go:191] Error syncing pod 989e3cab-2430-4d81-91f7-b0098b27e30c ("dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"
W0927 01:44:27.704100 756367 logs.go:138] Found kubelet problem: Sep 27 01:39:32 old-k8s-version-745133 kubelet[736]: E0927 01:39:32.973106 736 pod_workers.go:191] Error syncing pod 989e3cab-2430-4d81-91f7-b0098b27e30c ("dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"
W0927 01:44:27.704469 756367 logs.go:138] Found kubelet problem: Sep 27 01:39:39 old-k8s-version-745133 kubelet[736]: E0927 01:39:39.607023 736 pod_workers.go:191] Error syncing pod 989e3cab-2430-4d81-91f7-b0098b27e30c ("dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"
W0927 01:44:27.706606 756367 logs.go:138] Found kubelet problem: Sep 27 01:39:43 old-k8s-version-745133 kubelet[736]: E0927 01:39:43.686128 736 pod_workers.go:191] Error syncing pod 249f17e8-637b-4946-8ed3-edff6860c82b ("metrics-server-9975d5f86-5bphl_kube-system(249f17e8-637b-4946-8ed3-edff6860c82b)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = pinging container registry fake.domain: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain: no such host"
W0927 01:44:27.707301 756367 logs.go:138] Found kubelet problem: Sep 27 01:39:55 old-k8s-version-745133 kubelet[736]: E0927 01:39:55.013155 736 pod_workers.go:191] Error syncing pod 989e3cab-2430-4d81-91f7-b0098b27e30c ("dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"
W0927 01:44:27.707523 756367 logs.go:138] Found kubelet problem: Sep 27 01:39:58 old-k8s-version-745133 kubelet[736]: E0927 01:39:58.675275 736 pod_workers.go:191] Error syncing pod 249f17e8-637b-4946-8ed3-edff6860c82b ("metrics-server-9975d5f86-5bphl_kube-system(249f17e8-637b-4946-8ed3-edff6860c82b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0927 01:44:27.707878 756367 logs.go:138] Found kubelet problem: Sep 27 01:39:59 old-k8s-version-745133 kubelet[736]: E0927 01:39:59.607420 736 pod_workers.go:191] Error syncing pod 989e3cab-2430-4d81-91f7-b0098b27e30c ("dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"
W0927 01:44:27.708088 756367 logs.go:138] Found kubelet problem: Sep 27 01:40:09 old-k8s-version-745133 kubelet[736]: E0927 01:40:09.675710 736 pod_workers.go:191] Error syncing pod 249f17e8-637b-4946-8ed3-edff6860c82b ("metrics-server-9975d5f86-5bphl_kube-system(249f17e8-637b-4946-8ed3-edff6860c82b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0927 01:44:27.708444 756367 logs.go:138] Found kubelet problem: Sep 27 01:40:11 old-k8s-version-745133 kubelet[736]: E0927 01:40:11.674655 736 pod_workers.go:191] Error syncing pod 989e3cab-2430-4d81-91f7-b0098b27e30c ("dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"
W0927 01:44:27.709077 756367 logs.go:138] Found kubelet problem: Sep 27 01:40:24 old-k8s-version-745133 kubelet[736]: E0927 01:40:24.053848 736 pod_workers.go:191] Error syncing pod 989e3cab-2430-4d81-91f7-b0098b27e30c ("dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"
W0927 01:44:27.711317 756367 logs.go:138] Found kubelet problem: Sep 27 01:40:24 old-k8s-version-745133 kubelet[736]: E0927 01:40:24.685441 736 pod_workers.go:191] Error syncing pod 249f17e8-637b-4946-8ed3-edff6860c82b ("metrics-server-9975d5f86-5bphl_kube-system(249f17e8-637b-4946-8ed3-edff6860c82b)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = pinging container registry fake.domain: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain: no such host"
W0927 01:44:27.711682 756367 logs.go:138] Found kubelet problem: Sep 27 01:40:29 old-k8s-version-745133 kubelet[736]: E0927 01:40:29.607048 736 pod_workers.go:191] Error syncing pod 989e3cab-2430-4d81-91f7-b0098b27e30c ("dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"
W0927 01:44:27.711894 756367 logs.go:138] Found kubelet problem: Sep 27 01:40:38 old-k8s-version-745133 kubelet[736]: E0927 01:40:38.675142 736 pod_workers.go:191] Error syncing pod 249f17e8-637b-4946-8ed3-edff6860c82b ("metrics-server-9975d5f86-5bphl_kube-system(249f17e8-637b-4946-8ed3-edff6860c82b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0927 01:44:27.712250 756367 logs.go:138] Found kubelet problem: Sep 27 01:40:43 old-k8s-version-745133 kubelet[736]: E0927 01:40:43.674664 736 pod_workers.go:191] Error syncing pod 989e3cab-2430-4d81-91f7-b0098b27e30c ("dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"
W0927 01:44:27.712463 756367 logs.go:138] Found kubelet problem: Sep 27 01:40:50 old-k8s-version-745133 kubelet[736]: E0927 01:40:50.675165 736 pod_workers.go:191] Error syncing pod 249f17e8-637b-4946-8ed3-edff6860c82b ("metrics-server-9975d5f86-5bphl_kube-system(249f17e8-637b-4946-8ed3-edff6860c82b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0927 01:44:27.712820 756367 logs.go:138] Found kubelet problem: Sep 27 01:40:57 old-k8s-version-745133 kubelet[736]: E0927 01:40:57.675462 736 pod_workers.go:191] Error syncing pod 989e3cab-2430-4d81-91f7-b0098b27e30c ("dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"
W0927 01:44:27.713034 756367 logs.go:138] Found kubelet problem: Sep 27 01:41:04 old-k8s-version-745133 kubelet[736]: E0927 01:41:04.679852 736 pod_workers.go:191] Error syncing pod 249f17e8-637b-4946-8ed3-edff6860c82b ("metrics-server-9975d5f86-5bphl_kube-system(249f17e8-637b-4946-8ed3-edff6860c82b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0927 01:44:27.713655 756367 logs.go:138] Found kubelet problem: Sep 27 01:41:11 old-k8s-version-745133 kubelet[736]: E0927 01:41:11.121508 736 pod_workers.go:191] Error syncing pod 989e3cab-2430-4d81-91f7-b0098b27e30c ("dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"
W0927 01:44:27.713899 756367 logs.go:138] Found kubelet problem: Sep 27 01:41:17 old-k8s-version-745133 kubelet[736]: E0927 01:41:17.676076 736 pod_workers.go:191] Error syncing pod 249f17e8-637b-4946-8ed3-edff6860c82b ("metrics-server-9975d5f86-5bphl_kube-system(249f17e8-637b-4946-8ed3-edff6860c82b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0927 01:44:27.714253 756367 logs.go:138] Found kubelet problem: Sep 27 01:41:19 old-k8s-version-745133 kubelet[736]: E0927 01:41:19.607004 736 pod_workers.go:191] Error syncing pod 989e3cab-2430-4d81-91f7-b0098b27e30c ("dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"
W0927 01:44:27.714545 756367 logs.go:138] Found kubelet problem: Sep 27 01:41:28 old-k8s-version-745133 kubelet[736]: E0927 01:41:28.675474 736 pod_workers.go:191] Error syncing pod 249f17e8-637b-4946-8ed3-edff6860c82b ("metrics-server-9975d5f86-5bphl_kube-system(249f17e8-637b-4946-8ed3-edff6860c82b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0927 01:44:27.714933 756367 logs.go:138] Found kubelet problem: Sep 27 01:41:33 old-k8s-version-745133 kubelet[736]: E0927 01:41:33.674670 736 pod_workers.go:191] Error syncing pod 989e3cab-2430-4d81-91f7-b0098b27e30c ("dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"
W0927 01:44:27.715143 756367 logs.go:138] Found kubelet problem: Sep 27 01:41:41 old-k8s-version-745133 kubelet[736]: E0927 01:41:41.675136 736 pod_workers.go:191] Error syncing pod 249f17e8-637b-4946-8ed3-edff6860c82b ("metrics-server-9975d5f86-5bphl_kube-system(249f17e8-637b-4946-8ed3-edff6860c82b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0927 01:44:27.715561 756367 logs.go:138] Found kubelet problem: Sep 27 01:41:46 old-k8s-version-745133 kubelet[736]: E0927 01:41:46.674672 736 pod_workers.go:191] Error syncing pod 989e3cab-2430-4d81-91f7-b0098b27e30c ("dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"
W0927 01:44:27.721157 756367 logs.go:138] Found kubelet problem: Sep 27 01:41:55 old-k8s-version-745133 kubelet[736]: E0927 01:41:55.687901 736 pod_workers.go:191] Error syncing pod 249f17e8-637b-4946-8ed3-edff6860c82b ("metrics-server-9975d5f86-5bphl_kube-system(249f17e8-637b-4946-8ed3-edff6860c82b)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = pinging container registry fake.domain: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain: no such host"
W0927 01:44:27.721536 756367 logs.go:138] Found kubelet problem: Sep 27 01:42:01 old-k8s-version-745133 kubelet[736]: E0927 01:42:01.675876 736 pod_workers.go:191] Error syncing pod 989e3cab-2430-4d81-91f7-b0098b27e30c ("dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"
W0927 01:44:27.721796 756367 logs.go:138] Found kubelet problem: Sep 27 01:42:10 old-k8s-version-745133 kubelet[736]: E0927 01:42:10.675343 736 pod_workers.go:191] Error syncing pod 249f17e8-637b-4946-8ed3-edff6860c82b ("metrics-server-9975d5f86-5bphl_kube-system(249f17e8-637b-4946-8ed3-edff6860c82b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0927 01:44:27.722157 756367 logs.go:138] Found kubelet problem: Sep 27 01:42:13 old-k8s-version-745133 kubelet[736]: E0927 01:42:13.675175 736 pod_workers.go:191] Error syncing pod 989e3cab-2430-4d81-91f7-b0098b27e30c ("dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"
W0927 01:44:27.722367 756367 logs.go:138] Found kubelet problem: Sep 27 01:42:22 old-k8s-version-745133 kubelet[736]: E0927 01:42:22.675195 736 pod_workers.go:191] Error syncing pod 249f17e8-637b-4946-8ed3-edff6860c82b ("metrics-server-9975d5f86-5bphl_kube-system(249f17e8-637b-4946-8ed3-edff6860c82b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0927 01:44:27.722740 756367 logs.go:138] Found kubelet problem: Sep 27 01:42:26 old-k8s-version-745133 kubelet[736]: E0927 01:42:26.674767 736 pod_workers.go:191] Error syncing pod 989e3cab-2430-4d81-91f7-b0098b27e30c ("dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"
W0927 01:44:27.722949 756367 logs.go:138] Found kubelet problem: Sep 27 01:42:33 old-k8s-version-745133 kubelet[736]: E0927 01:42:33.675487 736 pod_workers.go:191] Error syncing pod 249f17e8-637b-4946-8ed3-edff6860c82b ("metrics-server-9975d5f86-5bphl_kube-system(249f17e8-637b-4946-8ed3-edff6860c82b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0927 01:44:27.723571 756367 logs.go:138] Found kubelet problem: Sep 27 01:42:42 old-k8s-version-745133 kubelet[736]: E0927 01:42:42.264610 736 pod_workers.go:191] Error syncing pod 989e3cab-2430-4d81-91f7-b0098b27e30c ("dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"
W0927 01:44:27.723782 756367 logs.go:138] Found kubelet problem: Sep 27 01:42:47 old-k8s-version-745133 kubelet[736]: E0927 01:42:47.675472 736 pod_workers.go:191] Error syncing pod 249f17e8-637b-4946-8ed3-edff6860c82b ("metrics-server-9975d5f86-5bphl_kube-system(249f17e8-637b-4946-8ed3-edff6860c82b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0927 01:44:27.724146 756367 logs.go:138] Found kubelet problem: Sep 27 01:42:49 old-k8s-version-745133 kubelet[736]: E0927 01:42:49.615148 736 pod_workers.go:191] Error syncing pod 989e3cab-2430-4d81-91f7-b0098b27e30c ("dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"
W0927 01:44:27.724507 756367 logs.go:138] Found kubelet problem: Sep 27 01:43:01 old-k8s-version-745133 kubelet[736]: E0927 01:43:01.674781 736 pod_workers.go:191] Error syncing pod 989e3cab-2430-4d81-91f7-b0098b27e30c ("dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"
W0927 01:44:27.724717 756367 logs.go:138] Found kubelet problem: Sep 27 01:43:01 old-k8s-version-745133 kubelet[736]: E0927 01:43:01.675864 736 pod_workers.go:191] Error syncing pod 249f17e8-637b-4946-8ed3-edff6860c82b ("metrics-server-9975d5f86-5bphl_kube-system(249f17e8-637b-4946-8ed3-edff6860c82b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0927 01:44:27.724926 756367 logs.go:138] Found kubelet problem: Sep 27 01:43:13 old-k8s-version-745133 kubelet[736]: E0927 01:43:13.675722 736 pod_workers.go:191] Error syncing pod 249f17e8-637b-4946-8ed3-edff6860c82b ("metrics-server-9975d5f86-5bphl_kube-system(249f17e8-637b-4946-8ed3-edff6860c82b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0927 01:44:27.725397 756367 logs.go:138] Found kubelet problem: Sep 27 01:43:15 old-k8s-version-745133 kubelet[736]: E0927 01:43:15.674635 736 pod_workers.go:191] Error syncing pod 989e3cab-2430-4d81-91f7-b0098b27e30c ("dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"
W0927 01:44:27.725777 756367 logs.go:138] Found kubelet problem: Sep 27 01:43:26 old-k8s-version-745133 kubelet[736]: E0927 01:43:26.674663 736 pod_workers.go:191] Error syncing pod 989e3cab-2430-4d81-91f7-b0098b27e30c ("dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"
W0927 01:44:27.725988 756367 logs.go:138] Found kubelet problem: Sep 27 01:43:28 old-k8s-version-745133 kubelet[736]: E0927 01:43:28.675242 736 pod_workers.go:191] Error syncing pod 249f17e8-637b-4946-8ed3-edff6860c82b ("metrics-server-9975d5f86-5bphl_kube-system(249f17e8-637b-4946-8ed3-edff6860c82b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0927 01:44:27.726198 756367 logs.go:138] Found kubelet problem: Sep 27 01:43:39 old-k8s-version-745133 kubelet[736]: E0927 01:43:39.675681 736 pod_workers.go:191] Error syncing pod 249f17e8-637b-4946-8ed3-edff6860c82b ("metrics-server-9975d5f86-5bphl_kube-system(249f17e8-637b-4946-8ed3-edff6860c82b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0927 01:44:27.726553 756367 logs.go:138] Found kubelet problem: Sep 27 01:43:40 old-k8s-version-745133 kubelet[736]: E0927 01:43:40.674684 736 pod_workers.go:191] Error syncing pod 989e3cab-2430-4d81-91f7-b0098b27e30c ("dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"
W0927 01:44:27.727033 756367 logs.go:138] Found kubelet problem: Sep 27 01:43:50 old-k8s-version-745133 kubelet[736]: E0927 01:43:50.675166 736 pod_workers.go:191] Error syncing pod 249f17e8-637b-4946-8ed3-edff6860c82b ("metrics-server-9975d5f86-5bphl_kube-system(249f17e8-637b-4946-8ed3-edff6860c82b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0927 01:44:27.727415 756367 logs.go:138] Found kubelet problem: Sep 27 01:43:54 old-k8s-version-745133 kubelet[736]: E0927 01:43:54.675191 736 pod_workers.go:191] Error syncing pod 989e3cab-2430-4d81-91f7-b0098b27e30c ("dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"
W0927 01:44:27.727656 756367 logs.go:138] Found kubelet problem: Sep 27 01:44:02 old-k8s-version-745133 kubelet[736]: E0927 01:44:02.676623 736 pod_workers.go:191] Error syncing pod 249f17e8-637b-4946-8ed3-edff6860c82b ("metrics-server-9975d5f86-5bphl_kube-system(249f17e8-637b-4946-8ed3-edff6860c82b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0927 01:44:27.728017 756367 logs.go:138] Found kubelet problem: Sep 27 01:44:06 old-k8s-version-745133 kubelet[736]: E0927 01:44:06.674628 736 pod_workers.go:191] Error syncing pod 989e3cab-2430-4d81-91f7-b0098b27e30c ("dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"
W0927 01:44:27.728228 756367 logs.go:138] Found kubelet problem: Sep 27 01:44:17 old-k8s-version-745133 kubelet[736]: E0927 01:44:17.675590 736 pod_workers.go:191] Error syncing pod 249f17e8-637b-4946-8ed3-edff6860c82b ("metrics-server-9975d5f86-5bphl_kube-system(249f17e8-637b-4946-8ed3-edff6860c82b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0927 01:44:27.728616 756367 logs.go:138] Found kubelet problem: Sep 27 01:44:21 old-k8s-version-745133 kubelet[736]: E0927 01:44:21.674844 736 pod_workers.go:191] Error syncing pod 989e3cab-2430-4d81-91f7-b0098b27e30c ("dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"
I0927 01:44:27.728630 756367 logs.go:123] Gathering logs for kube-controller-manager [fd21817034d06ff8ec30b1fa5089ddfd190af71c8dfdcde0d32fd61181caafaa] ...
I0927 01:44:27.728645 756367 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 fd21817034d06ff8ec30b1fa5089ddfd190af71c8dfdcde0d32fd61181caafaa"
I0927 01:44:27.845793 756367 logs.go:123] Gathering logs for kindnet [f74f5a74223b633c3ca99ac7465604311677c0c0b43adeacf4843a7ade66ca48] ...
I0927 01:44:27.845828 756367 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 f74f5a74223b633c3ca99ac7465604311677c0c0b43adeacf4843a7ade66ca48"
I0927 01:44:27.929600 756367 logs.go:123] Gathering logs for kubernetes-dashboard [7a82c31e2981413dba52726ae93a9b6786429d4055c821906975f6a58bb6787c] ...
I0927 01:44:27.929628 756367 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 7a82c31e2981413dba52726ae93a9b6786429d4055c821906975f6a58bb6787c"
I0927 01:44:28.012427 756367 logs.go:123] Gathering logs for dmesg ...
I0927 01:44:28.012457 756367 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0927 01:44:28.034915 756367 logs.go:123] Gathering logs for CRI-O ...
I0927 01:44:28.034993 756367 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I0927 01:44:28.149972 756367 logs.go:123] Gathering logs for kube-apiserver [728631fe1253bab9992c7a58f88fca5a34491a3d06d1a6601e0e70566e7d10f4] ...
I0927 01:44:28.150052 756367 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 728631fe1253bab9992c7a58f88fca5a34491a3d06d1a6601e0e70566e7d10f4"
I0927 01:44:28.283007 756367 logs.go:123] Gathering logs for kube-scheduler [1399d95796260c7e27b7a91a70576c5a3e3bfcfee9fb91839ddfe1b01c5114c0] ...
I0927 01:44:28.283106 756367 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 1399d95796260c7e27b7a91a70576c5a3e3bfcfee9fb91839ddfe1b01c5114c0"
I0927 01:44:28.353690 756367 logs.go:123] Gathering logs for kube-proxy [1f91c6f77f281dbe05880609e73acc353cb7ee468afa455c7d22c45e9428661e] ...
I0927 01:44:28.353785 756367 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 1f91c6f77f281dbe05880609e73acc353cb7ee468afa455c7d22c45e9428661e"
I0927 01:44:28.428293 756367 logs.go:123] Gathering logs for container status ...
I0927 01:44:28.428328 756367 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0927 01:44:28.500951 756367 logs.go:123] Gathering logs for describe nodes ...
I0927 01:44:28.501042 756367 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0927 01:44:28.691339 756367 logs.go:123] Gathering logs for etcd [fbfae056e26dd1b15e6b109b732296bcb89c5db7fabc0f8958574a0fc1248e81] ...
I0927 01:44:28.691372 756367 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 fbfae056e26dd1b15e6b109b732296bcb89c5db7fabc0f8958574a0fc1248e81"
I0927 01:44:28.752406 756367 logs.go:123] Gathering logs for coredns [6a28aab70700044c53668d4eceed46b67fba50e2d134c97b4c5cdd9f83c81e4a] ...
I0927 01:44:28.752437 756367 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 6a28aab70700044c53668d4eceed46b67fba50e2d134c97b4c5cdd9f83c81e4a"
I0927 01:44:28.791959 756367 logs.go:123] Gathering logs for storage-provisioner [138c41837cf0bbda88ce0b41c3d306956ef57ff9c2cb680fa71af1f16e609832] ...
I0927 01:44:28.791991 756367 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 138c41837cf0bbda88ce0b41c3d306956ef57ff9c2cb680fa71af1f16e609832"
I0927 01:44:28.833586 756367 out.go:358] Setting ErrFile to fd 2...
I0927 01:44:28.833613 756367 out.go:392] TERM=,COLORTERM=, which probably does not support color
W0927 01:44:28.833684 756367 out.go:270] X Problems detected in kubelet:
W0927 01:44:28.833702 756367 out.go:270] Sep 27 01:43:54 old-k8s-version-745133 kubelet[736]: E0927 01:43:54.675191 736 pod_workers.go:191] Error syncing pod 989e3cab-2430-4d81-91f7-b0098b27e30c ("dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"
W0927 01:44:28.833710 756367 out.go:270] Sep 27 01:44:02 old-k8s-version-745133 kubelet[736]: E0927 01:44:02.676623 736 pod_workers.go:191] Error syncing pod 249f17e8-637b-4946-8ed3-edff6860c82b ("metrics-server-9975d5f86-5bphl_kube-system(249f17e8-637b-4946-8ed3-edff6860c82b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0927 01:44:28.833752 756367 out.go:270] Sep 27 01:44:06 old-k8s-version-745133 kubelet[736]: E0927 01:44:06.674628 736 pod_workers.go:191] Error syncing pod 989e3cab-2430-4d81-91f7-b0098b27e30c ("dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"
W0927 01:44:28.833765 756367 out.go:270] Sep 27 01:44:17 old-k8s-version-745133 kubelet[736]: E0927 01:44:17.675590 736 pod_workers.go:191] Error syncing pod 249f17e8-637b-4946-8ed3-edff6860c82b ("metrics-server-9975d5f86-5bphl_kube-system(249f17e8-637b-4946-8ed3-edff6860c82b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0927 01:44:28.833773 756367 out.go:270] Sep 27 01:44:21 old-k8s-version-745133 kubelet[736]: E0927 01:44:21.674844 736 pod_workers.go:191] Error syncing pod 989e3cab-2430-4d81-91f7-b0098b27e30c ("dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"
I0927 01:44:28.833795 756367 out.go:358] Setting ErrFile to fd 2...
I0927 01:44:28.833815 756367 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0927 01:44:38.620864 760583 system_pods.go:59] 9 kube-system pods found
I0927 01:44:38.620900 760583 system_pods.go:61] "coredns-7c65d6cfc9-5wdrw" [cbb570f9-ad5b-4234-8a8f-87c1979edbde] Running
I0927 01:44:38.620908 760583 system_pods.go:61] "etcd-no-preload-874305" [87ac9caf-0333-4a2b-b20a-3001373bad27] Running
I0927 01:44:38.620913 760583 system_pods.go:61] "kindnet-pchqt" [d35c4808-e965-450b-bf50-6232196b792f] Running
I0927 01:44:38.620917 760583 system_pods.go:61] "kube-apiserver-no-preload-874305" [998d3df2-a118-4fbf-8ffb-baf15badc4da] Running
I0927 01:44:38.620921 760583 system_pods.go:61] "kube-controller-manager-no-preload-874305" [a77b21bd-8e77-48cd-a9f7-b9aca27f30e5] Running
I0927 01:44:38.620925 760583 system_pods.go:61] "kube-proxy-mghm9" [69e7e456-1607-4fe3-800f-c1089861982c] Running
I0927 01:44:38.620930 760583 system_pods.go:61] "kube-scheduler-no-preload-874305" [81b0b1e9-c100-443e-97ac-ec2b8a9b57ca] Running
I0927 01:44:38.620938 760583 system_pods.go:61] "metrics-server-6867b74b74-t5lkb" [24e2a140-bc6a-489b-958b-bb2fc8372734] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0927 01:44:38.620943 760583 system_pods.go:61] "storage-provisioner" [360de921-071c-413e-a12f-a02d6a3ba426] Running
I0927 01:44:38.620950 760583 system_pods.go:74] duration metric: took 11.730992143s to wait for pod list to return data ...
I0927 01:44:38.620966 760583 default_sa.go:34] waiting for default service account to be created ...
I0927 01:44:38.623836 760583 default_sa.go:45] found service account: "default"
I0927 01:44:38.623866 760583 default_sa.go:55] duration metric: took 2.893613ms for default service account to be created ...
I0927 01:44:38.623877 760583 system_pods.go:116] waiting for k8s-apps to be running ...
I0927 01:44:38.629496 760583 system_pods.go:86] 9 kube-system pods found
I0927 01:44:38.629530 760583 system_pods.go:89] "coredns-7c65d6cfc9-5wdrw" [cbb570f9-ad5b-4234-8a8f-87c1979edbde] Running
I0927 01:44:38.629538 760583 system_pods.go:89] "etcd-no-preload-874305" [87ac9caf-0333-4a2b-b20a-3001373bad27] Running
I0927 01:44:38.629542 760583 system_pods.go:89] "kindnet-pchqt" [d35c4808-e965-450b-bf50-6232196b792f] Running
I0927 01:44:38.629548 760583 system_pods.go:89] "kube-apiserver-no-preload-874305" [998d3df2-a118-4fbf-8ffb-baf15badc4da] Running
I0927 01:44:38.629554 760583 system_pods.go:89] "kube-controller-manager-no-preload-874305" [a77b21bd-8e77-48cd-a9f7-b9aca27f30e5] Running
I0927 01:44:38.629559 760583 system_pods.go:89] "kube-proxy-mghm9" [69e7e456-1607-4fe3-800f-c1089861982c] Running
I0927 01:44:38.629565 760583 system_pods.go:89] "kube-scheduler-no-preload-874305" [81b0b1e9-c100-443e-97ac-ec2b8a9b57ca] Running
I0927 01:44:38.629573 760583 system_pods.go:89] "metrics-server-6867b74b74-t5lkb" [24e2a140-bc6a-489b-958b-bb2fc8372734] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0927 01:44:38.629578 760583 system_pods.go:89] "storage-provisioner" [360de921-071c-413e-a12f-a02d6a3ba426] Running
I0927 01:44:38.629591 760583 system_pods.go:126] duration metric: took 5.709705ms to wait for k8s-apps to be running ...
I0927 01:44:38.629602 760583 system_svc.go:44] waiting for kubelet service to be running ....
I0927 01:44:38.629662 760583 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0927 01:44:38.643658 760583 system_svc.go:56] duration metric: took 14.038795ms WaitForService to wait for kubelet
I0927 01:44:38.643685 760583 kubeadm.go:582] duration metric: took 4m41.318593294s to wait for: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0927 01:44:38.643707 760583 node_conditions.go:102] verifying NodePressure condition ...
I0927 01:44:38.647341 760583 node_conditions.go:122] node storage ephemeral capacity is 203034800Ki
I0927 01:44:38.647376 760583 node_conditions.go:123] node cpu capacity is 2
I0927 01:44:38.647389 760583 node_conditions.go:105] duration metric: took 3.67588ms to run NodePressure ...
I0927 01:44:38.647402 760583 start.go:241] waiting for startup goroutines ...
I0927 01:44:38.647419 760583 start.go:246] waiting for cluster config update ...
I0927 01:44:38.647434 760583 start.go:255] writing updated cluster config ...
I0927 01:44:38.647732 760583 ssh_runner.go:195] Run: rm -f paused
I0927 01:44:38.714519 760583 start.go:600] kubectl: 1.31.1, cluster: 1.31.1 (minor skew: 0)
I0927 01:44:38.719037 760583 out.go:177] * Done! kubectl is now configured to use "no-preload-874305" cluster and "default" namespace by default
I0927 01:44:38.835711 756367 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0927 01:44:38.852118 756367 api_server.go:72] duration metric: took 5m59.130981288s to wait for apiserver process to appear ...
I0927 01:44:38.852145 756367 api_server.go:88] waiting for apiserver healthz status ...
I0927 01:44:38.852204 756367 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I0927 01:44:38.852315 756367 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0927 01:44:38.922459 756367 cri.go:89] found id: "728631fe1253bab9992c7a58f88fca5a34491a3d06d1a6601e0e70566e7d10f4"
I0927 01:44:38.922483 756367 cri.go:89] found id: ""
I0927 01:44:38.922490 756367 logs.go:276] 1 containers: [728631fe1253bab9992c7a58f88fca5a34491a3d06d1a6601e0e70566e7d10f4]
I0927 01:44:38.922545 756367 ssh_runner.go:195] Run: which crictl
I0927 01:44:38.927062 756367 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I0927 01:44:38.927133 756367 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0927 01:44:38.981224 756367 cri.go:89] found id: "fbfae056e26dd1b15e6b109b732296bcb89c5db7fabc0f8958574a0fc1248e81"
I0927 01:44:38.981250 756367 cri.go:89] found id: ""
I0927 01:44:38.981259 756367 logs.go:276] 1 containers: [fbfae056e26dd1b15e6b109b732296bcb89c5db7fabc0f8958574a0fc1248e81]
I0927 01:44:38.981318 756367 ssh_runner.go:195] Run: which crictl
I0927 01:44:38.986555 756367 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I0927 01:44:38.986636 756367 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0927 01:44:39.039294 756367 cri.go:89] found id: "6a28aab70700044c53668d4eceed46b67fba50e2d134c97b4c5cdd9f83c81e4a"
I0927 01:44:39.039320 756367 cri.go:89] found id: ""
I0927 01:44:39.039328 756367 logs.go:276] 1 containers: [6a28aab70700044c53668d4eceed46b67fba50e2d134c97b4c5cdd9f83c81e4a]
I0927 01:44:39.039386 756367 ssh_runner.go:195] Run: which crictl
I0927 01:44:39.043454 756367 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I0927 01:44:39.043529 756367 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0927 01:44:39.104793 756367 cri.go:89] found id: "1399d95796260c7e27b7a91a70576c5a3e3bfcfee9fb91839ddfe1b01c5114c0"
I0927 01:44:39.104822 756367 cri.go:89] found id: ""
I0927 01:44:39.104831 756367 logs.go:276] 1 containers: [1399d95796260c7e27b7a91a70576c5a3e3bfcfee9fb91839ddfe1b01c5114c0]
I0927 01:44:39.104884 756367 ssh_runner.go:195] Run: which crictl
I0927 01:44:39.110103 756367 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I0927 01:44:39.110168 756367 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0927 01:44:39.174469 756367 cri.go:89] found id: "1f91c6f77f281dbe05880609e73acc353cb7ee468afa455c7d22c45e9428661e"
I0927 01:44:39.174497 756367 cri.go:89] found id: ""
I0927 01:44:39.174505 756367 logs.go:276] 1 containers: [1f91c6f77f281dbe05880609e73acc353cb7ee468afa455c7d22c45e9428661e]
I0927 01:44:39.174562 756367 ssh_runner.go:195] Run: which crictl
I0927 01:44:39.178544 756367 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I0927 01:44:39.178620 756367 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0927 01:44:39.229152 756367 cri.go:89] found id: "fd21817034d06ff8ec30b1fa5089ddfd190af71c8dfdcde0d32fd61181caafaa"
I0927 01:44:39.229176 756367 cri.go:89] found id: ""
I0927 01:44:39.229184 756367 logs.go:276] 1 containers: [fd21817034d06ff8ec30b1fa5089ddfd190af71c8dfdcde0d32fd61181caafaa]
I0927 01:44:39.229244 756367 ssh_runner.go:195] Run: which crictl
I0927 01:44:39.232807 756367 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I0927 01:44:39.232877 756367 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0927 01:44:39.273216 756367 cri.go:89] found id: "f74f5a74223b633c3ca99ac7465604311677c0c0b43adeacf4843a7ade66ca48"
I0927 01:44:39.273239 756367 cri.go:89] found id: ""
I0927 01:44:39.273247 756367 logs.go:276] 1 containers: [f74f5a74223b633c3ca99ac7465604311677c0c0b43adeacf4843a7ade66ca48]
I0927 01:44:39.273305 756367 ssh_runner.go:195] Run: which crictl
I0927 01:44:39.277150 756367 cri.go:54] listing CRI containers in root : {State:all Name:storage-provisioner Namespaces:[]}
I0927 01:44:39.277226 756367 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
I0927 01:44:39.315705 756367 cri.go:89] found id: "138c41837cf0bbda88ce0b41c3d306956ef57ff9c2cb680fa71af1f16e609832"
I0927 01:44:39.315727 756367 cri.go:89] found id: ""
I0927 01:44:39.315734 756367 logs.go:276] 1 containers: [138c41837cf0bbda88ce0b41c3d306956ef57ff9c2cb680fa71af1f16e609832]
I0927 01:44:39.315791 756367 ssh_runner.go:195] Run: which crictl
I0927 01:44:39.319422 756367 cri.go:54] listing CRI containers in root : {State:all Name:kubernetes-dashboard Namespaces:[]}
I0927 01:44:39.319493 756367 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
I0927 01:44:39.374266 756367 cri.go:89] found id: "7a82c31e2981413dba52726ae93a9b6786429d4055c821906975f6a58bb6787c"
I0927 01:44:39.374289 756367 cri.go:89] found id: ""
I0927 01:44:39.374297 756367 logs.go:276] 1 containers: [7a82c31e2981413dba52726ae93a9b6786429d4055c821906975f6a58bb6787c]
I0927 01:44:39.374359 756367 ssh_runner.go:195] Run: which crictl
I0927 01:44:39.378605 756367 logs.go:123] Gathering logs for kindnet [f74f5a74223b633c3ca99ac7465604311677c0c0b43adeacf4843a7ade66ca48] ...
I0927 01:44:39.378629 756367 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 f74f5a74223b633c3ca99ac7465604311677c0c0b43adeacf4843a7ade66ca48"
I0927 01:44:39.431823 756367 logs.go:123] Gathering logs for kubernetes-dashboard [7a82c31e2981413dba52726ae93a9b6786429d4055c821906975f6a58bb6787c] ...
I0927 01:44:39.431856 756367 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 7a82c31e2981413dba52726ae93a9b6786429d4055c821906975f6a58bb6787c"
I0927 01:44:39.476375 756367 logs.go:123] Gathering logs for container status ...
I0927 01:44:39.476405 756367 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0927 01:44:39.531425 756367 logs.go:123] Gathering logs for dmesg ...
I0927 01:44:39.531456 756367 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0927 01:44:39.548458 756367 logs.go:123] Gathering logs for kube-proxy [1f91c6f77f281dbe05880609e73acc353cb7ee468afa455c7d22c45e9428661e] ...
I0927 01:44:39.548489 756367 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 1f91c6f77f281dbe05880609e73acc353cb7ee468afa455c7d22c45e9428661e"
I0927 01:44:39.587845 756367 logs.go:123] Gathering logs for kube-apiserver [728631fe1253bab9992c7a58f88fca5a34491a3d06d1a6601e0e70566e7d10f4] ...
I0927 01:44:39.587877 756367 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 728631fe1253bab9992c7a58f88fca5a34491a3d06d1a6601e0e70566e7d10f4"
I0927 01:44:39.665236 756367 logs.go:123] Gathering logs for kube-scheduler [1399d95796260c7e27b7a91a70576c5a3e3bfcfee9fb91839ddfe1b01c5114c0] ...
I0927 01:44:39.665275 756367 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 1399d95796260c7e27b7a91a70576c5a3e3bfcfee9fb91839ddfe1b01c5114c0"
I0927 01:44:39.711276 756367 logs.go:123] Gathering logs for storage-provisioner [138c41837cf0bbda88ce0b41c3d306956ef57ff9c2cb680fa71af1f16e609832] ...
I0927 01:44:39.711308 756367 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 138c41837cf0bbda88ce0b41c3d306956ef57ff9c2cb680fa71af1f16e609832"
I0927 01:44:39.751909 756367 logs.go:123] Gathering logs for CRI-O ...
I0927 01:44:39.751939 756367 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I0927 01:44:39.832973 756367 logs.go:123] Gathering logs for etcd [fbfae056e26dd1b15e6b109b732296bcb89c5db7fabc0f8958574a0fc1248e81] ...
I0927 01:44:39.833012 756367 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 fbfae056e26dd1b15e6b109b732296bcb89c5db7fabc0f8958574a0fc1248e81"
I0927 01:44:39.887308 756367 logs.go:123] Gathering logs for coredns [6a28aab70700044c53668d4eceed46b67fba50e2d134c97b4c5cdd9f83c81e4a] ...
I0927 01:44:39.887339 756367 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 6a28aab70700044c53668d4eceed46b67fba50e2d134c97b4c5cdd9f83c81e4a"
I0927 01:44:39.928050 756367 logs.go:123] Gathering logs for kube-controller-manager [fd21817034d06ff8ec30b1fa5089ddfd190af71c8dfdcde0d32fd61181caafaa] ...
I0927 01:44:39.928079 756367 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 fd21817034d06ff8ec30b1fa5089ddfd190af71c8dfdcde0d32fd61181caafaa"
I0927 01:44:40.029021 756367 logs.go:123] Gathering logs for kubelet ...
I0927 01:44:40.029073 756367 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
W0927 01:44:40.096759 756367 logs.go:138] Found kubelet problem: Sep 27 01:39:00 old-k8s-version-745133 kubelet[736]: E0927 01:39:00.276608 736 reflector.go:138] object-"kube-system"/"coredns": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "coredns" is forbidden: User "system:node:old-k8s-version-745133" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-745133' and this object
W0927 01:44:40.097055 756367 logs.go:138] Found kubelet problem: Sep 27 01:39:00 old-k8s-version-745133 kubelet[736]: E0927 01:39:00.277156 736 reflector.go:138] object-"kube-system"/"kube-proxy-token-mdl25": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kube-proxy-token-mdl25" is forbidden: User "system:node:old-k8s-version-745133" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-745133' and this object
W0927 01:44:40.097340 756367 logs.go:138] Found kubelet problem: Sep 27 01:39:00 old-k8s-version-745133 kubelet[736]: E0927 01:39:00.277414 736 reflector.go:138] object-"kube-system"/"kube-proxy": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-proxy" is forbidden: User "system:node:old-k8s-version-745133" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-745133' and this object
W0927 01:44:40.097591 756367 logs.go:138] Found kubelet problem: Sep 27 01:39:00 old-k8s-version-745133 kubelet[736]: E0927 01:39:00.277602 736 reflector.go:138] object-"kube-system"/"kindnet-token-jwlc6": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kindnet-token-jwlc6" is forbidden: User "system:node:old-k8s-version-745133" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-745133' and this object
W0927 01:44:40.097838 756367 logs.go:138] Found kubelet problem: Sep 27 01:39:00 old-k8s-version-745133 kubelet[736]: E0927 01:39:00.277796 736 reflector.go:138] object-"kube-system"/"coredns-token-k4cmv": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "coredns-token-k4cmv" is forbidden: User "system:node:old-k8s-version-745133" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-745133' and this object
W0927 01:44:40.098101 756367 logs.go:138] Found kubelet problem: Sep 27 01:39:00 old-k8s-version-745133 kubelet[736]: E0927 01:39:00.277995 736 reflector.go:138] object-"kube-system"/"storage-provisioner-token-tgp2f": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "storage-provisioner-token-tgp2f" is forbidden: User "system:node:old-k8s-version-745133" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-745133' and this object
W0927 01:44:40.098367 756367 logs.go:138] Found kubelet problem: Sep 27 01:39:00 old-k8s-version-745133 kubelet[736]: E0927 01:39:00.278201 736 reflector.go:138] object-"kube-system"/"metrics-server-token-9xfpw": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "metrics-server-token-9xfpw" is forbidden: User "system:node:old-k8s-version-745133" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-745133' and this object
W0927 01:44:40.098599 756367 logs.go:138] Found kubelet problem: Sep 27 01:39:00 old-k8s-version-745133 kubelet[736]: E0927 01:39:00.278383 736 reflector.go:138] object-"default"/"default-token-lm75v": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "default-token-lm75v" is forbidden: User "system:node:old-k8s-version-745133" cannot list resource "secrets" in API group "" in the namespace "default": no relationship found between node 'old-k8s-version-745133' and this object
W0927 01:44:40.108947 756367 logs.go:138] Found kubelet problem: Sep 27 01:39:03 old-k8s-version-745133 kubelet[736]: E0927 01:39:03.038144 736 pod_workers.go:191] Error syncing pod 249f17e8-637b-4946-8ed3-edff6860c82b ("metrics-server-9975d5f86-5bphl_kube-system(249f17e8-637b-4946-8ed3-edff6860c82b)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = pinging container registry fake.domain: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain: no such host"
W0927 01:44:40.109179 756367 logs.go:138] Found kubelet problem: Sep 27 01:39:03 old-k8s-version-745133 kubelet[736]: E0927 01:39:03.733711 736 pod_workers.go:191] Error syncing pod 249f17e8-637b-4946-8ed3-edff6860c82b ("metrics-server-9975d5f86-5bphl_kube-system(249f17e8-637b-4946-8ed3-edff6860c82b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0927 01:44:40.111478 756367 logs.go:138] Found kubelet problem: Sep 27 01:39:17 old-k8s-version-745133 kubelet[736]: E0927 01:39:17.695628 736 pod_workers.go:191] Error syncing pod 249f17e8-637b-4946-8ed3-edff6860c82b ("metrics-server-9975d5f86-5bphl_kube-system(249f17e8-637b-4946-8ed3-edff6860c82b)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = pinging container registry fake.domain: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain: no such host"
W0927 01:44:40.111949 756367 logs.go:138] Found kubelet problem: Sep 27 01:39:19 old-k8s-version-745133 kubelet[736]: E0927 01:39:19.799354 736 reflector.go:138] object-"kubernetes-dashboard"/"kubernetes-dashboard-token-hcwf2": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kubernetes-dashboard-token-hcwf2" is forbidden: User "system:node:old-k8s-version-745133" cannot list resource "secrets" in API group "" in the namespace "kubernetes-dashboard": no relationship found between node 'old-k8s-version-745133' and this object
W0927 01:44:40.113700 756367 logs.go:138] Found kubelet problem: Sep 27 01:39:28 old-k8s-version-745133 kubelet[736]: E0927 01:39:28.679675 736 pod_workers.go:191] Error syncing pod 249f17e8-637b-4946-8ed3-edff6860c82b ("metrics-server-9975d5f86-5bphl_kube-system(249f17e8-637b-4946-8ed3-edff6860c82b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0927 01:44:40.114248 756367 logs.go:138] Found kubelet problem: Sep 27 01:39:31 old-k8s-version-745133 kubelet[736]: E0927 01:39:31.971044 736 pod_workers.go:191] Error syncing pod 989e3cab-2430-4d81-91f7-b0098b27e30c ("dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"
W0927 01:44:40.114769 756367 logs.go:138] Found kubelet problem: Sep 27 01:39:32 old-k8s-version-745133 kubelet[736]: E0927 01:39:32.973106 736 pod_workers.go:191] Error syncing pod 989e3cab-2430-4d81-91f7-b0098b27e30c ("dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"
W0927 01:44:40.115110 756367 logs.go:138] Found kubelet problem: Sep 27 01:39:39 old-k8s-version-745133 kubelet[736]: E0927 01:39:39.607023 736 pod_workers.go:191] Error syncing pod 989e3cab-2430-4d81-91f7-b0098b27e30c ("dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"
W0927 01:44:40.117338 756367 logs.go:138] Found kubelet problem: Sep 27 01:39:43 old-k8s-version-745133 kubelet[736]: E0927 01:39:43.686128 736 pod_workers.go:191] Error syncing pod 249f17e8-637b-4946-8ed3-edff6860c82b ("metrics-server-9975d5f86-5bphl_kube-system(249f17e8-637b-4946-8ed3-edff6860c82b)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = pinging container registry fake.domain: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain: no such host"
W0927 01:44:40.117990 756367 logs.go:138] Found kubelet problem: Sep 27 01:39:55 old-k8s-version-745133 kubelet[736]: E0927 01:39:55.013155 736 pod_workers.go:191] Error syncing pod 989e3cab-2430-4d81-91f7-b0098b27e30c ("dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"
W0927 01:44:40.118191 756367 logs.go:138] Found kubelet problem: Sep 27 01:39:58 old-k8s-version-745133 kubelet[736]: E0927 01:39:58.675275 736 pod_workers.go:191] Error syncing pod 249f17e8-637b-4946-8ed3-edff6860c82b ("metrics-server-9975d5f86-5bphl_kube-system(249f17e8-637b-4946-8ed3-edff6860c82b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0927 01:44:40.118552 756367 logs.go:138] Found kubelet problem: Sep 27 01:39:59 old-k8s-version-745133 kubelet[736]: E0927 01:39:59.607420 736 pod_workers.go:191] Error syncing pod 989e3cab-2430-4d81-91f7-b0098b27e30c ("dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"
W0927 01:44:40.118760 756367 logs.go:138] Found kubelet problem: Sep 27 01:40:09 old-k8s-version-745133 kubelet[736]: E0927 01:40:09.675710 736 pod_workers.go:191] Error syncing pod 249f17e8-637b-4946-8ed3-edff6860c82b ("metrics-server-9975d5f86-5bphl_kube-system(249f17e8-637b-4946-8ed3-edff6860c82b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0927 01:44:40.119110 756367 logs.go:138] Found kubelet problem: Sep 27 01:40:11 old-k8s-version-745133 kubelet[736]: E0927 01:40:11.674655 736 pod_workers.go:191] Error syncing pod 989e3cab-2430-4d81-91f7-b0098b27e30c ("dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"
W0927 01:44:40.119744 756367 logs.go:138] Found kubelet problem: Sep 27 01:40:24 old-k8s-version-745133 kubelet[736]: E0927 01:40:24.053848 736 pod_workers.go:191] Error syncing pod 989e3cab-2430-4d81-91f7-b0098b27e30c ("dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"
W0927 01:44:40.121980 756367 logs.go:138] Found kubelet problem: Sep 27 01:40:24 old-k8s-version-745133 kubelet[736]: E0927 01:40:24.685441 736 pod_workers.go:191] Error syncing pod 249f17e8-637b-4946-8ed3-edff6860c82b ("metrics-server-9975d5f86-5bphl_kube-system(249f17e8-637b-4946-8ed3-edff6860c82b)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = pinging container registry fake.domain: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain: no such host"
W0927 01:44:40.122341 756367 logs.go:138] Found kubelet problem: Sep 27 01:40:29 old-k8s-version-745133 kubelet[736]: E0927 01:40:29.607048 736 pod_workers.go:191] Error syncing pod 989e3cab-2430-4d81-91f7-b0098b27e30c ("dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"
W0927 01:44:40.122545 756367 logs.go:138] Found kubelet problem: Sep 27 01:40:38 old-k8s-version-745133 kubelet[736]: E0927 01:40:38.675142 736 pod_workers.go:191] Error syncing pod 249f17e8-637b-4946-8ed3-edff6860c82b ("metrics-server-9975d5f86-5bphl_kube-system(249f17e8-637b-4946-8ed3-edff6860c82b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0927 01:44:40.122921 756367 logs.go:138] Found kubelet problem: Sep 27 01:40:43 old-k8s-version-745133 kubelet[736]: E0927 01:40:43.674664 736 pod_workers.go:191] Error syncing pod 989e3cab-2430-4d81-91f7-b0098b27e30c ("dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"
W0927 01:44:40.123130 756367 logs.go:138] Found kubelet problem: Sep 27 01:40:50 old-k8s-version-745133 kubelet[736]: E0927 01:40:50.675165 736 pod_workers.go:191] Error syncing pod 249f17e8-637b-4946-8ed3-edff6860c82b ("metrics-server-9975d5f86-5bphl_kube-system(249f17e8-637b-4946-8ed3-edff6860c82b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0927 01:44:40.123528 756367 logs.go:138] Found kubelet problem: Sep 27 01:40:57 old-k8s-version-745133 kubelet[736]: E0927 01:40:57.675462 736 pod_workers.go:191] Error syncing pod 989e3cab-2430-4d81-91f7-b0098b27e30c ("dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"
W0927 01:44:40.123736 756367 logs.go:138] Found kubelet problem: Sep 27 01:41:04 old-k8s-version-745133 kubelet[736]: E0927 01:41:04.679852 736 pod_workers.go:191] Error syncing pod 249f17e8-637b-4946-8ed3-edff6860c82b ("metrics-server-9975d5f86-5bphl_kube-system(249f17e8-637b-4946-8ed3-edff6860c82b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0927 01:44:40.124391 756367 logs.go:138] Found kubelet problem: Sep 27 01:41:11 old-k8s-version-745133 kubelet[736]: E0927 01:41:11.121508 736 pod_workers.go:191] Error syncing pod 989e3cab-2430-4d81-91f7-b0098b27e30c ("dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"
W0927 01:44:40.124607 756367 logs.go:138] Found kubelet problem: Sep 27 01:41:17 old-k8s-version-745133 kubelet[736]: E0927 01:41:17.676076 736 pod_workers.go:191] Error syncing pod 249f17e8-637b-4946-8ed3-edff6860c82b ("metrics-server-9975d5f86-5bphl_kube-system(249f17e8-637b-4946-8ed3-edff6860c82b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0927 01:44:40.124961 756367 logs.go:138] Found kubelet problem: Sep 27 01:41:19 old-k8s-version-745133 kubelet[736]: E0927 01:41:19.607004 736 pod_workers.go:191] Error syncing pod 989e3cab-2430-4d81-91f7-b0098b27e30c ("dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"
W0927 01:44:40.125167 756367 logs.go:138] Found kubelet problem: Sep 27 01:41:28 old-k8s-version-745133 kubelet[736]: E0927 01:41:28.675474 736 pod_workers.go:191] Error syncing pod 249f17e8-637b-4946-8ed3-edff6860c82b ("metrics-server-9975d5f86-5bphl_kube-system(249f17e8-637b-4946-8ed3-edff6860c82b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0927 01:44:40.125540 756367 logs.go:138] Found kubelet problem: Sep 27 01:41:33 old-k8s-version-745133 kubelet[736]: E0927 01:41:33.674670 736 pod_workers.go:191] Error syncing pod 989e3cab-2430-4d81-91f7-b0098b27e30c ("dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"
W0927 01:44:40.125751 756367 logs.go:138] Found kubelet problem: Sep 27 01:41:41 old-k8s-version-745133 kubelet[736]: E0927 01:41:41.675136 736 pod_workers.go:191] Error syncing pod 249f17e8-637b-4946-8ed3-edff6860c82b ("metrics-server-9975d5f86-5bphl_kube-system(249f17e8-637b-4946-8ed3-edff6860c82b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0927 01:44:40.126107 756367 logs.go:138] Found kubelet problem: Sep 27 01:41:46 old-k8s-version-745133 kubelet[736]: E0927 01:41:46.674672 736 pod_workers.go:191] Error syncing pod 989e3cab-2430-4d81-91f7-b0098b27e30c ("dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"
W0927 01:44:40.128445 756367 logs.go:138] Found kubelet problem: Sep 27 01:41:55 old-k8s-version-745133 kubelet[736]: E0927 01:41:55.687901 736 pod_workers.go:191] Error syncing pod 249f17e8-637b-4946-8ed3-edff6860c82b ("metrics-server-9975d5f86-5bphl_kube-system(249f17e8-637b-4946-8ed3-edff6860c82b)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = pinging container registry fake.domain: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain: no such host"
W0927 01:44:40.128841 756367 logs.go:138] Found kubelet problem: Sep 27 01:42:01 old-k8s-version-745133 kubelet[736]: E0927 01:42:01.675876 736 pod_workers.go:191] Error syncing pod 989e3cab-2430-4d81-91f7-b0098b27e30c ("dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"
W0927 01:44:40.129096 756367 logs.go:138] Found kubelet problem: Sep 27 01:42:10 old-k8s-version-745133 kubelet[736]: E0927 01:42:10.675343 736 pod_workers.go:191] Error syncing pod 249f17e8-637b-4946-8ed3-edff6860c82b ("metrics-server-9975d5f86-5bphl_kube-system(249f17e8-637b-4946-8ed3-edff6860c82b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0927 01:44:40.129444 756367 logs.go:138] Found kubelet problem: Sep 27 01:42:13 old-k8s-version-745133 kubelet[736]: E0927 01:42:13.675175 736 pod_workers.go:191] Error syncing pod 989e3cab-2430-4d81-91f7-b0098b27e30c ("dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"
W0927 01:44:40.129653 756367 logs.go:138] Found kubelet problem: Sep 27 01:42:22 old-k8s-version-745133 kubelet[736]: E0927 01:42:22.675195 736 pod_workers.go:191] Error syncing pod 249f17e8-637b-4946-8ed3-edff6860c82b ("metrics-server-9975d5f86-5bphl_kube-system(249f17e8-637b-4946-8ed3-edff6860c82b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0927 01:44:40.130012 756367 logs.go:138] Found kubelet problem: Sep 27 01:42:26 old-k8s-version-745133 kubelet[736]: E0927 01:42:26.674767 736 pod_workers.go:191] Error syncing pod 989e3cab-2430-4d81-91f7-b0098b27e30c ("dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"
W0927 01:44:40.130224 756367 logs.go:138] Found kubelet problem: Sep 27 01:42:33 old-k8s-version-745133 kubelet[736]: E0927 01:42:33.675487 736 pod_workers.go:191] Error syncing pod 249f17e8-637b-4946-8ed3-edff6860c82b ("metrics-server-9975d5f86-5bphl_kube-system(249f17e8-637b-4946-8ed3-edff6860c82b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0927 01:44:40.130896 756367 logs.go:138] Found kubelet problem: Sep 27 01:42:42 old-k8s-version-745133 kubelet[736]: E0927 01:42:42.264610 736 pod_workers.go:191] Error syncing pod 989e3cab-2430-4d81-91f7-b0098b27e30c ("dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"
W0927 01:44:40.131105 756367 logs.go:138] Found kubelet problem: Sep 27 01:42:47 old-k8s-version-745133 kubelet[736]: E0927 01:42:47.675472 736 pod_workers.go:191] Error syncing pod 249f17e8-637b-4946-8ed3-edff6860c82b ("metrics-server-9975d5f86-5bphl_kube-system(249f17e8-637b-4946-8ed3-edff6860c82b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0927 01:44:40.131468 756367 logs.go:138] Found kubelet problem: Sep 27 01:42:49 old-k8s-version-745133 kubelet[736]: E0927 01:42:49.615148 736 pod_workers.go:191] Error syncing pod 989e3cab-2430-4d81-91f7-b0098b27e30c ("dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"
W0927 01:44:40.131829 756367 logs.go:138] Found kubelet problem: Sep 27 01:43:01 old-k8s-version-745133 kubelet[736]: E0927 01:43:01.674781 736 pod_workers.go:191] Error syncing pod 989e3cab-2430-4d81-91f7-b0098b27e30c ("dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"
W0927 01:44:40.132045 756367 logs.go:138] Found kubelet problem: Sep 27 01:43:01 old-k8s-version-745133 kubelet[736]: E0927 01:43:01.675864 736 pod_workers.go:191] Error syncing pod 249f17e8-637b-4946-8ed3-edff6860c82b ("metrics-server-9975d5f86-5bphl_kube-system(249f17e8-637b-4946-8ed3-edff6860c82b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0927 01:44:40.132240 756367 logs.go:138] Found kubelet problem: Sep 27 01:43:13 old-k8s-version-745133 kubelet[736]: E0927 01:43:13.675722 736 pod_workers.go:191] Error syncing pod 249f17e8-637b-4946-8ed3-edff6860c82b ("metrics-server-9975d5f86-5bphl_kube-system(249f17e8-637b-4946-8ed3-edff6860c82b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0927 01:44:40.132601 756367 logs.go:138] Found kubelet problem: Sep 27 01:43:15 old-k8s-version-745133 kubelet[736]: E0927 01:43:15.674635 736 pod_workers.go:191] Error syncing pod 989e3cab-2430-4d81-91f7-b0098b27e30c ("dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"
W0927 01:44:40.132997 756367 logs.go:138] Found kubelet problem: Sep 27 01:43:26 old-k8s-version-745133 kubelet[736]: E0927 01:43:26.674663 736 pod_workers.go:191] Error syncing pod 989e3cab-2430-4d81-91f7-b0098b27e30c ("dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"
W0927 01:44:40.133196 756367 logs.go:138] Found kubelet problem: Sep 27 01:43:28 old-k8s-version-745133 kubelet[736]: E0927 01:43:28.675242 736 pod_workers.go:191] Error syncing pod 249f17e8-637b-4946-8ed3-edff6860c82b ("metrics-server-9975d5f86-5bphl_kube-system(249f17e8-637b-4946-8ed3-edff6860c82b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0927 01:44:40.133410 756367 logs.go:138] Found kubelet problem: Sep 27 01:43:39 old-k8s-version-745133 kubelet[736]: E0927 01:43:39.675681 736 pod_workers.go:191] Error syncing pod 249f17e8-637b-4946-8ed3-edff6860c82b ("metrics-server-9975d5f86-5bphl_kube-system(249f17e8-637b-4946-8ed3-edff6860c82b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0927 01:44:40.133777 756367 logs.go:138] Found kubelet problem: Sep 27 01:43:40 old-k8s-version-745133 kubelet[736]: E0927 01:43:40.674684 736 pod_workers.go:191] Error syncing pod 989e3cab-2430-4d81-91f7-b0098b27e30c ("dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"
W0927 01:44:40.134273 756367 logs.go:138] Found kubelet problem: Sep 27 01:43:50 old-k8s-version-745133 kubelet[736]: E0927 01:43:50.675166 736 pod_workers.go:191] Error syncing pod 249f17e8-637b-4946-8ed3-edff6860c82b ("metrics-server-9975d5f86-5bphl_kube-system(249f17e8-637b-4946-8ed3-edff6860c82b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0927 01:44:40.134641 756367 logs.go:138] Found kubelet problem: Sep 27 01:43:54 old-k8s-version-745133 kubelet[736]: E0927 01:43:54.675191 736 pod_workers.go:191] Error syncing pod 989e3cab-2430-4d81-91f7-b0098b27e30c ("dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"
W0927 01:44:40.134858 756367 logs.go:138] Found kubelet problem: Sep 27 01:44:02 old-k8s-version-745133 kubelet[736]: E0927 01:44:02.676623 736 pod_workers.go:191] Error syncing pod 249f17e8-637b-4946-8ed3-edff6860c82b ("metrics-server-9975d5f86-5bphl_kube-system(249f17e8-637b-4946-8ed3-edff6860c82b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0927 01:44:40.135214 756367 logs.go:138] Found kubelet problem: Sep 27 01:44:06 old-k8s-version-745133 kubelet[736]: E0927 01:44:06.674628 736 pod_workers.go:191] Error syncing pod 989e3cab-2430-4d81-91f7-b0098b27e30c ("dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"
W0927 01:44:40.135431 756367 logs.go:138] Found kubelet problem: Sep 27 01:44:17 old-k8s-version-745133 kubelet[736]: E0927 01:44:17.675590 736 pod_workers.go:191] Error syncing pod 249f17e8-637b-4946-8ed3-edff6860c82b ("metrics-server-9975d5f86-5bphl_kube-system(249f17e8-637b-4946-8ed3-edff6860c82b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0927 01:44:40.135825 756367 logs.go:138] Found kubelet problem: Sep 27 01:44:21 old-k8s-version-745133 kubelet[736]: E0927 01:44:21.674844 736 pod_workers.go:191] Error syncing pod 989e3cab-2430-4d81-91f7-b0098b27e30c ("dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"
W0927 01:44:40.136054 756367 logs.go:138] Found kubelet problem: Sep 27 01:44:30 old-k8s-version-745133 kubelet[736]: E0927 01:44:30.675344 736 pod_workers.go:191] Error syncing pod 249f17e8-637b-4946-8ed3-edff6860c82b ("metrics-server-9975d5f86-5bphl_kube-system(249f17e8-637b-4946-8ed3-edff6860c82b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0927 01:44:40.136427 756367 logs.go:138] Found kubelet problem: Sep 27 01:44:34 old-k8s-version-745133 kubelet[736]: E0927 01:44:34.674650 736 pod_workers.go:191] Error syncing pod 989e3cab-2430-4d81-91f7-b0098b27e30c ("dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"
I0927 01:44:40.136460 756367 logs.go:123] Gathering logs for describe nodes ...
I0927 01:44:40.136492 756367 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0927 01:44:40.285959 756367 out.go:358] Setting ErrFile to fd 2...
I0927 01:44:40.285985 756367 out.go:392] TERM=,COLORTERM=, which probably does not support color
W0927 01:44:40.286068 756367 out.go:270] X Problems detected in kubelet:
W0927 01:44:40.286083 756367 out.go:270] Sep 27 01:44:06 old-k8s-version-745133 kubelet[736]: E0927 01:44:06.674628 736 pod_workers.go:191] Error syncing pod 989e3cab-2430-4d81-91f7-b0098b27e30c ("dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"
W0927 01:44:40.286120 756367 out.go:270] Sep 27 01:44:17 old-k8s-version-745133 kubelet[736]: E0927 01:44:17.675590 736 pod_workers.go:191] Error syncing pod 249f17e8-637b-4946-8ed3-edff6860c82b ("metrics-server-9975d5f86-5bphl_kube-system(249f17e8-637b-4946-8ed3-edff6860c82b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0927 01:44:40.286137 756367 out.go:270] Sep 27 01:44:21 old-k8s-version-745133 kubelet[736]: E0927 01:44:21.674844 736 pod_workers.go:191] Error syncing pod 989e3cab-2430-4d81-91f7-b0098b27e30c ("dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"
W0927 01:44:40.286143 756367 out.go:270] Sep 27 01:44:30 old-k8s-version-745133 kubelet[736]: E0927 01:44:30.675344 736 pod_workers.go:191] Error syncing pod 249f17e8-637b-4946-8ed3-edff6860c82b ("metrics-server-9975d5f86-5bphl_kube-system(249f17e8-637b-4946-8ed3-edff6860c82b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0927 01:44:40.286152 756367 out.go:270] Sep 27 01:44:34 old-k8s-version-745133 kubelet[736]: E0927 01:44:34.674650 736 pod_workers.go:191] Error syncing pod 989e3cab-2430-4d81-91f7-b0098b27e30c ("dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"
I0927 01:44:40.286163 756367 out.go:358] Setting ErrFile to fd 2...
I0927 01:44:40.286170 756367 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0927 01:44:50.288102 756367 api_server.go:253] Checking apiserver healthz at https://192.168.76.2:8443/healthz ...
I0927 01:44:50.299610 756367 api_server.go:279] https://192.168.76.2:8443/healthz returned 200:
ok
I0927 01:44:50.302485 756367 out.go:201]
W0927 01:44:50.305011 756367 out.go:270] X Exiting due to K8S_UNHEALTHY_CONTROL_PLANE: wait 6m0s for node: wait for healthy API server: controlPlane never updated to v1.20.0
W0927 01:44:50.305047 756367 out.go:270] * Suggestion: Control Plane could not update, try minikube delete --all --purge
W0927 01:44:50.305076 756367 out.go:270] * Related issue: https://github.com/kubernetes/minikube/issues/11417
W0927 01:44:50.305085 756367 out.go:270] *
W0927 01:44:50.305893 756367 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0927 01:44:50.309681 756367 out.go:201]
==> CRI-O <==
Sep 27 01:42:42 old-k8s-version-745133 crio[625]: time="2024-09-27 01:42:42.291101335Z" level=info msg="Removed container 8b165d0197ab29202768f3aacc2c24d2d5ee336e652938d570e0b2ef3b035b54: kubernetes-dashboard/dashboard-metrics-scraper-8d5bb5db8-4qmkk/dashboard-metrics-scraper" id=d22a7734-c6b8-4c50-83f3-5f705b6d8f4c name=/runtime.v1alpha2.RuntimeService/RemoveContainer
Sep 27 01:42:47 old-k8s-version-745133 crio[625]: time="2024-09-27 01:42:47.674962811Z" level=info msg="Checking image status: fake.domain/registry.k8s.io/echoserver:1.4" id=c4a73f3b-fc30-4d05-9c19-c263cbcfd92c name=/runtime.v1alpha2.ImageService/ImageStatus
Sep 27 01:42:47 old-k8s-version-745133 crio[625]: time="2024-09-27 01:42:47.675182662Z" level=info msg="Image fake.domain/registry.k8s.io/echoserver:1.4 not found" id=c4a73f3b-fc30-4d05-9c19-c263cbcfd92c name=/runtime.v1alpha2.ImageService/ImageStatus
Sep 27 01:43:01 old-k8s-version-745133 crio[625]: time="2024-09-27 01:43:01.675324919Z" level=info msg="Checking image status: fake.domain/registry.k8s.io/echoserver:1.4" id=d814a018-8fe7-4551-9e3d-eedb76c75e91 name=/runtime.v1alpha2.ImageService/ImageStatus
Sep 27 01:43:01 old-k8s-version-745133 crio[625]: time="2024-09-27 01:43:01.675546601Z" level=info msg="Image fake.domain/registry.k8s.io/echoserver:1.4 not found" id=d814a018-8fe7-4551-9e3d-eedb76c75e91 name=/runtime.v1alpha2.ImageService/ImageStatus
Sep 27 01:43:13 old-k8s-version-745133 crio[625]: time="2024-09-27 01:43:13.674970422Z" level=info msg="Checking image status: fake.domain/registry.k8s.io/echoserver:1.4" id=08cf5ad7-5c5d-478f-add5-70f996b5a43f name=/runtime.v1alpha2.ImageService/ImageStatus
Sep 27 01:43:13 old-k8s-version-745133 crio[625]: time="2024-09-27 01:43:13.675192628Z" level=info msg="Image fake.domain/registry.k8s.io/echoserver:1.4 not found" id=08cf5ad7-5c5d-478f-add5-70f996b5a43f name=/runtime.v1alpha2.ImageService/ImageStatus
Sep 27 01:43:28 old-k8s-version-745133 crio[625]: time="2024-09-27 01:43:28.674697995Z" level=info msg="Checking image status: fake.domain/registry.k8s.io/echoserver:1.4" id=f66bdc77-7f02-4edf-b7f9-08ad1efdfa58 name=/runtime.v1alpha2.ImageService/ImageStatus
Sep 27 01:43:28 old-k8s-version-745133 crio[625]: time="2024-09-27 01:43:28.675024059Z" level=info msg="Image fake.domain/registry.k8s.io/echoserver:1.4 not found" id=f66bdc77-7f02-4edf-b7f9-08ad1efdfa58 name=/runtime.v1alpha2.ImageService/ImageStatus
Sep 27 01:43:39 old-k8s-version-745133 crio[625]: time="2024-09-27 01:43:39.675271511Z" level=info msg="Checking image status: fake.domain/registry.k8s.io/echoserver:1.4" id=5ff32f30-30c8-4735-9e3e-3f40472ab285 name=/runtime.v1alpha2.ImageService/ImageStatus
Sep 27 01:43:39 old-k8s-version-745133 crio[625]: time="2024-09-27 01:43:39.675504573Z" level=info msg="Image fake.domain/registry.k8s.io/echoserver:1.4 not found" id=5ff32f30-30c8-4735-9e3e-3f40472ab285 name=/runtime.v1alpha2.ImageService/ImageStatus
Sep 27 01:43:47 old-k8s-version-745133 crio[625]: time="2024-09-27 01:43:47.603515023Z" level=info msg="Checking image status: k8s.gcr.io/pause:3.2" id=788a5ab6-2ca0-429d-b2db-9b261a07ba1d name=/runtime.v1alpha2.ImageService/ImageStatus
Sep 27 01:43:47 old-k8s-version-745133 crio[625]: time="2024-09-27 01:43:47.603750152Z" level=info msg="Image status: &ImageStatusResponse{Image:&Image{Id:2a060e2e7101d419352bf82c613158587400be743482d9a537ec4a9d1b4eb93c,RepoTags:[k8s.gcr.io/pause:3.2 registry.k8s.io/pause:3.2],RepoDigests:[k8s.gcr.io/pause@sha256:31d3efd12022ffeffb3146bc10ae8beb890c80ed2f07363515580add7ed47636 k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f registry.k8s.io/pause@sha256:31d3efd12022ffeffb3146bc10ae8beb890c80ed2f07363515580add7ed47636 registry.k8s.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f],Size_:489397,Uid:nil,Username:,Spec:nil,},Info:map[string]string{},}" id=788a5ab6-2ca0-429d-b2db-9b261a07ba1d name=/runtime.v1alpha2.ImageService/ImageStatus
Sep 27 01:43:50 old-k8s-version-745133 crio[625]: time="2024-09-27 01:43:50.674696258Z" level=info msg="Checking image status: fake.domain/registry.k8s.io/echoserver:1.4" id=29df4f6d-90f1-4bfd-8a57-203f623f216a name=/runtime.v1alpha2.ImageService/ImageStatus
Sep 27 01:43:50 old-k8s-version-745133 crio[625]: time="2024-09-27 01:43:50.674952957Z" level=info msg="Image fake.domain/registry.k8s.io/echoserver:1.4 not found" id=29df4f6d-90f1-4bfd-8a57-203f623f216a name=/runtime.v1alpha2.ImageService/ImageStatus
Sep 27 01:44:02 old-k8s-version-745133 crio[625]: time="2024-09-27 01:44:02.675993589Z" level=info msg="Checking image status: fake.domain/registry.k8s.io/echoserver:1.4" id=331d73fd-61cf-4c24-b4f4-162867c4d4b3 name=/runtime.v1alpha2.ImageService/ImageStatus
Sep 27 01:44:02 old-k8s-version-745133 crio[625]: time="2024-09-27 01:44:02.676224049Z" level=info msg="Image fake.domain/registry.k8s.io/echoserver:1.4 not found" id=331d73fd-61cf-4c24-b4f4-162867c4d4b3 name=/runtime.v1alpha2.ImageService/ImageStatus
Sep 27 01:44:17 old-k8s-version-745133 crio[625]: time="2024-09-27 01:44:17.675015047Z" level=info msg="Checking image status: fake.domain/registry.k8s.io/echoserver:1.4" id=078141c4-49fb-4ade-b6e4-98d653b4dc91 name=/runtime.v1alpha2.ImageService/ImageStatus
Sep 27 01:44:17 old-k8s-version-745133 crio[625]: time="2024-09-27 01:44:17.675241200Z" level=info msg="Image fake.domain/registry.k8s.io/echoserver:1.4 not found" id=078141c4-49fb-4ade-b6e4-98d653b4dc91 name=/runtime.v1alpha2.ImageService/ImageStatus
Sep 27 01:44:30 old-k8s-version-745133 crio[625]: time="2024-09-27 01:44:30.674670072Z" level=info msg="Checking image status: fake.domain/registry.k8s.io/echoserver:1.4" id=54910b99-0d61-444a-b067-1694609a6b63 name=/runtime.v1alpha2.ImageService/ImageStatus
Sep 27 01:44:30 old-k8s-version-745133 crio[625]: time="2024-09-27 01:44:30.674928372Z" level=info msg="Image fake.domain/registry.k8s.io/echoserver:1.4 not found" id=54910b99-0d61-444a-b067-1694609a6b63 name=/runtime.v1alpha2.ImageService/ImageStatus
Sep 27 01:44:41 old-k8s-version-745133 crio[625]: time="2024-09-27 01:44:41.674747977Z" level=info msg="Checking image status: fake.domain/registry.k8s.io/echoserver:1.4" id=56a6e5ce-a564-45f7-ac3e-729e6c451922 name=/runtime.v1alpha2.ImageService/ImageStatus
Sep 27 01:44:41 old-k8s-version-745133 crio[625]: time="2024-09-27 01:44:41.674992033Z" level=info msg="Image fake.domain/registry.k8s.io/echoserver:1.4 not found" id=56a6e5ce-a564-45f7-ac3e-729e6c451922 name=/runtime.v1alpha2.ImageService/ImageStatus
Sep 27 01:44:41 old-k8s-version-745133 crio[625]: time="2024-09-27 01:44:41.675750719Z" level=info msg="Pulling image: fake.domain/registry.k8s.io/echoserver:1.4" id=1c6aef03-11c6-4d0a-a0df-d8c89a8843bf name=/runtime.v1alpha2.ImageService/PullImage
Sep 27 01:44:41 old-k8s-version-745133 crio[625]: time="2024-09-27 01:44:41.679941139Z" level=info msg="Trying to access \"fake.domain/registry.k8s.io/echoserver:1.4\""
==> container status <==
CONTAINER IMAGE CREATED STATE NAME ATTEMPT POD ID POD
054448306ce8e a90209bb39e3d7b5fc9daf60c17044ea969aaca0333d672d8c7a34c7446e7ff7 2 minutes ago Exited dashboard-metrics-scraper 5 06a3ff2d4d9cb dashboard-metrics-scraper-8d5bb5db8-4qmkk
7a82c31e29814 docker.io/kubernetesui/dashboard@sha256:2e500d29e9d5f4a086b908eb8dfe7ecac57d2ab09d65b24f588b1d449841ef93 5 minutes ago Running kubernetes-dashboard 0 bf391190b01eb kubernetes-dashboard-cd95d586-msqw2
f74f5a74223b6 6a23fa8fd2b78ab58e42ba273808edc936a9c53d8ac4a919f6337be094843a51 5 minutes ago Running kindnet-cni 0 29d20811ca7d5 kindnet-84442
138c41837cf0b ba04bb24b95753201135cbc420b233c1b0b9fa2e1fd21d28319c348c33fbcde6 5 minutes ago Running storage-provisioner 0 1b2a43663ab48 storage-provisioner
1f91c6f77f281 25a5233254979d0678a2db1d15b76b73dc380d81bc5eed93916ba5638b3cd894 5 minutes ago Running kube-proxy 0 519dbedf6aa38 kube-proxy-tvwdl
6a28aab707000 db91994f4ee8f894a1e8a6c1a76f615da8fc3c019300a3686291ce6fcbc57895 5 minutes ago Running coredns 0 0b6220f8343e0 coredns-74ff55c5b-drjjb
13e4e39e2cd19 1611cd07b61d57dbbfebe6db242513fd51e1c02d20ba08af17a45837d86a8a8c 5 minutes ago Running busybox 0 c98a6e89a03ee busybox
728631fe1253b 2c08bbbc02d3aa5dfbf4e79f15c0a61424049288917aa10364464ca1f7de7157 6 minutes ago Running kube-apiserver 0 bc24ca0fe0505 kube-apiserver-old-k8s-version-745133
fd21817034d06 1df8a2b116bd16f7070fd383a6769c8d644b365575e8ffa3e492b84e4f05fc74 6 minutes ago Running kube-controller-manager 0 62b86f5237685 kube-controller-manager-old-k8s-version-745133
fbfae056e26dd 05b738aa1bc6355db8a2ee8639f3631b908286e43f584a3d2ee0c472de033c28 6 minutes ago Running etcd 0 3a761aaccec43 etcd-old-k8s-version-745133
1399d95796260 e7605f88f17d6a4c3f083ef9c6f5f19b39f87e4d4406a05a8612b54a6ea57051 6 minutes ago Running kube-scheduler 0 d8b6e6a69f8f0 kube-scheduler-old-k8s-version-745133
==> coredns [6a28aab70700044c53668d4eceed46b67fba50e2d134c97b4c5cdd9f83c81e4a] <==
.:53
[INFO] plugin/reload: Running configuration MD5 = b494d968e357ba1b925cee838fbd78ed
CoreDNS-1.7.0
linux/arm64, go1.14.4, f59c03d
[INFO] 127.0.0.1:32897 - 63404 "HINFO IN 854050115976780122.743714874456846604. udp 55 false 512" NXDOMAIN qr,rd,ra 55 0.04926594s
[INFO] SIGTERM: Shutting down servers then terminating
[INFO] plugin/health: Going into lameduck mode for 5s
.:53
[INFO] plugin/reload: Running configuration MD5 = b494d968e357ba1b925cee838fbd78ed
CoreDNS-1.7.0
linux/arm64, go1.14.4, f59c03d
[INFO] 127.0.0.1:41906 - 3296 "HINFO IN 6266410673912259047.9184460476635664408. udp 57 false 512" NXDOMAIN qr,rd,ra 57 0.014385437s
[INFO] plugin/ready: Still waiting on: "kubernetes"
[INFO] plugin/ready: Still waiting on: "kubernetes"
[INFO] plugin/ready: Still waiting on: "kubernetes"
I0927 01:39:32.634470 1 trace.go:116] Trace[2019727887]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125 (started: 2024-09-27 01:39:02.633835143 +0000 UTC m=+0.122281414) (total time: 30.000508922s):
Trace[2019727887]: [30.000508922s] [30.000508922s] END
E0927 01:39:32.634585 1 reflector.go:178] pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125: Failed to list *v1.Namespace: Get "https://10.96.0.1:443/api/v1/namespaces?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout
I0927 01:39:32.634756 1 trace.go:116] Trace[939984059]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125 (started: 2024-09-27 01:39:02.634432438 +0000 UTC m=+0.122878701) (total time: 30.000270363s):
Trace[939984059]: [30.000270363s] [30.000270363s] END
E0927 01:39:32.634794 1 reflector.go:178] pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125: Failed to list *v1.Service: Get "https://10.96.0.1:443/api/v1/services?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout
I0927 01:39:32.641471 1 trace.go:116] Trace[1474941318]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125 (started: 2024-09-27 01:39:02.634691706 +0000 UTC m=+0.123137969) (total time: 30.006753813s):
Trace[1474941318]: [30.006753813s] [30.006753813s] END
E0927 01:39:32.641491 1 reflector.go:178] pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125: Failed to list *v1.Endpoints: Get "https://10.96.0.1:443/api/v1/endpoints?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout
==> describe nodes <==
Name: old-k8s-version-745133
Roles: control-plane,master
Labels: beta.kubernetes.io/arch=arm64
beta.kubernetes.io/os=linux
kubernetes.io/arch=arm64
kubernetes.io/hostname=old-k8s-version-745133
kubernetes.io/os=linux
minikube.k8s.io/commit=eee16a295c071ed5a0e96cbbc00bcd13b2654625
minikube.k8s.io/name=old-k8s-version-745133
minikube.k8s.io/primary=true
minikube.k8s.io/updated_at=2024_09_27T01_36_13_0700
minikube.k8s.io/version=v1.34.0
node-role.kubernetes.io/control-plane=
node-role.kubernetes.io/master=
Annotations: kubeadm.alpha.kubernetes.io/cri-socket: /var/run/crio/crio.sock
node.alpha.kubernetes.io/ttl: 0
volumes.kubernetes.io/controller-managed-attach-detach: true
CreationTimestamp: Fri, 27 Sep 2024 01:36:09 +0000
Taints: <none>
Unschedulable: false
Lease:
HolderIdentity: old-k8s-version-745133
AcquireTime: <unset>
RenewTime: Fri, 27 Sep 2024 01:44:42 +0000
Conditions:
Type Status LastHeartbeatTime LastTransitionTime Reason Message
---- ------ ----------------- ------------------ ------ -------
MemoryPressure False Fri, 27 Sep 2024 01:39:51 +0000 Fri, 27 Sep 2024 01:36:03 +0000 KubeletHasSufficientMemory kubelet has sufficient memory available
DiskPressure False Fri, 27 Sep 2024 01:39:51 +0000 Fri, 27 Sep 2024 01:36:03 +0000 KubeletHasNoDiskPressure kubelet has no disk pressure
PIDPressure False Fri, 27 Sep 2024 01:39:51 +0000 Fri, 27 Sep 2024 01:36:03 +0000 KubeletHasSufficientPID kubelet has sufficient PID available
Ready True Fri, 27 Sep 2024 01:39:51 +0000 Fri, 27 Sep 2024 01:36:51 +0000 KubeletReady kubelet is posting ready status
Addresses:
InternalIP: 192.168.76.2
Hostname: old-k8s-version-745133
Capacity:
cpu: 2
ephemeral-storage: 203034800Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
hugepages-32Mi: 0
hugepages-64Ki: 0
memory: 8022300Ki
pods: 110
Allocatable:
cpu: 2
ephemeral-storage: 203034800Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
hugepages-32Mi: 0
hugepages-64Ki: 0
memory: 8022300Ki
pods: 110
System Info:
Machine ID: db5b11027cb742ffb6640c5adfb52596
System UUID: a2ec7984-32b1-4e5d-9f7e-bed2abb3c864
Boot ID: 7df4580f-f941-474d-8050-3bbd7f78d321
Kernel Version: 5.15.0-1070-aws
OS Image: Ubuntu 22.04.5 LTS
Operating System: linux
Architecture: arm64
Container Runtime Version: cri-o://1.24.6
Kubelet Version: v1.20.0
Kube-Proxy Version: v1.20.0
PodCIDR: 10.244.0.0/24
PodCIDRs: 10.244.0.0/24
Non-terminated Pods: (12 in total)
Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits AGE
--------- ---- ------------ ---------- --------------- ------------- ---
default busybox 0 (0%) 0 (0%) 0 (0%) 0 (0%) 6m49s
kube-system coredns-74ff55c5b-drjjb 100m (5%) 0 (0%) 70Mi (0%) 170Mi (2%) 8m23s
kube-system etcd-old-k8s-version-745133 100m (5%) 0 (0%) 100Mi (1%) 0 (0%) 8m31s
kube-system kindnet-84442 100m (5%) 100m (5%) 50Mi (0%) 50Mi (0%) 8m23s
kube-system kube-apiserver-old-k8s-version-745133 250m (12%) 0 (0%) 0 (0%) 0 (0%) 8m31s
kube-system kube-controller-manager-old-k8s-version-745133 200m (10%) 0 (0%) 0 (0%) 0 (0%) 8m31s
kube-system kube-proxy-tvwdl 0 (0%) 0 (0%) 0 (0%) 0 (0%) 8m23s
kube-system kube-scheduler-old-k8s-version-745133 100m (5%) 0 (0%) 0 (0%) 0 (0%) 8m31s
kube-system metrics-server-9975d5f86-5bphl 100m (5%) 0 (0%) 200Mi (2%) 0 (0%) 6m35s
kube-system storage-provisioner 0 (0%) 0 (0%) 0 (0%) 0 (0%) 8m22s
kubernetes-dashboard dashboard-metrics-scraper-8d5bb5db8-4qmkk 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m33s
kubernetes-dashboard kubernetes-dashboard-cd95d586-msqw2 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m33s
Allocated resources:
(Total limits may be over 100 percent, i.e., overcommitted.)
Resource Requests Limits
-------- -------- ------
cpu 950m (47%) 100m (5%)
memory 420Mi (5%) 220Mi (2%)
ephemeral-storage 100Mi (0%) 0 (0%)
hugepages-1Gi 0 (0%) 0 (0%)
hugepages-2Mi 0 (0%) 0 (0%)
hugepages-32Mi 0 (0%) 0 (0%)
hugepages-64Ki 0 (0%) 0 (0%)
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal Starting 8m32s kubelet Starting kubelet.
Normal NodeHasSufficientMemory 8m32s kubelet Node old-k8s-version-745133 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 8m32s kubelet Node old-k8s-version-745133 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 8m32s kubelet Node old-k8s-version-745133 status is now: NodeHasSufficientPID
Normal Starting 8m22s kube-proxy Starting kube-proxy.
Normal NodeReady 8m1s kubelet Node old-k8s-version-745133 status is now: NodeReady
Normal Starting 6m5s kubelet Starting kubelet.
Normal NodeHasSufficientMemory 6m5s (x8 over 6m5s) kubelet Node old-k8s-version-745133 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 6m5s (x8 over 6m5s) kubelet Node old-k8s-version-745133 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 6m5s (x8 over 6m5s) kubelet Node old-k8s-version-745133 status is now: NodeHasSufficientPID
Normal Starting 5m49s kube-proxy Starting kube-proxy.
==> dmesg <==
[Sep27 00:06] overlayfs: '/var/lib/containers/storage/overlay/l/Q2QJNMTVZL6GMULS36RA5ZJGSA' not a directory
[Sep27 01:31] overlayfs: '/var/lib/containers/storage/overlay/l/Q2QJNMTVZL6GMULS36RA5ZJGSA' not a directory
==> etcd [fbfae056e26dd1b15e6b109b732296bcb89c5db7fabc0f8958574a0fc1248e81] <==
2024-09-27 01:40:48.968826 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-09-27 01:40:58.968961 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-09-27 01:41:08.968854 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-09-27 01:41:18.968967 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-09-27 01:41:28.969025 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-09-27 01:41:38.968941 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-09-27 01:41:48.968769 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-09-27 01:41:58.968833 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-09-27 01:42:08.968833 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-09-27 01:42:18.968850 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-09-27 01:42:28.968786 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-09-27 01:42:38.968848 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-09-27 01:42:48.968836 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-09-27 01:42:58.968895 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-09-27 01:43:08.968829 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-09-27 01:43:18.968826 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-09-27 01:43:28.968748 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-09-27 01:43:38.968835 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-09-27 01:43:48.968852 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-09-27 01:43:58.968809 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-09-27 01:44:08.970905 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-09-27 01:44:18.968713 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-09-27 01:44:28.968885 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-09-27 01:44:38.969218 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-09-27 01:44:48.968869 I | etcdserver/api/etcdhttp: /health OK (status code 200)
==> kernel <==
01:44:52 up 5:27, 0 users, load average: 0.70, 1.66, 2.12
Linux old-k8s-version-745133 5.15.0-1070-aws #76~20.04.1-Ubuntu SMP Mon Sep 2 12:20:48 UTC 2024 aarch64 aarch64 aarch64 GNU/Linux
PRETTY_NAME="Ubuntu 22.04.5 LTS"
==> kindnet [f74f5a74223b633c3ca99ac7465604311677c0c0b43adeacf4843a7ade66ca48] <==
I0927 01:42:44.720807 1 main.go:299] handling current node
I0927 01:42:54.721918 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I0927 01:42:54.721957 1 main.go:299] handling current node
I0927 01:43:04.720447 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I0927 01:43:04.720584 1 main.go:299] handling current node
I0927 01:43:14.722427 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I0927 01:43:14.722459 1 main.go:299] handling current node
I0927 01:43:24.728434 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I0927 01:43:24.728470 1 main.go:299] handling current node
I0927 01:43:34.726836 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I0927 01:43:34.726869 1 main.go:299] handling current node
I0927 01:43:44.727661 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I0927 01:43:44.727697 1 main.go:299] handling current node
I0927 01:43:54.722850 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I0927 01:43:54.722885 1 main.go:299] handling current node
I0927 01:44:04.720188 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I0927 01:44:04.720302 1 main.go:299] handling current node
I0927 01:44:14.726788 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I0927 01:44:14.726822 1 main.go:299] handling current node
I0927 01:44:24.728498 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I0927 01:44:24.728530 1 main.go:299] handling current node
I0927 01:44:34.720282 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I0927 01:44:34.720395 1 main.go:299] handling current node
I0927 01:44:44.726636 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I0927 01:44:44.726763 1 main.go:299] handling current node
==> kube-apiserver [728631fe1253bab9992c7a58f88fca5a34491a3d06d1a6601e0e70566e7d10f4] <==
I0927 01:41:10.973342 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0927 01:41:10.973351 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0927 01:41:49.850778 1 client.go:360] parsed scheme: "passthrough"
I0927 01:41:49.850822 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0927 01:41:49.850831 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
W0927 01:42:03.407866 1 handler_proxy.go:102] no RequestInfo found in the context
E0927 01:42:03.407941 1 controller.go:116] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
I0927 01:42:03.407949 1 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
I0927 01:42:32.364973 1 client.go:360] parsed scheme: "passthrough"
I0927 01:42:32.365014 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0927 01:42:32.365025 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0927 01:43:15.541835 1 client.go:360] parsed scheme: "passthrough"
I0927 01:43:15.541901 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0927 01:43:15.541911 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0927 01:43:53.091050 1 client.go:360] parsed scheme: "passthrough"
I0927 01:43:53.091094 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0927 01:43:53.091106 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
W0927 01:44:01.298691 1 handler_proxy.go:102] no RequestInfo found in the context
E0927 01:44:01.298804 1 controller.go:116] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
I0927 01:44:01.298865 1 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
I0927 01:44:26.575613 1 client.go:360] parsed scheme: "passthrough"
I0927 01:44:26.575656 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0927 01:44:26.575665 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
==> kube-controller-manager [fd21817034d06ff8ec30b1fa5089ddfd190af71c8dfdcde0d32fd61181caafaa] <==
W0927 01:40:27.681576 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0927 01:40:51.523962 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0927 01:40:59.332910 1 request.go:655] Throttling request took 1.048411631s, request: GET:https://192.168.76.2:8443/apis/storage.k8s.io/v1beta1?timeout=32s
W0927 01:41:00.184555 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0927 01:41:22.025801 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0927 01:41:31.834985 1 request.go:655] Throttling request took 1.048271669s, request: GET:https://192.168.76.2:8443/apis/extensions/v1beta1?timeout=32s
W0927 01:41:32.686390 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0927 01:41:52.527573 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0927 01:42:04.336811 1 request.go:655] Throttling request took 1.048305696s, request: GET:https://192.168.76.2:8443/apis/extensions/v1beta1?timeout=32s
W0927 01:42:05.188220 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0927 01:42:23.029445 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0927 01:42:36.838648 1 request.go:655] Throttling request took 1.048556723s, request: GET:https://192.168.76.2:8443/apis/scheduling.k8s.io/v1beta1?timeout=32s
W0927 01:42:37.690162 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0927 01:42:53.531196 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0927 01:43:09.340581 1 request.go:655] Throttling request took 1.048476502s, request: GET:https://192.168.76.2:8443/apis/apiextensions.k8s.io/v1?timeout=32s
W0927 01:43:10.192018 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0927 01:43:24.033128 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0927 01:43:41.842412 1 request.go:655] Throttling request took 1.048312355s, request: GET:https://192.168.76.2:8443/apis/extensions/v1beta1?timeout=32s
W0927 01:43:42.693781 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0927 01:43:54.534919 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0927 01:44:14.387681 1 request.go:655] Throttling request took 1.048299995s, request: GET:https://192.168.76.2:8443/apis/extensions/v1beta1?timeout=32s
W0927 01:44:15.239263 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0927 01:44:25.036789 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0927 01:44:46.889692 1 request.go:655] Throttling request took 1.048409135s, request: GET:https://192.168.76.2:8443/apis/authentication.k8s.io/v1?timeout=32s
W0927 01:44:47.741161 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
==> kube-proxy [1f91c6f77f281dbe05880609e73acc353cb7ee468afa455c7d22c45e9428661e] <==
I0927 01:36:30.733279 1 node.go:172] Successfully retrieved node IP: 192.168.76.2
I0927 01:36:30.735110 1 server_others.go:142] kube-proxy node IP is an IPv4 address (192.168.76.2), assume IPv4 operation
W0927 01:36:30.798859 1 server_others.go:578] Unknown proxy mode "", assuming iptables proxy
I0927 01:36:30.811340 1 server_others.go:185] Using iptables Proxier.
I0927 01:36:30.843199 1 server.go:650] Version: v1.20.0
I0927 01:36:30.843939 1 config.go:315] Starting service config controller
I0927 01:36:30.844010 1 shared_informer.go:240] Waiting for caches to sync for service config
I0927 01:36:30.970476 1 config.go:224] Starting endpoint slice config controller
I0927 01:36:30.970500 1 shared_informer.go:240] Waiting for caches to sync for endpoint slice config
I0927 01:36:30.971335 1 shared_informer.go:247] Caches are synced for service config
I0927 01:36:31.072754 1 shared_informer.go:247] Caches are synced for endpoint slice config
I0927 01:39:03.500144 1 node.go:172] Successfully retrieved node IP: 192.168.76.2
I0927 01:39:03.500390 1 server_others.go:142] kube-proxy node IP is an IPv4 address (192.168.76.2), assume IPv4 operation
W0927 01:39:03.519540 1 server_others.go:578] Unknown proxy mode "", assuming iptables proxy
I0927 01:39:03.519765 1 server_others.go:185] Using iptables Proxier.
I0927 01:39:03.520036 1 server.go:650] Version: v1.20.0
I0927 01:39:03.520876 1 config.go:315] Starting service config controller
I0927 01:39:03.520942 1 shared_informer.go:240] Waiting for caches to sync for service config
I0927 01:39:03.521035 1 config.go:224] Starting endpoint slice config controller
I0927 01:39:03.521071 1 shared_informer.go:240] Waiting for caches to sync for endpoint slice config
I0927 01:39:03.622774 1 shared_informer.go:247] Caches are synced for endpoint slice config
I0927 01:39:03.622963 1 shared_informer.go:247] Caches are synced for service config
==> kube-scheduler [1399d95796260c7e27b7a91a70576c5a3e3bfcfee9fb91839ddfe1b01c5114c0] <==
E0927 01:36:09.439125 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
E0927 01:36:09.439208 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
E0927 01:36:09.439412 1 reflector.go:138] k8s.io/apiserver/pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
E0927 01:36:09.440281 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1beta1.PodDisruptionBudget: failed to list *v1beta1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
E0927 01:36:10.263218 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
E0927 01:36:10.271660 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
E0927 01:36:10.297247 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
E0927 01:36:10.359392 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
E0927 01:36:10.373721 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
E0927 01:36:10.390618 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
E0927 01:36:10.446520 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
E0927 01:36:10.513622 1 reflector.go:138] k8s.io/apiserver/pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
I0927 01:36:13.035444 1 shared_informer.go:247] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0927 01:38:53.861068 1 serving.go:331] Generated self-signed cert in-memory
I0927 01:39:00.782063 1 secure_serving.go:197] Serving securely on 127.0.0.1:10259
I0927 01:39:00.783997 1 tlsconfig.go:240] Starting DynamicServingCertificateController
I0927 01:39:00.784134 1 requestheader_controller.go:169] Starting RequestHeaderAuthRequestController
I0927 01:39:00.866246 1 shared_informer.go:240] Waiting for caches to sync for RequestHeaderAuthRequestController
I0927 01:39:00.784146 1 configmap_cafile_content.go:202] Starting client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0927 01:39:00.866352 1 shared_informer.go:240] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0927 01:39:00.784156 1 configmap_cafile_content.go:202] Starting client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file
I0927 01:39:00.881764 1 shared_informer.go:240] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file
I0927 01:39:00.970941 1 shared_informer.go:247] Caches are synced for RequestHeaderAuthRequestController
I0927 01:39:00.972190 1 shared_informer.go:247] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0927 01:39:00.982431 1 shared_informer.go:247] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file
==> kubelet <==
Sep 27 01:43:26 old-k8s-version-745133 kubelet[736]: I0927 01:43:26.674295 736 scope.go:95] [topologymanager] RemoveContainer - Container ID: 054448306ce8e579034f52bb9851e525f2d5f2d5e52282bf77a6cbf74299bde7
Sep 27 01:43:26 old-k8s-version-745133 kubelet[736]: E0927 01:43:26.674663 736 pod_workers.go:191] Error syncing pod 989e3cab-2430-4d81-91f7-b0098b27e30c ("dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"
Sep 27 01:43:28 old-k8s-version-745133 kubelet[736]: E0927 01:43:28.675242 736 pod_workers.go:191] Error syncing pod 249f17e8-637b-4946-8ed3-edff6860c82b ("metrics-server-9975d5f86-5bphl_kube-system(249f17e8-637b-4946-8ed3-edff6860c82b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Sep 27 01:43:39 old-k8s-version-745133 kubelet[736]: E0927 01:43:39.675681 736 pod_workers.go:191] Error syncing pod 249f17e8-637b-4946-8ed3-edff6860c82b ("metrics-server-9975d5f86-5bphl_kube-system(249f17e8-637b-4946-8ed3-edff6860c82b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Sep 27 01:43:40 old-k8s-version-745133 kubelet[736]: I0927 01:43:40.674283 736 scope.go:95] [topologymanager] RemoveContainer - Container ID: 054448306ce8e579034f52bb9851e525f2d5f2d5e52282bf77a6cbf74299bde7
Sep 27 01:43:40 old-k8s-version-745133 kubelet[736]: E0927 01:43:40.674684 736 pod_workers.go:191] Error syncing pod 989e3cab-2430-4d81-91f7-b0098b27e30c ("dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"
Sep 27 01:43:47 old-k8s-version-745133 kubelet[736]: E0927 01:43:47.655568 736 container_manager_linux.go:533] failed to find cgroups of kubelet - cpu and memory cgroup hierarchy not unified. cpu: /docker/1fb14722efe43a080319cb455e783513aeccc71eb22ae6ffe2a2fad7eb054cbd, memory: /docker/1fb14722efe43a080319cb455e783513aeccc71eb22ae6ffe2a2fad7eb054cbd/system.slice/kubelet.service
Sep 27 01:43:50 old-k8s-version-745133 kubelet[736]: E0927 01:43:50.675166 736 pod_workers.go:191] Error syncing pod 249f17e8-637b-4946-8ed3-edff6860c82b ("metrics-server-9975d5f86-5bphl_kube-system(249f17e8-637b-4946-8ed3-edff6860c82b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Sep 27 01:43:54 old-k8s-version-745133 kubelet[736]: I0927 01:43:54.674330 736 scope.go:95] [topologymanager] RemoveContainer - Container ID: 054448306ce8e579034f52bb9851e525f2d5f2d5e52282bf77a6cbf74299bde7
Sep 27 01:43:54 old-k8s-version-745133 kubelet[736]: E0927 01:43:54.675191 736 pod_workers.go:191] Error syncing pod 989e3cab-2430-4d81-91f7-b0098b27e30c ("dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"
Sep 27 01:44:02 old-k8s-version-745133 kubelet[736]: E0927 01:44:02.676623 736 pod_workers.go:191] Error syncing pod 249f17e8-637b-4946-8ed3-edff6860c82b ("metrics-server-9975d5f86-5bphl_kube-system(249f17e8-637b-4946-8ed3-edff6860c82b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Sep 27 01:44:06 old-k8s-version-745133 kubelet[736]: I0927 01:44:06.674294 736 scope.go:95] [topologymanager] RemoveContainer - Container ID: 054448306ce8e579034f52bb9851e525f2d5f2d5e52282bf77a6cbf74299bde7
Sep 27 01:44:06 old-k8s-version-745133 kubelet[736]: E0927 01:44:06.674628 736 pod_workers.go:191] Error syncing pod 989e3cab-2430-4d81-91f7-b0098b27e30c ("dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"
Sep 27 01:44:17 old-k8s-version-745133 kubelet[736]: E0927 01:44:17.675590 736 pod_workers.go:191] Error syncing pod 249f17e8-637b-4946-8ed3-edff6860c82b ("metrics-server-9975d5f86-5bphl_kube-system(249f17e8-637b-4946-8ed3-edff6860c82b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Sep 27 01:44:21 old-k8s-version-745133 kubelet[736]: I0927 01:44:21.674489 736 scope.go:95] [topologymanager] RemoveContainer - Container ID: 054448306ce8e579034f52bb9851e525f2d5f2d5e52282bf77a6cbf74299bde7
Sep 27 01:44:21 old-k8s-version-745133 kubelet[736]: E0927 01:44:21.674844 736 pod_workers.go:191] Error syncing pod 989e3cab-2430-4d81-91f7-b0098b27e30c ("dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"
Sep 27 01:44:30 old-k8s-version-745133 kubelet[736]: E0927 01:44:30.675344 736 pod_workers.go:191] Error syncing pod 249f17e8-637b-4946-8ed3-edff6860c82b ("metrics-server-9975d5f86-5bphl_kube-system(249f17e8-637b-4946-8ed3-edff6860c82b)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Sep 27 01:44:34 old-k8s-version-745133 kubelet[736]: I0927 01:44:34.674283 736 scope.go:95] [topologymanager] RemoveContainer - Container ID: 054448306ce8e579034f52bb9851e525f2d5f2d5e52282bf77a6cbf74299bde7
Sep 27 01:44:34 old-k8s-version-745133 kubelet[736]: E0927 01:44:34.674650 736 pod_workers.go:191] Error syncing pod 989e3cab-2430-4d81-91f7-b0098b27e30c ("dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"
Sep 27 01:44:41 old-k8s-version-745133 kubelet[736]: E0927 01:44:41.689257 736 remote_image.go:113] PullImage "fake.domain/registry.k8s.io/echoserver:1.4" from image service failed: rpc error: code = Unknown desc = pinging container registry fake.domain: Get "https://fake.domain/v2/": dial tcp: lookup fake.domain: no such host
Sep 27 01:44:41 old-k8s-version-745133 kubelet[736]: E0927 01:44:41.689309 736 kuberuntime_image.go:51] Pull image "fake.domain/registry.k8s.io/echoserver:1.4" failed: rpc error: code = Unknown desc = pinging container registry fake.domain: Get "https://fake.domain/v2/": dial tcp: lookup fake.domain: no such host
Sep 27 01:44:41 old-k8s-version-745133 kubelet[736]: E0927 01:44:41.689461 736 kuberuntime_manager.go:829] container &Container{Name:metrics-server,Image:fake.domain/registry.k8s.io/echoserver:1.4,Command:[],Args:[--cert-dir=/tmp --secure-port=4443 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --kubelet-use-node-status-port --metric-resolution=60s --kubelet-insecure-tls],WorkingDir:,Ports:[]ContainerPort{ContainerPort{Name:https,HostPort:0,ContainerPort:4443,Protocol:TCP,HostIP:,},},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{cpu: {{100 -3} {<nil>} 100m DecimalSI},memory: {{209715200 0} {<nil>} BinarySI},},},VolumeMounts:[]VolumeMount{VolumeMount{Name:tmp-dir,ReadOnly:false,MountPath:/tmp,SubPath:,MountPropagation:nil,SubPathExpr:,},VolumeMount{Name:metrics-server-token-9xfpw,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,},},LivenessProbe:&Probe{Handler:Handler{Exec
:nil,HTTPGet:&HTTPGetAction{Path:/livez,Port:{1 0 https},Host:,Scheme:HTTPS,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,},InitialDelaySeconds:0,TimeoutSeconds:1,PeriodSeconds:10,SuccessThreshold:1,FailureThreshold:3,},ReadinessProbe:&Probe{Handler:Handler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/readyz,Port:{1 0 https},Host:,Scheme:HTTPS,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,},InitialDelaySeconds:0,TimeoutSeconds:1,PeriodSeconds:10,SuccessThreshold:1,FailureThreshold:3,},Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:nil,Privileged:nil,SELinuxOptions:nil,RunAsUser:*1000,RunAsNonRoot:*true,ReadOnlyRootFilesystem:*true,AllowPrivilegeEscalation:nil,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,} start failed in pod metrics-server-9975d5f86-5bphl_kube-system(249f17e
8-637b-4946-8ed3-edff6860c82b): ErrImagePull: rpc error: code = Unknown desc = pinging container registry fake.domain: Get "https://fake.domain/v2/": dial tcp: lookup fake.domain: no such host
Sep 27 01:44:41 old-k8s-version-745133 kubelet[736]: E0927 01:44:41.689488 736 pod_workers.go:191] Error syncing pod 249f17e8-637b-4946-8ed3-edff6860c82b ("metrics-server-9975d5f86-5bphl_kube-system(249f17e8-637b-4946-8ed3-edff6860c82b)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = pinging container registry fake.domain: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain: no such host"
Sep 27 01:44:48 old-k8s-version-745133 kubelet[736]: I0927 01:44:48.674243 736 scope.go:95] [topologymanager] RemoveContainer - Container ID: 054448306ce8e579034f52bb9851e525f2d5f2d5e52282bf77a6cbf74299bde7
Sep 27 01:44:48 old-k8s-version-745133 kubelet[736]: E0927 01:44:48.674591 736 pod_workers.go:191] Error syncing pod 989e3cab-2430-4d81-91f7-b0098b27e30c ("dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-4qmkk_kubernetes-dashboard(989e3cab-2430-4d81-91f7-b0098b27e30c)"
==> kubernetes-dashboard [7a82c31e2981413dba52726ae93a9b6786429d4055c821906975f6a58bb6787c] <==
2024/09/27 01:39:25 Using namespace: kubernetes-dashboard
2024/09/27 01:39:25 Using in-cluster config to connect to apiserver
2024/09/27 01:39:25 Using secret token for csrf signing
2024/09/27 01:39:25 Initializing csrf token from kubernetes-dashboard-csrf secret
2024/09/27 01:39:25 Empty token. Generating and storing in a secret kubernetes-dashboard-csrf
2024/09/27 01:39:25 Successful initial request to the apiserver, version: v1.20.0
2024/09/27 01:39:25 Generating JWE encryption key
2024/09/27 01:39:25 New synchronizer has been registered: kubernetes-dashboard-key-holder-kubernetes-dashboard. Starting
2024/09/27 01:39:25 Starting secret synchronizer for kubernetes-dashboard-key-holder in namespace kubernetes-dashboard
2024/09/27 01:39:26 Initializing JWE encryption key from synchronized object
2024/09/27 01:39:26 Creating in-cluster Sidecar client
2024/09/27 01:39:26 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/09/27 01:39:26 Serving insecurely on HTTP port: 9090
2024/09/27 01:39:56 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/09/27 01:40:26 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/09/27 01:40:56 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/09/27 01:41:26 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/09/27 01:41:56 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/09/27 01:42:26 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/09/27 01:42:56 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/09/27 01:43:26 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/09/27 01:43:56 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/09/27 01:44:26 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/09/27 01:39:25 Starting overwatch
==> storage-provisioner [138c41837cf0bbda88ce0b41c3d306956ef57ff9c2cb680fa71af1f16e609832] <==
I0927 01:36:55.793059 1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
I0927 01:36:55.811664 1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!
I0927 01:36:55.811777 1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...
I0927 01:36:55.835835 1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath
I0927 01:36:55.835993 1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_old-k8s-version-745133_0238d71c-6d61-45e2-8a17-8402f2337631!
I0927 01:36:55.836233 1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"fb63fc24-0025-4bfe-9bb1-d7dbe0da4177", APIVersion:"v1", ResourceVersion:"480", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' old-k8s-version-745133_0238d71c-6d61-45e2-8a17-8402f2337631 became leader
I0927 01:36:55.936895 1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_old-k8s-version-745133_0238d71c-6d61-45e2-8a17-8402f2337631!
I0927 01:39:04.282554 1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
I0927 01:39:04.295440 1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!
I0927 01:39:04.295581 1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...
I0927 01:39:21.751944 1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath
I0927 01:39:21.752395 1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"fb63fc24-0025-4bfe-9bb1-d7dbe0da4177", APIVersion:"v1", ResourceVersion:"751", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' old-k8s-version-745133_3fa9050b-8ba5-42b3-9684-551107498665 became leader
I0927 01:39:21.752502 1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_old-k8s-version-745133_3fa9050b-8ba5-42b3-9684-551107498665!
I0927 01:39:21.853569 1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_old-k8s-version-745133_3fa9050b-8ba5-42b3-9684-551107498665!
-- /stdout --
helpers_test.go:254: (dbg) Run: out/minikube-linux-arm64 status --format={{.APIServer}} -p old-k8s-version-745133 -n old-k8s-version-745133
helpers_test.go:261: (dbg) Run: kubectl --context old-k8s-version-745133 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:272: non-running pods: metrics-server-9975d5f86-5bphl
helpers_test.go:274: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/SecondStart]: describe non-running pods <======
helpers_test.go:277: (dbg) Run: kubectl --context old-k8s-version-745133 describe pod metrics-server-9975d5f86-5bphl
helpers_test.go:277: (dbg) Non-zero exit: kubectl --context old-k8s-version-745133 describe pod metrics-server-9975d5f86-5bphl: exit status 1 (126.989817ms)
** stderr **
Error from server (NotFound): pods "metrics-server-9975d5f86-5bphl" not found
** /stderr **
helpers_test.go:279: kubectl --context old-k8s-version-745133 describe pod metrics-server-9975d5f86-5bphl: exit status 1
--- FAIL: TestStartStop/group/old-k8s-version/serial/SecondStart (383.01s)