=== RUN TestStartStop/group/old-k8s-version/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run: out/minikube-linux-arm64 start -p old-k8s-version-516480 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --container-runtime=crio --kubernetes-version=v1.20.0
E0922 15:57:56.925373 2481953 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19648-2476577/.minikube/profiles/addons-063976/client.crt: no such file or directory" logger="UnhandledError"
start_stop_delete_test.go:256: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p old-k8s-version-516480 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --container-runtime=crio --kubernetes-version=v1.20.0: exit status 102 (6m17.97227762s)
-- stdout --
* [old-k8s-version-516480] minikube v1.34.0 on Ubuntu 20.04 (arm64)
- MINIKUBE_LOCATION=19648
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/19648-2476577/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/19648-2476577/.minikube
- MINIKUBE_BIN=out/minikube-linux-arm64
- MINIKUBE_FORCE_SYSTEMD=
* Kubernetes 1.31.1 is now available. If you would like to upgrade, specify: --kubernetes-version=v1.31.1
* Using the docker driver based on existing profile
* Starting "old-k8s-version-516480" primary control-plane node in "old-k8s-version-516480" cluster
* Pulling base image v0.0.45-1726784731-19672 ...
* Restarting existing docker container for "old-k8s-version-516480" ...
* Preparing Kubernetes v1.20.0 on CRI-O 1.24.6 ...
* Verifying Kubernetes components...
- Using image gcr.io/k8s-minikube/storage-provisioner:v5
- Using image docker.io/kubernetesui/dashboard:v2.7.0
- Using image registry.k8s.io/echoserver:1.4
- Using image fake.domain/registry.k8s.io/echoserver:1.4
* Some dashboard features require the metrics-server addon. To enable all features please run:
minikube -p old-k8s-version-516480 addons enable metrics-server
* Enabled addons: storage-provisioner, default-storageclass, metrics-server, dashboard
-- /stdout --
** stderr **
I0922 15:57:18.832805 2677774 out.go:345] Setting OutFile to fd 1 ...
I0922 15:57:18.832971 2677774 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0922 15:57:18.832980 2677774 out.go:358] Setting ErrFile to fd 2...
I0922 15:57:18.832986 2677774 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0922 15:57:18.833221 2677774 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19648-2476577/.minikube/bin
I0922 15:57:18.833572 2677774 out.go:352] Setting JSON to false
I0922 15:57:18.834524 2677774 start.go:129] hostinfo: {"hostname":"ip-172-31-21-244","uptime":70789,"bootTime":1726949850,"procs":197,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1070-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"da8ac1fd-6236-412a-a346-95873c98230d"}
I0922 15:57:18.834599 2677774 start.go:139] virtualization:
I0922 15:57:18.837745 2677774 out.go:177] * [old-k8s-version-516480] minikube v1.34.0 on Ubuntu 20.04 (arm64)
I0922 15:57:18.841719 2677774 out.go:177] - MINIKUBE_LOCATION=19648
I0922 15:57:18.841920 2677774 notify.go:220] Checking for updates...
I0922 15:57:18.847877 2677774 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0922 15:57:18.850624 2677774 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/19648-2476577/kubeconfig
I0922 15:57:18.853435 2677774 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/19648-2476577/.minikube
I0922 15:57:18.856145 2677774 out.go:177] - MINIKUBE_BIN=out/minikube-linux-arm64
I0922 15:57:18.858793 2677774 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0922 15:57:18.861897 2677774 config.go:182] Loaded profile config "old-k8s-version-516480": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.20.0
I0922 15:57:18.865155 2677774 out.go:177] * Kubernetes 1.31.1 is now available. If you would like to upgrade, specify: --kubernetes-version=v1.31.1
I0922 15:57:18.867800 2677774 driver.go:394] Setting default libvirt URI to qemu:///system
I0922 15:57:18.905607 2677774 docker.go:123] docker version: linux-27.3.1:Docker Engine - Community
I0922 15:57:18.905728 2677774 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0922 15:57:18.987872 2677774 info.go:266] docker info: {ID:5FDH:SA5P:5GCT:NLAS:B73P:SGDQ:PBG5:UBVH:UZY3:RXGO:CI7S:WAIH Containers:2 ContainersRunning:1 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:48 OomKillDisable:true NGoroutines:67 SystemTime:2024-09-22 15:57:18.976083097 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1070-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:a
arch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214831104 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-21-244 Labels:[] ExperimentalBuild:false ServerVersion:27.3.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c Expected:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c} RuncCommit:{ID:v1.1.14-0-g2c9f560 Expected:v1.1.14-0-g2c9f560} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:[WARNING: brid
ge-nf-call-iptables is disabled WARNING: bridge-nf-call-ip6tables is disabled] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.17.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.7]] Warnings:<nil>}}
I0922 15:57:18.987981 2677774 docker.go:318] overlay module found
I0922 15:57:18.990830 2677774 out.go:177] * Using the docker driver based on existing profile
I0922 15:57:18.994520 2677774 start.go:297] selected driver: docker
I0922 15:57:18.994542 2677774 start.go:901] validating driver "docker" against &{Name:old-k8s-version-516480 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726784731-19672@sha256:7f8c62ddb0100a5b958dd19c5b5478b8c7ef13da9a0a4d6c7d18f43544e0dbed Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-516480 Namespace:default APIServerHAVIP: AP
IServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountStr
ing:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0922 15:57:18.994670 2677774 start.go:912] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0922 15:57:18.995408 2677774 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0922 15:57:19.075474 2677774 info.go:266] docker info: {ID:5FDH:SA5P:5GCT:NLAS:B73P:SGDQ:PBG5:UBVH:UZY3:RXGO:CI7S:WAIH Containers:2 ContainersRunning:1 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:48 OomKillDisable:true NGoroutines:67 SystemTime:2024-09-22 15:57:19.065371398 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1070-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:a
arch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214831104 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-21-244 Labels:[] ExperimentalBuild:false ServerVersion:27.3.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c Expected:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c} RuncCommit:{ID:v1.1.14-0-g2c9f560 Expected:v1.1.14-0-g2c9f560} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:[WARNING: brid
ge-nf-call-iptables is disabled WARNING: bridge-nf-call-ip6tables is disabled] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.17.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.7]] Warnings:<nil>}}
I0922 15:57:19.075855 2677774 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0922 15:57:19.075889 2677774 cni.go:84] Creating CNI manager for ""
I0922 15:57:19.075929 2677774 cni.go:143] "docker" driver + "crio" runtime found, recommending kindnet
I0922 15:57:19.075971 2677774 start.go:340] cluster config:
{Name:old-k8s-version-516480 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726784731-19672@sha256:7f8c62ddb0100a5b958dd19c5b5478b8c7ef13da9a0a4d6c7d18f43544e0dbed Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-516480 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local
ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP
: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0922 15:57:19.081319 2677774 out.go:177] * Starting "old-k8s-version-516480" primary control-plane node in "old-k8s-version-516480" cluster
I0922 15:57:19.083948 2677774 cache.go:121] Beginning downloading kic base image for docker with crio
I0922 15:57:19.086623 2677774 out.go:177] * Pulling base image v0.0.45-1726784731-19672 ...
I0922 15:57:19.089186 2677774 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0922 15:57:19.089255 2677774 preload.go:146] Found local preload: /home/jenkins/minikube-integration/19648-2476577/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-arm64.tar.lz4
I0922 15:57:19.089266 2677774 cache.go:56] Caching tarball of preloaded images
I0922 15:57:19.089361 2677774 preload.go:172] Found /home/jenkins/minikube-integration/19648-2476577/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-arm64.tar.lz4 in cache, skipping download
I0922 15:57:19.089371 2677774 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on crio
I0922 15:57:19.089480 2677774 profile.go:143] Saving config to /home/jenkins/minikube-integration/19648-2476577/.minikube/profiles/old-k8s-version-516480/config.json ...
I0922 15:57:19.089689 2677774 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726784731-19672@sha256:7f8c62ddb0100a5b958dd19c5b5478b8c7ef13da9a0a4d6c7d18f43544e0dbed in local docker daemon
I0922 15:57:19.110456 2677774 image.go:98] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726784731-19672@sha256:7f8c62ddb0100a5b958dd19c5b5478b8c7ef13da9a0a4d6c7d18f43544e0dbed in local docker daemon, skipping pull
I0922 15:57:19.110476 2677774 cache.go:144] gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726784731-19672@sha256:7f8c62ddb0100a5b958dd19c5b5478b8c7ef13da9a0a4d6c7d18f43544e0dbed exists in daemon, skipping load
I0922 15:57:19.110490 2677774 cache.go:194] Successfully downloaded all kic artifacts
I0922 15:57:19.110520 2677774 start.go:360] acquireMachinesLock for old-k8s-version-516480: {Name:mk191620f90eae65cb344642c92a87a5dba74d22 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0922 15:57:19.110572 2677774 start.go:364] duration metric: took 34.748µs to acquireMachinesLock for "old-k8s-version-516480"
I0922 15:57:19.110592 2677774 start.go:96] Skipping create...Using existing machine configuration
I0922 15:57:19.110596 2677774 fix.go:54] fixHost starting:
I0922 15:57:19.110849 2677774 cli_runner.go:164] Run: docker container inspect old-k8s-version-516480 --format={{.State.Status}}
I0922 15:57:19.133799 2677774 fix.go:112] recreateIfNeeded on old-k8s-version-516480: state=Stopped err=<nil>
W0922 15:57:19.133828 2677774 fix.go:138] unexpected machine state, will restart: <nil>
I0922 15:57:19.136826 2677774 out.go:177] * Restarting existing docker container for "old-k8s-version-516480" ...
I0922 15:57:19.139834 2677774 cli_runner.go:164] Run: docker start old-k8s-version-516480
I0922 15:57:19.487885 2677774 cli_runner.go:164] Run: docker container inspect old-k8s-version-516480 --format={{.State.Status}}
I0922 15:57:19.526527 2677774 kic.go:430] container "old-k8s-version-516480" state is running.
I0922 15:57:19.526898 2677774 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-516480
I0922 15:57:19.546341 2677774 profile.go:143] Saving config to /home/jenkins/minikube-integration/19648-2476577/.minikube/profiles/old-k8s-version-516480/config.json ...
I0922 15:57:19.546567 2677774 machine.go:93] provisionDockerMachine start ...
I0922 15:57:19.546633 2677774 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-516480
I0922 15:57:19.568122 2677774 main.go:141] libmachine: Using SSH client type: native
I0922 15:57:19.568405 2677774 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x413650] 0x415e90 <nil> [] 0s} 127.0.0.1 36350 <nil> <nil>}
I0922 15:57:19.568416 2677774 main.go:141] libmachine: About to run SSH command:
hostname
I0922 15:57:19.569139 2677774 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: EOF
I0922 15:57:22.726441 2677774 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-516480
I0922 15:57:22.726468 2677774 ubuntu.go:169] provisioning hostname "old-k8s-version-516480"
I0922 15:57:22.726541 2677774 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-516480
I0922 15:57:22.760234 2677774 main.go:141] libmachine: Using SSH client type: native
I0922 15:57:22.760476 2677774 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x413650] 0x415e90 <nil> [] 0s} 127.0.0.1 36350 <nil> <nil>}
I0922 15:57:22.760488 2677774 main.go:141] libmachine: About to run SSH command:
sudo hostname old-k8s-version-516480 && echo "old-k8s-version-516480" | sudo tee /etc/hostname
I0922 15:57:22.915720 2677774 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-516480
I0922 15:57:22.915808 2677774 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-516480
I0922 15:57:22.955151 2677774 main.go:141] libmachine: Using SSH client type: native
I0922 15:57:22.955419 2677774 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x413650] 0x415e90 <nil> [] 0s} 127.0.0.1 36350 <nil> <nil>}
I0922 15:57:22.955444 2677774 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-516480' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-516480/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-516480' | sudo tee -a /etc/hosts;
fi
fi
I0922 15:57:23.089726 2677774 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0922 15:57:23.089756 2677774 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/19648-2476577/.minikube CaCertPath:/home/jenkins/minikube-integration/19648-2476577/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19648-2476577/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19648-2476577/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19648-2476577/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19648-2476577/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19648-2476577/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19648-2476577/.minikube}
I0922 15:57:23.089792 2677774 ubuntu.go:177] setting up certificates
I0922 15:57:23.089802 2677774 provision.go:84] configureAuth start
I0922 15:57:23.089870 2677774 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-516480
I0922 15:57:23.115973 2677774 provision.go:143] copyHostCerts
I0922 15:57:23.116048 2677774 exec_runner.go:144] found /home/jenkins/minikube-integration/19648-2476577/.minikube/ca.pem, removing ...
I0922 15:57:23.116069 2677774 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19648-2476577/.minikube/ca.pem
I0922 15:57:23.116147 2677774 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19648-2476577/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19648-2476577/.minikube/ca.pem (1078 bytes)
I0922 15:57:23.116254 2677774 exec_runner.go:144] found /home/jenkins/minikube-integration/19648-2476577/.minikube/cert.pem, removing ...
I0922 15:57:23.116265 2677774 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19648-2476577/.minikube/cert.pem
I0922 15:57:23.116294 2677774 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19648-2476577/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19648-2476577/.minikube/cert.pem (1123 bytes)
I0922 15:57:23.116360 2677774 exec_runner.go:144] found /home/jenkins/minikube-integration/19648-2476577/.minikube/key.pem, removing ...
I0922 15:57:23.116369 2677774 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19648-2476577/.minikube/key.pem
I0922 15:57:23.116405 2677774 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19648-2476577/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19648-2476577/.minikube/key.pem (1675 bytes)
I0922 15:57:23.116468 2677774 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19648-2476577/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19648-2476577/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19648-2476577/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-516480 san=[127.0.0.1 192.168.76.2 localhost minikube old-k8s-version-516480]
I0922 15:57:23.516464 2677774 provision.go:177] copyRemoteCerts
I0922 15:57:23.516534 2677774 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0922 15:57:23.516575 2677774 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-516480
I0922 15:57:23.551780 2677774 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:36350 SSHKeyPath:/home/jenkins/minikube-integration/19648-2476577/.minikube/machines/old-k8s-version-516480/id_rsa Username:docker}
I0922 15:57:23.652620 2677774 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19648-2476577/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0922 15:57:23.678460 2677774 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19648-2476577/.minikube/machines/server.pem --> /etc/docker/server.pem (1233 bytes)
I0922 15:57:23.704784 2677774 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19648-2476577/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I0922 15:57:23.729523 2677774 provision.go:87] duration metric: took 639.701371ms to configureAuth
I0922 15:57:23.729552 2677774 ubuntu.go:193] setting minikube options for container-runtime
I0922 15:57:23.729749 2677774 config.go:182] Loaded profile config "old-k8s-version-516480": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.20.0
I0922 15:57:23.729857 2677774 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-516480
I0922 15:57:23.747638 2677774 main.go:141] libmachine: Using SSH client type: native
I0922 15:57:23.747877 2677774 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x413650] 0x415e90 <nil> [] 0s} 127.0.0.1 36350 <nil> <nil>}
I0922 15:57:23.747897 2677774 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %s "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0922 15:57:24.159600 2677774 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0922 15:57:24.159618 2677774 machine.go:96] duration metric: took 4.613041818s to provisionDockerMachine
I0922 15:57:24.159630 2677774 start.go:293] postStartSetup for "old-k8s-version-516480" (driver="docker")
I0922 15:57:24.159641 2677774 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0922 15:57:24.159715 2677774 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0922 15:57:24.159765 2677774 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-516480
I0922 15:57:24.190888 2677774 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:36350 SSHKeyPath:/home/jenkins/minikube-integration/19648-2476577/.minikube/machines/old-k8s-version-516480/id_rsa Username:docker}
I0922 15:57:24.292670 2677774 ssh_runner.go:195] Run: cat /etc/os-release
I0922 15:57:24.296872 2677774 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I0922 15:57:24.296969 2677774 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
I0922 15:57:24.297012 2677774 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
I0922 15:57:24.297038 2677774 info.go:137] Remote host: Ubuntu 22.04.5 LTS
I0922 15:57:24.297061 2677774 filesync.go:126] Scanning /home/jenkins/minikube-integration/19648-2476577/.minikube/addons for local assets ...
I0922 15:57:24.297148 2677774 filesync.go:126] Scanning /home/jenkins/minikube-integration/19648-2476577/.minikube/files for local assets ...
I0922 15:57:24.297282 2677774 filesync.go:149] local asset: /home/jenkins/minikube-integration/19648-2476577/.minikube/files/etc/ssl/certs/24819532.pem -> 24819532.pem in /etc/ssl/certs
I0922 15:57:24.297448 2677774 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0922 15:57:24.309466 2677774 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19648-2476577/.minikube/files/etc/ssl/certs/24819532.pem --> /etc/ssl/certs/24819532.pem (1708 bytes)
I0922 15:57:24.338435 2677774 start.go:296] duration metric: took 178.789643ms for postStartSetup
I0922 15:57:24.338566 2677774 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I0922 15:57:24.338646 2677774 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-516480
I0922 15:57:24.359871 2677774 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:36350 SSHKeyPath:/home/jenkins/minikube-integration/19648-2476577/.minikube/machines/old-k8s-version-516480/id_rsa Username:docker}
I0922 15:57:24.452471 2677774 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
I0922 15:57:24.457629 2677774 fix.go:56] duration metric: took 5.347024883s for fixHost
I0922 15:57:24.457651 2677774 start.go:83] releasing machines lock for "old-k8s-version-516480", held for 5.34707129s
I0922 15:57:24.457719 2677774 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-516480
I0922 15:57:24.476270 2677774 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0922 15:57:24.476364 2677774 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-516480
I0922 15:57:24.476578 2677774 ssh_runner.go:195] Run: cat /version.json
I0922 15:57:24.476615 2677774 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-516480
I0922 15:57:24.511989 2677774 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:36350 SSHKeyPath:/home/jenkins/minikube-integration/19648-2476577/.minikube/machines/old-k8s-version-516480/id_rsa Username:docker}
I0922 15:57:24.517280 2677774 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:36350 SSHKeyPath:/home/jenkins/minikube-integration/19648-2476577/.minikube/machines/old-k8s-version-516480/id_rsa Username:docker}
I0922 15:57:24.745109 2677774 ssh_runner.go:195] Run: systemctl --version
I0922 15:57:24.749491 2677774 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0922 15:57:24.903942 2677774 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
I0922 15:57:24.908563 2677774 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0922 15:57:24.918165 2677774 cni.go:221] loopback cni configuration disabled: "/etc/cni/net.d/*loopback.conf*" found
I0922 15:57:24.918285 2677774 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0922 15:57:24.927741 2677774 cni.go:259] no active bridge cni configs found in "/etc/cni/net.d" - nothing to disable
I0922 15:57:24.927814 2677774 start.go:495] detecting cgroup driver to use...
I0922 15:57:24.927861 2677774 detect.go:187] detected "cgroupfs" cgroup driver on host os
I0922 15:57:24.927935 2677774 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0922 15:57:24.945899 2677774 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0922 15:57:24.960516 2677774 docker.go:217] disabling cri-docker service (if available) ...
I0922 15:57:24.960636 2677774 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0922 15:57:24.974792 2677774 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0922 15:57:24.993875 2677774 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0922 15:57:25.131130 2677774 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0922 15:57:25.240184 2677774 docker.go:233] disabling docker service ...
I0922 15:57:25.240342 2677774 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0922 15:57:25.261249 2677774 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0922 15:57:25.276695 2677774 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0922 15:57:25.397423 2677774 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0922 15:57:25.508378 2677774 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0922 15:57:25.521574 2677774 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0922 15:57:25.538528 2677774 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.2" pause image...
I0922 15:57:25.538638 2677774 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.2"|' /etc/crio/crio.conf.d/02-crio.conf"
I0922 15:57:25.548532 2677774 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0922 15:57:25.548684 2677774 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0922 15:57:25.558412 2677774 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0922 15:57:25.568163 2677774 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0922 15:57:25.578217 2677774 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0922 15:57:25.587675 2677774 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0922 15:57:25.596484 2677774 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0922 15:57:25.605169 2677774 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0922 15:57:25.706964 2677774 ssh_runner.go:195] Run: sudo systemctl restart crio
I0922 15:57:26.361084 2677774 start.go:542] Will wait 60s for socket path /var/run/crio/crio.sock
I0922 15:57:26.361210 2677774 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0922 15:57:26.365281 2677774 start.go:563] Will wait 60s for crictl version
I0922 15:57:26.365415 2677774 ssh_runner.go:195] Run: which crictl
I0922 15:57:26.369894 2677774 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0922 15:57:26.434961 2677774 start.go:579] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.24.6
RuntimeApiVersion: v1
I0922 15:57:26.435142 2677774 ssh_runner.go:195] Run: crio --version
I0922 15:57:26.481450 2677774 ssh_runner.go:195] Run: crio --version
I0922 15:57:26.535837 2677774 out.go:177] * Preparing Kubernetes v1.20.0 on CRI-O 1.24.6 ...
I0922 15:57:26.537190 2677774 cli_runner.go:164] Run: docker network inspect old-k8s-version-516480 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I0922 15:57:26.553932 2677774 ssh_runner.go:195] Run: grep 192.168.76.1 host.minikube.internal$ /etc/hosts
I0922 15:57:26.558007 2677774 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.76.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0922 15:57:26.569346 2677774 kubeadm.go:883] updating cluster {Name:old-k8s-version-516480 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726784731-19672@sha256:7f8c62ddb0100a5b958dd19c5b5478b8c7ef13da9a0a4d6c7d18f43544e0dbed Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-516480 Namespace:default APIServerHAVIP: APIServerName:minik
ubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins
:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0922 15:57:26.569463 2677774 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0922 15:57:26.569515 2677774 ssh_runner.go:195] Run: sudo crictl images --output json
I0922 15:57:26.627071 2677774 crio.go:514] all images are preloaded for cri-o runtime.
I0922 15:57:26.627098 2677774 crio.go:433] Images already preloaded, skipping extraction
I0922 15:57:26.627152 2677774 ssh_runner.go:195] Run: sudo crictl images --output json
I0922 15:57:26.676741 2677774 crio.go:514] all images are preloaded for cri-o runtime.
I0922 15:57:26.676762 2677774 cache_images.go:84] Images are preloaded, skipping loading
I0922 15:57:26.676771 2677774 kubeadm.go:934] updating node { 192.168.76.2 8443 v1.20.0 crio true true} ...
I0922 15:57:26.676875 2677774 kubeadm.go:946] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.20.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --cgroups-per-qos=false --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///var/run/crio/crio.sock --enforce-node-allocatable= --hostname-override=old-k8s-version-516480 --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.76.2
[Install]
config:
{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-516480 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0922 15:57:26.676962 2677774 ssh_runner.go:195] Run: crio config
I0922 15:57:26.761448 2677774 cni.go:84] Creating CNI manager for ""
I0922 15:57:26.761473 2677774 cni.go:143] "docker" driver + "crio" runtime found, recommending kindnet
I0922 15:57:26.761483 2677774 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0922 15:57:26.761505 2677774 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.76.2 APIServerPort:8443 KubernetesVersion:v1.20.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-516480 NodeName:old-k8s-version-516480 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.76.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.76.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPo
dPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
I0922 15:57:26.761657 2677774 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta2
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.76.2
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /var/run/crio/crio.sock
name: "old-k8s-version-516480"
kubeletExtraArgs:
node-ip: 192.168.76.2
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta2
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.76.2"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.20.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0922 15:57:26.761739 2677774 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.20.0
I0922 15:57:26.771778 2677774 binaries.go:44] Found k8s binaries, skipping transfer
I0922 15:57:26.771848 2677774 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0922 15:57:26.781165 2677774 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (480 bytes)
I0922 15:57:26.801576 2677774 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0922 15:57:26.821963 2677774 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2117 bytes)
I0922 15:57:26.843148 2677774 ssh_runner.go:195] Run: grep 192.168.76.2 control-plane.minikube.internal$ /etc/hosts
I0922 15:57:26.847011 2677774 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.76.2 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0922 15:57:26.858888 2677774 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0922 15:57:26.977956 2677774 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0922 15:57:26.994444 2677774 certs.go:68] Setting up /home/jenkins/minikube-integration/19648-2476577/.minikube/profiles/old-k8s-version-516480 for IP: 192.168.76.2
I0922 15:57:26.994466 2677774 certs.go:194] generating shared ca certs ...
I0922 15:57:26.994482 2677774 certs.go:226] acquiring lock for ca certs: {Name:mkeff3e73d2be4d9e117d80b8189a4c062e8cbf0 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0922 15:57:26.994626 2677774 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/19648-2476577/.minikube/ca.key
I0922 15:57:26.994675 2677774 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19648-2476577/.minikube/proxy-client-ca.key
I0922 15:57:26.994687 2677774 certs.go:256] generating profile certs ...
I0922 15:57:26.994800 2677774 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/19648-2476577/.minikube/profiles/old-k8s-version-516480/client.key
I0922 15:57:26.994883 2677774 certs.go:359] skipping valid signed profile cert regeneration for "minikube": /home/jenkins/minikube-integration/19648-2476577/.minikube/profiles/old-k8s-version-516480/apiserver.key.1c564e3e
I0922 15:57:26.994950 2677774 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/19648-2476577/.minikube/profiles/old-k8s-version-516480/proxy-client.key
I0922 15:57:26.995069 2677774 certs.go:484] found cert: /home/jenkins/minikube-integration/19648-2476577/.minikube/certs/2481953.pem (1338 bytes)
W0922 15:57:26.995103 2677774 certs.go:480] ignoring /home/jenkins/minikube-integration/19648-2476577/.minikube/certs/2481953_empty.pem, impossibly tiny 0 bytes
I0922 15:57:26.995116 2677774 certs.go:484] found cert: /home/jenkins/minikube-integration/19648-2476577/.minikube/certs/ca-key.pem (1675 bytes)
I0922 15:57:26.995139 2677774 certs.go:484] found cert: /home/jenkins/minikube-integration/19648-2476577/.minikube/certs/ca.pem (1078 bytes)
I0922 15:57:26.995178 2677774 certs.go:484] found cert: /home/jenkins/minikube-integration/19648-2476577/.minikube/certs/cert.pem (1123 bytes)
I0922 15:57:26.995203 2677774 certs.go:484] found cert: /home/jenkins/minikube-integration/19648-2476577/.minikube/certs/key.pem (1675 bytes)
I0922 15:57:26.995250 2677774 certs.go:484] found cert: /home/jenkins/minikube-integration/19648-2476577/.minikube/files/etc/ssl/certs/24819532.pem (1708 bytes)
I0922 15:57:26.995943 2677774 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19648-2476577/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0922 15:57:27.076152 2677774 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19648-2476577/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
I0922 15:57:27.170855 2677774 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19648-2476577/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0922 15:57:27.229204 2677774 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19648-2476577/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I0922 15:57:27.256294 2677774 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19648-2476577/.minikube/profiles/old-k8s-version-516480/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
I0922 15:57:27.291873 2677774 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19648-2476577/.minikube/profiles/old-k8s-version-516480/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
I0922 15:57:27.314965 2677774 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19648-2476577/.minikube/profiles/old-k8s-version-516480/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0922 15:57:27.345847 2677774 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19648-2476577/.minikube/profiles/old-k8s-version-516480/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I0922 15:57:27.376979 2677774 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19648-2476577/.minikube/certs/2481953.pem --> /usr/share/ca-certificates/2481953.pem (1338 bytes)
I0922 15:57:27.406668 2677774 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19648-2476577/.minikube/files/etc/ssl/certs/24819532.pem --> /usr/share/ca-certificates/24819532.pem (1708 bytes)
I0922 15:57:27.432301 2677774 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19648-2476577/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0922 15:57:27.457151 2677774 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0922 15:57:27.475657 2677774 ssh_runner.go:195] Run: openssl version
I0922 15:57:27.481571 2677774 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/2481953.pem && ln -fs /usr/share/ca-certificates/2481953.pem /etc/ssl/certs/2481953.pem"
I0922 15:57:27.492250 2677774 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/2481953.pem
I0922 15:57:27.496139 2677774 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Sep 22 15:14 /usr/share/ca-certificates/2481953.pem
I0922 15:57:27.496282 2677774 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/2481953.pem
I0922 15:57:27.503527 2677774 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/2481953.pem /etc/ssl/certs/51391683.0"
I0922 15:57:27.513029 2677774 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/24819532.pem && ln -fs /usr/share/ca-certificates/24819532.pem /etc/ssl/certs/24819532.pem"
I0922 15:57:27.522623 2677774 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/24819532.pem
I0922 15:57:27.526451 2677774 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Sep 22 15:14 /usr/share/ca-certificates/24819532.pem
I0922 15:57:27.526566 2677774 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/24819532.pem
I0922 15:57:27.533781 2677774 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/24819532.pem /etc/ssl/certs/3ec20f2e.0"
I0922 15:57:27.543511 2677774 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0922 15:57:27.553103 2677774 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0922 15:57:27.556943 2677774 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Sep 22 14:55 /usr/share/ca-certificates/minikubeCA.pem
I0922 15:57:27.557049 2677774 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0922 15:57:27.564169 2677774 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0922 15:57:27.573345 2677774 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0922 15:57:27.577141 2677774 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-etcd-client.crt -checkend 86400
I0922 15:57:27.583960 2677774 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-kubelet-client.crt -checkend 86400
I0922 15:57:27.590980 2677774 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/server.crt -checkend 86400
I0922 15:57:27.597857 2677774 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/healthcheck-client.crt -checkend 86400
I0922 15:57:27.604818 2677774 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/peer.crt -checkend 86400
I0922 15:57:27.611821 2677774 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/front-proxy-client.crt -checkend 86400
I0922 15:57:27.618704 2677774 kubeadm.go:392] StartCluster: {Name:old-k8s-version-516480 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726784731-19672@sha256:7f8c62ddb0100a5b958dd19c5b5478b8c7ef13da9a0a4d6c7d18f43544e0dbed Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-516480 Namespace:default APIServerHAVIP: APIServerName:minikube
CA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/m
inikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0922 15:57:27.618850 2677774 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I0922 15:57:27.618987 2677774 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0922 15:57:27.669200 2677774 cri.go:89] found id: ""
I0922 15:57:27.669321 2677774 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0922 15:57:27.679273 2677774 kubeadm.go:408] found existing configuration files, will attempt cluster restart
I0922 15:57:27.679319 2677774 kubeadm.go:593] restartPrimaryControlPlane start ...
I0922 15:57:27.679395 2677774 ssh_runner.go:195] Run: sudo test -d /data/minikube
I0922 15:57:27.688367 2677774 kubeadm.go:130] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1
stdout:
stderr:
I0922 15:57:27.688884 2677774 kubeconfig.go:47] verify endpoint returned: get endpoint: "old-k8s-version-516480" does not appear in /home/jenkins/minikube-integration/19648-2476577/kubeconfig
I0922 15:57:27.689042 2677774 kubeconfig.go:62] /home/jenkins/minikube-integration/19648-2476577/kubeconfig needs updating (will repair): [kubeconfig missing "old-k8s-version-516480" cluster setting kubeconfig missing "old-k8s-version-516480" context setting]
I0922 15:57:27.689421 2677774 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19648-2476577/kubeconfig: {Name:mk86102d2663511afa0f6941c90df65de1224212 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0922 15:57:27.691973 2677774 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new
I0922 15:57:27.701171 2677774 kubeadm.go:630] The running cluster does not require reconfiguration: 192.168.76.2
I0922 15:57:27.701228 2677774 kubeadm.go:597] duration metric: took 21.895979ms to restartPrimaryControlPlane
I0922 15:57:27.701243 2677774 kubeadm.go:394] duration metric: took 82.550293ms to StartCluster
I0922 15:57:27.701259 2677774 settings.go:142] acquiring lock: {Name:mk2cf6e4d3f37a4f62280a8a9356d931b86b236f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0922 15:57:27.701360 2677774 settings.go:150] Updating kubeconfig: /home/jenkins/minikube-integration/19648-2476577/kubeconfig
I0922 15:57:27.702124 2677774 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19648-2476577/kubeconfig: {Name:mk86102d2663511afa0f6941c90df65de1224212 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0922 15:57:27.702370 2677774 start.go:235] Will wait 6m0s for node &{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}
I0922 15:57:27.702751 2677774 addons.go:507] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:true default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false]
I0922 15:57:27.702837 2677774 addons.go:69] Setting storage-provisioner=true in profile "old-k8s-version-516480"
I0922 15:57:27.702850 2677774 addons.go:234] Setting addon storage-provisioner=true in "old-k8s-version-516480"
W0922 15:57:27.702856 2677774 addons.go:243] addon storage-provisioner should already be in state true
I0922 15:57:27.702878 2677774 host.go:66] Checking if "old-k8s-version-516480" exists ...
I0922 15:57:27.703409 2677774 cli_runner.go:164] Run: docker container inspect old-k8s-version-516480 --format={{.State.Status}}
I0922 15:57:27.704070 2677774 config.go:182] Loaded profile config "old-k8s-version-516480": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.20.0
I0922 15:57:27.704195 2677774 addons.go:69] Setting default-storageclass=true in profile "old-k8s-version-516480"
I0922 15:57:27.704240 2677774 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "old-k8s-version-516480"
I0922 15:57:27.704672 2677774 cli_runner.go:164] Run: docker container inspect old-k8s-version-516480 --format={{.State.Status}}
I0922 15:57:27.706917 2677774 addons.go:69] Setting metrics-server=true in profile "old-k8s-version-516480"
I0922 15:57:27.707258 2677774 addons.go:234] Setting addon metrics-server=true in "old-k8s-version-516480"
W0922 15:57:27.707323 2677774 addons.go:243] addon metrics-server should already be in state true
I0922 15:57:27.706966 2677774 addons.go:69] Setting dashboard=true in profile "old-k8s-version-516480"
I0922 15:57:27.707378 2677774 addons.go:234] Setting addon dashboard=true in "old-k8s-version-516480"
W0922 15:57:27.707385 2677774 addons.go:243] addon dashboard should already be in state true
I0922 15:57:27.707405 2677774 host.go:66] Checking if "old-k8s-version-516480" exists ...
I0922 15:57:27.707850 2677774 cli_runner.go:164] Run: docker container inspect old-k8s-version-516480 --format={{.State.Status}}
I0922 15:57:27.708013 2677774 host.go:66] Checking if "old-k8s-version-516480" exists ...
I0922 15:57:27.707015 2677774 out.go:177] * Verifying Kubernetes components...
I0922 15:57:27.709577 2677774 cli_runner.go:164] Run: docker container inspect old-k8s-version-516480 --format={{.State.Status}}
I0922 15:57:27.711727 2677774 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0922 15:57:27.751792 2677774 out.go:177] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
I0922 15:57:27.754093 2677774 addons.go:431] installing /etc/kubernetes/addons/storage-provisioner.yaml
I0922 15:57:27.754113 2677774 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I0922 15:57:27.754174 2677774 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-516480
I0922 15:57:27.780736 2677774 out.go:177] - Using image docker.io/kubernetesui/dashboard:v2.7.0
I0922 15:57:27.784539 2677774 addons.go:234] Setting addon default-storageclass=true in "old-k8s-version-516480"
W0922 15:57:27.784557 2677774 addons.go:243] addon default-storageclass should already be in state true
I0922 15:57:27.784581 2677774 host.go:66] Checking if "old-k8s-version-516480" exists ...
I0922 15:57:27.784993 2677774 cli_runner.go:164] Run: docker container inspect old-k8s-version-516480 --format={{.State.Status}}
I0922 15:57:27.787078 2677774 out.go:177] - Using image registry.k8s.io/echoserver:1.4
I0922 15:57:27.798975 2677774 addons.go:431] installing /etc/kubernetes/addons/dashboard-ns.yaml
I0922 15:57:27.799002 2677774 ssh_runner.go:362] scp dashboard/dashboard-ns.yaml --> /etc/kubernetes/addons/dashboard-ns.yaml (759 bytes)
I0922 15:57:27.799070 2677774 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-516480
I0922 15:57:27.800852 2677774 out.go:177] - Using image fake.domain/registry.k8s.io/echoserver:1.4
I0922 15:57:27.802620 2677774 addons.go:431] installing /etc/kubernetes/addons/metrics-apiservice.yaml
I0922 15:57:27.802638 2677774 ssh_runner.go:362] scp metrics-server/metrics-apiservice.yaml --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)
I0922 15:57:27.802705 2677774 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-516480
I0922 15:57:27.823237 2677774 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:36350 SSHKeyPath:/home/jenkins/minikube-integration/19648-2476577/.minikube/machines/old-k8s-version-516480/id_rsa Username:docker}
I0922 15:57:27.847097 2677774 addons.go:431] installing /etc/kubernetes/addons/storageclass.yaml
I0922 15:57:27.847119 2677774 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I0922 15:57:27.847177 2677774 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-516480
I0922 15:57:27.852114 2677774 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:36350 SSHKeyPath:/home/jenkins/minikube-integration/19648-2476577/.minikube/machines/old-k8s-version-516480/id_rsa Username:docker}
I0922 15:57:27.872513 2677774 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:36350 SSHKeyPath:/home/jenkins/minikube-integration/19648-2476577/.minikube/machines/old-k8s-version-516480/id_rsa Username:docker}
I0922 15:57:27.881223 2677774 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:36350 SSHKeyPath:/home/jenkins/minikube-integration/19648-2476577/.minikube/machines/old-k8s-version-516480/id_rsa Username:docker}
I0922 15:57:27.996514 2677774 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0922 15:57:28.019343 2677774 node_ready.go:35] waiting up to 6m0s for node "old-k8s-version-516480" to be "Ready" ...
I0922 15:57:28.038134 2677774 addons.go:431] installing /etc/kubernetes/addons/dashboard-clusterrole.yaml
I0922 15:57:28.038162 2677774 ssh_runner.go:362] scp dashboard/dashboard-clusterrole.yaml --> /etc/kubernetes/addons/dashboard-clusterrole.yaml (1001 bytes)
I0922 15:57:28.085397 2677774 addons.go:431] installing /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml
I0922 15:57:28.085433 2677774 ssh_runner.go:362] scp dashboard/dashboard-clusterrolebinding.yaml --> /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml (1018 bytes)
I0922 15:57:28.101513 2677774 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I0922 15:57:28.109478 2677774 addons.go:431] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
I0922 15:57:28.109509 2677774 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1825 bytes)
I0922 15:57:28.133423 2677774 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
I0922 15:57:28.161132 2677774 addons.go:431] installing /etc/kubernetes/addons/dashboard-configmap.yaml
I0922 15:57:28.161158 2677774 ssh_runner.go:362] scp dashboard/dashboard-configmap.yaml --> /etc/kubernetes/addons/dashboard-configmap.yaml (837 bytes)
I0922 15:57:28.177875 2677774 addons.go:431] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
I0922 15:57:28.177917 2677774 ssh_runner.go:362] scp metrics-server/metrics-server-rbac.yaml --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)
I0922 15:57:28.294969 2677774 addons.go:431] installing /etc/kubernetes/addons/dashboard-dp.yaml
I0922 15:57:28.294994 2677774 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-dp.yaml (4201 bytes)
I0922 15:57:28.303300 2677774 addons.go:431] installing /etc/kubernetes/addons/metrics-server-service.yaml
I0922 15:57:28.303333 2677774 ssh_runner.go:362] scp metrics-server/metrics-server-service.yaml --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)
I0922 15:57:28.403508 2677774 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0922 15:57:28.417310 2677774 addons.go:431] installing /etc/kubernetes/addons/dashboard-role.yaml
I0922 15:57:28.417390 2677774 ssh_runner.go:362] scp dashboard/dashboard-role.yaml --> /etc/kubernetes/addons/dashboard-role.yaml (1724 bytes)
W0922 15:57:28.434620 2677774 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0922 15:57:28.434713 2677774 retry.go:31] will retry after 252.33837ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0922 15:57:28.455263 2677774 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0922 15:57:28.455335 2677774 retry.go:31] will retry after 340.993652ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0922 15:57:28.472896 2677774 addons.go:431] installing /etc/kubernetes/addons/dashboard-rolebinding.yaml
I0922 15:57:28.472978 2677774 ssh_runner.go:362] scp dashboard/dashboard-rolebinding.yaml --> /etc/kubernetes/addons/dashboard-rolebinding.yaml (1046 bytes)
I0922 15:57:28.536396 2677774 addons.go:431] installing /etc/kubernetes/addons/dashboard-sa.yaml
I0922 15:57:28.536469 2677774 ssh_runner.go:362] scp dashboard/dashboard-sa.yaml --> /etc/kubernetes/addons/dashboard-sa.yaml (837 bytes)
I0922 15:57:28.586307 2677774 addons.go:431] installing /etc/kubernetes/addons/dashboard-secret.yaml
I0922 15:57:28.586376 2677774 ssh_runner.go:362] scp dashboard/dashboard-secret.yaml --> /etc/kubernetes/addons/dashboard-secret.yaml (1389 bytes)
W0922 15:57:28.592502 2677774 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0922 15:57:28.592588 2677774 retry.go:31] will retry after 165.285366ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0922 15:57:28.608872 2677774 addons.go:431] installing /etc/kubernetes/addons/dashboard-svc.yaml
I0922 15:57:28.608940 2677774 ssh_runner.go:362] scp dashboard/dashboard-svc.yaml --> /etc/kubernetes/addons/dashboard-svc.yaml (1294 bytes)
I0922 15:57:28.629168 2677774 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
I0922 15:57:28.687508 2677774 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W0922 15:57:28.756492 2677774 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0922 15:57:28.756599 2677774 retry.go:31] will retry after 141.303596ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0922 15:57:28.758798 2677774 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0922 15:57:28.797508 2677774 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W0922 15:57:28.844343 2677774 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0922 15:57:28.844430 2677774 retry.go:31] will retry after 560.619318ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0922 15:57:28.898668 2677774 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0922 15:57:28.997577 2677774 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0922 15:57:28.997683 2677774 retry.go:31] will retry after 280.902696ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0922 15:57:29.041330 2677774 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0922 15:57:29.041427 2677774 retry.go:31] will retry after 267.739653ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0922 15:57:29.121772 2677774 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0922 15:57:29.121866 2677774 retry.go:31] will retry after 440.559121ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0922 15:57:29.279332 2677774 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0922 15:57:29.309763 2677774 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W0922 15:57:29.396296 2677774 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0922 15:57:29.396376 2677774 retry.go:31] will retry after 808.514598ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0922 15:57:29.405482 2677774 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W0922 15:57:29.544273 2677774 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0922 15:57:29.544307 2677774 retry.go:31] will retry after 540.870455ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0922 15:57:29.563434 2677774 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0922 15:57:29.580310 2677774 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0922 15:57:29.580388 2677774 retry.go:31] will retry after 492.136917ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0922 15:57:29.677813 2677774 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0922 15:57:29.677892 2677774 retry.go:31] will retry after 429.65471ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0922 15:57:30.020613 2677774 node_ready.go:53] error getting node "old-k8s-version-516480": Get "https://192.168.76.2:8443/api/v1/nodes/old-k8s-version-516480": dial tcp 192.168.76.2:8443: connect: connection refused
I0922 15:57:30.073690 2677774 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
I0922 15:57:30.086178 2677774 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
I0922 15:57:30.108502 2677774 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
I0922 15:57:30.205998 2677774 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W0922 15:57:30.372425 2677774 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0922 15:57:30.372458 2677774 retry.go:31] will retry after 987.246777ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0922 15:57:30.412333 2677774 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0922 15:57:30.412376 2677774 retry.go:31] will retry after 1.161561138s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0922 15:57:30.412431 2677774 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0922 15:57:30.412452 2677774 retry.go:31] will retry after 557.290715ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0922 15:57:30.450661 2677774 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0922 15:57:30.450722 2677774 retry.go:31] will retry after 790.463175ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0922 15:57:30.969947 2677774 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0922 15:57:31.068853 2677774 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0922 15:57:31.068935 2677774 retry.go:31] will retry after 687.843753ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0922 15:57:31.242387 2677774 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W0922 15:57:31.338154 2677774 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0922 15:57:31.338188 2677774 retry.go:31] will retry after 1.033457653s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0922 15:57:31.360457 2677774 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W0922 15:57:31.460111 2677774 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0922 15:57:31.460198 2677774 retry.go:31] will retry after 1.23471221s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0922 15:57:31.574826 2677774 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W0922 15:57:31.644833 2677774 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0922 15:57:31.644867 2677774 retry.go:31] will retry after 1.420771797s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0922 15:57:31.757026 2677774 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0922 15:57:31.827691 2677774 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0922 15:57:31.827725 2677774 retry.go:31] will retry after 2.340227144s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0922 15:57:32.371861 2677774 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W0922 15:57:32.492931 2677774 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0922 15:57:32.492975 2677774 retry.go:31] will retry after 2.752900838s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0922 15:57:32.520530 2677774 node_ready.go:53] error getting node "old-k8s-version-516480": Get "https://192.168.76.2:8443/api/v1/nodes/old-k8s-version-516480": dial tcp 192.168.76.2:8443: connect: connection refused
I0922 15:57:32.695932 2677774 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W0922 15:57:32.801407 2677774 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0922 15:57:32.801441 2677774 retry.go:31] will retry after 1.21043584s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0922 15:57:33.066433 2677774 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W0922 15:57:33.177542 2677774 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0922 15:57:33.177577 2677774 retry.go:31] will retry after 1.918950177s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0922 15:57:34.012276 2677774 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W0922 15:57:34.135266 2677774 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0922 15:57:34.135300 2677774 retry.go:31] will retry after 2.738686505s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0922 15:57:34.168567 2677774 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0922 15:57:34.302088 2677774 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0922 15:57:34.302123 2677774 retry.go:31] will retry after 3.038302668s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0922 15:57:34.520804 2677774 node_ready.go:53] error getting node "old-k8s-version-516480": Get "https://192.168.76.2:8443/api/v1/nodes/old-k8s-version-516480": dial tcp 192.168.76.2:8443: connect: connection refused
I0922 15:57:35.096658 2677774 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W0922 15:57:35.227460 2677774 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0922 15:57:35.227497 2677774 retry.go:31] will retry after 1.877265793s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0922 15:57:35.246782 2677774 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W0922 15:57:35.408554 2677774 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0922 15:57:35.408605 2677774 retry.go:31] will retry after 3.3042693s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0922 15:57:36.875001 2677774 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
I0922 15:57:37.105250 2677774 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
I0922 15:57:37.340632 2677774 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
I0922 15:57:38.713356 2677774 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0922 15:57:46.822728 2677774 node_ready.go:49] node "old-k8s-version-516480" has status "Ready":"True"
I0922 15:57:46.822754 2677774 node_ready.go:38] duration metric: took 18.803374974s for node "old-k8s-version-516480" to be "Ready" ...
I0922 15:57:46.822777 2677774 pod_ready.go:36] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0922 15:57:47.111134 2677774 pod_ready.go:79] waiting up to 6m0s for pod "coredns-74ff55c5b-mnbq6" in "kube-system" namespace to be "Ready" ...
I0922 15:57:47.563607 2677774 pod_ready.go:93] pod "coredns-74ff55c5b-mnbq6" in "kube-system" namespace has status "Ready":"True"
I0922 15:57:47.563655 2677774 pod_ready.go:82] duration metric: took 452.416462ms for pod "coredns-74ff55c5b-mnbq6" in "kube-system" namespace to be "Ready" ...
I0922 15:57:47.563666 2677774 pod_ready.go:79] waiting up to 6m0s for pod "etcd-old-k8s-version-516480" in "kube-system" namespace to be "Ready" ...
I0922 15:57:48.012094 2677774 pod_ready.go:93] pod "etcd-old-k8s-version-516480" in "kube-system" namespace has status "Ready":"True"
I0922 15:57:48.012175 2677774 pod_ready.go:82] duration metric: took 448.499106ms for pod "etcd-old-k8s-version-516480" in "kube-system" namespace to be "Ready" ...
I0922 15:57:48.012205 2677774 pod_ready.go:79] waiting up to 6m0s for pod "kube-apiserver-old-k8s-version-516480" in "kube-system" namespace to be "Ready" ...
I0922 15:57:48.430682 2677774 pod_ready.go:93] pod "kube-apiserver-old-k8s-version-516480" in "kube-system" namespace has status "Ready":"True"
I0922 15:57:48.430757 2677774 pod_ready.go:82] duration metric: took 418.527789ms for pod "kube-apiserver-old-k8s-version-516480" in "kube-system" namespace to be "Ready" ...
I0922 15:57:48.430784 2677774 pod_ready.go:79] waiting up to 6m0s for pod "kube-controller-manager-old-k8s-version-516480" in "kube-system" namespace to be "Ready" ...
I0922 15:57:48.447464 2677774 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: (11.34216359s)
I0922 15:57:48.447756 2677774 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: (11.572726583s)
I0922 15:57:49.923798 2677774 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: (12.583117114s)
I0922 15:57:49.924112 2677774 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (11.210724838s)
I0922 15:57:49.924144 2677774 addons.go:475] Verifying addon metrics-server=true in "old-k8s-version-516480"
I0922 15:57:49.927233 2677774 out.go:177] * Some dashboard features require the metrics-server addon. To enable all features please run:
minikube -p old-k8s-version-516480 addons enable metrics-server
I0922 15:57:49.930494 2677774 out.go:177] * Enabled addons: storage-provisioner, default-storageclass, metrics-server, dashboard
I0922 15:57:49.933417 2677774 addons.go:510] duration metric: took 22.230663802s for enable addons: enabled=[storage-provisioner default-storageclass metrics-server dashboard]
I0922 15:57:50.443317 2677774 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-516480" in "kube-system" namespace has status "Ready":"False"
I0922 15:57:52.938664 2677774 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-516480" in "kube-system" namespace has status "Ready":"False"
I0922 15:57:54.939244 2677774 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-516480" in "kube-system" namespace has status "Ready":"False"
I0922 15:57:57.437392 2677774 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-516480" in "kube-system" namespace has status "Ready":"False"
I0922 15:57:59.937612 2677774 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-516480" in "kube-system" namespace has status "Ready":"False"
I0922 15:58:01.938155 2677774 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-516480" in "kube-system" namespace has status "Ready":"False"
I0922 15:58:04.437621 2677774 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-516480" in "kube-system" namespace has status "Ready":"False"
I0922 15:58:06.439791 2677774 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-516480" in "kube-system" namespace has status "Ready":"False"
I0922 15:58:08.464829 2677774 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-516480" in "kube-system" namespace has status "Ready":"False"
I0922 15:58:10.937554 2677774 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-516480" in "kube-system" namespace has status "Ready":"False"
I0922 15:58:12.941872 2677774 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-516480" in "kube-system" namespace has status "Ready":"False"
I0922 15:58:14.945440 2677774 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-516480" in "kube-system" namespace has status "Ready":"False"
I0922 15:58:16.951441 2677774 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-516480" in "kube-system" namespace has status "Ready":"False"
I0922 15:58:18.951682 2677774 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-516480" in "kube-system" namespace has status "Ready":"False"
I0922 15:58:21.437654 2677774 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-516480" in "kube-system" namespace has status "Ready":"False"
I0922 15:58:23.937278 2677774 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-516480" in "kube-system" namespace has status "Ready":"False"
I0922 15:58:26.437265 2677774 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-516480" in "kube-system" namespace has status "Ready":"False"
I0922 15:58:28.438681 2677774 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-516480" in "kube-system" namespace has status "Ready":"False"
I0922 15:58:30.445213 2677774 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-516480" in "kube-system" namespace has status "Ready":"False"
I0922 15:58:32.939246 2677774 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-516480" in "kube-system" namespace has status "Ready":"False"
I0922 15:58:34.940465 2677774 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-516480" in "kube-system" namespace has status "Ready":"False"
I0922 15:58:36.948246 2677774 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-516480" in "kube-system" namespace has status "Ready":"False"
I0922 15:58:39.439614 2677774 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-516480" in "kube-system" namespace has status "Ready":"False"
I0922 15:58:41.937763 2677774 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-516480" in "kube-system" namespace has status "Ready":"False"
I0922 15:58:43.938446 2677774 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-516480" in "kube-system" namespace has status "Ready":"False"
I0922 15:58:46.437852 2677774 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-516480" in "kube-system" namespace has status "Ready":"False"
I0922 15:58:48.938531 2677774 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-516480" in "kube-system" namespace has status "Ready":"False"
I0922 15:58:51.439372 2677774 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-516480" in "kube-system" namespace has status "Ready":"False"
I0922 15:58:53.939266 2677774 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-516480" in "kube-system" namespace has status "Ready":"False"
I0922 15:58:55.939438 2677774 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-516480" in "kube-system" namespace has status "Ready":"False"
I0922 15:58:58.437752 2677774 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-516480" in "kube-system" namespace has status "Ready":"False"
I0922 15:59:00.437821 2677774 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-516480" in "kube-system" namespace has status "Ready":"False"
I0922 15:59:02.937129 2677774 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-516480" in "kube-system" namespace has status "Ready":"False"
I0922 15:59:05.437527 2677774 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-516480" in "kube-system" namespace has status "Ready":"False"
I0922 15:59:07.464476 2677774 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-516480" in "kube-system" namespace has status "Ready":"False"
I0922 15:59:09.937037 2677774 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-516480" in "kube-system" namespace has status "Ready":"False"
I0922 15:59:11.937740 2677774 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-516480" in "kube-system" namespace has status "Ready":"False"
I0922 15:59:13.938595 2677774 pod_ready.go:93] pod "kube-controller-manager-old-k8s-version-516480" in "kube-system" namespace has status "Ready":"True"
I0922 15:59:13.938624 2677774 pod_ready.go:82] duration metric: took 1m25.507817208s for pod "kube-controller-manager-old-k8s-version-516480" in "kube-system" namespace to be "Ready" ...
I0922 15:59:13.938637 2677774 pod_ready.go:79] waiting up to 6m0s for pod "kube-proxy-2nbfq" in "kube-system" namespace to be "Ready" ...
I0922 15:59:13.944642 2677774 pod_ready.go:93] pod "kube-proxy-2nbfq" in "kube-system" namespace has status "Ready":"True"
I0922 15:59:13.944670 2677774 pod_ready.go:82] duration metric: took 6.02509ms for pod "kube-proxy-2nbfq" in "kube-system" namespace to be "Ready" ...
I0922 15:59:13.944682 2677774 pod_ready.go:79] waiting up to 6m0s for pod "kube-scheduler-old-k8s-version-516480" in "kube-system" namespace to be "Ready" ...
I0922 15:59:13.953228 2677774 pod_ready.go:93] pod "kube-scheduler-old-k8s-version-516480" in "kube-system" namespace has status "Ready":"True"
I0922 15:59:13.953253 2677774 pod_ready.go:82] duration metric: took 8.561579ms for pod "kube-scheduler-old-k8s-version-516480" in "kube-system" namespace to be "Ready" ...
I0922 15:59:13.953265 2677774 pod_ready.go:79] waiting up to 6m0s for pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace to be "Ready" ...
I0922 15:59:15.960230 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 15:59:18.460104 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 15:59:20.460277 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 15:59:22.460466 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 15:59:24.959031 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 15:59:26.959456 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 15:59:29.459883 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 15:59:31.960050 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 15:59:34.458815 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 15:59:36.469951 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 15:59:38.959364 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 15:59:40.969661 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 15:59:43.459797 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 15:59:45.464875 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 15:59:47.969799 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 15:59:50.459552 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 15:59:52.459968 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 15:59:54.960206 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 15:59:57.459912 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 15:59:59.959895 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:00:01.960493 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:00:04.459880 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:00:06.959766 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:00:08.961038 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:00:11.459004 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:00:13.459719 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:00:15.460118 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:00:18.044106 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:00:20.459666 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:00:22.959590 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:00:25.459784 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:00:27.960077 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:00:30.460363 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:00:32.460586 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:00:34.962292 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:00:37.460524 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:00:39.959069 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:00:41.959430 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:00:43.960702 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:00:46.459194 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:00:48.459230 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:00:50.958879 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:00:52.959688 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:00:54.960448 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:00:57.459853 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:00:59.463200 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:01:01.959806 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:01:04.460123 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:01:06.960245 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:01:08.960375 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:01:11.460053 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:01:13.960296 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:01:16.459359 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:01:18.459400 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:01:20.460251 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:01:22.960533 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:01:25.459324 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:01:27.460356 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:01:29.461256 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:01:31.959905 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:01:33.961431 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:01:36.459795 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:01:38.465145 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:01:40.960741 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:01:43.459968 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:01:45.960315 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:01:47.960474 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:01:49.963942 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:01:52.459754 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:01:54.460162 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:01:56.960349 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:01:58.960405 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:02:00.966739 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:02:03.460400 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:02:05.960304 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:02:08.459894 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:02:10.459962 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:02:12.460661 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:02:14.959583 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:02:17.459919 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:02:19.461309 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:02:21.959489 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:02:23.959564 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:02:26.460187 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:02:28.959361 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:02:30.959720 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:02:32.960411 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:02:35.459619 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:02:37.460403 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:02:39.960119 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:02:42.458996 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:02:44.460102 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:02:46.960232 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:02:49.463287 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:02:51.959943 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:02:53.960343 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:02:56.460979 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:02:58.960773 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:03:01.459602 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:03:03.959787 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:03:06.460100 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:03:08.959599 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:03:11.459075 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:03:13.459883 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:03:13.959947 2677774 pod_ready.go:82] duration metric: took 4m0.006668215s for pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace to be "Ready" ...
E0922 16:03:13.959978 2677774 pod_ready.go:67] WaitExtra: waitPodCondition: context deadline exceeded
I0922 16:03:13.959988 2677774 pod_ready.go:39] duration metric: took 5m27.137197276s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0922 16:03:13.960001 2677774 api_server.go:52] waiting for apiserver process to appear ...
I0922 16:03:13.960035 2677774 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I0922 16:03:13.960099 2677774 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0922 16:03:14.000708 2677774 cri.go:89] found id: "7c1fcc5987e5e298748cead12955f5b511798c88fb01575612ee7b9dd567b55f"
I0922 16:03:14.000731 2677774 cri.go:89] found id: ""
I0922 16:03:14.000739 2677774 logs.go:276] 1 containers: [7c1fcc5987e5e298748cead12955f5b511798c88fb01575612ee7b9dd567b55f]
I0922 16:03:14.000799 2677774 ssh_runner.go:195] Run: which crictl
I0922 16:03:14.004993 2677774 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I0922 16:03:14.005072 2677774 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0922 16:03:14.047308 2677774 cri.go:89] found id: "9c0a027a1be5775f8f8bab62ea785c923794fad9dd784833db780d0c12ec968b"
I0922 16:03:14.047331 2677774 cri.go:89] found id: ""
I0922 16:03:14.047340 2677774 logs.go:276] 1 containers: [9c0a027a1be5775f8f8bab62ea785c923794fad9dd784833db780d0c12ec968b]
I0922 16:03:14.047394 2677774 ssh_runner.go:195] Run: which crictl
I0922 16:03:14.050893 2677774 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I0922 16:03:14.051005 2677774 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0922 16:03:14.094249 2677774 cri.go:89] found id: "74c18335c2ae08ca4773950befa864f23e6a8bee2767e6f7f6eae0ddb3683ab2"
I0922 16:03:14.094280 2677774 cri.go:89] found id: ""
I0922 16:03:14.094289 2677774 logs.go:276] 1 containers: [74c18335c2ae08ca4773950befa864f23e6a8bee2767e6f7f6eae0ddb3683ab2]
I0922 16:03:14.094346 2677774 ssh_runner.go:195] Run: which crictl
I0922 16:03:14.098089 2677774 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I0922 16:03:14.098164 2677774 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0922 16:03:14.137752 2677774 cri.go:89] found id: "30f03ae4101098906a64fcc1aa6671c8702b5191e639bfa1be31ac12b0b1b75f"
I0922 16:03:14.137774 2677774 cri.go:89] found id: ""
I0922 16:03:14.137785 2677774 logs.go:276] 1 containers: [30f03ae4101098906a64fcc1aa6671c8702b5191e639bfa1be31ac12b0b1b75f]
I0922 16:03:14.137841 2677774 ssh_runner.go:195] Run: which crictl
I0922 16:03:14.141568 2677774 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I0922 16:03:14.141644 2677774 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0922 16:03:14.184911 2677774 cri.go:89] found id: "ec9f69248870fe845f3489361c85e0a4b8603653e8b0e35027240720c8219d3d"
I0922 16:03:14.184936 2677774 cri.go:89] found id: ""
I0922 16:03:14.184945 2677774 logs.go:276] 1 containers: [ec9f69248870fe845f3489361c85e0a4b8603653e8b0e35027240720c8219d3d]
I0922 16:03:14.185020 2677774 ssh_runner.go:195] Run: which crictl
I0922 16:03:14.188587 2677774 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I0922 16:03:14.188699 2677774 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0922 16:03:14.226429 2677774 cri.go:89] found id: "132b8fae57bdf9d2a5fc2c5513a926caa1aa8b41366180c05ecd3ba3f700a87f"
I0922 16:03:14.226454 2677774 cri.go:89] found id: ""
I0922 16:03:14.226463 2677774 logs.go:276] 1 containers: [132b8fae57bdf9d2a5fc2c5513a926caa1aa8b41366180c05ecd3ba3f700a87f]
I0922 16:03:14.226520 2677774 ssh_runner.go:195] Run: which crictl
I0922 16:03:14.230171 2677774 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I0922 16:03:14.230249 2677774 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0922 16:03:14.269011 2677774 cri.go:89] found id: "817a0d84fdbc60639f69c50c14178f79e4829f83ef55c42936ea8baf284b5fb2"
I0922 16:03:14.269034 2677774 cri.go:89] found id: ""
I0922 16:03:14.269043 2677774 logs.go:276] 1 containers: [817a0d84fdbc60639f69c50c14178f79e4829f83ef55c42936ea8baf284b5fb2]
I0922 16:03:14.269102 2677774 ssh_runner.go:195] Run: which crictl
I0922 16:03:14.272645 2677774 cri.go:54] listing CRI containers in root : {State:all Name:kubernetes-dashboard Namespaces:[]}
I0922 16:03:14.272718 2677774 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
I0922 16:03:14.309840 2677774 cri.go:89] found id: "8aeff047dc834f6a9760e6b43096ec896a75509fed306bf7078b51c94eca99f3"
I0922 16:03:14.309859 2677774 cri.go:89] found id: ""
I0922 16:03:14.309866 2677774 logs.go:276] 1 containers: [8aeff047dc834f6a9760e6b43096ec896a75509fed306bf7078b51c94eca99f3]
I0922 16:03:14.309921 2677774 ssh_runner.go:195] Run: which crictl
I0922 16:03:14.313387 2677774 cri.go:54] listing CRI containers in root : {State:all Name:storage-provisioner Namespaces:[]}
I0922 16:03:14.313467 2677774 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
I0922 16:03:14.354435 2677774 cri.go:89] found id: "e4a2ecaf05417d51ac0d7f89b7d4f38dda15dd8046c8d1febc60579492dce3dc"
I0922 16:03:14.354459 2677774 cri.go:89] found id: "45e9854e642ac4e51de161c0467764011cb66eb499bb2602b89c2f55ef4ba4f1"
I0922 16:03:14.354464 2677774 cri.go:89] found id: ""
I0922 16:03:14.354508 2677774 logs.go:276] 2 containers: [e4a2ecaf05417d51ac0d7f89b7d4f38dda15dd8046c8d1febc60579492dce3dc 45e9854e642ac4e51de161c0467764011cb66eb499bb2602b89c2f55ef4ba4f1]
I0922 16:03:14.354574 2677774 ssh_runner.go:195] Run: which crictl
I0922 16:03:14.358302 2677774 ssh_runner.go:195] Run: which crictl
I0922 16:03:14.361650 2677774 logs.go:123] Gathering logs for kube-scheduler [30f03ae4101098906a64fcc1aa6671c8702b5191e639bfa1be31ac12b0b1b75f] ...
I0922 16:03:14.361677 2677774 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 30f03ae4101098906a64fcc1aa6671c8702b5191e639bfa1be31ac12b0b1b75f"
I0922 16:03:14.403472 2677774 logs.go:123] Gathering logs for kindnet [817a0d84fdbc60639f69c50c14178f79e4829f83ef55c42936ea8baf284b5fb2] ...
I0922 16:03:14.403506 2677774 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 817a0d84fdbc60639f69c50c14178f79e4829f83ef55c42936ea8baf284b5fb2"
I0922 16:03:14.457385 2677774 logs.go:123] Gathering logs for storage-provisioner [45e9854e642ac4e51de161c0467764011cb66eb499bb2602b89c2f55ef4ba4f1] ...
I0922 16:03:14.457416 2677774 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 45e9854e642ac4e51de161c0467764011cb66eb499bb2602b89c2f55ef4ba4f1"
I0922 16:03:14.502450 2677774 logs.go:123] Gathering logs for CRI-O ...
I0922 16:03:14.502480 2677774 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I0922 16:03:14.588889 2677774 logs.go:123] Gathering logs for kubelet ...
I0922 16:03:14.588925 2677774 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
W0922 16:03:14.643482 2677774 logs.go:138] Found kubelet problem: Sep 22 15:57:46 old-k8s-version-516480 kubelet[731]: E0922 15:57:46.900162 731 reflector.go:138] object-"kube-system"/"kube-proxy-token-qd9mk": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kube-proxy-token-qd9mk" is forbidden: User "system:node:old-k8s-version-516480" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-516480' and this object
W0922 16:03:14.643717 2677774 logs.go:138] Found kubelet problem: Sep 22 15:57:46 old-k8s-version-516480 kubelet[731]: E0922 15:57:46.900230 731 reflector.go:138] object-"kube-system"/"kindnet-token-4qmzm": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kindnet-token-4qmzm" is forbidden: User "system:node:old-k8s-version-516480" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-516480' and this object
W0922 16:03:14.643970 2677774 logs.go:138] Found kubelet problem: Sep 22 15:57:46 old-k8s-version-516480 kubelet[731]: E0922 15:57:46.900281 731 reflector.go:138] object-"kube-system"/"storage-provisioner-token-8jzbw": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "storage-provisioner-token-8jzbw" is forbidden: User "system:node:old-k8s-version-516480" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-516480' and this object
W0922 16:03:14.644184 2677774 logs.go:138] Found kubelet problem: Sep 22 15:57:46 old-k8s-version-516480 kubelet[731]: E0922 15:57:46.900346 731 reflector.go:138] object-"kube-system"/"coredns-token-s54l7": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "coredns-token-s54l7" is forbidden: User "system:node:old-k8s-version-516480" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-516480' and this object
W0922 16:03:14.644397 2677774 logs.go:138] Found kubelet problem: Sep 22 15:57:46 old-k8s-version-516480 kubelet[731]: E0922 15:57:46.900399 731 reflector.go:138] object-"default"/"default-token-bfhkm": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "default-token-bfhkm" is forbidden: User "system:node:old-k8s-version-516480" cannot list resource "secrets" in API group "" in the namespace "default": no relationship found between node 'old-k8s-version-516480' and this object
W0922 16:03:14.644598 2677774 logs.go:138] Found kubelet problem: Sep 22 15:57:46 old-k8s-version-516480 kubelet[731]: E0922 15:57:46.900456 731 reflector.go:138] object-"kube-system"/"coredns": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "coredns" is forbidden: User "system:node:old-k8s-version-516480" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-516480' and this object
W0922 16:03:14.644804 2677774 logs.go:138] Found kubelet problem: Sep 22 15:57:46 old-k8s-version-516480 kubelet[731]: E0922 15:57:46.900499 731 reflector.go:138] object-"kube-system"/"kube-proxy": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-proxy" is forbidden: User "system:node:old-k8s-version-516480" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-516480' and this object
W0922 16:03:14.648261 2677774 logs.go:138] Found kubelet problem: Sep 22 15:57:47 old-k8s-version-516480 kubelet[731]: E0922 15:57:47.566740 731 reflector.go:138] object-"kube-system"/"metrics-server-token-qckbp": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "metrics-server-token-qckbp" is forbidden: User "system:node:old-k8s-version-516480" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-516480' and this object
W0922 16:03:14.655022 2677774 logs.go:138] Found kubelet problem: Sep 22 15:57:50 old-k8s-version-516480 kubelet[731]: E0922 15:57:50.088641 731 pod_workers.go:191] Error syncing pod dcecb091-e954-4a6f-b51e-c8087bb59734 ("metrics-server-9975d5f86-9dfk7_kube-system(dcecb091-e954-4a6f-b51e-c8087bb59734)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = pinging container registry fake.domain: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain: no such host"
W0922 16:03:14.655214 2677774 logs.go:138] Found kubelet problem: Sep 22 15:57:50 old-k8s-version-516480 kubelet[731]: E0922 15:57:50.733867 731 pod_workers.go:191] Error syncing pod dcecb091-e954-4a6f-b51e-c8087bb59734 ("metrics-server-9975d5f86-9dfk7_kube-system(dcecb091-e954-4a6f-b51e-c8087bb59734)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0922 16:03:14.657259 2677774 logs.go:138] Found kubelet problem: Sep 22 15:58:05 old-k8s-version-516480 kubelet[731]: E0922 15:58:05.674769 731 pod_workers.go:191] Error syncing pod dcecb091-e954-4a6f-b51e-c8087bb59734 ("metrics-server-9975d5f86-9dfk7_kube-system(dcecb091-e954-4a6f-b51e-c8087bb59734)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = pinging container registry fake.domain: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain: no such host"
W0922 16:03:14.659277 2677774 logs.go:138] Found kubelet problem: Sep 22 15:58:12 old-k8s-version-516480 kubelet[731]: E0922 15:58:12.804811 731 pod_workers.go:191] Error syncing pod 9b7e692e-cd09-45ee-804a-db312d9515e5 ("dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"
W0922 16:03:14.659734 2677774 logs.go:138] Found kubelet problem: Sep 22 15:58:13 old-k8s-version-516480 kubelet[731]: E0922 15:58:13.807220 731 pod_workers.go:191] Error syncing pod 9b7e692e-cd09-45ee-804a-db312d9515e5 ("dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"
W0922 16:03:14.659920 2677774 logs.go:138] Found kubelet problem: Sep 22 15:58:17 old-k8s-version-516480 kubelet[731]: E0922 15:58:17.664740 731 pod_workers.go:191] Error syncing pod dcecb091-e954-4a6f-b51e-c8087bb59734 ("metrics-server-9975d5f86-9dfk7_kube-system(dcecb091-e954-4a6f-b51e-c8087bb59734)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0922 16:03:14.660381 2677774 logs.go:138] Found kubelet problem: Sep 22 15:58:20 old-k8s-version-516480 kubelet[731]: E0922 15:58:20.190220 731 pod_workers.go:191] Error syncing pod 9b7e692e-cd09-45ee-804a-db312d9515e5 ("dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"
W0922 16:03:14.660965 2677774 logs.go:138] Found kubelet problem: Sep 22 15:58:30 old-k8s-version-516480 kubelet[731]: E0922 15:58:30.841934 731 pod_workers.go:191] Error syncing pod 9b7e692e-cd09-45ee-804a-db312d9515e5 ("dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"
W0922 16:03:14.663034 2677774 logs.go:138] Found kubelet problem: Sep 22 15:58:32 old-k8s-version-516480 kubelet[731]: E0922 15:58:32.675646 731 pod_workers.go:191] Error syncing pod dcecb091-e954-4a6f-b51e-c8087bb59734 ("metrics-server-9975d5f86-9dfk7_kube-system(dcecb091-e954-4a6f-b51e-c8087bb59734)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = pinging container registry fake.domain: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain: no such host"
W0922 16:03:14.663826 2677774 logs.go:138] Found kubelet problem: Sep 22 15:58:40 old-k8s-version-516480 kubelet[731]: E0922 15:58:40.190704 731 pod_workers.go:191] Error syncing pod 9b7e692e-cd09-45ee-804a-db312d9515e5 ("dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"
W0922 16:03:14.664059 2677774 logs.go:138] Found kubelet problem: Sep 22 15:58:47 old-k8s-version-516480 kubelet[731]: E0922 15:58:47.663896 731 pod_workers.go:191] Error syncing pod dcecb091-e954-4a6f-b51e-c8087bb59734 ("metrics-server-9975d5f86-9dfk7_kube-system(dcecb091-e954-4a6f-b51e-c8087bb59734)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0922 16:03:14.664659 2677774 logs.go:138] Found kubelet problem: Sep 22 15:58:51 old-k8s-version-516480 kubelet[731]: E0922 15:58:51.872475 731 pod_workers.go:191] Error syncing pod 9b7e692e-cd09-45ee-804a-db312d9515e5 ("dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"
W0922 16:03:14.664988 2677774 logs.go:138] Found kubelet problem: Sep 22 15:59:00 old-k8s-version-516480 kubelet[731]: E0922 15:59:00.190211 731 pod_workers.go:191] Error syncing pod 9b7e692e-cd09-45ee-804a-db312d9515e5 ("dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"
W0922 16:03:14.665174 2677774 logs.go:138] Found kubelet problem: Sep 22 15:59:02 old-k8s-version-516480 kubelet[731]: E0922 15:59:02.663955 731 pod_workers.go:191] Error syncing pod dcecb091-e954-4a6f-b51e-c8087bb59734 ("metrics-server-9975d5f86-9dfk7_kube-system(dcecb091-e954-4a6f-b51e-c8087bb59734)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0922 16:03:14.665502 2677774 logs.go:138] Found kubelet problem: Sep 22 15:59:13 old-k8s-version-516480 kubelet[731]: E0922 15:59:13.664941 731 pod_workers.go:191] Error syncing pod 9b7e692e-cd09-45ee-804a-db312d9515e5 ("dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"
W0922 16:03:14.667562 2677774 logs.go:138] Found kubelet problem: Sep 22 15:59:16 old-k8s-version-516480 kubelet[731]: E0922 15:59:16.691143 731 pod_workers.go:191] Error syncing pod dcecb091-e954-4a6f-b51e-c8087bb59734 ("metrics-server-9975d5f86-9dfk7_kube-system(dcecb091-e954-4a6f-b51e-c8087bb59734)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = pinging container registry fake.domain: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain: no such host"
W0922 16:03:14.667890 2677774 logs.go:138] Found kubelet problem: Sep 22 15:59:25 old-k8s-version-516480 kubelet[731]: E0922 15:59:25.663919 731 pod_workers.go:191] Error syncing pod 9b7e692e-cd09-45ee-804a-db312d9515e5 ("dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"
W0922 16:03:14.668078 2677774 logs.go:138] Found kubelet problem: Sep 22 15:59:27 old-k8s-version-516480 kubelet[731]: E0922 15:59:27.664531 731 pod_workers.go:191] Error syncing pod dcecb091-e954-4a6f-b51e-c8087bb59734 ("metrics-server-9975d5f86-9dfk7_kube-system(dcecb091-e954-4a6f-b51e-c8087bb59734)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0922 16:03:14.668671 2677774 logs.go:138] Found kubelet problem: Sep 22 15:59:40 old-k8s-version-516480 kubelet[731]: E0922 15:59:40.937803 731 pod_workers.go:191] Error syncing pod 9b7e692e-cd09-45ee-804a-db312d9515e5 ("dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"
W0922 16:03:14.668854 2677774 logs.go:138] Found kubelet problem: Sep 22 15:59:41 old-k8s-version-516480 kubelet[731]: E0922 15:59:41.664383 731 pod_workers.go:191] Error syncing pod dcecb091-e954-4a6f-b51e-c8087bb59734 ("metrics-server-9975d5f86-9dfk7_kube-system(dcecb091-e954-4a6f-b51e-c8087bb59734)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0922 16:03:14.669182 2677774 logs.go:138] Found kubelet problem: Sep 22 15:59:50 old-k8s-version-516480 kubelet[731]: E0922 15:59:50.190598 731 pod_workers.go:191] Error syncing pod 9b7e692e-cd09-45ee-804a-db312d9515e5 ("dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"
W0922 16:03:14.669366 2677774 logs.go:138] Found kubelet problem: Sep 22 15:59:52 old-k8s-version-516480 kubelet[731]: E0922 15:59:52.664210 731 pod_workers.go:191] Error syncing pod dcecb091-e954-4a6f-b51e-c8087bb59734 ("metrics-server-9975d5f86-9dfk7_kube-system(dcecb091-e954-4a6f-b51e-c8087bb59734)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0922 16:03:14.669694 2677774 logs.go:138] Found kubelet problem: Sep 22 16:00:04 old-k8s-version-516480 kubelet[731]: E0922 16:00:04.663628 731 pod_workers.go:191] Error syncing pod 9b7e692e-cd09-45ee-804a-db312d9515e5 ("dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"
W0922 16:03:14.669879 2677774 logs.go:138] Found kubelet problem: Sep 22 16:00:07 old-k8s-version-516480 kubelet[731]: E0922 16:00:07.664303 731 pod_workers.go:191] Error syncing pod dcecb091-e954-4a6f-b51e-c8087bb59734 ("metrics-server-9975d5f86-9dfk7_kube-system(dcecb091-e954-4a6f-b51e-c8087bb59734)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0922 16:03:14.670206 2677774 logs.go:138] Found kubelet problem: Sep 22 16:00:16 old-k8s-version-516480 kubelet[731]: E0922 16:00:16.663530 731 pod_workers.go:191] Error syncing pod 9b7e692e-cd09-45ee-804a-db312d9515e5 ("dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"
W0922 16:03:14.670392 2677774 logs.go:138] Found kubelet problem: Sep 22 16:00:22 old-k8s-version-516480 kubelet[731]: E0922 16:00:22.664177 731 pod_workers.go:191] Error syncing pod dcecb091-e954-4a6f-b51e-c8087bb59734 ("metrics-server-9975d5f86-9dfk7_kube-system(dcecb091-e954-4a6f-b51e-c8087bb59734)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0922 16:03:14.670722 2677774 logs.go:138] Found kubelet problem: Sep 22 16:00:29 old-k8s-version-516480 kubelet[731]: E0922 16:00:29.663555 731 pod_workers.go:191] Error syncing pod 9b7e692e-cd09-45ee-804a-db312d9515e5 ("dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"
W0922 16:03:14.673291 2677774 logs.go:138] Found kubelet problem: Sep 22 16:00:37 old-k8s-version-516480 kubelet[731]: E0922 16:00:37.676231 731 pod_workers.go:191] Error syncing pod dcecb091-e954-4a6f-b51e-c8087bb59734 ("metrics-server-9975d5f86-9dfk7_kube-system(dcecb091-e954-4a6f-b51e-c8087bb59734)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = pinging container registry fake.domain: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain: no such host"
W0922 16:03:14.673622 2677774 logs.go:138] Found kubelet problem: Sep 22 16:00:42 old-k8s-version-516480 kubelet[731]: E0922 16:00:42.663980 731 pod_workers.go:191] Error syncing pod 9b7e692e-cd09-45ee-804a-db312d9515e5 ("dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"
W0922 16:03:14.673805 2677774 logs.go:138] Found kubelet problem: Sep 22 16:00:48 old-k8s-version-516480 kubelet[731]: E0922 16:00:48.665894 731 pod_workers.go:191] Error syncing pod dcecb091-e954-4a6f-b51e-c8087bb59734 ("metrics-server-9975d5f86-9dfk7_kube-system(dcecb091-e954-4a6f-b51e-c8087bb59734)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0922 16:03:14.674135 2677774 logs.go:138] Found kubelet problem: Sep 22 16:00:57 old-k8s-version-516480 kubelet[731]: E0922 16:00:57.663548 731 pod_workers.go:191] Error syncing pod 9b7e692e-cd09-45ee-804a-db312d9515e5 ("dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"
W0922 16:03:14.674319 2677774 logs.go:138] Found kubelet problem: Sep 22 16:01:03 old-k8s-version-516480 kubelet[731]: E0922 16:01:03.664687 731 pod_workers.go:191] Error syncing pod dcecb091-e954-4a6f-b51e-c8087bb59734 ("metrics-server-9975d5f86-9dfk7_kube-system(dcecb091-e954-4a6f-b51e-c8087bb59734)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0922 16:03:14.674917 2677774 logs.go:138] Found kubelet problem: Sep 22 16:01:10 old-k8s-version-516480 kubelet[731]: E0922 16:01:10.069563 731 pod_workers.go:191] Error syncing pod 9b7e692e-cd09-45ee-804a-db312d9515e5 ("dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"
W0922 16:03:14.675253 2677774 logs.go:138] Found kubelet problem: Sep 22 16:01:11 old-k8s-version-516480 kubelet[731]: E0922 16:01:11.073348 731 pod_workers.go:191] Error syncing pod 9b7e692e-cd09-45ee-804a-db312d9515e5 ("dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"
W0922 16:03:14.675438 2677774 logs.go:138] Found kubelet problem: Sep 22 16:01:18 old-k8s-version-516480 kubelet[731]: E0922 16:01:18.664091 731 pod_workers.go:191] Error syncing pod dcecb091-e954-4a6f-b51e-c8087bb59734 ("metrics-server-9975d5f86-9dfk7_kube-system(dcecb091-e954-4a6f-b51e-c8087bb59734)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0922 16:03:14.675766 2677774 logs.go:138] Found kubelet problem: Sep 22 16:01:22 old-k8s-version-516480 kubelet[731]: E0922 16:01:22.663469 731 pod_workers.go:191] Error syncing pod 9b7e692e-cd09-45ee-804a-db312d9515e5 ("dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"
W0922 16:03:14.675953 2677774 logs.go:138] Found kubelet problem: Sep 22 16:01:31 old-k8s-version-516480 kubelet[731]: E0922 16:01:31.664295 731 pod_workers.go:191] Error syncing pod dcecb091-e954-4a6f-b51e-c8087bb59734 ("metrics-server-9975d5f86-9dfk7_kube-system(dcecb091-e954-4a6f-b51e-c8087bb59734)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0922 16:03:14.676280 2677774 logs.go:138] Found kubelet problem: Sep 22 16:01:33 old-k8s-version-516480 kubelet[731]: E0922 16:01:33.663565 731 pod_workers.go:191] Error syncing pod 9b7e692e-cd09-45ee-804a-db312d9515e5 ("dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"
W0922 16:03:14.676610 2677774 logs.go:138] Found kubelet problem: Sep 22 16:01:44 old-k8s-version-516480 kubelet[731]: E0922 16:01:44.663519 731 pod_workers.go:191] Error syncing pod 9b7e692e-cd09-45ee-804a-db312d9515e5 ("dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"
W0922 16:03:14.676796 2677774 logs.go:138] Found kubelet problem: Sep 22 16:01:46 old-k8s-version-516480 kubelet[731]: E0922 16:01:46.664063 731 pod_workers.go:191] Error syncing pod dcecb091-e954-4a6f-b51e-c8087bb59734 ("metrics-server-9975d5f86-9dfk7_kube-system(dcecb091-e954-4a6f-b51e-c8087bb59734)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0922 16:03:14.677123 2677774 logs.go:138] Found kubelet problem: Sep 22 16:01:57 old-k8s-version-516480 kubelet[731]: E0922 16:01:57.663546 731 pod_workers.go:191] Error syncing pod 9b7e692e-cd09-45ee-804a-db312d9515e5 ("dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"
W0922 16:03:14.677309 2677774 logs.go:138] Found kubelet problem: Sep 22 16:01:59 old-k8s-version-516480 kubelet[731]: E0922 16:01:59.664339 731 pod_workers.go:191] Error syncing pod dcecb091-e954-4a6f-b51e-c8087bb59734 ("metrics-server-9975d5f86-9dfk7_kube-system(dcecb091-e954-4a6f-b51e-c8087bb59734)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0922 16:03:14.677640 2677774 logs.go:138] Found kubelet problem: Sep 22 16:02:09 old-k8s-version-516480 kubelet[731]: E0922 16:02:09.663527 731 pod_workers.go:191] Error syncing pod 9b7e692e-cd09-45ee-804a-db312d9515e5 ("dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"
W0922 16:03:14.677825 2677774 logs.go:138] Found kubelet problem: Sep 22 16:02:10 old-k8s-version-516480 kubelet[731]: E0922 16:02:10.664283 731 pod_workers.go:191] Error syncing pod dcecb091-e954-4a6f-b51e-c8087bb59734 ("metrics-server-9975d5f86-9dfk7_kube-system(dcecb091-e954-4a6f-b51e-c8087bb59734)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0922 16:03:14.678152 2677774 logs.go:138] Found kubelet problem: Sep 22 16:02:24 old-k8s-version-516480 kubelet[731]: E0922 16:02:24.664676 731 pod_workers.go:191] Error syncing pod 9b7e692e-cd09-45ee-804a-db312d9515e5 ("dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"
W0922 16:03:14.678335 2677774 logs.go:138] Found kubelet problem: Sep 22 16:02:24 old-k8s-version-516480 kubelet[731]: E0922 16:02:24.664799 731 pod_workers.go:191] Error syncing pod dcecb091-e954-4a6f-b51e-c8087bb59734 ("metrics-server-9975d5f86-9dfk7_kube-system(dcecb091-e954-4a6f-b51e-c8087bb59734)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0922 16:03:14.678768 2677774 logs.go:138] Found kubelet problem: Sep 22 16:02:35 old-k8s-version-516480 kubelet[731]: E0922 16:02:35.667623 731 pod_workers.go:191] Error syncing pod dcecb091-e954-4a6f-b51e-c8087bb59734 ("metrics-server-9975d5f86-9dfk7_kube-system(dcecb091-e954-4a6f-b51e-c8087bb59734)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0922 16:03:14.679106 2677774 logs.go:138] Found kubelet problem: Sep 22 16:02:37 old-k8s-version-516480 kubelet[731]: E0922 16:02:37.663543 731 pod_workers.go:191] Error syncing pod 9b7e692e-cd09-45ee-804a-db312d9515e5 ("dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"
W0922 16:03:14.679292 2677774 logs.go:138] Found kubelet problem: Sep 22 16:02:47 old-k8s-version-516480 kubelet[731]: E0922 16:02:47.664131 731 pod_workers.go:191] Error syncing pod dcecb091-e954-4a6f-b51e-c8087bb59734 ("metrics-server-9975d5f86-9dfk7_kube-system(dcecb091-e954-4a6f-b51e-c8087bb59734)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0922 16:03:14.679619 2677774 logs.go:138] Found kubelet problem: Sep 22 16:02:51 old-k8s-version-516480 kubelet[731]: E0922 16:02:51.663557 731 pod_workers.go:191] Error syncing pod 9b7e692e-cd09-45ee-804a-db312d9515e5 ("dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"
W0922 16:03:14.679803 2677774 logs.go:138] Found kubelet problem: Sep 22 16:02:58 old-k8s-version-516480 kubelet[731]: E0922 16:02:58.664091 731 pod_workers.go:191] Error syncing pod dcecb091-e954-4a6f-b51e-c8087bb59734 ("metrics-server-9975d5f86-9dfk7_kube-system(dcecb091-e954-4a6f-b51e-c8087bb59734)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0922 16:03:14.680142 2677774 logs.go:138] Found kubelet problem: Sep 22 16:03:02 old-k8s-version-516480 kubelet[731]: E0922 16:03:02.663546 731 pod_workers.go:191] Error syncing pod 9b7e692e-cd09-45ee-804a-db312d9515e5 ("dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"
W0922 16:03:14.680328 2677774 logs.go:138] Found kubelet problem: Sep 22 16:03:10 old-k8s-version-516480 kubelet[731]: E0922 16:03:10.664090 731 pod_workers.go:191] Error syncing pod dcecb091-e954-4a6f-b51e-c8087bb59734 ("metrics-server-9975d5f86-9dfk7_kube-system(dcecb091-e954-4a6f-b51e-c8087bb59734)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
I0922 16:03:14.680338 2677774 logs.go:123] Gathering logs for coredns [74c18335c2ae08ca4773950befa864f23e6a8bee2767e6f7f6eae0ddb3683ab2] ...
I0922 16:03:14.680353 2677774 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 74c18335c2ae08ca4773950befa864f23e6a8bee2767e6f7f6eae0ddb3683ab2"
I0922 16:03:14.729315 2677774 logs.go:123] Gathering logs for kube-apiserver [7c1fcc5987e5e298748cead12955f5b511798c88fb01575612ee7b9dd567b55f] ...
I0922 16:03:14.729345 2677774 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 7c1fcc5987e5e298748cead12955f5b511798c88fb01575612ee7b9dd567b55f"
I0922 16:03:14.805783 2677774 logs.go:123] Gathering logs for etcd [9c0a027a1be5775f8f8bab62ea785c923794fad9dd784833db780d0c12ec968b] ...
I0922 16:03:14.805824 2677774 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 9c0a027a1be5775f8f8bab62ea785c923794fad9dd784833db780d0c12ec968b"
I0922 16:03:14.859833 2677774 logs.go:123] Gathering logs for kube-controller-manager [132b8fae57bdf9d2a5fc2c5513a926caa1aa8b41366180c05ecd3ba3f700a87f] ...
I0922 16:03:14.859871 2677774 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 132b8fae57bdf9d2a5fc2c5513a926caa1aa8b41366180c05ecd3ba3f700a87f"
I0922 16:03:14.945468 2677774 logs.go:123] Gathering logs for dmesg ...
I0922 16:03:14.945534 2677774 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0922 16:03:14.966220 2677774 logs.go:123] Gathering logs for describe nodes ...
I0922 16:03:14.966253 2677774 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0922 16:03:15.128735 2677774 logs.go:123] Gathering logs for kubernetes-dashboard [8aeff047dc834f6a9760e6b43096ec896a75509fed306bf7078b51c94eca99f3] ...
I0922 16:03:15.128768 2677774 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 8aeff047dc834f6a9760e6b43096ec896a75509fed306bf7078b51c94eca99f3"
I0922 16:03:15.175666 2677774 logs.go:123] Gathering logs for container status ...
I0922 16:03:15.175695 2677774 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0922 16:03:15.218920 2677774 logs.go:123] Gathering logs for kube-proxy [ec9f69248870fe845f3489361c85e0a4b8603653e8b0e35027240720c8219d3d] ...
I0922 16:03:15.219001 2677774 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 ec9f69248870fe845f3489361c85e0a4b8603653e8b0e35027240720c8219d3d"
I0922 16:03:15.258261 2677774 logs.go:123] Gathering logs for storage-provisioner [e4a2ecaf05417d51ac0d7f89b7d4f38dda15dd8046c8d1febc60579492dce3dc] ...
I0922 16:03:15.258288 2677774 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 e4a2ecaf05417d51ac0d7f89b7d4f38dda15dd8046c8d1febc60579492dce3dc"
I0922 16:03:15.297993 2677774 out.go:358] Setting ErrFile to fd 2...
I0922 16:03:15.298017 2677774 out.go:392] TERM=,COLORTERM=, which probably does not support color
W0922 16:03:15.298068 2677774 out.go:270] X Problems detected in kubelet:
X Problems detected in kubelet:
W0922 16:03:15.298085 2677774 out.go:270] Sep 22 16:02:47 old-k8s-version-516480 kubelet[731]: E0922 16:02:47.664131 731 pod_workers.go:191] Error syncing pod dcecb091-e954-4a6f-b51e-c8087bb59734 ("metrics-server-9975d5f86-9dfk7_kube-system(dcecb091-e954-4a6f-b51e-c8087bb59734)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Sep 22 16:02:47 old-k8s-version-516480 kubelet[731]: E0922 16:02:47.664131 731 pod_workers.go:191] Error syncing pod dcecb091-e954-4a6f-b51e-c8087bb59734 ("metrics-server-9975d5f86-9dfk7_kube-system(dcecb091-e954-4a6f-b51e-c8087bb59734)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0922 16:03:15.298094 2677774 out.go:270] Sep 22 16:02:51 old-k8s-version-516480 kubelet[731]: E0922 16:02:51.663557 731 pod_workers.go:191] Error syncing pod 9b7e692e-cd09-45ee-804a-db312d9515e5 ("dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"
Sep 22 16:02:51 old-k8s-version-516480 kubelet[731]: E0922 16:02:51.663557 731 pod_workers.go:191] Error syncing pod 9b7e692e-cd09-45ee-804a-db312d9515e5 ("dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"
W0922 16:03:15.298106 2677774 out.go:270] Sep 22 16:02:58 old-k8s-version-516480 kubelet[731]: E0922 16:02:58.664091 731 pod_workers.go:191] Error syncing pod dcecb091-e954-4a6f-b51e-c8087bb59734 ("metrics-server-9975d5f86-9dfk7_kube-system(dcecb091-e954-4a6f-b51e-c8087bb59734)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Sep 22 16:02:58 old-k8s-version-516480 kubelet[731]: E0922 16:02:58.664091 731 pod_workers.go:191] Error syncing pod dcecb091-e954-4a6f-b51e-c8087bb59734 ("metrics-server-9975d5f86-9dfk7_kube-system(dcecb091-e954-4a6f-b51e-c8087bb59734)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0922 16:03:15.298116 2677774 out.go:270] Sep 22 16:03:02 old-k8s-version-516480 kubelet[731]: E0922 16:03:02.663546 731 pod_workers.go:191] Error syncing pod 9b7e692e-cd09-45ee-804a-db312d9515e5 ("dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"
Sep 22 16:03:02 old-k8s-version-516480 kubelet[731]: E0922 16:03:02.663546 731 pod_workers.go:191] Error syncing pod 9b7e692e-cd09-45ee-804a-db312d9515e5 ("dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"
W0922 16:03:15.298140 2677774 out.go:270] Sep 22 16:03:10 old-k8s-version-516480 kubelet[731]: E0922 16:03:10.664090 731 pod_workers.go:191] Error syncing pod dcecb091-e954-4a6f-b51e-c8087bb59734 ("metrics-server-9975d5f86-9dfk7_kube-system(dcecb091-e954-4a6f-b51e-c8087bb59734)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Sep 22 16:03:10 old-k8s-version-516480 kubelet[731]: E0922 16:03:10.664090 731 pod_workers.go:191] Error syncing pod dcecb091-e954-4a6f-b51e-c8087bb59734 ("metrics-server-9975d5f86-9dfk7_kube-system(dcecb091-e954-4a6f-b51e-c8087bb59734)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
I0922 16:03:15.298151 2677774 out.go:358] Setting ErrFile to fd 2...
I0922 16:03:15.298158 2677774 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0922 16:03:25.299726 2677774 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0922 16:03:25.312356 2677774 api_server.go:72] duration metric: took 5m57.609951104s to wait for apiserver process to appear ...
I0922 16:03:25.312380 2677774 api_server.go:88] waiting for apiserver healthz status ...
I0922 16:03:25.312417 2677774 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I0922 16:03:25.312472 2677774 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0922 16:03:25.354045 2677774 cri.go:89] found id: "7c1fcc5987e5e298748cead12955f5b511798c88fb01575612ee7b9dd567b55f"
I0922 16:03:25.354105 2677774 cri.go:89] found id: ""
I0922 16:03:25.354112 2677774 logs.go:276] 1 containers: [7c1fcc5987e5e298748cead12955f5b511798c88fb01575612ee7b9dd567b55f]
I0922 16:03:25.354170 2677774 ssh_runner.go:195] Run: which crictl
I0922 16:03:25.358132 2677774 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I0922 16:03:25.358203 2677774 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0922 16:03:25.396145 2677774 cri.go:89] found id: "9c0a027a1be5775f8f8bab62ea785c923794fad9dd784833db780d0c12ec968b"
I0922 16:03:25.396167 2677774 cri.go:89] found id: ""
I0922 16:03:25.396175 2677774 logs.go:276] 1 containers: [9c0a027a1be5775f8f8bab62ea785c923794fad9dd784833db780d0c12ec968b]
I0922 16:03:25.396229 2677774 ssh_runner.go:195] Run: which crictl
I0922 16:03:25.399809 2677774 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I0922 16:03:25.399883 2677774 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0922 16:03:25.439685 2677774 cri.go:89] found id: "74c18335c2ae08ca4773950befa864f23e6a8bee2767e6f7f6eae0ddb3683ab2"
I0922 16:03:25.439709 2677774 cri.go:89] found id: ""
I0922 16:03:25.439717 2677774 logs.go:276] 1 containers: [74c18335c2ae08ca4773950befa864f23e6a8bee2767e6f7f6eae0ddb3683ab2]
I0922 16:03:25.439776 2677774 ssh_runner.go:195] Run: which crictl
I0922 16:03:25.443344 2677774 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I0922 16:03:25.443416 2677774 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0922 16:03:25.480825 2677774 cri.go:89] found id: "30f03ae4101098906a64fcc1aa6671c8702b5191e639bfa1be31ac12b0b1b75f"
I0922 16:03:25.480850 2677774 cri.go:89] found id: ""
I0922 16:03:25.480858 2677774 logs.go:276] 1 containers: [30f03ae4101098906a64fcc1aa6671c8702b5191e639bfa1be31ac12b0b1b75f]
I0922 16:03:25.480939 2677774 ssh_runner.go:195] Run: which crictl
I0922 16:03:25.484490 2677774 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I0922 16:03:25.484565 2677774 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0922 16:03:25.521254 2677774 cri.go:89] found id: "ec9f69248870fe845f3489361c85e0a4b8603653e8b0e35027240720c8219d3d"
I0922 16:03:25.521277 2677774 cri.go:89] found id: ""
I0922 16:03:25.521285 2677774 logs.go:276] 1 containers: [ec9f69248870fe845f3489361c85e0a4b8603653e8b0e35027240720c8219d3d]
I0922 16:03:25.521355 2677774 ssh_runner.go:195] Run: which crictl
I0922 16:03:25.525127 2677774 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I0922 16:03:25.525199 2677774 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0922 16:03:25.564263 2677774 cri.go:89] found id: "132b8fae57bdf9d2a5fc2c5513a926caa1aa8b41366180c05ecd3ba3f700a87f"
I0922 16:03:25.564293 2677774 cri.go:89] found id: ""
I0922 16:03:25.564302 2677774 logs.go:276] 1 containers: [132b8fae57bdf9d2a5fc2c5513a926caa1aa8b41366180c05ecd3ba3f700a87f]
I0922 16:03:25.564360 2677774 ssh_runner.go:195] Run: which crictl
I0922 16:03:25.567949 2677774 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I0922 16:03:25.568025 2677774 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0922 16:03:25.605454 2677774 cri.go:89] found id: "817a0d84fdbc60639f69c50c14178f79e4829f83ef55c42936ea8baf284b5fb2"
I0922 16:03:25.605480 2677774 cri.go:89] found id: ""
I0922 16:03:25.605489 2677774 logs.go:276] 1 containers: [817a0d84fdbc60639f69c50c14178f79e4829f83ef55c42936ea8baf284b5fb2]
I0922 16:03:25.605600 2677774 ssh_runner.go:195] Run: which crictl
I0922 16:03:25.609248 2677774 cri.go:54] listing CRI containers in root : {State:all Name:kubernetes-dashboard Namespaces:[]}
I0922 16:03:25.609369 2677774 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
I0922 16:03:25.650258 2677774 cri.go:89] found id: "8aeff047dc834f6a9760e6b43096ec896a75509fed306bf7078b51c94eca99f3"
I0922 16:03:25.650282 2677774 cri.go:89] found id: ""
I0922 16:03:25.650290 2677774 logs.go:276] 1 containers: [8aeff047dc834f6a9760e6b43096ec896a75509fed306bf7078b51c94eca99f3]
I0922 16:03:25.650346 2677774 ssh_runner.go:195] Run: which crictl
I0922 16:03:25.653805 2677774 cri.go:54] listing CRI containers in root : {State:all Name:storage-provisioner Namespaces:[]}
I0922 16:03:25.653903 2677774 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
I0922 16:03:25.707409 2677774 cri.go:89] found id: "e4a2ecaf05417d51ac0d7f89b7d4f38dda15dd8046c8d1febc60579492dce3dc"
I0922 16:03:25.707477 2677774 cri.go:89] found id: "45e9854e642ac4e51de161c0467764011cb66eb499bb2602b89c2f55ef4ba4f1"
I0922 16:03:25.707498 2677774 cri.go:89] found id: ""
I0922 16:03:25.707524 2677774 logs.go:276] 2 containers: [e4a2ecaf05417d51ac0d7f89b7d4f38dda15dd8046c8d1febc60579492dce3dc 45e9854e642ac4e51de161c0467764011cb66eb499bb2602b89c2f55ef4ba4f1]
I0922 16:03:25.707610 2677774 ssh_runner.go:195] Run: which crictl
I0922 16:03:25.711240 2677774 ssh_runner.go:195] Run: which crictl
I0922 16:03:25.714461 2677774 logs.go:123] Gathering logs for describe nodes ...
I0922 16:03:25.714488 2677774 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0922 16:03:25.865134 2677774 logs.go:123] Gathering logs for etcd [9c0a027a1be5775f8f8bab62ea785c923794fad9dd784833db780d0c12ec968b] ...
I0922 16:03:25.865165 2677774 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 9c0a027a1be5775f8f8bab62ea785c923794fad9dd784833db780d0c12ec968b"
I0922 16:03:25.920843 2677774 logs.go:123] Gathering logs for kube-scheduler [30f03ae4101098906a64fcc1aa6671c8702b5191e639bfa1be31ac12b0b1b75f] ...
I0922 16:03:25.920875 2677774 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 30f03ae4101098906a64fcc1aa6671c8702b5191e639bfa1be31ac12b0b1b75f"
I0922 16:03:25.973587 2677774 logs.go:123] Gathering logs for kube-proxy [ec9f69248870fe845f3489361c85e0a4b8603653e8b0e35027240720c8219d3d] ...
I0922 16:03:25.973620 2677774 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 ec9f69248870fe845f3489361c85e0a4b8603653e8b0e35027240720c8219d3d"
I0922 16:03:26.013979 2677774 logs.go:123] Gathering logs for kubelet ...
I0922 16:03:26.014058 2677774 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
W0922 16:03:26.064198 2677774 logs.go:138] Found kubelet problem: Sep 22 15:57:46 old-k8s-version-516480 kubelet[731]: E0922 15:57:46.900162 731 reflector.go:138] object-"kube-system"/"kube-proxy-token-qd9mk": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kube-proxy-token-qd9mk" is forbidden: User "system:node:old-k8s-version-516480" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-516480' and this object
W0922 16:03:26.064468 2677774 logs.go:138] Found kubelet problem: Sep 22 15:57:46 old-k8s-version-516480 kubelet[731]: E0922 15:57:46.900230 731 reflector.go:138] object-"kube-system"/"kindnet-token-4qmzm": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kindnet-token-4qmzm" is forbidden: User "system:node:old-k8s-version-516480" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-516480' and this object
W0922 16:03:26.064725 2677774 logs.go:138] Found kubelet problem: Sep 22 15:57:46 old-k8s-version-516480 kubelet[731]: E0922 15:57:46.900281 731 reflector.go:138] object-"kube-system"/"storage-provisioner-token-8jzbw": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "storage-provisioner-token-8jzbw" is forbidden: User "system:node:old-k8s-version-516480" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-516480' and this object
W0922 16:03:26.064959 2677774 logs.go:138] Found kubelet problem: Sep 22 15:57:46 old-k8s-version-516480 kubelet[731]: E0922 15:57:46.900346 731 reflector.go:138] object-"kube-system"/"coredns-token-s54l7": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "coredns-token-s54l7" is forbidden: User "system:node:old-k8s-version-516480" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-516480' and this object
W0922 16:03:26.065191 2677774 logs.go:138] Found kubelet problem: Sep 22 15:57:46 old-k8s-version-516480 kubelet[731]: E0922 15:57:46.900399 731 reflector.go:138] object-"default"/"default-token-bfhkm": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "default-token-bfhkm" is forbidden: User "system:node:old-k8s-version-516480" cannot list resource "secrets" in API group "" in the namespace "default": no relationship found between node 'old-k8s-version-516480' and this object
W0922 16:03:26.065416 2677774 logs.go:138] Found kubelet problem: Sep 22 15:57:46 old-k8s-version-516480 kubelet[731]: E0922 15:57:46.900456 731 reflector.go:138] object-"kube-system"/"coredns": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "coredns" is forbidden: User "system:node:old-k8s-version-516480" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-516480' and this object
W0922 16:03:26.065643 2677774 logs.go:138] Found kubelet problem: Sep 22 15:57:46 old-k8s-version-516480 kubelet[731]: E0922 15:57:46.900499 731 reflector.go:138] object-"kube-system"/"kube-proxy": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-proxy" is forbidden: User "system:node:old-k8s-version-516480" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-516480' and this object
W0922 16:03:26.069190 2677774 logs.go:138] Found kubelet problem: Sep 22 15:57:47 old-k8s-version-516480 kubelet[731]: E0922 15:57:47.566740 731 reflector.go:138] object-"kube-system"/"metrics-server-token-qckbp": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "metrics-server-token-qckbp" is forbidden: User "system:node:old-k8s-version-516480" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-516480' and this object
W0922 16:03:26.077104 2677774 logs.go:138] Found kubelet problem: Sep 22 15:57:50 old-k8s-version-516480 kubelet[731]: E0922 15:57:50.088641 731 pod_workers.go:191] Error syncing pod dcecb091-e954-4a6f-b51e-c8087bb59734 ("metrics-server-9975d5f86-9dfk7_kube-system(dcecb091-e954-4a6f-b51e-c8087bb59734)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = pinging container registry fake.domain: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain: no such host"
W0922 16:03:26.077310 2677774 logs.go:138] Found kubelet problem: Sep 22 15:57:50 old-k8s-version-516480 kubelet[731]: E0922 15:57:50.733867 731 pod_workers.go:191] Error syncing pod dcecb091-e954-4a6f-b51e-c8087bb59734 ("metrics-server-9975d5f86-9dfk7_kube-system(dcecb091-e954-4a6f-b51e-c8087bb59734)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0922 16:03:26.079498 2677774 logs.go:138] Found kubelet problem: Sep 22 15:58:05 old-k8s-version-516480 kubelet[731]: E0922 15:58:05.674769 731 pod_workers.go:191] Error syncing pod dcecb091-e954-4a6f-b51e-c8087bb59734 ("metrics-server-9975d5f86-9dfk7_kube-system(dcecb091-e954-4a6f-b51e-c8087bb59734)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = pinging container registry fake.domain: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain: no such host"
W0922 16:03:26.081539 2677774 logs.go:138] Found kubelet problem: Sep 22 15:58:12 old-k8s-version-516480 kubelet[731]: E0922 15:58:12.804811 731 pod_workers.go:191] Error syncing pod 9b7e692e-cd09-45ee-804a-db312d9515e5 ("dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"
W0922 16:03:26.082000 2677774 logs.go:138] Found kubelet problem: Sep 22 15:58:13 old-k8s-version-516480 kubelet[731]: E0922 15:58:13.807220 731 pod_workers.go:191] Error syncing pod 9b7e692e-cd09-45ee-804a-db312d9515e5 ("dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"
W0922 16:03:26.082188 2677774 logs.go:138] Found kubelet problem: Sep 22 15:58:17 old-k8s-version-516480 kubelet[731]: E0922 15:58:17.664740 731 pod_workers.go:191] Error syncing pod dcecb091-e954-4a6f-b51e-c8087bb59734 ("metrics-server-9975d5f86-9dfk7_kube-system(dcecb091-e954-4a6f-b51e-c8087bb59734)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0922 16:03:26.082649 2677774 logs.go:138] Found kubelet problem: Sep 22 15:58:20 old-k8s-version-516480 kubelet[731]: E0922 15:58:20.190220 731 pod_workers.go:191] Error syncing pod 9b7e692e-cd09-45ee-804a-db312d9515e5 ("dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"
W0922 16:03:26.083266 2677774 logs.go:138] Found kubelet problem: Sep 22 15:58:30 old-k8s-version-516480 kubelet[731]: E0922 15:58:30.841934 731 pod_workers.go:191] Error syncing pod 9b7e692e-cd09-45ee-804a-db312d9515e5 ("dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"
W0922 16:03:26.085397 2677774 logs.go:138] Found kubelet problem: Sep 22 15:58:32 old-k8s-version-516480 kubelet[731]: E0922 15:58:32.675646 731 pod_workers.go:191] Error syncing pod dcecb091-e954-4a6f-b51e-c8087bb59734 ("metrics-server-9975d5f86-9dfk7_kube-system(dcecb091-e954-4a6f-b51e-c8087bb59734)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = pinging container registry fake.domain: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain: no such host"
W0922 16:03:26.085737 2677774 logs.go:138] Found kubelet problem: Sep 22 15:58:40 old-k8s-version-516480 kubelet[731]: E0922 15:58:40.190704 731 pod_workers.go:191] Error syncing pod 9b7e692e-cd09-45ee-804a-db312d9515e5 ("dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"
W0922 16:03:26.085924 2677774 logs.go:138] Found kubelet problem: Sep 22 15:58:47 old-k8s-version-516480 kubelet[731]: E0922 15:58:47.663896 731 pod_workers.go:191] Error syncing pod dcecb091-e954-4a6f-b51e-c8087bb59734 ("metrics-server-9975d5f86-9dfk7_kube-system(dcecb091-e954-4a6f-b51e-c8087bb59734)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0922 16:03:26.086518 2677774 logs.go:138] Found kubelet problem: Sep 22 15:58:51 old-k8s-version-516480 kubelet[731]: E0922 15:58:51.872475 731 pod_workers.go:191] Error syncing pod 9b7e692e-cd09-45ee-804a-db312d9515e5 ("dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"
W0922 16:03:26.086844 2677774 logs.go:138] Found kubelet problem: Sep 22 15:59:00 old-k8s-version-516480 kubelet[731]: E0922 15:59:00.190211 731 pod_workers.go:191] Error syncing pod 9b7e692e-cd09-45ee-804a-db312d9515e5 ("dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"
W0922 16:03:26.087040 2677774 logs.go:138] Found kubelet problem: Sep 22 15:59:02 old-k8s-version-516480 kubelet[731]: E0922 15:59:02.663955 731 pod_workers.go:191] Error syncing pod dcecb091-e954-4a6f-b51e-c8087bb59734 ("metrics-server-9975d5f86-9dfk7_kube-system(dcecb091-e954-4a6f-b51e-c8087bb59734)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0922 16:03:26.087373 2677774 logs.go:138] Found kubelet problem: Sep 22 15:59:13 old-k8s-version-516480 kubelet[731]: E0922 15:59:13.664941 731 pod_workers.go:191] Error syncing pod 9b7e692e-cd09-45ee-804a-db312d9515e5 ("dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"
W0922 16:03:26.089422 2677774 logs.go:138] Found kubelet problem: Sep 22 15:59:16 old-k8s-version-516480 kubelet[731]: E0922 15:59:16.691143 731 pod_workers.go:191] Error syncing pod dcecb091-e954-4a6f-b51e-c8087bb59734 ("metrics-server-9975d5f86-9dfk7_kube-system(dcecb091-e954-4a6f-b51e-c8087bb59734)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = pinging container registry fake.domain: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain: no such host"
W0922 16:03:26.089762 2677774 logs.go:138] Found kubelet problem: Sep 22 15:59:25 old-k8s-version-516480 kubelet[731]: E0922 15:59:25.663919 731 pod_workers.go:191] Error syncing pod 9b7e692e-cd09-45ee-804a-db312d9515e5 ("dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"
W0922 16:03:26.089948 2677774 logs.go:138] Found kubelet problem: Sep 22 15:59:27 old-k8s-version-516480 kubelet[731]: E0922 15:59:27.664531 731 pod_workers.go:191] Error syncing pod dcecb091-e954-4a6f-b51e-c8087bb59734 ("metrics-server-9975d5f86-9dfk7_kube-system(dcecb091-e954-4a6f-b51e-c8087bb59734)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0922 16:03:26.090540 2677774 logs.go:138] Found kubelet problem: Sep 22 15:59:40 old-k8s-version-516480 kubelet[731]: E0922 15:59:40.937803 731 pod_workers.go:191] Error syncing pod 9b7e692e-cd09-45ee-804a-db312d9515e5 ("dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"
W0922 16:03:26.090726 2677774 logs.go:138] Found kubelet problem: Sep 22 15:59:41 old-k8s-version-516480 kubelet[731]: E0922 15:59:41.664383 731 pod_workers.go:191] Error syncing pod dcecb091-e954-4a6f-b51e-c8087bb59734 ("metrics-server-9975d5f86-9dfk7_kube-system(dcecb091-e954-4a6f-b51e-c8087bb59734)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0922 16:03:26.091310 2677774 logs.go:138] Found kubelet problem: Sep 22 15:59:50 old-k8s-version-516480 kubelet[731]: E0922 15:59:50.190598 731 pod_workers.go:191] Error syncing pod 9b7e692e-cd09-45ee-804a-db312d9515e5 ("dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"
W0922 16:03:26.091520 2677774 logs.go:138] Found kubelet problem: Sep 22 15:59:52 old-k8s-version-516480 kubelet[731]: E0922 15:59:52.664210 731 pod_workers.go:191] Error syncing pod dcecb091-e954-4a6f-b51e-c8087bb59734 ("metrics-server-9975d5f86-9dfk7_kube-system(dcecb091-e954-4a6f-b51e-c8087bb59734)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0922 16:03:26.091857 2677774 logs.go:138] Found kubelet problem: Sep 22 16:00:04 old-k8s-version-516480 kubelet[731]: E0922 16:00:04.663628 731 pod_workers.go:191] Error syncing pod 9b7e692e-cd09-45ee-804a-db312d9515e5 ("dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"
W0922 16:03:26.092049 2677774 logs.go:138] Found kubelet problem: Sep 22 16:00:07 old-k8s-version-516480 kubelet[731]: E0922 16:00:07.664303 731 pod_workers.go:191] Error syncing pod dcecb091-e954-4a6f-b51e-c8087bb59734 ("metrics-server-9975d5f86-9dfk7_kube-system(dcecb091-e954-4a6f-b51e-c8087bb59734)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0922 16:03:26.092451 2677774 logs.go:138] Found kubelet problem: Sep 22 16:00:16 old-k8s-version-516480 kubelet[731]: E0922 16:00:16.663530 731 pod_workers.go:191] Error syncing pod 9b7e692e-cd09-45ee-804a-db312d9515e5 ("dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"
W0922 16:03:26.092665 2677774 logs.go:138] Found kubelet problem: Sep 22 16:00:22 old-k8s-version-516480 kubelet[731]: E0922 16:00:22.664177 731 pod_workers.go:191] Error syncing pod dcecb091-e954-4a6f-b51e-c8087bb59734 ("metrics-server-9975d5f86-9dfk7_kube-system(dcecb091-e954-4a6f-b51e-c8087bb59734)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0922 16:03:26.093044 2677774 logs.go:138] Found kubelet problem: Sep 22 16:00:29 old-k8s-version-516480 kubelet[731]: E0922 16:00:29.663555 731 pod_workers.go:191] Error syncing pod 9b7e692e-cd09-45ee-804a-db312d9515e5 ("dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"
W0922 16:03:26.097746 2677774 logs.go:138] Found kubelet problem: Sep 22 16:00:37 old-k8s-version-516480 kubelet[731]: E0922 16:00:37.676231 731 pod_workers.go:191] Error syncing pod dcecb091-e954-4a6f-b51e-c8087bb59734 ("metrics-server-9975d5f86-9dfk7_kube-system(dcecb091-e954-4a6f-b51e-c8087bb59734)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = pinging container registry fake.domain: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain: no such host"
W0922 16:03:26.098093 2677774 logs.go:138] Found kubelet problem: Sep 22 16:00:42 old-k8s-version-516480 kubelet[731]: E0922 16:00:42.663980 731 pod_workers.go:191] Error syncing pod 9b7e692e-cd09-45ee-804a-db312d9515e5 ("dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"
W0922 16:03:26.098280 2677774 logs.go:138] Found kubelet problem: Sep 22 16:00:48 old-k8s-version-516480 kubelet[731]: E0922 16:00:48.665894 731 pod_workers.go:191] Error syncing pod dcecb091-e954-4a6f-b51e-c8087bb59734 ("metrics-server-9975d5f86-9dfk7_kube-system(dcecb091-e954-4a6f-b51e-c8087bb59734)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0922 16:03:26.098656 2677774 logs.go:138] Found kubelet problem: Sep 22 16:00:57 old-k8s-version-516480 kubelet[731]: E0922 16:00:57.663548 731 pod_workers.go:191] Error syncing pod 9b7e692e-cd09-45ee-804a-db312d9515e5 ("dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"
W0922 16:03:26.098851 2677774 logs.go:138] Found kubelet problem: Sep 22 16:01:03 old-k8s-version-516480 kubelet[731]: E0922 16:01:03.664687 731 pod_workers.go:191] Error syncing pod dcecb091-e954-4a6f-b51e-c8087bb59734 ("metrics-server-9975d5f86-9dfk7_kube-system(dcecb091-e954-4a6f-b51e-c8087bb59734)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0922 16:03:26.100437 2677774 logs.go:138] Found kubelet problem: Sep 22 16:01:10 old-k8s-version-516480 kubelet[731]: E0922 16:01:10.069563 731 pod_workers.go:191] Error syncing pod 9b7e692e-cd09-45ee-804a-db312d9515e5 ("dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"
W0922 16:03:26.100776 2677774 logs.go:138] Found kubelet problem: Sep 22 16:01:11 old-k8s-version-516480 kubelet[731]: E0922 16:01:11.073348 731 pod_workers.go:191] Error syncing pod 9b7e692e-cd09-45ee-804a-db312d9515e5 ("dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"
W0922 16:03:26.100964 2677774 logs.go:138] Found kubelet problem: Sep 22 16:01:18 old-k8s-version-516480 kubelet[731]: E0922 16:01:18.664091 731 pod_workers.go:191] Error syncing pod dcecb091-e954-4a6f-b51e-c8087bb59734 ("metrics-server-9975d5f86-9dfk7_kube-system(dcecb091-e954-4a6f-b51e-c8087bb59734)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0922 16:03:26.101292 2677774 logs.go:138] Found kubelet problem: Sep 22 16:01:22 old-k8s-version-516480 kubelet[731]: E0922 16:01:22.663469 731 pod_workers.go:191] Error syncing pod 9b7e692e-cd09-45ee-804a-db312d9515e5 ("dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"
W0922 16:03:26.101477 2677774 logs.go:138] Found kubelet problem: Sep 22 16:01:31 old-k8s-version-516480 kubelet[731]: E0922 16:01:31.664295 731 pod_workers.go:191] Error syncing pod dcecb091-e954-4a6f-b51e-c8087bb59734 ("metrics-server-9975d5f86-9dfk7_kube-system(dcecb091-e954-4a6f-b51e-c8087bb59734)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0922 16:03:26.101816 2677774 logs.go:138] Found kubelet problem: Sep 22 16:01:33 old-k8s-version-516480 kubelet[731]: E0922 16:01:33.663565 731 pod_workers.go:191] Error syncing pod 9b7e692e-cd09-45ee-804a-db312d9515e5 ("dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"
W0922 16:03:26.102147 2677774 logs.go:138] Found kubelet problem: Sep 22 16:01:44 old-k8s-version-516480 kubelet[731]: E0922 16:01:44.663519 731 pod_workers.go:191] Error syncing pod 9b7e692e-cd09-45ee-804a-db312d9515e5 ("dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"
W0922 16:03:26.102330 2677774 logs.go:138] Found kubelet problem: Sep 22 16:01:46 old-k8s-version-516480 kubelet[731]: E0922 16:01:46.664063 731 pod_workers.go:191] Error syncing pod dcecb091-e954-4a6f-b51e-c8087bb59734 ("metrics-server-9975d5f86-9dfk7_kube-system(dcecb091-e954-4a6f-b51e-c8087bb59734)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0922 16:03:26.102660 2677774 logs.go:138] Found kubelet problem: Sep 22 16:01:57 old-k8s-version-516480 kubelet[731]: E0922 16:01:57.663546 731 pod_workers.go:191] Error syncing pod 9b7e692e-cd09-45ee-804a-db312d9515e5 ("dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"
W0922 16:03:26.102849 2677774 logs.go:138] Found kubelet problem: Sep 22 16:01:59 old-k8s-version-516480 kubelet[731]: E0922 16:01:59.664339 731 pod_workers.go:191] Error syncing pod dcecb091-e954-4a6f-b51e-c8087bb59734 ("metrics-server-9975d5f86-9dfk7_kube-system(dcecb091-e954-4a6f-b51e-c8087bb59734)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0922 16:03:26.103194 2677774 logs.go:138] Found kubelet problem: Sep 22 16:02:09 old-k8s-version-516480 kubelet[731]: E0922 16:02:09.663527 731 pod_workers.go:191] Error syncing pod 9b7e692e-cd09-45ee-804a-db312d9515e5 ("dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"
W0922 16:03:26.103380 2677774 logs.go:138] Found kubelet problem: Sep 22 16:02:10 old-k8s-version-516480 kubelet[731]: E0922 16:02:10.664283 731 pod_workers.go:191] Error syncing pod dcecb091-e954-4a6f-b51e-c8087bb59734 ("metrics-server-9975d5f86-9dfk7_kube-system(dcecb091-e954-4a6f-b51e-c8087bb59734)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0922 16:03:26.103710 2677774 logs.go:138] Found kubelet problem: Sep 22 16:02:24 old-k8s-version-516480 kubelet[731]: E0922 16:02:24.664676 731 pod_workers.go:191] Error syncing pod 9b7e692e-cd09-45ee-804a-db312d9515e5 ("dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"
W0922 16:03:26.103895 2677774 logs.go:138] Found kubelet problem: Sep 22 16:02:24 old-k8s-version-516480 kubelet[731]: E0922 16:02:24.664799 731 pod_workers.go:191] Error syncing pod dcecb091-e954-4a6f-b51e-c8087bb59734 ("metrics-server-9975d5f86-9dfk7_kube-system(dcecb091-e954-4a6f-b51e-c8087bb59734)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0922 16:03:26.104342 2677774 logs.go:138] Found kubelet problem: Sep 22 16:02:35 old-k8s-version-516480 kubelet[731]: E0922 16:02:35.667623 731 pod_workers.go:191] Error syncing pod dcecb091-e954-4a6f-b51e-c8087bb59734 ("metrics-server-9975d5f86-9dfk7_kube-system(dcecb091-e954-4a6f-b51e-c8087bb59734)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0922 16:03:26.104672 2677774 logs.go:138] Found kubelet problem: Sep 22 16:02:37 old-k8s-version-516480 kubelet[731]: E0922 16:02:37.663543 731 pod_workers.go:191] Error syncing pod 9b7e692e-cd09-45ee-804a-db312d9515e5 ("dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"
W0922 16:03:26.104855 2677774 logs.go:138] Found kubelet problem: Sep 22 16:02:47 old-k8s-version-516480 kubelet[731]: E0922 16:02:47.664131 731 pod_workers.go:191] Error syncing pod dcecb091-e954-4a6f-b51e-c8087bb59734 ("metrics-server-9975d5f86-9dfk7_kube-system(dcecb091-e954-4a6f-b51e-c8087bb59734)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0922 16:03:26.105185 2677774 logs.go:138] Found kubelet problem: Sep 22 16:02:51 old-k8s-version-516480 kubelet[731]: E0922 16:02:51.663557 731 pod_workers.go:191] Error syncing pod 9b7e692e-cd09-45ee-804a-db312d9515e5 ("dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"
W0922 16:03:26.105371 2677774 logs.go:138] Found kubelet problem: Sep 22 16:02:58 old-k8s-version-516480 kubelet[731]: E0922 16:02:58.664091 731 pod_workers.go:191] Error syncing pod dcecb091-e954-4a6f-b51e-c8087bb59734 ("metrics-server-9975d5f86-9dfk7_kube-system(dcecb091-e954-4a6f-b51e-c8087bb59734)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0922 16:03:26.105698 2677774 logs.go:138] Found kubelet problem: Sep 22 16:03:02 old-k8s-version-516480 kubelet[731]: E0922 16:03:02.663546 731 pod_workers.go:191] Error syncing pod 9b7e692e-cd09-45ee-804a-db312d9515e5 ("dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"
W0922 16:03:26.105881 2677774 logs.go:138] Found kubelet problem: Sep 22 16:03:10 old-k8s-version-516480 kubelet[731]: E0922 16:03:10.664090 731 pod_workers.go:191] Error syncing pod dcecb091-e954-4a6f-b51e-c8087bb59734 ("metrics-server-9975d5f86-9dfk7_kube-system(dcecb091-e954-4a6f-b51e-c8087bb59734)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0922 16:03:26.106209 2677774 logs.go:138] Found kubelet problem: Sep 22 16:03:14 old-k8s-version-516480 kubelet[731]: E0922 16:03:14.663628 731 pod_workers.go:191] Error syncing pod 9b7e692e-cd09-45ee-804a-db312d9515e5 ("dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"
W0922 16:03:26.106540 2677774 logs.go:138] Found kubelet problem: Sep 22 16:03:25 old-k8s-version-516480 kubelet[731]: E0922 16:03:25.665238 731 pod_workers.go:191] Error syncing pod 9b7e692e-cd09-45ee-804a-db312d9515e5 ("dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"
W0922 16:03:26.108605 2677774 logs.go:138] Found kubelet problem: Sep 22 16:03:25 old-k8s-version-516480 kubelet[731]: E0922 16:03:25.691950 731 pod_workers.go:191] Error syncing pod dcecb091-e954-4a6f-b51e-c8087bb59734 ("metrics-server-9975d5f86-9dfk7_kube-system(dcecb091-e954-4a6f-b51e-c8087bb59734)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = pinging container registry fake.domain: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain: no such host"
I0922 16:03:26.108617 2677774 logs.go:123] Gathering logs for coredns [74c18335c2ae08ca4773950befa864f23e6a8bee2767e6f7f6eae0ddb3683ab2] ...
I0922 16:03:26.108631 2677774 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 74c18335c2ae08ca4773950befa864f23e6a8bee2767e6f7f6eae0ddb3683ab2"
I0922 16:03:26.151673 2677774 logs.go:123] Gathering logs for kubernetes-dashboard [8aeff047dc834f6a9760e6b43096ec896a75509fed306bf7078b51c94eca99f3] ...
I0922 16:03:26.151704 2677774 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 8aeff047dc834f6a9760e6b43096ec896a75509fed306bf7078b51c94eca99f3"
I0922 16:03:26.192315 2677774 logs.go:123] Gathering logs for kindnet [817a0d84fdbc60639f69c50c14178f79e4829f83ef55c42936ea8baf284b5fb2] ...
I0922 16:03:26.192348 2677774 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 817a0d84fdbc60639f69c50c14178f79e4829f83ef55c42936ea8baf284b5fb2"
I0922 16:03:26.270007 2677774 logs.go:123] Gathering logs for storage-provisioner [45e9854e642ac4e51de161c0467764011cb66eb499bb2602b89c2f55ef4ba4f1] ...
I0922 16:03:26.270045 2677774 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 45e9854e642ac4e51de161c0467764011cb66eb499bb2602b89c2f55ef4ba4f1"
I0922 16:03:26.315316 2677774 logs.go:123] Gathering logs for container status ...
I0922 16:03:26.315345 2677774 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0922 16:03:26.366973 2677774 logs.go:123] Gathering logs for dmesg ...
I0922 16:03:26.367009 2677774 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0922 16:03:26.383923 2677774 logs.go:123] Gathering logs for kube-apiserver [7c1fcc5987e5e298748cead12955f5b511798c88fb01575612ee7b9dd567b55f] ...
I0922 16:03:26.384005 2677774 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 7c1fcc5987e5e298748cead12955f5b511798c88fb01575612ee7b9dd567b55f"
I0922 16:03:26.454554 2677774 logs.go:123] Gathering logs for kube-controller-manager [132b8fae57bdf9d2a5fc2c5513a926caa1aa8b41366180c05ecd3ba3f700a87f] ...
I0922 16:03:26.454588 2677774 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 132b8fae57bdf9d2a5fc2c5513a926caa1aa8b41366180c05ecd3ba3f700a87f"
I0922 16:03:26.552246 2677774 logs.go:123] Gathering logs for storage-provisioner [e4a2ecaf05417d51ac0d7f89b7d4f38dda15dd8046c8d1febc60579492dce3dc] ...
I0922 16:03:26.552286 2677774 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 e4a2ecaf05417d51ac0d7f89b7d4f38dda15dd8046c8d1febc60579492dce3dc"
I0922 16:03:26.597494 2677774 logs.go:123] Gathering logs for CRI-O ...
I0922 16:03:26.597523 2677774 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I0922 16:03:26.687849 2677774 out.go:358] Setting ErrFile to fd 2...
I0922 16:03:26.687883 2677774 out.go:392] TERM=,COLORTERM=, which probably does not support color
W0922 16:03:26.687953 2677774 out.go:270] X Problems detected in kubelet:
X Problems detected in kubelet:
W0922 16:03:26.687966 2677774 out.go:270] Sep 22 16:03:02 old-k8s-version-516480 kubelet[731]: E0922 16:03:02.663546 731 pod_workers.go:191] Error syncing pod 9b7e692e-cd09-45ee-804a-db312d9515e5 ("dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"
Sep 22 16:03:02 old-k8s-version-516480 kubelet[731]: E0922 16:03:02.663546 731 pod_workers.go:191] Error syncing pod 9b7e692e-cd09-45ee-804a-db312d9515e5 ("dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"
W0922 16:03:26.687976 2677774 out.go:270] Sep 22 16:03:10 old-k8s-version-516480 kubelet[731]: E0922 16:03:10.664090 731 pod_workers.go:191] Error syncing pod dcecb091-e954-4a6f-b51e-c8087bb59734 ("metrics-server-9975d5f86-9dfk7_kube-system(dcecb091-e954-4a6f-b51e-c8087bb59734)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Sep 22 16:03:10 old-k8s-version-516480 kubelet[731]: E0922 16:03:10.664090 731 pod_workers.go:191] Error syncing pod dcecb091-e954-4a6f-b51e-c8087bb59734 ("metrics-server-9975d5f86-9dfk7_kube-system(dcecb091-e954-4a6f-b51e-c8087bb59734)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0922 16:03:26.687984 2677774 out.go:270] Sep 22 16:03:14 old-k8s-version-516480 kubelet[731]: E0922 16:03:14.663628 731 pod_workers.go:191] Error syncing pod 9b7e692e-cd09-45ee-804a-db312d9515e5 ("dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"
Sep 22 16:03:14 old-k8s-version-516480 kubelet[731]: E0922 16:03:14.663628 731 pod_workers.go:191] Error syncing pod 9b7e692e-cd09-45ee-804a-db312d9515e5 ("dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"
W0922 16:03:26.687990 2677774 out.go:270] Sep 22 16:03:25 old-k8s-version-516480 kubelet[731]: E0922 16:03:25.665238 731 pod_workers.go:191] Error syncing pod 9b7e692e-cd09-45ee-804a-db312d9515e5 ("dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"
Sep 22 16:03:25 old-k8s-version-516480 kubelet[731]: E0922 16:03:25.665238 731 pod_workers.go:191] Error syncing pod 9b7e692e-cd09-45ee-804a-db312d9515e5 ("dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"
W0922 16:03:26.687997 2677774 out.go:270] Sep 22 16:03:25 old-k8s-version-516480 kubelet[731]: E0922 16:03:25.691950 731 pod_workers.go:191] Error syncing pod dcecb091-e954-4a6f-b51e-c8087bb59734 ("metrics-server-9975d5f86-9dfk7_kube-system(dcecb091-e954-4a6f-b51e-c8087bb59734)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = pinging container registry fake.domain: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain: no such host"
Sep 22 16:03:25 old-k8s-version-516480 kubelet[731]: E0922 16:03:25.691950 731 pod_workers.go:191] Error syncing pod dcecb091-e954-4a6f-b51e-c8087bb59734 ("metrics-server-9975d5f86-9dfk7_kube-system(dcecb091-e954-4a6f-b51e-c8087bb59734)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = pinging container registry fake.domain: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain: no such host"
I0922 16:03:26.688013 2677774 out.go:358] Setting ErrFile to fd 2...
I0922 16:03:26.688029 2677774 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0922 16:03:36.688280 2677774 api_server.go:253] Checking apiserver healthz at https://192.168.76.2:8443/healthz ...
I0922 16:03:36.700813 2677774 api_server.go:279] https://192.168.76.2:8443/healthz returned 200:
ok
I0922 16:03:36.703682 2677774 out.go:201]
W0922 16:03:36.706164 2677774 out.go:270] X Exiting due to K8S_UNHEALTHY_CONTROL_PLANE: wait 6m0s for node: wait for healthy API server: controlPlane never updated to v1.20.0
X Exiting due to K8S_UNHEALTHY_CONTROL_PLANE: wait 6m0s for node: wait for healthy API server: controlPlane never updated to v1.20.0
W0922 16:03:36.706212 2677774 out.go:270] * Suggestion: Control Plane could not update, try minikube delete --all --purge
* Suggestion: Control Plane could not update, try minikube delete --all --purge
W0922 16:03:36.706235 2677774 out.go:270] * Related issue: https://github.com/kubernetes/minikube/issues/11417
* Related issue: https://github.com/kubernetes/minikube/issues/11417
W0922 16:03:36.706241 2677774 out.go:270] *
*
W0922 16:03:36.707282 2677774 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0922 16:03:36.710620 2677774 out.go:201]
** /stderr **
start_stop_delete_test.go:259: failed to start minikube post-stop. args "out/minikube-linux-arm64 start -p old-k8s-version-516480 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --container-runtime=crio --kubernetes-version=v1.20.0": exit status 102
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:230: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/SecondStart]: docker inspect <======
helpers_test.go:231: (dbg) Run: docker inspect old-k8s-version-516480
helpers_test.go:235: (dbg) docker inspect old-k8s-version-516480:
-- stdout --
[
{
"Id": "7698124a9b3f470ea3bf9a4388ac4c2519f15e9b8da1b4908fae865f74ffd689",
"Created": "2024-09-22T15:54:21.683848322Z",
"Path": "/usr/local/bin/entrypoint",
"Args": [
"/sbin/init"
],
"State": {
"Status": "running",
"Running": true,
"Paused": false,
"Restarting": false,
"OOMKilled": false,
"Dead": false,
"Pid": 2677975,
"ExitCode": 0,
"Error": "",
"StartedAt": "2024-09-22T15:57:19.272435101Z",
"FinishedAt": "2024-09-22T15:57:16.875935192Z"
},
"Image": "sha256:c94982da1293baee77c00993711af197ed62d6b1a4ee12c0caa4f57c70de4fdc",
"ResolvConfPath": "/var/lib/docker/containers/7698124a9b3f470ea3bf9a4388ac4c2519f15e9b8da1b4908fae865f74ffd689/resolv.conf",
"HostnamePath": "/var/lib/docker/containers/7698124a9b3f470ea3bf9a4388ac4c2519f15e9b8da1b4908fae865f74ffd689/hostname",
"HostsPath": "/var/lib/docker/containers/7698124a9b3f470ea3bf9a4388ac4c2519f15e9b8da1b4908fae865f74ffd689/hosts",
"LogPath": "/var/lib/docker/containers/7698124a9b3f470ea3bf9a4388ac4c2519f15e9b8da1b4908fae865f74ffd689/7698124a9b3f470ea3bf9a4388ac4c2519f15e9b8da1b4908fae865f74ffd689-json.log",
"Name": "/old-k8s-version-516480",
"RestartCount": 0,
"Driver": "overlay2",
"Platform": "linux",
"MountLabel": "",
"ProcessLabel": "",
"AppArmorProfile": "unconfined",
"ExecIDs": null,
"HostConfig": {
"Binds": [
"/lib/modules:/lib/modules:ro",
"old-k8s-version-516480:/var"
],
"ContainerIDFile": "",
"LogConfig": {
"Type": "json-file",
"Config": {}
},
"NetworkMode": "old-k8s-version-516480",
"PortBindings": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
]
},
"RestartPolicy": {
"Name": "no",
"MaximumRetryCount": 0
},
"AutoRemove": false,
"VolumeDriver": "",
"VolumesFrom": null,
"ConsoleSize": [
0,
0
],
"CapAdd": null,
"CapDrop": null,
"CgroupnsMode": "host",
"Dns": [],
"DnsOptions": [],
"DnsSearch": [],
"ExtraHosts": null,
"GroupAdd": null,
"IpcMode": "private",
"Cgroup": "",
"Links": null,
"OomScoreAdj": 0,
"PidMode": "",
"Privileged": true,
"PublishAllPorts": false,
"ReadonlyRootfs": false,
"SecurityOpt": [
"seccomp=unconfined",
"apparmor=unconfined",
"label=disable"
],
"Tmpfs": {
"/run": "",
"/tmp": ""
},
"UTSMode": "",
"UsernsMode": "",
"ShmSize": 67108864,
"Runtime": "runc",
"Isolation": "",
"CpuShares": 0,
"Memory": 2306867200,
"NanoCpus": 2000000000,
"CgroupParent": "",
"BlkioWeight": 0,
"BlkioWeightDevice": [],
"BlkioDeviceReadBps": [],
"BlkioDeviceWriteBps": [],
"BlkioDeviceReadIOps": [],
"BlkioDeviceWriteIOps": [],
"CpuPeriod": 0,
"CpuQuota": 0,
"CpuRealtimePeriod": 0,
"CpuRealtimeRuntime": 0,
"CpusetCpus": "",
"CpusetMems": "",
"Devices": [],
"DeviceCgroupRules": null,
"DeviceRequests": null,
"MemoryReservation": 0,
"MemorySwap": 4613734400,
"MemorySwappiness": null,
"OomKillDisable": false,
"PidsLimit": null,
"Ulimits": [],
"CpuCount": 0,
"CpuPercent": 0,
"IOMaximumIOps": 0,
"IOMaximumBandwidth": 0,
"MaskedPaths": null,
"ReadonlyPaths": null
},
"GraphDriver": {
"Data": {
"LowerDir": "/var/lib/docker/overlay2/997ff72646511ca87581be431ce7c4130ce94850bfa5a79867551db3d303b273-init/diff:/var/lib/docker/overlay2/d9219ecf4ba4139ee105e87e1abf332b82a9a5b666e2f75f38e8e0be91bf8411/diff",
"MergedDir": "/var/lib/docker/overlay2/997ff72646511ca87581be431ce7c4130ce94850bfa5a79867551db3d303b273/merged",
"UpperDir": "/var/lib/docker/overlay2/997ff72646511ca87581be431ce7c4130ce94850bfa5a79867551db3d303b273/diff",
"WorkDir": "/var/lib/docker/overlay2/997ff72646511ca87581be431ce7c4130ce94850bfa5a79867551db3d303b273/work"
},
"Name": "overlay2"
},
"Mounts": [
{
"Type": "bind",
"Source": "/lib/modules",
"Destination": "/lib/modules",
"Mode": "ro",
"RW": false,
"Propagation": "rprivate"
},
{
"Type": "volume",
"Name": "old-k8s-version-516480",
"Source": "/var/lib/docker/volumes/old-k8s-version-516480/_data",
"Destination": "/var",
"Driver": "local",
"Mode": "z",
"RW": true,
"Propagation": ""
}
],
"Config": {
"Hostname": "old-k8s-version-516480",
"Domainname": "",
"User": "",
"AttachStdin": false,
"AttachStdout": false,
"AttachStderr": false,
"ExposedPorts": {
"22/tcp": {},
"2376/tcp": {},
"32443/tcp": {},
"5000/tcp": {},
"8443/tcp": {}
},
"Tty": true,
"OpenStdin": false,
"StdinOnce": false,
"Env": [
"container=docker",
"PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
],
"Cmd": null,
"Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726784731-19672@sha256:7f8c62ddb0100a5b958dd19c5b5478b8c7ef13da9a0a4d6c7d18f43544e0dbed",
"Volumes": null,
"WorkingDir": "/",
"Entrypoint": [
"/usr/local/bin/entrypoint",
"/sbin/init"
],
"OnBuild": null,
"Labels": {
"created_by.minikube.sigs.k8s.io": "true",
"mode.minikube.sigs.k8s.io": "old-k8s-version-516480",
"name.minikube.sigs.k8s.io": "old-k8s-version-516480",
"role.minikube.sigs.k8s.io": ""
},
"StopSignal": "SIGRTMIN+3"
},
"NetworkSettings": {
"Bridge": "",
"SandboxID": "fedba79e69ed8cfe5124d9af70e5ee9024bab89d2c589ada0d8c5aab05f89228",
"SandboxKey": "/var/run/docker/netns/fedba79e69ed",
"Ports": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "36350"
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "36351"
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "36354"
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "36352"
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "36353"
}
]
},
"HairpinMode": false,
"LinkLocalIPv6Address": "",
"LinkLocalIPv6PrefixLen": 0,
"SecondaryIPAddresses": null,
"SecondaryIPv6Addresses": null,
"EndpointID": "",
"Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"IPAddress": "",
"IPPrefixLen": 0,
"IPv6Gateway": "",
"MacAddress": "",
"Networks": {
"old-k8s-version-516480": {
"IPAMConfig": {
"IPv4Address": "192.168.76.2"
},
"Links": null,
"Aliases": null,
"MacAddress": "02:42:c0:a8:4c:02",
"DriverOpts": null,
"NetworkID": "22b07022c94af44a29b5e705c91b4b41228784ddf9f1416eda5af089dc57fb15",
"EndpointID": "95b55880dea22d746d13a249d462ac0a321e510fb35b332f756706c8ce9814e8",
"Gateway": "192.168.76.1",
"IPAddress": "192.168.76.2",
"IPPrefixLen": 24,
"IPv6Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"DNSNames": [
"old-k8s-version-516480",
"7698124a9b3f"
]
}
}
}
}
]
-- /stdout --
helpers_test.go:239: (dbg) Run: out/minikube-linux-arm64 status --format={{.Host}} -p old-k8s-version-516480 -n old-k8s-version-516480
helpers_test.go:244: <<< TestStartStop/group/old-k8s-version/serial/SecondStart FAILED: start of post-mortem logs <<<
helpers_test.go:245: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/SecondStart]: minikube logs <======
helpers_test.go:247: (dbg) Run: out/minikube-linux-arm64 -p old-k8s-version-516480 logs -n 25
helpers_test.go:247: (dbg) Done: out/minikube-linux-arm64 -p old-k8s-version-516480 logs -n 25: (1.596371852s)
helpers_test.go:252: TestStartStop/group/old-k8s-version/serial/SecondStart logs:
-- stdout --
==> Audit <==
|---------|--------------------------------------------------------|--------------------------|---------|---------|---------------------|---------------------|
| Command | Args | Profile | User | Version | Start Time | End Time |
|---------|--------------------------------------------------------|--------------------------|---------|---------|---------------------|---------------------|
| ssh | -p cilium-568447 sudo cat | cilium-568447 | jenkins | v1.34.0 | 22 Sep 24 15:53 UTC | |
| | /etc/containerd/config.toml | | | | | |
| ssh | -p cilium-568447 sudo | cilium-568447 | jenkins | v1.34.0 | 22 Sep 24 15:53 UTC | |
| | containerd config dump | | | | | |
| ssh | -p cilium-568447 sudo | cilium-568447 | jenkins | v1.34.0 | 22 Sep 24 15:53 UTC | |
| | systemctl status crio --all | | | | | |
| | --full --no-pager | | | | | |
| ssh | -p cilium-568447 sudo | cilium-568447 | jenkins | v1.34.0 | 22 Sep 24 15:53 UTC | |
| | systemctl cat crio --no-pager | | | | | |
| ssh | -p cilium-568447 sudo find | cilium-568447 | jenkins | v1.34.0 | 22 Sep 24 15:53 UTC | |
| | /etc/crio -type f -exec sh -c | | | | | |
| | 'echo {}; cat {}' \; | | | | | |
| ssh | -p cilium-568447 sudo crio | cilium-568447 | jenkins | v1.34.0 | 22 Sep 24 15:53 UTC | |
| | config | | | | | |
| delete | -p cilium-568447 | cilium-568447 | jenkins | v1.34.0 | 22 Sep 24 15:53 UTC | 22 Sep 24 15:53 UTC |
| start | -p cert-expiration-100495 | cert-expiration-100495 | jenkins | v1.34.0 | 22 Sep 24 15:53 UTC | 22 Sep 24 15:53 UTC |
| | --memory=2048 | | | | | |
| | --cert-expiration=3m | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=crio | | | | | |
| delete | -p force-systemd-env-067912 | force-systemd-env-067912 | jenkins | v1.34.0 | 22 Sep 24 15:53 UTC | 22 Sep 24 15:53 UTC |
| start | -p cert-options-156319 | cert-options-156319 | jenkins | v1.34.0 | 22 Sep 24 15:53 UTC | 22 Sep 24 15:54 UTC |
| | --memory=2048 | | | | | |
| | --apiserver-ips=127.0.0.1 | | | | | |
| | --apiserver-ips=192.168.15.15 | | | | | |
| | --apiserver-names=localhost | | | | | |
| | --apiserver-names=www.google.com | | | | | |
| | --apiserver-port=8555 | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=crio | | | | | |
| ssh | cert-options-156319 ssh | cert-options-156319 | jenkins | v1.34.0 | 22 Sep 24 15:54 UTC | 22 Sep 24 15:54 UTC |
| | openssl x509 -text -noout -in | | | | | |
| | /var/lib/minikube/certs/apiserver.crt | | | | | |
| ssh | -p cert-options-156319 -- sudo | cert-options-156319 | jenkins | v1.34.0 | 22 Sep 24 15:54 UTC | 22 Sep 24 15:54 UTC |
| | cat /etc/kubernetes/admin.conf | | | | | |
| delete | -p cert-options-156319 | cert-options-156319 | jenkins | v1.34.0 | 22 Sep 24 15:54 UTC | 22 Sep 24 15:54 UTC |
| start | -p old-k8s-version-516480 | old-k8s-version-516480 | jenkins | v1.34.0 | 22 Sep 24 15:54 UTC | 22 Sep 24 15:56 UTC |
| | --memory=2200 | | | | | |
| | --alsologtostderr --wait=true | | | | | |
| | --kvm-network=default | | | | | |
| | --kvm-qemu-uri=qemu:///system | | | | | |
| | --disable-driver-mounts | | | | | |
| | --keep-context=false | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=crio | | | | | |
| | --kubernetes-version=v1.20.0 | | | | | |
| start | -p cert-expiration-100495 | cert-expiration-100495 | jenkins | v1.34.0 | 22 Sep 24 15:56 UTC | 22 Sep 24 15:56 UTC |
| | --memory=2048 | | | | | |
| | --cert-expiration=8760h | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=crio | | | | | |
| delete | -p cert-expiration-100495 | cert-expiration-100495 | jenkins | v1.34.0 | 22 Sep 24 15:56 UTC | 22 Sep 24 15:57 UTC |
| start | -p no-preload-592860 | no-preload-592860 | jenkins | v1.34.0 | 22 Sep 24 15:57 UTC | 22 Sep 24 15:58 UTC |
| | --memory=2200 | | | | | |
| | --alsologtostderr | | | | | |
| | --wait=true --preload=false | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=crio | | | | | |
| | --kubernetes-version=v1.31.1 | | | | | |
| addons | enable metrics-server -p old-k8s-version-516480 | old-k8s-version-516480 | jenkins | v1.34.0 | 22 Sep 24 15:57 UTC | 22 Sep 24 15:57 UTC |
| | --images=MetricsServer=registry.k8s.io/echoserver:1.4 | | | | | |
| | --registries=MetricsServer=fake.domain | | | | | |
| stop | -p old-k8s-version-516480 | old-k8s-version-516480 | jenkins | v1.34.0 | 22 Sep 24 15:57 UTC | 22 Sep 24 15:57 UTC |
| | --alsologtostderr -v=3 | | | | | |
| addons | enable dashboard -p old-k8s-version-516480 | old-k8s-version-516480 | jenkins | v1.34.0 | 22 Sep 24 15:57 UTC | 22 Sep 24 15:57 UTC |
| | --images=MetricsScraper=registry.k8s.io/echoserver:1.4 | | | | | |
| start | -p old-k8s-version-516480 | old-k8s-version-516480 | jenkins | v1.34.0 | 22 Sep 24 15:57 UTC | |
| | --memory=2200 | | | | | |
| | --alsologtostderr --wait=true | | | | | |
| | --kvm-network=default | | | | | |
| | --kvm-qemu-uri=qemu:///system | | | | | |
| | --disable-driver-mounts | | | | | |
| | --keep-context=false | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=crio | | | | | |
| | --kubernetes-version=v1.20.0 | | | | | |
| addons | enable metrics-server -p no-preload-592860 | no-preload-592860 | jenkins | v1.34.0 | 22 Sep 24 15:58 UTC | 22 Sep 24 15:58 UTC |
| | --images=MetricsServer=registry.k8s.io/echoserver:1.4 | | | | | |
| | --registries=MetricsServer=fake.domain | | | | | |
| stop | -p no-preload-592860 | no-preload-592860 | jenkins | v1.34.0 | 22 Sep 24 15:58 UTC | 22 Sep 24 15:58 UTC |
| | --alsologtostderr -v=3 | | | | | |
| addons | enable dashboard -p no-preload-592860 | no-preload-592860 | jenkins | v1.34.0 | 22 Sep 24 15:58 UTC | 22 Sep 24 15:58 UTC |
| | --images=MetricsScraper=registry.k8s.io/echoserver:1.4 | | | | | |
| start | -p no-preload-592860 | no-preload-592860 | jenkins | v1.34.0 | 22 Sep 24 15:58 UTC | 22 Sep 24 16:03 UTC |
| | --memory=2200 | | | | | |
| | --alsologtostderr | | | | | |
| | --wait=true --preload=false | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=crio | | | | | |
| | --kubernetes-version=v1.31.1 | | | | | |
|---------|--------------------------------------------------------|--------------------------|---------|---------|---------------------|---------------------|
==> Last Start <==
Log file created at: 2024/09/22 15:58:28
Running on machine: ip-172-31-21-244
Binary: Built with gc go1.23.0 for linux/arm64
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
I0922 15:58:28.816775 2681906 out.go:345] Setting OutFile to fd 1 ...
I0922 15:58:28.816977 2681906 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0922 15:58:28.817005 2681906 out.go:358] Setting ErrFile to fd 2...
I0922 15:58:28.817024 2681906 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0922 15:58:28.817328 2681906 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19648-2476577/.minikube/bin
I0922 15:58:28.817751 2681906 out.go:352] Setting JSON to false
I0922 15:58:28.818865 2681906 start.go:129] hostinfo: {"hostname":"ip-172-31-21-244","uptime":70859,"bootTime":1726949850,"procs":223,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1070-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"da8ac1fd-6236-412a-a346-95873c98230d"}
I0922 15:58:28.819006 2681906 start.go:139] virtualization:
I0922 15:58:28.823887 2681906 out.go:177] * [no-preload-592860] minikube v1.34.0 on Ubuntu 20.04 (arm64)
I0922 15:58:28.826570 2681906 out.go:177] - MINIKUBE_LOCATION=19648
I0922 15:58:28.826632 2681906 notify.go:220] Checking for updates...
I0922 15:58:28.832739 2681906 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0922 15:58:23.937278 2677774 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-516480" in "kube-system" namespace has status "Ready":"False"
I0922 15:58:26.437265 2677774 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-516480" in "kube-system" namespace has status "Ready":"False"
I0922 15:58:28.438681 2677774 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-516480" in "kube-system" namespace has status "Ready":"False"
I0922 15:58:28.836755 2681906 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/19648-2476577/kubeconfig
I0922 15:58:28.839786 2681906 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/19648-2476577/.minikube
I0922 15:58:28.842831 2681906 out.go:177] - MINIKUBE_BIN=out/minikube-linux-arm64
I0922 15:58:28.846903 2681906 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0922 15:58:28.849605 2681906 config.go:182] Loaded profile config "no-preload-592860": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.31.1
I0922 15:58:28.850152 2681906 driver.go:394] Setting default libvirt URI to qemu:///system
I0922 15:58:28.885308 2681906 docker.go:123] docker version: linux-27.3.1:Docker Engine - Community
I0922 15:58:28.885437 2681906 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0922 15:58:28.938613 2681906 info.go:266] docker info: {ID:5FDH:SA5P:5GCT:NLAS:B73P:SGDQ:PBG5:UBVH:UZY3:RXGO:CI7S:WAIH Containers:2 ContainersRunning:1 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:38 OomKillDisable:true NGoroutines:52 SystemTime:2024-09-22 15:58:28.92570398 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1070-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aa
rch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214831104 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-21-244 Labels:[] ExperimentalBuild:false ServerVersion:27.3.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c Expected:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c} RuncCommit:{ID:v1.1.14-0-g2c9f560 Expected:v1.1.14-0-g2c9f560} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:[WARNING: bridg
e-nf-call-iptables is disabled WARNING: bridge-nf-call-ip6tables is disabled] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.17.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.7]] Warnings:<nil>}}
I0922 15:58:28.938730 2681906 docker.go:318] overlay module found
I0922 15:58:28.942654 2681906 out.go:177] * Using the docker driver based on existing profile
I0922 15:58:28.944963 2681906 start.go:297] selected driver: docker
I0922 15:58:28.944984 2681906 start.go:901] validating driver "docker" against &{Name:no-preload-592860 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726784731-19672@sha256:7f8c62ddb0100a5b958dd19c5b5478b8c7ef13da9a0a4d6c7d18f43544e0dbed Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.1 ClusterName:no-preload-592860 Namespace:default APIServerHAVIP: APIServerNa
me:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home
/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0922 15:58:28.945111 2681906 start.go:912] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0922 15:58:28.945749 2681906 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0922 15:58:29.004957 2681906 info.go:266] docker info: {ID:5FDH:SA5P:5GCT:NLAS:B73P:SGDQ:PBG5:UBVH:UZY3:RXGO:CI7S:WAIH Containers:2 ContainersRunning:1 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:38 OomKillDisable:true NGoroutines:52 SystemTime:2024-09-22 15:58:28.995422632 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1070-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:a
arch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214831104 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-21-244 Labels:[] ExperimentalBuild:false ServerVersion:27.3.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c Expected:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c} RuncCommit:{ID:v1.1.14-0-g2c9f560 Expected:v1.1.14-0-g2c9f560} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:[WARNING: brid
ge-nf-call-iptables is disabled WARNING: bridge-nf-call-ip6tables is disabled] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.17.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.7]] Warnings:<nil>}}
I0922 15:58:29.005360 2681906 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0922 15:58:29.005397 2681906 cni.go:84] Creating CNI manager for ""
I0922 15:58:29.005440 2681906 cni.go:143] "docker" driver + "crio" runtime found, recommending kindnet
I0922 15:58:29.005481 2681906 start.go:340] cluster config:
{Name:no-preload-592860 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726784731-19672@sha256:7f8c62ddb0100a5b958dd19c5b5478b8c7ef13da9a0a4d6c7d18f43544e0dbed Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.1 ClusterName:no-preload-592860 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local Containe
rRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMS
ize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0922 15:58:29.008117 2681906 out.go:177] * Starting "no-preload-592860" primary control-plane node in "no-preload-592860" cluster
I0922 15:58:29.010553 2681906 cache.go:121] Beginning downloading kic base image for docker with crio
I0922 15:58:29.012953 2681906 out.go:177] * Pulling base image v0.0.45-1726784731-19672 ...
I0922 15:58:29.015909 2681906 preload.go:131] Checking if preload exists for k8s version v1.31.1 and runtime crio
I0922 15:58:29.015990 2681906 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726784731-19672@sha256:7f8c62ddb0100a5b958dd19c5b5478b8c7ef13da9a0a4d6c7d18f43544e0dbed in local docker daemon
I0922 15:58:29.016075 2681906 profile.go:143] Saving config to /home/jenkins/minikube-integration/19648-2476577/.minikube/profiles/no-preload-592860/config.json ...
I0922 15:58:29.016398 2681906 cache.go:107] acquiring lock: {Name:mkc59c6483da2f92ac20ee127ee99f4b03d4ed07 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0922 15:58:29.016489 2681906 cache.go:115] /home/jenkins/minikube-integration/19648-2476577/.minikube/cache/images/arm64/registry.k8s.io/kube-apiserver_v1.31.1 exists
I0922 15:58:29.016502 2681906 cache.go:96] cache image "registry.k8s.io/kube-apiserver:v1.31.1" -> "/home/jenkins/minikube-integration/19648-2476577/.minikube/cache/images/arm64/registry.k8s.io/kube-apiserver_v1.31.1" took 133.782µs
I0922 15:58:29.016516 2681906 cache.go:80] save to tar file registry.k8s.io/kube-apiserver:v1.31.1 -> /home/jenkins/minikube-integration/19648-2476577/.minikube/cache/images/arm64/registry.k8s.io/kube-apiserver_v1.31.1 succeeded
I0922 15:58:29.016528 2681906 cache.go:107] acquiring lock: {Name:mk4cd191d99c698d6d3316a28dd3fde03e11a809 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0922 15:58:29.016568 2681906 cache.go:115] /home/jenkins/minikube-integration/19648-2476577/.minikube/cache/images/arm64/registry.k8s.io/kube-controller-manager_v1.31.1 exists
I0922 15:58:29.016577 2681906 cache.go:96] cache image "registry.k8s.io/kube-controller-manager:v1.31.1" -> "/home/jenkins/minikube-integration/19648-2476577/.minikube/cache/images/arm64/registry.k8s.io/kube-controller-manager_v1.31.1" took 51.56µs
I0922 15:58:29.016583 2681906 cache.go:80] save to tar file registry.k8s.io/kube-controller-manager:v1.31.1 -> /home/jenkins/minikube-integration/19648-2476577/.minikube/cache/images/arm64/registry.k8s.io/kube-controller-manager_v1.31.1 succeeded
I0922 15:58:29.016593 2681906 cache.go:107] acquiring lock: {Name:mk44ca01b3031d29216b1e104a3ae8994ab9030e Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0922 15:58:29.016629 2681906 cache.go:115] /home/jenkins/minikube-integration/19648-2476577/.minikube/cache/images/arm64/registry.k8s.io/kube-scheduler_v1.31.1 exists
I0922 15:58:29.016638 2681906 cache.go:96] cache image "registry.k8s.io/kube-scheduler:v1.31.1" -> "/home/jenkins/minikube-integration/19648-2476577/.minikube/cache/images/arm64/registry.k8s.io/kube-scheduler_v1.31.1" took 46.03µs
I0922 15:58:29.016644 2681906 cache.go:80] save to tar file registry.k8s.io/kube-scheduler:v1.31.1 -> /home/jenkins/minikube-integration/19648-2476577/.minikube/cache/images/arm64/registry.k8s.io/kube-scheduler_v1.31.1 succeeded
I0922 15:58:29.016652 2681906 cache.go:107] acquiring lock: {Name:mk128689ba0cd72f589d13839754dc6d4e1a6364 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0922 15:58:29.016679 2681906 cache.go:115] /home/jenkins/minikube-integration/19648-2476577/.minikube/cache/images/arm64/registry.k8s.io/kube-proxy_v1.31.1 exists
I0922 15:58:29.016684 2681906 cache.go:96] cache image "registry.k8s.io/kube-proxy:v1.31.1" -> "/home/jenkins/minikube-integration/19648-2476577/.minikube/cache/images/arm64/registry.k8s.io/kube-proxy_v1.31.1" took 32.549µs
I0922 15:58:29.016689 2681906 cache.go:80] save to tar file registry.k8s.io/kube-proxy:v1.31.1 -> /home/jenkins/minikube-integration/19648-2476577/.minikube/cache/images/arm64/registry.k8s.io/kube-proxy_v1.31.1 succeeded
I0922 15:58:29.016698 2681906 cache.go:107] acquiring lock: {Name:mk13c208f3ba4b218c932fbda99361b409d176ff Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0922 15:58:29.016726 2681906 cache.go:115] /home/jenkins/minikube-integration/19648-2476577/.minikube/cache/images/arm64/registry.k8s.io/pause_3.10 exists
I0922 15:58:29.016734 2681906 cache.go:96] cache image "registry.k8s.io/pause:3.10" -> "/home/jenkins/minikube-integration/19648-2476577/.minikube/cache/images/arm64/registry.k8s.io/pause_3.10" took 36.996µs
I0922 15:58:29.016740 2681906 cache.go:80] save to tar file registry.k8s.io/pause:3.10 -> /home/jenkins/minikube-integration/19648-2476577/.minikube/cache/images/arm64/registry.k8s.io/pause_3.10 succeeded
I0922 15:58:29.016748 2681906 cache.go:107] acquiring lock: {Name:mkd40c4120a5db288a05b6ea76a1b0917b646c38 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0922 15:58:29.016782 2681906 cache.go:115] /home/jenkins/minikube-integration/19648-2476577/.minikube/cache/images/arm64/registry.k8s.io/etcd_3.5.15-0 exists
I0922 15:58:29.016790 2681906 cache.go:96] cache image "registry.k8s.io/etcd:3.5.15-0" -> "/home/jenkins/minikube-integration/19648-2476577/.minikube/cache/images/arm64/registry.k8s.io/etcd_3.5.15-0" took 42.788µs
I0922 15:58:29.016795 2681906 cache.go:80] save to tar file registry.k8s.io/etcd:3.5.15-0 -> /home/jenkins/minikube-integration/19648-2476577/.minikube/cache/images/arm64/registry.k8s.io/etcd_3.5.15-0 succeeded
I0922 15:58:29.016804 2681906 cache.go:107] acquiring lock: {Name:mk1f4a22891b15166728c103494ec46b5ba969f5 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0922 15:58:29.016833 2681906 cache.go:115] /home/jenkins/minikube-integration/19648-2476577/.minikube/cache/images/arm64/registry.k8s.io/coredns/coredns_v1.11.3 exists
I0922 15:58:29.016838 2681906 cache.go:96] cache image "registry.k8s.io/coredns/coredns:v1.11.3" -> "/home/jenkins/minikube-integration/19648-2476577/.minikube/cache/images/arm64/registry.k8s.io/coredns/coredns_v1.11.3" took 34.896µs
I0922 15:58:29.016847 2681906 cache.go:80] save to tar file registry.k8s.io/coredns/coredns:v1.11.3 -> /home/jenkins/minikube-integration/19648-2476577/.minikube/cache/images/arm64/registry.k8s.io/coredns/coredns_v1.11.3 succeeded
I0922 15:58:29.016896 2681906 cache.go:107] acquiring lock: {Name:mk1d19e9baf685f3093a70f4cd685e63a5a722e3 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0922 15:58:29.016935 2681906 cache.go:115] /home/jenkins/minikube-integration/19648-2476577/.minikube/cache/images/arm64/gcr.io/k8s-minikube/storage-provisioner_v5 exists
I0922 15:58:29.016946 2681906 cache.go:96] cache image "gcr.io/k8s-minikube/storage-provisioner:v5" -> "/home/jenkins/minikube-integration/19648-2476577/.minikube/cache/images/arm64/gcr.io/k8s-minikube/storage-provisioner_v5" took 51.617µs
I0922 15:58:29.016953 2681906 cache.go:80] save to tar file gcr.io/k8s-minikube/storage-provisioner:v5 -> /home/jenkins/minikube-integration/19648-2476577/.minikube/cache/images/arm64/gcr.io/k8s-minikube/storage-provisioner_v5 succeeded
I0922 15:58:29.016958 2681906 cache.go:87] Successfully saved all images to host disk.
I0922 15:58:29.040581 2681906 image.go:98] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726784731-19672@sha256:7f8c62ddb0100a5b958dd19c5b5478b8c7ef13da9a0a4d6c7d18f43544e0dbed in local docker daemon, skipping pull
I0922 15:58:29.040603 2681906 cache.go:144] gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726784731-19672@sha256:7f8c62ddb0100a5b958dd19c5b5478b8c7ef13da9a0a4d6c7d18f43544e0dbed exists in daemon, skipping load
I0922 15:58:29.040622 2681906 cache.go:194] Successfully downloaded all kic artifacts
I0922 15:58:29.040721 2681906 start.go:360] acquireMachinesLock for no-preload-592860: {Name:mk0de96f97e174a676862097196da2e6b62b2bbc Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0922 15:58:29.040805 2681906 start.go:364] duration metric: took 45.619µs to acquireMachinesLock for "no-preload-592860"
I0922 15:58:29.040827 2681906 start.go:96] Skipping create...Using existing machine configuration
I0922 15:58:29.040832 2681906 fix.go:54] fixHost starting:
I0922 15:58:29.041171 2681906 cli_runner.go:164] Run: docker container inspect no-preload-592860 --format={{.State.Status}}
I0922 15:58:29.058258 2681906 fix.go:112] recreateIfNeeded on no-preload-592860: state=Stopped err=<nil>
W0922 15:58:29.058295 2681906 fix.go:138] unexpected machine state, will restart: <nil>
I0922 15:58:29.062728 2681906 out.go:177] * Restarting existing docker container for "no-preload-592860" ...
I0922 15:58:29.065409 2681906 cli_runner.go:164] Run: docker start no-preload-592860
I0922 15:58:29.382472 2681906 cli_runner.go:164] Run: docker container inspect no-preload-592860 --format={{.State.Status}}
I0922 15:58:29.404532 2681906 kic.go:430] container "no-preload-592860" state is running.
I0922 15:58:29.406717 2681906 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" no-preload-592860
I0922 15:58:29.428462 2681906 profile.go:143] Saving config to /home/jenkins/minikube-integration/19648-2476577/.minikube/profiles/no-preload-592860/config.json ...
I0922 15:58:29.429002 2681906 machine.go:93] provisionDockerMachine start ...
I0922 15:58:29.430443 2681906 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-592860
I0922 15:58:29.453800 2681906 main.go:141] libmachine: Using SSH client type: native
I0922 15:58:29.454060 2681906 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x413650] 0x415e90 <nil> [] 0s} 127.0.0.1 36355 <nil> <nil>}
I0922 15:58:29.454079 2681906 main.go:141] libmachine: About to run SSH command:
hostname
I0922 15:58:29.455082 2681906 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: EOF
I0922 15:58:32.590476 2681906 main.go:141] libmachine: SSH cmd err, output: <nil>: no-preload-592860
I0922 15:58:32.590502 2681906 ubuntu.go:169] provisioning hostname "no-preload-592860"
I0922 15:58:32.590574 2681906 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-592860
I0922 15:58:32.608267 2681906 main.go:141] libmachine: Using SSH client type: native
I0922 15:58:32.608503 2681906 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x413650] 0x415e90 <nil> [] 0s} 127.0.0.1 36355 <nil> <nil>}
I0922 15:58:32.608520 2681906 main.go:141] libmachine: About to run SSH command:
sudo hostname no-preload-592860 && echo "no-preload-592860" | sudo tee /etc/hostname
I0922 15:58:32.767308 2681906 main.go:141] libmachine: SSH cmd err, output: <nil>: no-preload-592860
I0922 15:58:32.767388 2681906 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-592860
I0922 15:58:32.785349 2681906 main.go:141] libmachine: Using SSH client type: native
I0922 15:58:32.785627 2681906 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x413650] 0x415e90 <nil> [] 0s} 127.0.0.1 36355 <nil> <nil>}
I0922 15:58:32.785652 2681906 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sno-preload-592860' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 no-preload-592860/g' /etc/hosts;
else
echo '127.0.1.1 no-preload-592860' | sudo tee -a /etc/hosts;
fi
fi
I0922 15:58:32.919219 2681906 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0922 15:58:32.919245 2681906 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/19648-2476577/.minikube CaCertPath:/home/jenkins/minikube-integration/19648-2476577/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19648-2476577/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19648-2476577/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19648-2476577/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19648-2476577/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19648-2476577/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19648-2476577/.minikube}
I0922 15:58:32.919279 2681906 ubuntu.go:177] setting up certificates
I0922 15:58:32.919292 2681906 provision.go:84] configureAuth start
I0922 15:58:32.919382 2681906 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" no-preload-592860
I0922 15:58:32.940926 2681906 provision.go:143] copyHostCerts
I0922 15:58:32.941042 2681906 exec_runner.go:144] found /home/jenkins/minikube-integration/19648-2476577/.minikube/ca.pem, removing ...
I0922 15:58:32.941060 2681906 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19648-2476577/.minikube/ca.pem
I0922 15:58:32.941144 2681906 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19648-2476577/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19648-2476577/.minikube/ca.pem (1078 bytes)
I0922 15:58:32.941252 2681906 exec_runner.go:144] found /home/jenkins/minikube-integration/19648-2476577/.minikube/cert.pem, removing ...
I0922 15:58:32.941257 2681906 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19648-2476577/.minikube/cert.pem
I0922 15:58:32.941289 2681906 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19648-2476577/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19648-2476577/.minikube/cert.pem (1123 bytes)
I0922 15:58:32.941348 2681906 exec_runner.go:144] found /home/jenkins/minikube-integration/19648-2476577/.minikube/key.pem, removing ...
I0922 15:58:32.941353 2681906 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19648-2476577/.minikube/key.pem
I0922 15:58:32.941378 2681906 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19648-2476577/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19648-2476577/.minikube/key.pem (1675 bytes)
I0922 15:58:32.941491 2681906 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19648-2476577/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19648-2476577/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19648-2476577/.minikube/certs/ca-key.pem org=jenkins.no-preload-592860 san=[127.0.0.1 192.168.85.2 localhost minikube no-preload-592860]
I0922 15:58:33.447507 2681906 provision.go:177] copyRemoteCerts
I0922 15:58:33.447580 2681906 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0922 15:58:33.447625 2681906 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-592860
I0922 15:58:33.465001 2681906 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:36355 SSHKeyPath:/home/jenkins/minikube-integration/19648-2476577/.minikube/machines/no-preload-592860/id_rsa Username:docker}
I0922 15:58:33.560375 2681906 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19648-2476577/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0922 15:58:33.586820 2681906 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19648-2476577/.minikube/machines/server.pem --> /etc/docker/server.pem (1220 bytes)
I0922 15:58:33.612600 2681906 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19648-2476577/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
I0922 15:58:33.639240 2681906 provision.go:87] duration metric: took 719.9322ms to configureAuth
I0922 15:58:33.639267 2681906 ubuntu.go:193] setting minikube options for container-runtime
I0922 15:58:33.639468 2681906 config.go:182] Loaded profile config "no-preload-592860": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.31.1
I0922 15:58:33.639581 2681906 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-592860
I0922 15:58:33.655794 2681906 main.go:141] libmachine: Using SSH client type: native
I0922 15:58:33.656066 2681906 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x413650] 0x415e90 <nil> [] 0s} 127.0.0.1 36355 <nil> <nil>}
I0922 15:58:33.656090 2681906 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %s "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0922 15:58:30.445213 2677774 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-516480" in "kube-system" namespace has status "Ready":"False"
I0922 15:58:32.939246 2677774 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-516480" in "kube-system" namespace has status "Ready":"False"
I0922 15:58:34.058478 2681906 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0922 15:58:34.058502 2681906 machine.go:96] duration metric: took 4.629480119s to provisionDockerMachine
I0922 15:58:34.058514 2681906 start.go:293] postStartSetup for "no-preload-592860" (driver="docker")
I0922 15:58:34.058546 2681906 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0922 15:58:34.058625 2681906 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0922 15:58:34.058686 2681906 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-592860
I0922 15:58:34.080322 2681906 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:36355 SSHKeyPath:/home/jenkins/minikube-integration/19648-2476577/.minikube/machines/no-preload-592860/id_rsa Username:docker}
I0922 15:58:34.185255 2681906 ssh_runner.go:195] Run: cat /etc/os-release
I0922 15:58:34.188665 2681906 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I0922 15:58:34.188705 2681906 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
I0922 15:58:34.188716 2681906 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
I0922 15:58:34.188723 2681906 info.go:137] Remote host: Ubuntu 22.04.5 LTS
I0922 15:58:34.188734 2681906 filesync.go:126] Scanning /home/jenkins/minikube-integration/19648-2476577/.minikube/addons for local assets ...
I0922 15:58:34.188795 2681906 filesync.go:126] Scanning /home/jenkins/minikube-integration/19648-2476577/.minikube/files for local assets ...
I0922 15:58:34.188880 2681906 filesync.go:149] local asset: /home/jenkins/minikube-integration/19648-2476577/.minikube/files/etc/ssl/certs/24819532.pem -> 24819532.pem in /etc/ssl/certs
I0922 15:58:34.188991 2681906 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0922 15:58:34.199421 2681906 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19648-2476577/.minikube/files/etc/ssl/certs/24819532.pem --> /etc/ssl/certs/24819532.pem (1708 bytes)
I0922 15:58:34.224967 2681906 start.go:296] duration metric: took 166.419227ms for postStartSetup
I0922 15:58:34.225051 2681906 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I0922 15:58:34.225141 2681906 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-592860
I0922 15:58:34.242190 2681906 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:36355 SSHKeyPath:/home/jenkins/minikube-integration/19648-2476577/.minikube/machines/no-preload-592860/id_rsa Username:docker}
I0922 15:58:34.336306 2681906 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
I0922 15:58:34.340937 2681906 fix.go:56] duration metric: took 5.30009583s for fixHost
I0922 15:58:34.340985 2681906 start.go:83] releasing machines lock for "no-preload-592860", held for 5.300150049s
I0922 15:58:34.341082 2681906 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" no-preload-592860
I0922 15:58:34.359375 2681906 ssh_runner.go:195] Run: cat /version.json
I0922 15:58:34.359431 2681906 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-592860
I0922 15:58:34.359566 2681906 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0922 15:58:34.359677 2681906 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-592860
I0922 15:58:34.381748 2681906 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:36355 SSHKeyPath:/home/jenkins/minikube-integration/19648-2476577/.minikube/machines/no-preload-592860/id_rsa Username:docker}
I0922 15:58:34.389981 2681906 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:36355 SSHKeyPath:/home/jenkins/minikube-integration/19648-2476577/.minikube/machines/no-preload-592860/id_rsa Username:docker}
I0922 15:58:34.617710 2681906 ssh_runner.go:195] Run: systemctl --version
I0922 15:58:34.622268 2681906 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0922 15:58:34.764663 2681906 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
I0922 15:58:34.768996 2681906 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0922 15:58:34.778416 2681906 cni.go:221] loopback cni configuration disabled: "/etc/cni/net.d/*loopback.conf*" found
I0922 15:58:34.778492 2681906 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0922 15:58:34.787532 2681906 cni.go:259] no active bridge cni configs found in "/etc/cni/net.d" - nothing to disable
I0922 15:58:34.787557 2681906 start.go:495] detecting cgroup driver to use...
I0922 15:58:34.787591 2681906 detect.go:187] detected "cgroupfs" cgroup driver on host os
I0922 15:58:34.787644 2681906 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0922 15:58:34.800493 2681906 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0922 15:58:34.812136 2681906 docker.go:217] disabling cri-docker service (if available) ...
I0922 15:58:34.812287 2681906 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0922 15:58:34.827126 2681906 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0922 15:58:34.838701 2681906 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0922 15:58:34.925787 2681906 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0922 15:58:35.019970 2681906 docker.go:233] disabling docker service ...
I0922 15:58:35.020037 2681906 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0922 15:58:35.032980 2681906 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0922 15:58:35.051549 2681906 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0922 15:58:35.153342 2681906 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0922 15:58:35.234465 2681906 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0922 15:58:35.246636 2681906 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0922 15:58:35.263008 2681906 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.10" pause image...
I0922 15:58:35.263121 2681906 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.10"|' /etc/crio/crio.conf.d/02-crio.conf"
I0922 15:58:35.272840 2681906 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0922 15:58:35.272911 2681906 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0922 15:58:35.283342 2681906 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0922 15:58:35.294279 2681906 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0922 15:58:35.304077 2681906 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0922 15:58:35.313470 2681906 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *"net.ipv4.ip_unprivileged_port_start=.*"/d' /etc/crio/crio.conf.d/02-crio.conf"
I0922 15:58:35.323446 2681906 ssh_runner.go:195] Run: sh -c "sudo grep -q "^ *default_sysctls" /etc/crio/crio.conf.d/02-crio.conf || sudo sed -i '/conmon_cgroup = .*/a default_sysctls = \[\n\]' /etc/crio/crio.conf.d/02-crio.conf"
I0922 15:58:35.333545 2681906 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^default_sysctls *= *\[|&\n "net.ipv4.ip_unprivileged_port_start=0",|' /etc/crio/crio.conf.d/02-crio.conf"
I0922 15:58:35.343925 2681906 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0922 15:58:35.353152 2681906 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0922 15:58:35.361549 2681906 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0922 15:58:35.443971 2681906 ssh_runner.go:195] Run: sudo systemctl restart crio
I0922 15:58:35.592419 2681906 start.go:542] Will wait 60s for socket path /var/run/crio/crio.sock
I0922 15:58:35.592538 2681906 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0922 15:58:35.598627 2681906 start.go:563] Will wait 60s for crictl version
I0922 15:58:35.598746 2681906 ssh_runner.go:195] Run: which crictl
I0922 15:58:35.602588 2681906 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0922 15:58:35.656327 2681906 start.go:579] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.24.6
RuntimeApiVersion: v1
I0922 15:58:35.656475 2681906 ssh_runner.go:195] Run: crio --version
I0922 15:58:35.708452 2681906 ssh_runner.go:195] Run: crio --version
I0922 15:58:35.754028 2681906 out.go:177] * Preparing Kubernetes v1.31.1 on CRI-O 1.24.6 ...
I0922 15:58:35.756506 2681906 cli_runner.go:164] Run: docker network inspect no-preload-592860 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I0922 15:58:35.773330 2681906 ssh_runner.go:195] Run: grep 192.168.85.1 host.minikube.internal$ /etc/hosts
I0922 15:58:35.777353 2681906 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.85.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0922 15:58:35.788255 2681906 kubeadm.go:883] updating cluster {Name:no-preload-592860 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726784731-19672@sha256:7f8c62ddb0100a5b958dd19c5b5478b8c7ef13da9a0a4d6c7d18f43544e0dbed Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.1 ClusterName:no-preload-592860 Namespace:default APIServerHAVIP: APIServerName:minikubeCA API
ServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikub
e-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0922 15:58:35.788387 2681906 preload.go:131] Checking if preload exists for k8s version v1.31.1 and runtime crio
I0922 15:58:35.788429 2681906 ssh_runner.go:195] Run: sudo crictl images --output json
I0922 15:58:35.840860 2681906 crio.go:514] all images are preloaded for cri-o runtime.
I0922 15:58:35.840886 2681906 cache_images.go:84] Images are preloaded, skipping loading
I0922 15:58:35.840895 2681906 kubeadm.go:934] updating node { 192.168.85.2 8443 v1.31.1 crio true true} ...
I0922 15:58:35.840992 2681906 kubeadm.go:946] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.31.1/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --cgroups-per-qos=false --config=/var/lib/kubelet/config.yaml --enforce-node-allocatable= --hostname-override=no-preload-592860 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.85.2
[Install]
config:
{KubernetesVersion:v1.31.1 ClusterName:no-preload-592860 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0922 15:58:35.841083 2681906 ssh_runner.go:195] Run: crio config
I0922 15:58:35.940789 2681906 cni.go:84] Creating CNI manager for ""
I0922 15:58:35.940820 2681906 cni.go:143] "docker" driver + "crio" runtime found, recommending kindnet
I0922 15:58:35.940832 2681906 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0922 15:58:35.940865 2681906 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.85.2 APIServerPort:8443 KubernetesVersion:v1.31.1 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:no-preload-592860 NodeName:no-preload-592860 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.85.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.85.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc
/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///var/run/crio/crio.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
I0922 15:58:35.941009 2681906 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta3
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.85.2
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: unix:///var/run/crio/crio.sock
name: "no-preload-592860"
kubeletExtraArgs:
node-ip: 192.168.85.2
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta3
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.85.2"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.31.1
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
containerRuntimeEndpoint: unix:///var/run/crio/crio.sock
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0922 15:58:35.941081 2681906 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.31.1
I0922 15:58:35.951281 2681906 binaries.go:44] Found k8s binaries, skipping transfer
I0922 15:58:35.951353 2681906 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0922 15:58:35.960523 2681906 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (367 bytes)
I0922 15:58:35.979720 2681906 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0922 15:58:35.998729 2681906 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2155 bytes)
I0922 15:58:36.019125 2681906 ssh_runner.go:195] Run: grep 192.168.85.2 control-plane.minikube.internal$ /etc/hosts
I0922 15:58:36.022795 2681906 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.85.2 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0922 15:58:36.034111 2681906 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0922 15:58:36.136304 2681906 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0922 15:58:36.151511 2681906 certs.go:68] Setting up /home/jenkins/minikube-integration/19648-2476577/.minikube/profiles/no-preload-592860 for IP: 192.168.85.2
I0922 15:58:36.151545 2681906 certs.go:194] generating shared ca certs ...
I0922 15:58:36.151564 2681906 certs.go:226] acquiring lock for ca certs: {Name:mkeff3e73d2be4d9e117d80b8189a4c062e8cbf0 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0922 15:58:36.151730 2681906 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/19648-2476577/.minikube/ca.key
I0922 15:58:36.151786 2681906 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19648-2476577/.minikube/proxy-client-ca.key
I0922 15:58:36.151799 2681906 certs.go:256] generating profile certs ...
I0922 15:58:36.151893 2681906 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/19648-2476577/.minikube/profiles/no-preload-592860/client.key
I0922 15:58:36.152010 2681906 certs.go:359] skipping valid signed profile cert regeneration for "minikube": /home/jenkins/minikube-integration/19648-2476577/.minikube/profiles/no-preload-592860/apiserver.key.718cbde7
I0922 15:58:36.152061 2681906 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/19648-2476577/.minikube/profiles/no-preload-592860/proxy-client.key
I0922 15:58:36.152186 2681906 certs.go:484] found cert: /home/jenkins/minikube-integration/19648-2476577/.minikube/certs/2481953.pem (1338 bytes)
W0922 15:58:36.152220 2681906 certs.go:480] ignoring /home/jenkins/minikube-integration/19648-2476577/.minikube/certs/2481953_empty.pem, impossibly tiny 0 bytes
I0922 15:58:36.152242 2681906 certs.go:484] found cert: /home/jenkins/minikube-integration/19648-2476577/.minikube/certs/ca-key.pem (1675 bytes)
I0922 15:58:36.152270 2681906 certs.go:484] found cert: /home/jenkins/minikube-integration/19648-2476577/.minikube/certs/ca.pem (1078 bytes)
I0922 15:58:36.152294 2681906 certs.go:484] found cert: /home/jenkins/minikube-integration/19648-2476577/.minikube/certs/cert.pem (1123 bytes)
I0922 15:58:36.152320 2681906 certs.go:484] found cert: /home/jenkins/minikube-integration/19648-2476577/.minikube/certs/key.pem (1675 bytes)
I0922 15:58:36.152367 2681906 certs.go:484] found cert: /home/jenkins/minikube-integration/19648-2476577/.minikube/files/etc/ssl/certs/24819532.pem (1708 bytes)
I0922 15:58:36.152997 2681906 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19648-2476577/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0922 15:58:36.187076 2681906 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19648-2476577/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
I0922 15:58:36.218499 2681906 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19648-2476577/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0922 15:58:36.246798 2681906 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19648-2476577/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I0922 15:58:36.274111 2681906 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19648-2476577/.minikube/profiles/no-preload-592860/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1424 bytes)
I0922 15:58:36.300673 2681906 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19648-2476577/.minikube/profiles/no-preload-592860/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I0922 15:58:36.346040 2681906 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19648-2476577/.minikube/profiles/no-preload-592860/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0922 15:58:36.380821 2681906 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19648-2476577/.minikube/profiles/no-preload-592860/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
I0922 15:58:36.448045 2681906 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19648-2476577/.minikube/files/etc/ssl/certs/24819532.pem --> /usr/share/ca-certificates/24819532.pem (1708 bytes)
I0922 15:58:36.476268 2681906 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19648-2476577/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0922 15:58:36.506397 2681906 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19648-2476577/.minikube/certs/2481953.pem --> /usr/share/ca-certificates/2481953.pem (1338 bytes)
I0922 15:58:36.534455 2681906 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0922 15:58:36.553753 2681906 ssh_runner.go:195] Run: openssl version
I0922 15:58:36.561120 2681906 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/24819532.pem && ln -fs /usr/share/ca-certificates/24819532.pem /etc/ssl/certs/24819532.pem"
I0922 15:58:36.571486 2681906 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/24819532.pem
I0922 15:58:36.575040 2681906 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Sep 22 15:14 /usr/share/ca-certificates/24819532.pem
I0922 15:58:36.575116 2681906 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/24819532.pem
I0922 15:58:36.582327 2681906 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/24819532.pem /etc/ssl/certs/3ec20f2e.0"
I0922 15:58:36.591901 2681906 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0922 15:58:36.601628 2681906 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0922 15:58:36.605365 2681906 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Sep 22 14:55 /usr/share/ca-certificates/minikubeCA.pem
I0922 15:58:36.605434 2681906 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0922 15:58:36.613166 2681906 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0922 15:58:36.622744 2681906 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/2481953.pem && ln -fs /usr/share/ca-certificates/2481953.pem /etc/ssl/certs/2481953.pem"
I0922 15:58:36.632820 2681906 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/2481953.pem
I0922 15:58:36.636738 2681906 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Sep 22 15:14 /usr/share/ca-certificates/2481953.pem
I0922 15:58:36.636840 2681906 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/2481953.pem
I0922 15:58:36.644155 2681906 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/2481953.pem /etc/ssl/certs/51391683.0"
I0922 15:58:36.653095 2681906 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0922 15:58:36.656748 2681906 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-etcd-client.crt -checkend 86400
I0922 15:58:36.663866 2681906 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-kubelet-client.crt -checkend 86400
I0922 15:58:36.670791 2681906 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/server.crt -checkend 86400
I0922 15:58:36.677534 2681906 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/healthcheck-client.crt -checkend 86400
I0922 15:58:36.684167 2681906 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/peer.crt -checkend 86400
I0922 15:58:36.691158 2681906 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/front-proxy-client.crt -checkend 86400
I0922 15:58:36.698487 2681906 kubeadm.go:392] StartCluster: {Name:no-preload-592860 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726784731-19672@sha256:7f8c62ddb0100a5b958dd19c5b5478b8c7ef13da9a0a4d6c7d18f43544e0dbed Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.1 ClusterName:no-preload-592860 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APISer
verNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-h
ost Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0922 15:58:36.698596 2681906 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I0922 15:58:36.698677 2681906 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0922 15:58:36.758214 2681906 cri.go:89] found id: ""
I0922 15:58:36.758289 2681906 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0922 15:58:36.774055 2681906 kubeadm.go:408] found existing configuration files, will attempt cluster restart
I0922 15:58:36.774073 2681906 kubeadm.go:593] restartPrimaryControlPlane start ...
I0922 15:58:36.774129 2681906 ssh_runner.go:195] Run: sudo test -d /data/minikube
I0922 15:58:36.790757 2681906 kubeadm.go:130] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1
stdout:
stderr:
I0922 15:58:36.791350 2681906 kubeconfig.go:47] verify endpoint returned: get endpoint: "no-preload-592860" does not appear in /home/jenkins/minikube-integration/19648-2476577/kubeconfig
I0922 15:58:36.791609 2681906 kubeconfig.go:62] /home/jenkins/minikube-integration/19648-2476577/kubeconfig needs updating (will repair): [kubeconfig missing "no-preload-592860" cluster setting kubeconfig missing "no-preload-592860" context setting]
I0922 15:58:36.792110 2681906 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19648-2476577/kubeconfig: {Name:mk86102d2663511afa0f6941c90df65de1224212 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0922 15:58:36.793443 2681906 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new
I0922 15:58:36.804873 2681906 kubeadm.go:630] The running cluster does not require reconfiguration: 192.168.85.2
I0922 15:58:36.804946 2681906 kubeadm.go:597] duration metric: took 30.867075ms to restartPrimaryControlPlane
I0922 15:58:36.804985 2681906 kubeadm.go:394] duration metric: took 106.505727ms to StartCluster
I0922 15:58:36.805019 2681906 settings.go:142] acquiring lock: {Name:mk2cf6e4d3f37a4f62280a8a9356d931b86b236f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0922 15:58:36.805103 2681906 settings.go:150] Updating kubeconfig: /home/jenkins/minikube-integration/19648-2476577/kubeconfig
I0922 15:58:36.806026 2681906 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19648-2476577/kubeconfig: {Name:mk86102d2663511afa0f6941c90df65de1224212 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0922 15:58:36.806294 2681906 start.go:235] Will wait 6m0s for node &{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:crio ControlPlane:true Worker:true}
I0922 15:58:36.806559 2681906 config.go:182] Loaded profile config "no-preload-592860": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.31.1
I0922 15:58:36.806461 2681906 addons.go:507] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:true default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false]
I0922 15:58:36.806844 2681906 addons.go:69] Setting storage-provisioner=true in profile "no-preload-592860"
I0922 15:58:36.806859 2681906 addons.go:234] Setting addon storage-provisioner=true in "no-preload-592860"
W0922 15:58:36.806865 2681906 addons.go:243] addon storage-provisioner should already be in state true
I0922 15:58:36.806888 2681906 host.go:66] Checking if "no-preload-592860" exists ...
I0922 15:58:36.807419 2681906 cli_runner.go:164] Run: docker container inspect no-preload-592860 --format={{.State.Status}}
I0922 15:58:36.807637 2681906 addons.go:69] Setting default-storageclass=true in profile "no-preload-592860"
I0922 15:58:36.807672 2681906 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "no-preload-592860"
I0922 15:58:36.807987 2681906 cli_runner.go:164] Run: docker container inspect no-preload-592860 --format={{.State.Status}}
I0922 15:58:36.808605 2681906 addons.go:69] Setting dashboard=true in profile "no-preload-592860"
I0922 15:58:36.808626 2681906 addons.go:234] Setting addon dashboard=true in "no-preload-592860"
W0922 15:58:36.808633 2681906 addons.go:243] addon dashboard should already be in state true
I0922 15:58:36.808661 2681906 host.go:66] Checking if "no-preload-592860" exists ...
I0922 15:58:36.809082 2681906 cli_runner.go:164] Run: docker container inspect no-preload-592860 --format={{.State.Status}}
I0922 15:58:36.812173 2681906 out.go:177] * Verifying Kubernetes components...
I0922 15:58:36.812278 2681906 addons.go:69] Setting metrics-server=true in profile "no-preload-592860"
I0922 15:58:36.812298 2681906 addons.go:234] Setting addon metrics-server=true in "no-preload-592860"
W0922 15:58:36.812305 2681906 addons.go:243] addon metrics-server should already be in state true
I0922 15:58:36.812339 2681906 host.go:66] Checking if "no-preload-592860" exists ...
I0922 15:58:36.812802 2681906 cli_runner.go:164] Run: docker container inspect no-preload-592860 --format={{.State.Status}}
I0922 15:58:36.816154 2681906 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0922 15:58:36.866265 2681906 addons.go:234] Setting addon default-storageclass=true in "no-preload-592860"
W0922 15:58:36.866288 2681906 addons.go:243] addon default-storageclass should already be in state true
I0922 15:58:36.866671 2681906 host.go:66] Checking if "no-preload-592860" exists ...
I0922 15:58:36.867168 2681906 cli_runner.go:164] Run: docker container inspect no-preload-592860 --format={{.State.Status}}
I0922 15:58:36.880743 2681906 out.go:177] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
I0922 15:58:36.884205 2681906 out.go:177] - Using image registry.k8s.io/echoserver:1.4
I0922 15:58:36.884412 2681906 addons.go:431] installing /etc/kubernetes/addons/storage-provisioner.yaml
I0922 15:58:36.884425 2681906 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I0922 15:58:36.884487 2681906 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-592860
I0922 15:58:36.890702 2681906 out.go:177] - Using image fake.domain/registry.k8s.io/echoserver:1.4
I0922 15:58:36.890823 2681906 out.go:177] - Using image docker.io/kubernetesui/dashboard:v2.7.0
I0922 15:58:36.894427 2681906 addons.go:431] installing /etc/kubernetes/addons/dashboard-ns.yaml
I0922 15:58:36.894453 2681906 ssh_runner.go:362] scp dashboard/dashboard-ns.yaml --> /etc/kubernetes/addons/dashboard-ns.yaml (759 bytes)
I0922 15:58:36.894522 2681906 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-592860
I0922 15:58:36.894663 2681906 addons.go:431] installing /etc/kubernetes/addons/metrics-apiservice.yaml
I0922 15:58:36.894672 2681906 ssh_runner.go:362] scp metrics-server/metrics-apiservice.yaml --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)
I0922 15:58:36.894706 2681906 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-592860
I0922 15:58:36.961790 2681906 addons.go:431] installing /etc/kubernetes/addons/storageclass.yaml
I0922 15:58:36.961811 2681906 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I0922 15:58:36.961882 2681906 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-592860
I0922 15:58:36.963713 2681906 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:36355 SSHKeyPath:/home/jenkins/minikube-integration/19648-2476577/.minikube/machines/no-preload-592860/id_rsa Username:docker}
I0922 15:58:36.985354 2681906 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:36355 SSHKeyPath:/home/jenkins/minikube-integration/19648-2476577/.minikube/machines/no-preload-592860/id_rsa Username:docker}
I0922 15:58:36.999341 2681906 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:36355 SSHKeyPath:/home/jenkins/minikube-integration/19648-2476577/.minikube/machines/no-preload-592860/id_rsa Username:docker}
I0922 15:58:37.009765 2681906 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:36355 SSHKeyPath:/home/jenkins/minikube-integration/19648-2476577/.minikube/machines/no-preload-592860/id_rsa Username:docker}
I0922 15:58:37.183974 2681906 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0922 15:58:37.234523 2681906 node_ready.go:35] waiting up to 6m0s for node "no-preload-592860" to be "Ready" ...
I0922 15:58:37.251880 2681906 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I0922 15:58:37.321924 2681906 addons.go:431] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
I0922 15:58:37.321958 2681906 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1825 bytes)
I0922 15:58:37.331533 2681906 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
I0922 15:58:37.365858 2681906 addons.go:431] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
I0922 15:58:37.365885 2681906 ssh_runner.go:362] scp metrics-server/metrics-server-rbac.yaml --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)
I0922 15:58:37.376255 2681906 addons.go:431] installing /etc/kubernetes/addons/dashboard-clusterrole.yaml
I0922 15:58:37.376335 2681906 ssh_runner.go:362] scp dashboard/dashboard-clusterrole.yaml --> /etc/kubernetes/addons/dashboard-clusterrole.yaml (1001 bytes)
I0922 15:58:37.441551 2681906 addons.go:431] installing /etc/kubernetes/addons/metrics-server-service.yaml
I0922 15:58:37.441626 2681906 ssh_runner.go:362] scp metrics-server/metrics-server-service.yaml --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)
I0922 15:58:37.471392 2681906 addons.go:431] installing /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml
I0922 15:58:37.471466 2681906 ssh_runner.go:362] scp dashboard/dashboard-clusterrolebinding.yaml --> /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml (1018 bytes)
I0922 15:58:37.516851 2681906 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W0922 15:58:37.519909 2681906 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
error: error validating "/etc/kubernetes/addons/storage-provisioner.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": dial tcp [::1]:8443: connect: connection refused; if you choose to ignore these errors, turn validation off with --validate=false
I0922 15:58:37.519991 2681906 retry.go:31] will retry after 206.183493ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
error: error validating "/etc/kubernetes/addons/storage-provisioner.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": dial tcp [::1]:8443: connect: connection refused; if you choose to ignore these errors, turn validation off with --validate=false
I0922 15:58:37.541028 2681906 addons.go:431] installing /etc/kubernetes/addons/dashboard-configmap.yaml
I0922 15:58:37.541104 2681906 ssh_runner.go:362] scp dashboard/dashboard-configmap.yaml --> /etc/kubernetes/addons/dashboard-configmap.yaml (837 bytes)
W0922 15:58:37.587297 2681906 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
error: error validating "/etc/kubernetes/addons/storageclass.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": dial tcp [::1]:8443: connect: connection refused; if you choose to ignore these errors, turn validation off with --validate=false
I0922 15:58:37.587380 2681906 retry.go:31] will retry after 330.154939ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
error: error validating "/etc/kubernetes/addons/storageclass.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": dial tcp [::1]:8443: connect: connection refused; if you choose to ignore these errors, turn validation off with --validate=false
I0922 15:58:37.597132 2681906 addons.go:431] installing /etc/kubernetes/addons/dashboard-dp.yaml
I0922 15:58:37.597204 2681906 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-dp.yaml (4201 bytes)
I0922 15:58:37.661673 2681906 addons.go:431] installing /etc/kubernetes/addons/dashboard-role.yaml
I0922 15:58:37.661749 2681906 ssh_runner.go:362] scp dashboard/dashboard-role.yaml --> /etc/kubernetes/addons/dashboard-role.yaml (1724 bytes)
W0922 15:58:37.665920 2681906 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
error validating "/etc/kubernetes/addons/metrics-apiservice.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": dial tcp [::1]:8443: connect: connection refused; if you choose to ignore these errors, turn validation off with --validate=false
error validating "/etc/kubernetes/addons/metrics-server-deployment.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": dial tcp [::1]:8443: connect: connection refused; if you choose to ignore these errors, turn validation off with --validate=false
error validating "/etc/kubernetes/addons/metrics-server-rbac.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": dial tcp [::1]:8443: connect: connection refused; if you choose to ignore these errors, turn validation off with --validate=false
error validating "/etc/kubernetes/addons/metrics-server-service.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": dial tcp [::1]:8443: connect: connection refused; if you choose to ignore these errors, turn validation off with --validate=false
I0922 15:58:37.666004 2681906 retry.go:31] will retry after 219.709418ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
error validating "/etc/kubernetes/addons/metrics-apiservice.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": dial tcp [::1]:8443: connect: connection refused; if you choose to ignore these errors, turn validation off with --validate=false
error validating "/etc/kubernetes/addons/metrics-server-deployment.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": dial tcp [::1]:8443: connect: connection refused; if you choose to ignore these errors, turn validation off with --validate=false
error validating "/etc/kubernetes/addons/metrics-server-rbac.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": dial tcp [::1]:8443: connect: connection refused; if you choose to ignore these errors, turn validation off with --validate=false
error validating "/etc/kubernetes/addons/metrics-server-service.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": dial tcp [::1]:8443: connect: connection refused; if you choose to ignore these errors, turn validation off with --validate=false
I0922 15:58:37.685294 2681906 addons.go:431] installing /etc/kubernetes/addons/dashboard-rolebinding.yaml
I0922 15:58:37.685379 2681906 ssh_runner.go:362] scp dashboard/dashboard-rolebinding.yaml --> /etc/kubernetes/addons/dashboard-rolebinding.yaml (1046 bytes)
I0922 15:58:37.710551 2681906 addons.go:431] installing /etc/kubernetes/addons/dashboard-sa.yaml
I0922 15:58:37.710634 2681906 ssh_runner.go:362] scp dashboard/dashboard-sa.yaml --> /etc/kubernetes/addons/dashboard-sa.yaml (837 bytes)
I0922 15:58:37.727084 2681906 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
I0922 15:58:37.753795 2681906 addons.go:431] installing /etc/kubernetes/addons/dashboard-secret.yaml
I0922 15:58:37.753818 2681906 ssh_runner.go:362] scp dashboard/dashboard-secret.yaml --> /etc/kubernetes/addons/dashboard-secret.yaml (1389 bytes)
I0922 15:58:37.831654 2681906 addons.go:431] installing /etc/kubernetes/addons/dashboard-svc.yaml
I0922 15:58:37.831677 2681906 ssh_runner.go:362] scp dashboard/dashboard-svc.yaml --> /etc/kubernetes/addons/dashboard-svc.yaml (1294 bytes)
I0922 15:58:37.856831 2681906 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
I0922 15:58:37.886079 2681906 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0922 15:58:37.918630 2681906 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
I0922 15:58:34.940465 2677774 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-516480" in "kube-system" namespace has status "Ready":"False"
I0922 15:58:36.948246 2677774 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-516480" in "kube-system" namespace has status "Ready":"False"
I0922 15:58:42.361243 2681906 node_ready.go:49] node "no-preload-592860" has status "Ready":"True"
I0922 15:58:42.361267 2681906 node_ready.go:38] duration metric: took 5.126692461s for node "no-preload-592860" to be "Ready" ...
I0922 15:58:42.361278 2681906 pod_ready.go:36] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0922 15:58:42.450424 2681906 pod_ready.go:79] waiting up to 6m0s for pod "coredns-7c65d6cfc9-c9vlc" in "kube-system" namespace to be "Ready" ...
I0922 15:58:42.683273 2681906 pod_ready.go:93] pod "coredns-7c65d6cfc9-c9vlc" in "kube-system" namespace has status "Ready":"True"
I0922 15:58:42.683356 2681906 pod_ready.go:82] duration metric: took 232.842703ms for pod "coredns-7c65d6cfc9-c9vlc" in "kube-system" namespace to be "Ready" ...
I0922 15:58:42.683384 2681906 pod_ready.go:79] waiting up to 6m0s for pod "etcd-no-preload-592860" in "kube-system" namespace to be "Ready" ...
I0922 15:58:39.439614 2677774 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-516480" in "kube-system" namespace has status "Ready":"False"
I0922 15:58:41.937763 2677774 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-516480" in "kube-system" namespace has status "Ready":"False"
I0922 15:58:44.143537 2681906 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: (6.416355004s)
I0922 15:58:44.645238 2681906 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: (6.788365134s)
I0922 15:58:44.645381 2681906 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (6.759259774s)
I0922 15:58:44.645403 2681906 addons.go:475] Verifying addon metrics-server=true in "no-preload-592860"
I0922 15:58:44.645474 2681906 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: (6.726772281s)
I0922 15:58:44.648490 2681906 out.go:177] * Some dashboard features require the metrics-server addon. To enable all features please run:
minikube -p no-preload-592860 addons enable metrics-server
I0922 15:58:44.665968 2681906 out.go:177] * Enabled addons: storage-provisioner, metrics-server, dashboard, default-storageclass
I0922 15:58:44.668871 2681906 addons.go:510] duration metric: took 7.862403999s for enable addons: enabled=[storage-provisioner metrics-server dashboard default-storageclass]
I0922 15:58:44.696928 2681906 pod_ready.go:103] pod "etcd-no-preload-592860" in "kube-system" namespace has status "Ready":"False"
I0922 15:58:47.190338 2681906 pod_ready.go:103] pod "etcd-no-preload-592860" in "kube-system" namespace has status "Ready":"False"
I0922 15:58:43.938446 2677774 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-516480" in "kube-system" namespace has status "Ready":"False"
I0922 15:58:46.437852 2677774 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-516480" in "kube-system" namespace has status "Ready":"False"
I0922 15:58:49.200425 2681906 pod_ready.go:103] pod "etcd-no-preload-592860" in "kube-system" namespace has status "Ready":"False"
I0922 15:58:51.702990 2681906 pod_ready.go:103] pod "etcd-no-preload-592860" in "kube-system" namespace has status "Ready":"False"
I0922 15:58:48.938531 2677774 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-516480" in "kube-system" namespace has status "Ready":"False"
I0922 15:58:51.439372 2677774 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-516480" in "kube-system" namespace has status "Ready":"False"
I0922 15:58:54.208420 2681906 pod_ready.go:103] pod "etcd-no-preload-592860" in "kube-system" namespace has status "Ready":"False"
I0922 15:58:55.193369 2681906 pod_ready.go:93] pod "etcd-no-preload-592860" in "kube-system" namespace has status "Ready":"True"
I0922 15:58:55.193396 2681906 pod_ready.go:82] duration metric: took 12.509989678s for pod "etcd-no-preload-592860" in "kube-system" namespace to be "Ready" ...
I0922 15:58:55.193412 2681906 pod_ready.go:79] waiting up to 6m0s for pod "kube-apiserver-no-preload-592860" in "kube-system" namespace to be "Ready" ...
I0922 15:58:55.206869 2681906 pod_ready.go:93] pod "kube-apiserver-no-preload-592860" in "kube-system" namespace has status "Ready":"True"
I0922 15:58:55.206896 2681906 pod_ready.go:82] duration metric: took 13.47591ms for pod "kube-apiserver-no-preload-592860" in "kube-system" namespace to be "Ready" ...
I0922 15:58:55.206910 2681906 pod_ready.go:79] waiting up to 6m0s for pod "kube-controller-manager-no-preload-592860" in "kube-system" namespace to be "Ready" ...
I0922 15:58:55.233803 2681906 pod_ready.go:93] pod "kube-controller-manager-no-preload-592860" in "kube-system" namespace has status "Ready":"True"
I0922 15:58:55.233830 2681906 pod_ready.go:82] duration metric: took 26.911287ms for pod "kube-controller-manager-no-preload-592860" in "kube-system" namespace to be "Ready" ...
I0922 15:58:55.233843 2681906 pod_ready.go:79] waiting up to 6m0s for pod "kube-proxy-nnd5t" in "kube-system" namespace to be "Ready" ...
I0922 15:58:55.255781 2681906 pod_ready.go:93] pod "kube-proxy-nnd5t" in "kube-system" namespace has status "Ready":"True"
I0922 15:58:55.255849 2681906 pod_ready.go:82] duration metric: took 21.997105ms for pod "kube-proxy-nnd5t" in "kube-system" namespace to be "Ready" ...
I0922 15:58:55.255877 2681906 pod_ready.go:79] waiting up to 6m0s for pod "kube-scheduler-no-preload-592860" in "kube-system" namespace to be "Ready" ...
I0922 15:58:55.272252 2681906 pod_ready.go:93] pod "kube-scheduler-no-preload-592860" in "kube-system" namespace has status "Ready":"True"
I0922 15:58:55.272321 2681906 pod_ready.go:82] duration metric: took 16.421145ms for pod "kube-scheduler-no-preload-592860" in "kube-system" namespace to be "Ready" ...
I0922 15:58:55.272349 2681906 pod_ready.go:79] waiting up to 6m0s for pod "metrics-server-6867b74b74-6ttcv" in "kube-system" namespace to be "Ready" ...
I0922 15:58:57.279899 2681906 pod_ready.go:103] pod "metrics-server-6867b74b74-6ttcv" in "kube-system" namespace has status "Ready":"False"
I0922 15:58:53.939266 2677774 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-516480" in "kube-system" namespace has status "Ready":"False"
I0922 15:58:55.939438 2677774 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-516480" in "kube-system" namespace has status "Ready":"False"
I0922 15:58:58.437752 2677774 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-516480" in "kube-system" namespace has status "Ready":"False"
I0922 15:58:59.778100 2681906 pod_ready.go:103] pod "metrics-server-6867b74b74-6ttcv" in "kube-system" namespace has status "Ready":"False"
I0922 15:59:01.778658 2681906 pod_ready.go:103] pod "metrics-server-6867b74b74-6ttcv" in "kube-system" namespace has status "Ready":"False"
I0922 15:59:03.778741 2681906 pod_ready.go:103] pod "metrics-server-6867b74b74-6ttcv" in "kube-system" namespace has status "Ready":"False"
I0922 15:59:00.437821 2677774 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-516480" in "kube-system" namespace has status "Ready":"False"
I0922 15:59:02.937129 2677774 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-516480" in "kube-system" namespace has status "Ready":"False"
I0922 15:59:05.779083 2681906 pod_ready.go:103] pod "metrics-server-6867b74b74-6ttcv" in "kube-system" namespace has status "Ready":"False"
I0922 15:59:08.284346 2681906 pod_ready.go:103] pod "metrics-server-6867b74b74-6ttcv" in "kube-system" namespace has status "Ready":"False"
I0922 15:59:05.437527 2677774 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-516480" in "kube-system" namespace has status "Ready":"False"
I0922 15:59:07.464476 2677774 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-516480" in "kube-system" namespace has status "Ready":"False"
I0922 15:59:10.779147 2681906 pod_ready.go:103] pod "metrics-server-6867b74b74-6ttcv" in "kube-system" namespace has status "Ready":"False"
I0922 15:59:13.279102 2681906 pod_ready.go:103] pod "metrics-server-6867b74b74-6ttcv" in "kube-system" namespace has status "Ready":"False"
I0922 15:59:09.937037 2677774 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-516480" in "kube-system" namespace has status "Ready":"False"
I0922 15:59:11.937740 2677774 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-516480" in "kube-system" namespace has status "Ready":"False"
I0922 15:59:15.778852 2681906 pod_ready.go:103] pod "metrics-server-6867b74b74-6ttcv" in "kube-system" namespace has status "Ready":"False"
I0922 15:59:18.278897 2681906 pod_ready.go:103] pod "metrics-server-6867b74b74-6ttcv" in "kube-system" namespace has status "Ready":"False"
I0922 15:59:13.938595 2677774 pod_ready.go:93] pod "kube-controller-manager-old-k8s-version-516480" in "kube-system" namespace has status "Ready":"True"
I0922 15:59:13.938624 2677774 pod_ready.go:82] duration metric: took 1m25.507817208s for pod "kube-controller-manager-old-k8s-version-516480" in "kube-system" namespace to be "Ready" ...
I0922 15:59:13.938637 2677774 pod_ready.go:79] waiting up to 6m0s for pod "kube-proxy-2nbfq" in "kube-system" namespace to be "Ready" ...
I0922 15:59:13.944642 2677774 pod_ready.go:93] pod "kube-proxy-2nbfq" in "kube-system" namespace has status "Ready":"True"
I0922 15:59:13.944670 2677774 pod_ready.go:82] duration metric: took 6.02509ms for pod "kube-proxy-2nbfq" in "kube-system" namespace to be "Ready" ...
I0922 15:59:13.944682 2677774 pod_ready.go:79] waiting up to 6m0s for pod "kube-scheduler-old-k8s-version-516480" in "kube-system" namespace to be "Ready" ...
I0922 15:59:13.953228 2677774 pod_ready.go:93] pod "kube-scheduler-old-k8s-version-516480" in "kube-system" namespace has status "Ready":"True"
I0922 15:59:13.953253 2677774 pod_ready.go:82] duration metric: took 8.561579ms for pod "kube-scheduler-old-k8s-version-516480" in "kube-system" namespace to be "Ready" ...
I0922 15:59:13.953265 2677774 pod_ready.go:79] waiting up to 6m0s for pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace to be "Ready" ...
I0922 15:59:15.960230 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 15:59:18.460104 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 15:59:20.279186 2681906 pod_ready.go:103] pod "metrics-server-6867b74b74-6ttcv" in "kube-system" namespace has status "Ready":"False"
I0922 15:59:22.777875 2681906 pod_ready.go:103] pod "metrics-server-6867b74b74-6ttcv" in "kube-system" namespace has status "Ready":"False"
I0922 15:59:20.460277 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 15:59:22.460466 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 15:59:24.777996 2681906 pod_ready.go:103] pod "metrics-server-6867b74b74-6ttcv" in "kube-system" namespace has status "Ready":"False"
I0922 15:59:26.778454 2681906 pod_ready.go:103] pod "metrics-server-6867b74b74-6ttcv" in "kube-system" namespace has status "Ready":"False"
I0922 15:59:28.778973 2681906 pod_ready.go:103] pod "metrics-server-6867b74b74-6ttcv" in "kube-system" namespace has status "Ready":"False"
I0922 15:59:24.959031 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 15:59:26.959456 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 15:59:30.779008 2681906 pod_ready.go:103] pod "metrics-server-6867b74b74-6ttcv" in "kube-system" namespace has status "Ready":"False"
I0922 15:59:33.278746 2681906 pod_ready.go:103] pod "metrics-server-6867b74b74-6ttcv" in "kube-system" namespace has status "Ready":"False"
I0922 15:59:29.459883 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 15:59:31.960050 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 15:59:35.779912 2681906 pod_ready.go:103] pod "metrics-server-6867b74b74-6ttcv" in "kube-system" namespace has status "Ready":"False"
I0922 15:59:38.279437 2681906 pod_ready.go:103] pod "metrics-server-6867b74b74-6ttcv" in "kube-system" namespace has status "Ready":"False"
I0922 15:59:34.458815 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 15:59:36.469951 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 15:59:40.779157 2681906 pod_ready.go:103] pod "metrics-server-6867b74b74-6ttcv" in "kube-system" namespace has status "Ready":"False"
I0922 15:59:43.278829 2681906 pod_ready.go:103] pod "metrics-server-6867b74b74-6ttcv" in "kube-system" namespace has status "Ready":"False"
I0922 15:59:38.959364 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 15:59:40.969661 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 15:59:43.459797 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 15:59:45.280209 2681906 pod_ready.go:103] pod "metrics-server-6867b74b74-6ttcv" in "kube-system" namespace has status "Ready":"False"
I0922 15:59:47.777726 2681906 pod_ready.go:103] pod "metrics-server-6867b74b74-6ttcv" in "kube-system" namespace has status "Ready":"False"
I0922 15:59:45.464875 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 15:59:47.969799 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 15:59:49.778784 2681906 pod_ready.go:103] pod "metrics-server-6867b74b74-6ttcv" in "kube-system" namespace has status "Ready":"False"
I0922 15:59:51.779001 2681906 pod_ready.go:103] pod "metrics-server-6867b74b74-6ttcv" in "kube-system" namespace has status "Ready":"False"
I0922 15:59:53.779580 2681906 pod_ready.go:103] pod "metrics-server-6867b74b74-6ttcv" in "kube-system" namespace has status "Ready":"False"
I0922 15:59:50.459552 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 15:59:52.459968 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 15:59:56.278730 2681906 pod_ready.go:103] pod "metrics-server-6867b74b74-6ttcv" in "kube-system" namespace has status "Ready":"False"
I0922 15:59:58.779042 2681906 pod_ready.go:103] pod "metrics-server-6867b74b74-6ttcv" in "kube-system" namespace has status "Ready":"False"
I0922 15:59:54.960206 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 15:59:57.459912 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:00:00.780357 2681906 pod_ready.go:103] pod "metrics-server-6867b74b74-6ttcv" in "kube-system" namespace has status "Ready":"False"
I0922 16:00:03.279280 2681906 pod_ready.go:103] pod "metrics-server-6867b74b74-6ttcv" in "kube-system" namespace has status "Ready":"False"
I0922 15:59:59.959895 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:00:01.960493 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:00:05.279517 2681906 pod_ready.go:103] pod "metrics-server-6867b74b74-6ttcv" in "kube-system" namespace has status "Ready":"False"
I0922 16:00:07.779092 2681906 pod_ready.go:103] pod "metrics-server-6867b74b74-6ttcv" in "kube-system" namespace has status "Ready":"False"
I0922 16:00:04.459880 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:00:06.959766 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:00:10.278515 2681906 pod_ready.go:103] pod "metrics-server-6867b74b74-6ttcv" in "kube-system" namespace has status "Ready":"False"
I0922 16:00:12.278809 2681906 pod_ready.go:103] pod "metrics-server-6867b74b74-6ttcv" in "kube-system" namespace has status "Ready":"False"
I0922 16:00:08.961038 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:00:11.459004 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:00:13.459719 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:00:14.279503 2681906 pod_ready.go:103] pod "metrics-server-6867b74b74-6ttcv" in "kube-system" namespace has status "Ready":"False"
I0922 16:00:16.778574 2681906 pod_ready.go:103] pod "metrics-server-6867b74b74-6ttcv" in "kube-system" namespace has status "Ready":"False"
I0922 16:00:18.778820 2681906 pod_ready.go:103] pod "metrics-server-6867b74b74-6ttcv" in "kube-system" namespace has status "Ready":"False"
I0922 16:00:15.460118 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:00:18.044106 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:00:21.278293 2681906 pod_ready.go:103] pod "metrics-server-6867b74b74-6ttcv" in "kube-system" namespace has status "Ready":"False"
I0922 16:00:23.278668 2681906 pod_ready.go:103] pod "metrics-server-6867b74b74-6ttcv" in "kube-system" namespace has status "Ready":"False"
I0922 16:00:20.459666 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:00:22.959590 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:00:25.279298 2681906 pod_ready.go:103] pod "metrics-server-6867b74b74-6ttcv" in "kube-system" namespace has status "Ready":"False"
I0922 16:00:27.778515 2681906 pod_ready.go:103] pod "metrics-server-6867b74b74-6ttcv" in "kube-system" namespace has status "Ready":"False"
I0922 16:00:25.459784 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:00:27.960077 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:00:29.778752 2681906 pod_ready.go:103] pod "metrics-server-6867b74b74-6ttcv" in "kube-system" namespace has status "Ready":"False"
I0922 16:00:31.779462 2681906 pod_ready.go:103] pod "metrics-server-6867b74b74-6ttcv" in "kube-system" namespace has status "Ready":"False"
I0922 16:00:30.460363 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:00:32.460586 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:00:34.278632 2681906 pod_ready.go:103] pod "metrics-server-6867b74b74-6ttcv" in "kube-system" namespace has status "Ready":"False"
I0922 16:00:36.778437 2681906 pod_ready.go:103] pod "metrics-server-6867b74b74-6ttcv" in "kube-system" namespace has status "Ready":"False"
I0922 16:00:38.778732 2681906 pod_ready.go:103] pod "metrics-server-6867b74b74-6ttcv" in "kube-system" namespace has status "Ready":"False"
I0922 16:00:34.962292 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:00:37.460524 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:00:41.279033 2681906 pod_ready.go:103] pod "metrics-server-6867b74b74-6ttcv" in "kube-system" namespace has status "Ready":"False"
I0922 16:00:43.778868 2681906 pod_ready.go:103] pod "metrics-server-6867b74b74-6ttcv" in "kube-system" namespace has status "Ready":"False"
I0922 16:00:39.959069 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:00:41.959430 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:00:45.785780 2681906 pod_ready.go:103] pod "metrics-server-6867b74b74-6ttcv" in "kube-system" namespace has status "Ready":"False"
I0922 16:00:48.280242 2681906 pod_ready.go:103] pod "metrics-server-6867b74b74-6ttcv" in "kube-system" namespace has status "Ready":"False"
I0922 16:00:43.960702 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:00:46.459194 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:00:48.459230 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:00:50.779767 2681906 pod_ready.go:103] pod "metrics-server-6867b74b74-6ttcv" in "kube-system" namespace has status "Ready":"False"
I0922 16:00:53.278645 2681906 pod_ready.go:103] pod "metrics-server-6867b74b74-6ttcv" in "kube-system" namespace has status "Ready":"False"
I0922 16:00:50.958879 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:00:52.959688 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:00:55.279410 2681906 pod_ready.go:103] pod "metrics-server-6867b74b74-6ttcv" in "kube-system" namespace has status "Ready":"False"
I0922 16:00:57.778899 2681906 pod_ready.go:103] pod "metrics-server-6867b74b74-6ttcv" in "kube-system" namespace has status "Ready":"False"
I0922 16:00:54.960448 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:00:57.459853 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:01:00.279207 2681906 pod_ready.go:103] pod "metrics-server-6867b74b74-6ttcv" in "kube-system" namespace has status "Ready":"False"
I0922 16:01:02.779108 2681906 pod_ready.go:103] pod "metrics-server-6867b74b74-6ttcv" in "kube-system" namespace has status "Ready":"False"
I0922 16:00:59.463200 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:01:01.959806 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:01:05.279215 2681906 pod_ready.go:103] pod "metrics-server-6867b74b74-6ttcv" in "kube-system" namespace has status "Ready":"False"
I0922 16:01:07.780168 2681906 pod_ready.go:103] pod "metrics-server-6867b74b74-6ttcv" in "kube-system" namespace has status "Ready":"False"
I0922 16:01:04.460123 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:01:06.960245 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:01:10.278522 2681906 pod_ready.go:103] pod "metrics-server-6867b74b74-6ttcv" in "kube-system" namespace has status "Ready":"False"
I0922 16:01:12.279149 2681906 pod_ready.go:103] pod "metrics-server-6867b74b74-6ttcv" in "kube-system" namespace has status "Ready":"False"
I0922 16:01:08.960375 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:01:11.460053 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:01:14.777970 2681906 pod_ready.go:103] pod "metrics-server-6867b74b74-6ttcv" in "kube-system" namespace has status "Ready":"False"
I0922 16:01:16.778846 2681906 pod_ready.go:103] pod "metrics-server-6867b74b74-6ttcv" in "kube-system" namespace has status "Ready":"False"
I0922 16:01:13.960296 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:01:16.459359 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:01:18.459400 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:01:19.279660 2681906 pod_ready.go:103] pod "metrics-server-6867b74b74-6ttcv" in "kube-system" namespace has status "Ready":"False"
I0922 16:01:21.777765 2681906 pod_ready.go:103] pod "metrics-server-6867b74b74-6ttcv" in "kube-system" namespace has status "Ready":"False"
I0922 16:01:23.778349 2681906 pod_ready.go:103] pod "metrics-server-6867b74b74-6ttcv" in "kube-system" namespace has status "Ready":"False"
I0922 16:01:20.460251 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:01:22.960533 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:01:25.778535 2681906 pod_ready.go:103] pod "metrics-server-6867b74b74-6ttcv" in "kube-system" namespace has status "Ready":"False"
I0922 16:01:28.279073 2681906 pod_ready.go:103] pod "metrics-server-6867b74b74-6ttcv" in "kube-system" namespace has status "Ready":"False"
I0922 16:01:25.459324 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:01:27.460356 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:01:30.778693 2681906 pod_ready.go:103] pod "metrics-server-6867b74b74-6ttcv" in "kube-system" namespace has status "Ready":"False"
I0922 16:01:33.278428 2681906 pod_ready.go:103] pod "metrics-server-6867b74b74-6ttcv" in "kube-system" namespace has status "Ready":"False"
I0922 16:01:29.461256 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:01:31.959905 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:01:35.278717 2681906 pod_ready.go:103] pod "metrics-server-6867b74b74-6ttcv" in "kube-system" namespace has status "Ready":"False"
I0922 16:01:37.278864 2681906 pod_ready.go:103] pod "metrics-server-6867b74b74-6ttcv" in "kube-system" namespace has status "Ready":"False"
I0922 16:01:33.961431 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:01:36.459795 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:01:38.465145 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:01:39.280284 2681906 pod_ready.go:103] pod "metrics-server-6867b74b74-6ttcv" in "kube-system" namespace has status "Ready":"False"
I0922 16:01:41.777923 2681906 pod_ready.go:103] pod "metrics-server-6867b74b74-6ttcv" in "kube-system" namespace has status "Ready":"False"
I0922 16:01:43.778676 2681906 pod_ready.go:103] pod "metrics-server-6867b74b74-6ttcv" in "kube-system" namespace has status "Ready":"False"
I0922 16:01:40.960741 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:01:43.459968 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:01:46.279412 2681906 pod_ready.go:103] pod "metrics-server-6867b74b74-6ttcv" in "kube-system" namespace has status "Ready":"False"
I0922 16:01:48.779483 2681906 pod_ready.go:103] pod "metrics-server-6867b74b74-6ttcv" in "kube-system" namespace has status "Ready":"False"
I0922 16:01:45.960315 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:01:47.960474 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:01:51.278565 2681906 pod_ready.go:103] pod "metrics-server-6867b74b74-6ttcv" in "kube-system" namespace has status "Ready":"False"
I0922 16:01:53.778904 2681906 pod_ready.go:103] pod "metrics-server-6867b74b74-6ttcv" in "kube-system" namespace has status "Ready":"False"
I0922 16:01:49.963942 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:01:52.459754 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:01:56.279419 2681906 pod_ready.go:103] pod "metrics-server-6867b74b74-6ttcv" in "kube-system" namespace has status "Ready":"False"
I0922 16:01:58.778843 2681906 pod_ready.go:103] pod "metrics-server-6867b74b74-6ttcv" in "kube-system" namespace has status "Ready":"False"
I0922 16:01:54.460162 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:01:56.960349 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:02:00.779316 2681906 pod_ready.go:103] pod "metrics-server-6867b74b74-6ttcv" in "kube-system" namespace has status "Ready":"False"
I0922 16:02:03.279558 2681906 pod_ready.go:103] pod "metrics-server-6867b74b74-6ttcv" in "kube-system" namespace has status "Ready":"False"
I0922 16:01:58.960405 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:02:00.966739 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:02:03.460400 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:02:05.779409 2681906 pod_ready.go:103] pod "metrics-server-6867b74b74-6ttcv" in "kube-system" namespace has status "Ready":"False"
I0922 16:02:08.279444 2681906 pod_ready.go:103] pod "metrics-server-6867b74b74-6ttcv" in "kube-system" namespace has status "Ready":"False"
I0922 16:02:05.960304 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:02:08.459894 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:02:10.779071 2681906 pod_ready.go:103] pod "metrics-server-6867b74b74-6ttcv" in "kube-system" namespace has status "Ready":"False"
I0922 16:02:13.278736 2681906 pod_ready.go:103] pod "metrics-server-6867b74b74-6ttcv" in "kube-system" namespace has status "Ready":"False"
I0922 16:02:10.459962 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:02:12.460661 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:02:15.279203 2681906 pod_ready.go:103] pod "metrics-server-6867b74b74-6ttcv" in "kube-system" namespace has status "Ready":"False"
I0922 16:02:17.779973 2681906 pod_ready.go:103] pod "metrics-server-6867b74b74-6ttcv" in "kube-system" namespace has status "Ready":"False"
I0922 16:02:14.959583 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:02:17.459919 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:02:20.279045 2681906 pod_ready.go:103] pod "metrics-server-6867b74b74-6ttcv" in "kube-system" namespace has status "Ready":"False"
I0922 16:02:22.279101 2681906 pod_ready.go:103] pod "metrics-server-6867b74b74-6ttcv" in "kube-system" namespace has status "Ready":"False"
I0922 16:02:19.461309 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:02:21.959489 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:02:24.778738 2681906 pod_ready.go:103] pod "metrics-server-6867b74b74-6ttcv" in "kube-system" namespace has status "Ready":"False"
I0922 16:02:27.279296 2681906 pod_ready.go:103] pod "metrics-server-6867b74b74-6ttcv" in "kube-system" namespace has status "Ready":"False"
I0922 16:02:23.959564 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:02:26.460187 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:02:29.778275 2681906 pod_ready.go:103] pod "metrics-server-6867b74b74-6ttcv" in "kube-system" namespace has status "Ready":"False"
I0922 16:02:32.279504 2681906 pod_ready.go:103] pod "metrics-server-6867b74b74-6ttcv" in "kube-system" namespace has status "Ready":"False"
I0922 16:02:28.959361 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:02:30.959720 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:02:32.960411 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:02:34.778862 2681906 pod_ready.go:103] pod "metrics-server-6867b74b74-6ttcv" in "kube-system" namespace has status "Ready":"False"
I0922 16:02:37.278958 2681906 pod_ready.go:103] pod "metrics-server-6867b74b74-6ttcv" in "kube-system" namespace has status "Ready":"False"
I0922 16:02:35.459619 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:02:37.460403 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:02:39.279734 2681906 pod_ready.go:103] pod "metrics-server-6867b74b74-6ttcv" in "kube-system" namespace has status "Ready":"False"
I0922 16:02:41.778990 2681906 pod_ready.go:103] pod "metrics-server-6867b74b74-6ttcv" in "kube-system" namespace has status "Ready":"False"
I0922 16:02:39.960119 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:02:42.458996 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:02:44.280115 2681906 pod_ready.go:103] pod "metrics-server-6867b74b74-6ttcv" in "kube-system" namespace has status "Ready":"False"
I0922 16:02:46.778016 2681906 pod_ready.go:103] pod "metrics-server-6867b74b74-6ttcv" in "kube-system" namespace has status "Ready":"False"
I0922 16:02:48.778977 2681906 pod_ready.go:103] pod "metrics-server-6867b74b74-6ttcv" in "kube-system" namespace has status "Ready":"False"
I0922 16:02:44.460102 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:02:46.960232 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:02:51.278580 2681906 pod_ready.go:103] pod "metrics-server-6867b74b74-6ttcv" in "kube-system" namespace has status "Ready":"False"
I0922 16:02:53.780007 2681906 pod_ready.go:103] pod "metrics-server-6867b74b74-6ttcv" in "kube-system" namespace has status "Ready":"False"
I0922 16:02:49.463287 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:02:51.959943 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:02:55.278655 2681906 pod_ready.go:82] duration metric: took 4m0.006277677s for pod "metrics-server-6867b74b74-6ttcv" in "kube-system" namespace to be "Ready" ...
E0922 16:02:55.278685 2681906 pod_ready.go:67] WaitExtra: waitPodCondition: context deadline exceeded
I0922 16:02:55.278695 2681906 pod_ready.go:39] duration metric: took 4m12.91740587s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0922 16:02:55.278710 2681906 api_server.go:52] waiting for apiserver process to appear ...
I0922 16:02:55.278739 2681906 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I0922 16:02:55.278801 2681906 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0922 16:02:55.320881 2681906 cri.go:89] found id: "f13df5fde0297e4f1e20802c1ce093b57b7d7fa723f8544509bb91f9880faaa0"
I0922 16:02:55.320903 2681906 cri.go:89] found id: ""
I0922 16:02:55.320913 2681906 logs.go:276] 1 containers: [f13df5fde0297e4f1e20802c1ce093b57b7d7fa723f8544509bb91f9880faaa0]
I0922 16:02:55.320969 2681906 ssh_runner.go:195] Run: which crictl
I0922 16:02:55.324801 2681906 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I0922 16:02:55.324874 2681906 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0922 16:02:55.362955 2681906 cri.go:89] found id: "fbeebb3a9101973a106be48fe12ae869c032d65b92aef86cf6339ece84fff8d9"
I0922 16:02:55.362977 2681906 cri.go:89] found id: ""
I0922 16:02:55.362985 2681906 logs.go:276] 1 containers: [fbeebb3a9101973a106be48fe12ae869c032d65b92aef86cf6339ece84fff8d9]
I0922 16:02:55.363046 2681906 ssh_runner.go:195] Run: which crictl
I0922 16:02:55.366633 2681906 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I0922 16:02:55.366711 2681906 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0922 16:02:55.407117 2681906 cri.go:89] found id: "6562f7c7de3f3d9c08292bc33b953e463ba9e13039bee890e9c1d2c449fbbdf2"
I0922 16:02:55.407145 2681906 cri.go:89] found id: ""
I0922 16:02:55.407154 2681906 logs.go:276] 1 containers: [6562f7c7de3f3d9c08292bc33b953e463ba9e13039bee890e9c1d2c449fbbdf2]
I0922 16:02:55.407215 2681906 ssh_runner.go:195] Run: which crictl
I0922 16:02:55.411153 2681906 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I0922 16:02:55.411233 2681906 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0922 16:02:55.451379 2681906 cri.go:89] found id: "cba3476d8734ac22f86d2179412c8fce8540d3be0fa4d476311018d37f310c1e"
I0922 16:02:55.451399 2681906 cri.go:89] found id: ""
I0922 16:02:55.451411 2681906 logs.go:276] 1 containers: [cba3476d8734ac22f86d2179412c8fce8540d3be0fa4d476311018d37f310c1e]
I0922 16:02:55.451467 2681906 ssh_runner.go:195] Run: which crictl
I0922 16:02:55.458070 2681906 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I0922 16:02:55.458141 2681906 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0922 16:02:55.496445 2681906 cri.go:89] found id: "5f8a7c270f6b2b2c471fa8edebcc45a1c228d473c4fabcbcbb25d0b9441757d8"
I0922 16:02:55.496468 2681906 cri.go:89] found id: ""
I0922 16:02:55.496477 2681906 logs.go:276] 1 containers: [5f8a7c270f6b2b2c471fa8edebcc45a1c228d473c4fabcbcbb25d0b9441757d8]
I0922 16:02:55.496553 2681906 ssh_runner.go:195] Run: which crictl
I0922 16:02:55.500421 2681906 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I0922 16:02:55.500494 2681906 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0922 16:02:55.542576 2681906 cri.go:89] found id: "635997381cc62183373066ee36ee89df2b9c9a2c0f5cb6f2ae9c88d351413fae"
I0922 16:02:55.542644 2681906 cri.go:89] found id: ""
I0922 16:02:55.542667 2681906 logs.go:276] 1 containers: [635997381cc62183373066ee36ee89df2b9c9a2c0f5cb6f2ae9c88d351413fae]
I0922 16:02:55.542758 2681906 ssh_runner.go:195] Run: which crictl
I0922 16:02:55.546377 2681906 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I0922 16:02:55.546498 2681906 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0922 16:02:55.581982 2681906 cri.go:89] found id: "3bd7e760873ba293057f368b9467f70adede6a407492e559b8f4d337e1a7d1c1"
I0922 16:02:55.582004 2681906 cri.go:89] found id: ""
I0922 16:02:55.582013 2681906 logs.go:276] 1 containers: [3bd7e760873ba293057f368b9467f70adede6a407492e559b8f4d337e1a7d1c1]
I0922 16:02:55.582069 2681906 ssh_runner.go:195] Run: which crictl
I0922 16:02:55.587201 2681906 cri.go:54] listing CRI containers in root : {State:all Name:storage-provisioner Namespaces:[]}
I0922 16:02:55.587315 2681906 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
I0922 16:02:55.651464 2681906 cri.go:89] found id: "dff19d72968123299c8e421e21d2e6d06810fd0987111d30b7752d10aef52d7b"
I0922 16:02:55.651526 2681906 cri.go:89] found id: "c9649fe03112847528d915220d1d09db1d4eb743be95e5b881e3203089779681"
I0922 16:02:55.651545 2681906 cri.go:89] found id: ""
I0922 16:02:55.651570 2681906 logs.go:276] 2 containers: [dff19d72968123299c8e421e21d2e6d06810fd0987111d30b7752d10aef52d7b c9649fe03112847528d915220d1d09db1d4eb743be95e5b881e3203089779681]
I0922 16:02:55.651638 2681906 ssh_runner.go:195] Run: which crictl
I0922 16:02:55.655113 2681906 ssh_runner.go:195] Run: which crictl
I0922 16:02:55.658539 2681906 cri.go:54] listing CRI containers in root : {State:all Name:kubernetes-dashboard Namespaces:[]}
I0922 16:02:55.658656 2681906 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
I0922 16:02:55.696592 2681906 cri.go:89] found id: "ba4a19226ec88f010f3223c02bcb1fbb25ab2ceabc15b808701fc4185ac6e9a3"
I0922 16:02:55.696616 2681906 cri.go:89] found id: ""
I0922 16:02:55.696624 2681906 logs.go:276] 1 containers: [ba4a19226ec88f010f3223c02bcb1fbb25ab2ceabc15b808701fc4185ac6e9a3]
I0922 16:02:55.696680 2681906 ssh_runner.go:195] Run: which crictl
I0922 16:02:55.700428 2681906 logs.go:123] Gathering logs for kubelet ...
I0922 16:02:55.700455 2681906 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
W0922 16:02:55.743207 2681906 logs.go:138] Found kubelet problem: Sep 22 15:58:42 no-preload-592860 kubelet[744]: W0922 15:58:42.333243 744 reflector.go:561] object-"kube-system"/"coredns": failed to list *v1.ConfigMap: configmaps "coredns" is forbidden: User "system:node:no-preload-592860" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'no-preload-592860' and this object
W0922 16:02:55.743450 2681906 logs.go:138] Found kubelet problem: Sep 22 15:58:42 no-preload-592860 kubelet[744]: E0922 15:58:42.333306 744 reflector.go:158] "Unhandled Error" err="object-\"kube-system\"/\"coredns\": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps \"coredns\" is forbidden: User \"system:node:no-preload-592860\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"kube-system\": no relationship found between node 'no-preload-592860' and this object" logger="UnhandledError"
W0922 16:02:55.743646 2681906 logs.go:138] Found kubelet problem: Sep 22 15:58:42 no-preload-592860 kubelet[744]: W0922 15:58:42.334611 744 reflector.go:561] object-"default"/"kube-root-ca.crt": failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:no-preload-592860" cannot list resource "configmaps" in API group "" in the namespace "default": no relationship found between node 'no-preload-592860' and this object
W0922 16:02:55.743877 2681906 logs.go:138] Found kubelet problem: Sep 22 15:58:42 no-preload-592860 kubelet[744]: E0922 15:58:42.334646 744 reflector.go:158] "Unhandled Error" err="object-\"default\"/\"kube-root-ca.crt\": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:no-preload-592860\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"default\": no relationship found between node 'no-preload-592860' and this object" logger="UnhandledError"
W0922 16:02:55.744066 2681906 logs.go:138] Found kubelet problem: Sep 22 15:58:42 no-preload-592860 kubelet[744]: W0922 15:58:42.335086 744 reflector.go:561] object-"kube-system"/"kube-root-ca.crt": failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:no-preload-592860" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'no-preload-592860' and this object
W0922 16:02:55.744297 2681906 logs.go:138] Found kubelet problem: Sep 22 15:58:42 no-preload-592860 kubelet[744]: E0922 15:58:42.335118 744 reflector.go:158] "Unhandled Error" err="object-\"kube-system\"/\"kube-root-ca.crt\": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:no-preload-592860\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"kube-system\": no relationship found between node 'no-preload-592860' and this object" logger="UnhandledError"
W0922 16:02:55.744475 2681906 logs.go:138] Found kubelet problem: Sep 22 15:58:42 no-preload-592860 kubelet[744]: W0922 15:58:42.335403 744 reflector.go:561] object-"kube-system"/"kube-proxy": failed to list *v1.ConfigMap: configmaps "kube-proxy" is forbidden: User "system:node:no-preload-592860" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'no-preload-592860' and this object
W0922 16:02:55.744693 2681906 logs.go:138] Found kubelet problem: Sep 22 15:58:42 no-preload-592860 kubelet[744]: E0922 15:58:42.335430 744 reflector.go:158] "Unhandled Error" err="object-\"kube-system\"/\"kube-proxy\": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps \"kube-proxy\" is forbidden: User \"system:node:no-preload-592860\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"kube-system\": no relationship found between node 'no-preload-592860' and this object" logger="UnhandledError"
I0922 16:02:55.792547 2681906 logs.go:123] Gathering logs for describe nodes ...
I0922 16:02:55.792582 2681906 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.31.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0922 16:02:55.941415 2681906 logs.go:123] Gathering logs for kube-scheduler [cba3476d8734ac22f86d2179412c8fce8540d3be0fa4d476311018d37f310c1e] ...
I0922 16:02:55.941446 2681906 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 cba3476d8734ac22f86d2179412c8fce8540d3be0fa4d476311018d37f310c1e"
I0922 16:02:55.992372 2681906 logs.go:123] Gathering logs for storage-provisioner [dff19d72968123299c8e421e21d2e6d06810fd0987111d30b7752d10aef52d7b] ...
I0922 16:02:55.992401 2681906 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 dff19d72968123299c8e421e21d2e6d06810fd0987111d30b7752d10aef52d7b"
I0922 16:02:56.032586 2681906 logs.go:123] Gathering logs for CRI-O ...
I0922 16:02:56.032612 2681906 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I0922 16:02:56.121210 2681906 logs.go:123] Gathering logs for container status ...
I0922 16:02:56.121253 2681906 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0922 16:02:56.172057 2681906 logs.go:123] Gathering logs for kindnet [3bd7e760873ba293057f368b9467f70adede6a407492e559b8f4d337e1a7d1c1] ...
I0922 16:02:56.172091 2681906 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 3bd7e760873ba293057f368b9467f70adede6a407492e559b8f4d337e1a7d1c1"
I0922 16:02:56.220892 2681906 logs.go:123] Gathering logs for kube-apiserver [f13df5fde0297e4f1e20802c1ce093b57b7d7fa723f8544509bb91f9880faaa0] ...
I0922 16:02:56.220921 2681906 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 f13df5fde0297e4f1e20802c1ce093b57b7d7fa723f8544509bb91f9880faaa0"
I0922 16:02:56.283436 2681906 logs.go:123] Gathering logs for etcd [fbeebb3a9101973a106be48fe12ae869c032d65b92aef86cf6339ece84fff8d9] ...
I0922 16:02:56.283469 2681906 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 fbeebb3a9101973a106be48fe12ae869c032d65b92aef86cf6339ece84fff8d9"
I0922 16:02:56.333724 2681906 logs.go:123] Gathering logs for coredns [6562f7c7de3f3d9c08292bc33b953e463ba9e13039bee890e9c1d2c449fbbdf2] ...
I0922 16:02:56.333764 2681906 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 6562f7c7de3f3d9c08292bc33b953e463ba9e13039bee890e9c1d2c449fbbdf2"
I0922 16:02:56.373332 2681906 logs.go:123] Gathering logs for kube-controller-manager [635997381cc62183373066ee36ee89df2b9c9a2c0f5cb6f2ae9c88d351413fae] ...
I0922 16:02:56.373360 2681906 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 635997381cc62183373066ee36ee89df2b9c9a2c0f5cb6f2ae9c88d351413fae"
I0922 16:02:56.439114 2681906 logs.go:123] Gathering logs for dmesg ...
I0922 16:02:56.439149 2681906 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0922 16:02:56.462174 2681906 logs.go:123] Gathering logs for kube-proxy [5f8a7c270f6b2b2c471fa8edebcc45a1c228d473c4fabcbcbb25d0b9441757d8] ...
I0922 16:02:56.462232 2681906 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 5f8a7c270f6b2b2c471fa8edebcc45a1c228d473c4fabcbcbb25d0b9441757d8"
I0922 16:02:56.506202 2681906 logs.go:123] Gathering logs for storage-provisioner [c9649fe03112847528d915220d1d09db1d4eb743be95e5b881e3203089779681] ...
I0922 16:02:56.506232 2681906 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 c9649fe03112847528d915220d1d09db1d4eb743be95e5b881e3203089779681"
I0922 16:02:56.548348 2681906 logs.go:123] Gathering logs for kubernetes-dashboard [ba4a19226ec88f010f3223c02bcb1fbb25ab2ceabc15b808701fc4185ac6e9a3] ...
I0922 16:02:56.548378 2681906 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 ba4a19226ec88f010f3223c02bcb1fbb25ab2ceabc15b808701fc4185ac6e9a3"
I0922 16:02:56.593332 2681906 out.go:358] Setting ErrFile to fd 2...
I0922 16:02:56.593359 2681906 out.go:392] TERM=,COLORTERM=, which probably does not support color
W0922 16:02:56.593420 2681906 out.go:270] X Problems detected in kubelet:
W0922 16:02:56.593432 2681906 out.go:270] Sep 22 15:58:42 no-preload-592860 kubelet[744]: E0922 15:58:42.334646 744 reflector.go:158] "Unhandled Error" err="object-\"default\"/\"kube-root-ca.crt\": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:no-preload-592860\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"default\": no relationship found between node 'no-preload-592860' and this object" logger="UnhandledError"
W0922 16:02:56.593450 2681906 out.go:270] Sep 22 15:58:42 no-preload-592860 kubelet[744]: W0922 15:58:42.335086 744 reflector.go:561] object-"kube-system"/"kube-root-ca.crt": failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:no-preload-592860" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'no-preload-592860' and this object
W0922 16:02:56.593459 2681906 out.go:270] Sep 22 15:58:42 no-preload-592860 kubelet[744]: E0922 15:58:42.335118 744 reflector.go:158] "Unhandled Error" err="object-\"kube-system\"/\"kube-root-ca.crt\": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:no-preload-592860\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"kube-system\": no relationship found between node 'no-preload-592860' and this object" logger="UnhandledError"
W0922 16:02:56.593465 2681906 out.go:270] Sep 22 15:58:42 no-preload-592860 kubelet[744]: W0922 15:58:42.335403 744 reflector.go:561] object-"kube-system"/"kube-proxy": failed to list *v1.ConfigMap: configmaps "kube-proxy" is forbidden: User "system:node:no-preload-592860" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'no-preload-592860' and this object
W0922 16:02:56.593479 2681906 out.go:270] Sep 22 15:58:42 no-preload-592860 kubelet[744]: E0922 15:58:42.335430 744 reflector.go:158] "Unhandled Error" err="object-\"kube-system\"/\"kube-proxy\": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps \"kube-proxy\" is forbidden: User \"system:node:no-preload-592860\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"kube-system\": no relationship found between node 'no-preload-592860' and this object" logger="UnhandledError"
I0922 16:02:56.593485 2681906 out.go:358] Setting ErrFile to fd 2...
I0922 16:02:56.593492 2681906 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0922 16:02:53.960343 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:02:56.460979 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:02:58.960773 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:03:01.459602 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:03:06.594864 2681906 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0922 16:03:06.607142 2681906 api_server.go:72] duration metric: took 4m29.80059553s to wait for apiserver process to appear ...
I0922 16:03:06.607167 2681906 api_server.go:88] waiting for apiserver healthz status ...
I0922 16:03:06.607204 2681906 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I0922 16:03:06.607277 2681906 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0922 16:03:06.647652 2681906 cri.go:89] found id: "f13df5fde0297e4f1e20802c1ce093b57b7d7fa723f8544509bb91f9880faaa0"
I0922 16:03:06.647674 2681906 cri.go:89] found id: ""
I0922 16:03:06.647682 2681906 logs.go:276] 1 containers: [f13df5fde0297e4f1e20802c1ce093b57b7d7fa723f8544509bb91f9880faaa0]
I0922 16:03:06.647744 2681906 ssh_runner.go:195] Run: which crictl
I0922 16:03:06.651170 2681906 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I0922 16:03:06.651241 2681906 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0922 16:03:06.686918 2681906 cri.go:89] found id: "fbeebb3a9101973a106be48fe12ae869c032d65b92aef86cf6339ece84fff8d9"
I0922 16:03:06.686964 2681906 cri.go:89] found id: ""
I0922 16:03:06.686972 2681906 logs.go:276] 1 containers: [fbeebb3a9101973a106be48fe12ae869c032d65b92aef86cf6339ece84fff8d9]
I0922 16:03:06.687029 2681906 ssh_runner.go:195] Run: which crictl
I0922 16:03:06.690502 2681906 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I0922 16:03:06.690573 2681906 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0922 16:03:06.727643 2681906 cri.go:89] found id: "6562f7c7de3f3d9c08292bc33b953e463ba9e13039bee890e9c1d2c449fbbdf2"
I0922 16:03:06.727666 2681906 cri.go:89] found id: ""
I0922 16:03:06.727674 2681906 logs.go:276] 1 containers: [6562f7c7de3f3d9c08292bc33b953e463ba9e13039bee890e9c1d2c449fbbdf2]
I0922 16:03:06.727731 2681906 ssh_runner.go:195] Run: which crictl
I0922 16:03:06.731404 2681906 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I0922 16:03:06.731476 2681906 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0922 16:03:06.770769 2681906 cri.go:89] found id: "cba3476d8734ac22f86d2179412c8fce8540d3be0fa4d476311018d37f310c1e"
I0922 16:03:06.770792 2681906 cri.go:89] found id: ""
I0922 16:03:06.770801 2681906 logs.go:276] 1 containers: [cba3476d8734ac22f86d2179412c8fce8540d3be0fa4d476311018d37f310c1e]
I0922 16:03:06.770856 2681906 ssh_runner.go:195] Run: which crictl
I0922 16:03:06.774285 2681906 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I0922 16:03:06.774384 2681906 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0922 16:03:06.814048 2681906 cri.go:89] found id: "5f8a7c270f6b2b2c471fa8edebcc45a1c228d473c4fabcbcbb25d0b9441757d8"
I0922 16:03:06.814069 2681906 cri.go:89] found id: ""
I0922 16:03:06.814081 2681906 logs.go:276] 1 containers: [5f8a7c270f6b2b2c471fa8edebcc45a1c228d473c4fabcbcbb25d0b9441757d8]
I0922 16:03:06.814156 2681906 ssh_runner.go:195] Run: which crictl
I0922 16:03:06.817975 2681906 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I0922 16:03:06.818072 2681906 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0922 16:03:06.863640 2681906 cri.go:89] found id: "635997381cc62183373066ee36ee89df2b9c9a2c0f5cb6f2ae9c88d351413fae"
I0922 16:03:06.863671 2681906 cri.go:89] found id: ""
I0922 16:03:06.863680 2681906 logs.go:276] 1 containers: [635997381cc62183373066ee36ee89df2b9c9a2c0f5cb6f2ae9c88d351413fae]
I0922 16:03:06.863741 2681906 ssh_runner.go:195] Run: which crictl
I0922 16:03:06.867504 2681906 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I0922 16:03:06.867596 2681906 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0922 16:03:06.908390 2681906 cri.go:89] found id: "3bd7e760873ba293057f368b9467f70adede6a407492e559b8f4d337e1a7d1c1"
I0922 16:03:06.908414 2681906 cri.go:89] found id: ""
I0922 16:03:06.908422 2681906 logs.go:276] 1 containers: [3bd7e760873ba293057f368b9467f70adede6a407492e559b8f4d337e1a7d1c1]
I0922 16:03:06.908478 2681906 ssh_runner.go:195] Run: which crictl
I0922 16:03:06.912490 2681906 cri.go:54] listing CRI containers in root : {State:all Name:kubernetes-dashboard Namespaces:[]}
I0922 16:03:06.912567 2681906 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
I0922 16:03:06.967109 2681906 cri.go:89] found id: "ba4a19226ec88f010f3223c02bcb1fbb25ab2ceabc15b808701fc4185ac6e9a3"
I0922 16:03:06.967132 2681906 cri.go:89] found id: ""
I0922 16:03:06.967140 2681906 logs.go:276] 1 containers: [ba4a19226ec88f010f3223c02bcb1fbb25ab2ceabc15b808701fc4185ac6e9a3]
I0922 16:03:06.967230 2681906 ssh_runner.go:195] Run: which crictl
I0922 16:03:06.971173 2681906 cri.go:54] listing CRI containers in root : {State:all Name:storage-provisioner Namespaces:[]}
I0922 16:03:06.971251 2681906 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
I0922 16:03:07.012943 2681906 cri.go:89] found id: "dff19d72968123299c8e421e21d2e6d06810fd0987111d30b7752d10aef52d7b"
I0922 16:03:07.012963 2681906 cri.go:89] found id: "c9649fe03112847528d915220d1d09db1d4eb743be95e5b881e3203089779681"
I0922 16:03:07.012967 2681906 cri.go:89] found id: ""
I0922 16:03:07.012974 2681906 logs.go:276] 2 containers: [dff19d72968123299c8e421e21d2e6d06810fd0987111d30b7752d10aef52d7b c9649fe03112847528d915220d1d09db1d4eb743be95e5b881e3203089779681]
I0922 16:03:07.013033 2681906 ssh_runner.go:195] Run: which crictl
I0922 16:03:07.017133 2681906 ssh_runner.go:195] Run: which crictl
I0922 16:03:07.020773 2681906 logs.go:123] Gathering logs for kubelet ...
I0922 16:03:07.020801 2681906 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
W0922 16:03:07.060940 2681906 logs.go:138] Found kubelet problem: Sep 22 15:58:42 no-preload-592860 kubelet[744]: W0922 15:58:42.333243 744 reflector.go:561] object-"kube-system"/"coredns": failed to list *v1.ConfigMap: configmaps "coredns" is forbidden: User "system:node:no-preload-592860" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'no-preload-592860' and this object
W0922 16:03:07.061184 2681906 logs.go:138] Found kubelet problem: Sep 22 15:58:42 no-preload-592860 kubelet[744]: E0922 15:58:42.333306 744 reflector.go:158] "Unhandled Error" err="object-\"kube-system\"/\"coredns\": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps \"coredns\" is forbidden: User \"system:node:no-preload-592860\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"kube-system\": no relationship found between node 'no-preload-592860' and this object" logger="UnhandledError"
W0922 16:03:07.061677 2681906 logs.go:138] Found kubelet problem: Sep 22 15:58:42 no-preload-592860 kubelet[744]: W0922 15:58:42.334611 744 reflector.go:561] object-"default"/"kube-root-ca.crt": failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:no-preload-592860" cannot list resource "configmaps" in API group "" in the namespace "default": no relationship found between node 'no-preload-592860' and this object
W0922 16:03:07.061913 2681906 logs.go:138] Found kubelet problem: Sep 22 15:58:42 no-preload-592860 kubelet[744]: E0922 15:58:42.334646 744 reflector.go:158] "Unhandled Error" err="object-\"default\"/\"kube-root-ca.crt\": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:no-preload-592860\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"default\": no relationship found between node 'no-preload-592860' and this object" logger="UnhandledError"
W0922 16:03:07.062102 2681906 logs.go:138] Found kubelet problem: Sep 22 15:58:42 no-preload-592860 kubelet[744]: W0922 15:58:42.335086 744 reflector.go:561] object-"kube-system"/"kube-root-ca.crt": failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:no-preload-592860" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'no-preload-592860' and this object
W0922 16:03:07.062337 2681906 logs.go:138] Found kubelet problem: Sep 22 15:58:42 no-preload-592860 kubelet[744]: E0922 15:58:42.335118 744 reflector.go:158] "Unhandled Error" err="object-\"kube-system\"/\"kube-root-ca.crt\": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:no-preload-592860\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"kube-system\": no relationship found between node 'no-preload-592860' and this object" logger="UnhandledError"
W0922 16:03:07.062518 2681906 logs.go:138] Found kubelet problem: Sep 22 15:58:42 no-preload-592860 kubelet[744]: W0922 15:58:42.335403 744 reflector.go:561] object-"kube-system"/"kube-proxy": failed to list *v1.ConfigMap: configmaps "kube-proxy" is forbidden: User "system:node:no-preload-592860" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'no-preload-592860' and this object
W0922 16:03:07.062737 2681906 logs.go:138] Found kubelet problem: Sep 22 15:58:42 no-preload-592860 kubelet[744]: E0922 15:58:42.335430 744 reflector.go:158] "Unhandled Error" err="object-\"kube-system\"/\"kube-proxy\": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps \"kube-proxy\" is forbidden: User \"system:node:no-preload-592860\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"kube-system\": no relationship found between node 'no-preload-592860' and this object" logger="UnhandledError"
I0922 16:03:07.115362 2681906 logs.go:123] Gathering logs for coredns [6562f7c7de3f3d9c08292bc33b953e463ba9e13039bee890e9c1d2c449fbbdf2] ...
I0922 16:03:07.115400 2681906 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 6562f7c7de3f3d9c08292bc33b953e463ba9e13039bee890e9c1d2c449fbbdf2"
I0922 16:03:07.174607 2681906 logs.go:123] Gathering logs for kindnet [3bd7e760873ba293057f368b9467f70adede6a407492e559b8f4d337e1a7d1c1] ...
I0922 16:03:07.174660 2681906 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 3bd7e760873ba293057f368b9467f70adede6a407492e559b8f4d337e1a7d1c1"
I0922 16:03:07.234641 2681906 logs.go:123] Gathering logs for CRI-O ...
I0922 16:03:07.234671 2681906 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I0922 16:03:07.319132 2681906 logs.go:123] Gathering logs for kube-apiserver [f13df5fde0297e4f1e20802c1ce093b57b7d7fa723f8544509bb91f9880faaa0] ...
I0922 16:03:07.319169 2681906 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 f13df5fde0297e4f1e20802c1ce093b57b7d7fa723f8544509bb91f9880faaa0"
I0922 16:03:07.380036 2681906 logs.go:123] Gathering logs for kube-scheduler [cba3476d8734ac22f86d2179412c8fce8540d3be0fa4d476311018d37f310c1e] ...
I0922 16:03:07.380072 2681906 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 cba3476d8734ac22f86d2179412c8fce8540d3be0fa4d476311018d37f310c1e"
I0922 16:03:07.425987 2681906 logs.go:123] Gathering logs for kube-proxy [5f8a7c270f6b2b2c471fa8edebcc45a1c228d473c4fabcbcbb25d0b9441757d8] ...
I0922 16:03:07.426065 2681906 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 5f8a7c270f6b2b2c471fa8edebcc45a1c228d473c4fabcbcbb25d0b9441757d8"
I0922 16:03:07.470526 2681906 logs.go:123] Gathering logs for storage-provisioner [c9649fe03112847528d915220d1d09db1d4eb743be95e5b881e3203089779681] ...
I0922 16:03:07.470632 2681906 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 c9649fe03112847528d915220d1d09db1d4eb743be95e5b881e3203089779681"
I0922 16:03:07.509317 2681906 logs.go:123] Gathering logs for dmesg ...
I0922 16:03:07.509348 2681906 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0922 16:03:07.526011 2681906 logs.go:123] Gathering logs for etcd [fbeebb3a9101973a106be48fe12ae869c032d65b92aef86cf6339ece84fff8d9] ...
I0922 16:03:07.526047 2681906 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 fbeebb3a9101973a106be48fe12ae869c032d65b92aef86cf6339ece84fff8d9"
I0922 16:03:07.577742 2681906 logs.go:123] Gathering logs for kube-controller-manager [635997381cc62183373066ee36ee89df2b9c9a2c0f5cb6f2ae9c88d351413fae] ...
I0922 16:03:07.577777 2681906 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 635997381cc62183373066ee36ee89df2b9c9a2c0f5cb6f2ae9c88d351413fae"
I0922 16:03:07.639403 2681906 logs.go:123] Gathering logs for storage-provisioner [dff19d72968123299c8e421e21d2e6d06810fd0987111d30b7752d10aef52d7b] ...
I0922 16:03:07.639441 2681906 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 dff19d72968123299c8e421e21d2e6d06810fd0987111d30b7752d10aef52d7b"
I0922 16:03:07.680503 2681906 logs.go:123] Gathering logs for container status ...
I0922 16:03:07.680532 2681906 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0922 16:03:07.724551 2681906 logs.go:123] Gathering logs for describe nodes ...
I0922 16:03:07.724583 2681906 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.31.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0922 16:03:07.852738 2681906 logs.go:123] Gathering logs for kubernetes-dashboard [ba4a19226ec88f010f3223c02bcb1fbb25ab2ceabc15b808701fc4185ac6e9a3] ...
I0922 16:03:07.852770 2681906 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 ba4a19226ec88f010f3223c02bcb1fbb25ab2ceabc15b808701fc4185ac6e9a3"
I0922 16:03:07.890665 2681906 out.go:358] Setting ErrFile to fd 2...
I0922 16:03:07.890691 2681906 out.go:392] TERM=,COLORTERM=, which probably does not support color
W0922 16:03:07.890748 2681906 out.go:270] X Problems detected in kubelet:
W0922 16:03:07.890761 2681906 out.go:270] Sep 22 15:58:42 no-preload-592860 kubelet[744]: E0922 15:58:42.334646 744 reflector.go:158] "Unhandled Error" err="object-\"default\"/\"kube-root-ca.crt\": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:no-preload-592860\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"default\": no relationship found between node 'no-preload-592860' and this object" logger="UnhandledError"
W0922 16:03:07.890779 2681906 out.go:270] Sep 22 15:58:42 no-preload-592860 kubelet[744]: W0922 15:58:42.335086 744 reflector.go:561] object-"kube-system"/"kube-root-ca.crt": failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:no-preload-592860" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'no-preload-592860' and this object
W0922 16:03:07.890787 2681906 out.go:270] Sep 22 15:58:42 no-preload-592860 kubelet[744]: E0922 15:58:42.335118 744 reflector.go:158] "Unhandled Error" err="object-\"kube-system\"/\"kube-root-ca.crt\": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:no-preload-592860\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"kube-system\": no relationship found between node 'no-preload-592860' and this object" logger="UnhandledError"
W0922 16:03:07.890798 2681906 out.go:270] Sep 22 15:58:42 no-preload-592860 kubelet[744]: W0922 15:58:42.335403 744 reflector.go:561] object-"kube-system"/"kube-proxy": failed to list *v1.ConfigMap: configmaps "kube-proxy" is forbidden: User "system:node:no-preload-592860" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'no-preload-592860' and this object
W0922 16:03:07.890809 2681906 out.go:270] Sep 22 15:58:42 no-preload-592860 kubelet[744]: E0922 15:58:42.335430 744 reflector.go:158] "Unhandled Error" err="object-\"kube-system\"/\"kube-proxy\": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps \"kube-proxy\" is forbidden: User \"system:node:no-preload-592860\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"kube-system\": no relationship found between node 'no-preload-592860' and this object" logger="UnhandledError"
I0922 16:03:07.890815 2681906 out.go:358] Setting ErrFile to fd 2...
I0922 16:03:07.890821 2681906 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0922 16:03:03.959787 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:03:06.460100 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:03:08.959599 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:03:11.459075 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:03:13.459883 2677774 pod_ready.go:103] pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace has status "Ready":"False"
I0922 16:03:17.891824 2681906 api_server.go:253] Checking apiserver healthz at https://192.168.85.2:8443/healthz ...
I0922 16:03:17.899710 2681906 api_server.go:279] https://192.168.85.2:8443/healthz returned 200:
ok
I0922 16:03:17.900674 2681906 api_server.go:141] control plane version: v1.31.1
I0922 16:03:17.900699 2681906 api_server.go:131] duration metric: took 11.293523715s to wait for apiserver health ...
I0922 16:03:17.900708 2681906 system_pods.go:43] waiting for kube-system pods to appear ...
I0922 16:03:17.900729 2681906 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I0922 16:03:17.900794 2681906 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0922 16:03:17.940992 2681906 cri.go:89] found id: "f13df5fde0297e4f1e20802c1ce093b57b7d7fa723f8544509bb91f9880faaa0"
I0922 16:03:17.941014 2681906 cri.go:89] found id: ""
I0922 16:03:17.941028 2681906 logs.go:276] 1 containers: [f13df5fde0297e4f1e20802c1ce093b57b7d7fa723f8544509bb91f9880faaa0]
I0922 16:03:17.941086 2681906 ssh_runner.go:195] Run: which crictl
I0922 16:03:17.945692 2681906 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I0922 16:03:17.945769 2681906 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0922 16:03:17.988406 2681906 cri.go:89] found id: "fbeebb3a9101973a106be48fe12ae869c032d65b92aef86cf6339ece84fff8d9"
I0922 16:03:17.988429 2681906 cri.go:89] found id: ""
I0922 16:03:17.988437 2681906 logs.go:276] 1 containers: [fbeebb3a9101973a106be48fe12ae869c032d65b92aef86cf6339ece84fff8d9]
I0922 16:03:17.988494 2681906 ssh_runner.go:195] Run: which crictl
I0922 16:03:17.992179 2681906 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I0922 16:03:17.992254 2681906 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0922 16:03:18.030512 2681906 cri.go:89] found id: "6562f7c7de3f3d9c08292bc33b953e463ba9e13039bee890e9c1d2c449fbbdf2"
I0922 16:03:18.030534 2681906 cri.go:89] found id: ""
I0922 16:03:18.030543 2681906 logs.go:276] 1 containers: [6562f7c7de3f3d9c08292bc33b953e463ba9e13039bee890e9c1d2c449fbbdf2]
I0922 16:03:18.030602 2681906 ssh_runner.go:195] Run: which crictl
I0922 16:03:18.035369 2681906 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I0922 16:03:18.035464 2681906 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0922 16:03:18.092061 2681906 cri.go:89] found id: "cba3476d8734ac22f86d2179412c8fce8540d3be0fa4d476311018d37f310c1e"
I0922 16:03:18.092083 2681906 cri.go:89] found id: ""
I0922 16:03:18.092091 2681906 logs.go:276] 1 containers: [cba3476d8734ac22f86d2179412c8fce8540d3be0fa4d476311018d37f310c1e]
I0922 16:03:18.092157 2681906 ssh_runner.go:195] Run: which crictl
I0922 16:03:18.096124 2681906 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I0922 16:03:18.096202 2681906 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0922 16:03:18.138115 2681906 cri.go:89] found id: "5f8a7c270f6b2b2c471fa8edebcc45a1c228d473c4fabcbcbb25d0b9441757d8"
I0922 16:03:18.138138 2681906 cri.go:89] found id: ""
I0922 16:03:18.138146 2681906 logs.go:276] 1 containers: [5f8a7c270f6b2b2c471fa8edebcc45a1c228d473c4fabcbcbb25d0b9441757d8]
I0922 16:03:18.138208 2681906 ssh_runner.go:195] Run: which crictl
I0922 16:03:18.142556 2681906 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I0922 16:03:18.142683 2681906 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0922 16:03:18.186999 2681906 cri.go:89] found id: "635997381cc62183373066ee36ee89df2b9c9a2c0f5cb6f2ae9c88d351413fae"
I0922 16:03:18.187021 2681906 cri.go:89] found id: ""
I0922 16:03:18.187030 2681906 logs.go:276] 1 containers: [635997381cc62183373066ee36ee89df2b9c9a2c0f5cb6f2ae9c88d351413fae]
I0922 16:03:18.187084 2681906 ssh_runner.go:195] Run: which crictl
I0922 16:03:18.190611 2681906 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I0922 16:03:18.190731 2681906 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0922 16:03:18.232823 2681906 cri.go:89] found id: "3bd7e760873ba293057f368b9467f70adede6a407492e559b8f4d337e1a7d1c1"
I0922 16:03:18.232848 2681906 cri.go:89] found id: ""
I0922 16:03:18.232856 2681906 logs.go:276] 1 containers: [3bd7e760873ba293057f368b9467f70adede6a407492e559b8f4d337e1a7d1c1]
I0922 16:03:18.232933 2681906 ssh_runner.go:195] Run: which crictl
I0922 16:03:18.237051 2681906 cri.go:54] listing CRI containers in root : {State:all Name:storage-provisioner Namespaces:[]}
I0922 16:03:18.237154 2681906 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
I0922 16:03:18.282111 2681906 cri.go:89] found id: "dff19d72968123299c8e421e21d2e6d06810fd0987111d30b7752d10aef52d7b"
I0922 16:03:18.282134 2681906 cri.go:89] found id: "c9649fe03112847528d915220d1d09db1d4eb743be95e5b881e3203089779681"
I0922 16:03:18.282140 2681906 cri.go:89] found id: ""
I0922 16:03:18.282148 2681906 logs.go:276] 2 containers: [dff19d72968123299c8e421e21d2e6d06810fd0987111d30b7752d10aef52d7b c9649fe03112847528d915220d1d09db1d4eb743be95e5b881e3203089779681]
I0922 16:03:18.282204 2681906 ssh_runner.go:195] Run: which crictl
I0922 16:03:18.287232 2681906 ssh_runner.go:195] Run: which crictl
I0922 16:03:18.290569 2681906 cri.go:54] listing CRI containers in root : {State:all Name:kubernetes-dashboard Namespaces:[]}
I0922 16:03:18.290642 2681906 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
I0922 16:03:18.329403 2681906 cri.go:89] found id: "ba4a19226ec88f010f3223c02bcb1fbb25ab2ceabc15b808701fc4185ac6e9a3"
I0922 16:03:18.329428 2681906 cri.go:89] found id: ""
I0922 16:03:18.329436 2681906 logs.go:276] 1 containers: [ba4a19226ec88f010f3223c02bcb1fbb25ab2ceabc15b808701fc4185ac6e9a3]
I0922 16:03:18.329493 2681906 ssh_runner.go:195] Run: which crictl
I0922 16:03:18.333429 2681906 logs.go:123] Gathering logs for kube-scheduler [cba3476d8734ac22f86d2179412c8fce8540d3be0fa4d476311018d37f310c1e] ...
I0922 16:03:18.333500 2681906 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 cba3476d8734ac22f86d2179412c8fce8540d3be0fa4d476311018d37f310c1e"
I0922 16:03:18.375944 2681906 logs.go:123] Gathering logs for kube-proxy [5f8a7c270f6b2b2c471fa8edebcc45a1c228d473c4fabcbcbb25d0b9441757d8] ...
I0922 16:03:18.375972 2681906 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 5f8a7c270f6b2b2c471fa8edebcc45a1c228d473c4fabcbcbb25d0b9441757d8"
I0922 16:03:18.417052 2681906 logs.go:123] Gathering logs for kubelet ...
I0922 16:03:18.417080 2681906 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
W0922 16:03:18.457150 2681906 logs.go:138] Found kubelet problem: Sep 22 15:58:42 no-preload-592860 kubelet[744]: W0922 15:58:42.333243 744 reflector.go:561] object-"kube-system"/"coredns": failed to list *v1.ConfigMap: configmaps "coredns" is forbidden: User "system:node:no-preload-592860" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'no-preload-592860' and this object
W0922 16:03:18.457410 2681906 logs.go:138] Found kubelet problem: Sep 22 15:58:42 no-preload-592860 kubelet[744]: E0922 15:58:42.333306 744 reflector.go:158] "Unhandled Error" err="object-\"kube-system\"/\"coredns\": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps \"coredns\" is forbidden: User \"system:node:no-preload-592860\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"kube-system\": no relationship found between node 'no-preload-592860' and this object" logger="UnhandledError"
W0922 16:03:18.457598 2681906 logs.go:138] Found kubelet problem: Sep 22 15:58:42 no-preload-592860 kubelet[744]: W0922 15:58:42.334611 744 reflector.go:561] object-"default"/"kube-root-ca.crt": failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:no-preload-592860" cannot list resource "configmaps" in API group "" in the namespace "default": no relationship found between node 'no-preload-592860' and this object
W0922 16:03:18.457832 2681906 logs.go:138] Found kubelet problem: Sep 22 15:58:42 no-preload-592860 kubelet[744]: E0922 15:58:42.334646 744 reflector.go:158] "Unhandled Error" err="object-\"default\"/\"kube-root-ca.crt\": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:no-preload-592860\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"default\": no relationship found between node 'no-preload-592860' and this object" logger="UnhandledError"
W0922 16:03:18.458018 2681906 logs.go:138] Found kubelet problem: Sep 22 15:58:42 no-preload-592860 kubelet[744]: W0922 15:58:42.335086 744 reflector.go:561] object-"kube-system"/"kube-root-ca.crt": failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:no-preload-592860" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'no-preload-592860' and this object
W0922 16:03:18.458250 2681906 logs.go:138] Found kubelet problem: Sep 22 15:58:42 no-preload-592860 kubelet[744]: E0922 15:58:42.335118 744 reflector.go:158] "Unhandled Error" err="object-\"kube-system\"/\"kube-root-ca.crt\": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:no-preload-592860\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"kube-system\": no relationship found between node 'no-preload-592860' and this object" logger="UnhandledError"
W0922 16:03:18.458429 2681906 logs.go:138] Found kubelet problem: Sep 22 15:58:42 no-preload-592860 kubelet[744]: W0922 15:58:42.335403 744 reflector.go:561] object-"kube-system"/"kube-proxy": failed to list *v1.ConfigMap: configmaps "kube-proxy" is forbidden: User "system:node:no-preload-592860" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'no-preload-592860' and this object
W0922 16:03:18.458649 2681906 logs.go:138] Found kubelet problem: Sep 22 15:58:42 no-preload-592860 kubelet[744]: E0922 15:58:42.335430 744 reflector.go:158] "Unhandled Error" err="object-\"kube-system\"/\"kube-proxy\": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps \"kube-proxy\" is forbidden: User \"system:node:no-preload-592860\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"kube-system\": no relationship found between node 'no-preload-592860' and this object" logger="UnhandledError"
I0922 16:03:18.511451 2681906 logs.go:123] Gathering logs for describe nodes ...
I0922 16:03:18.511492 2681906 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.31.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0922 16:03:18.633021 2681906 logs.go:123] Gathering logs for etcd [fbeebb3a9101973a106be48fe12ae869c032d65b92aef86cf6339ece84fff8d9] ...
I0922 16:03:18.633050 2681906 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 fbeebb3a9101973a106be48fe12ae869c032d65b92aef86cf6339ece84fff8d9"
I0922 16:03:18.690225 2681906 logs.go:123] Gathering logs for kindnet [3bd7e760873ba293057f368b9467f70adede6a407492e559b8f4d337e1a7d1c1] ...
I0922 16:03:18.690262 2681906 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 3bd7e760873ba293057f368b9467f70adede6a407492e559b8f4d337e1a7d1c1"
I0922 16:03:18.733580 2681906 logs.go:123] Gathering logs for storage-provisioner [dff19d72968123299c8e421e21d2e6d06810fd0987111d30b7752d10aef52d7b] ...
I0922 16:03:18.733611 2681906 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 dff19d72968123299c8e421e21d2e6d06810fd0987111d30b7752d10aef52d7b"
I0922 16:03:18.774036 2681906 logs.go:123] Gathering logs for CRI-O ...
I0922 16:03:18.774062 2681906 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I0922 16:03:13.959947 2677774 pod_ready.go:82] duration metric: took 4m0.006668215s for pod "metrics-server-9975d5f86-9dfk7" in "kube-system" namespace to be "Ready" ...
E0922 16:03:13.959978 2677774 pod_ready.go:67] WaitExtra: waitPodCondition: context deadline exceeded
I0922 16:03:13.959988 2677774 pod_ready.go:39] duration metric: took 5m27.137197276s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0922 16:03:13.960001 2677774 api_server.go:52] waiting for apiserver process to appear ...
I0922 16:03:13.960035 2677774 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I0922 16:03:13.960099 2677774 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0922 16:03:14.000708 2677774 cri.go:89] found id: "7c1fcc5987e5e298748cead12955f5b511798c88fb01575612ee7b9dd567b55f"
I0922 16:03:14.000731 2677774 cri.go:89] found id: ""
I0922 16:03:14.000739 2677774 logs.go:276] 1 containers: [7c1fcc5987e5e298748cead12955f5b511798c88fb01575612ee7b9dd567b55f]
I0922 16:03:14.000799 2677774 ssh_runner.go:195] Run: which crictl
I0922 16:03:14.004993 2677774 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I0922 16:03:14.005072 2677774 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0922 16:03:14.047308 2677774 cri.go:89] found id: "9c0a027a1be5775f8f8bab62ea785c923794fad9dd784833db780d0c12ec968b"
I0922 16:03:14.047331 2677774 cri.go:89] found id: ""
I0922 16:03:14.047340 2677774 logs.go:276] 1 containers: [9c0a027a1be5775f8f8bab62ea785c923794fad9dd784833db780d0c12ec968b]
I0922 16:03:14.047394 2677774 ssh_runner.go:195] Run: which crictl
I0922 16:03:14.050893 2677774 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I0922 16:03:14.051005 2677774 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0922 16:03:14.094249 2677774 cri.go:89] found id: "74c18335c2ae08ca4773950befa864f23e6a8bee2767e6f7f6eae0ddb3683ab2"
I0922 16:03:14.094280 2677774 cri.go:89] found id: ""
I0922 16:03:14.094289 2677774 logs.go:276] 1 containers: [74c18335c2ae08ca4773950befa864f23e6a8bee2767e6f7f6eae0ddb3683ab2]
I0922 16:03:14.094346 2677774 ssh_runner.go:195] Run: which crictl
I0922 16:03:14.098089 2677774 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I0922 16:03:14.098164 2677774 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0922 16:03:14.137752 2677774 cri.go:89] found id: "30f03ae4101098906a64fcc1aa6671c8702b5191e639bfa1be31ac12b0b1b75f"
I0922 16:03:14.137774 2677774 cri.go:89] found id: ""
I0922 16:03:14.137785 2677774 logs.go:276] 1 containers: [30f03ae4101098906a64fcc1aa6671c8702b5191e639bfa1be31ac12b0b1b75f]
I0922 16:03:14.137841 2677774 ssh_runner.go:195] Run: which crictl
I0922 16:03:14.141568 2677774 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I0922 16:03:14.141644 2677774 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0922 16:03:14.184911 2677774 cri.go:89] found id: "ec9f69248870fe845f3489361c85e0a4b8603653e8b0e35027240720c8219d3d"
I0922 16:03:14.184936 2677774 cri.go:89] found id: ""
I0922 16:03:14.184945 2677774 logs.go:276] 1 containers: [ec9f69248870fe845f3489361c85e0a4b8603653e8b0e35027240720c8219d3d]
I0922 16:03:14.185020 2677774 ssh_runner.go:195] Run: which crictl
I0922 16:03:14.188587 2677774 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I0922 16:03:14.188699 2677774 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0922 16:03:14.226429 2677774 cri.go:89] found id: "132b8fae57bdf9d2a5fc2c5513a926caa1aa8b41366180c05ecd3ba3f700a87f"
I0922 16:03:14.226454 2677774 cri.go:89] found id: ""
I0922 16:03:14.226463 2677774 logs.go:276] 1 containers: [132b8fae57bdf9d2a5fc2c5513a926caa1aa8b41366180c05ecd3ba3f700a87f]
I0922 16:03:14.226520 2677774 ssh_runner.go:195] Run: which crictl
I0922 16:03:14.230171 2677774 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I0922 16:03:14.230249 2677774 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0922 16:03:14.269011 2677774 cri.go:89] found id: "817a0d84fdbc60639f69c50c14178f79e4829f83ef55c42936ea8baf284b5fb2"
I0922 16:03:14.269034 2677774 cri.go:89] found id: ""
I0922 16:03:14.269043 2677774 logs.go:276] 1 containers: [817a0d84fdbc60639f69c50c14178f79e4829f83ef55c42936ea8baf284b5fb2]
I0922 16:03:14.269102 2677774 ssh_runner.go:195] Run: which crictl
I0922 16:03:14.272645 2677774 cri.go:54] listing CRI containers in root : {State:all Name:kubernetes-dashboard Namespaces:[]}
I0922 16:03:14.272718 2677774 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
I0922 16:03:14.309840 2677774 cri.go:89] found id: "8aeff047dc834f6a9760e6b43096ec896a75509fed306bf7078b51c94eca99f3"
I0922 16:03:14.309859 2677774 cri.go:89] found id: ""
I0922 16:03:14.309866 2677774 logs.go:276] 1 containers: [8aeff047dc834f6a9760e6b43096ec896a75509fed306bf7078b51c94eca99f3]
I0922 16:03:14.309921 2677774 ssh_runner.go:195] Run: which crictl
I0922 16:03:14.313387 2677774 cri.go:54] listing CRI containers in root : {State:all Name:storage-provisioner Namespaces:[]}
I0922 16:03:14.313467 2677774 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
I0922 16:03:14.354435 2677774 cri.go:89] found id: "e4a2ecaf05417d51ac0d7f89b7d4f38dda15dd8046c8d1febc60579492dce3dc"
I0922 16:03:14.354459 2677774 cri.go:89] found id: "45e9854e642ac4e51de161c0467764011cb66eb499bb2602b89c2f55ef4ba4f1"
I0922 16:03:14.354464 2677774 cri.go:89] found id: ""
I0922 16:03:14.354508 2677774 logs.go:276] 2 containers: [e4a2ecaf05417d51ac0d7f89b7d4f38dda15dd8046c8d1febc60579492dce3dc 45e9854e642ac4e51de161c0467764011cb66eb499bb2602b89c2f55ef4ba4f1]
I0922 16:03:14.354574 2677774 ssh_runner.go:195] Run: which crictl
I0922 16:03:14.358302 2677774 ssh_runner.go:195] Run: which crictl
I0922 16:03:14.361650 2677774 logs.go:123] Gathering logs for kube-scheduler [30f03ae4101098906a64fcc1aa6671c8702b5191e639bfa1be31ac12b0b1b75f] ...
I0922 16:03:14.361677 2677774 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 30f03ae4101098906a64fcc1aa6671c8702b5191e639bfa1be31ac12b0b1b75f"
I0922 16:03:14.403472 2677774 logs.go:123] Gathering logs for kindnet [817a0d84fdbc60639f69c50c14178f79e4829f83ef55c42936ea8baf284b5fb2] ...
I0922 16:03:14.403506 2677774 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 817a0d84fdbc60639f69c50c14178f79e4829f83ef55c42936ea8baf284b5fb2"
I0922 16:03:14.457385 2677774 logs.go:123] Gathering logs for storage-provisioner [45e9854e642ac4e51de161c0467764011cb66eb499bb2602b89c2f55ef4ba4f1] ...
I0922 16:03:14.457416 2677774 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 45e9854e642ac4e51de161c0467764011cb66eb499bb2602b89c2f55ef4ba4f1"
I0922 16:03:14.502450 2677774 logs.go:123] Gathering logs for CRI-O ...
I0922 16:03:14.502480 2677774 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I0922 16:03:14.588889 2677774 logs.go:123] Gathering logs for kubelet ...
I0922 16:03:14.588925 2677774 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
W0922 16:03:14.643482 2677774 logs.go:138] Found kubelet problem: Sep 22 15:57:46 old-k8s-version-516480 kubelet[731]: E0922 15:57:46.900162 731 reflector.go:138] object-"kube-system"/"kube-proxy-token-qd9mk": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kube-proxy-token-qd9mk" is forbidden: User "system:node:old-k8s-version-516480" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-516480' and this object
W0922 16:03:14.643717 2677774 logs.go:138] Found kubelet problem: Sep 22 15:57:46 old-k8s-version-516480 kubelet[731]: E0922 15:57:46.900230 731 reflector.go:138] object-"kube-system"/"kindnet-token-4qmzm": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kindnet-token-4qmzm" is forbidden: User "system:node:old-k8s-version-516480" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-516480' and this object
W0922 16:03:14.643970 2677774 logs.go:138] Found kubelet problem: Sep 22 15:57:46 old-k8s-version-516480 kubelet[731]: E0922 15:57:46.900281 731 reflector.go:138] object-"kube-system"/"storage-provisioner-token-8jzbw": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "storage-provisioner-token-8jzbw" is forbidden: User "system:node:old-k8s-version-516480" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-516480' and this object
W0922 16:03:14.644184 2677774 logs.go:138] Found kubelet problem: Sep 22 15:57:46 old-k8s-version-516480 kubelet[731]: E0922 15:57:46.900346 731 reflector.go:138] object-"kube-system"/"coredns-token-s54l7": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "coredns-token-s54l7" is forbidden: User "system:node:old-k8s-version-516480" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-516480' and this object
W0922 16:03:14.644397 2677774 logs.go:138] Found kubelet problem: Sep 22 15:57:46 old-k8s-version-516480 kubelet[731]: E0922 15:57:46.900399 731 reflector.go:138] object-"default"/"default-token-bfhkm": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "default-token-bfhkm" is forbidden: User "system:node:old-k8s-version-516480" cannot list resource "secrets" in API group "" in the namespace "default": no relationship found between node 'old-k8s-version-516480' and this object
W0922 16:03:14.644598 2677774 logs.go:138] Found kubelet problem: Sep 22 15:57:46 old-k8s-version-516480 kubelet[731]: E0922 15:57:46.900456 731 reflector.go:138] object-"kube-system"/"coredns": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "coredns" is forbidden: User "system:node:old-k8s-version-516480" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-516480' and this object
W0922 16:03:14.644804 2677774 logs.go:138] Found kubelet problem: Sep 22 15:57:46 old-k8s-version-516480 kubelet[731]: E0922 15:57:46.900499 731 reflector.go:138] object-"kube-system"/"kube-proxy": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-proxy" is forbidden: User "system:node:old-k8s-version-516480" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-516480' and this object
W0922 16:03:14.648261 2677774 logs.go:138] Found kubelet problem: Sep 22 15:57:47 old-k8s-version-516480 kubelet[731]: E0922 15:57:47.566740 731 reflector.go:138] object-"kube-system"/"metrics-server-token-qckbp": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "metrics-server-token-qckbp" is forbidden: User "system:node:old-k8s-version-516480" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-516480' and this object
W0922 16:03:14.655022 2677774 logs.go:138] Found kubelet problem: Sep 22 15:57:50 old-k8s-version-516480 kubelet[731]: E0922 15:57:50.088641 731 pod_workers.go:191] Error syncing pod dcecb091-e954-4a6f-b51e-c8087bb59734 ("metrics-server-9975d5f86-9dfk7_kube-system(dcecb091-e954-4a6f-b51e-c8087bb59734)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = pinging container registry fake.domain: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain: no such host"
W0922 16:03:14.655214 2677774 logs.go:138] Found kubelet problem: Sep 22 15:57:50 old-k8s-version-516480 kubelet[731]: E0922 15:57:50.733867 731 pod_workers.go:191] Error syncing pod dcecb091-e954-4a6f-b51e-c8087bb59734 ("metrics-server-9975d5f86-9dfk7_kube-system(dcecb091-e954-4a6f-b51e-c8087bb59734)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0922 16:03:14.657259 2677774 logs.go:138] Found kubelet problem: Sep 22 15:58:05 old-k8s-version-516480 kubelet[731]: E0922 15:58:05.674769 731 pod_workers.go:191] Error syncing pod dcecb091-e954-4a6f-b51e-c8087bb59734 ("metrics-server-9975d5f86-9dfk7_kube-system(dcecb091-e954-4a6f-b51e-c8087bb59734)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = pinging container registry fake.domain: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain: no such host"
W0922 16:03:14.659277 2677774 logs.go:138] Found kubelet problem: Sep 22 15:58:12 old-k8s-version-516480 kubelet[731]: E0922 15:58:12.804811 731 pod_workers.go:191] Error syncing pod 9b7e692e-cd09-45ee-804a-db312d9515e5 ("dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"
W0922 16:03:14.659734 2677774 logs.go:138] Found kubelet problem: Sep 22 15:58:13 old-k8s-version-516480 kubelet[731]: E0922 15:58:13.807220 731 pod_workers.go:191] Error syncing pod 9b7e692e-cd09-45ee-804a-db312d9515e5 ("dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"
W0922 16:03:14.659920 2677774 logs.go:138] Found kubelet problem: Sep 22 15:58:17 old-k8s-version-516480 kubelet[731]: E0922 15:58:17.664740 731 pod_workers.go:191] Error syncing pod dcecb091-e954-4a6f-b51e-c8087bb59734 ("metrics-server-9975d5f86-9dfk7_kube-system(dcecb091-e954-4a6f-b51e-c8087bb59734)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0922 16:03:14.660381 2677774 logs.go:138] Found kubelet problem: Sep 22 15:58:20 old-k8s-version-516480 kubelet[731]: E0922 15:58:20.190220 731 pod_workers.go:191] Error syncing pod 9b7e692e-cd09-45ee-804a-db312d9515e5 ("dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"
W0922 16:03:14.660965 2677774 logs.go:138] Found kubelet problem: Sep 22 15:58:30 old-k8s-version-516480 kubelet[731]: E0922 15:58:30.841934 731 pod_workers.go:191] Error syncing pod 9b7e692e-cd09-45ee-804a-db312d9515e5 ("dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"
W0922 16:03:14.663034 2677774 logs.go:138] Found kubelet problem: Sep 22 15:58:32 old-k8s-version-516480 kubelet[731]: E0922 15:58:32.675646 731 pod_workers.go:191] Error syncing pod dcecb091-e954-4a6f-b51e-c8087bb59734 ("metrics-server-9975d5f86-9dfk7_kube-system(dcecb091-e954-4a6f-b51e-c8087bb59734)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = pinging container registry fake.domain: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain: no such host"
W0922 16:03:14.663826 2677774 logs.go:138] Found kubelet problem: Sep 22 15:58:40 old-k8s-version-516480 kubelet[731]: E0922 15:58:40.190704 731 pod_workers.go:191] Error syncing pod 9b7e692e-cd09-45ee-804a-db312d9515e5 ("dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"
W0922 16:03:14.664059 2677774 logs.go:138] Found kubelet problem: Sep 22 15:58:47 old-k8s-version-516480 kubelet[731]: E0922 15:58:47.663896 731 pod_workers.go:191] Error syncing pod dcecb091-e954-4a6f-b51e-c8087bb59734 ("metrics-server-9975d5f86-9dfk7_kube-system(dcecb091-e954-4a6f-b51e-c8087bb59734)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0922 16:03:14.664659 2677774 logs.go:138] Found kubelet problem: Sep 22 15:58:51 old-k8s-version-516480 kubelet[731]: E0922 15:58:51.872475 731 pod_workers.go:191] Error syncing pod 9b7e692e-cd09-45ee-804a-db312d9515e5 ("dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"
W0922 16:03:14.664988 2677774 logs.go:138] Found kubelet problem: Sep 22 15:59:00 old-k8s-version-516480 kubelet[731]: E0922 15:59:00.190211 731 pod_workers.go:191] Error syncing pod 9b7e692e-cd09-45ee-804a-db312d9515e5 ("dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"
W0922 16:03:14.665174 2677774 logs.go:138] Found kubelet problem: Sep 22 15:59:02 old-k8s-version-516480 kubelet[731]: E0922 15:59:02.663955 731 pod_workers.go:191] Error syncing pod dcecb091-e954-4a6f-b51e-c8087bb59734 ("metrics-server-9975d5f86-9dfk7_kube-system(dcecb091-e954-4a6f-b51e-c8087bb59734)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0922 16:03:14.665502 2677774 logs.go:138] Found kubelet problem: Sep 22 15:59:13 old-k8s-version-516480 kubelet[731]: E0922 15:59:13.664941 731 pod_workers.go:191] Error syncing pod 9b7e692e-cd09-45ee-804a-db312d9515e5 ("dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"
W0922 16:03:14.667562 2677774 logs.go:138] Found kubelet problem: Sep 22 15:59:16 old-k8s-version-516480 kubelet[731]: E0922 15:59:16.691143 731 pod_workers.go:191] Error syncing pod dcecb091-e954-4a6f-b51e-c8087bb59734 ("metrics-server-9975d5f86-9dfk7_kube-system(dcecb091-e954-4a6f-b51e-c8087bb59734)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = pinging container registry fake.domain: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain: no such host"
W0922 16:03:14.667890 2677774 logs.go:138] Found kubelet problem: Sep 22 15:59:25 old-k8s-version-516480 kubelet[731]: E0922 15:59:25.663919 731 pod_workers.go:191] Error syncing pod 9b7e692e-cd09-45ee-804a-db312d9515e5 ("dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"
W0922 16:03:14.668078 2677774 logs.go:138] Found kubelet problem: Sep 22 15:59:27 old-k8s-version-516480 kubelet[731]: E0922 15:59:27.664531 731 pod_workers.go:191] Error syncing pod dcecb091-e954-4a6f-b51e-c8087bb59734 ("metrics-server-9975d5f86-9dfk7_kube-system(dcecb091-e954-4a6f-b51e-c8087bb59734)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0922 16:03:14.668671 2677774 logs.go:138] Found kubelet problem: Sep 22 15:59:40 old-k8s-version-516480 kubelet[731]: E0922 15:59:40.937803 731 pod_workers.go:191] Error syncing pod 9b7e692e-cd09-45ee-804a-db312d9515e5 ("dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"
W0922 16:03:14.668854 2677774 logs.go:138] Found kubelet problem: Sep 22 15:59:41 old-k8s-version-516480 kubelet[731]: E0922 15:59:41.664383 731 pod_workers.go:191] Error syncing pod dcecb091-e954-4a6f-b51e-c8087bb59734 ("metrics-server-9975d5f86-9dfk7_kube-system(dcecb091-e954-4a6f-b51e-c8087bb59734)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0922 16:03:14.669182 2677774 logs.go:138] Found kubelet problem: Sep 22 15:59:50 old-k8s-version-516480 kubelet[731]: E0922 15:59:50.190598 731 pod_workers.go:191] Error syncing pod 9b7e692e-cd09-45ee-804a-db312d9515e5 ("dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"
W0922 16:03:14.669366 2677774 logs.go:138] Found kubelet problem: Sep 22 15:59:52 old-k8s-version-516480 kubelet[731]: E0922 15:59:52.664210 731 pod_workers.go:191] Error syncing pod dcecb091-e954-4a6f-b51e-c8087bb59734 ("metrics-server-9975d5f86-9dfk7_kube-system(dcecb091-e954-4a6f-b51e-c8087bb59734)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0922 16:03:14.669694 2677774 logs.go:138] Found kubelet problem: Sep 22 16:00:04 old-k8s-version-516480 kubelet[731]: E0922 16:00:04.663628 731 pod_workers.go:191] Error syncing pod 9b7e692e-cd09-45ee-804a-db312d9515e5 ("dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"
W0922 16:03:14.669879 2677774 logs.go:138] Found kubelet problem: Sep 22 16:00:07 old-k8s-version-516480 kubelet[731]: E0922 16:00:07.664303 731 pod_workers.go:191] Error syncing pod dcecb091-e954-4a6f-b51e-c8087bb59734 ("metrics-server-9975d5f86-9dfk7_kube-system(dcecb091-e954-4a6f-b51e-c8087bb59734)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0922 16:03:14.670206 2677774 logs.go:138] Found kubelet problem: Sep 22 16:00:16 old-k8s-version-516480 kubelet[731]: E0922 16:00:16.663530 731 pod_workers.go:191] Error syncing pod 9b7e692e-cd09-45ee-804a-db312d9515e5 ("dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"
W0922 16:03:14.670392 2677774 logs.go:138] Found kubelet problem: Sep 22 16:00:22 old-k8s-version-516480 kubelet[731]: E0922 16:00:22.664177 731 pod_workers.go:191] Error syncing pod dcecb091-e954-4a6f-b51e-c8087bb59734 ("metrics-server-9975d5f86-9dfk7_kube-system(dcecb091-e954-4a6f-b51e-c8087bb59734)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0922 16:03:14.670722 2677774 logs.go:138] Found kubelet problem: Sep 22 16:00:29 old-k8s-version-516480 kubelet[731]: E0922 16:00:29.663555 731 pod_workers.go:191] Error syncing pod 9b7e692e-cd09-45ee-804a-db312d9515e5 ("dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"
W0922 16:03:14.673291 2677774 logs.go:138] Found kubelet problem: Sep 22 16:00:37 old-k8s-version-516480 kubelet[731]: E0922 16:00:37.676231 731 pod_workers.go:191] Error syncing pod dcecb091-e954-4a6f-b51e-c8087bb59734 ("metrics-server-9975d5f86-9dfk7_kube-system(dcecb091-e954-4a6f-b51e-c8087bb59734)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = pinging container registry fake.domain: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain: no such host"
W0922 16:03:14.673622 2677774 logs.go:138] Found kubelet problem: Sep 22 16:00:42 old-k8s-version-516480 kubelet[731]: E0922 16:00:42.663980 731 pod_workers.go:191] Error syncing pod 9b7e692e-cd09-45ee-804a-db312d9515e5 ("dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"
W0922 16:03:14.673805 2677774 logs.go:138] Found kubelet problem: Sep 22 16:00:48 old-k8s-version-516480 kubelet[731]: E0922 16:00:48.665894 731 pod_workers.go:191] Error syncing pod dcecb091-e954-4a6f-b51e-c8087bb59734 ("metrics-server-9975d5f86-9dfk7_kube-system(dcecb091-e954-4a6f-b51e-c8087bb59734)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0922 16:03:14.674135 2677774 logs.go:138] Found kubelet problem: Sep 22 16:00:57 old-k8s-version-516480 kubelet[731]: E0922 16:00:57.663548 731 pod_workers.go:191] Error syncing pod 9b7e692e-cd09-45ee-804a-db312d9515e5 ("dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"
W0922 16:03:14.674319 2677774 logs.go:138] Found kubelet problem: Sep 22 16:01:03 old-k8s-version-516480 kubelet[731]: E0922 16:01:03.664687 731 pod_workers.go:191] Error syncing pod dcecb091-e954-4a6f-b51e-c8087bb59734 ("metrics-server-9975d5f86-9dfk7_kube-system(dcecb091-e954-4a6f-b51e-c8087bb59734)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0922 16:03:14.674917 2677774 logs.go:138] Found kubelet problem: Sep 22 16:01:10 old-k8s-version-516480 kubelet[731]: E0922 16:01:10.069563 731 pod_workers.go:191] Error syncing pod 9b7e692e-cd09-45ee-804a-db312d9515e5 ("dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"
W0922 16:03:14.675253 2677774 logs.go:138] Found kubelet problem: Sep 22 16:01:11 old-k8s-version-516480 kubelet[731]: E0922 16:01:11.073348 731 pod_workers.go:191] Error syncing pod 9b7e692e-cd09-45ee-804a-db312d9515e5 ("dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"
W0922 16:03:14.675438 2677774 logs.go:138] Found kubelet problem: Sep 22 16:01:18 old-k8s-version-516480 kubelet[731]: E0922 16:01:18.664091 731 pod_workers.go:191] Error syncing pod dcecb091-e954-4a6f-b51e-c8087bb59734 ("metrics-server-9975d5f86-9dfk7_kube-system(dcecb091-e954-4a6f-b51e-c8087bb59734)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0922 16:03:14.675766 2677774 logs.go:138] Found kubelet problem: Sep 22 16:01:22 old-k8s-version-516480 kubelet[731]: E0922 16:01:22.663469 731 pod_workers.go:191] Error syncing pod 9b7e692e-cd09-45ee-804a-db312d9515e5 ("dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"
W0922 16:03:14.675953 2677774 logs.go:138] Found kubelet problem: Sep 22 16:01:31 old-k8s-version-516480 kubelet[731]: E0922 16:01:31.664295 731 pod_workers.go:191] Error syncing pod dcecb091-e954-4a6f-b51e-c8087bb59734 ("metrics-server-9975d5f86-9dfk7_kube-system(dcecb091-e954-4a6f-b51e-c8087bb59734)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0922 16:03:14.676280 2677774 logs.go:138] Found kubelet problem: Sep 22 16:01:33 old-k8s-version-516480 kubelet[731]: E0922 16:01:33.663565 731 pod_workers.go:191] Error syncing pod 9b7e692e-cd09-45ee-804a-db312d9515e5 ("dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"
W0922 16:03:14.676610 2677774 logs.go:138] Found kubelet problem: Sep 22 16:01:44 old-k8s-version-516480 kubelet[731]: E0922 16:01:44.663519 731 pod_workers.go:191] Error syncing pod 9b7e692e-cd09-45ee-804a-db312d9515e5 ("dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"
W0922 16:03:14.676796 2677774 logs.go:138] Found kubelet problem: Sep 22 16:01:46 old-k8s-version-516480 kubelet[731]: E0922 16:01:46.664063 731 pod_workers.go:191] Error syncing pod dcecb091-e954-4a6f-b51e-c8087bb59734 ("metrics-server-9975d5f86-9dfk7_kube-system(dcecb091-e954-4a6f-b51e-c8087bb59734)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0922 16:03:14.677123 2677774 logs.go:138] Found kubelet problem: Sep 22 16:01:57 old-k8s-version-516480 kubelet[731]: E0922 16:01:57.663546 731 pod_workers.go:191] Error syncing pod 9b7e692e-cd09-45ee-804a-db312d9515e5 ("dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"
W0922 16:03:14.677309 2677774 logs.go:138] Found kubelet problem: Sep 22 16:01:59 old-k8s-version-516480 kubelet[731]: E0922 16:01:59.664339 731 pod_workers.go:191] Error syncing pod dcecb091-e954-4a6f-b51e-c8087bb59734 ("metrics-server-9975d5f86-9dfk7_kube-system(dcecb091-e954-4a6f-b51e-c8087bb59734)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0922 16:03:14.677640 2677774 logs.go:138] Found kubelet problem: Sep 22 16:02:09 old-k8s-version-516480 kubelet[731]: E0922 16:02:09.663527 731 pod_workers.go:191] Error syncing pod 9b7e692e-cd09-45ee-804a-db312d9515e5 ("dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"
W0922 16:03:14.677825 2677774 logs.go:138] Found kubelet problem: Sep 22 16:02:10 old-k8s-version-516480 kubelet[731]: E0922 16:02:10.664283 731 pod_workers.go:191] Error syncing pod dcecb091-e954-4a6f-b51e-c8087bb59734 ("metrics-server-9975d5f86-9dfk7_kube-system(dcecb091-e954-4a6f-b51e-c8087bb59734)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0922 16:03:14.678152 2677774 logs.go:138] Found kubelet problem: Sep 22 16:02:24 old-k8s-version-516480 kubelet[731]: E0922 16:02:24.664676 731 pod_workers.go:191] Error syncing pod 9b7e692e-cd09-45ee-804a-db312d9515e5 ("dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"
W0922 16:03:14.678335 2677774 logs.go:138] Found kubelet problem: Sep 22 16:02:24 old-k8s-version-516480 kubelet[731]: E0922 16:02:24.664799 731 pod_workers.go:191] Error syncing pod dcecb091-e954-4a6f-b51e-c8087bb59734 ("metrics-server-9975d5f86-9dfk7_kube-system(dcecb091-e954-4a6f-b51e-c8087bb59734)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0922 16:03:14.678768 2677774 logs.go:138] Found kubelet problem: Sep 22 16:02:35 old-k8s-version-516480 kubelet[731]: E0922 16:02:35.667623 731 pod_workers.go:191] Error syncing pod dcecb091-e954-4a6f-b51e-c8087bb59734 ("metrics-server-9975d5f86-9dfk7_kube-system(dcecb091-e954-4a6f-b51e-c8087bb59734)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0922 16:03:14.679106 2677774 logs.go:138] Found kubelet problem: Sep 22 16:02:37 old-k8s-version-516480 kubelet[731]: E0922 16:02:37.663543 731 pod_workers.go:191] Error syncing pod 9b7e692e-cd09-45ee-804a-db312d9515e5 ("dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"
W0922 16:03:14.679292 2677774 logs.go:138] Found kubelet problem: Sep 22 16:02:47 old-k8s-version-516480 kubelet[731]: E0922 16:02:47.664131 731 pod_workers.go:191] Error syncing pod dcecb091-e954-4a6f-b51e-c8087bb59734 ("metrics-server-9975d5f86-9dfk7_kube-system(dcecb091-e954-4a6f-b51e-c8087bb59734)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0922 16:03:14.679619 2677774 logs.go:138] Found kubelet problem: Sep 22 16:02:51 old-k8s-version-516480 kubelet[731]: E0922 16:02:51.663557 731 pod_workers.go:191] Error syncing pod 9b7e692e-cd09-45ee-804a-db312d9515e5 ("dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"
W0922 16:03:14.679803 2677774 logs.go:138] Found kubelet problem: Sep 22 16:02:58 old-k8s-version-516480 kubelet[731]: E0922 16:02:58.664091 731 pod_workers.go:191] Error syncing pod dcecb091-e954-4a6f-b51e-c8087bb59734 ("metrics-server-9975d5f86-9dfk7_kube-system(dcecb091-e954-4a6f-b51e-c8087bb59734)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0922 16:03:14.680142 2677774 logs.go:138] Found kubelet problem: Sep 22 16:03:02 old-k8s-version-516480 kubelet[731]: E0922 16:03:02.663546 731 pod_workers.go:191] Error syncing pod 9b7e692e-cd09-45ee-804a-db312d9515e5 ("dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"
W0922 16:03:14.680328 2677774 logs.go:138] Found kubelet problem: Sep 22 16:03:10 old-k8s-version-516480 kubelet[731]: E0922 16:03:10.664090 731 pod_workers.go:191] Error syncing pod dcecb091-e954-4a6f-b51e-c8087bb59734 ("metrics-server-9975d5f86-9dfk7_kube-system(dcecb091-e954-4a6f-b51e-c8087bb59734)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
I0922 16:03:14.680338 2677774 logs.go:123] Gathering logs for coredns [74c18335c2ae08ca4773950befa864f23e6a8bee2767e6f7f6eae0ddb3683ab2] ...
I0922 16:03:14.680353 2677774 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 74c18335c2ae08ca4773950befa864f23e6a8bee2767e6f7f6eae0ddb3683ab2"
I0922 16:03:14.729315 2677774 logs.go:123] Gathering logs for kube-apiserver [7c1fcc5987e5e298748cead12955f5b511798c88fb01575612ee7b9dd567b55f] ...
I0922 16:03:14.729345 2677774 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 7c1fcc5987e5e298748cead12955f5b511798c88fb01575612ee7b9dd567b55f"
I0922 16:03:14.805783 2677774 logs.go:123] Gathering logs for etcd [9c0a027a1be5775f8f8bab62ea785c923794fad9dd784833db780d0c12ec968b] ...
I0922 16:03:14.805824 2677774 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 9c0a027a1be5775f8f8bab62ea785c923794fad9dd784833db780d0c12ec968b"
I0922 16:03:14.859833 2677774 logs.go:123] Gathering logs for kube-controller-manager [132b8fae57bdf9d2a5fc2c5513a926caa1aa8b41366180c05ecd3ba3f700a87f] ...
I0922 16:03:14.859871 2677774 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 132b8fae57bdf9d2a5fc2c5513a926caa1aa8b41366180c05ecd3ba3f700a87f"
I0922 16:03:14.945468 2677774 logs.go:123] Gathering logs for dmesg ...
I0922 16:03:14.945534 2677774 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0922 16:03:14.966220 2677774 logs.go:123] Gathering logs for describe nodes ...
I0922 16:03:14.966253 2677774 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0922 16:03:15.128735 2677774 logs.go:123] Gathering logs for kubernetes-dashboard [8aeff047dc834f6a9760e6b43096ec896a75509fed306bf7078b51c94eca99f3] ...
I0922 16:03:15.128768 2677774 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 8aeff047dc834f6a9760e6b43096ec896a75509fed306bf7078b51c94eca99f3"
I0922 16:03:15.175666 2677774 logs.go:123] Gathering logs for container status ...
I0922 16:03:15.175695 2677774 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0922 16:03:15.218920 2677774 logs.go:123] Gathering logs for kube-proxy [ec9f69248870fe845f3489361c85e0a4b8603653e8b0e35027240720c8219d3d] ...
I0922 16:03:15.219001 2677774 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 ec9f69248870fe845f3489361c85e0a4b8603653e8b0e35027240720c8219d3d"
I0922 16:03:15.258261 2677774 logs.go:123] Gathering logs for storage-provisioner [e4a2ecaf05417d51ac0d7f89b7d4f38dda15dd8046c8d1febc60579492dce3dc] ...
I0922 16:03:15.258288 2677774 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 e4a2ecaf05417d51ac0d7f89b7d4f38dda15dd8046c8d1febc60579492dce3dc"
I0922 16:03:15.297993 2677774 out.go:358] Setting ErrFile to fd 2...
I0922 16:03:15.298017 2677774 out.go:392] TERM=,COLORTERM=, which probably does not support color
W0922 16:03:15.298068 2677774 out.go:270] X Problems detected in kubelet:
W0922 16:03:15.298085 2677774 out.go:270] Sep 22 16:02:47 old-k8s-version-516480 kubelet[731]: E0922 16:02:47.664131 731 pod_workers.go:191] Error syncing pod dcecb091-e954-4a6f-b51e-c8087bb59734 ("metrics-server-9975d5f86-9dfk7_kube-system(dcecb091-e954-4a6f-b51e-c8087bb59734)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0922 16:03:15.298094 2677774 out.go:270] Sep 22 16:02:51 old-k8s-version-516480 kubelet[731]: E0922 16:02:51.663557 731 pod_workers.go:191] Error syncing pod 9b7e692e-cd09-45ee-804a-db312d9515e5 ("dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"
W0922 16:03:15.298106 2677774 out.go:270] Sep 22 16:02:58 old-k8s-version-516480 kubelet[731]: E0922 16:02:58.664091 731 pod_workers.go:191] Error syncing pod dcecb091-e954-4a6f-b51e-c8087bb59734 ("metrics-server-9975d5f86-9dfk7_kube-system(dcecb091-e954-4a6f-b51e-c8087bb59734)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0922 16:03:15.298116 2677774 out.go:270] Sep 22 16:03:02 old-k8s-version-516480 kubelet[731]: E0922 16:03:02.663546 731 pod_workers.go:191] Error syncing pod 9b7e692e-cd09-45ee-804a-db312d9515e5 ("dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"
W0922 16:03:15.298140 2677774 out.go:270] Sep 22 16:03:10 old-k8s-version-516480 kubelet[731]: E0922 16:03:10.664090 731 pod_workers.go:191] Error syncing pod dcecb091-e954-4a6f-b51e-c8087bb59734 ("metrics-server-9975d5f86-9dfk7_kube-system(dcecb091-e954-4a6f-b51e-c8087bb59734)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
I0922 16:03:15.298151 2677774 out.go:358] Setting ErrFile to fd 2...
I0922 16:03:15.298158 2677774 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0922 16:03:18.855839 2681906 logs.go:123] Gathering logs for dmesg ...
I0922 16:03:18.855874 2681906 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0922 16:03:18.873311 2681906 logs.go:123] Gathering logs for storage-provisioner [c9649fe03112847528d915220d1d09db1d4eb743be95e5b881e3203089779681] ...
I0922 16:03:18.873341 2681906 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 c9649fe03112847528d915220d1d09db1d4eb743be95e5b881e3203089779681"
I0922 16:03:18.917331 2681906 logs.go:123] Gathering logs for container status ...
I0922 16:03:18.917371 2681906 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0922 16:03:18.985648 2681906 logs.go:123] Gathering logs for kube-apiserver [f13df5fde0297e4f1e20802c1ce093b57b7d7fa723f8544509bb91f9880faaa0] ...
I0922 16:03:18.985732 2681906 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 f13df5fde0297e4f1e20802c1ce093b57b7d7fa723f8544509bb91f9880faaa0"
I0922 16:03:19.036327 2681906 logs.go:123] Gathering logs for coredns [6562f7c7de3f3d9c08292bc33b953e463ba9e13039bee890e9c1d2c449fbbdf2] ...
I0922 16:03:19.036357 2681906 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 6562f7c7de3f3d9c08292bc33b953e463ba9e13039bee890e9c1d2c449fbbdf2"
I0922 16:03:19.086543 2681906 logs.go:123] Gathering logs for kube-controller-manager [635997381cc62183373066ee36ee89df2b9c9a2c0f5cb6f2ae9c88d351413fae] ...
I0922 16:03:19.086572 2681906 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 635997381cc62183373066ee36ee89df2b9c9a2c0f5cb6f2ae9c88d351413fae"
I0922 16:03:19.159487 2681906 logs.go:123] Gathering logs for kubernetes-dashboard [ba4a19226ec88f010f3223c02bcb1fbb25ab2ceabc15b808701fc4185ac6e9a3] ...
I0922 16:03:19.159520 2681906 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 ba4a19226ec88f010f3223c02bcb1fbb25ab2ceabc15b808701fc4185ac6e9a3"
I0922 16:03:19.200418 2681906 out.go:358] Setting ErrFile to fd 2...
I0922 16:03:19.200444 2681906 out.go:392] TERM=,COLORTERM=, which probably does not support color
W0922 16:03:19.200506 2681906 out.go:270] X Problems detected in kubelet:
W0922 16:03:19.200525 2681906 out.go:270] Sep 22 15:58:42 no-preload-592860 kubelet[744]: E0922 15:58:42.334646 744 reflector.go:158] "Unhandled Error" err="object-\"default\"/\"kube-root-ca.crt\": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:no-preload-592860\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"default\": no relationship found between node 'no-preload-592860' and this object" logger="UnhandledError"
W0922 16:03:19.200533 2681906 out.go:270] Sep 22 15:58:42 no-preload-592860 kubelet[744]: W0922 15:58:42.335086 744 reflector.go:561] object-"kube-system"/"kube-root-ca.crt": failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:no-preload-592860" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'no-preload-592860' and this object
W0922 16:03:19.200540 2681906 out.go:270] Sep 22 15:58:42 no-preload-592860 kubelet[744]: E0922 15:58:42.335118 744 reflector.go:158] "Unhandled Error" err="object-\"kube-system\"/\"kube-root-ca.crt\": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:no-preload-592860\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"kube-system\": no relationship found between node 'no-preload-592860' and this object" logger="UnhandledError"
W0922 16:03:19.200664 2681906 out.go:270] Sep 22 15:58:42 no-preload-592860 kubelet[744]: W0922 15:58:42.335403 744 reflector.go:561] object-"kube-system"/"kube-proxy": failed to list *v1.ConfigMap: configmaps "kube-proxy" is forbidden: User "system:node:no-preload-592860" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'no-preload-592860' and this object
W0922 16:03:19.200679 2681906 out.go:270] Sep 22 15:58:42 no-preload-592860 kubelet[744]: E0922 15:58:42.335430 744 reflector.go:158] "Unhandled Error" err="object-\"kube-system\"/\"kube-proxy\": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps \"kube-proxy\" is forbidden: User \"system:node:no-preload-592860\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"kube-system\": no relationship found between node 'no-preload-592860' and this object" logger="UnhandledError"
I0922 16:03:19.200686 2681906 out.go:358] Setting ErrFile to fd 2...
I0922 16:03:19.200694 2681906 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0922 16:03:25.299726 2677774 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0922 16:03:25.312356 2677774 api_server.go:72] duration metric: took 5m57.609951104s to wait for apiserver process to appear ...
I0922 16:03:25.312380 2677774 api_server.go:88] waiting for apiserver healthz status ...
I0922 16:03:25.312417 2677774 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I0922 16:03:25.312472 2677774 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0922 16:03:25.354045 2677774 cri.go:89] found id: "7c1fcc5987e5e298748cead12955f5b511798c88fb01575612ee7b9dd567b55f"
I0922 16:03:25.354105 2677774 cri.go:89] found id: ""
I0922 16:03:25.354112 2677774 logs.go:276] 1 containers: [7c1fcc5987e5e298748cead12955f5b511798c88fb01575612ee7b9dd567b55f]
I0922 16:03:25.354170 2677774 ssh_runner.go:195] Run: which crictl
I0922 16:03:25.358132 2677774 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I0922 16:03:25.358203 2677774 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0922 16:03:25.396145 2677774 cri.go:89] found id: "9c0a027a1be5775f8f8bab62ea785c923794fad9dd784833db780d0c12ec968b"
I0922 16:03:25.396167 2677774 cri.go:89] found id: ""
I0922 16:03:25.396175 2677774 logs.go:276] 1 containers: [9c0a027a1be5775f8f8bab62ea785c923794fad9dd784833db780d0c12ec968b]
I0922 16:03:25.396229 2677774 ssh_runner.go:195] Run: which crictl
I0922 16:03:25.399809 2677774 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I0922 16:03:25.399883 2677774 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0922 16:03:25.439685 2677774 cri.go:89] found id: "74c18335c2ae08ca4773950befa864f23e6a8bee2767e6f7f6eae0ddb3683ab2"
I0922 16:03:25.439709 2677774 cri.go:89] found id: ""
I0922 16:03:25.439717 2677774 logs.go:276] 1 containers: [74c18335c2ae08ca4773950befa864f23e6a8bee2767e6f7f6eae0ddb3683ab2]
I0922 16:03:25.439776 2677774 ssh_runner.go:195] Run: which crictl
I0922 16:03:25.443344 2677774 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I0922 16:03:25.443416 2677774 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0922 16:03:25.480825 2677774 cri.go:89] found id: "30f03ae4101098906a64fcc1aa6671c8702b5191e639bfa1be31ac12b0b1b75f"
I0922 16:03:25.480850 2677774 cri.go:89] found id: ""
I0922 16:03:25.480858 2677774 logs.go:276] 1 containers: [30f03ae4101098906a64fcc1aa6671c8702b5191e639bfa1be31ac12b0b1b75f]
I0922 16:03:25.480939 2677774 ssh_runner.go:195] Run: which crictl
I0922 16:03:25.484490 2677774 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I0922 16:03:25.484565 2677774 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0922 16:03:25.521254 2677774 cri.go:89] found id: "ec9f69248870fe845f3489361c85e0a4b8603653e8b0e35027240720c8219d3d"
I0922 16:03:25.521277 2677774 cri.go:89] found id: ""
I0922 16:03:25.521285 2677774 logs.go:276] 1 containers: [ec9f69248870fe845f3489361c85e0a4b8603653e8b0e35027240720c8219d3d]
I0922 16:03:25.521355 2677774 ssh_runner.go:195] Run: which crictl
I0922 16:03:25.525127 2677774 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I0922 16:03:25.525199 2677774 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0922 16:03:25.564263 2677774 cri.go:89] found id: "132b8fae57bdf9d2a5fc2c5513a926caa1aa8b41366180c05ecd3ba3f700a87f"
I0922 16:03:25.564293 2677774 cri.go:89] found id: ""
I0922 16:03:25.564302 2677774 logs.go:276] 1 containers: [132b8fae57bdf9d2a5fc2c5513a926caa1aa8b41366180c05ecd3ba3f700a87f]
I0922 16:03:25.564360 2677774 ssh_runner.go:195] Run: which crictl
I0922 16:03:25.567949 2677774 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I0922 16:03:25.568025 2677774 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0922 16:03:25.605454 2677774 cri.go:89] found id: "817a0d84fdbc60639f69c50c14178f79e4829f83ef55c42936ea8baf284b5fb2"
I0922 16:03:25.605480 2677774 cri.go:89] found id: ""
I0922 16:03:25.605489 2677774 logs.go:276] 1 containers: [817a0d84fdbc60639f69c50c14178f79e4829f83ef55c42936ea8baf284b5fb2]
I0922 16:03:25.605600 2677774 ssh_runner.go:195] Run: which crictl
I0922 16:03:25.609248 2677774 cri.go:54] listing CRI containers in root : {State:all Name:kubernetes-dashboard Namespaces:[]}
I0922 16:03:25.609369 2677774 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
I0922 16:03:25.650258 2677774 cri.go:89] found id: "8aeff047dc834f6a9760e6b43096ec896a75509fed306bf7078b51c94eca99f3"
I0922 16:03:25.650282 2677774 cri.go:89] found id: ""
I0922 16:03:25.650290 2677774 logs.go:276] 1 containers: [8aeff047dc834f6a9760e6b43096ec896a75509fed306bf7078b51c94eca99f3]
I0922 16:03:25.650346 2677774 ssh_runner.go:195] Run: which crictl
I0922 16:03:25.653805 2677774 cri.go:54] listing CRI containers in root : {State:all Name:storage-provisioner Namespaces:[]}
I0922 16:03:25.653903 2677774 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
I0922 16:03:25.707409 2677774 cri.go:89] found id: "e4a2ecaf05417d51ac0d7f89b7d4f38dda15dd8046c8d1febc60579492dce3dc"
I0922 16:03:25.707477 2677774 cri.go:89] found id: "45e9854e642ac4e51de161c0467764011cb66eb499bb2602b89c2f55ef4ba4f1"
I0922 16:03:25.707498 2677774 cri.go:89] found id: ""
I0922 16:03:25.707524 2677774 logs.go:276] 2 containers: [e4a2ecaf05417d51ac0d7f89b7d4f38dda15dd8046c8d1febc60579492dce3dc 45e9854e642ac4e51de161c0467764011cb66eb499bb2602b89c2f55ef4ba4f1]
I0922 16:03:25.707610 2677774 ssh_runner.go:195] Run: which crictl
I0922 16:03:25.711240 2677774 ssh_runner.go:195] Run: which crictl
I0922 16:03:25.714461 2677774 logs.go:123] Gathering logs for describe nodes ...
I0922 16:03:25.714488 2677774 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0922 16:03:25.865134 2677774 logs.go:123] Gathering logs for etcd [9c0a027a1be5775f8f8bab62ea785c923794fad9dd784833db780d0c12ec968b] ...
I0922 16:03:25.865165 2677774 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 9c0a027a1be5775f8f8bab62ea785c923794fad9dd784833db780d0c12ec968b"
I0922 16:03:25.920843 2677774 logs.go:123] Gathering logs for kube-scheduler [30f03ae4101098906a64fcc1aa6671c8702b5191e639bfa1be31ac12b0b1b75f] ...
I0922 16:03:25.920875 2677774 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 30f03ae4101098906a64fcc1aa6671c8702b5191e639bfa1be31ac12b0b1b75f"
I0922 16:03:25.973587 2677774 logs.go:123] Gathering logs for kube-proxy [ec9f69248870fe845f3489361c85e0a4b8603653e8b0e35027240720c8219d3d] ...
I0922 16:03:25.973620 2677774 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 ec9f69248870fe845f3489361c85e0a4b8603653e8b0e35027240720c8219d3d"
I0922 16:03:26.013979 2677774 logs.go:123] Gathering logs for kubelet ...
I0922 16:03:26.014058 2677774 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
W0922 16:03:26.064198 2677774 logs.go:138] Found kubelet problem: Sep 22 15:57:46 old-k8s-version-516480 kubelet[731]: E0922 15:57:46.900162 731 reflector.go:138] object-"kube-system"/"kube-proxy-token-qd9mk": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kube-proxy-token-qd9mk" is forbidden: User "system:node:old-k8s-version-516480" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-516480' and this object
W0922 16:03:26.064468 2677774 logs.go:138] Found kubelet problem: Sep 22 15:57:46 old-k8s-version-516480 kubelet[731]: E0922 15:57:46.900230 731 reflector.go:138] object-"kube-system"/"kindnet-token-4qmzm": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kindnet-token-4qmzm" is forbidden: User "system:node:old-k8s-version-516480" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-516480' and this object
W0922 16:03:26.064725 2677774 logs.go:138] Found kubelet problem: Sep 22 15:57:46 old-k8s-version-516480 kubelet[731]: E0922 15:57:46.900281 731 reflector.go:138] object-"kube-system"/"storage-provisioner-token-8jzbw": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "storage-provisioner-token-8jzbw" is forbidden: User "system:node:old-k8s-version-516480" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-516480' and this object
W0922 16:03:26.064959 2677774 logs.go:138] Found kubelet problem: Sep 22 15:57:46 old-k8s-version-516480 kubelet[731]: E0922 15:57:46.900346 731 reflector.go:138] object-"kube-system"/"coredns-token-s54l7": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "coredns-token-s54l7" is forbidden: User "system:node:old-k8s-version-516480" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-516480' and this object
W0922 16:03:26.065191 2677774 logs.go:138] Found kubelet problem: Sep 22 15:57:46 old-k8s-version-516480 kubelet[731]: E0922 15:57:46.900399 731 reflector.go:138] object-"default"/"default-token-bfhkm": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "default-token-bfhkm" is forbidden: User "system:node:old-k8s-version-516480" cannot list resource "secrets" in API group "" in the namespace "default": no relationship found between node 'old-k8s-version-516480' and this object
W0922 16:03:26.065416 2677774 logs.go:138] Found kubelet problem: Sep 22 15:57:46 old-k8s-version-516480 kubelet[731]: E0922 15:57:46.900456 731 reflector.go:138] object-"kube-system"/"coredns": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "coredns" is forbidden: User "system:node:old-k8s-version-516480" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-516480' and this object
W0922 16:03:26.065643 2677774 logs.go:138] Found kubelet problem: Sep 22 15:57:46 old-k8s-version-516480 kubelet[731]: E0922 15:57:46.900499 731 reflector.go:138] object-"kube-system"/"kube-proxy": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-proxy" is forbidden: User "system:node:old-k8s-version-516480" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-516480' and this object
W0922 16:03:26.069190 2677774 logs.go:138] Found kubelet problem: Sep 22 15:57:47 old-k8s-version-516480 kubelet[731]: E0922 15:57:47.566740 731 reflector.go:138] object-"kube-system"/"metrics-server-token-qckbp": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "metrics-server-token-qckbp" is forbidden: User "system:node:old-k8s-version-516480" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-516480' and this object
W0922 16:03:26.077104 2677774 logs.go:138] Found kubelet problem: Sep 22 15:57:50 old-k8s-version-516480 kubelet[731]: E0922 15:57:50.088641 731 pod_workers.go:191] Error syncing pod dcecb091-e954-4a6f-b51e-c8087bb59734 ("metrics-server-9975d5f86-9dfk7_kube-system(dcecb091-e954-4a6f-b51e-c8087bb59734)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = pinging container registry fake.domain: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain: no such host"
W0922 16:03:26.077310 2677774 logs.go:138] Found kubelet problem: Sep 22 15:57:50 old-k8s-version-516480 kubelet[731]: E0922 15:57:50.733867 731 pod_workers.go:191] Error syncing pod dcecb091-e954-4a6f-b51e-c8087bb59734 ("metrics-server-9975d5f86-9dfk7_kube-system(dcecb091-e954-4a6f-b51e-c8087bb59734)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0922 16:03:26.079498 2677774 logs.go:138] Found kubelet problem: Sep 22 15:58:05 old-k8s-version-516480 kubelet[731]: E0922 15:58:05.674769 731 pod_workers.go:191] Error syncing pod dcecb091-e954-4a6f-b51e-c8087bb59734 ("metrics-server-9975d5f86-9dfk7_kube-system(dcecb091-e954-4a6f-b51e-c8087bb59734)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = pinging container registry fake.domain: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain: no such host"
W0922 16:03:26.081539 2677774 logs.go:138] Found kubelet problem: Sep 22 15:58:12 old-k8s-version-516480 kubelet[731]: E0922 15:58:12.804811 731 pod_workers.go:191] Error syncing pod 9b7e692e-cd09-45ee-804a-db312d9515e5 ("dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"
W0922 16:03:26.082000 2677774 logs.go:138] Found kubelet problem: Sep 22 15:58:13 old-k8s-version-516480 kubelet[731]: E0922 15:58:13.807220 731 pod_workers.go:191] Error syncing pod 9b7e692e-cd09-45ee-804a-db312d9515e5 ("dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"
W0922 16:03:26.082188 2677774 logs.go:138] Found kubelet problem: Sep 22 15:58:17 old-k8s-version-516480 kubelet[731]: E0922 15:58:17.664740 731 pod_workers.go:191] Error syncing pod dcecb091-e954-4a6f-b51e-c8087bb59734 ("metrics-server-9975d5f86-9dfk7_kube-system(dcecb091-e954-4a6f-b51e-c8087bb59734)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0922 16:03:26.082649 2677774 logs.go:138] Found kubelet problem: Sep 22 15:58:20 old-k8s-version-516480 kubelet[731]: E0922 15:58:20.190220 731 pod_workers.go:191] Error syncing pod 9b7e692e-cd09-45ee-804a-db312d9515e5 ("dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"
W0922 16:03:26.083266 2677774 logs.go:138] Found kubelet problem: Sep 22 15:58:30 old-k8s-version-516480 kubelet[731]: E0922 15:58:30.841934 731 pod_workers.go:191] Error syncing pod 9b7e692e-cd09-45ee-804a-db312d9515e5 ("dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"
W0922 16:03:26.085397 2677774 logs.go:138] Found kubelet problem: Sep 22 15:58:32 old-k8s-version-516480 kubelet[731]: E0922 15:58:32.675646 731 pod_workers.go:191] Error syncing pod dcecb091-e954-4a6f-b51e-c8087bb59734 ("metrics-server-9975d5f86-9dfk7_kube-system(dcecb091-e954-4a6f-b51e-c8087bb59734)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = pinging container registry fake.domain: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain: no such host"
W0922 16:03:26.085737 2677774 logs.go:138] Found kubelet problem: Sep 22 15:58:40 old-k8s-version-516480 kubelet[731]: E0922 15:58:40.190704 731 pod_workers.go:191] Error syncing pod 9b7e692e-cd09-45ee-804a-db312d9515e5 ("dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"
W0922 16:03:26.085924 2677774 logs.go:138] Found kubelet problem: Sep 22 15:58:47 old-k8s-version-516480 kubelet[731]: E0922 15:58:47.663896 731 pod_workers.go:191] Error syncing pod dcecb091-e954-4a6f-b51e-c8087bb59734 ("metrics-server-9975d5f86-9dfk7_kube-system(dcecb091-e954-4a6f-b51e-c8087bb59734)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0922 16:03:26.086518 2677774 logs.go:138] Found kubelet problem: Sep 22 15:58:51 old-k8s-version-516480 kubelet[731]: E0922 15:58:51.872475 731 pod_workers.go:191] Error syncing pod 9b7e692e-cd09-45ee-804a-db312d9515e5 ("dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"
W0922 16:03:26.086844 2677774 logs.go:138] Found kubelet problem: Sep 22 15:59:00 old-k8s-version-516480 kubelet[731]: E0922 15:59:00.190211 731 pod_workers.go:191] Error syncing pod 9b7e692e-cd09-45ee-804a-db312d9515e5 ("dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"
W0922 16:03:26.087040 2677774 logs.go:138] Found kubelet problem: Sep 22 15:59:02 old-k8s-version-516480 kubelet[731]: E0922 15:59:02.663955 731 pod_workers.go:191] Error syncing pod dcecb091-e954-4a6f-b51e-c8087bb59734 ("metrics-server-9975d5f86-9dfk7_kube-system(dcecb091-e954-4a6f-b51e-c8087bb59734)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0922 16:03:26.087373 2677774 logs.go:138] Found kubelet problem: Sep 22 15:59:13 old-k8s-version-516480 kubelet[731]: E0922 15:59:13.664941 731 pod_workers.go:191] Error syncing pod 9b7e692e-cd09-45ee-804a-db312d9515e5 ("dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"
W0922 16:03:26.089422 2677774 logs.go:138] Found kubelet problem: Sep 22 15:59:16 old-k8s-version-516480 kubelet[731]: E0922 15:59:16.691143 731 pod_workers.go:191] Error syncing pod dcecb091-e954-4a6f-b51e-c8087bb59734 ("metrics-server-9975d5f86-9dfk7_kube-system(dcecb091-e954-4a6f-b51e-c8087bb59734)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = pinging container registry fake.domain: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain: no such host"
W0922 16:03:26.089762 2677774 logs.go:138] Found kubelet problem: Sep 22 15:59:25 old-k8s-version-516480 kubelet[731]: E0922 15:59:25.663919 731 pod_workers.go:191] Error syncing pod 9b7e692e-cd09-45ee-804a-db312d9515e5 ("dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"
W0922 16:03:26.089948 2677774 logs.go:138] Found kubelet problem: Sep 22 15:59:27 old-k8s-version-516480 kubelet[731]: E0922 15:59:27.664531 731 pod_workers.go:191] Error syncing pod dcecb091-e954-4a6f-b51e-c8087bb59734 ("metrics-server-9975d5f86-9dfk7_kube-system(dcecb091-e954-4a6f-b51e-c8087bb59734)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0922 16:03:26.090540 2677774 logs.go:138] Found kubelet problem: Sep 22 15:59:40 old-k8s-version-516480 kubelet[731]: E0922 15:59:40.937803 731 pod_workers.go:191] Error syncing pod 9b7e692e-cd09-45ee-804a-db312d9515e5 ("dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"
W0922 16:03:26.090726 2677774 logs.go:138] Found kubelet problem: Sep 22 15:59:41 old-k8s-version-516480 kubelet[731]: E0922 15:59:41.664383 731 pod_workers.go:191] Error syncing pod dcecb091-e954-4a6f-b51e-c8087bb59734 ("metrics-server-9975d5f86-9dfk7_kube-system(dcecb091-e954-4a6f-b51e-c8087bb59734)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0922 16:03:26.091310 2677774 logs.go:138] Found kubelet problem: Sep 22 15:59:50 old-k8s-version-516480 kubelet[731]: E0922 15:59:50.190598 731 pod_workers.go:191] Error syncing pod 9b7e692e-cd09-45ee-804a-db312d9515e5 ("dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"
W0922 16:03:26.091520 2677774 logs.go:138] Found kubelet problem: Sep 22 15:59:52 old-k8s-version-516480 kubelet[731]: E0922 15:59:52.664210 731 pod_workers.go:191] Error syncing pod dcecb091-e954-4a6f-b51e-c8087bb59734 ("metrics-server-9975d5f86-9dfk7_kube-system(dcecb091-e954-4a6f-b51e-c8087bb59734)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0922 16:03:26.091857 2677774 logs.go:138] Found kubelet problem: Sep 22 16:00:04 old-k8s-version-516480 kubelet[731]: E0922 16:00:04.663628 731 pod_workers.go:191] Error syncing pod 9b7e692e-cd09-45ee-804a-db312d9515e5 ("dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"
W0922 16:03:26.092049 2677774 logs.go:138] Found kubelet problem: Sep 22 16:00:07 old-k8s-version-516480 kubelet[731]: E0922 16:00:07.664303 731 pod_workers.go:191] Error syncing pod dcecb091-e954-4a6f-b51e-c8087bb59734 ("metrics-server-9975d5f86-9dfk7_kube-system(dcecb091-e954-4a6f-b51e-c8087bb59734)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0922 16:03:26.092451 2677774 logs.go:138] Found kubelet problem: Sep 22 16:00:16 old-k8s-version-516480 kubelet[731]: E0922 16:00:16.663530 731 pod_workers.go:191] Error syncing pod 9b7e692e-cd09-45ee-804a-db312d9515e5 ("dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"
W0922 16:03:26.092665 2677774 logs.go:138] Found kubelet problem: Sep 22 16:00:22 old-k8s-version-516480 kubelet[731]: E0922 16:00:22.664177 731 pod_workers.go:191] Error syncing pod dcecb091-e954-4a6f-b51e-c8087bb59734 ("metrics-server-9975d5f86-9dfk7_kube-system(dcecb091-e954-4a6f-b51e-c8087bb59734)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0922 16:03:26.093044 2677774 logs.go:138] Found kubelet problem: Sep 22 16:00:29 old-k8s-version-516480 kubelet[731]: E0922 16:00:29.663555 731 pod_workers.go:191] Error syncing pod 9b7e692e-cd09-45ee-804a-db312d9515e5 ("dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"
W0922 16:03:26.097746 2677774 logs.go:138] Found kubelet problem: Sep 22 16:00:37 old-k8s-version-516480 kubelet[731]: E0922 16:00:37.676231 731 pod_workers.go:191] Error syncing pod dcecb091-e954-4a6f-b51e-c8087bb59734 ("metrics-server-9975d5f86-9dfk7_kube-system(dcecb091-e954-4a6f-b51e-c8087bb59734)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = pinging container registry fake.domain: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain: no such host"
W0922 16:03:26.098093 2677774 logs.go:138] Found kubelet problem: Sep 22 16:00:42 old-k8s-version-516480 kubelet[731]: E0922 16:00:42.663980 731 pod_workers.go:191] Error syncing pod 9b7e692e-cd09-45ee-804a-db312d9515e5 ("dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"
W0922 16:03:26.098280 2677774 logs.go:138] Found kubelet problem: Sep 22 16:00:48 old-k8s-version-516480 kubelet[731]: E0922 16:00:48.665894 731 pod_workers.go:191] Error syncing pod dcecb091-e954-4a6f-b51e-c8087bb59734 ("metrics-server-9975d5f86-9dfk7_kube-system(dcecb091-e954-4a6f-b51e-c8087bb59734)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0922 16:03:26.098656 2677774 logs.go:138] Found kubelet problem: Sep 22 16:00:57 old-k8s-version-516480 kubelet[731]: E0922 16:00:57.663548 731 pod_workers.go:191] Error syncing pod 9b7e692e-cd09-45ee-804a-db312d9515e5 ("dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"
W0922 16:03:26.098851 2677774 logs.go:138] Found kubelet problem: Sep 22 16:01:03 old-k8s-version-516480 kubelet[731]: E0922 16:01:03.664687 731 pod_workers.go:191] Error syncing pod dcecb091-e954-4a6f-b51e-c8087bb59734 ("metrics-server-9975d5f86-9dfk7_kube-system(dcecb091-e954-4a6f-b51e-c8087bb59734)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0922 16:03:26.100437 2677774 logs.go:138] Found kubelet problem: Sep 22 16:01:10 old-k8s-version-516480 kubelet[731]: E0922 16:01:10.069563 731 pod_workers.go:191] Error syncing pod 9b7e692e-cd09-45ee-804a-db312d9515e5 ("dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"
W0922 16:03:26.100776 2677774 logs.go:138] Found kubelet problem: Sep 22 16:01:11 old-k8s-version-516480 kubelet[731]: E0922 16:01:11.073348 731 pod_workers.go:191] Error syncing pod 9b7e692e-cd09-45ee-804a-db312d9515e5 ("dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"
W0922 16:03:26.100964 2677774 logs.go:138] Found kubelet problem: Sep 22 16:01:18 old-k8s-version-516480 kubelet[731]: E0922 16:01:18.664091 731 pod_workers.go:191] Error syncing pod dcecb091-e954-4a6f-b51e-c8087bb59734 ("metrics-server-9975d5f86-9dfk7_kube-system(dcecb091-e954-4a6f-b51e-c8087bb59734)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0922 16:03:26.101292 2677774 logs.go:138] Found kubelet problem: Sep 22 16:01:22 old-k8s-version-516480 kubelet[731]: E0922 16:01:22.663469 731 pod_workers.go:191] Error syncing pod 9b7e692e-cd09-45ee-804a-db312d9515e5 ("dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"
W0922 16:03:26.101477 2677774 logs.go:138] Found kubelet problem: Sep 22 16:01:31 old-k8s-version-516480 kubelet[731]: E0922 16:01:31.664295 731 pod_workers.go:191] Error syncing pod dcecb091-e954-4a6f-b51e-c8087bb59734 ("metrics-server-9975d5f86-9dfk7_kube-system(dcecb091-e954-4a6f-b51e-c8087bb59734)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0922 16:03:26.101816 2677774 logs.go:138] Found kubelet problem: Sep 22 16:01:33 old-k8s-version-516480 kubelet[731]: E0922 16:01:33.663565 731 pod_workers.go:191] Error syncing pod 9b7e692e-cd09-45ee-804a-db312d9515e5 ("dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"
W0922 16:03:26.102147 2677774 logs.go:138] Found kubelet problem: Sep 22 16:01:44 old-k8s-version-516480 kubelet[731]: E0922 16:01:44.663519 731 pod_workers.go:191] Error syncing pod 9b7e692e-cd09-45ee-804a-db312d9515e5 ("dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"
W0922 16:03:26.102330 2677774 logs.go:138] Found kubelet problem: Sep 22 16:01:46 old-k8s-version-516480 kubelet[731]: E0922 16:01:46.664063 731 pod_workers.go:191] Error syncing pod dcecb091-e954-4a6f-b51e-c8087bb59734 ("metrics-server-9975d5f86-9dfk7_kube-system(dcecb091-e954-4a6f-b51e-c8087bb59734)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0922 16:03:26.102660 2677774 logs.go:138] Found kubelet problem: Sep 22 16:01:57 old-k8s-version-516480 kubelet[731]: E0922 16:01:57.663546 731 pod_workers.go:191] Error syncing pod 9b7e692e-cd09-45ee-804a-db312d9515e5 ("dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"
W0922 16:03:26.102849 2677774 logs.go:138] Found kubelet problem: Sep 22 16:01:59 old-k8s-version-516480 kubelet[731]: E0922 16:01:59.664339 731 pod_workers.go:191] Error syncing pod dcecb091-e954-4a6f-b51e-c8087bb59734 ("metrics-server-9975d5f86-9dfk7_kube-system(dcecb091-e954-4a6f-b51e-c8087bb59734)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0922 16:03:26.103194 2677774 logs.go:138] Found kubelet problem: Sep 22 16:02:09 old-k8s-version-516480 kubelet[731]: E0922 16:02:09.663527 731 pod_workers.go:191] Error syncing pod 9b7e692e-cd09-45ee-804a-db312d9515e5 ("dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"
W0922 16:03:26.103380 2677774 logs.go:138] Found kubelet problem: Sep 22 16:02:10 old-k8s-version-516480 kubelet[731]: E0922 16:02:10.664283 731 pod_workers.go:191] Error syncing pod dcecb091-e954-4a6f-b51e-c8087bb59734 ("metrics-server-9975d5f86-9dfk7_kube-system(dcecb091-e954-4a6f-b51e-c8087bb59734)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0922 16:03:26.103710 2677774 logs.go:138] Found kubelet problem: Sep 22 16:02:24 old-k8s-version-516480 kubelet[731]: E0922 16:02:24.664676 731 pod_workers.go:191] Error syncing pod 9b7e692e-cd09-45ee-804a-db312d9515e5 ("dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"
W0922 16:03:26.103895 2677774 logs.go:138] Found kubelet problem: Sep 22 16:02:24 old-k8s-version-516480 kubelet[731]: E0922 16:02:24.664799 731 pod_workers.go:191] Error syncing pod dcecb091-e954-4a6f-b51e-c8087bb59734 ("metrics-server-9975d5f86-9dfk7_kube-system(dcecb091-e954-4a6f-b51e-c8087bb59734)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0922 16:03:26.104342 2677774 logs.go:138] Found kubelet problem: Sep 22 16:02:35 old-k8s-version-516480 kubelet[731]: E0922 16:02:35.667623 731 pod_workers.go:191] Error syncing pod dcecb091-e954-4a6f-b51e-c8087bb59734 ("metrics-server-9975d5f86-9dfk7_kube-system(dcecb091-e954-4a6f-b51e-c8087bb59734)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0922 16:03:26.104672 2677774 logs.go:138] Found kubelet problem: Sep 22 16:02:37 old-k8s-version-516480 kubelet[731]: E0922 16:02:37.663543 731 pod_workers.go:191] Error syncing pod 9b7e692e-cd09-45ee-804a-db312d9515e5 ("dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"
W0922 16:03:26.104855 2677774 logs.go:138] Found kubelet problem: Sep 22 16:02:47 old-k8s-version-516480 kubelet[731]: E0922 16:02:47.664131 731 pod_workers.go:191] Error syncing pod dcecb091-e954-4a6f-b51e-c8087bb59734 ("metrics-server-9975d5f86-9dfk7_kube-system(dcecb091-e954-4a6f-b51e-c8087bb59734)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0922 16:03:26.105185 2677774 logs.go:138] Found kubelet problem: Sep 22 16:02:51 old-k8s-version-516480 kubelet[731]: E0922 16:02:51.663557 731 pod_workers.go:191] Error syncing pod 9b7e692e-cd09-45ee-804a-db312d9515e5 ("dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"
W0922 16:03:26.105371 2677774 logs.go:138] Found kubelet problem: Sep 22 16:02:58 old-k8s-version-516480 kubelet[731]: E0922 16:02:58.664091 731 pod_workers.go:191] Error syncing pod dcecb091-e954-4a6f-b51e-c8087bb59734 ("metrics-server-9975d5f86-9dfk7_kube-system(dcecb091-e954-4a6f-b51e-c8087bb59734)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0922 16:03:26.105698 2677774 logs.go:138] Found kubelet problem: Sep 22 16:03:02 old-k8s-version-516480 kubelet[731]: E0922 16:03:02.663546 731 pod_workers.go:191] Error syncing pod 9b7e692e-cd09-45ee-804a-db312d9515e5 ("dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"
W0922 16:03:26.105881 2677774 logs.go:138] Found kubelet problem: Sep 22 16:03:10 old-k8s-version-516480 kubelet[731]: E0922 16:03:10.664090 731 pod_workers.go:191] Error syncing pod dcecb091-e954-4a6f-b51e-c8087bb59734 ("metrics-server-9975d5f86-9dfk7_kube-system(dcecb091-e954-4a6f-b51e-c8087bb59734)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0922 16:03:26.106209 2677774 logs.go:138] Found kubelet problem: Sep 22 16:03:14 old-k8s-version-516480 kubelet[731]: E0922 16:03:14.663628 731 pod_workers.go:191] Error syncing pod 9b7e692e-cd09-45ee-804a-db312d9515e5 ("dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"
W0922 16:03:26.106540 2677774 logs.go:138] Found kubelet problem: Sep 22 16:03:25 old-k8s-version-516480 kubelet[731]: E0922 16:03:25.665238 731 pod_workers.go:191] Error syncing pod 9b7e692e-cd09-45ee-804a-db312d9515e5 ("dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"
W0922 16:03:26.108605 2677774 logs.go:138] Found kubelet problem: Sep 22 16:03:25 old-k8s-version-516480 kubelet[731]: E0922 16:03:25.691950 731 pod_workers.go:191] Error syncing pod dcecb091-e954-4a6f-b51e-c8087bb59734 ("metrics-server-9975d5f86-9dfk7_kube-system(dcecb091-e954-4a6f-b51e-c8087bb59734)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = pinging container registry fake.domain: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain: no such host"
I0922 16:03:26.108617 2677774 logs.go:123] Gathering logs for coredns [74c18335c2ae08ca4773950befa864f23e6a8bee2767e6f7f6eae0ddb3683ab2] ...
I0922 16:03:26.108631 2677774 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 74c18335c2ae08ca4773950befa864f23e6a8bee2767e6f7f6eae0ddb3683ab2"
I0922 16:03:26.151673 2677774 logs.go:123] Gathering logs for kubernetes-dashboard [8aeff047dc834f6a9760e6b43096ec896a75509fed306bf7078b51c94eca99f3] ...
I0922 16:03:26.151704 2677774 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 8aeff047dc834f6a9760e6b43096ec896a75509fed306bf7078b51c94eca99f3"
I0922 16:03:26.192315 2677774 logs.go:123] Gathering logs for kindnet [817a0d84fdbc60639f69c50c14178f79e4829f83ef55c42936ea8baf284b5fb2] ...
I0922 16:03:26.192348 2677774 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 817a0d84fdbc60639f69c50c14178f79e4829f83ef55c42936ea8baf284b5fb2"
I0922 16:03:26.270007 2677774 logs.go:123] Gathering logs for storage-provisioner [45e9854e642ac4e51de161c0467764011cb66eb499bb2602b89c2f55ef4ba4f1] ...
I0922 16:03:26.270045 2677774 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 45e9854e642ac4e51de161c0467764011cb66eb499bb2602b89c2f55ef4ba4f1"
I0922 16:03:26.315316 2677774 logs.go:123] Gathering logs for container status ...
I0922 16:03:26.315345 2677774 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0922 16:03:26.366973 2677774 logs.go:123] Gathering logs for dmesg ...
I0922 16:03:26.367009 2677774 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0922 16:03:26.383923 2677774 logs.go:123] Gathering logs for kube-apiserver [7c1fcc5987e5e298748cead12955f5b511798c88fb01575612ee7b9dd567b55f] ...
I0922 16:03:26.384005 2677774 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 7c1fcc5987e5e298748cead12955f5b511798c88fb01575612ee7b9dd567b55f"
I0922 16:03:26.454554 2677774 logs.go:123] Gathering logs for kube-controller-manager [132b8fae57bdf9d2a5fc2c5513a926caa1aa8b41366180c05ecd3ba3f700a87f] ...
I0922 16:03:26.454588 2677774 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 132b8fae57bdf9d2a5fc2c5513a926caa1aa8b41366180c05ecd3ba3f700a87f"
I0922 16:03:26.552246 2677774 logs.go:123] Gathering logs for storage-provisioner [e4a2ecaf05417d51ac0d7f89b7d4f38dda15dd8046c8d1febc60579492dce3dc] ...
I0922 16:03:26.552286 2677774 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 e4a2ecaf05417d51ac0d7f89b7d4f38dda15dd8046c8d1febc60579492dce3dc"
I0922 16:03:26.597494 2677774 logs.go:123] Gathering logs for CRI-O ...
I0922 16:03:26.597523 2677774 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I0922 16:03:26.687849 2677774 out.go:358] Setting ErrFile to fd 2...
I0922 16:03:26.687883 2677774 out.go:392] TERM=,COLORTERM=, which probably does not support color
W0922 16:03:26.687953 2677774 out.go:270] X Problems detected in kubelet:
W0922 16:03:26.687966 2677774 out.go:270] Sep 22 16:03:02 old-k8s-version-516480 kubelet[731]: E0922 16:03:02.663546 731 pod_workers.go:191] Error syncing pod 9b7e692e-cd09-45ee-804a-db312d9515e5 ("dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"
W0922 16:03:26.687976 2677774 out.go:270] Sep 22 16:03:10 old-k8s-version-516480 kubelet[731]: E0922 16:03:10.664090 731 pod_workers.go:191] Error syncing pod dcecb091-e954-4a6f-b51e-c8087bb59734 ("metrics-server-9975d5f86-9dfk7_kube-system(dcecb091-e954-4a6f-b51e-c8087bb59734)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0922 16:03:26.687984 2677774 out.go:270] Sep 22 16:03:14 old-k8s-version-516480 kubelet[731]: E0922 16:03:14.663628 731 pod_workers.go:191] Error syncing pod 9b7e692e-cd09-45ee-804a-db312d9515e5 ("dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"
W0922 16:03:26.687990 2677774 out.go:270] Sep 22 16:03:25 old-k8s-version-516480 kubelet[731]: E0922 16:03:25.665238 731 pod_workers.go:191] Error syncing pod 9b7e692e-cd09-45ee-804a-db312d9515e5 ("dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"
W0922 16:03:26.687997 2677774 out.go:270] Sep 22 16:03:25 old-k8s-version-516480 kubelet[731]: E0922 16:03:25.691950 731 pod_workers.go:191] Error syncing pod dcecb091-e954-4a6f-b51e-c8087bb59734 ("metrics-server-9975d5f86-9dfk7_kube-system(dcecb091-e954-4a6f-b51e-c8087bb59734)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = pinging container registry fake.domain: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain: no such host"
I0922 16:03:26.688013 2677774 out.go:358] Setting ErrFile to fd 2...
I0922 16:03:26.688029 2677774 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0922 16:03:29.208836 2681906 system_pods.go:59] 9 kube-system pods found
I0922 16:03:29.208875 2681906 system_pods.go:61] "coredns-7c65d6cfc9-c9vlc" [6c9254db-abb5-4029-8aba-163fab90da66] Running
I0922 16:03:29.208881 2681906 system_pods.go:61] "etcd-no-preload-592860" [71157a1c-3b55-458d-884d-cee5b36431b7] Running
I0922 16:03:29.208886 2681906 system_pods.go:61] "kindnet-p4kfv" [ca002604-c8df-49ca-a142-064e82ea102c] Running
I0922 16:03:29.208893 2681906 system_pods.go:61] "kube-apiserver-no-preload-592860" [012e7045-6246-455d-bcc5-a64d235c975b] Running
I0922 16:03:29.208898 2681906 system_pods.go:61] "kube-controller-manager-no-preload-592860" [5bb855e7-a681-4b48-938e-f7472b28bca9] Running
I0922 16:03:29.208902 2681906 system_pods.go:61] "kube-proxy-nnd5t" [10d13235-79f6-48e2-a7ea-319329fb128e] Running
I0922 16:03:29.208906 2681906 system_pods.go:61] "kube-scheduler-no-preload-592860" [69e7676a-51f0-4029-9a5b-7e4853d8d3e2] Running
I0922 16:03:29.208912 2681906 system_pods.go:61] "metrics-server-6867b74b74-6ttcv" [fdd34696-9db0-40e6-a413-e4967f26fbc8] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0922 16:03:29.208917 2681906 system_pods.go:61] "storage-provisioner" [677e5899-719e-4c93-981e-2022b995a46c] Running
I0922 16:03:29.208925 2681906 system_pods.go:74] duration metric: took 11.308210255s to wait for pod list to return data ...
I0922 16:03:29.208937 2681906 default_sa.go:34] waiting for default service account to be created ...
I0922 16:03:29.215364 2681906 default_sa.go:45] found service account: "default"
I0922 16:03:29.215396 2681906 default_sa.go:55] duration metric: took 6.445978ms for default service account to be created ...
I0922 16:03:29.215407 2681906 system_pods.go:116] waiting for k8s-apps to be running ...
I0922 16:03:29.221476 2681906 system_pods.go:86] 9 kube-system pods found
I0922 16:03:29.221515 2681906 system_pods.go:89] "coredns-7c65d6cfc9-c9vlc" [6c9254db-abb5-4029-8aba-163fab90da66] Running
I0922 16:03:29.221523 2681906 system_pods.go:89] "etcd-no-preload-592860" [71157a1c-3b55-458d-884d-cee5b36431b7] Running
I0922 16:03:29.221529 2681906 system_pods.go:89] "kindnet-p4kfv" [ca002604-c8df-49ca-a142-064e82ea102c] Running
I0922 16:03:29.221534 2681906 system_pods.go:89] "kube-apiserver-no-preload-592860" [012e7045-6246-455d-bcc5-a64d235c975b] Running
I0922 16:03:29.221539 2681906 system_pods.go:89] "kube-controller-manager-no-preload-592860" [5bb855e7-a681-4b48-938e-f7472b28bca9] Running
I0922 16:03:29.221544 2681906 system_pods.go:89] "kube-proxy-nnd5t" [10d13235-79f6-48e2-a7ea-319329fb128e] Running
I0922 16:03:29.221548 2681906 system_pods.go:89] "kube-scheduler-no-preload-592860" [69e7676a-51f0-4029-9a5b-7e4853d8d3e2] Running
I0922 16:03:29.221555 2681906 system_pods.go:89] "metrics-server-6867b74b74-6ttcv" [fdd34696-9db0-40e6-a413-e4967f26fbc8] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0922 16:03:29.221567 2681906 system_pods.go:89] "storage-provisioner" [677e5899-719e-4c93-981e-2022b995a46c] Running
I0922 16:03:29.221579 2681906 system_pods.go:126] duration metric: took 6.166174ms to wait for k8s-apps to be running ...
I0922 16:03:29.221594 2681906 system_svc.go:44] waiting for kubelet service to be running ....
I0922 16:03:29.221656 2681906 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0922 16:03:29.233954 2681906 system_svc.go:56] duration metric: took 12.350587ms WaitForService to wait for kubelet
I0922 16:03:29.233985 2681906 kubeadm.go:582] duration metric: took 4m52.427442232s to wait for: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0922 16:03:29.234005 2681906 node_conditions.go:102] verifying NodePressure condition ...
I0922 16:03:29.237343 2681906 node_conditions.go:122] node storage ephemeral capacity is 203034800Ki
I0922 16:03:29.237394 2681906 node_conditions.go:123] node cpu capacity is 2
I0922 16:03:29.237406 2681906 node_conditions.go:105] duration metric: took 3.394776ms to run NodePressure ...
I0922 16:03:29.237419 2681906 start.go:241] waiting for startup goroutines ...
I0922 16:03:29.237426 2681906 start.go:246] waiting for cluster config update ...
I0922 16:03:29.237437 2681906 start.go:255] writing updated cluster config ...
I0922 16:03:29.237738 2681906 ssh_runner.go:195] Run: rm -f paused
I0922 16:03:29.307182 2681906 start.go:600] kubectl: 1.31.1, cluster: 1.31.1 (minor skew: 0)
I0922 16:03:29.310083 2681906 out.go:177] * Done! kubectl is now configured to use "no-preload-592860" cluster and "default" namespace by default
I0922 16:03:36.688280 2677774 api_server.go:253] Checking apiserver healthz at https://192.168.76.2:8443/healthz ...
I0922 16:03:36.700813 2677774 api_server.go:279] https://192.168.76.2:8443/healthz returned 200:
ok
I0922 16:03:36.703682 2677774 out.go:201]
W0922 16:03:36.706164 2677774 out.go:270] X Exiting due to K8S_UNHEALTHY_CONTROL_PLANE: wait 6m0s for node: wait for healthy API server: controlPlane never updated to v1.20.0
W0922 16:03:36.706212 2677774 out.go:270] * Suggestion: Control Plane could not update, try minikube delete --all --purge
W0922 16:03:36.706235 2677774 out.go:270] * Related issue: https://github.com/kubernetes/minikube/issues/11417
W0922 16:03:36.706241 2677774 out.go:270] *
W0922 16:03:36.707282 2677774 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0922 16:03:36.710620 2677774 out.go:201]
==> CRI-O <==
Sep 22 16:01:18 old-k8s-version-516480 crio[619]: time="2024-09-22 16:01:18.663843294Z" level=info msg="Image fake.domain/registry.k8s.io/echoserver:1.4 not found" id=6e98704e-a55a-453e-b0fc-30011db9551b name=/runtime.v1alpha2.ImageService/ImageStatus
Sep 22 16:01:31 old-k8s-version-516480 crio[619]: time="2024-09-22 16:01:31.663497085Z" level=info msg="Checking image status: fake.domain/registry.k8s.io/echoserver:1.4" id=80de93f4-0476-47e2-b75f-70878669451a name=/runtime.v1alpha2.ImageService/ImageStatus
Sep 22 16:01:31 old-k8s-version-516480 crio[619]: time="2024-09-22 16:01:31.663737966Z" level=info msg="Image fake.domain/registry.k8s.io/echoserver:1.4 not found" id=80de93f4-0476-47e2-b75f-70878669451a name=/runtime.v1alpha2.ImageService/ImageStatus
Sep 22 16:01:46 old-k8s-version-516480 crio[619]: time="2024-09-22 16:01:46.663584152Z" level=info msg="Checking image status: fake.domain/registry.k8s.io/echoserver:1.4" id=475d331d-79ef-4b2f-9f7d-a085e33af892 name=/runtime.v1alpha2.ImageService/ImageStatus
Sep 22 16:01:46 old-k8s-version-516480 crio[619]: time="2024-09-22 16:01:46.663827600Z" level=info msg="Image fake.domain/registry.k8s.io/echoserver:1.4 not found" id=475d331d-79ef-4b2f-9f7d-a085e33af892 name=/runtime.v1alpha2.ImageService/ImageStatus
Sep 22 16:01:59 old-k8s-version-516480 crio[619]: time="2024-09-22 16:01:59.663450890Z" level=info msg="Checking image status: fake.domain/registry.k8s.io/echoserver:1.4" id=59dc38fa-be15-4899-a28e-8f3c5da3cfaa name=/runtime.v1alpha2.ImageService/ImageStatus
Sep 22 16:01:59 old-k8s-version-516480 crio[619]: time="2024-09-22 16:01:59.663679882Z" level=info msg="Image fake.domain/registry.k8s.io/echoserver:1.4 not found" id=59dc38fa-be15-4899-a28e-8f3c5da3cfaa name=/runtime.v1alpha2.ImageService/ImageStatus
Sep 22 16:02:10 old-k8s-version-516480 crio[619]: time="2024-09-22 16:02:10.663608069Z" level=info msg="Checking image status: fake.domain/registry.k8s.io/echoserver:1.4" id=d64b81d8-21e8-4a4c-a410-f4d6fe92ccf8 name=/runtime.v1alpha2.ImageService/ImageStatus
Sep 22 16:02:10 old-k8s-version-516480 crio[619]: time="2024-09-22 16:02:10.663901658Z" level=info msg="Image fake.domain/registry.k8s.io/echoserver:1.4 not found" id=d64b81d8-21e8-4a4c-a410-f4d6fe92ccf8 name=/runtime.v1alpha2.ImageService/ImageStatus
Sep 22 16:02:24 old-k8s-version-516480 crio[619]: time="2024-09-22 16:02:24.664113831Z" level=info msg="Checking image status: fake.domain/registry.k8s.io/echoserver:1.4" id=40d1283b-9865-4f54-a806-725c33905622 name=/runtime.v1alpha2.ImageService/ImageStatus
Sep 22 16:02:24 old-k8s-version-516480 crio[619]: time="2024-09-22 16:02:24.664349230Z" level=info msg="Image fake.domain/registry.k8s.io/echoserver:1.4 not found" id=40d1283b-9865-4f54-a806-725c33905622 name=/runtime.v1alpha2.ImageService/ImageStatus
Sep 22 16:02:35 old-k8s-version-516480 crio[619]: time="2024-09-22 16:02:35.586422400Z" level=info msg="Checking image status: k8s.gcr.io/pause:3.2" id=62ee795e-43a7-4a43-ac75-d50d14e3aa48 name=/runtime.v1alpha2.ImageService/ImageStatus
Sep 22 16:02:35 old-k8s-version-516480 crio[619]: time="2024-09-22 16:02:35.586655592Z" level=info msg="Image status: &ImageStatusResponse{Image:&Image{Id:2a060e2e7101d419352bf82c613158587400be743482d9a537ec4a9d1b4eb93c,RepoTags:[k8s.gcr.io/pause:3.2 registry.k8s.io/pause:3.2],RepoDigests:[k8s.gcr.io/pause@sha256:31d3efd12022ffeffb3146bc10ae8beb890c80ed2f07363515580add7ed47636 k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f registry.k8s.io/pause@sha256:31d3efd12022ffeffb3146bc10ae8beb890c80ed2f07363515580add7ed47636 registry.k8s.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f],Size_:489397,Uid:nil,Username:,Spec:nil,},Info:map[string]string{},}" id=62ee795e-43a7-4a43-ac75-d50d14e3aa48 name=/runtime.v1alpha2.ImageService/ImageStatus
Sep 22 16:02:35 old-k8s-version-516480 crio[619]: time="2024-09-22 16:02:35.667190862Z" level=info msg="Checking image status: fake.domain/registry.k8s.io/echoserver:1.4" id=76ce6ea4-e252-4769-bdf5-daa30277ffec name=/runtime.v1alpha2.ImageService/ImageStatus
Sep 22 16:02:35 old-k8s-version-516480 crio[619]: time="2024-09-22 16:02:35.667426376Z" level=info msg="Image fake.domain/registry.k8s.io/echoserver:1.4 not found" id=76ce6ea4-e252-4769-bdf5-daa30277ffec name=/runtime.v1alpha2.ImageService/ImageStatus
Sep 22 16:02:47 old-k8s-version-516480 crio[619]: time="2024-09-22 16:02:47.663450437Z" level=info msg="Checking image status: fake.domain/registry.k8s.io/echoserver:1.4" id=7d5b2e97-da21-4bb5-963d-f4639629901f name=/runtime.v1alpha2.ImageService/ImageStatus
Sep 22 16:02:47 old-k8s-version-516480 crio[619]: time="2024-09-22 16:02:47.663692466Z" level=info msg="Image fake.domain/registry.k8s.io/echoserver:1.4 not found" id=7d5b2e97-da21-4bb5-963d-f4639629901f name=/runtime.v1alpha2.ImageService/ImageStatus
Sep 22 16:02:58 old-k8s-version-516480 crio[619]: time="2024-09-22 16:02:58.663573685Z" level=info msg="Checking image status: fake.domain/registry.k8s.io/echoserver:1.4" id=73e318ba-6737-4c16-833e-c3cf29296f54 name=/runtime.v1alpha2.ImageService/ImageStatus
Sep 22 16:02:58 old-k8s-version-516480 crio[619]: time="2024-09-22 16:02:58.663813983Z" level=info msg="Image fake.domain/registry.k8s.io/echoserver:1.4 not found" id=73e318ba-6737-4c16-833e-c3cf29296f54 name=/runtime.v1alpha2.ImageService/ImageStatus
Sep 22 16:03:10 old-k8s-version-516480 crio[619]: time="2024-09-22 16:03:10.663633995Z" level=info msg="Checking image status: fake.domain/registry.k8s.io/echoserver:1.4" id=a16b211a-69f2-4cc2-a5ee-f8c113958d82 name=/runtime.v1alpha2.ImageService/ImageStatus
Sep 22 16:03:10 old-k8s-version-516480 crio[619]: time="2024-09-22 16:03:10.663874088Z" level=info msg="Image fake.domain/registry.k8s.io/echoserver:1.4 not found" id=a16b211a-69f2-4cc2-a5ee-f8c113958d82 name=/runtime.v1alpha2.ImageService/ImageStatus
Sep 22 16:03:25 old-k8s-version-516480 crio[619]: time="2024-09-22 16:03:25.663910687Z" level=info msg="Checking image status: fake.domain/registry.k8s.io/echoserver:1.4" id=a878e7fa-6f7f-4401-8fbc-4bdf9ad7ea5c name=/runtime.v1alpha2.ImageService/ImageStatus
Sep 22 16:03:25 old-k8s-version-516480 crio[619]: time="2024-09-22 16:03:25.664150780Z" level=info msg="Image fake.domain/registry.k8s.io/echoserver:1.4 not found" id=a878e7fa-6f7f-4401-8fbc-4bdf9ad7ea5c name=/runtime.v1alpha2.ImageService/ImageStatus
Sep 22 16:03:25 old-k8s-version-516480 crio[619]: time="2024-09-22 16:03:25.666423736Z" level=info msg="Pulling image: fake.domain/registry.k8s.io/echoserver:1.4" id=de39ca81-5aaf-4987-9d62-bfba7d31cdfb name=/runtime.v1alpha2.ImageService/PullImage
Sep 22 16:03:25 old-k8s-version-516480 crio[619]: time="2024-09-22 16:03:25.686371142Z" level=info msg="Trying to access \"fake.domain/registry.k8s.io/echoserver:1.4\""
==> container status <==
CONTAINER IMAGE CREATED STATE NAME ATTEMPT POD ID POD
df12ef6e60777 a90209bb39e3d7b5fc9daf60c17044ea969aaca0333d672d8c7a34c7446e7ff7 2 minutes ago Exited dashboard-metrics-scraper 5 c68a42c14d596 dashboard-metrics-scraper-8d5bb5db8-2g6tk
e4a2ecaf05417 ba04bb24b95753201135cbc420b233c1b0b9fa2e1fd21d28319c348c33fbcde6 5 minutes ago Running storage-provisioner 1 84576f306c729 storage-provisioner
8aeff047dc834 docker.io/kubernetesui/dashboard@sha256:2e500d29e9d5f4a086b908eb8dfe7ecac57d2ab09d65b24f588b1d449841ef93 5 minutes ago Running kubernetes-dashboard 0 b72f254e61a25 kubernetes-dashboard-cd95d586-tcbq6
ae5e78c88dae1 1611cd07b61d57dbbfebe6db242513fd51e1c02d20ba08af17a45837d86a8a8c 5 minutes ago Running busybox 0 2e7fdf22c1ed3 busybox
74c18335c2ae0 db91994f4ee8f894a1e8a6c1a76f615da8fc3c019300a3686291ce6fcbc57895 5 minutes ago Running coredns 0 6da5fa77a9d92 coredns-74ff55c5b-mnbq6
ec9f69248870f 25a5233254979d0678a2db1d15b76b73dc380d81bc5eed93916ba5638b3cd894 5 minutes ago Running kube-proxy 0 13565fba9e97d kube-proxy-2nbfq
817a0d84fdbc6 6a23fa8fd2b78ab58e42ba273808edc936a9c53d8ac4a919f6337be094843a51 5 minutes ago Running kindnet-cni 0 4162135ff2973 kindnet-fqs69
45e9854e642ac ba04bb24b95753201135cbc420b233c1b0b9fa2e1fd21d28319c348c33fbcde6 5 minutes ago Exited storage-provisioner 0 84576f306c729 storage-provisioner
7c1fcc5987e5e 2c08bbbc02d3aa5dfbf4e79f15c0a61424049288917aa10364464ca1f7de7157 6 minutes ago Running kube-apiserver 0 962fcca6f7629 kube-apiserver-old-k8s-version-516480
30f03ae410109 e7605f88f17d6a4c3f083ef9c6f5f19b39f87e4d4406a05a8612b54a6ea57051 6 minutes ago Running kube-scheduler 0 0096ffb5504d7 kube-scheduler-old-k8s-version-516480
9c0a027a1be57 05b738aa1bc6355db8a2ee8639f3631b908286e43f584a3d2ee0c472de033c28 6 minutes ago Running etcd 0 9270008133b42 etcd-old-k8s-version-516480
132b8fae57bdf 1df8a2b116bd16f7070fd383a6769c8d644b365575e8ffa3e492b84e4f05fc74 6 minutes ago Running kube-controller-manager 0 d5d6d24574bcc kube-controller-manager-old-k8s-version-516480
==> coredns [74c18335c2ae08ca4773950befa864f23e6a8bee2767e6f7f6eae0ddb3683ab2] <==
.:53
[INFO] plugin/reload: Running configuration MD5 = b494d968e357ba1b925cee838fbd78ed
CoreDNS-1.7.0
linux/arm64, go1.14.4, f59c03d
[INFO] 127.0.0.1:49028 - 62665 "HINFO IN 6222698112995145531.6528082151209931312. udp 57 false 512" NXDOMAIN qr,rd,ra 57 0.033590177s
[INFO] SIGTERM: Shutting down servers then terminating
[INFO] plugin/health: Going into lameduck mode for 5s
.:53
[INFO] plugin/reload: Running configuration MD5 = b494d968e357ba1b925cee838fbd78ed
CoreDNS-1.7.0
linux/arm64, go1.14.4, f59c03d
[INFO] 127.0.0.1:46656 - 49414 "HINFO IN 1396077942774086302.7462809931940747334. udp 57 false 512" NXDOMAIN qr,rd,ra 57 0.026708214s
[INFO] plugin/ready: Still waiting on: "kubernetes"
[INFO] plugin/ready: Still waiting on: "kubernetes"
[INFO] plugin/ready: Still waiting on: "kubernetes"
I0922 15:58:19.885006 1 trace.go:116] Trace[2019727887]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125 (started: 2024-09-22 15:57:49.884465535 +0000 UTC m=+0.274731754) (total time: 30.000436454s):
Trace[2019727887]: [30.000436454s] [30.000436454s] END
E0922 15:58:19.885037 1 reflector.go:178] pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125: Failed to list *v1.Service: Get "https://10.96.0.1:443/api/v1/services?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout
I0922 15:58:19.885207 1 trace.go:116] Trace[939984059]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125 (started: 2024-09-22 15:57:49.884930263 +0000 UTC m=+0.275196482) (total time: 30.000252187s):
Trace[939984059]: [30.000252187s] [30.000252187s] END
E0922 15:58:19.885221 1 reflector.go:178] pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125: Failed to list *v1.Endpoints: Get "https://10.96.0.1:443/api/v1/endpoints?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout
I0922 15:58:19.885407 1 trace.go:116] Trace[911902081]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125 (started: 2024-09-22 15:57:49.885162003 +0000 UTC m=+0.275428214) (total time: 30.000231798s):
Trace[911902081]: [30.000231798s] [30.000231798s] END
E0922 15:58:19.885418 1 reflector.go:178] pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125: Failed to list *v1.Namespace: Get "https://10.96.0.1:443/api/v1/namespaces?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout
==> describe nodes <==
Name: old-k8s-version-516480
Roles: control-plane,master
Labels: beta.kubernetes.io/arch=arm64
beta.kubernetes.io/os=linux
kubernetes.io/arch=arm64
kubernetes.io/hostname=old-k8s-version-516480
kubernetes.io/os=linux
minikube.k8s.io/commit=5b57912a6e11509dc1149ba04e12218d24f36ea3
minikube.k8s.io/name=old-k8s-version-516480
minikube.k8s.io/primary=true
minikube.k8s.io/updated_at=2024_09_22T15_55_08_0700
minikube.k8s.io/version=v1.34.0
node-role.kubernetes.io/control-plane=
node-role.kubernetes.io/master=
Annotations: kubeadm.alpha.kubernetes.io/cri-socket: /var/run/crio/crio.sock
node.alpha.kubernetes.io/ttl: 0
volumes.kubernetes.io/controller-managed-attach-detach: true
CreationTimestamp: Sun, 22 Sep 2024 15:55:04 +0000
Taints: <none>
Unschedulable: false
Lease:
HolderIdentity: old-k8s-version-516480
AcquireTime: <unset>
RenewTime: Sun, 22 Sep 2024 16:03:29 +0000
Conditions:
Type Status LastHeartbeatTime LastTransitionTime Reason Message
---- ------ ----------------- ------------------ ------ -------
MemoryPressure False Sun, 22 Sep 2024 15:58:37 +0000 Sun, 22 Sep 2024 15:54:59 +0000 KubeletHasSufficientMemory kubelet has sufficient memory available
DiskPressure False Sun, 22 Sep 2024 15:58:37 +0000 Sun, 22 Sep 2024 15:54:59 +0000 KubeletHasNoDiskPressure kubelet has no disk pressure
PIDPressure False Sun, 22 Sep 2024 15:58:37 +0000 Sun, 22 Sep 2024 15:54:59 +0000 KubeletHasSufficientPID kubelet has sufficient PID available
Ready True Sun, 22 Sep 2024 15:58:37 +0000 Sun, 22 Sep 2024 15:55:45 +0000 KubeletReady kubelet is posting ready status
Addresses:
InternalIP: 192.168.76.2
Hostname: old-k8s-version-516480
Capacity:
cpu: 2
ephemeral-storage: 203034800Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
hugepages-32Mi: 0
hugepages-64Ki: 0
memory: 8022296Ki
pods: 110
Allocatable:
cpu: 2
ephemeral-storage: 203034800Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
hugepages-32Mi: 0
hugepages-64Ki: 0
memory: 8022296Ki
pods: 110
System Info:
Machine ID: 450f414c299a43d3854bcadf8cc89c91
System UUID: f83b10ca-d4e5-42c2-8835-96bf7e679886
Boot ID: 83c23869-b84b-4612-8d17-ba3dc253a1e0
Kernel Version: 5.15.0-1070-aws
OS Image: Ubuntu 22.04.5 LTS
Operating System: linux
Architecture: arm64
Container Runtime Version: cri-o://1.24.6
Kubelet Version: v1.20.0
Kube-Proxy Version: v1.20.0
PodCIDR: 10.244.0.0/24
PodCIDRs: 10.244.0.0/24
Non-terminated Pods: (12 in total)
Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits AGE
--------- ---- ------------ ---------- --------------- ------------- ---
default busybox 0 (0%) 0 (0%) 0 (0%) 0 (0%) 6m47s
kube-system coredns-74ff55c5b-mnbq6 100m (5%) 0 (0%) 70Mi (0%) 170Mi (2%) 8m15s
kube-system etcd-old-k8s-version-516480 100m (5%) 0 (0%) 100Mi (1%) 0 (0%) 8m22s
kube-system kindnet-fqs69 100m (5%) 100m (5%) 50Mi (0%) 50Mi (0%) 8m15s
kube-system kube-apiserver-old-k8s-version-516480 250m (12%) 0 (0%) 0 (0%) 0 (0%) 8m22s
kube-system kube-controller-manager-old-k8s-version-516480 200m (10%) 0 (0%) 0 (0%) 0 (0%) 8m22s
kube-system kube-proxy-2nbfq 0 (0%) 0 (0%) 0 (0%) 0 (0%) 8m15s
kube-system kube-scheduler-old-k8s-version-516480 100m (5%) 0 (0%) 0 (0%) 0 (0%) 8m22s
kube-system metrics-server-9975d5f86-9dfk7 100m (5%) 0 (0%) 200Mi (2%) 0 (0%) 6m33s
kube-system storage-provisioner 0 (0%) 0 (0%) 0 (0%) 0 (0%) 8m14s
kubernetes-dashboard dashboard-metrics-scraper-8d5bb5db8-2g6tk 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m32s
kubernetes-dashboard kubernetes-dashboard-cd95d586-tcbq6 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m32s
Allocated resources:
(Total limits may be over 100 percent, i.e., overcommitted.)
Resource Requests Limits
-------- -------- ------
cpu 950m (47%) 100m (5%)
memory 420Mi (5%) 220Mi (2%)
ephemeral-storage 100Mi (0%) 0 (0%)
hugepages-1Gi 0 (0%) 0 (0%)
hugepages-2Mi 0 (0%) 0 (0%)
hugepages-32Mi 0 (0%) 0 (0%)
hugepages-64Ki 0 (0%) 0 (0%)
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal NodeHasSufficientMemory 8m40s (x5 over 8m40s) kubelet Node old-k8s-version-516480 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 8m40s (x4 over 8m40s) kubelet Node old-k8s-version-516480 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 8m40s (x4 over 8m40s) kubelet Node old-k8s-version-516480 status is now: NodeHasSufficientPID
Normal Starting 8m23s kubelet Starting kubelet.
Normal NodeHasSufficientMemory 8m23s kubelet Node old-k8s-version-516480 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 8m23s kubelet Node old-k8s-version-516480 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 8m23s kubelet Node old-k8s-version-516480 status is now: NodeHasSufficientPID
Normal Starting 8m14s kube-proxy Starting kube-proxy.
Normal NodeReady 7m53s kubelet Node old-k8s-version-516480 status is now: NodeReady
Normal Starting 6m3s kubelet Starting kubelet.
Normal NodeHasSufficientMemory 6m3s (x8 over 6m3s) kubelet Node old-k8s-version-516480 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 6m3s (x8 over 6m3s) kubelet Node old-k8s-version-516480 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 6m3s (x8 over 6m3s) kubelet Node old-k8s-version-516480 status is now: NodeHasSufficientPID
Normal Starting 5m48s kube-proxy Starting kube-proxy.
==> dmesg <==
[Sep22 14:08] overlayfs: '/var/lib/containers/storage/overlay/l/ZLTOCNGE2IGM6DT7VP2QP7OV3M' not a directory
[ +0.739108] overlayfs: '/var/lib/containers/storage/overlay/l/Q2QJNMTVZL6GMULS36RA5ZJGSA' not a directory
[Sep22 15:49] overlayfs: '/var/lib/containers/storage/overlay/l/Q2QJNMTVZL6GMULS36RA5ZJGSA' not a directory
==> etcd [9c0a027a1be5775f8f8bab62ea785c923794fad9dd784833db780d0c12ec968b] <==
2024-09-22 15:59:36.018539 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-09-22 15:59:46.018815 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-09-22 15:59:56.018520 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-09-22 16:00:06.018578 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-09-22 16:00:16.018632 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-09-22 16:00:26.018449 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-09-22 16:00:36.018577 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-09-22 16:00:46.025240 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-09-22 16:00:56.018506 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-09-22 16:01:06.018821 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-09-22 16:01:16.018693 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-09-22 16:01:26.018563 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-09-22 16:01:36.018502 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-09-22 16:01:46.018504 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-09-22 16:01:56.018527 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-09-22 16:02:06.018533 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-09-22 16:02:16.018486 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-09-22 16:02:26.018528 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-09-22 16:02:36.018645 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-09-22 16:02:46.019592 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-09-22 16:02:56.018491 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-09-22 16:03:06.018663 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-09-22 16:03:16.018644 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-09-22 16:03:26.018532 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-09-22 16:03:36.018495 I | etcdserver/api/etcdhttp: /health OK (status code 200)
==> kernel <==
16:03:38 up 19:46, 0 users, load average: 0.40, 1.51, 2.07
Linux old-k8s-version-516480 5.15.0-1070-aws #76~20.04.1-Ubuntu SMP Mon Sep 2 12:20:48 UTC 2024 aarch64 aarch64 aarch64 GNU/Linux
PRETTY_NAME="Ubuntu 22.04.5 LTS"
==> kindnet [817a0d84fdbc60639f69c50c14178f79e4829f83ef55c42936ea8baf284b5fb2] <==
I0922 16:01:29.915333 1 main.go:299] handling current node
I0922 16:01:39.915943 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I0922 16:01:39.916062 1 main.go:299] handling current node
I0922 16:01:49.908471 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I0922 16:01:49.908536 1 main.go:299] handling current node
I0922 16:01:59.915939 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I0922 16:01:59.916059 1 main.go:299] handling current node
I0922 16:02:09.910426 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I0922 16:02:09.910459 1 main.go:299] handling current node
I0922 16:02:19.916225 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I0922 16:02:19.916261 1 main.go:299] handling current node
I0922 16:02:29.907985 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I0922 16:02:29.908037 1 main.go:299] handling current node
I0922 16:02:39.915625 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I0922 16:02:39.915659 1 main.go:299] handling current node
I0922 16:02:49.908778 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I0922 16:02:49.908815 1 main.go:299] handling current node
I0922 16:02:59.916025 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I0922 16:02:59.916060 1 main.go:299] handling current node
I0922 16:03:09.915406 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I0922 16:03:09.915441 1 main.go:299] handling current node
I0922 16:03:19.916969 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I0922 16:03:19.917006 1 main.go:299] handling current node
I0922 16:03:29.915312 1 main.go:295] Handling node with IPs: map[192.168.76.2:{}]
I0922 16:03:29.915349 1 main.go:299] handling current node
==> kube-apiserver [7c1fcc5987e5e298748cead12955f5b511798c88fb01575612ee7b9dd567b55f] <==
I0922 15:59:40.082305 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0922 15:59:40.082314 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0922 16:00:25.067124 1 client.go:360] parsed scheme: "passthrough"
I0922 16:00:25.067172 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0922 16:00:25.067181 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
W0922 16:00:51.788922 1 handler_proxy.go:102] no RequestInfo found in the context
E0922 16:00:51.788991 1 controller.go:116] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
I0922 16:00:51.788999 1 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
I0922 16:00:57.483310 1 client.go:360] parsed scheme: "passthrough"
I0922 16:00:57.483358 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0922 16:00:57.483367 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0922 16:01:33.486191 1 client.go:360] parsed scheme: "passthrough"
I0922 16:01:33.486233 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0922 16:01:33.486242 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0922 16:02:12.230031 1 client.go:360] parsed scheme: "passthrough"
I0922 16:02:12.230076 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0922 16:02:12.230085 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
W0922 16:02:47.918719 1 handler_proxy.go:102] no RequestInfo found in the context
E0922 16:02:47.918796 1 controller.go:116] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
I0922 16:02:47.918806 1 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
I0922 16:02:56.860302 1 client.go:360] parsed scheme: "passthrough"
I0922 16:02:56.860345 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0922 16:02:56.860353 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
==> kube-controller-manager [132b8fae57bdf9d2a5fc2c5513a926caa1aa8b41366180c05ecd3ba3f700a87f] <==
W0922 15:59:14.033526 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0922 15:59:39.300814 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0922 15:59:45.684024 1 request.go:655] Throttling request took 1.048270648s, request: GET:https://192.168.76.2:8443/apis/policy/v1beta1?timeout=32s
W0922 15:59:46.535403 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0922 16:00:09.802613 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0922 16:00:18.185791 1 request.go:655] Throttling request took 1.04841034s, request: GET:https://192.168.76.2:8443/apis/extensions/v1beta1?timeout=32s
W0922 16:00:19.037372 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0922 16:00:40.304517 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0922 16:00:50.687794 1 request.go:655] Throttling request took 1.04832589s, request: GET:https://192.168.76.2:8443/apis/authorization.k8s.io/v1beta1?timeout=32s
W0922 16:00:51.539234 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0922 16:01:10.806433 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0922 16:01:23.189662 1 request.go:655] Throttling request took 1.048314258s, request: GET:https://192.168.76.2:8443/apis/apiextensions.k8s.io/v1beta1?timeout=32s
W0922 16:01:24.041256 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0922 16:01:41.308230 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0922 16:01:55.691634 1 request.go:655] Throttling request took 1.048530239s, request: GET:https://192.168.76.2:8443/apis/apiextensions.k8s.io/v1beta1?timeout=32s
W0922 16:01:56.543071 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0922 16:02:11.810106 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0922 16:02:28.193436 1 request.go:655] Throttling request took 1.048173352s, request: GET:https://192.168.76.2:8443/apis/extensions/v1beta1?timeout=32s
W0922 16:02:29.044927 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0922 16:02:42.311869 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0922 16:03:00.695313 1 request.go:655] Throttling request took 1.048236139s, request: GET:https://192.168.76.2:8443/apis/extensions/v1beta1?timeout=32s
W0922 16:03:01.546703 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0922 16:03:12.813796 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0922 16:03:33.197093 1 request.go:655] Throttling request took 1.048507643s, request: GET:https://192.168.76.2:8443/apis/coordination.k8s.io/v1beta1?timeout=32s
W0922 16:03:34.048537 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
==> kube-proxy [ec9f69248870fe845f3489361c85e0a4b8603653e8b0e35027240720c8219d3d] <==
I0922 15:55:24.473590 1 node.go:172] Successfully retrieved node IP: 192.168.76.2
I0922 15:55:24.473704 1 server_others.go:142] kube-proxy node IP is an IPv4 address (192.168.76.2), assume IPv4 operation
W0922 15:55:24.507070 1 server_others.go:578] Unknown proxy mode "", assuming iptables proxy
I0922 15:55:24.507221 1 server_others.go:185] Using iptables Proxier.
I0922 15:55:24.507754 1 server.go:650] Version: v1.20.0
I0922 15:55:24.508494 1 config.go:315] Starting service config controller
I0922 15:55:24.508522 1 shared_informer.go:240] Waiting for caches to sync for service config
I0922 15:55:24.508555 1 config.go:224] Starting endpoint slice config controller
I0922 15:55:24.508560 1 shared_informer.go:240] Waiting for caches to sync for endpoint slice config
I0922 15:55:24.693967 1 shared_informer.go:247] Caches are synced for endpoint slice config
I0922 15:55:24.694048 1 shared_informer.go:247] Caches are synced for service config
I0922 15:57:50.419269 1 node.go:172] Successfully retrieved node IP: 192.168.76.2
I0922 15:57:50.419562 1 server_others.go:142] kube-proxy node IP is an IPv4 address (192.168.76.2), assume IPv4 operation
W0922 15:57:50.454435 1 server_others.go:578] Unknown proxy mode "", assuming iptables proxy
I0922 15:57:50.467192 1 server_others.go:185] Using iptables Proxier.
I0922 15:57:50.467452 1 server.go:650] Version: v1.20.0
I0922 15:57:50.468016 1 config.go:315] Starting service config controller
I0922 15:57:50.468046 1 shared_informer.go:240] Waiting for caches to sync for service config
I0922 15:57:50.468692 1 config.go:224] Starting endpoint slice config controller
I0922 15:57:50.468699 1 shared_informer.go:240] Waiting for caches to sync for endpoint slice config
I0922 15:57:50.568179 1 shared_informer.go:247] Caches are synced for service config
I0922 15:57:50.568793 1 shared_informer.go:247] Caches are synced for endpoint slice config
==> kube-scheduler [30f03ae4101098906a64fcc1aa6671c8702b5191e639bfa1be31ac12b0b1b75f] <==
E0922 15:55:04.787217 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
E0922 15:55:04.787386 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
E0922 15:55:04.787564 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
E0922 15:55:04.787878 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
E0922 15:55:04.790419 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
E0922 15:55:04.790775 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
E0922 15:55:04.791262 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
E0922 15:55:04.791454 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
E0922 15:55:04.791607 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
E0922 15:55:04.792432 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
E0922 15:55:05.662340 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
E0922 15:55:05.695496 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
E0922 15:55:05.721530 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
E0922 15:55:05.724842 1 reflector.go:138] k8s.io/apiserver/pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
I0922 15:55:08.859871 1 shared_informer.go:247] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0922 15:57:41.282135 1 serving.go:331] Generated self-signed cert in-memory
W0922 15:57:46.872036 1 requestheader_controller.go:193] Unable to get configmap/extension-apiserver-authentication in kube-system. Usually fixed by 'kubectl create rolebinding -n kube-system ROLEBINDING_NAME --role=extension-apiserver-authentication-reader --serviceaccount=YOUR_NS:YOUR_SA'
W0922 15:57:46.872176 1 authentication.go:332] Error looking up in-cluster authentication configuration: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot get resource "configmaps" in API group "" in the namespace "kube-system"
W0922 15:57:46.872243 1 authentication.go:333] Continuing without authentication configuration. This may treat all requests as anonymous.
W0922 15:57:46.872274 1 authentication.go:334] To require authentication configuration lookup to succeed, set --authentication-tolerate-lookup-failure=false
I0922 15:57:47.247036 1 configmap_cafile_content.go:202] Starting client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0922 15:57:47.250166 1 shared_informer.go:240] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0922 15:57:47.256418 1 tlsconfig.go:240] Starting DynamicServingCertificateController
I0922 15:57:47.258745 1 secure_serving.go:197] Serving securely on 127.0.0.1:10259
I0922 15:57:47.351153 1 shared_informer.go:247] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
==> kubelet <==
Sep 22 16:02:09 old-k8s-version-516480 kubelet[731]: I0922 16:02:09.663181 731 scope.go:95] [topologymanager] RemoveContainer - Container ID: df12ef6e60777eaf161e86284d6f3644a14b5b50edf31e6cff1ce731abc8ea1c
Sep 22 16:02:09 old-k8s-version-516480 kubelet[731]: E0922 16:02:09.663527 731 pod_workers.go:191] Error syncing pod 9b7e692e-cd09-45ee-804a-db312d9515e5 ("dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"
Sep 22 16:02:10 old-k8s-version-516480 kubelet[731]: E0922 16:02:10.664283 731 pod_workers.go:191] Error syncing pod dcecb091-e954-4a6f-b51e-c8087bb59734 ("metrics-server-9975d5f86-9dfk7_kube-system(dcecb091-e954-4a6f-b51e-c8087bb59734)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Sep 22 16:02:24 old-k8s-version-516480 kubelet[731]: I0922 16:02:24.663198 731 scope.go:95] [topologymanager] RemoveContainer - Container ID: df12ef6e60777eaf161e86284d6f3644a14b5b50edf31e6cff1ce731abc8ea1c
Sep 22 16:02:24 old-k8s-version-516480 kubelet[731]: E0922 16:02:24.664676 731 pod_workers.go:191] Error syncing pod 9b7e692e-cd09-45ee-804a-db312d9515e5 ("dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"
Sep 22 16:02:24 old-k8s-version-516480 kubelet[731]: E0922 16:02:24.664799 731 pod_workers.go:191] Error syncing pod dcecb091-e954-4a6f-b51e-c8087bb59734 ("metrics-server-9975d5f86-9dfk7_kube-system(dcecb091-e954-4a6f-b51e-c8087bb59734)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Sep 22 16:02:35 old-k8s-version-516480 kubelet[731]: E0922 16:02:35.634161 731 container_manager_linux.go:533] failed to find cgroups of kubelet - cpu and memory cgroup hierarchy not unified. cpu: /docker/7698124a9b3f470ea3bf9a4388ac4c2519f15e9b8da1b4908fae865f74ffd689, memory: /docker/7698124a9b3f470ea3bf9a4388ac4c2519f15e9b8da1b4908fae865f74ffd689/system.slice/kubelet.service
Sep 22 16:02:35 old-k8s-version-516480 kubelet[731]: E0922 16:02:35.667623 731 pod_workers.go:191] Error syncing pod dcecb091-e954-4a6f-b51e-c8087bb59734 ("metrics-server-9975d5f86-9dfk7_kube-system(dcecb091-e954-4a6f-b51e-c8087bb59734)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Sep 22 16:02:37 old-k8s-version-516480 kubelet[731]: I0922 16:02:37.663203 731 scope.go:95] [topologymanager] RemoveContainer - Container ID: df12ef6e60777eaf161e86284d6f3644a14b5b50edf31e6cff1ce731abc8ea1c
Sep 22 16:02:37 old-k8s-version-516480 kubelet[731]: E0922 16:02:37.663543 731 pod_workers.go:191] Error syncing pod 9b7e692e-cd09-45ee-804a-db312d9515e5 ("dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"
Sep 22 16:02:47 old-k8s-version-516480 kubelet[731]: E0922 16:02:47.664131 731 pod_workers.go:191] Error syncing pod dcecb091-e954-4a6f-b51e-c8087bb59734 ("metrics-server-9975d5f86-9dfk7_kube-system(dcecb091-e954-4a6f-b51e-c8087bb59734)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Sep 22 16:02:51 old-k8s-version-516480 kubelet[731]: I0922 16:02:51.663223 731 scope.go:95] [topologymanager] RemoveContainer - Container ID: df12ef6e60777eaf161e86284d6f3644a14b5b50edf31e6cff1ce731abc8ea1c
Sep 22 16:02:51 old-k8s-version-516480 kubelet[731]: E0922 16:02:51.663557 731 pod_workers.go:191] Error syncing pod 9b7e692e-cd09-45ee-804a-db312d9515e5 ("dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"
Sep 22 16:02:58 old-k8s-version-516480 kubelet[731]: E0922 16:02:58.664091 731 pod_workers.go:191] Error syncing pod dcecb091-e954-4a6f-b51e-c8087bb59734 ("metrics-server-9975d5f86-9dfk7_kube-system(dcecb091-e954-4a6f-b51e-c8087bb59734)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Sep 22 16:03:02 old-k8s-version-516480 kubelet[731]: I0922 16:03:02.663167 731 scope.go:95] [topologymanager] RemoveContainer - Container ID: df12ef6e60777eaf161e86284d6f3644a14b5b50edf31e6cff1ce731abc8ea1c
Sep 22 16:03:02 old-k8s-version-516480 kubelet[731]: E0922 16:03:02.663546 731 pod_workers.go:191] Error syncing pod 9b7e692e-cd09-45ee-804a-db312d9515e5 ("dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"
Sep 22 16:03:10 old-k8s-version-516480 kubelet[731]: E0922 16:03:10.664090 731 pod_workers.go:191] Error syncing pod dcecb091-e954-4a6f-b51e-c8087bb59734 ("metrics-server-9975d5f86-9dfk7_kube-system(dcecb091-e954-4a6f-b51e-c8087bb59734)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Sep 22 16:03:14 old-k8s-version-516480 kubelet[731]: I0922 16:03:14.663291 731 scope.go:95] [topologymanager] RemoveContainer - Container ID: df12ef6e60777eaf161e86284d6f3644a14b5b50edf31e6cff1ce731abc8ea1c
Sep 22 16:03:14 old-k8s-version-516480 kubelet[731]: E0922 16:03:14.663628 731 pod_workers.go:191] Error syncing pod 9b7e692e-cd09-45ee-804a-db312d9515e5 ("dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"
Sep 22 16:03:25 old-k8s-version-516480 kubelet[731]: I0922 16:03:25.664934 731 scope.go:95] [topologymanager] RemoveContainer - Container ID: df12ef6e60777eaf161e86284d6f3644a14b5b50edf31e6cff1ce731abc8ea1c
Sep 22 16:03:25 old-k8s-version-516480 kubelet[731]: E0922 16:03:25.665238 731 pod_workers.go:191] Error syncing pod 9b7e692e-cd09-45ee-804a-db312d9515e5 ("dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-2g6tk_kubernetes-dashboard(9b7e692e-cd09-45ee-804a-db312d9515e5)"
Sep 22 16:03:25 old-k8s-version-516480 kubelet[731]: E0922 16:03:25.691737 731 remote_image.go:113] PullImage "fake.domain/registry.k8s.io/echoserver:1.4" from image service failed: rpc error: code = Unknown desc = pinging container registry fake.domain: Get "https://fake.domain/v2/": dial tcp: lookup fake.domain: no such host
Sep 22 16:03:25 old-k8s-version-516480 kubelet[731]: E0922 16:03:25.691786 731 kuberuntime_image.go:51] Pull image "fake.domain/registry.k8s.io/echoserver:1.4" failed: rpc error: code = Unknown desc = pinging container registry fake.domain: Get "https://fake.domain/v2/": dial tcp: lookup fake.domain: no such host
Sep 22 16:03:25 old-k8s-version-516480 kubelet[731]: E0922 16:03:25.691912 731 kuberuntime_manager.go:829] container &Container{Name:metrics-server,Image:fake.domain/registry.k8s.io/echoserver:1.4,Command:[],Args:[--cert-dir=/tmp --secure-port=4443 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --kubelet-use-node-status-port --metric-resolution=60s --kubelet-insecure-tls],WorkingDir:,Ports:[]ContainerPort{ContainerPort{Name:https,HostPort:0,ContainerPort:4443,Protocol:TCP,HostIP:,},},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{cpu: {{100 -3} {<nil>} 100m DecimalSI},memory: {{209715200 0} {<nil>} BinarySI},},},VolumeMounts:[]VolumeMount{VolumeMount{Name:tmp-dir,ReadOnly:false,MountPath:/tmp,SubPath:,MountPropagation:nil,SubPathExpr:,},VolumeMount{Name:metrics-server-token-qckbp,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,},},LivenessProbe:&Probe{Handler:Handler{Exec
:nil,HTTPGet:&HTTPGetAction{Path:/livez,Port:{1 0 https},Host:,Scheme:HTTPS,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,},InitialDelaySeconds:0,TimeoutSeconds:1,PeriodSeconds:10,SuccessThreshold:1,FailureThreshold:3,},ReadinessProbe:&Probe{Handler:Handler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/readyz,Port:{1 0 https},Host:,Scheme:HTTPS,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,},InitialDelaySeconds:0,TimeoutSeconds:1,PeriodSeconds:10,SuccessThreshold:1,FailureThreshold:3,},Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:nil,Privileged:nil,SELinuxOptions:nil,RunAsUser:*1000,RunAsNonRoot:*true,ReadOnlyRootFilesystem:*true,AllowPrivilegeEscalation:nil,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,} start failed in pod metrics-server-9975d5f86-9dfk7_kube-system(dcecb09
1-e954-4a6f-b51e-c8087bb59734): ErrImagePull: rpc error: code = Unknown desc = pinging container registry fake.domain: Get "https://fake.domain/v2/": dial tcp: lookup fake.domain: no such host
Sep 22 16:03:25 old-k8s-version-516480 kubelet[731]: E0922 16:03:25.691950 731 pod_workers.go:191] Error syncing pod dcecb091-e954-4a6f-b51e-c8087bb59734 ("metrics-server-9975d5f86-9dfk7_kube-system(dcecb091-e954-4a6f-b51e-c8087bb59734)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = pinging container registry fake.domain: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain: no such host"
==> kubernetes-dashboard [8aeff047dc834f6a9760e6b43096ec896a75509fed306bf7078b51c94eca99f3] <==
2024/09/22 15:58:16 Starting overwatch
2024/09/22 15:58:16 Using namespace: kubernetes-dashboard
2024/09/22 15:58:16 Using in-cluster config to connect to apiserver
2024/09/22 15:58:16 Using secret token for csrf signing
2024/09/22 15:58:16 Initializing csrf token from kubernetes-dashboard-csrf secret
2024/09/22 15:58:16 Empty token. Generating and storing in a secret kubernetes-dashboard-csrf
2024/09/22 15:58:16 Successful initial request to the apiserver, version: v1.20.0
2024/09/22 15:58:16 Generating JWE encryption key
2024/09/22 15:58:16 New synchronizer has been registered: kubernetes-dashboard-key-holder-kubernetes-dashboard. Starting
2024/09/22 15:58:16 Starting secret synchronizer for kubernetes-dashboard-key-holder in namespace kubernetes-dashboard
2024/09/22 15:58:17 Initializing JWE encryption key from synchronized object
2024/09/22 15:58:17 Creating in-cluster Sidecar client
2024/09/22 15:58:17 Serving insecurely on HTTP port: 9090
2024/09/22 15:58:17 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/09/22 15:58:47 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/09/22 15:59:17 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/09/22 15:59:47 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/09/22 16:00:17 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/09/22 16:00:47 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/09/22 16:01:17 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/09/22 16:01:47 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/09/22 16:02:17 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/09/22 16:02:47 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/09/22 16:03:17 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
==> storage-provisioner [45e9854e642ac4e51de161c0467764011cb66eb499bb2602b89c2f55ef4ba4f1] <==
I0922 15:55:50.888407 1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
I0922 15:55:50.908882 1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!
I0922 15:55:50.908927 1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...
I0922 15:55:50.932191 1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath
I0922 15:55:50.932802 1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"577d8eb6-f72f-4598-8a04-db642c0205b9", APIVersion:"v1", ResourceVersion:"485", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' old-k8s-version-516480_8d4cc81e-d789-440c-be88-1c6be789cf12 became leader
I0922 15:55:50.937074 1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_old-k8s-version-516480_8d4cc81e-d789-440c-be88-1c6be789cf12!
I0922 15:55:51.038045 1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_old-k8s-version-516480_8d4cc81e-d789-440c-be88-1c6be789cf12!
I0922 15:57:48.353248 1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
F0922 15:58:18.355029 1 main.go:39] error getting server version: Get "https://10.96.0.1:443/version?timeout=32s": dial tcp 10.96.0.1:443: i/o timeout
==> storage-provisioner [e4a2ecaf05417d51ac0d7f89b7d4f38dda15dd8046c8d1febc60579492dce3dc] <==
I0922 15:58:18.911544 1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
I0922 15:58:18.933481 1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!
I0922 15:58:18.933616 1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...
I0922 15:58:36.412069 1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath
I0922 15:58:36.412199 1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"577d8eb6-f72f-4598-8a04-db642c0205b9", APIVersion:"v1", ResourceVersion:"797", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' old-k8s-version-516480_fd4c7021-c337-4dec-b654-81c4cab4a4e7 became leader
I0922 15:58:36.426051 1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_old-k8s-version-516480_fd4c7021-c337-4dec-b654-81c4cab4a4e7!
I0922 15:58:36.526491 1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_old-k8s-version-516480_fd4c7021-c337-4dec-b654-81c4cab4a4e7!
-- /stdout --
helpers_test.go:254: (dbg) Run: out/minikube-linux-arm64 status --format={{.APIServer}} -p old-k8s-version-516480 -n old-k8s-version-516480
helpers_test.go:261: (dbg) Run: kubectl --context old-k8s-version-516480 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:272: non-running pods: metrics-server-9975d5f86-9dfk7
helpers_test.go:274: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/SecondStart]: describe non-running pods <======
helpers_test.go:277: (dbg) Run: kubectl --context old-k8s-version-516480 describe pod metrics-server-9975d5f86-9dfk7
helpers_test.go:277: (dbg) Non-zero exit: kubectl --context old-k8s-version-516480 describe pod metrics-server-9975d5f86-9dfk7: exit status 1 (258.105247ms)
** stderr **
E0922 16:03:39.657725 2686124 memcache.go:287] "Unhandled Error" err="couldn't get resource list for metrics.k8s.io/v1beta1: the server is currently unable to handle the request"
E0922 16:03:39.660447 2686124 memcache.go:121] "Unhandled Error" err="couldn't get resource list for metrics.k8s.io/v1beta1: the server is currently unable to handle the request"
E0922 16:03:39.670920 2686124 memcache.go:121] "Unhandled Error" err="couldn't get resource list for metrics.k8s.io/v1beta1: the server is currently unable to handle the request"
E0922 16:03:39.697379 2686124 memcache.go:121] "Unhandled Error" err="couldn't get resource list for metrics.k8s.io/v1beta1: the server is currently unable to handle the request"
E0922 16:03:39.783711 2686124 memcache.go:121] "Unhandled Error" err="couldn't get resource list for metrics.k8s.io/v1beta1: the server is currently unable to handle the request"
E0922 16:03:39.790723 2686124 memcache.go:121] "Unhandled Error" err="couldn't get resource list for metrics.k8s.io/v1beta1: the server is currently unable to handle the request"
Error from server (NotFound): pods "metrics-server-9975d5f86-9dfk7" not found
** /stderr **
helpers_test.go:279: kubectl --context old-k8s-version-516480 describe pod metrics-server-9975d5f86-9dfk7: exit status 1
--- FAIL: TestStartStop/group/old-k8s-version/serial/SecondStart (381.05s)