=== RUN TestStartStop/group/old-k8s-version/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run: out/minikube-linux-arm64 start -p old-k8s-version-196977 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --container-runtime=crio --kubernetes-version=v1.20.0
start_stop_delete_test.go:256: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p old-k8s-version-196977 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --container-runtime=crio --kubernetes-version=v1.20.0: exit status 102 (6m16.234613268s)
-- stdout --
* [old-k8s-version-196977] minikube v1.33.1 on Ubuntu 20.04 (arm64)
- MINIKUBE_LOCATION=18932
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/18932-2131433/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/18932-2131433/.minikube
- MINIKUBE_BIN=out/minikube-linux-arm64
- MINIKUBE_FORCE_SYSTEMD=
* Kubernetes 1.30.1 is now available. If you would like to upgrade, specify: --kubernetes-version=v1.30.1
* Using the docker driver based on existing profile
* Starting "old-k8s-version-196977" primary control-plane node in "old-k8s-version-196977" cluster
* Pulling base image v0.0.44-1715707529-18887 ...
* Restarting existing docker container for "old-k8s-version-196977" ...
* Preparing Kubernetes v1.20.0 on CRI-O 1.24.6 ...
* Verifying Kubernetes components...
- Using image gcr.io/k8s-minikube/storage-provisioner:v5
- Using image docker.io/kubernetesui/dashboard:v2.7.0
- Using image registry.k8s.io/echoserver:1.4
- Using image fake.domain/registry.k8s.io/echoserver:1.4
* Some dashboard features require the metrics-server addon. To enable all features please run:
minikube -p old-k8s-version-196977 addons enable metrics-server
* Enabled addons: metrics-server, storage-provisioner, dashboard, default-storageclass
-- /stdout --
** stderr **
I0520 13:55:47.894421 2324155 out.go:291] Setting OutFile to fd 1 ...
I0520 13:55:47.894539 2324155 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0520 13:55:47.894546 2324155 out.go:304] Setting ErrFile to fd 2...
I0520 13:55:47.894551 2324155 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0520 13:55:47.894795 2324155 root.go:338] Updating PATH: /home/jenkins/minikube-integration/18932-2131433/.minikube/bin
I0520 13:55:47.895152 2324155 out.go:298] Setting JSON to false
I0520 13:55:47.896077 2324155 start.go:129] hostinfo: {"hostname":"ip-172-31-21-244","uptime":164295,"bootTime":1716049053,"procs":197,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1058-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"da8ac1fd-6236-412a-a346-95873c98230d"}
I0520 13:55:47.896156 2324155 start.go:139] virtualization:
I0520 13:55:47.901139 2324155 out.go:177] * [old-k8s-version-196977] minikube v1.33.1 on Ubuntu 20.04 (arm64)
I0520 13:55:47.902929 2324155 out.go:177] - MINIKUBE_LOCATION=18932
I0520 13:55:47.904570 2324155 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0520 13:55:47.902974 2324155 notify.go:220] Checking for updates...
I0520 13:55:47.906574 2324155 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/18932-2131433/kubeconfig
I0520 13:55:47.908587 2324155 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/18932-2131433/.minikube
I0520 13:55:47.910709 2324155 out.go:177] - MINIKUBE_BIN=out/minikube-linux-arm64
I0520 13:55:47.912577 2324155 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0520 13:55:47.914875 2324155 config.go:182] Loaded profile config "old-k8s-version-196977": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.20.0
I0520 13:55:47.916962 2324155 out.go:177] * Kubernetes 1.30.1 is now available. If you would like to upgrade, specify: --kubernetes-version=v1.30.1
I0520 13:55:47.918811 2324155 driver.go:392] Setting default libvirt URI to qemu:///system
I0520 13:55:47.958874 2324155 docker.go:122] docker version: linux-26.1.3:Docker Engine - Community
I0520 13:55:47.958999 2324155 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0520 13:55:48.053465 2324155 info.go:266] docker info: {ID:5FDH:SA5P:5GCT:NLAS:B73P:SGDQ:PBG5:UBVH:UZY3:RXGO:CI7S:WAIH Containers:2 ContainersRunning:1 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:50 OomKillDisable:true NGoroutines:67 SystemTime:2024-05-20 13:55:48.042912874 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1058-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8215035904 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-21-244 Labels:[] ExperimentalBuild:false ServerVersion:26.1.3 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:e377cd56a71523140ca6ae87e30244719194a521 Expected:e377cd56a71523140ca6ae87e30244719194a521} RuncCommit:{ID:v1.1.12-0-g51d5e94 Expected:v1.1.12-0-g51d5e94} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.14.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.27.0]] Warnings:<nil>}}
I0520 13:55:48.053579 2324155 docker.go:295] overlay module found
I0520 13:55:48.055850 2324155 out.go:177] * Using the docker driver based on existing profile
I0520 13:55:48.057460 2324155 start.go:297] selected driver: docker
I0520 13:55:48.057476 2324155 start.go:901] validating driver "docker" against &{Name:old-k8s-version-196977 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1715707529-18887@sha256:734a2adad159415bd51b0392bc8976bd7e3e543e9165c2374d6e59bac37aed3a Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-196977 Namespace:default APIServerHAVIP: AP
IServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountStr
ing:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0520 13:55:48.057567 2324155 start.go:912] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0520 13:55:48.058325 2324155 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0520 13:55:48.150994 2324155 info.go:266] docker info: {ID:5FDH:SA5P:5GCT:NLAS:B73P:SGDQ:PBG5:UBVH:UZY3:RXGO:CI7S:WAIH Containers:2 ContainersRunning:1 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:50 OomKillDisable:true NGoroutines:67 SystemTime:2024-05-20 13:55:48.141909422 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1058-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8215035904 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-21-244 Labels:[] ExperimentalBuild:false ServerVersion:26.1.3 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:e377cd56a71523140ca6ae87e30244719194a521 Expected:e377cd56a71523140ca6ae87e30244719194a521} RuncCommit:{ID:v1.1.12-0-g51d5e94 Expected:v1.1.12-0-g51d5e94} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.14.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.27.0]] Warnings:<nil>}}
I0520 13:55:48.151343 2324155 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0520 13:55:48.151364 2324155 cni.go:84] Creating CNI manager for ""
I0520 13:55:48.151380 2324155 cni.go:143] "docker" driver + "crio" runtime found, recommending kindnet
I0520 13:55:48.151419 2324155 start.go:340] cluster config:
{Name:old-k8s-version-196977 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1715707529-18887@sha256:734a2adad159415bd51b0392bc8976bd7e3e543e9165c2374d6e59bac37aed3a Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-196977 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local
ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP
: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0520 13:55:48.153630 2324155 out.go:177] * Starting "old-k8s-version-196977" primary control-plane node in "old-k8s-version-196977" cluster
I0520 13:55:48.155487 2324155 cache.go:121] Beginning downloading kic base image for docker with crio
I0520 13:55:48.157226 2324155 out.go:177] * Pulling base image v0.0.44-1715707529-18887 ...
I0520 13:55:48.158828 2324155 preload.go:132] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0520 13:55:48.158892 2324155 preload.go:147] Found local preload: /home/jenkins/minikube-integration/18932-2131433/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-arm64.tar.lz4
I0520 13:55:48.158907 2324155 cache.go:56] Caching tarball of preloaded images
I0520 13:55:48.158991 2324155 preload.go:173] Found /home/jenkins/minikube-integration/18932-2131433/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-arm64.tar.lz4 in cache, skipping download
I0520 13:55:48.159005 2324155 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on crio
I0520 13:55:48.159125 2324155 profile.go:143] Saving config to /home/jenkins/minikube-integration/18932-2131433/.minikube/profiles/old-k8s-version-196977/config.json ...
I0520 13:55:48.159344 2324155 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1715707529-18887@sha256:734a2adad159415bd51b0392bc8976bd7e3e543e9165c2374d6e59bac37aed3a in local docker daemon
I0520 13:55:48.176752 2324155 image.go:83] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1715707529-18887@sha256:734a2adad159415bd51b0392bc8976bd7e3e543e9165c2374d6e59bac37aed3a in local docker daemon, skipping pull
I0520 13:55:48.176777 2324155 cache.go:144] gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1715707529-18887@sha256:734a2adad159415bd51b0392bc8976bd7e3e543e9165c2374d6e59bac37aed3a exists in daemon, skipping load
I0520 13:55:48.176806 2324155 cache.go:194] Successfully downloaded all kic artifacts
I0520 13:55:48.176848 2324155 start.go:360] acquireMachinesLock for old-k8s-version-196977: {Name:mkcfc55611b1f90e6ec0322b2a7093693d56b8b4 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0520 13:55:48.176919 2324155 start.go:364] duration metric: took 44.611µs to acquireMachinesLock for "old-k8s-version-196977"
I0520 13:55:48.176950 2324155 start.go:96] Skipping create...Using existing machine configuration
I0520 13:55:48.176955 2324155 fix.go:54] fixHost starting:
I0520 13:55:48.177228 2324155 cli_runner.go:164] Run: docker container inspect old-k8s-version-196977 --format={{.State.Status}}
I0520 13:55:48.206161 2324155 fix.go:112] recreateIfNeeded on old-k8s-version-196977: state=Stopped err=<nil>
W0520 13:55:48.206203 2324155 fix.go:138] unexpected machine state, will restart: <nil>
I0520 13:55:48.208354 2324155 out.go:177] * Restarting existing docker container for "old-k8s-version-196977" ...
I0520 13:55:48.210084 2324155 cli_runner.go:164] Run: docker start old-k8s-version-196977
I0520 13:55:48.615736 2324155 cli_runner.go:164] Run: docker container inspect old-k8s-version-196977 --format={{.State.Status}}
I0520 13:55:48.654509 2324155 kic.go:430] container "old-k8s-version-196977" state is running.
I0520 13:55:48.654880 2324155 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-196977
I0520 13:55:48.683708 2324155 profile.go:143] Saving config to /home/jenkins/minikube-integration/18932-2131433/.minikube/profiles/old-k8s-version-196977/config.json ...
I0520 13:55:48.683937 2324155 machine.go:94] provisionDockerMachine start ...
I0520 13:55:48.684000 2324155 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-196977
I0520 13:55:48.713954 2324155 main.go:141] libmachine: Using SSH client type: native
I0520 13:55:48.714221 2324155 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e2b30] 0x3e5390 <nil> [] 0s} 127.0.0.1 41548 <nil> <nil>}
I0520 13:55:48.714229 2324155 main.go:141] libmachine: About to run SSH command:
hostname
I0520 13:55:48.715189 2324155 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: EOF
I0520 13:55:51.846168 2324155 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-196977
I0520 13:55:51.846219 2324155 ubuntu.go:169] provisioning hostname "old-k8s-version-196977"
I0520 13:55:51.846291 2324155 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-196977
I0520 13:55:51.870574 2324155 main.go:141] libmachine: Using SSH client type: native
I0520 13:55:51.870857 2324155 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e2b30] 0x3e5390 <nil> [] 0s} 127.0.0.1 41548 <nil> <nil>}
I0520 13:55:51.870877 2324155 main.go:141] libmachine: About to run SSH command:
sudo hostname old-k8s-version-196977 && echo "old-k8s-version-196977" | sudo tee /etc/hostname
I0520 13:55:52.027079 2324155 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-196977
I0520 13:55:52.027197 2324155 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-196977
I0520 13:55:52.082030 2324155 main.go:141] libmachine: Using SSH client type: native
I0520 13:55:52.082303 2324155 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e2b30] 0x3e5390 <nil> [] 0s} 127.0.0.1 41548 <nil> <nil>}
I0520 13:55:52.082326 2324155 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-196977' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-196977/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-196977' | sudo tee -a /etc/hosts;
fi
fi
I0520 13:55:52.233883 2324155 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0520 13:55:52.233907 2324155 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/18932-2131433/.minikube CaCertPath:/home/jenkins/minikube-integration/18932-2131433/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/18932-2131433/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/18932-2131433/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/18932-2131433/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/18932-2131433/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/18932-2131433/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/18932-2131433/.minikube}
I0520 13:55:52.233945 2324155 ubuntu.go:177] setting up certificates
I0520 13:55:52.233965 2324155 provision.go:84] configureAuth start
I0520 13:55:52.234033 2324155 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-196977
I0520 13:55:52.271086 2324155 provision.go:143] copyHostCerts
I0520 13:55:52.271157 2324155 exec_runner.go:144] found /home/jenkins/minikube-integration/18932-2131433/.minikube/cert.pem, removing ...
I0520 13:55:52.271173 2324155 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18932-2131433/.minikube/cert.pem
I0520 13:55:52.271261 2324155 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18932-2131433/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/18932-2131433/.minikube/cert.pem (1123 bytes)
I0520 13:55:52.271364 2324155 exec_runner.go:144] found /home/jenkins/minikube-integration/18932-2131433/.minikube/key.pem, removing ...
I0520 13:55:52.271370 2324155 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18932-2131433/.minikube/key.pem
I0520 13:55:52.271399 2324155 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18932-2131433/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/18932-2131433/.minikube/key.pem (1679 bytes)
I0520 13:55:52.271452 2324155 exec_runner.go:144] found /home/jenkins/minikube-integration/18932-2131433/.minikube/ca.pem, removing ...
I0520 13:55:52.271456 2324155 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18932-2131433/.minikube/ca.pem
I0520 13:55:52.271479 2324155 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18932-2131433/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/18932-2131433/.minikube/ca.pem (1078 bytes)
I0520 13:55:52.271524 2324155 provision.go:117] generating server cert: /home/jenkins/minikube-integration/18932-2131433/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/18932-2131433/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/18932-2131433/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-196977 san=[127.0.0.1 192.168.76.2 localhost minikube old-k8s-version-196977]
I0520 13:55:52.704766 2324155 provision.go:177] copyRemoteCerts
I0520 13:55:52.704962 2324155 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0520 13:55:52.705061 2324155 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-196977
I0520 13:55:52.726877 2324155 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:41548 SSHKeyPath:/home/jenkins/minikube-integration/18932-2131433/.minikube/machines/old-k8s-version-196977/id_rsa Username:docker}
I0520 13:55:52.824238 2324155 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18932-2131433/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0520 13:55:52.851390 2324155 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18932-2131433/.minikube/machines/server.pem --> /etc/docker/server.pem (1233 bytes)
I0520 13:55:52.878641 2324155 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18932-2131433/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I0520 13:55:52.912718 2324155 provision.go:87] duration metric: took 678.72828ms to configureAuth
I0520 13:55:52.912795 2324155 ubuntu.go:193] setting minikube options for container-runtime
I0520 13:55:52.913038 2324155 config.go:182] Loaded profile config "old-k8s-version-196977": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.20.0
I0520 13:55:52.913207 2324155 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-196977
I0520 13:55:52.954776 2324155 main.go:141] libmachine: Using SSH client type: native
I0520 13:55:52.955025 2324155 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e2b30] 0x3e5390 <nil> [] 0s} 127.0.0.1 41548 <nil> <nil>}
I0520 13:55:52.955039 2324155 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %s "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0520 13:55:53.446737 2324155 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0520 13:55:53.446756 2324155 machine.go:97] duration metric: took 4.762809991s to provisionDockerMachine
I0520 13:55:53.446768 2324155 start.go:293] postStartSetup for "old-k8s-version-196977" (driver="docker")
I0520 13:55:53.446779 2324155 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0520 13:55:53.446861 2324155 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0520 13:55:53.446900 2324155 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-196977
I0520 13:55:53.474939 2324155 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:41548 SSHKeyPath:/home/jenkins/minikube-integration/18932-2131433/.minikube/machines/old-k8s-version-196977/id_rsa Username:docker}
I0520 13:55:53.571698 2324155 ssh_runner.go:195] Run: cat /etc/os-release
I0520 13:55:53.576765 2324155 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I0520 13:55:53.576800 2324155 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
I0520 13:55:53.576814 2324155 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
I0520 13:55:53.576821 2324155 info.go:137] Remote host: Ubuntu 22.04.4 LTS
I0520 13:55:53.576831 2324155 filesync.go:126] Scanning /home/jenkins/minikube-integration/18932-2131433/.minikube/addons for local assets ...
I0520 13:55:53.576895 2324155 filesync.go:126] Scanning /home/jenkins/minikube-integration/18932-2131433/.minikube/files for local assets ...
I0520 13:55:53.576974 2324155 filesync.go:149] local asset: /home/jenkins/minikube-integration/18932-2131433/.minikube/files/etc/ssl/certs/21368502.pem -> 21368502.pem in /etc/ssl/certs
I0520 13:55:53.577077 2324155 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0520 13:55:53.587763 2324155 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18932-2131433/.minikube/files/etc/ssl/certs/21368502.pem --> /etc/ssl/certs/21368502.pem (1708 bytes)
I0520 13:55:53.615515 2324155 start.go:296] duration metric: took 168.731452ms for postStartSetup
I0520 13:55:53.615601 2324155 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I0520 13:55:53.615672 2324155 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-196977
I0520 13:55:53.643343 2324155 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:41548 SSHKeyPath:/home/jenkins/minikube-integration/18932-2131433/.minikube/machines/old-k8s-version-196977/id_rsa Username:docker}
I0520 13:55:53.767316 2324155 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
I0520 13:55:53.772308 2324155 fix.go:56] duration metric: took 5.595344018s for fixHost
I0520 13:55:53.772338 2324155 start.go:83] releasing machines lock for "old-k8s-version-196977", held for 5.595409519s
I0520 13:55:53.772408 2324155 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-196977
I0520 13:55:53.791076 2324155 ssh_runner.go:195] Run: cat /version.json
I0520 13:55:53.791134 2324155 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-196977
I0520 13:55:53.791374 2324155 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0520 13:55:53.791430 2324155 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-196977
I0520 13:55:53.816146 2324155 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:41548 SSHKeyPath:/home/jenkins/minikube-integration/18932-2131433/.minikube/machines/old-k8s-version-196977/id_rsa Username:docker}
I0520 13:55:53.831443 2324155 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:41548 SSHKeyPath:/home/jenkins/minikube-integration/18932-2131433/.minikube/machines/old-k8s-version-196977/id_rsa Username:docker}
I0520 13:55:53.913569 2324155 ssh_runner.go:195] Run: systemctl --version
I0520 13:55:54.035749 2324155 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0520 13:55:54.195075 2324155 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
I0520 13:55:54.199646 2324155 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0520 13:55:54.208713 2324155 cni.go:221] loopback cni configuration disabled: "/etc/cni/net.d/*loopback.conf*" found
I0520 13:55:54.208839 2324155 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0520 13:55:54.219319 2324155 cni.go:259] no active bridge cni configs found in "/etc/cni/net.d" - nothing to disable
I0520 13:55:54.219382 2324155 start.go:494] detecting cgroup driver to use...
I0520 13:55:54.219429 2324155 detect.go:196] detected "cgroupfs" cgroup driver on host os
I0520 13:55:54.219499 2324155 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0520 13:55:54.242475 2324155 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0520 13:55:54.255717 2324155 docker.go:217] disabling cri-docker service (if available) ...
I0520 13:55:54.255831 2324155 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0520 13:55:54.270107 2324155 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0520 13:55:54.283205 2324155 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0520 13:55:54.396472 2324155 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0520 13:55:54.512997 2324155 docker.go:233] disabling docker service ...
I0520 13:55:54.513125 2324155 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0520 13:55:54.530086 2324155 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0520 13:55:54.543187 2324155 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0520 13:55:54.659876 2324155 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0520 13:55:54.781555 2324155 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0520 13:55:54.795431 2324155 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0520 13:55:54.813079 2324155 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.2" pause image...
I0520 13:55:54.813208 2324155 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.2"|' /etc/crio/crio.conf.d/02-crio.conf"
I0520 13:55:54.825151 2324155 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0520 13:55:54.825289 2324155 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0520 13:55:54.836230 2324155 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0520 13:55:54.847285 2324155 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0520 13:55:54.857983 2324155 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0520 13:55:54.867940 2324155 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0520 13:55:54.877844 2324155 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0520 13:55:54.887472 2324155 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0520 13:55:54.999504 2324155 ssh_runner.go:195] Run: sudo systemctl restart crio
I0520 13:55:55.682969 2324155 start.go:541] Will wait 60s for socket path /var/run/crio/crio.sock
I0520 13:55:55.683131 2324155 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0520 13:55:55.687027 2324155 start.go:562] Will wait 60s for crictl version
I0520 13:55:55.687138 2324155 ssh_runner.go:195] Run: which crictl
I0520 13:55:55.692469 2324155 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0520 13:55:55.749569 2324155 start.go:578] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.24.6
RuntimeApiVersion: v1
I0520 13:55:55.749728 2324155 ssh_runner.go:195] Run: crio --version
I0520 13:55:55.801725 2324155 ssh_runner.go:195] Run: crio --version
I0520 13:55:55.859305 2324155 out.go:177] * Preparing Kubernetes v1.20.0 on CRI-O 1.24.6 ...
I0520 13:55:55.861211 2324155 cli_runner.go:164] Run: docker network inspect old-k8s-version-196977 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I0520 13:55:55.876407 2324155 ssh_runner.go:195] Run: grep 192.168.76.1 host.minikube.internal$ /etc/hosts
I0520 13:55:55.880391 2324155 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.76.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0520 13:55:55.891804 2324155 kubeadm.go:877] updating cluster {Name:old-k8s-version-196977 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1715707529-18887@sha256:734a2adad159415bd51b0392bc8976bd7e3e543e9165c2374d6e59bac37aed3a Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-196977 Namespace:default APIServerHAVIP: APIServerName:minik
ubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins
:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0520 13:55:55.891931 2324155 preload.go:132] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0520 13:55:55.892001 2324155 ssh_runner.go:195] Run: sudo crictl images --output json
I0520 13:55:55.948613 2324155 crio.go:514] all images are preloaded for cri-o runtime.
I0520 13:55:55.948639 2324155 crio.go:433] Images already preloaded, skipping extraction
I0520 13:55:55.948698 2324155 ssh_runner.go:195] Run: sudo crictl images --output json
I0520 13:55:55.995047 2324155 crio.go:514] all images are preloaded for cri-o runtime.
I0520 13:55:55.995072 2324155 cache_images.go:84] Images are preloaded, skipping loading
I0520 13:55:55.995081 2324155 kubeadm.go:928] updating node { 192.168.76.2 8443 v1.20.0 crio true true} ...
I0520 13:55:55.995245 2324155 kubeadm.go:940] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.20.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --cgroups-per-qos=false --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///var/run/crio/crio.sock --enforce-node-allocatable= --hostname-override=old-k8s-version-196977 --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.76.2
[Install]
config:
{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-196977 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0520 13:55:55.995372 2324155 ssh_runner.go:195] Run: crio config
I0520 13:55:56.067702 2324155 cni.go:84] Creating CNI manager for ""
I0520 13:55:56.067726 2324155 cni.go:143] "docker" driver + "crio" runtime found, recommending kindnet
I0520 13:55:56.067736 2324155 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0520 13:55:56.067782 2324155 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.76.2 APIServerPort:8443 KubernetesVersion:v1.20.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-196977 NodeName:old-k8s-version-196977 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.76.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.76.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPo
dPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
I0520 13:55:56.067982 2324155 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta2
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.76.2
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /var/run/crio/crio.sock
name: "old-k8s-version-196977"
kubeletExtraArgs:
node-ip: 192.168.76.2
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta2
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.76.2"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.20.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0520 13:55:56.068093 2324155 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.20.0
I0520 13:55:56.078175 2324155 binaries.go:44] Found k8s binaries, skipping transfer
I0520 13:55:56.078284 2324155 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0520 13:55:56.087961 2324155 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (480 bytes)
I0520 13:55:56.107644 2324155 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0520 13:55:56.132761 2324155 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2117 bytes)
I0520 13:55:56.153128 2324155 ssh_runner.go:195] Run: grep 192.168.76.2 control-plane.minikube.internal$ /etc/hosts
I0520 13:55:56.157148 2324155 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.76.2 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0520 13:55:56.168489 2324155 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0520 13:55:56.274119 2324155 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0520 13:55:56.291321 2324155 certs.go:68] Setting up /home/jenkins/minikube-integration/18932-2131433/.minikube/profiles/old-k8s-version-196977 for IP: 192.168.76.2
I0520 13:55:56.291343 2324155 certs.go:194] generating shared ca certs ...
I0520 13:55:56.291364 2324155 certs.go:226] acquiring lock for ca certs: {Name:mkda41de55619bd96b621e0f7a20a1099e6afcc5 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0520 13:55:56.291585 2324155 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/18932-2131433/.minikube/ca.key
I0520 13:55:56.291658 2324155 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/18932-2131433/.minikube/proxy-client-ca.key
I0520 13:55:56.291673 2324155 certs.go:256] generating profile certs ...
I0520 13:55:56.291799 2324155 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/18932-2131433/.minikube/profiles/old-k8s-version-196977/client.key
I0520 13:55:56.291904 2324155 certs.go:359] skipping valid signed profile cert regeneration for "minikube": /home/jenkins/minikube-integration/18932-2131433/.minikube/profiles/old-k8s-version-196977/apiserver.key.7d86c9e7
I0520 13:55:56.291976 2324155 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/18932-2131433/.minikube/profiles/old-k8s-version-196977/proxy-client.key
I0520 13:55:56.292134 2324155 certs.go:484] found cert: /home/jenkins/minikube-integration/18932-2131433/.minikube/certs/2136850.pem (1338 bytes)
W0520 13:55:56.292196 2324155 certs.go:480] ignoring /home/jenkins/minikube-integration/18932-2131433/.minikube/certs/2136850_empty.pem, impossibly tiny 0 bytes
I0520 13:55:56.292213 2324155 certs.go:484] found cert: /home/jenkins/minikube-integration/18932-2131433/.minikube/certs/ca-key.pem (1675 bytes)
I0520 13:55:56.292259 2324155 certs.go:484] found cert: /home/jenkins/minikube-integration/18932-2131433/.minikube/certs/ca.pem (1078 bytes)
I0520 13:55:56.292309 2324155 certs.go:484] found cert: /home/jenkins/minikube-integration/18932-2131433/.minikube/certs/cert.pem (1123 bytes)
I0520 13:55:56.292357 2324155 certs.go:484] found cert: /home/jenkins/minikube-integration/18932-2131433/.minikube/certs/key.pem (1679 bytes)
I0520 13:55:56.292447 2324155 certs.go:484] found cert: /home/jenkins/minikube-integration/18932-2131433/.minikube/files/etc/ssl/certs/21368502.pem (1708 bytes)
I0520 13:55:56.293185 2324155 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18932-2131433/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0520 13:55:56.336468 2324155 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18932-2131433/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
I0520 13:55:56.427269 2324155 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18932-2131433/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0520 13:55:56.484417 2324155 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18932-2131433/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I0520 13:55:56.510292 2324155 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18932-2131433/.minikube/profiles/old-k8s-version-196977/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
I0520 13:55:56.540001 2324155 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18932-2131433/.minikube/profiles/old-k8s-version-196977/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I0520 13:55:56.576590 2324155 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18932-2131433/.minikube/profiles/old-k8s-version-196977/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0520 13:55:56.604299 2324155 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18932-2131433/.minikube/profiles/old-k8s-version-196977/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
I0520 13:55:56.635070 2324155 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18932-2131433/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0520 13:55:56.662209 2324155 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18932-2131433/.minikube/certs/2136850.pem --> /usr/share/ca-certificates/2136850.pem (1338 bytes)
I0520 13:55:56.688690 2324155 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18932-2131433/.minikube/files/etc/ssl/certs/21368502.pem --> /usr/share/ca-certificates/21368502.pem (1708 bytes)
I0520 13:55:56.715414 2324155 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0520 13:55:56.735298 2324155 ssh_runner.go:195] Run: openssl version
I0520 13:55:56.741412 2324155 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0520 13:55:56.751920 2324155 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0520 13:55:56.756018 2324155 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 May 20 12:59 /usr/share/ca-certificates/minikubeCA.pem
I0520 13:55:56.756130 2324155 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0520 13:55:56.763493 2324155 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0520 13:55:56.773344 2324155 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/2136850.pem && ln -fs /usr/share/ca-certificates/2136850.pem /etc/ssl/certs/2136850.pem"
I0520 13:55:56.783339 2324155 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/2136850.pem
I0520 13:55:56.787530 2324155 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 May 20 13:10 /usr/share/ca-certificates/2136850.pem
I0520 13:55:56.787645 2324155 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/2136850.pem
I0520 13:55:56.795188 2324155 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/2136850.pem /etc/ssl/certs/51391683.0"
I0520 13:55:56.805029 2324155 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/21368502.pem && ln -fs /usr/share/ca-certificates/21368502.pem /etc/ssl/certs/21368502.pem"
I0520 13:55:56.815300 2324155 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/21368502.pem
I0520 13:55:56.820747 2324155 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 May 20 13:10 /usr/share/ca-certificates/21368502.pem
I0520 13:55:56.820963 2324155 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/21368502.pem
I0520 13:55:56.828655 2324155 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/21368502.pem /etc/ssl/certs/3ec20f2e.0"
I0520 13:55:56.838824 2324155 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0520 13:55:56.843133 2324155 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-etcd-client.crt -checkend 86400
I0520 13:55:56.851227 2324155 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-kubelet-client.crt -checkend 86400
I0520 13:55:56.859324 2324155 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/server.crt -checkend 86400
I0520 13:55:56.867034 2324155 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/healthcheck-client.crt -checkend 86400
I0520 13:55:56.874426 2324155 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/peer.crt -checkend 86400
I0520 13:55:56.881885 2324155 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/front-proxy-client.crt -checkend 86400
I0520 13:55:56.889219 2324155 kubeadm.go:391] StartCluster: {Name:old-k8s-version-196977 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1715707529-18887@sha256:734a2adad159415bd51b0392bc8976bd7e3e543e9165c2374d6e59bac37aed3a Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-196977 Namespace:default APIServerHAVIP: APIServerName:minikube
CA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/m
inikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0520 13:55:56.889367 2324155 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I0520 13:55:56.889470 2324155 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0520 13:55:56.952502 2324155 cri.go:89] found id: ""
I0520 13:55:56.952622 2324155 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
W0520 13:55:56.962800 2324155 kubeadm.go:404] apiserver tunnel failed: apiserver port not set
I0520 13:55:56.962870 2324155 kubeadm.go:407] found existing configuration files, will attempt cluster restart
I0520 13:55:56.962889 2324155 kubeadm.go:587] restartPrimaryControlPlane start ...
I0520 13:55:56.962975 2324155 ssh_runner.go:195] Run: sudo test -d /data/minikube
I0520 13:55:56.972734 2324155 kubeadm.go:129] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1
stdout:
stderr:
I0520 13:55:56.973293 2324155 kubeconfig.go:47] verify endpoint returned: get endpoint: "old-k8s-version-196977" does not appear in /home/jenkins/minikube-integration/18932-2131433/kubeconfig
I0520 13:55:56.973464 2324155 kubeconfig.go:62] /home/jenkins/minikube-integration/18932-2131433/kubeconfig needs updating (will repair): [kubeconfig missing "old-k8s-version-196977" cluster setting kubeconfig missing "old-k8s-version-196977" context setting]
I0520 13:55:56.973863 2324155 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18932-2131433/kubeconfig: {Name:mk25e4292d0f0e8cead7cbea265d93ee120fa58d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0520 13:55:56.975201 2324155 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new
I0520 13:55:56.985034 2324155 kubeadm.go:624] The running cluster does not require reconfiguration: 192.168.76.2
I0520 13:55:56.985106 2324155 kubeadm.go:591] duration metric: took 22.193005ms to restartPrimaryControlPlane
I0520 13:55:56.985130 2324155 kubeadm.go:393] duration metric: took 95.921262ms to StartCluster
I0520 13:55:56.985177 2324155 settings.go:142] acquiring lock: {Name:mk8a804dace6c895f546e9ce556774d71bbc812c Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0520 13:55:56.985255 2324155 settings.go:150] Updating kubeconfig: /home/jenkins/minikube-integration/18932-2131433/kubeconfig
I0520 13:55:56.985949 2324155 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18932-2131433/kubeconfig: {Name:mk25e4292d0f0e8cead7cbea265d93ee120fa58d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0520 13:55:56.986199 2324155 start.go:234] Will wait 6m0s for node &{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}
I0520 13:55:56.989188 2324155 out.go:177] * Verifying Kubernetes components...
I0520 13:55:56.986550 2324155 config.go:182] Loaded profile config "old-k8s-version-196977": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.20.0
I0520 13:55:56.986576 2324155 addons.go:502] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:true default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:false volumesnapshots:false yakd:false]
I0520 13:55:56.991072 2324155 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0520 13:55:56.991117 2324155 addons.go:69] Setting storage-provisioner=true in profile "old-k8s-version-196977"
I0520 13:55:56.991166 2324155 addons.go:234] Setting addon storage-provisioner=true in "old-k8s-version-196977"
W0520 13:55:56.991197 2324155 addons.go:243] addon storage-provisioner should already be in state true
I0520 13:55:56.991226 2324155 addons.go:69] Setting default-storageclass=true in profile "old-k8s-version-196977"
I0520 13:55:56.991253 2324155 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "old-k8s-version-196977"
I0520 13:55:56.991283 2324155 host.go:66] Checking if "old-k8s-version-196977" exists ...
I0520 13:55:56.991519 2324155 cli_runner.go:164] Run: docker container inspect old-k8s-version-196977 --format={{.State.Status}}
I0520 13:55:56.991801 2324155 cli_runner.go:164] Run: docker container inspect old-k8s-version-196977 --format={{.State.Status}}
I0520 13:55:56.991172 2324155 addons.go:69] Setting dashboard=true in profile "old-k8s-version-196977"
I0520 13:55:56.993037 2324155 addons.go:234] Setting addon dashboard=true in "old-k8s-version-196977"
W0520 13:55:56.993063 2324155 addons.go:243] addon dashboard should already be in state true
I0520 13:55:56.993125 2324155 host.go:66] Checking if "old-k8s-version-196977" exists ...
I0520 13:55:56.993151 2324155 addons.go:69] Setting metrics-server=true in profile "old-k8s-version-196977"
I0520 13:55:56.993184 2324155 addons.go:234] Setting addon metrics-server=true in "old-k8s-version-196977"
W0520 13:55:56.993196 2324155 addons.go:243] addon metrics-server should already be in state true
I0520 13:55:56.993222 2324155 host.go:66] Checking if "old-k8s-version-196977" exists ...
I0520 13:55:56.993615 2324155 cli_runner.go:164] Run: docker container inspect old-k8s-version-196977 --format={{.State.Status}}
I0520 13:55:56.995812 2324155 cli_runner.go:164] Run: docker container inspect old-k8s-version-196977 --format={{.State.Status}}
I0520 13:55:57.039120 2324155 out.go:177] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
I0520 13:55:57.041420 2324155 addons.go:426] installing /etc/kubernetes/addons/storage-provisioner.yaml
I0520 13:55:57.041444 2324155 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I0520 13:55:57.041515 2324155 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-196977
I0520 13:55:57.069889 2324155 out.go:177] - Using image docker.io/kubernetesui/dashboard:v2.7.0
I0520 13:55:57.072106 2324155 out.go:177] - Using image registry.k8s.io/echoserver:1.4
I0520 13:55:57.074036 2324155 addons.go:426] installing /etc/kubernetes/addons/dashboard-ns.yaml
I0520 13:55:57.074061 2324155 ssh_runner.go:362] scp dashboard/dashboard-ns.yaml --> /etc/kubernetes/addons/dashboard-ns.yaml (759 bytes)
I0520 13:55:57.074144 2324155 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-196977
I0520 13:55:57.078660 2324155 addons.go:234] Setting addon default-storageclass=true in "old-k8s-version-196977"
W0520 13:55:57.078684 2324155 addons.go:243] addon default-storageclass should already be in state true
I0520 13:55:57.078713 2324155 host.go:66] Checking if "old-k8s-version-196977" exists ...
I0520 13:55:57.079133 2324155 cli_runner.go:164] Run: docker container inspect old-k8s-version-196977 --format={{.State.Status}}
I0520 13:55:57.098981 2324155 out.go:177] - Using image fake.domain/registry.k8s.io/echoserver:1.4
I0520 13:55:57.102900 2324155 addons.go:426] installing /etc/kubernetes/addons/metrics-apiservice.yaml
I0520 13:55:57.102926 2324155 ssh_runner.go:362] scp metrics-server/metrics-apiservice.yaml --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)
I0520 13:55:57.103003 2324155 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-196977
I0520 13:55:57.138113 2324155 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:41548 SSHKeyPath:/home/jenkins/minikube-integration/18932-2131433/.minikube/machines/old-k8s-version-196977/id_rsa Username:docker}
I0520 13:55:57.145320 2324155 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:41548 SSHKeyPath:/home/jenkins/minikube-integration/18932-2131433/.minikube/machines/old-k8s-version-196977/id_rsa Username:docker}
I0520 13:55:57.154051 2324155 addons.go:426] installing /etc/kubernetes/addons/storageclass.yaml
I0520 13:55:57.154074 2324155 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I0520 13:55:57.154139 2324155 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-196977
I0520 13:55:57.189173 2324155 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:41548 SSHKeyPath:/home/jenkins/minikube-integration/18932-2131433/.minikube/machines/old-k8s-version-196977/id_rsa Username:docker}
I0520 13:55:57.189201 2324155 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:41548 SSHKeyPath:/home/jenkins/minikube-integration/18932-2131433/.minikube/machines/old-k8s-version-196977/id_rsa Username:docker}
I0520 13:55:57.302847 2324155 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0520 13:55:57.338805 2324155 node_ready.go:35] waiting up to 6m0s for node "old-k8s-version-196977" to be "Ready" ...
I0520 13:55:57.361078 2324155 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I0520 13:55:57.391805 2324155 addons.go:426] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
I0520 13:55:57.391880 2324155 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1825 bytes)
I0520 13:55:57.414946 2324155 addons.go:426] installing /etc/kubernetes/addons/dashboard-clusterrole.yaml
I0520 13:55:57.415020 2324155 ssh_runner.go:362] scp dashboard/dashboard-clusterrole.yaml --> /etc/kubernetes/addons/dashboard-clusterrole.yaml (1001 bytes)
I0520 13:55:57.428319 2324155 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
I0520 13:55:57.473180 2324155 addons.go:426] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
I0520 13:55:57.473258 2324155 ssh_runner.go:362] scp metrics-server/metrics-server-rbac.yaml --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)
I0520 13:55:57.502677 2324155 addons.go:426] installing /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml
I0520 13:55:57.502700 2324155 ssh_runner.go:362] scp dashboard/dashboard-clusterrolebinding.yaml --> /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml (1018 bytes)
I0520 13:55:57.544531 2324155 addons.go:426] installing /etc/kubernetes/addons/metrics-server-service.yaml
I0520 13:55:57.544554 2324155 ssh_runner.go:362] scp metrics-server/metrics-server-service.yaml --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)
I0520 13:55:57.558434 2324155 addons.go:426] installing /etc/kubernetes/addons/dashboard-configmap.yaml
I0520 13:55:57.558456 2324155 ssh_runner.go:362] scp dashboard/dashboard-configmap.yaml --> /etc/kubernetes/addons/dashboard-configmap.yaml (837 bytes)
W0520 13:55:57.642227 2324155 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0520 13:55:57.642315 2324155 retry.go:31] will retry after 358.76019ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0520 13:55:57.642722 2324155 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0520 13:55:57.644992 2324155 addons.go:426] installing /etc/kubernetes/addons/dashboard-dp.yaml
I0520 13:55:57.645057 2324155 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-dp.yaml (4201 bytes)
I0520 13:55:57.741719 2324155 addons.go:426] installing /etc/kubernetes/addons/dashboard-role.yaml
I0520 13:55:57.741799 2324155 ssh_runner.go:362] scp dashboard/dashboard-role.yaml --> /etc/kubernetes/addons/dashboard-role.yaml (1724 bytes)
W0520 13:55:57.751045 2324155 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0520 13:55:57.751142 2324155 retry.go:31] will retry after 342.565224ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0520 13:55:57.821478 2324155 addons.go:426] installing /etc/kubernetes/addons/dashboard-rolebinding.yaml
I0520 13:55:57.821505 2324155 ssh_runner.go:362] scp dashboard/dashboard-rolebinding.yaml --> /etc/kubernetes/addons/dashboard-rolebinding.yaml (1046 bytes)
W0520 13:55:57.876298 2324155 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0520 13:55:57.876335 2324155 retry.go:31] will retry after 299.099362ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0520 13:55:57.879495 2324155 addons.go:426] installing /etc/kubernetes/addons/dashboard-sa.yaml
I0520 13:55:57.879527 2324155 ssh_runner.go:362] scp dashboard/dashboard-sa.yaml --> /etc/kubernetes/addons/dashboard-sa.yaml (837 bytes)
I0520 13:55:57.900034 2324155 addons.go:426] installing /etc/kubernetes/addons/dashboard-secret.yaml
I0520 13:55:57.900063 2324155 ssh_runner.go:362] scp dashboard/dashboard-secret.yaml --> /etc/kubernetes/addons/dashboard-secret.yaml (1389 bytes)
I0520 13:55:57.919557 2324155 addons.go:426] installing /etc/kubernetes/addons/dashboard-svc.yaml
I0520 13:55:57.919593 2324155 ssh_runner.go:362] scp dashboard/dashboard-svc.yaml --> /etc/kubernetes/addons/dashboard-svc.yaml (1294 bytes)
I0520 13:55:57.939622 2324155 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
I0520 13:55:58.001922 2324155 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W0520 13:55:58.040752 2324155 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0520 13:55:58.040827 2324155 retry.go:31] will retry after 352.369513ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0520 13:55:58.094898 2324155 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W0520 13:55:58.133934 2324155 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0520 13:55:58.133969 2324155 retry.go:31] will retry after 467.164494ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0520 13:55:58.176295 2324155 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W0520 13:55:58.227397 2324155 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0520 13:55:58.227428 2324155 retry.go:31] will retry after 386.028154ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0520 13:55:58.300258 2324155 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0520 13:55:58.300308 2324155 retry.go:31] will retry after 533.089218ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0520 13:55:58.394097 2324155 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0520 13:55:58.496681 2324155 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0520 13:55:58.496781 2324155 retry.go:31] will retry after 191.253956ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0520 13:55:58.601994 2324155 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
I0520 13:55:58.613894 2324155 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
I0520 13:55:58.688779 2324155 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0520 13:55:58.801614 2324155 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0520 13:55:58.801762 2324155 retry.go:31] will retry after 776.956744ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0520 13:55:58.833901 2324155 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W0520 13:55:58.914458 2324155 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0520 13:55:58.914574 2324155 retry.go:31] will retry after 622.193417ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0520 13:55:59.043452 2324155 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0520 13:55:59.043614 2324155 retry.go:31] will retry after 494.122224ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0520 13:55:59.095688 2324155 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0520 13:55:59.095804 2324155 retry.go:31] will retry after 814.481454ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0520 13:55:59.339505 2324155 node_ready.go:53] error getting node "old-k8s-version-196977": Get "https://192.168.76.2:8443/api/v1/nodes/old-k8s-version-196977": dial tcp 192.168.76.2:8443: connect: connection refused
I0520 13:55:59.537874 2324155 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
I0520 13:55:59.538104 2324155 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
I0520 13:55:59.579642 2324155 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W0520 13:55:59.815193 2324155 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0520 13:55:59.815229 2324155 retry.go:31] will retry after 862.84822ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0520 13:55:59.815261 2324155 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0520 13:55:59.815274 2324155 retry.go:31] will retry after 900.946128ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0520 13:55:59.829795 2324155 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0520 13:55:59.829829 2324155 retry.go:31] will retry after 948.196909ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0520 13:55:59.910634 2324155 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W0520 13:56:00.035175 2324155 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0520 13:56:00.035219 2324155 retry.go:31] will retry after 857.790951ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0520 13:56:00.678379 2324155 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
I0520 13:56:00.716973 2324155 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
I0520 13:56:00.778918 2324155 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W0520 13:56:00.803126 2324155 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0520 13:56:00.803160 2324155 retry.go:31] will retry after 1.570931769s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0520 13:56:00.894016 2324155 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W0520 13:56:00.924293 2324155 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0520 13:56:00.924328 2324155 retry.go:31] will retry after 760.14401ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0520 13:56:00.989462 2324155 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0520 13:56:00.989497 2324155 retry.go:31] will retry after 871.984692ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0520 13:56:01.052535 2324155 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0520 13:56:01.052589 2324155 retry.go:31] will retry after 776.368482ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0520 13:56:01.684614 2324155 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
I0520 13:56:01.829169 2324155 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0520 13:56:01.839852 2324155 node_ready.go:53] error getting node "old-k8s-version-196977": Get "https://192.168.76.2:8443/api/v1/nodes/old-k8s-version-196977": dial tcp 192.168.76.2:8443: connect: connection refused
W0520 13:56:01.857372 2324155 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0520 13:56:01.857401 2324155 retry.go:31] will retry after 2.100268522s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0520 13:56:01.861590 2324155 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W0520 13:56:02.086835 2324155 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0520 13:56:02.086867 2324155 retry.go:31] will retry after 2.752001897s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0520 13:56:02.086955 2324155 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0520 13:56:02.086966 2324155 retry.go:31] will retry after 2.733163477s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0520 13:56:02.374789 2324155 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0520 13:56:02.605476 2324155 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0520 13:56:02.605506 2324155 retry.go:31] will retry after 1.070474345s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0520 13:56:03.676921 2324155 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0520 13:56:03.777606 2324155 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0520 13:56:03.777638 2324155 retry.go:31] will retry after 3.327453384s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0520 13:56:03.840269 2324155 node_ready.go:53] error getting node "old-k8s-version-196977": Get "https://192.168.76.2:8443/api/v1/nodes/old-k8s-version-196977": dial tcp 192.168.76.2:8443: connect: connection refused
I0520 13:56:03.958627 2324155 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W0520 13:56:04.064924 2324155 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0520 13:56:04.064952 2324155 retry.go:31] will retry after 2.760639365s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0520 13:56:04.820346 2324155 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0520 13:56:04.840077 2324155 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W0520 13:56:05.129435 2324155 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0520 13:56:05.129463 2324155 retry.go:31] will retry after 3.449138665s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0520 13:56:05.140574 2324155 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0520 13:56:05.140611 2324155 retry.go:31] will retry after 3.694000707s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0520 13:56:06.825816 2324155 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
I0520 13:56:07.105621 2324155 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
I0520 13:56:08.578816 2324155 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0520 13:56:08.835344 2324155 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
I0520 13:56:16.341074 2324155 node_ready.go:53] error getting node "old-k8s-version-196977": Get "https://192.168.76.2:8443/api/v1/nodes/old-k8s-version-196977": net/http: TLS handshake timeout
I0520 13:56:16.974026 2324155 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: (10.148168901s)
W0520 13:56:16.974060 2324155 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
Unable to connect to the server: net/http: TLS handshake timeout
I0520 13:56:16.974079 2324155 retry.go:31] will retry after 5.779838781s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
Unable to connect to the server: net/http: TLS handshake timeout
I0520 13:56:17.279137 2324155 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: (10.173470873s)
W0520 13:56:17.279174 2324155 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
Unable to connect to the server: net/http: TLS handshake timeout
I0520 13:56:17.279193 2324155 retry.go:31] will retry after 4.643821684s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
Unable to connect to the server: net/http: TLS handshake timeout
I0520 13:56:18.316456 2324155 node_ready.go:49] node "old-k8s-version-196977" has status "Ready":"True"
I0520 13:56:18.316479 2324155 node_ready.go:38] duration metric: took 20.977593718s for node "old-k8s-version-196977" to be "Ready" ...
I0520 13:56:18.316489 2324155 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0520 13:56:18.454047 2324155 pod_ready.go:78] waiting up to 6m0s for pod "coredns-74ff55c5b-ptmbw" in "kube-system" namespace to be "Ready" ...
I0520 13:56:18.694924 2324155 pod_ready.go:92] pod "coredns-74ff55c5b-ptmbw" in "kube-system" namespace has status "Ready":"True"
I0520 13:56:18.695025 2324155 pod_ready.go:81] duration metric: took 240.885512ms for pod "coredns-74ff55c5b-ptmbw" in "kube-system" namespace to be "Ready" ...
I0520 13:56:18.695052 2324155 pod_ready.go:78] waiting up to 6m0s for pod "etcd-old-k8s-version-196977" in "kube-system" namespace to be "Ready" ...
I0520 13:56:19.383756 2324155 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (10.804885311s)
I0520 13:56:19.383852 2324155 addons.go:470] Verifying addon metrics-server=true in "old-k8s-version-196977"
I0520 13:56:19.495543 2324155 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: (10.660139543s)
I0520 13:56:20.721331 2324155 pod_ready.go:102] pod "etcd-old-k8s-version-196977" in "kube-system" namespace has status "Ready":"False"
I0520 13:56:21.923615 2324155 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
I0520 13:56:22.722561 2324155 pod_ready.go:102] pod "etcd-old-k8s-version-196977" in "kube-system" namespace has status "Ready":"False"
I0520 13:56:22.754897 2324155 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
I0520 13:56:23.322565 2324155 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: (1.398895322s)
I0520 13:56:23.324478 2324155 out.go:177] * Some dashboard features require the metrics-server addon. To enable all features please run:
minikube -p old-k8s-version-196977 addons enable metrics-server
I0520 13:56:23.436162 2324155 out.go:177] * Enabled addons: metrics-server, storage-provisioner, dashboard, default-storageclass
I0520 13:56:23.438476 2324155 addons.go:505] duration metric: took 26.451894014s for enable addons: enabled=[metrics-server storage-provisioner dashboard default-storageclass]
I0520 13:56:25.201184 2324155 pod_ready.go:102] pod "etcd-old-k8s-version-196977" in "kube-system" namespace has status "Ready":"False"
I0520 13:56:27.708584 2324155 pod_ready.go:102] pod "etcd-old-k8s-version-196977" in "kube-system" namespace has status "Ready":"False"
I0520 13:56:30.201622 2324155 pod_ready.go:102] pod "etcd-old-k8s-version-196977" in "kube-system" namespace has status "Ready":"False"
I0520 13:56:32.701312 2324155 pod_ready.go:102] pod "etcd-old-k8s-version-196977" in "kube-system" namespace has status "Ready":"False"
I0520 13:56:34.701948 2324155 pod_ready.go:102] pod "etcd-old-k8s-version-196977" in "kube-system" namespace has status "Ready":"False"
I0520 13:56:36.728708 2324155 pod_ready.go:102] pod "etcd-old-k8s-version-196977" in "kube-system" namespace has status "Ready":"False"
I0520 13:56:39.202100 2324155 pod_ready.go:102] pod "etcd-old-k8s-version-196977" in "kube-system" namespace has status "Ready":"False"
I0520 13:56:41.215168 2324155 pod_ready.go:102] pod "etcd-old-k8s-version-196977" in "kube-system" namespace has status "Ready":"False"
I0520 13:56:43.711946 2324155 pod_ready.go:102] pod "etcd-old-k8s-version-196977" in "kube-system" namespace has status "Ready":"False"
I0520 13:56:46.202518 2324155 pod_ready.go:102] pod "etcd-old-k8s-version-196977" in "kube-system" namespace has status "Ready":"False"
I0520 13:56:48.223901 2324155 pod_ready.go:102] pod "etcd-old-k8s-version-196977" in "kube-system" namespace has status "Ready":"False"
I0520 13:56:50.701248 2324155 pod_ready.go:102] pod "etcd-old-k8s-version-196977" in "kube-system" namespace has status "Ready":"False"
I0520 13:56:52.701880 2324155 pod_ready.go:102] pod "etcd-old-k8s-version-196977" in "kube-system" namespace has status "Ready":"False"
I0520 13:56:55.203077 2324155 pod_ready.go:102] pod "etcd-old-k8s-version-196977" in "kube-system" namespace has status "Ready":"False"
I0520 13:56:57.707613 2324155 pod_ready.go:102] pod "etcd-old-k8s-version-196977" in "kube-system" namespace has status "Ready":"False"
I0520 13:57:00.204946 2324155 pod_ready.go:102] pod "etcd-old-k8s-version-196977" in "kube-system" namespace has status "Ready":"False"
I0520 13:57:02.701527 2324155 pod_ready.go:102] pod "etcd-old-k8s-version-196977" in "kube-system" namespace has status "Ready":"False"
I0520 13:57:05.201286 2324155 pod_ready.go:102] pod "etcd-old-k8s-version-196977" in "kube-system" namespace has status "Ready":"False"
I0520 13:57:07.701417 2324155 pod_ready.go:102] pod "etcd-old-k8s-version-196977" in "kube-system" namespace has status "Ready":"False"
I0520 13:57:10.201169 2324155 pod_ready.go:102] pod "etcd-old-k8s-version-196977" in "kube-system" namespace has status "Ready":"False"
I0520 13:57:12.202949 2324155 pod_ready.go:102] pod "etcd-old-k8s-version-196977" in "kube-system" namespace has status "Ready":"False"
I0520 13:57:14.701595 2324155 pod_ready.go:102] pod "etcd-old-k8s-version-196977" in "kube-system" namespace has status "Ready":"False"
I0520 13:57:17.201429 2324155 pod_ready.go:102] pod "etcd-old-k8s-version-196977" in "kube-system" namespace has status "Ready":"False"
I0520 13:57:19.206994 2324155 pod_ready.go:102] pod "etcd-old-k8s-version-196977" in "kube-system" namespace has status "Ready":"False"
I0520 13:57:21.702576 2324155 pod_ready.go:102] pod "etcd-old-k8s-version-196977" in "kube-system" namespace has status "Ready":"False"
I0520 13:57:24.204198 2324155 pod_ready.go:102] pod "etcd-old-k8s-version-196977" in "kube-system" namespace has status "Ready":"False"
I0520 13:57:26.702155 2324155 pod_ready.go:102] pod "etcd-old-k8s-version-196977" in "kube-system" namespace has status "Ready":"False"
I0520 13:57:29.201248 2324155 pod_ready.go:102] pod "etcd-old-k8s-version-196977" in "kube-system" namespace has status "Ready":"False"
I0520 13:57:31.700806 2324155 pod_ready.go:102] pod "etcd-old-k8s-version-196977" in "kube-system" namespace has status "Ready":"False"
I0520 13:57:33.701620 2324155 pod_ready.go:102] pod "etcd-old-k8s-version-196977" in "kube-system" namespace has status "Ready":"False"
I0520 13:57:35.702413 2324155 pod_ready.go:102] pod "etcd-old-k8s-version-196977" in "kube-system" namespace has status "Ready":"False"
I0520 13:57:38.201496 2324155 pod_ready.go:102] pod "etcd-old-k8s-version-196977" in "kube-system" namespace has status "Ready":"False"
I0520 13:57:39.203879 2324155 pod_ready.go:92] pod "etcd-old-k8s-version-196977" in "kube-system" namespace has status "Ready":"True"
I0520 13:57:39.203910 2324155 pod_ready.go:81] duration metric: took 1m20.508836573s for pod "etcd-old-k8s-version-196977" in "kube-system" namespace to be "Ready" ...
I0520 13:57:39.203925 2324155 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-old-k8s-version-196977" in "kube-system" namespace to be "Ready" ...
I0520 13:57:39.209590 2324155 pod_ready.go:92] pod "kube-apiserver-old-k8s-version-196977" in "kube-system" namespace has status "Ready":"True"
I0520 13:57:39.209688 2324155 pod_ready.go:81] duration metric: took 5.753177ms for pod "kube-apiserver-old-k8s-version-196977" in "kube-system" namespace to be "Ready" ...
I0520 13:57:39.209718 2324155 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-old-k8s-version-196977" in "kube-system" namespace to be "Ready" ...
I0520 13:57:41.215413 2324155 pod_ready.go:92] pod "kube-controller-manager-old-k8s-version-196977" in "kube-system" namespace has status "Ready":"True"
I0520 13:57:41.215440 2324155 pod_ready.go:81] duration metric: took 2.005700409s for pod "kube-controller-manager-old-k8s-version-196977" in "kube-system" namespace to be "Ready" ...
I0520 13:57:41.215452 2324155 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-2sgl4" in "kube-system" namespace to be "Ready" ...
I0520 13:57:41.221242 2324155 pod_ready.go:92] pod "kube-proxy-2sgl4" in "kube-system" namespace has status "Ready":"True"
I0520 13:57:41.221267 2324155 pod_ready.go:81] duration metric: took 5.807027ms for pod "kube-proxy-2sgl4" in "kube-system" namespace to be "Ready" ...
I0520 13:57:41.221279 2324155 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-old-k8s-version-196977" in "kube-system" namespace to be "Ready" ...
I0520 13:57:41.226416 2324155 pod_ready.go:92] pod "kube-scheduler-old-k8s-version-196977" in "kube-system" namespace has status "Ready":"True"
I0520 13:57:41.226442 2324155 pod_ready.go:81] duration metric: took 5.154084ms for pod "kube-scheduler-old-k8s-version-196977" in "kube-system" namespace to be "Ready" ...
I0520 13:57:41.226455 2324155 pod_ready.go:78] waiting up to 6m0s for pod "metrics-server-9975d5f86-cxvzj" in "kube-system" namespace to be "Ready" ...
I0520 13:57:43.232419 2324155 pod_ready.go:102] pod "metrics-server-9975d5f86-cxvzj" in "kube-system" namespace has status "Ready":"False"
I0520 13:57:45.234156 2324155 pod_ready.go:102] pod "metrics-server-9975d5f86-cxvzj" in "kube-system" namespace has status "Ready":"False"
I0520 13:57:47.238512 2324155 pod_ready.go:102] pod "metrics-server-9975d5f86-cxvzj" in "kube-system" namespace has status "Ready":"False"
I0520 13:57:49.734591 2324155 pod_ready.go:102] pod "metrics-server-9975d5f86-cxvzj" in "kube-system" namespace has status "Ready":"False"
I0520 13:57:52.232995 2324155 pod_ready.go:102] pod "metrics-server-9975d5f86-cxvzj" in "kube-system" namespace has status "Ready":"False"
I0520 13:57:54.733214 2324155 pod_ready.go:102] pod "metrics-server-9975d5f86-cxvzj" in "kube-system" namespace has status "Ready":"False"
I0520 13:57:57.233219 2324155 pod_ready.go:102] pod "metrics-server-9975d5f86-cxvzj" in "kube-system" namespace has status "Ready":"False"
I0520 13:57:59.732437 2324155 pod_ready.go:102] pod "metrics-server-9975d5f86-cxvzj" in "kube-system" namespace has status "Ready":"False"
I0520 13:58:01.733029 2324155 pod_ready.go:102] pod "metrics-server-9975d5f86-cxvzj" in "kube-system" namespace has status "Ready":"False"
I0520 13:58:03.733210 2324155 pod_ready.go:102] pod "metrics-server-9975d5f86-cxvzj" in "kube-system" namespace has status "Ready":"False"
I0520 13:58:05.735246 2324155 pod_ready.go:102] pod "metrics-server-9975d5f86-cxvzj" in "kube-system" namespace has status "Ready":"False"
I0520 13:58:08.233043 2324155 pod_ready.go:102] pod "metrics-server-9975d5f86-cxvzj" in "kube-system" namespace has status "Ready":"False"
I0520 13:58:10.234068 2324155 pod_ready.go:102] pod "metrics-server-9975d5f86-cxvzj" in "kube-system" namespace has status "Ready":"False"
I0520 13:58:12.235051 2324155 pod_ready.go:102] pod "metrics-server-9975d5f86-cxvzj" in "kube-system" namespace has status "Ready":"False"
I0520 13:58:14.735283 2324155 pod_ready.go:102] pod "metrics-server-9975d5f86-cxvzj" in "kube-system" namespace has status "Ready":"False"
I0520 13:58:17.233963 2324155 pod_ready.go:102] pod "metrics-server-9975d5f86-cxvzj" in "kube-system" namespace has status "Ready":"False"
I0520 13:58:19.733012 2324155 pod_ready.go:102] pod "metrics-server-9975d5f86-cxvzj" in "kube-system" namespace has status "Ready":"False"
I0520 13:58:22.233820 2324155 pod_ready.go:102] pod "metrics-server-9975d5f86-cxvzj" in "kube-system" namespace has status "Ready":"False"
I0520 13:58:24.732631 2324155 pod_ready.go:102] pod "metrics-server-9975d5f86-cxvzj" in "kube-system" namespace has status "Ready":"False"
I0520 13:58:26.733417 2324155 pod_ready.go:102] pod "metrics-server-9975d5f86-cxvzj" in "kube-system" namespace has status "Ready":"False"
I0520 13:58:29.234062 2324155 pod_ready.go:102] pod "metrics-server-9975d5f86-cxvzj" in "kube-system" namespace has status "Ready":"False"
I0520 13:58:31.733326 2324155 pod_ready.go:102] pod "metrics-server-9975d5f86-cxvzj" in "kube-system" namespace has status "Ready":"False"
I0520 13:58:34.233010 2324155 pod_ready.go:102] pod "metrics-server-9975d5f86-cxvzj" in "kube-system" namespace has status "Ready":"False"
I0520 13:58:36.234477 2324155 pod_ready.go:102] pod "metrics-server-9975d5f86-cxvzj" in "kube-system" namespace has status "Ready":"False"
I0520 13:58:38.732993 2324155 pod_ready.go:102] pod "metrics-server-9975d5f86-cxvzj" in "kube-system" namespace has status "Ready":"False"
I0520 13:58:41.233246 2324155 pod_ready.go:102] pod "metrics-server-9975d5f86-cxvzj" in "kube-system" namespace has status "Ready":"False"
I0520 13:58:43.234768 2324155 pod_ready.go:102] pod "metrics-server-9975d5f86-cxvzj" in "kube-system" namespace has status "Ready":"False"
I0520 13:58:45.234877 2324155 pod_ready.go:102] pod "metrics-server-9975d5f86-cxvzj" in "kube-system" namespace has status "Ready":"False"
I0520 13:58:47.732805 2324155 pod_ready.go:102] pod "metrics-server-9975d5f86-cxvzj" in "kube-system" namespace has status "Ready":"False"
I0520 13:58:50.232929 2324155 pod_ready.go:102] pod "metrics-server-9975d5f86-cxvzj" in "kube-system" namespace has status "Ready":"False"
I0520 13:58:52.234196 2324155 pod_ready.go:102] pod "metrics-server-9975d5f86-cxvzj" in "kube-system" namespace has status "Ready":"False"
I0520 13:58:54.732208 2324155 pod_ready.go:102] pod "metrics-server-9975d5f86-cxvzj" in "kube-system" namespace has status "Ready":"False"
I0520 13:58:56.733400 2324155 pod_ready.go:102] pod "metrics-server-9975d5f86-cxvzj" in "kube-system" namespace has status "Ready":"False"
I0520 13:58:59.234438 2324155 pod_ready.go:102] pod "metrics-server-9975d5f86-cxvzj" in "kube-system" namespace has status "Ready":"False"
I0520 13:59:01.735943 2324155 pod_ready.go:102] pod "metrics-server-9975d5f86-cxvzj" in "kube-system" namespace has status "Ready":"False"
I0520 13:59:04.233130 2324155 pod_ready.go:102] pod "metrics-server-9975d5f86-cxvzj" in "kube-system" namespace has status "Ready":"False"
I0520 13:59:06.733221 2324155 pod_ready.go:102] pod "metrics-server-9975d5f86-cxvzj" in "kube-system" namespace has status "Ready":"False"
I0520 13:59:09.232031 2324155 pod_ready.go:102] pod "metrics-server-9975d5f86-cxvzj" in "kube-system" namespace has status "Ready":"False"
I0520 13:59:11.232664 2324155 pod_ready.go:102] pod "metrics-server-9975d5f86-cxvzj" in "kube-system" namespace has status "Ready":"False"
I0520 13:59:13.233513 2324155 pod_ready.go:102] pod "metrics-server-9975d5f86-cxvzj" in "kube-system" namespace has status "Ready":"False"
I0520 13:59:15.733723 2324155 pod_ready.go:102] pod "metrics-server-9975d5f86-cxvzj" in "kube-system" namespace has status "Ready":"False"
I0520 13:59:18.232386 2324155 pod_ready.go:102] pod "metrics-server-9975d5f86-cxvzj" in "kube-system" namespace has status "Ready":"False"
I0520 13:59:20.233224 2324155 pod_ready.go:102] pod "metrics-server-9975d5f86-cxvzj" in "kube-system" namespace has status "Ready":"False"
I0520 13:59:22.732924 2324155 pod_ready.go:102] pod "metrics-server-9975d5f86-cxvzj" in "kube-system" namespace has status "Ready":"False"
I0520 13:59:24.733112 2324155 pod_ready.go:102] pod "metrics-server-9975d5f86-cxvzj" in "kube-system" namespace has status "Ready":"False"
I0520 13:59:26.733438 2324155 pod_ready.go:102] pod "metrics-server-9975d5f86-cxvzj" in "kube-system" namespace has status "Ready":"False"
I0520 13:59:29.233488 2324155 pod_ready.go:102] pod "metrics-server-9975d5f86-cxvzj" in "kube-system" namespace has status "Ready":"False"
I0520 13:59:31.733060 2324155 pod_ready.go:102] pod "metrics-server-9975d5f86-cxvzj" in "kube-system" namespace has status "Ready":"False"
I0520 13:59:34.233622 2324155 pod_ready.go:102] pod "metrics-server-9975d5f86-cxvzj" in "kube-system" namespace has status "Ready":"False"
I0520 13:59:36.732876 2324155 pod_ready.go:102] pod "metrics-server-9975d5f86-cxvzj" in "kube-system" namespace has status "Ready":"False"
I0520 13:59:38.734420 2324155 pod_ready.go:102] pod "metrics-server-9975d5f86-cxvzj" in "kube-system" namespace has status "Ready":"False"
I0520 13:59:41.232792 2324155 pod_ready.go:102] pod "metrics-server-9975d5f86-cxvzj" in "kube-system" namespace has status "Ready":"False"
I0520 13:59:43.233395 2324155 pod_ready.go:102] pod "metrics-server-9975d5f86-cxvzj" in "kube-system" namespace has status "Ready":"False"
I0520 13:59:45.234497 2324155 pod_ready.go:102] pod "metrics-server-9975d5f86-cxvzj" in "kube-system" namespace has status "Ready":"False"
I0520 13:59:47.733244 2324155 pod_ready.go:102] pod "metrics-server-9975d5f86-cxvzj" in "kube-system" namespace has status "Ready":"False"
I0520 13:59:49.733542 2324155 pod_ready.go:102] pod "metrics-server-9975d5f86-cxvzj" in "kube-system" namespace has status "Ready":"False"
I0520 13:59:52.234044 2324155 pod_ready.go:102] pod "metrics-server-9975d5f86-cxvzj" in "kube-system" namespace has status "Ready":"False"
I0520 13:59:54.736188 2324155 pod_ready.go:102] pod "metrics-server-9975d5f86-cxvzj" in "kube-system" namespace has status "Ready":"False"
I0520 13:59:57.233223 2324155 pod_ready.go:102] pod "metrics-server-9975d5f86-cxvzj" in "kube-system" namespace has status "Ready":"False"
I0520 13:59:59.733384 2324155 pod_ready.go:102] pod "metrics-server-9975d5f86-cxvzj" in "kube-system" namespace has status "Ready":"False"
I0520 14:00:01.735351 2324155 pod_ready.go:102] pod "metrics-server-9975d5f86-cxvzj" in "kube-system" namespace has status "Ready":"False"
I0520 14:00:04.233497 2324155 pod_ready.go:102] pod "metrics-server-9975d5f86-cxvzj" in "kube-system" namespace has status "Ready":"False"
I0520 14:00:06.733771 2324155 pod_ready.go:102] pod "metrics-server-9975d5f86-cxvzj" in "kube-system" namespace has status "Ready":"False"
I0520 14:00:09.232677 2324155 pod_ready.go:102] pod "metrics-server-9975d5f86-cxvzj" in "kube-system" namespace has status "Ready":"False"
I0520 14:00:11.733596 2324155 pod_ready.go:102] pod "metrics-server-9975d5f86-cxvzj" in "kube-system" namespace has status "Ready":"False"
I0520 14:00:13.733689 2324155 pod_ready.go:102] pod "metrics-server-9975d5f86-cxvzj" in "kube-system" namespace has status "Ready":"False"
I0520 14:00:15.734782 2324155 pod_ready.go:102] pod "metrics-server-9975d5f86-cxvzj" in "kube-system" namespace has status "Ready":"False"
I0520 14:00:18.233826 2324155 pod_ready.go:102] pod "metrics-server-9975d5f86-cxvzj" in "kube-system" namespace has status "Ready":"False"
I0520 14:00:20.233884 2324155 pod_ready.go:102] pod "metrics-server-9975d5f86-cxvzj" in "kube-system" namespace has status "Ready":"False"
I0520 14:00:22.732250 2324155 pod_ready.go:102] pod "metrics-server-9975d5f86-cxvzj" in "kube-system" namespace has status "Ready":"False"
I0520 14:00:25.240085 2324155 pod_ready.go:102] pod "metrics-server-9975d5f86-cxvzj" in "kube-system" namespace has status "Ready":"False"
I0520 14:00:27.734212 2324155 pod_ready.go:102] pod "metrics-server-9975d5f86-cxvzj" in "kube-system" namespace has status "Ready":"False"
I0520 14:00:30.233366 2324155 pod_ready.go:102] pod "metrics-server-9975d5f86-cxvzj" in "kube-system" namespace has status "Ready":"False"
I0520 14:00:32.733281 2324155 pod_ready.go:102] pod "metrics-server-9975d5f86-cxvzj" in "kube-system" namespace has status "Ready":"False"
I0520 14:00:35.232700 2324155 pod_ready.go:102] pod "metrics-server-9975d5f86-cxvzj" in "kube-system" namespace has status "Ready":"False"
I0520 14:00:37.233536 2324155 pod_ready.go:102] pod "metrics-server-9975d5f86-cxvzj" in "kube-system" namespace has status "Ready":"False"
I0520 14:00:39.733881 2324155 pod_ready.go:102] pod "metrics-server-9975d5f86-cxvzj" in "kube-system" namespace has status "Ready":"False"
I0520 14:00:42.234099 2324155 pod_ready.go:102] pod "metrics-server-9975d5f86-cxvzj" in "kube-system" namespace has status "Ready":"False"
I0520 14:00:44.239612 2324155 pod_ready.go:102] pod "metrics-server-9975d5f86-cxvzj" in "kube-system" namespace has status "Ready":"False"
I0520 14:00:46.243652 2324155 pod_ready.go:102] pod "metrics-server-9975d5f86-cxvzj" in "kube-system" namespace has status "Ready":"False"
I0520 14:00:48.732882 2324155 pod_ready.go:102] pod "metrics-server-9975d5f86-cxvzj" in "kube-system" namespace has status "Ready":"False"
I0520 14:00:50.733805 2324155 pod_ready.go:102] pod "metrics-server-9975d5f86-cxvzj" in "kube-system" namespace has status "Ready":"False"
I0520 14:00:53.232405 2324155 pod_ready.go:102] pod "metrics-server-9975d5f86-cxvzj" in "kube-system" namespace has status "Ready":"False"
I0520 14:00:55.232754 2324155 pod_ready.go:102] pod "metrics-server-9975d5f86-cxvzj" in "kube-system" namespace has status "Ready":"False"
I0520 14:00:57.731942 2324155 pod_ready.go:102] pod "metrics-server-9975d5f86-cxvzj" in "kube-system" namespace has status "Ready":"False"
I0520 14:00:59.733137 2324155 pod_ready.go:102] pod "metrics-server-9975d5f86-cxvzj" in "kube-system" namespace has status "Ready":"False"
I0520 14:01:01.734224 2324155 pod_ready.go:102] pod "metrics-server-9975d5f86-cxvzj" in "kube-system" namespace has status "Ready":"False"
I0520 14:01:04.233455 2324155 pod_ready.go:102] pod "metrics-server-9975d5f86-cxvzj" in "kube-system" namespace has status "Ready":"False"
I0520 14:01:06.733828 2324155 pod_ready.go:102] pod "metrics-server-9975d5f86-cxvzj" in "kube-system" namespace has status "Ready":"False"
I0520 14:01:09.233316 2324155 pod_ready.go:102] pod "metrics-server-9975d5f86-cxvzj" in "kube-system" namespace has status "Ready":"False"
I0520 14:01:11.732736 2324155 pod_ready.go:102] pod "metrics-server-9975d5f86-cxvzj" in "kube-system" namespace has status "Ready":"False"
I0520 14:01:14.233147 2324155 pod_ready.go:102] pod "metrics-server-9975d5f86-cxvzj" in "kube-system" namespace has status "Ready":"False"
I0520 14:01:16.233400 2324155 pod_ready.go:102] pod "metrics-server-9975d5f86-cxvzj" in "kube-system" namespace has status "Ready":"False"
I0520 14:01:18.732835 2324155 pod_ready.go:102] pod "metrics-server-9975d5f86-cxvzj" in "kube-system" namespace has status "Ready":"False"
I0520 14:01:20.732895 2324155 pod_ready.go:102] pod "metrics-server-9975d5f86-cxvzj" in "kube-system" namespace has status "Ready":"False"
I0520 14:01:22.733398 2324155 pod_ready.go:102] pod "metrics-server-9975d5f86-cxvzj" in "kube-system" namespace has status "Ready":"False"
I0520 14:01:24.733490 2324155 pod_ready.go:102] pod "metrics-server-9975d5f86-cxvzj" in "kube-system" namespace has status "Ready":"False"
I0520 14:01:27.232666 2324155 pod_ready.go:102] pod "metrics-server-9975d5f86-cxvzj" in "kube-system" namespace has status "Ready":"False"
I0520 14:01:29.233043 2324155 pod_ready.go:102] pod "metrics-server-9975d5f86-cxvzj" in "kube-system" namespace has status "Ready":"False"
I0520 14:01:31.734204 2324155 pod_ready.go:102] pod "metrics-server-9975d5f86-cxvzj" in "kube-system" namespace has status "Ready":"False"
I0520 14:01:34.232953 2324155 pod_ready.go:102] pod "metrics-server-9975d5f86-cxvzj" in "kube-system" namespace has status "Ready":"False"
I0520 14:01:36.234224 2324155 pod_ready.go:102] pod "metrics-server-9975d5f86-cxvzj" in "kube-system" namespace has status "Ready":"False"
I0520 14:01:38.732566 2324155 pod_ready.go:102] pod "metrics-server-9975d5f86-cxvzj" in "kube-system" namespace has status "Ready":"False"
I0520 14:01:40.733598 2324155 pod_ready.go:102] pod "metrics-server-9975d5f86-cxvzj" in "kube-system" namespace has status "Ready":"False"
I0520 14:01:41.232697 2324155 pod_ready.go:81] duration metric: took 4m0.006209109s for pod "metrics-server-9975d5f86-cxvzj" in "kube-system" namespace to be "Ready" ...
E0520 14:01:41.232722 2324155 pod_ready.go:66] WaitExtra: waitPodCondition: context deadline exceeded
I0520 14:01:41.232732 2324155 pod_ready.go:38] duration metric: took 5m22.91623165s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0520 14:01:41.232747 2324155 api_server.go:52] waiting for apiserver process to appear ...
I0520 14:01:41.232776 2324155 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I0520 14:01:41.232837 2324155 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0520 14:01:41.282335 2324155 cri.go:89] found id: "21f02b40f812f73866c7240ca4f394dd16d29cf18f0bd90fe73f0f88278d7c3c"
I0520 14:01:41.282362 2324155 cri.go:89] found id: ""
I0520 14:01:41.282370 2324155 logs.go:276] 1 containers: [21f02b40f812f73866c7240ca4f394dd16d29cf18f0bd90fe73f0f88278d7c3c]
I0520 14:01:41.282429 2324155 ssh_runner.go:195] Run: which crictl
I0520 14:01:41.286397 2324155 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I0520 14:01:41.286469 2324155 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0520 14:01:41.327352 2324155 cri.go:89] found id: "574ca79575df26bfbb124b76c08ba1882d73ae20602034b6e0c9d2a4a58ddc9f"
I0520 14:01:41.327427 2324155 cri.go:89] found id: ""
I0520 14:01:41.327450 2324155 logs.go:276] 1 containers: [574ca79575df26bfbb124b76c08ba1882d73ae20602034b6e0c9d2a4a58ddc9f]
I0520 14:01:41.327539 2324155 ssh_runner.go:195] Run: which crictl
I0520 14:01:41.331894 2324155 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I0520 14:01:41.332057 2324155 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0520 14:01:41.400890 2324155 cri.go:89] found id: "758b608b9e8e08eed64aeb045062ae7d4a5a33e5295c6519a33c1a800cb38dd9"
I0520 14:01:41.400963 2324155 cri.go:89] found id: ""
I0520 14:01:41.400985 2324155 logs.go:276] 1 containers: [758b608b9e8e08eed64aeb045062ae7d4a5a33e5295c6519a33c1a800cb38dd9]
I0520 14:01:41.401073 2324155 ssh_runner.go:195] Run: which crictl
I0520 14:01:41.405100 2324155 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I0520 14:01:41.405221 2324155 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0520 14:01:41.453868 2324155 cri.go:89] found id: "b2bf99df779efc3459ff13a39979c379186fd56c60c69dc26b9297b16d4c1a3e"
I0520 14:01:41.453935 2324155 cri.go:89] found id: ""
I0520 14:01:41.453958 2324155 logs.go:276] 1 containers: [b2bf99df779efc3459ff13a39979c379186fd56c60c69dc26b9297b16d4c1a3e]
I0520 14:01:41.454048 2324155 ssh_runner.go:195] Run: which crictl
I0520 14:01:41.458580 2324155 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I0520 14:01:41.458755 2324155 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0520 14:01:41.506940 2324155 cri.go:89] found id: "577e4eac4cee4596652e1e0a4aa1aab157007dd6015d77ef54ce41d332d17660"
I0520 14:01:41.506964 2324155 cri.go:89] found id: ""
I0520 14:01:41.506973 2324155 logs.go:276] 1 containers: [577e4eac4cee4596652e1e0a4aa1aab157007dd6015d77ef54ce41d332d17660]
I0520 14:01:41.507042 2324155 ssh_runner.go:195] Run: which crictl
I0520 14:01:41.510833 2324155 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I0520 14:01:41.510905 2324155 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0520 14:01:41.554830 2324155 cri.go:89] found id: "6573124f1f00f0b93e75e9d9c4005f0198ca7f6b5324170c53a4e24d835271c4"
I0520 14:01:41.554898 2324155 cri.go:89] found id: ""
I0520 14:01:41.554922 2324155 logs.go:276] 1 containers: [6573124f1f00f0b93e75e9d9c4005f0198ca7f6b5324170c53a4e24d835271c4]
I0520 14:01:41.555019 2324155 ssh_runner.go:195] Run: which crictl
I0520 14:01:41.558967 2324155 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I0520 14:01:41.559093 2324155 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0520 14:01:41.598516 2324155 cri.go:89] found id: "e8289b46f01a9d3e0e6b44ce3290e107e18c07f655ba4194c834341c4d468c83"
I0520 14:01:41.598541 2324155 cri.go:89] found id: ""
I0520 14:01:41.598558 2324155 logs.go:276] 1 containers: [e8289b46f01a9d3e0e6b44ce3290e107e18c07f655ba4194c834341c4d468c83]
I0520 14:01:41.598621 2324155 ssh_runner.go:195] Run: which crictl
I0520 14:01:41.602403 2324155 cri.go:54] listing CRI containers in root : {State:all Name:kubernetes-dashboard Namespaces:[]}
I0520 14:01:41.602488 2324155 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
I0520 14:01:41.653381 2324155 cri.go:89] found id: "a5779cc8510e582479bdedeecea9ca5a0471306b7bf72588b0563dcb1a60a030"
I0520 14:01:41.653404 2324155 cri.go:89] found id: ""
I0520 14:01:41.653412 2324155 logs.go:276] 1 containers: [a5779cc8510e582479bdedeecea9ca5a0471306b7bf72588b0563dcb1a60a030]
I0520 14:01:41.653475 2324155 ssh_runner.go:195] Run: which crictl
I0520 14:01:41.657100 2324155 cri.go:54] listing CRI containers in root : {State:all Name:storage-provisioner Namespaces:[]}
I0520 14:01:41.657173 2324155 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
I0520 14:01:41.700451 2324155 cri.go:89] found id: "c6481d58189faf4b67ee0efb1177763e086618f853c876070abc9fb1a4dc75cd"
I0520 14:01:41.700519 2324155 cri.go:89] found id: ""
I0520 14:01:41.700542 2324155 logs.go:276] 1 containers: [c6481d58189faf4b67ee0efb1177763e086618f853c876070abc9fb1a4dc75cd]
I0520 14:01:41.700643 2324155 ssh_runner.go:195] Run: which crictl
I0520 14:01:41.704545 2324155 logs.go:123] Gathering logs for kube-proxy [577e4eac4cee4596652e1e0a4aa1aab157007dd6015d77ef54ce41d332d17660] ...
I0520 14:01:41.704623 2324155 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 577e4eac4cee4596652e1e0a4aa1aab157007dd6015d77ef54ce41d332d17660"
I0520 14:01:41.755307 2324155 logs.go:123] Gathering logs for kubelet ...
I0520 14:01:41.755335 2324155 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
W0520 14:01:41.808270 2324155 logs.go:138] Found kubelet problem: May 20 13:56:18 old-k8s-version-196977 kubelet[735]: E0520 13:56:18.281923 735 reflector.go:138] object-"kube-system"/"kindnet-token-22d6h": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kindnet-token-22d6h" is forbidden: User "system:node:old-k8s-version-196977" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-196977' and this object
W0520 14:01:41.808501 2324155 logs.go:138] Found kubelet problem: May 20 13:56:18 old-k8s-version-196977 kubelet[735]: E0520 13:56:18.282422 735 reflector.go:138] object-"kube-system"/"kube-proxy": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-proxy" is forbidden: User "system:node:old-k8s-version-196977" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-196977' and this object
W0520 14:01:41.808704 2324155 logs.go:138] Found kubelet problem: May 20 13:56:18 old-k8s-version-196977 kubelet[735]: E0520 13:56:18.282696 735 reflector.go:138] object-"kube-system"/"coredns": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "coredns" is forbidden: User "system:node:old-k8s-version-196977" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-196977' and this object
W0520 14:01:41.808946 2324155 logs.go:138] Found kubelet problem: May 20 13:56:18 old-k8s-version-196977 kubelet[735]: E0520 13:56:18.283001 735 reflector.go:138] object-"kube-system"/"kube-proxy-token-dxz6j": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kube-proxy-token-dxz6j" is forbidden: User "system:node:old-k8s-version-196977" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-196977' and this object
W0520 14:01:41.809163 2324155 logs.go:138] Found kubelet problem: May 20 13:56:18 old-k8s-version-196977 kubelet[735]: E0520 13:56:18.283271 735 reflector.go:138] object-"kube-system"/"coredns-token-x8bzr": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "coredns-token-x8bzr" is forbidden: User "system:node:old-k8s-version-196977" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-196977' and this object
W0520 14:01:41.809387 2324155 logs.go:138] Found kubelet problem: May 20 13:56:18 old-k8s-version-196977 kubelet[735]: E0520 13:56:18.283558 735 reflector.go:138] object-"kube-system"/"storage-provisioner-token-jqqsh": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "storage-provisioner-token-jqqsh" is forbidden: User "system:node:old-k8s-version-196977" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-196977' and this object
W0520 14:01:41.809608 2324155 logs.go:138] Found kubelet problem: May 20 13:56:18 old-k8s-version-196977 kubelet[735]: E0520 13:56:18.284130 735 reflector.go:138] object-"kube-system"/"metrics-server-token-l5sd5": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "metrics-server-token-l5sd5" is forbidden: User "system:node:old-k8s-version-196977" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-196977' and this object
W0520 14:01:41.809829 2324155 logs.go:138] Found kubelet problem: May 20 13:56:18 old-k8s-version-196977 kubelet[735]: E0520 13:56:18.284596 735 reflector.go:138] object-"default"/"default-token-ptqw7": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "default-token-ptqw7" is forbidden: User "system:node:old-k8s-version-196977" cannot list resource "secrets" in API group "" in the namespace "default": no relationship found between node 'old-k8s-version-196977' and this object
W0520 14:01:41.823018 2324155 logs.go:138] Found kubelet problem: May 20 13:56:22 old-k8s-version-196977 kubelet[735]: E0520 13:56:22.333275 735 pod_workers.go:191] Error syncing pod c8365eaa-709d-43e2-8d02-7bb97878bae7 ("metrics-server-9975d5f86-cxvzj_kube-system(c8365eaa-709d-43e2-8d02-7bb97878bae7)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = pinging container registry fake.domain: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain: no such host"
W0520 14:01:41.823219 2324155 logs.go:138] Found kubelet problem: May 20 13:56:23 old-k8s-version-196977 kubelet[735]: E0520 13:56:23.281444 735 pod_workers.go:191] Error syncing pod c8365eaa-709d-43e2-8d02-7bb97878bae7 ("metrics-server-9975d5f86-cxvzj_kube-system(c8365eaa-709d-43e2-8d02-7bb97878bae7)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 14:01:41.825772 2324155 logs.go:138] Found kubelet problem: May 20 13:56:44 old-k8s-version-196977 kubelet[735]: E0520 13:56:44.365021 735 pod_workers.go:191] Error syncing pod ab81093c-bffe-45a6-bb1f-d68defdc028d ("dashboard-metrics-scraper-8d5bb5db8-5689z_kubernetes-dashboard(ab81093c-bffe-45a6-bb1f-d68defdc028d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5689z_kubernetes-dashboard(ab81093c-bffe-45a6-bb1f-d68defdc028d)"
W0520 14:01:41.826106 2324155 logs.go:138] Found kubelet problem: May 20 13:56:45 old-k8s-version-196977 kubelet[735]: E0520 13:56:45.365825 735 pod_workers.go:191] Error syncing pod ab81093c-bffe-45a6-bb1f-d68defdc028d ("dashboard-metrics-scraper-8d5bb5db8-5689z_kubernetes-dashboard(ab81093c-bffe-45a6-bb1f-d68defdc028d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5689z_kubernetes-dashboard(ab81093c-bffe-45a6-bb1f-d68defdc028d)"
W0520 14:01:41.826441 2324155 logs.go:138] Found kubelet problem: May 20 13:56:46 old-k8s-version-196977 kubelet[735]: E0520 13:56:46.368219 735 pod_workers.go:191] Error syncing pod ab81093c-bffe-45a6-bb1f-d68defdc028d ("dashboard-metrics-scraper-8d5bb5db8-5689z_kubernetes-dashboard(ab81093c-bffe-45a6-bb1f-d68defdc028d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5689z_kubernetes-dashboard(ab81093c-bffe-45a6-bb1f-d68defdc028d)"
W0520 14:01:41.828491 2324155 logs.go:138] Found kubelet problem: May 20 13:56:48 old-k8s-version-196977 kubelet[735]: E0520 13:56:48.619596 735 pod_workers.go:191] Error syncing pod c8365eaa-709d-43e2-8d02-7bb97878bae7 ("metrics-server-9975d5f86-cxvzj_kube-system(c8365eaa-709d-43e2-8d02-7bb97878bae7)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = pinging container registry fake.domain: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain: no such host"
W0520 14:01:41.829077 2324155 logs.go:138] Found kubelet problem: May 20 13:56:59 old-k8s-version-196977 kubelet[735]: E0520 13:56:59.394720 735 pod_workers.go:191] Error syncing pod ab81093c-bffe-45a6-bb1f-d68defdc028d ("dashboard-metrics-scraper-8d5bb5db8-5689z_kubernetes-dashboard(ab81093c-bffe-45a6-bb1f-d68defdc028d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5689z_kubernetes-dashboard(ab81093c-bffe-45a6-bb1f-d68defdc028d)"
W0520 14:01:41.829262 2324155 logs.go:138] Found kubelet problem: May 20 13:57:01 old-k8s-version-196977 kubelet[735]: E0520 13:57:01.157773 735 pod_workers.go:191] Error syncing pod c8365eaa-709d-43e2-8d02-7bb97878bae7 ("metrics-server-9975d5f86-cxvzj_kube-system(c8365eaa-709d-43e2-8d02-7bb97878bae7)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 14:01:41.829590 2324155 logs.go:138] Found kubelet problem: May 20 13:57:04 old-k8s-version-196977 kubelet[735]: E0520 13:57:04.669530 735 pod_workers.go:191] Error syncing pod ab81093c-bffe-45a6-bb1f-d68defdc028d ("dashboard-metrics-scraper-8d5bb5db8-5689z_kubernetes-dashboard(ab81093c-bffe-45a6-bb1f-d68defdc028d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5689z_kubernetes-dashboard(ab81093c-bffe-45a6-bb1f-d68defdc028d)"
W0520 14:01:41.831691 2324155 logs.go:138] Found kubelet problem: May 20 13:57:14 old-k8s-version-196977 kubelet[735]: E0520 13:57:14.169140 735 pod_workers.go:191] Error syncing pod c8365eaa-709d-43e2-8d02-7bb97878bae7 ("metrics-server-9975d5f86-cxvzj_kube-system(c8365eaa-709d-43e2-8d02-7bb97878bae7)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = pinging container registry fake.domain: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain: no such host"
W0520 14:01:41.832279 2324155 logs.go:138] Found kubelet problem: May 20 13:57:20 old-k8s-version-196977 kubelet[735]: E0520 13:57:20.425874 735 pod_workers.go:191] Error syncing pod ab81093c-bffe-45a6-bb1f-d68defdc028d ("dashboard-metrics-scraper-8d5bb5db8-5689z_kubernetes-dashboard(ab81093c-bffe-45a6-bb1f-d68defdc028d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5689z_kubernetes-dashboard(ab81093c-bffe-45a6-bb1f-d68defdc028d)"
W0520 14:01:41.832673 2324155 logs.go:138] Found kubelet problem: May 20 13:57:24 old-k8s-version-196977 kubelet[735]: E0520 13:57:24.668675 735 pod_workers.go:191] Error syncing pod ab81093c-bffe-45a6-bb1f-d68defdc028d ("dashboard-metrics-scraper-8d5bb5db8-5689z_kubernetes-dashboard(ab81093c-bffe-45a6-bb1f-d68defdc028d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5689z_kubernetes-dashboard(ab81093c-bffe-45a6-bb1f-d68defdc028d)"
W0520 14:01:41.832895 2324155 logs.go:138] Found kubelet problem: May 20 13:57:29 old-k8s-version-196977 kubelet[735]: E0520 13:57:29.158229 735 pod_workers.go:191] Error syncing pod c8365eaa-709d-43e2-8d02-7bb97878bae7 ("metrics-server-9975d5f86-cxvzj_kube-system(c8365eaa-709d-43e2-8d02-7bb97878bae7)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 14:01:41.833251 2324155 logs.go:138] Found kubelet problem: May 20 13:57:38 old-k8s-version-196977 kubelet[735]: E0520 13:57:38.156983 735 pod_workers.go:191] Error syncing pod ab81093c-bffe-45a6-bb1f-d68defdc028d ("dashboard-metrics-scraper-8d5bb5db8-5689z_kubernetes-dashboard(ab81093c-bffe-45a6-bb1f-d68defdc028d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5689z_kubernetes-dashboard(ab81093c-bffe-45a6-bb1f-d68defdc028d)"
W0520 14:01:41.833438 2324155 logs.go:138] Found kubelet problem: May 20 13:57:42 old-k8s-version-196977 kubelet[735]: E0520 13:57:42.159077 735 pod_workers.go:191] Error syncing pod c8365eaa-709d-43e2-8d02-7bb97878bae7 ("metrics-server-9975d5f86-cxvzj_kube-system(c8365eaa-709d-43e2-8d02-7bb97878bae7)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 14:01:41.833777 2324155 logs.go:138] Found kubelet problem: May 20 13:57:53 old-k8s-version-196977 kubelet[735]: E0520 13:57:53.157024 735 pod_workers.go:191] Error syncing pod ab81093c-bffe-45a6-bb1f-d68defdc028d ("dashboard-metrics-scraper-8d5bb5db8-5689z_kubernetes-dashboard(ab81093c-bffe-45a6-bb1f-d68defdc028d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5689z_kubernetes-dashboard(ab81093c-bffe-45a6-bb1f-d68defdc028d)"
W0520 14:01:41.835842 2324155 logs.go:138] Found kubelet problem: May 20 13:57:55 old-k8s-version-196977 kubelet[735]: E0520 13:57:55.167292 735 pod_workers.go:191] Error syncing pod c8365eaa-709d-43e2-8d02-7bb97878bae7 ("metrics-server-9975d5f86-cxvzj_kube-system(c8365eaa-709d-43e2-8d02-7bb97878bae7)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = pinging container registry fake.domain: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain: no such host"
W0520 14:01:41.836028 2324155 logs.go:138] Found kubelet problem: May 20 13:58:06 old-k8s-version-196977 kubelet[735]: E0520 13:58:06.158207 735 pod_workers.go:191] Error syncing pod c8365eaa-709d-43e2-8d02-7bb97878bae7 ("metrics-server-9975d5f86-cxvzj_kube-system(c8365eaa-709d-43e2-8d02-7bb97878bae7)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 14:01:41.836621 2324155 logs.go:138] Found kubelet problem: May 20 13:58:07 old-k8s-version-196977 kubelet[735]: E0520 13:58:07.486766 735 pod_workers.go:191] Error syncing pod ab81093c-bffe-45a6-bb1f-d68defdc028d ("dashboard-metrics-scraper-8d5bb5db8-5689z_kubernetes-dashboard(ab81093c-bffe-45a6-bb1f-d68defdc028d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5689z_kubernetes-dashboard(ab81093c-bffe-45a6-bb1f-d68defdc028d)"
W0520 14:01:41.836949 2324155 logs.go:138] Found kubelet problem: May 20 13:58:14 old-k8s-version-196977 kubelet[735]: E0520 13:58:14.668747 735 pod_workers.go:191] Error syncing pod ab81093c-bffe-45a6-bb1f-d68defdc028d ("dashboard-metrics-scraper-8d5bb5db8-5689z_kubernetes-dashboard(ab81093c-bffe-45a6-bb1f-d68defdc028d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5689z_kubernetes-dashboard(ab81093c-bffe-45a6-bb1f-d68defdc028d)"
W0520 14:01:41.837134 2324155 logs.go:138] Found kubelet problem: May 20 13:58:19 old-k8s-version-196977 kubelet[735]: E0520 13:58:19.158242 735 pod_workers.go:191] Error syncing pod c8365eaa-709d-43e2-8d02-7bb97878bae7 ("metrics-server-9975d5f86-cxvzj_kube-system(c8365eaa-709d-43e2-8d02-7bb97878bae7)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 14:01:41.837461 2324155 logs.go:138] Found kubelet problem: May 20 13:58:28 old-k8s-version-196977 kubelet[735]: E0520 13:58:28.156931 735 pod_workers.go:191] Error syncing pod ab81093c-bffe-45a6-bb1f-d68defdc028d ("dashboard-metrics-scraper-8d5bb5db8-5689z_kubernetes-dashboard(ab81093c-bffe-45a6-bb1f-d68defdc028d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5689z_kubernetes-dashboard(ab81093c-bffe-45a6-bb1f-d68defdc028d)"
W0520 14:01:41.837650 2324155 logs.go:138] Found kubelet problem: May 20 13:58:30 old-k8s-version-196977 kubelet[735]: E0520 13:58:30.157866 735 pod_workers.go:191] Error syncing pod c8365eaa-709d-43e2-8d02-7bb97878bae7 ("metrics-server-9975d5f86-cxvzj_kube-system(c8365eaa-709d-43e2-8d02-7bb97878bae7)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 14:01:41.837977 2324155 logs.go:138] Found kubelet problem: May 20 13:58:41 old-k8s-version-196977 kubelet[735]: E0520 13:58:41.156994 735 pod_workers.go:191] Error syncing pod ab81093c-bffe-45a6-bb1f-d68defdc028d ("dashboard-metrics-scraper-8d5bb5db8-5689z_kubernetes-dashboard(ab81093c-bffe-45a6-bb1f-d68defdc028d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5689z_kubernetes-dashboard(ab81093c-bffe-45a6-bb1f-d68defdc028d)"
W0520 14:01:41.838163 2324155 logs.go:138] Found kubelet problem: May 20 13:58:44 old-k8s-version-196977 kubelet[735]: E0520 13:58:44.157439 735 pod_workers.go:191] Error syncing pod c8365eaa-709d-43e2-8d02-7bb97878bae7 ("metrics-server-9975d5f86-cxvzj_kube-system(c8365eaa-709d-43e2-8d02-7bb97878bae7)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 14:01:41.838476 2324155 logs.go:138] Found kubelet problem: May 20 13:58:56 old-k8s-version-196977 kubelet[735]: E0520 13:58:56.158086 735 pod_workers.go:191] Error syncing pod c8365eaa-709d-43e2-8d02-7bb97878bae7 ("metrics-server-9975d5f86-cxvzj_kube-system(c8365eaa-709d-43e2-8d02-7bb97878bae7)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 14:01:41.838673 2324155 logs.go:138] Found kubelet problem: May 20 13:58:56 old-k8s-version-196977 kubelet[735]: E0520 13:58:56.158153 735 pod_workers.go:191] Error syncing pod ab81093c-bffe-45a6-bb1f-d68defdc028d ("dashboard-metrics-scraper-8d5bb5db8-5689z_kubernetes-dashboard(ab81093c-bffe-45a6-bb1f-d68defdc028d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5689z_kubernetes-dashboard(ab81093c-bffe-45a6-bb1f-d68defdc028d)"
W0520 14:01:41.839527 2324155 logs.go:138] Found kubelet problem: May 20 13:59:08 old-k8s-version-196977 kubelet[735]: E0520 13:59:08.156835 735 pod_workers.go:191] Error syncing pod ab81093c-bffe-45a6-bb1f-d68defdc028d ("dashboard-metrics-scraper-8d5bb5db8-5689z_kubernetes-dashboard(ab81093c-bffe-45a6-bb1f-d68defdc028d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5689z_kubernetes-dashboard(ab81093c-bffe-45a6-bb1f-d68defdc028d)"
W0520 14:01:41.839717 2324155 logs.go:138] Found kubelet problem: May 20 13:59:10 old-k8s-version-196977 kubelet[735]: E0520 13:59:10.157811 735 pod_workers.go:191] Error syncing pod c8365eaa-709d-43e2-8d02-7bb97878bae7 ("metrics-server-9975d5f86-cxvzj_kube-system(c8365eaa-709d-43e2-8d02-7bb97878bae7)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 14:01:41.840063 2324155 logs.go:138] Found kubelet problem: May 20 13:59:19 old-k8s-version-196977 kubelet[735]: E0520 13:59:19.158201 735 pod_workers.go:191] Error syncing pod ab81093c-bffe-45a6-bb1f-d68defdc028d ("dashboard-metrics-scraper-8d5bb5db8-5689z_kubernetes-dashboard(ab81093c-bffe-45a6-bb1f-d68defdc028d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5689z_kubernetes-dashboard(ab81093c-bffe-45a6-bb1f-d68defdc028d)"
W0520 14:01:41.842114 2324155 logs.go:138] Found kubelet problem: May 20 13:59:24 old-k8s-version-196977 kubelet[735]: E0520 13:59:24.165546 735 pod_workers.go:191] Error syncing pod c8365eaa-709d-43e2-8d02-7bb97878bae7 ("metrics-server-9975d5f86-cxvzj_kube-system(c8365eaa-709d-43e2-8d02-7bb97878bae7)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = pinging container registry fake.domain: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain: no such host"
W0520 14:01:41.842700 2324155 logs.go:138] Found kubelet problem: May 20 13:59:32 old-k8s-version-196977 kubelet[735]: E0520 13:59:32.607875 735 pod_workers.go:191] Error syncing pod ab81093c-bffe-45a6-bb1f-d68defdc028d ("dashboard-metrics-scraper-8d5bb5db8-5689z_kubernetes-dashboard(ab81093c-bffe-45a6-bb1f-d68defdc028d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5689z_kubernetes-dashboard(ab81093c-bffe-45a6-bb1f-d68defdc028d)"
W0520 14:01:41.843030 2324155 logs.go:138] Found kubelet problem: May 20 13:59:34 old-k8s-version-196977 kubelet[735]: E0520 13:59:34.668730 735 pod_workers.go:191] Error syncing pod ab81093c-bffe-45a6-bb1f-d68defdc028d ("dashboard-metrics-scraper-8d5bb5db8-5689z_kubernetes-dashboard(ab81093c-bffe-45a6-bb1f-d68defdc028d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5689z_kubernetes-dashboard(ab81093c-bffe-45a6-bb1f-d68defdc028d)"
W0520 14:01:41.843213 2324155 logs.go:138] Found kubelet problem: May 20 13:59:38 old-k8s-version-196977 kubelet[735]: E0520 13:59:38.157403 735 pod_workers.go:191] Error syncing pod c8365eaa-709d-43e2-8d02-7bb97878bae7 ("metrics-server-9975d5f86-cxvzj_kube-system(c8365eaa-709d-43e2-8d02-7bb97878bae7)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 14:01:41.843539 2324155 logs.go:138] Found kubelet problem: May 20 13:59:48 old-k8s-version-196977 kubelet[735]: E0520 13:59:48.156994 735 pod_workers.go:191] Error syncing pod ab81093c-bffe-45a6-bb1f-d68defdc028d ("dashboard-metrics-scraper-8d5bb5db8-5689z_kubernetes-dashboard(ab81093c-bffe-45a6-bb1f-d68defdc028d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5689z_kubernetes-dashboard(ab81093c-bffe-45a6-bb1f-d68defdc028d)"
W0520 14:01:41.843726 2324155 logs.go:138] Found kubelet problem: May 20 13:59:49 old-k8s-version-196977 kubelet[735]: E0520 13:59:49.162211 735 pod_workers.go:191] Error syncing pod c8365eaa-709d-43e2-8d02-7bb97878bae7 ("metrics-server-9975d5f86-cxvzj_kube-system(c8365eaa-709d-43e2-8d02-7bb97878bae7)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 14:01:41.844063 2324155 logs.go:138] Found kubelet problem: May 20 14:00:00 old-k8s-version-196977 kubelet[735]: E0520 14:00:00.159051 735 pod_workers.go:191] Error syncing pod ab81093c-bffe-45a6-bb1f-d68defdc028d ("dashboard-metrics-scraper-8d5bb5db8-5689z_kubernetes-dashboard(ab81093c-bffe-45a6-bb1f-d68defdc028d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5689z_kubernetes-dashboard(ab81093c-bffe-45a6-bb1f-d68defdc028d)"
W0520 14:01:41.844246 2324155 logs.go:138] Found kubelet problem: May 20 14:00:03 old-k8s-version-196977 kubelet[735]: E0520 14:00:03.157867 735 pod_workers.go:191] Error syncing pod c8365eaa-709d-43e2-8d02-7bb97878bae7 ("metrics-server-9975d5f86-cxvzj_kube-system(c8365eaa-709d-43e2-8d02-7bb97878bae7)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 14:01:41.845091 2324155 logs.go:138] Found kubelet problem: May 20 14:00:11 old-k8s-version-196977 kubelet[735]: E0520 14:00:11.156991 735 pod_workers.go:191] Error syncing pod ab81093c-bffe-45a6-bb1f-d68defdc028d ("dashboard-metrics-scraper-8d5bb5db8-5689z_kubernetes-dashboard(ab81093c-bffe-45a6-bb1f-d68defdc028d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5689z_kubernetes-dashboard(ab81093c-bffe-45a6-bb1f-d68defdc028d)"
W0520 14:01:41.845275 2324155 logs.go:138] Found kubelet problem: May 20 14:00:16 old-k8s-version-196977 kubelet[735]: E0520 14:00:16.157437 735 pod_workers.go:191] Error syncing pod c8365eaa-709d-43e2-8d02-7bb97878bae7 ("metrics-server-9975d5f86-cxvzj_kube-system(c8365eaa-709d-43e2-8d02-7bb97878bae7)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 14:01:41.845604 2324155 logs.go:138] Found kubelet problem: May 20 14:00:23 old-k8s-version-196977 kubelet[735]: E0520 14:00:23.156963 735 pod_workers.go:191] Error syncing pod ab81093c-bffe-45a6-bb1f-d68defdc028d ("dashboard-metrics-scraper-8d5bb5db8-5689z_kubernetes-dashboard(ab81093c-bffe-45a6-bb1f-d68defdc028d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5689z_kubernetes-dashboard(ab81093c-bffe-45a6-bb1f-d68defdc028d)"
W0520 14:01:41.845811 2324155 logs.go:138] Found kubelet problem: May 20 14:00:28 old-k8s-version-196977 kubelet[735]: E0520 14:00:28.157555 735 pod_workers.go:191] Error syncing pod c8365eaa-709d-43e2-8d02-7bb97878bae7 ("metrics-server-9975d5f86-cxvzj_kube-system(c8365eaa-709d-43e2-8d02-7bb97878bae7)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 14:01:41.846138 2324155 logs.go:138] Found kubelet problem: May 20 14:00:37 old-k8s-version-196977 kubelet[735]: E0520 14:00:37.157011 735 pod_workers.go:191] Error syncing pod ab81093c-bffe-45a6-bb1f-d68defdc028d ("dashboard-metrics-scraper-8d5bb5db8-5689z_kubernetes-dashboard(ab81093c-bffe-45a6-bb1f-d68defdc028d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5689z_kubernetes-dashboard(ab81093c-bffe-45a6-bb1f-d68defdc028d)"
W0520 14:01:41.846323 2324155 logs.go:138] Found kubelet problem: May 20 14:00:42 old-k8s-version-196977 kubelet[735]: E0520 14:00:42.157800 735 pod_workers.go:191] Error syncing pod c8365eaa-709d-43e2-8d02-7bb97878bae7 ("metrics-server-9975d5f86-cxvzj_kube-system(c8365eaa-709d-43e2-8d02-7bb97878bae7)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 14:01:41.846653 2324155 logs.go:138] Found kubelet problem: May 20 14:00:52 old-k8s-version-196977 kubelet[735]: E0520 14:00:52.156937 735 pod_workers.go:191] Error syncing pod ab81093c-bffe-45a6-bb1f-d68defdc028d ("dashboard-metrics-scraper-8d5bb5db8-5689z_kubernetes-dashboard(ab81093c-bffe-45a6-bb1f-d68defdc028d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5689z_kubernetes-dashboard(ab81093c-bffe-45a6-bb1f-d68defdc028d)"
W0520 14:01:41.846836 2324155 logs.go:138] Found kubelet problem: May 20 14:00:54 old-k8s-version-196977 kubelet[735]: E0520 14:00:54.157689 735 pod_workers.go:191] Error syncing pod c8365eaa-709d-43e2-8d02-7bb97878bae7 ("metrics-server-9975d5f86-cxvzj_kube-system(c8365eaa-709d-43e2-8d02-7bb97878bae7)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 14:01:41.847161 2324155 logs.go:138] Found kubelet problem: May 20 14:01:03 old-k8s-version-196977 kubelet[735]: E0520 14:01:03.157044 735 pod_workers.go:191] Error syncing pod ab81093c-bffe-45a6-bb1f-d68defdc028d ("dashboard-metrics-scraper-8d5bb5db8-5689z_kubernetes-dashboard(ab81093c-bffe-45a6-bb1f-d68defdc028d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5689z_kubernetes-dashboard(ab81093c-bffe-45a6-bb1f-d68defdc028d)"
W0520 14:01:41.847590 2324155 logs.go:138] Found kubelet problem: May 20 14:01:05 old-k8s-version-196977 kubelet[735]: E0520 14:01:05.157906 735 pod_workers.go:191] Error syncing pod c8365eaa-709d-43e2-8d02-7bb97878bae7 ("metrics-server-9975d5f86-cxvzj_kube-system(c8365eaa-709d-43e2-8d02-7bb97878bae7)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 14:01:41.847920 2324155 logs.go:138] Found kubelet problem: May 20 14:01:14 old-k8s-version-196977 kubelet[735]: E0520 14:01:14.157027 735 pod_workers.go:191] Error syncing pod ab81093c-bffe-45a6-bb1f-d68defdc028d ("dashboard-metrics-scraper-8d5bb5db8-5689z_kubernetes-dashboard(ab81093c-bffe-45a6-bb1f-d68defdc028d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5689z_kubernetes-dashboard(ab81093c-bffe-45a6-bb1f-d68defdc028d)"
W0520 14:01:41.848105 2324155 logs.go:138] Found kubelet problem: May 20 14:01:20 old-k8s-version-196977 kubelet[735]: E0520 14:01:20.157731 735 pod_workers.go:191] Error syncing pod c8365eaa-709d-43e2-8d02-7bb97878bae7 ("metrics-server-9975d5f86-cxvzj_kube-system(c8365eaa-709d-43e2-8d02-7bb97878bae7)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 14:01:41.848430 2324155 logs.go:138] Found kubelet problem: May 20 14:01:28 old-k8s-version-196977 kubelet[735]: E0520 14:01:28.156964 735 pod_workers.go:191] Error syncing pod ab81093c-bffe-45a6-bb1f-d68defdc028d ("dashboard-metrics-scraper-8d5bb5db8-5689z_kubernetes-dashboard(ab81093c-bffe-45a6-bb1f-d68defdc028d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5689z_kubernetes-dashboard(ab81093c-bffe-45a6-bb1f-d68defdc028d)"
W0520 14:01:41.848613 2324155 logs.go:138] Found kubelet problem: May 20 14:01:33 old-k8s-version-196977 kubelet[735]: E0520 14:01:33.157618 735 pod_workers.go:191] Error syncing pod c8365eaa-709d-43e2-8d02-7bb97878bae7 ("metrics-server-9975d5f86-cxvzj_kube-system(c8365eaa-709d-43e2-8d02-7bb97878bae7)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 14:01:41.848939 2324155 logs.go:138] Found kubelet problem: May 20 14:01:40 old-k8s-version-196977 kubelet[735]: E0520 14:01:40.157785 735 pod_workers.go:191] Error syncing pod ab81093c-bffe-45a6-bb1f-d68defdc028d ("dashboard-metrics-scraper-8d5bb5db8-5689z_kubernetes-dashboard(ab81093c-bffe-45a6-bb1f-d68defdc028d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5689z_kubernetes-dashboard(ab81093c-bffe-45a6-bb1f-d68defdc028d)"
I0520 14:01:41.848950 2324155 logs.go:123] Gathering logs for dmesg ...
I0520 14:01:41.848963 2324155 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0520 14:01:41.870194 2324155 logs.go:123] Gathering logs for coredns [758b608b9e8e08eed64aeb045062ae7d4a5a33e5295c6519a33c1a800cb38dd9] ...
I0520 14:01:41.870226 2324155 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 758b608b9e8e08eed64aeb045062ae7d4a5a33e5295c6519a33c1a800cb38dd9"
I0520 14:01:41.915302 2324155 logs.go:123] Gathering logs for kube-controller-manager [6573124f1f00f0b93e75e9d9c4005f0198ca7f6b5324170c53a4e24d835271c4] ...
I0520 14:01:41.915332 2324155 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 6573124f1f00f0b93e75e9d9c4005f0198ca7f6b5324170c53a4e24d835271c4"
I0520 14:01:41.997589 2324155 logs.go:123] Gathering logs for kindnet [e8289b46f01a9d3e0e6b44ce3290e107e18c07f655ba4194c834341c4d468c83] ...
I0520 14:01:41.997628 2324155 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 e8289b46f01a9d3e0e6b44ce3290e107e18c07f655ba4194c834341c4d468c83"
I0520 14:01:42.048980 2324155 logs.go:123] Gathering logs for describe nodes ...
I0520 14:01:42.049011 2324155 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0520 14:01:42.245987 2324155 logs.go:123] Gathering logs for etcd [574ca79575df26bfbb124b76c08ba1882d73ae20602034b6e0c9d2a4a58ddc9f] ...
I0520 14:01:42.246058 2324155 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 574ca79575df26bfbb124b76c08ba1882d73ae20602034b6e0c9d2a4a58ddc9f"
I0520 14:01:42.305846 2324155 logs.go:123] Gathering logs for kube-scheduler [b2bf99df779efc3459ff13a39979c379186fd56c60c69dc26b9297b16d4c1a3e] ...
I0520 14:01:42.305884 2324155 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 b2bf99df779efc3459ff13a39979c379186fd56c60c69dc26b9297b16d4c1a3e"
I0520 14:01:42.362717 2324155 logs.go:123] Gathering logs for storage-provisioner [c6481d58189faf4b67ee0efb1177763e086618f853c876070abc9fb1a4dc75cd] ...
I0520 14:01:42.362755 2324155 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 c6481d58189faf4b67ee0efb1177763e086618f853c876070abc9fb1a4dc75cd"
I0520 14:01:42.404458 2324155 logs.go:123] Gathering logs for CRI-O ...
I0520 14:01:42.404489 2324155 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I0520 14:01:42.481903 2324155 logs.go:123] Gathering logs for container status ...
I0520 14:01:42.481938 2324155 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0520 14:01:42.529714 2324155 logs.go:123] Gathering logs for kube-apiserver [21f02b40f812f73866c7240ca4f394dd16d29cf18f0bd90fe73f0f88278d7c3c] ...
I0520 14:01:42.529792 2324155 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 21f02b40f812f73866c7240ca4f394dd16d29cf18f0bd90fe73f0f88278d7c3c"
I0520 14:01:42.608432 2324155 logs.go:123] Gathering logs for kubernetes-dashboard [a5779cc8510e582479bdedeecea9ca5a0471306b7bf72588b0563dcb1a60a030] ...
I0520 14:01:42.608469 2324155 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 a5779cc8510e582479bdedeecea9ca5a0471306b7bf72588b0563dcb1a60a030"
I0520 14:01:42.650767 2324155 out.go:304] Setting ErrFile to fd 2...
I0520 14:01:42.650793 2324155 out.go:338] TERM=,COLORTERM=, which probably does not support color
W0520 14:01:42.650876 2324155 out.go:239] X Problems detected in kubelet:
X Problems detected in kubelet:
W0520 14:01:42.650891 2324155 out.go:239] May 20 14:01:14 old-k8s-version-196977 kubelet[735]: E0520 14:01:14.157027 735 pod_workers.go:191] Error syncing pod ab81093c-bffe-45a6-bb1f-d68defdc028d ("dashboard-metrics-scraper-8d5bb5db8-5689z_kubernetes-dashboard(ab81093c-bffe-45a6-bb1f-d68defdc028d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5689z_kubernetes-dashboard(ab81093c-bffe-45a6-bb1f-d68defdc028d)"
May 20 14:01:14 old-k8s-version-196977 kubelet[735]: E0520 14:01:14.157027 735 pod_workers.go:191] Error syncing pod ab81093c-bffe-45a6-bb1f-d68defdc028d ("dashboard-metrics-scraper-8d5bb5db8-5689z_kubernetes-dashboard(ab81093c-bffe-45a6-bb1f-d68defdc028d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5689z_kubernetes-dashboard(ab81093c-bffe-45a6-bb1f-d68defdc028d)"
W0520 14:01:42.650923 2324155 out.go:239] May 20 14:01:20 old-k8s-version-196977 kubelet[735]: E0520 14:01:20.157731 735 pod_workers.go:191] Error syncing pod c8365eaa-709d-43e2-8d02-7bb97878bae7 ("metrics-server-9975d5f86-cxvzj_kube-system(c8365eaa-709d-43e2-8d02-7bb97878bae7)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
May 20 14:01:20 old-k8s-version-196977 kubelet[735]: E0520 14:01:20.157731 735 pod_workers.go:191] Error syncing pod c8365eaa-709d-43e2-8d02-7bb97878bae7 ("metrics-server-9975d5f86-cxvzj_kube-system(c8365eaa-709d-43e2-8d02-7bb97878bae7)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 14:01:42.650948 2324155 out.go:239] May 20 14:01:28 old-k8s-version-196977 kubelet[735]: E0520 14:01:28.156964 735 pod_workers.go:191] Error syncing pod ab81093c-bffe-45a6-bb1f-d68defdc028d ("dashboard-metrics-scraper-8d5bb5db8-5689z_kubernetes-dashboard(ab81093c-bffe-45a6-bb1f-d68defdc028d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5689z_kubernetes-dashboard(ab81093c-bffe-45a6-bb1f-d68defdc028d)"
May 20 14:01:28 old-k8s-version-196977 kubelet[735]: E0520 14:01:28.156964 735 pod_workers.go:191] Error syncing pod ab81093c-bffe-45a6-bb1f-d68defdc028d ("dashboard-metrics-scraper-8d5bb5db8-5689z_kubernetes-dashboard(ab81093c-bffe-45a6-bb1f-d68defdc028d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5689z_kubernetes-dashboard(ab81093c-bffe-45a6-bb1f-d68defdc028d)"
W0520 14:01:42.650955 2324155 out.go:239] May 20 14:01:33 old-k8s-version-196977 kubelet[735]: E0520 14:01:33.157618 735 pod_workers.go:191] Error syncing pod c8365eaa-709d-43e2-8d02-7bb97878bae7 ("metrics-server-9975d5f86-cxvzj_kube-system(c8365eaa-709d-43e2-8d02-7bb97878bae7)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
May 20 14:01:33 old-k8s-version-196977 kubelet[735]: E0520 14:01:33.157618 735 pod_workers.go:191] Error syncing pod c8365eaa-709d-43e2-8d02-7bb97878bae7 ("metrics-server-9975d5f86-cxvzj_kube-system(c8365eaa-709d-43e2-8d02-7bb97878bae7)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 14:01:42.650984 2324155 out.go:239] May 20 14:01:40 old-k8s-version-196977 kubelet[735]: E0520 14:01:40.157785 735 pod_workers.go:191] Error syncing pod ab81093c-bffe-45a6-bb1f-d68defdc028d ("dashboard-metrics-scraper-8d5bb5db8-5689z_kubernetes-dashboard(ab81093c-bffe-45a6-bb1f-d68defdc028d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5689z_kubernetes-dashboard(ab81093c-bffe-45a6-bb1f-d68defdc028d)"
May 20 14:01:40 old-k8s-version-196977 kubelet[735]: E0520 14:01:40.157785 735 pod_workers.go:191] Error syncing pod ab81093c-bffe-45a6-bb1f-d68defdc028d ("dashboard-metrics-scraper-8d5bb5db8-5689z_kubernetes-dashboard(ab81093c-bffe-45a6-bb1f-d68defdc028d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5689z_kubernetes-dashboard(ab81093c-bffe-45a6-bb1f-d68defdc028d)"
I0520 14:01:42.650991 2324155 out.go:304] Setting ErrFile to fd 2...
I0520 14:01:42.651013 2324155 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0520 14:01:52.651286 2324155 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0520 14:01:52.662771 2324155 api_server.go:72] duration metric: took 5m55.676507614s to wait for apiserver process to appear ...
I0520 14:01:52.662797 2324155 api_server.go:88] waiting for apiserver healthz status ...
I0520 14:01:52.662835 2324155 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I0520 14:01:52.662898 2324155 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0520 14:01:52.714924 2324155 cri.go:89] found id: "21f02b40f812f73866c7240ca4f394dd16d29cf18f0bd90fe73f0f88278d7c3c"
I0520 14:01:52.714944 2324155 cri.go:89] found id: ""
I0520 14:01:52.714952 2324155 logs.go:276] 1 containers: [21f02b40f812f73866c7240ca4f394dd16d29cf18f0bd90fe73f0f88278d7c3c]
I0520 14:01:52.715010 2324155 ssh_runner.go:195] Run: which crictl
I0520 14:01:52.718757 2324155 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I0520 14:01:52.718832 2324155 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0520 14:01:52.757013 2324155 cri.go:89] found id: "574ca79575df26bfbb124b76c08ba1882d73ae20602034b6e0c9d2a4a58ddc9f"
I0520 14:01:52.757040 2324155 cri.go:89] found id: ""
I0520 14:01:52.757055 2324155 logs.go:276] 1 containers: [574ca79575df26bfbb124b76c08ba1882d73ae20602034b6e0c9d2a4a58ddc9f]
I0520 14:01:52.757117 2324155 ssh_runner.go:195] Run: which crictl
I0520 14:01:52.760769 2324155 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I0520 14:01:52.760839 2324155 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0520 14:01:52.808238 2324155 cri.go:89] found id: "758b608b9e8e08eed64aeb045062ae7d4a5a33e5295c6519a33c1a800cb38dd9"
I0520 14:01:52.808259 2324155 cri.go:89] found id: ""
I0520 14:01:52.808267 2324155 logs.go:276] 1 containers: [758b608b9e8e08eed64aeb045062ae7d4a5a33e5295c6519a33c1a800cb38dd9]
I0520 14:01:52.808324 2324155 ssh_runner.go:195] Run: which crictl
I0520 14:01:52.811931 2324155 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I0520 14:01:52.812006 2324155 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0520 14:01:52.849280 2324155 cri.go:89] found id: "b2bf99df779efc3459ff13a39979c379186fd56c60c69dc26b9297b16d4c1a3e"
I0520 14:01:52.849299 2324155 cri.go:89] found id: ""
I0520 14:01:52.849306 2324155 logs.go:276] 1 containers: [b2bf99df779efc3459ff13a39979c379186fd56c60c69dc26b9297b16d4c1a3e]
I0520 14:01:52.849369 2324155 ssh_runner.go:195] Run: which crictl
I0520 14:01:52.852943 2324155 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I0520 14:01:52.853013 2324155 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0520 14:01:52.893309 2324155 cri.go:89] found id: "577e4eac4cee4596652e1e0a4aa1aab157007dd6015d77ef54ce41d332d17660"
I0520 14:01:52.893328 2324155 cri.go:89] found id: ""
I0520 14:01:52.893335 2324155 logs.go:276] 1 containers: [577e4eac4cee4596652e1e0a4aa1aab157007dd6015d77ef54ce41d332d17660]
I0520 14:01:52.893398 2324155 ssh_runner.go:195] Run: which crictl
I0520 14:01:52.897705 2324155 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I0520 14:01:52.897775 2324155 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0520 14:01:52.944872 2324155 cri.go:89] found id: "6573124f1f00f0b93e75e9d9c4005f0198ca7f6b5324170c53a4e24d835271c4"
I0520 14:01:52.944901 2324155 cri.go:89] found id: ""
I0520 14:01:52.944910 2324155 logs.go:276] 1 containers: [6573124f1f00f0b93e75e9d9c4005f0198ca7f6b5324170c53a4e24d835271c4]
I0520 14:01:52.944968 2324155 ssh_runner.go:195] Run: which crictl
I0520 14:01:52.948935 2324155 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I0520 14:01:52.949029 2324155 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0520 14:01:52.992064 2324155 cri.go:89] found id: "e8289b46f01a9d3e0e6b44ce3290e107e18c07f655ba4194c834341c4d468c83"
I0520 14:01:52.992088 2324155 cri.go:89] found id: ""
I0520 14:01:52.992097 2324155 logs.go:276] 1 containers: [e8289b46f01a9d3e0e6b44ce3290e107e18c07f655ba4194c834341c4d468c83]
I0520 14:01:52.992155 2324155 ssh_runner.go:195] Run: which crictl
I0520 14:01:52.996121 2324155 cri.go:54] listing CRI containers in root : {State:all Name:storage-provisioner Namespaces:[]}
I0520 14:01:52.996195 2324155 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
I0520 14:01:53.039041 2324155 cri.go:89] found id: "c6481d58189faf4b67ee0efb1177763e086618f853c876070abc9fb1a4dc75cd"
I0520 14:01:53.039112 2324155 cri.go:89] found id: ""
I0520 14:01:53.039134 2324155 logs.go:276] 1 containers: [c6481d58189faf4b67ee0efb1177763e086618f853c876070abc9fb1a4dc75cd]
I0520 14:01:53.039220 2324155 ssh_runner.go:195] Run: which crictl
I0520 14:01:53.043207 2324155 cri.go:54] listing CRI containers in root : {State:all Name:kubernetes-dashboard Namespaces:[]}
I0520 14:01:53.043329 2324155 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
I0520 14:01:53.088578 2324155 cri.go:89] found id: "a5779cc8510e582479bdedeecea9ca5a0471306b7bf72588b0563dcb1a60a030"
I0520 14:01:53.088643 2324155 cri.go:89] found id: ""
I0520 14:01:53.088660 2324155 logs.go:276] 1 containers: [a5779cc8510e582479bdedeecea9ca5a0471306b7bf72588b0563dcb1a60a030]
I0520 14:01:53.088739 2324155 ssh_runner.go:195] Run: which crictl
I0520 14:01:53.092410 2324155 logs.go:123] Gathering logs for etcd [574ca79575df26bfbb124b76c08ba1882d73ae20602034b6e0c9d2a4a58ddc9f] ...
I0520 14:01:53.092437 2324155 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 574ca79575df26bfbb124b76c08ba1882d73ae20602034b6e0c9d2a4a58ddc9f"
I0520 14:01:53.140578 2324155 logs.go:123] Gathering logs for kube-controller-manager [6573124f1f00f0b93e75e9d9c4005f0198ca7f6b5324170c53a4e24d835271c4] ...
I0520 14:01:53.140611 2324155 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 6573124f1f00f0b93e75e9d9c4005f0198ca7f6b5324170c53a4e24d835271c4"
I0520 14:01:53.234740 2324155 logs.go:123] Gathering logs for kindnet [e8289b46f01a9d3e0e6b44ce3290e107e18c07f655ba4194c834341c4d468c83] ...
I0520 14:01:53.234783 2324155 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 e8289b46f01a9d3e0e6b44ce3290e107e18c07f655ba4194c834341c4d468c83"
I0520 14:01:53.297047 2324155 logs.go:123] Gathering logs for kubelet ...
I0520 14:01:53.297076 2324155 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
W0520 14:01:53.355325 2324155 logs.go:138] Found kubelet problem: May 20 13:56:18 old-k8s-version-196977 kubelet[735]: E0520 13:56:18.281923 735 reflector.go:138] object-"kube-system"/"kindnet-token-22d6h": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kindnet-token-22d6h" is forbidden: User "system:node:old-k8s-version-196977" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-196977' and this object
W0520 14:01:53.355591 2324155 logs.go:138] Found kubelet problem: May 20 13:56:18 old-k8s-version-196977 kubelet[735]: E0520 13:56:18.282422 735 reflector.go:138] object-"kube-system"/"kube-proxy": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-proxy" is forbidden: User "system:node:old-k8s-version-196977" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-196977' and this object
W0520 14:01:53.355800 2324155 logs.go:138] Found kubelet problem: May 20 13:56:18 old-k8s-version-196977 kubelet[735]: E0520 13:56:18.282696 735 reflector.go:138] object-"kube-system"/"coredns": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "coredns" is forbidden: User "system:node:old-k8s-version-196977" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-196977' and this object
W0520 14:01:53.356021 2324155 logs.go:138] Found kubelet problem: May 20 13:56:18 old-k8s-version-196977 kubelet[735]: E0520 13:56:18.283001 735 reflector.go:138] object-"kube-system"/"kube-proxy-token-dxz6j": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kube-proxy-token-dxz6j" is forbidden: User "system:node:old-k8s-version-196977" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-196977' and this object
W0520 14:01:53.356242 2324155 logs.go:138] Found kubelet problem: May 20 13:56:18 old-k8s-version-196977 kubelet[735]: E0520 13:56:18.283271 735 reflector.go:138] object-"kube-system"/"coredns-token-x8bzr": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "coredns-token-x8bzr" is forbidden: User "system:node:old-k8s-version-196977" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-196977' and this object
W0520 14:01:53.356472 2324155 logs.go:138] Found kubelet problem: May 20 13:56:18 old-k8s-version-196977 kubelet[735]: E0520 13:56:18.283558 735 reflector.go:138] object-"kube-system"/"storage-provisioner-token-jqqsh": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "storage-provisioner-token-jqqsh" is forbidden: User "system:node:old-k8s-version-196977" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-196977' and this object
W0520 14:01:53.356697 2324155 logs.go:138] Found kubelet problem: May 20 13:56:18 old-k8s-version-196977 kubelet[735]: E0520 13:56:18.284130 735 reflector.go:138] object-"kube-system"/"metrics-server-token-l5sd5": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "metrics-server-token-l5sd5" is forbidden: User "system:node:old-k8s-version-196977" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-196977' and this object
W0520 14:01:53.356909 2324155 logs.go:138] Found kubelet problem: May 20 13:56:18 old-k8s-version-196977 kubelet[735]: E0520 13:56:18.284596 735 reflector.go:138] object-"default"/"default-token-ptqw7": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "default-token-ptqw7" is forbidden: User "system:node:old-k8s-version-196977" cannot list resource "secrets" in API group "" in the namespace "default": no relationship found between node 'old-k8s-version-196977' and this object
W0520 14:01:53.370176 2324155 logs.go:138] Found kubelet problem: May 20 13:56:22 old-k8s-version-196977 kubelet[735]: E0520 13:56:22.333275 735 pod_workers.go:191] Error syncing pod c8365eaa-709d-43e2-8d02-7bb97878bae7 ("metrics-server-9975d5f86-cxvzj_kube-system(c8365eaa-709d-43e2-8d02-7bb97878bae7)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = pinging container registry fake.domain: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain: no such host"
W0520 14:01:53.370438 2324155 logs.go:138] Found kubelet problem: May 20 13:56:23 old-k8s-version-196977 kubelet[735]: E0520 13:56:23.281444 735 pod_workers.go:191] Error syncing pod c8365eaa-709d-43e2-8d02-7bb97878bae7 ("metrics-server-9975d5f86-cxvzj_kube-system(c8365eaa-709d-43e2-8d02-7bb97878bae7)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 14:01:53.373003 2324155 logs.go:138] Found kubelet problem: May 20 13:56:44 old-k8s-version-196977 kubelet[735]: E0520 13:56:44.365021 735 pod_workers.go:191] Error syncing pod ab81093c-bffe-45a6-bb1f-d68defdc028d ("dashboard-metrics-scraper-8d5bb5db8-5689z_kubernetes-dashboard(ab81093c-bffe-45a6-bb1f-d68defdc028d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5689z_kubernetes-dashboard(ab81093c-bffe-45a6-bb1f-d68defdc028d)"
W0520 14:01:53.373338 2324155 logs.go:138] Found kubelet problem: May 20 13:56:45 old-k8s-version-196977 kubelet[735]: E0520 13:56:45.365825 735 pod_workers.go:191] Error syncing pod ab81093c-bffe-45a6-bb1f-d68defdc028d ("dashboard-metrics-scraper-8d5bb5db8-5689z_kubernetes-dashboard(ab81093c-bffe-45a6-bb1f-d68defdc028d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5689z_kubernetes-dashboard(ab81093c-bffe-45a6-bb1f-d68defdc028d)"
W0520 14:01:53.373681 2324155 logs.go:138] Found kubelet problem: May 20 13:56:46 old-k8s-version-196977 kubelet[735]: E0520 13:56:46.368219 735 pod_workers.go:191] Error syncing pod ab81093c-bffe-45a6-bb1f-d68defdc028d ("dashboard-metrics-scraper-8d5bb5db8-5689z_kubernetes-dashboard(ab81093c-bffe-45a6-bb1f-d68defdc028d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5689z_kubernetes-dashboard(ab81093c-bffe-45a6-bb1f-d68defdc028d)"
W0520 14:01:53.375749 2324155 logs.go:138] Found kubelet problem: May 20 13:56:48 old-k8s-version-196977 kubelet[735]: E0520 13:56:48.619596 735 pod_workers.go:191] Error syncing pod c8365eaa-709d-43e2-8d02-7bb97878bae7 ("metrics-server-9975d5f86-cxvzj_kube-system(c8365eaa-709d-43e2-8d02-7bb97878bae7)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = pinging container registry fake.domain: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain: no such host"
W0520 14:01:53.376345 2324155 logs.go:138] Found kubelet problem: May 20 13:56:59 old-k8s-version-196977 kubelet[735]: E0520 13:56:59.394720 735 pod_workers.go:191] Error syncing pod ab81093c-bffe-45a6-bb1f-d68defdc028d ("dashboard-metrics-scraper-8d5bb5db8-5689z_kubernetes-dashboard(ab81093c-bffe-45a6-bb1f-d68defdc028d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5689z_kubernetes-dashboard(ab81093c-bffe-45a6-bb1f-d68defdc028d)"
W0520 14:01:53.376530 2324155 logs.go:138] Found kubelet problem: May 20 13:57:01 old-k8s-version-196977 kubelet[735]: E0520 13:57:01.157773 735 pod_workers.go:191] Error syncing pod c8365eaa-709d-43e2-8d02-7bb97878bae7 ("metrics-server-9975d5f86-cxvzj_kube-system(c8365eaa-709d-43e2-8d02-7bb97878bae7)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 14:01:53.376864 2324155 logs.go:138] Found kubelet problem: May 20 13:57:04 old-k8s-version-196977 kubelet[735]: E0520 13:57:04.669530 735 pod_workers.go:191] Error syncing pod ab81093c-bffe-45a6-bb1f-d68defdc028d ("dashboard-metrics-scraper-8d5bb5db8-5689z_kubernetes-dashboard(ab81093c-bffe-45a6-bb1f-d68defdc028d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5689z_kubernetes-dashboard(ab81093c-bffe-45a6-bb1f-d68defdc028d)"
W0520 14:01:53.378931 2324155 logs.go:138] Found kubelet problem: May 20 13:57:14 old-k8s-version-196977 kubelet[735]: E0520 13:57:14.169140 735 pod_workers.go:191] Error syncing pod c8365eaa-709d-43e2-8d02-7bb97878bae7 ("metrics-server-9975d5f86-cxvzj_kube-system(c8365eaa-709d-43e2-8d02-7bb97878bae7)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = pinging container registry fake.domain: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain: no such host"
W0520 14:01:53.379526 2324155 logs.go:138] Found kubelet problem: May 20 13:57:20 old-k8s-version-196977 kubelet[735]: E0520 13:57:20.425874 735 pod_workers.go:191] Error syncing pod ab81093c-bffe-45a6-bb1f-d68defdc028d ("dashboard-metrics-scraper-8d5bb5db8-5689z_kubernetes-dashboard(ab81093c-bffe-45a6-bb1f-d68defdc028d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5689z_kubernetes-dashboard(ab81093c-bffe-45a6-bb1f-d68defdc028d)"
W0520 14:01:53.379862 2324155 logs.go:138] Found kubelet problem: May 20 13:57:24 old-k8s-version-196977 kubelet[735]: E0520 13:57:24.668675 735 pod_workers.go:191] Error syncing pod ab81093c-bffe-45a6-bb1f-d68defdc028d ("dashboard-metrics-scraper-8d5bb5db8-5689z_kubernetes-dashboard(ab81093c-bffe-45a6-bb1f-d68defdc028d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5689z_kubernetes-dashboard(ab81093c-bffe-45a6-bb1f-d68defdc028d)"
W0520 14:01:53.380049 2324155 logs.go:138] Found kubelet problem: May 20 13:57:29 old-k8s-version-196977 kubelet[735]: E0520 13:57:29.158229 735 pod_workers.go:191] Error syncing pod c8365eaa-709d-43e2-8d02-7bb97878bae7 ("metrics-server-9975d5f86-cxvzj_kube-system(c8365eaa-709d-43e2-8d02-7bb97878bae7)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 14:01:53.380399 2324155 logs.go:138] Found kubelet problem: May 20 13:57:38 old-k8s-version-196977 kubelet[735]: E0520 13:57:38.156983 735 pod_workers.go:191] Error syncing pod ab81093c-bffe-45a6-bb1f-d68defdc028d ("dashboard-metrics-scraper-8d5bb5db8-5689z_kubernetes-dashboard(ab81093c-bffe-45a6-bb1f-d68defdc028d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5689z_kubernetes-dashboard(ab81093c-bffe-45a6-bb1f-d68defdc028d)"
W0520 14:01:53.380586 2324155 logs.go:138] Found kubelet problem: May 20 13:57:42 old-k8s-version-196977 kubelet[735]: E0520 13:57:42.159077 735 pod_workers.go:191] Error syncing pod c8365eaa-709d-43e2-8d02-7bb97878bae7 ("metrics-server-9975d5f86-cxvzj_kube-system(c8365eaa-709d-43e2-8d02-7bb97878bae7)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 14:01:53.381108 2324155 logs.go:138] Found kubelet problem: May 20 13:57:53 old-k8s-version-196977 kubelet[735]: E0520 13:57:53.157024 735 pod_workers.go:191] Error syncing pod ab81093c-bffe-45a6-bb1f-d68defdc028d ("dashboard-metrics-scraper-8d5bb5db8-5689z_kubernetes-dashboard(ab81093c-bffe-45a6-bb1f-d68defdc028d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5689z_kubernetes-dashboard(ab81093c-bffe-45a6-bb1f-d68defdc028d)"
W0520 14:01:53.383217 2324155 logs.go:138] Found kubelet problem: May 20 13:57:55 old-k8s-version-196977 kubelet[735]: E0520 13:57:55.167292 735 pod_workers.go:191] Error syncing pod c8365eaa-709d-43e2-8d02-7bb97878bae7 ("metrics-server-9975d5f86-cxvzj_kube-system(c8365eaa-709d-43e2-8d02-7bb97878bae7)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = pinging container registry fake.domain: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain: no such host"
W0520 14:01:53.383406 2324155 logs.go:138] Found kubelet problem: May 20 13:58:06 old-k8s-version-196977 kubelet[735]: E0520 13:58:06.158207 735 pod_workers.go:191] Error syncing pod c8365eaa-709d-43e2-8d02-7bb97878bae7 ("metrics-server-9975d5f86-cxvzj_kube-system(c8365eaa-709d-43e2-8d02-7bb97878bae7)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 14:01:53.384011 2324155 logs.go:138] Found kubelet problem: May 20 13:58:07 old-k8s-version-196977 kubelet[735]: E0520 13:58:07.486766 735 pod_workers.go:191] Error syncing pod ab81093c-bffe-45a6-bb1f-d68defdc028d ("dashboard-metrics-scraper-8d5bb5db8-5689z_kubernetes-dashboard(ab81093c-bffe-45a6-bb1f-d68defdc028d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5689z_kubernetes-dashboard(ab81093c-bffe-45a6-bb1f-d68defdc028d)"
W0520 14:01:53.384343 2324155 logs.go:138] Found kubelet problem: May 20 13:58:14 old-k8s-version-196977 kubelet[735]: E0520 13:58:14.668747 735 pod_workers.go:191] Error syncing pod ab81093c-bffe-45a6-bb1f-d68defdc028d ("dashboard-metrics-scraper-8d5bb5db8-5689z_kubernetes-dashboard(ab81093c-bffe-45a6-bb1f-d68defdc028d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5689z_kubernetes-dashboard(ab81093c-bffe-45a6-bb1f-d68defdc028d)"
W0520 14:01:53.384531 2324155 logs.go:138] Found kubelet problem: May 20 13:58:19 old-k8s-version-196977 kubelet[735]: E0520 13:58:19.158242 735 pod_workers.go:191] Error syncing pod c8365eaa-709d-43e2-8d02-7bb97878bae7 ("metrics-server-9975d5f86-cxvzj_kube-system(c8365eaa-709d-43e2-8d02-7bb97878bae7)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 14:01:53.384860 2324155 logs.go:138] Found kubelet problem: May 20 13:58:28 old-k8s-version-196977 kubelet[735]: E0520 13:58:28.156931 735 pod_workers.go:191] Error syncing pod ab81093c-bffe-45a6-bb1f-d68defdc028d ("dashboard-metrics-scraper-8d5bb5db8-5689z_kubernetes-dashboard(ab81093c-bffe-45a6-bb1f-d68defdc028d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5689z_kubernetes-dashboard(ab81093c-bffe-45a6-bb1f-d68defdc028d)"
W0520 14:01:53.385047 2324155 logs.go:138] Found kubelet problem: May 20 13:58:30 old-k8s-version-196977 kubelet[735]: E0520 13:58:30.157866 735 pod_workers.go:191] Error syncing pod c8365eaa-709d-43e2-8d02-7bb97878bae7 ("metrics-server-9975d5f86-cxvzj_kube-system(c8365eaa-709d-43e2-8d02-7bb97878bae7)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 14:01:53.385376 2324155 logs.go:138] Found kubelet problem: May 20 13:58:41 old-k8s-version-196977 kubelet[735]: E0520 13:58:41.156994 735 pod_workers.go:191] Error syncing pod ab81093c-bffe-45a6-bb1f-d68defdc028d ("dashboard-metrics-scraper-8d5bb5db8-5689z_kubernetes-dashboard(ab81093c-bffe-45a6-bb1f-d68defdc028d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5689z_kubernetes-dashboard(ab81093c-bffe-45a6-bb1f-d68defdc028d)"
W0520 14:01:53.385564 2324155 logs.go:138] Found kubelet problem: May 20 13:58:44 old-k8s-version-196977 kubelet[735]: E0520 13:58:44.157439 735 pod_workers.go:191] Error syncing pod c8365eaa-709d-43e2-8d02-7bb97878bae7 ("metrics-server-9975d5f86-cxvzj_kube-system(c8365eaa-709d-43e2-8d02-7bb97878bae7)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 14:01:53.385886 2324155 logs.go:138] Found kubelet problem: May 20 13:58:56 old-k8s-version-196977 kubelet[735]: E0520 13:58:56.158086 735 pod_workers.go:191] Error syncing pod c8365eaa-709d-43e2-8d02-7bb97878bae7 ("metrics-server-9975d5f86-cxvzj_kube-system(c8365eaa-709d-43e2-8d02-7bb97878bae7)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 14:01:53.386088 2324155 logs.go:138] Found kubelet problem: May 20 13:58:56 old-k8s-version-196977 kubelet[735]: E0520 13:58:56.158153 735 pod_workers.go:191] Error syncing pod ab81093c-bffe-45a6-bb1f-d68defdc028d ("dashboard-metrics-scraper-8d5bb5db8-5689z_kubernetes-dashboard(ab81093c-bffe-45a6-bb1f-d68defdc028d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5689z_kubernetes-dashboard(ab81093c-bffe-45a6-bb1f-d68defdc028d)"
W0520 14:01:53.386947 2324155 logs.go:138] Found kubelet problem: May 20 13:59:08 old-k8s-version-196977 kubelet[735]: E0520 13:59:08.156835 735 pod_workers.go:191] Error syncing pod ab81093c-bffe-45a6-bb1f-d68defdc028d ("dashboard-metrics-scraper-8d5bb5db8-5689z_kubernetes-dashboard(ab81093c-bffe-45a6-bb1f-d68defdc028d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5689z_kubernetes-dashboard(ab81093c-bffe-45a6-bb1f-d68defdc028d)"
W0520 14:01:53.387132 2324155 logs.go:138] Found kubelet problem: May 20 13:59:10 old-k8s-version-196977 kubelet[735]: E0520 13:59:10.157811 735 pod_workers.go:191] Error syncing pod c8365eaa-709d-43e2-8d02-7bb97878bae7 ("metrics-server-9975d5f86-cxvzj_kube-system(c8365eaa-709d-43e2-8d02-7bb97878bae7)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 14:01:53.387466 2324155 logs.go:138] Found kubelet problem: May 20 13:59:19 old-k8s-version-196977 kubelet[735]: E0520 13:59:19.158201 735 pod_workers.go:191] Error syncing pod ab81093c-bffe-45a6-bb1f-d68defdc028d ("dashboard-metrics-scraper-8d5bb5db8-5689z_kubernetes-dashboard(ab81093c-bffe-45a6-bb1f-d68defdc028d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5689z_kubernetes-dashboard(ab81093c-bffe-45a6-bb1f-d68defdc028d)"
W0520 14:01:53.389531 2324155 logs.go:138] Found kubelet problem: May 20 13:59:24 old-k8s-version-196977 kubelet[735]: E0520 13:59:24.165546 735 pod_workers.go:191] Error syncing pod c8365eaa-709d-43e2-8d02-7bb97878bae7 ("metrics-server-9975d5f86-cxvzj_kube-system(c8365eaa-709d-43e2-8d02-7bb97878bae7)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = pinging container registry fake.domain: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain: no such host"
W0520 14:01:53.390128 2324155 logs.go:138] Found kubelet problem: May 20 13:59:32 old-k8s-version-196977 kubelet[735]: E0520 13:59:32.607875 735 pod_workers.go:191] Error syncing pod ab81093c-bffe-45a6-bb1f-d68defdc028d ("dashboard-metrics-scraper-8d5bb5db8-5689z_kubernetes-dashboard(ab81093c-bffe-45a6-bb1f-d68defdc028d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5689z_kubernetes-dashboard(ab81093c-bffe-45a6-bb1f-d68defdc028d)"
W0520 14:01:53.390464 2324155 logs.go:138] Found kubelet problem: May 20 13:59:34 old-k8s-version-196977 kubelet[735]: E0520 13:59:34.668730 735 pod_workers.go:191] Error syncing pod ab81093c-bffe-45a6-bb1f-d68defdc028d ("dashboard-metrics-scraper-8d5bb5db8-5689z_kubernetes-dashboard(ab81093c-bffe-45a6-bb1f-d68defdc028d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5689z_kubernetes-dashboard(ab81093c-bffe-45a6-bb1f-d68defdc028d)"
W0520 14:01:53.390650 2324155 logs.go:138] Found kubelet problem: May 20 13:59:38 old-k8s-version-196977 kubelet[735]: E0520 13:59:38.157403 735 pod_workers.go:191] Error syncing pod c8365eaa-709d-43e2-8d02-7bb97878bae7 ("metrics-server-9975d5f86-cxvzj_kube-system(c8365eaa-709d-43e2-8d02-7bb97878bae7)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 14:01:53.390981 2324155 logs.go:138] Found kubelet problem: May 20 13:59:48 old-k8s-version-196977 kubelet[735]: E0520 13:59:48.156994 735 pod_workers.go:191] Error syncing pod ab81093c-bffe-45a6-bb1f-d68defdc028d ("dashboard-metrics-scraper-8d5bb5db8-5689z_kubernetes-dashboard(ab81093c-bffe-45a6-bb1f-d68defdc028d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5689z_kubernetes-dashboard(ab81093c-bffe-45a6-bb1f-d68defdc028d)"
W0520 14:01:53.391165 2324155 logs.go:138] Found kubelet problem: May 20 13:59:49 old-k8s-version-196977 kubelet[735]: E0520 13:59:49.162211 735 pod_workers.go:191] Error syncing pod c8365eaa-709d-43e2-8d02-7bb97878bae7 ("metrics-server-9975d5f86-cxvzj_kube-system(c8365eaa-709d-43e2-8d02-7bb97878bae7)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 14:01:53.391496 2324155 logs.go:138] Found kubelet problem: May 20 14:00:00 old-k8s-version-196977 kubelet[735]: E0520 14:00:00.159051 735 pod_workers.go:191] Error syncing pod ab81093c-bffe-45a6-bb1f-d68defdc028d ("dashboard-metrics-scraper-8d5bb5db8-5689z_kubernetes-dashboard(ab81093c-bffe-45a6-bb1f-d68defdc028d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5689z_kubernetes-dashboard(ab81093c-bffe-45a6-bb1f-d68defdc028d)"
W0520 14:01:53.391683 2324155 logs.go:138] Found kubelet problem: May 20 14:00:03 old-k8s-version-196977 kubelet[735]: E0520 14:00:03.157867 735 pod_workers.go:191] Error syncing pod c8365eaa-709d-43e2-8d02-7bb97878bae7 ("metrics-server-9975d5f86-cxvzj_kube-system(c8365eaa-709d-43e2-8d02-7bb97878bae7)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 14:01:53.392535 2324155 logs.go:138] Found kubelet problem: May 20 14:00:11 old-k8s-version-196977 kubelet[735]: E0520 14:00:11.156991 735 pod_workers.go:191] Error syncing pod ab81093c-bffe-45a6-bb1f-d68defdc028d ("dashboard-metrics-scraper-8d5bb5db8-5689z_kubernetes-dashboard(ab81093c-bffe-45a6-bb1f-d68defdc028d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5689z_kubernetes-dashboard(ab81093c-bffe-45a6-bb1f-d68defdc028d)"
W0520 14:01:53.392721 2324155 logs.go:138] Found kubelet problem: May 20 14:00:16 old-k8s-version-196977 kubelet[735]: E0520 14:00:16.157437 735 pod_workers.go:191] Error syncing pod c8365eaa-709d-43e2-8d02-7bb97878bae7 ("metrics-server-9975d5f86-cxvzj_kube-system(c8365eaa-709d-43e2-8d02-7bb97878bae7)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 14:01:53.393054 2324155 logs.go:138] Found kubelet problem: May 20 14:00:23 old-k8s-version-196977 kubelet[735]: E0520 14:00:23.156963 735 pod_workers.go:191] Error syncing pod ab81093c-bffe-45a6-bb1f-d68defdc028d ("dashboard-metrics-scraper-8d5bb5db8-5689z_kubernetes-dashboard(ab81093c-bffe-45a6-bb1f-d68defdc028d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5689z_kubernetes-dashboard(ab81093c-bffe-45a6-bb1f-d68defdc028d)"
W0520 14:01:53.393240 2324155 logs.go:138] Found kubelet problem: May 20 14:00:28 old-k8s-version-196977 kubelet[735]: E0520 14:00:28.157555 735 pod_workers.go:191] Error syncing pod c8365eaa-709d-43e2-8d02-7bb97878bae7 ("metrics-server-9975d5f86-cxvzj_kube-system(c8365eaa-709d-43e2-8d02-7bb97878bae7)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 14:01:53.393573 2324155 logs.go:138] Found kubelet problem: May 20 14:00:37 old-k8s-version-196977 kubelet[735]: E0520 14:00:37.157011 735 pod_workers.go:191] Error syncing pod ab81093c-bffe-45a6-bb1f-d68defdc028d ("dashboard-metrics-scraper-8d5bb5db8-5689z_kubernetes-dashboard(ab81093c-bffe-45a6-bb1f-d68defdc028d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5689z_kubernetes-dashboard(ab81093c-bffe-45a6-bb1f-d68defdc028d)"
W0520 14:01:53.393804 2324155 logs.go:138] Found kubelet problem: May 20 14:00:42 old-k8s-version-196977 kubelet[735]: E0520 14:00:42.157800 735 pod_workers.go:191] Error syncing pod c8365eaa-709d-43e2-8d02-7bb97878bae7 ("metrics-server-9975d5f86-cxvzj_kube-system(c8365eaa-709d-43e2-8d02-7bb97878bae7)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 14:01:53.394139 2324155 logs.go:138] Found kubelet problem: May 20 14:00:52 old-k8s-version-196977 kubelet[735]: E0520 14:00:52.156937 735 pod_workers.go:191] Error syncing pod ab81093c-bffe-45a6-bb1f-d68defdc028d ("dashboard-metrics-scraper-8d5bb5db8-5689z_kubernetes-dashboard(ab81093c-bffe-45a6-bb1f-d68defdc028d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5689z_kubernetes-dashboard(ab81093c-bffe-45a6-bb1f-d68defdc028d)"
W0520 14:01:53.394326 2324155 logs.go:138] Found kubelet problem: May 20 14:00:54 old-k8s-version-196977 kubelet[735]: E0520 14:00:54.157689 735 pod_workers.go:191] Error syncing pod c8365eaa-709d-43e2-8d02-7bb97878bae7 ("metrics-server-9975d5f86-cxvzj_kube-system(c8365eaa-709d-43e2-8d02-7bb97878bae7)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 14:01:53.394665 2324155 logs.go:138] Found kubelet problem: May 20 14:01:03 old-k8s-version-196977 kubelet[735]: E0520 14:01:03.157044 735 pod_workers.go:191] Error syncing pod ab81093c-bffe-45a6-bb1f-d68defdc028d ("dashboard-metrics-scraper-8d5bb5db8-5689z_kubernetes-dashboard(ab81093c-bffe-45a6-bb1f-d68defdc028d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5689z_kubernetes-dashboard(ab81093c-bffe-45a6-bb1f-d68defdc028d)"
W0520 14:01:53.395105 2324155 logs.go:138] Found kubelet problem: May 20 14:01:05 old-k8s-version-196977 kubelet[735]: E0520 14:01:05.157906 735 pod_workers.go:191] Error syncing pod c8365eaa-709d-43e2-8d02-7bb97878bae7 ("metrics-server-9975d5f86-cxvzj_kube-system(c8365eaa-709d-43e2-8d02-7bb97878bae7)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 14:01:53.395434 2324155 logs.go:138] Found kubelet problem: May 20 14:01:14 old-k8s-version-196977 kubelet[735]: E0520 14:01:14.157027 735 pod_workers.go:191] Error syncing pod ab81093c-bffe-45a6-bb1f-d68defdc028d ("dashboard-metrics-scraper-8d5bb5db8-5689z_kubernetes-dashboard(ab81093c-bffe-45a6-bb1f-d68defdc028d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5689z_kubernetes-dashboard(ab81093c-bffe-45a6-bb1f-d68defdc028d)"
W0520 14:01:53.395626 2324155 logs.go:138] Found kubelet problem: May 20 14:01:20 old-k8s-version-196977 kubelet[735]: E0520 14:01:20.157731 735 pod_workers.go:191] Error syncing pod c8365eaa-709d-43e2-8d02-7bb97878bae7 ("metrics-server-9975d5f86-cxvzj_kube-system(c8365eaa-709d-43e2-8d02-7bb97878bae7)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 14:01:53.395960 2324155 logs.go:138] Found kubelet problem: May 20 14:01:28 old-k8s-version-196977 kubelet[735]: E0520 14:01:28.156964 735 pod_workers.go:191] Error syncing pod ab81093c-bffe-45a6-bb1f-d68defdc028d ("dashboard-metrics-scraper-8d5bb5db8-5689z_kubernetes-dashboard(ab81093c-bffe-45a6-bb1f-d68defdc028d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5689z_kubernetes-dashboard(ab81093c-bffe-45a6-bb1f-d68defdc028d)"
W0520 14:01:53.396147 2324155 logs.go:138] Found kubelet problem: May 20 14:01:33 old-k8s-version-196977 kubelet[735]: E0520 14:01:33.157618 735 pod_workers.go:191] Error syncing pod c8365eaa-709d-43e2-8d02-7bb97878bae7 ("metrics-server-9975d5f86-cxvzj_kube-system(c8365eaa-709d-43e2-8d02-7bb97878bae7)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 14:01:53.396476 2324155 logs.go:138] Found kubelet problem: May 20 14:01:40 old-k8s-version-196977 kubelet[735]: E0520 14:01:40.157785 735 pod_workers.go:191] Error syncing pod ab81093c-bffe-45a6-bb1f-d68defdc028d ("dashboard-metrics-scraper-8d5bb5db8-5689z_kubernetes-dashboard(ab81093c-bffe-45a6-bb1f-d68defdc028d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5689z_kubernetes-dashboard(ab81093c-bffe-45a6-bb1f-d68defdc028d)"
W0520 14:01:53.396662 2324155 logs.go:138] Found kubelet problem: May 20 14:01:46 old-k8s-version-196977 kubelet[735]: E0520 14:01:46.157493 735 pod_workers.go:191] Error syncing pod c8365eaa-709d-43e2-8d02-7bb97878bae7 ("metrics-server-9975d5f86-cxvzj_kube-system(c8365eaa-709d-43e2-8d02-7bb97878bae7)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 14:01:53.396991 2324155 logs.go:138] Found kubelet problem: May 20 14:01:52 old-k8s-version-196977 kubelet[735]: E0520 14:01:52.157520 735 pod_workers.go:191] Error syncing pod ab81093c-bffe-45a6-bb1f-d68defdc028d ("dashboard-metrics-scraper-8d5bb5db8-5689z_kubernetes-dashboard(ab81093c-bffe-45a6-bb1f-d68defdc028d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5689z_kubernetes-dashboard(ab81093c-bffe-45a6-bb1f-d68defdc028d)"
I0520 14:01:53.397001 2324155 logs.go:123] Gathering logs for describe nodes ...
I0520 14:01:53.397015 2324155 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0520 14:01:53.541610 2324155 logs.go:123] Gathering logs for kubernetes-dashboard [a5779cc8510e582479bdedeecea9ca5a0471306b7bf72588b0563dcb1a60a030] ...
I0520 14:01:53.541813 2324155 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 a5779cc8510e582479bdedeecea9ca5a0471306b7bf72588b0563dcb1a60a030"
I0520 14:01:53.598523 2324155 logs.go:123] Gathering logs for container status ...
I0520 14:01:53.598552 2324155 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0520 14:01:53.645713 2324155 logs.go:123] Gathering logs for dmesg ...
I0520 14:01:53.645745 2324155 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0520 14:01:53.666646 2324155 logs.go:123] Gathering logs for kube-proxy [577e4eac4cee4596652e1e0a4aa1aab157007dd6015d77ef54ce41d332d17660] ...
I0520 14:01:53.666676 2324155 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 577e4eac4cee4596652e1e0a4aa1aab157007dd6015d77ef54ce41d332d17660"
I0520 14:01:53.708323 2324155 logs.go:123] Gathering logs for storage-provisioner [c6481d58189faf4b67ee0efb1177763e086618f853c876070abc9fb1a4dc75cd] ...
I0520 14:01:53.708349 2324155 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 c6481d58189faf4b67ee0efb1177763e086618f853c876070abc9fb1a4dc75cd"
I0520 14:01:53.748664 2324155 logs.go:123] Gathering logs for kube-apiserver [21f02b40f812f73866c7240ca4f394dd16d29cf18f0bd90fe73f0f88278d7c3c] ...
I0520 14:01:53.748691 2324155 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 21f02b40f812f73866c7240ca4f394dd16d29cf18f0bd90fe73f0f88278d7c3c"
I0520 14:01:53.837496 2324155 logs.go:123] Gathering logs for kube-scheduler [b2bf99df779efc3459ff13a39979c379186fd56c60c69dc26b9297b16d4c1a3e] ...
I0520 14:01:53.837536 2324155 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 b2bf99df779efc3459ff13a39979c379186fd56c60c69dc26b9297b16d4c1a3e"
I0520 14:01:53.885111 2324155 logs.go:123] Gathering logs for coredns [758b608b9e8e08eed64aeb045062ae7d4a5a33e5295c6519a33c1a800cb38dd9] ...
I0520 14:01:53.885144 2324155 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 758b608b9e8e08eed64aeb045062ae7d4a5a33e5295c6519a33c1a800cb38dd9"
I0520 14:01:53.929107 2324155 logs.go:123] Gathering logs for CRI-O ...
I0520 14:01:53.929137 2324155 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I0520 14:01:54.019365 2324155 out.go:304] Setting ErrFile to fd 2...
I0520 14:01:54.019407 2324155 out.go:338] TERM=,COLORTERM=, which probably does not support color
W0520 14:01:54.019482 2324155 out.go:239] X Problems detected in kubelet:
X Problems detected in kubelet:
W0520 14:01:54.019501 2324155 out.go:239] May 20 14:01:28 old-k8s-version-196977 kubelet[735]: E0520 14:01:28.156964 735 pod_workers.go:191] Error syncing pod ab81093c-bffe-45a6-bb1f-d68defdc028d ("dashboard-metrics-scraper-8d5bb5db8-5689z_kubernetes-dashboard(ab81093c-bffe-45a6-bb1f-d68defdc028d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5689z_kubernetes-dashboard(ab81093c-bffe-45a6-bb1f-d68defdc028d)"
May 20 14:01:28 old-k8s-version-196977 kubelet[735]: E0520 14:01:28.156964 735 pod_workers.go:191] Error syncing pod ab81093c-bffe-45a6-bb1f-d68defdc028d ("dashboard-metrics-scraper-8d5bb5db8-5689z_kubernetes-dashboard(ab81093c-bffe-45a6-bb1f-d68defdc028d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5689z_kubernetes-dashboard(ab81093c-bffe-45a6-bb1f-d68defdc028d)"
W0520 14:01:54.019517 2324155 out.go:239] May 20 14:01:33 old-k8s-version-196977 kubelet[735]: E0520 14:01:33.157618 735 pod_workers.go:191] Error syncing pod c8365eaa-709d-43e2-8d02-7bb97878bae7 ("metrics-server-9975d5f86-cxvzj_kube-system(c8365eaa-709d-43e2-8d02-7bb97878bae7)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
May 20 14:01:33 old-k8s-version-196977 kubelet[735]: E0520 14:01:33.157618 735 pod_workers.go:191] Error syncing pod c8365eaa-709d-43e2-8d02-7bb97878bae7 ("metrics-server-9975d5f86-cxvzj_kube-system(c8365eaa-709d-43e2-8d02-7bb97878bae7)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 14:01:54.019531 2324155 out.go:239] May 20 14:01:40 old-k8s-version-196977 kubelet[735]: E0520 14:01:40.157785 735 pod_workers.go:191] Error syncing pod ab81093c-bffe-45a6-bb1f-d68defdc028d ("dashboard-metrics-scraper-8d5bb5db8-5689z_kubernetes-dashboard(ab81093c-bffe-45a6-bb1f-d68defdc028d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5689z_kubernetes-dashboard(ab81093c-bffe-45a6-bb1f-d68defdc028d)"
May 20 14:01:40 old-k8s-version-196977 kubelet[735]: E0520 14:01:40.157785 735 pod_workers.go:191] Error syncing pod ab81093c-bffe-45a6-bb1f-d68defdc028d ("dashboard-metrics-scraper-8d5bb5db8-5689z_kubernetes-dashboard(ab81093c-bffe-45a6-bb1f-d68defdc028d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5689z_kubernetes-dashboard(ab81093c-bffe-45a6-bb1f-d68defdc028d)"
W0520 14:01:54.019543 2324155 out.go:239] May 20 14:01:46 old-k8s-version-196977 kubelet[735]: E0520 14:01:46.157493 735 pod_workers.go:191] Error syncing pod c8365eaa-709d-43e2-8d02-7bb97878bae7 ("metrics-server-9975d5f86-cxvzj_kube-system(c8365eaa-709d-43e2-8d02-7bb97878bae7)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
May 20 14:01:46 old-k8s-version-196977 kubelet[735]: E0520 14:01:46.157493 735 pod_workers.go:191] Error syncing pod c8365eaa-709d-43e2-8d02-7bb97878bae7 ("metrics-server-9975d5f86-cxvzj_kube-system(c8365eaa-709d-43e2-8d02-7bb97878bae7)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0520 14:01:54.019550 2324155 out.go:239] May 20 14:01:52 old-k8s-version-196977 kubelet[735]: E0520 14:01:52.157520 735 pod_workers.go:191] Error syncing pod ab81093c-bffe-45a6-bb1f-d68defdc028d ("dashboard-metrics-scraper-8d5bb5db8-5689z_kubernetes-dashboard(ab81093c-bffe-45a6-bb1f-d68defdc028d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5689z_kubernetes-dashboard(ab81093c-bffe-45a6-bb1f-d68defdc028d)"
May 20 14:01:52 old-k8s-version-196977 kubelet[735]: E0520 14:01:52.157520 735 pod_workers.go:191] Error syncing pod ab81093c-bffe-45a6-bb1f-d68defdc028d ("dashboard-metrics-scraper-8d5bb5db8-5689z_kubernetes-dashboard(ab81093c-bffe-45a6-bb1f-d68defdc028d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5689z_kubernetes-dashboard(ab81093c-bffe-45a6-bb1f-d68defdc028d)"
I0520 14:01:54.019560 2324155 out.go:304] Setting ErrFile to fd 2...
I0520 14:01:54.019570 2324155 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0520 14:02:04.020340 2324155 api_server.go:253] Checking apiserver healthz at https://192.168.76.2:8443/healthz ...
I0520 14:02:04.032540 2324155 api_server.go:279] https://192.168.76.2:8443/healthz returned 200:
ok
I0520 14:02:04.037782 2324155 out.go:177]
W0520 14:02:04.039777 2324155 out.go:239] X Exiting due to K8S_UNHEALTHY_CONTROL_PLANE: wait 6m0s for node: wait for healthy API server: controlPlane never updated to v1.20.0
X Exiting due to K8S_UNHEALTHY_CONTROL_PLANE: wait 6m0s for node: wait for healthy API server: controlPlane never updated to v1.20.0
W0520 14:02:04.039818 2324155 out.go:239] * Suggestion: Control Plane could not update, try minikube delete --all --purge
* Suggestion: Control Plane could not update, try minikube delete --all --purge
W0520 14:02:04.039837 2324155 out.go:239] * Related issue: https://github.com/kubernetes/minikube/issues/11417
* Related issue: https://github.com/kubernetes/minikube/issues/11417
W0520 14:02:04.039844 2324155 out.go:239] *
*
W0520 14:02:04.040713 2324155 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0520 14:02:04.043549 2324155 out.go:177]
** /stderr **
start_stop_delete_test.go:259: failed to start minikube post-stop. args "out/minikube-linux-arm64 start -p old-k8s-version-196977 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --container-runtime=crio --kubernetes-version=v1.20.0": exit status 102
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:230: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/SecondStart]: docker inspect <======
helpers_test.go:231: (dbg) Run: docker inspect old-k8s-version-196977
helpers_test.go:235: (dbg) docker inspect old-k8s-version-196977:
-- stdout --
[
{
"Id": "37060f4867782612657eb50778f8f5effe655164d79c2ef9257ca077c3219353",
"Created": "2024-05-20T13:53:00.99000388Z",
"Path": "/usr/local/bin/entrypoint",
"Args": [
"/sbin/init"
],
"State": {
"Status": "running",
"Running": true,
"Paused": false,
"Restarting": false,
"OOMKilled": false,
"Dead": false,
"Pid": 2324370,
"ExitCode": 0,
"Error": "",
"StartedAt": "2024-05-20T13:55:48.606312918Z",
"FinishedAt": "2024-05-20T13:55:47.031918481Z"
},
"Image": "sha256:56620e18f2c2c9a0448fc43c42f840334bd2baea497ff8deae66477dd0dbfecf",
"ResolvConfPath": "/var/lib/docker/containers/37060f4867782612657eb50778f8f5effe655164d79c2ef9257ca077c3219353/resolv.conf",
"HostnamePath": "/var/lib/docker/containers/37060f4867782612657eb50778f8f5effe655164d79c2ef9257ca077c3219353/hostname",
"HostsPath": "/var/lib/docker/containers/37060f4867782612657eb50778f8f5effe655164d79c2ef9257ca077c3219353/hosts",
"LogPath": "/var/lib/docker/containers/37060f4867782612657eb50778f8f5effe655164d79c2ef9257ca077c3219353/37060f4867782612657eb50778f8f5effe655164d79c2ef9257ca077c3219353-json.log",
"Name": "/old-k8s-version-196977",
"RestartCount": 0,
"Driver": "overlay2",
"Platform": "linux",
"MountLabel": "",
"ProcessLabel": "",
"AppArmorProfile": "unconfined",
"ExecIDs": null,
"HostConfig": {
"Binds": [
"/lib/modules:/lib/modules:ro",
"old-k8s-version-196977:/var"
],
"ContainerIDFile": "",
"LogConfig": {
"Type": "json-file",
"Config": {}
},
"NetworkMode": "old-k8s-version-196977",
"PortBindings": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
]
},
"RestartPolicy": {
"Name": "no",
"MaximumRetryCount": 0
},
"AutoRemove": false,
"VolumeDriver": "",
"VolumesFrom": null,
"ConsoleSize": [
0,
0
],
"CapAdd": null,
"CapDrop": null,
"CgroupnsMode": "host",
"Dns": [],
"DnsOptions": [],
"DnsSearch": [],
"ExtraHosts": null,
"GroupAdd": null,
"IpcMode": "private",
"Cgroup": "",
"Links": null,
"OomScoreAdj": 0,
"PidMode": "",
"Privileged": true,
"PublishAllPorts": false,
"ReadonlyRootfs": false,
"SecurityOpt": [
"seccomp=unconfined",
"apparmor=unconfined",
"label=disable"
],
"Tmpfs": {
"/run": "",
"/tmp": ""
},
"UTSMode": "",
"UsernsMode": "",
"ShmSize": 67108864,
"Runtime": "runc",
"Isolation": "",
"CpuShares": 0,
"Memory": 2306867200,
"NanoCpus": 2000000000,
"CgroupParent": "",
"BlkioWeight": 0,
"BlkioWeightDevice": [],
"BlkioDeviceReadBps": [],
"BlkioDeviceWriteBps": [],
"BlkioDeviceReadIOps": [],
"BlkioDeviceWriteIOps": [],
"CpuPeriod": 0,
"CpuQuota": 0,
"CpuRealtimePeriod": 0,
"CpuRealtimeRuntime": 0,
"CpusetCpus": "",
"CpusetMems": "",
"Devices": [],
"DeviceCgroupRules": null,
"DeviceRequests": null,
"MemoryReservation": 0,
"MemorySwap": 4613734400,
"MemorySwappiness": null,
"OomKillDisable": false,
"PidsLimit": null,
"Ulimits": [],
"CpuCount": 0,
"CpuPercent": 0,
"IOMaximumIOps": 0,
"IOMaximumBandwidth": 0,
"MaskedPaths": null,
"ReadonlyPaths": null
},
"GraphDriver": {
"Data": {
"LowerDir": "/var/lib/docker/overlay2/0c8f996c95eb7ec809063a98eab02a185bc49767a5de7f319dd928594b3f783c-init/diff:/var/lib/docker/overlay2/09243f7216acde7041311f912f5283575bfe74881861cdca9e27a3f4c99eaf64/diff",
"MergedDir": "/var/lib/docker/overlay2/0c8f996c95eb7ec809063a98eab02a185bc49767a5de7f319dd928594b3f783c/merged",
"UpperDir": "/var/lib/docker/overlay2/0c8f996c95eb7ec809063a98eab02a185bc49767a5de7f319dd928594b3f783c/diff",
"WorkDir": "/var/lib/docker/overlay2/0c8f996c95eb7ec809063a98eab02a185bc49767a5de7f319dd928594b3f783c/work"
},
"Name": "overlay2"
},
"Mounts": [
{
"Type": "bind",
"Source": "/lib/modules",
"Destination": "/lib/modules",
"Mode": "ro",
"RW": false,
"Propagation": "rprivate"
},
{
"Type": "volume",
"Name": "old-k8s-version-196977",
"Source": "/var/lib/docker/volumes/old-k8s-version-196977/_data",
"Destination": "/var",
"Driver": "local",
"Mode": "z",
"RW": true,
"Propagation": ""
}
],
"Config": {
"Hostname": "old-k8s-version-196977",
"Domainname": "",
"User": "",
"AttachStdin": false,
"AttachStdout": false,
"AttachStderr": false,
"ExposedPorts": {
"22/tcp": {},
"2376/tcp": {},
"32443/tcp": {},
"5000/tcp": {},
"8443/tcp": {}
},
"Tty": true,
"OpenStdin": false,
"StdinOnce": false,
"Env": [
"container=docker",
"PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
],
"Cmd": null,
"Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1715707529-18887@sha256:734a2adad159415bd51b0392bc8976bd7e3e543e9165c2374d6e59bac37aed3a",
"Volumes": null,
"WorkingDir": "/",
"Entrypoint": [
"/usr/local/bin/entrypoint",
"/sbin/init"
],
"OnBuild": null,
"Labels": {
"created_by.minikube.sigs.k8s.io": "true",
"mode.minikube.sigs.k8s.io": "old-k8s-version-196977",
"name.minikube.sigs.k8s.io": "old-k8s-version-196977",
"role.minikube.sigs.k8s.io": ""
},
"StopSignal": "SIGRTMIN+3"
},
"NetworkSettings": {
"Bridge": "",
"SandboxID": "4c716e1f56bf91dad56f868456fa893de30f0c8d8b2357b645d85ad2f3d23eba",
"SandboxKey": "/var/run/docker/netns/4c716e1f56bf",
"Ports": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "41548"
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "41547"
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "41544"
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "41546"
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "41545"
}
]
},
"HairpinMode": false,
"LinkLocalIPv6Address": "",
"LinkLocalIPv6PrefixLen": 0,
"SecondaryIPAddresses": null,
"SecondaryIPv6Addresses": null,
"EndpointID": "",
"Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"IPAddress": "",
"IPPrefixLen": 0,
"IPv6Gateway": "",
"MacAddress": "",
"Networks": {
"old-k8s-version-196977": {
"IPAMConfig": {
"IPv4Address": "192.168.76.2"
},
"Links": null,
"Aliases": null,
"MacAddress": "02:42:c0:a8:4c:02",
"NetworkID": "adc24f3e0c84705a58d61d69db42c927c227c7ec6ec5013b0ef666b5f2a545ca",
"EndpointID": "f633304350f8d60d89b218e359bfc9f5f63f3063fba33b460be261e5a4e5cfab",
"Gateway": "192.168.76.1",
"IPAddress": "192.168.76.2",
"IPPrefixLen": 24,
"IPv6Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"DriverOpts": null,
"DNSNames": [
"old-k8s-version-196977",
"37060f486778"
]
}
}
}
}
]
-- /stdout --
helpers_test.go:239: (dbg) Run: out/minikube-linux-arm64 status --format={{.Host}} -p old-k8s-version-196977 -n old-k8s-version-196977
helpers_test.go:244: <<< TestStartStop/group/old-k8s-version/serial/SecondStart FAILED: start of post-mortem logs <<<
helpers_test.go:245: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/SecondStart]: minikube logs <======
helpers_test.go:247: (dbg) Run: out/minikube-linux-arm64 -p old-k8s-version-196977 logs -n 25
helpers_test.go:247: (dbg) Done: out/minikube-linux-arm64 -p old-k8s-version-196977 logs -n 25: (2.702420211s)
helpers_test.go:252: TestStartStop/group/old-k8s-version/serial/SecondStart logs:
-- stdout --
==> Audit <==
|---------|--------------------------------------------------------|--------------------------|---------|---------|---------------------|---------------------|
| Command | Args | Profile | User | Version | Start Time | End Time |
|---------|--------------------------------------------------------|--------------------------|---------|---------|---------------------|---------------------|
| delete | -p pause-070988 | pause-070988 | jenkins | v1.33.1 | 20 May 24 13:51 UTC | 20 May 24 13:51 UTC |
| start | -p cert-expiration-611836 | cert-expiration-611836 | jenkins | v1.33.1 | 20 May 24 13:51 UTC | 20 May 24 13:52 UTC |
| | --memory=2048 | | | | | |
| | --cert-expiration=3m | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=crio | | | | | |
| delete | -p force-systemd-env-833531 | force-systemd-env-833531 | jenkins | v1.33.1 | 20 May 24 13:52 UTC | 20 May 24 13:52 UTC |
| start | -p cert-options-428536 | cert-options-428536 | jenkins | v1.33.1 | 20 May 24 13:52 UTC | 20 May 24 13:52 UTC |
| | --memory=2048 | | | | | |
| | --apiserver-ips=127.0.0.1 | | | | | |
| | --apiserver-ips=192.168.15.15 | | | | | |
| | --apiserver-names=localhost | | | | | |
| | --apiserver-names=www.google.com | | | | | |
| | --apiserver-port=8555 | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=crio | | | | | |
| ssh | cert-options-428536 ssh | cert-options-428536 | jenkins | v1.33.1 | 20 May 24 13:52 UTC | 20 May 24 13:52 UTC |
| | openssl x509 -text -noout -in | | | | | |
| | /var/lib/minikube/certs/apiserver.crt | | | | | |
| ssh | -p cert-options-428536 -- sudo | cert-options-428536 | jenkins | v1.33.1 | 20 May 24 13:52 UTC | 20 May 24 13:52 UTC |
| | cat /etc/kubernetes/admin.conf | | | | | |
| delete | -p cert-options-428536 | cert-options-428536 | jenkins | v1.33.1 | 20 May 24 13:52 UTC | 20 May 24 13:52 UTC |
| start | -p old-k8s-version-196977 | old-k8s-version-196977 | jenkins | v1.33.1 | 20 May 24 13:52 UTC | 20 May 24 13:55 UTC |
| | --memory=2200 | | | | | |
| | --alsologtostderr --wait=true | | | | | |
| | --kvm-network=default | | | | | |
| | --kvm-qemu-uri=qemu:///system | | | | | |
| | --disable-driver-mounts | | | | | |
| | --keep-context=false | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=crio | | | | | |
| | --kubernetes-version=v1.20.0 | | | | | |
| start | -p cert-expiration-611836 | cert-expiration-611836 | jenkins | v1.33.1 | 20 May 24 13:55 UTC | 20 May 24 13:55 UTC |
| | --memory=2048 | | | | | |
| | --cert-expiration=8760h | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=crio | | | | | |
| addons | enable metrics-server -p old-k8s-version-196977 | old-k8s-version-196977 | jenkins | v1.33.1 | 20 May 24 13:55 UTC | 20 May 24 13:55 UTC |
| | --images=MetricsServer=registry.k8s.io/echoserver:1.4 | | | | | |
| | --registries=MetricsServer=fake.domain | | | | | |
| stop | -p old-k8s-version-196977 | old-k8s-version-196977 | jenkins | v1.33.1 | 20 May 24 13:55 UTC | 20 May 24 13:55 UTC |
| | --alsologtostderr -v=3 | | | | | |
| delete | -p cert-expiration-611836 | cert-expiration-611836 | jenkins | v1.33.1 | 20 May 24 13:55 UTC | 20 May 24 13:55 UTC |
| start | -p no-preload-121831 | no-preload-121831 | jenkins | v1.33.1 | 20 May 24 13:55 UTC | 20 May 24 13:56 UTC |
| | --memory=2200 | | | | | |
| | --alsologtostderr | | | | | |
| | --wait=true --preload=false | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=crio | | | | | |
| | --kubernetes-version=v1.30.1 | | | | | |
| addons | enable dashboard -p old-k8s-version-196977 | old-k8s-version-196977 | jenkins | v1.33.1 | 20 May 24 13:55 UTC | 20 May 24 13:55 UTC |
| | --images=MetricsScraper=registry.k8s.io/echoserver:1.4 | | | | | |
| start | -p old-k8s-version-196977 | old-k8s-version-196977 | jenkins | v1.33.1 | 20 May 24 13:55 UTC | |
| | --memory=2200 | | | | | |
| | --alsologtostderr --wait=true | | | | | |
| | --kvm-network=default | | | | | |
| | --kvm-qemu-uri=qemu:///system | | | | | |
| | --disable-driver-mounts | | | | | |
| | --keep-context=false | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=crio | | | | | |
| | --kubernetes-version=v1.20.0 | | | | | |
| addons | enable metrics-server -p no-preload-121831 | no-preload-121831 | jenkins | v1.33.1 | 20 May 24 13:56 UTC | 20 May 24 13:56 UTC |
| | --images=MetricsServer=registry.k8s.io/echoserver:1.4 | | | | | |
| | --registries=MetricsServer=fake.domain | | | | | |
| stop | -p no-preload-121831 | no-preload-121831 | jenkins | v1.33.1 | 20 May 24 13:56 UTC | 20 May 24 13:57 UTC |
| | --alsologtostderr -v=3 | | | | | |
| addons | enable dashboard -p no-preload-121831 | no-preload-121831 | jenkins | v1.33.1 | 20 May 24 13:57 UTC | 20 May 24 13:57 UTC |
| | --images=MetricsScraper=registry.k8s.io/echoserver:1.4 | | | | | |
| start | -p no-preload-121831 | no-preload-121831 | jenkins | v1.33.1 | 20 May 24 13:57 UTC | 20 May 24 14:01 UTC |
| | --memory=2200 | | | | | |
| | --alsologtostderr | | | | | |
| | --wait=true --preload=false | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=crio | | | | | |
| | --kubernetes-version=v1.30.1 | | | | | |
| image | no-preload-121831 image list | no-preload-121831 | jenkins | v1.33.1 | 20 May 24 14:01 UTC | 20 May 24 14:01 UTC |
| | --format=json | | | | | |
| pause | -p no-preload-121831 | no-preload-121831 | jenkins | v1.33.1 | 20 May 24 14:01 UTC | 20 May 24 14:01 UTC |
| | --alsologtostderr -v=1 | | | | | |
| unpause | -p no-preload-121831 | no-preload-121831 | jenkins | v1.33.1 | 20 May 24 14:01 UTC | 20 May 24 14:01 UTC |
| | --alsologtostderr -v=1 | | | | | |
| delete | -p no-preload-121831 | no-preload-121831 | jenkins | v1.33.1 | 20 May 24 14:01 UTC | 20 May 24 14:02 UTC |
| delete | -p no-preload-121831 | no-preload-121831 | jenkins | v1.33.1 | 20 May 24 14:02 UTC | 20 May 24 14:02 UTC |
| start | -p embed-certs-690365 | embed-certs-690365 | jenkins | v1.33.1 | 20 May 24 14:02 UTC | |
| | --memory=2200 | | | | | |
| | --alsologtostderr --wait=true | | | | | |
| | --embed-certs --driver=docker | | | | | |
| | --container-runtime=crio | | | | | |
| | --kubernetes-version=v1.30.1 | | | | | |
|---------|--------------------------------------------------------|--------------------------|---------|---------|---------------------|---------------------|
==> Last Start <==
Log file created at: 2024/05/20 14:02:01
Running on machine: ip-172-31-21-244
Binary: Built with gc go1.22.3 for linux/arm64
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
I0520 14:02:01.122116 2333239 out.go:291] Setting OutFile to fd 1 ...
I0520 14:02:01.122244 2333239 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0520 14:02:01.122261 2333239 out.go:304] Setting ErrFile to fd 2...
I0520 14:02:01.122266 2333239 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0520 14:02:01.122532 2333239 root.go:338] Updating PATH: /home/jenkins/minikube-integration/18932-2131433/.minikube/bin
I0520 14:02:01.122987 2333239 out.go:298] Setting JSON to false
I0520 14:02:01.124042 2333239 start.go:129] hostinfo: {"hostname":"ip-172-31-21-244","uptime":164669,"bootTime":1716049053,"procs":203,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1058-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"da8ac1fd-6236-412a-a346-95873c98230d"}
I0520 14:02:01.124123 2333239 start.go:139] virtualization:
I0520 14:02:01.126731 2333239 out.go:177] * [embed-certs-690365] minikube v1.33.1 on Ubuntu 20.04 (arm64)
I0520 14:02:01.128903 2333239 out.go:177] - MINIKUBE_LOCATION=18932
I0520 14:02:01.130558 2333239 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0520 14:02:01.129052 2333239 notify.go:220] Checking for updates...
I0520 14:02:01.134104 2333239 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/18932-2131433/kubeconfig
I0520 14:02:01.136142 2333239 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/18932-2131433/.minikube
I0520 14:02:01.138224 2333239 out.go:177] - MINIKUBE_BIN=out/minikube-linux-arm64
I0520 14:02:01.139787 2333239 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0520 14:02:01.142350 2333239 config.go:182] Loaded profile config "old-k8s-version-196977": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.20.0
I0520 14:02:01.142478 2333239 driver.go:392] Setting default libvirt URI to qemu:///system
I0520 14:02:01.187399 2333239 docker.go:122] docker version: linux-26.1.3:Docker Engine - Community
I0520 14:02:01.187534 2333239 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0520 14:02:01.268293 2333239 info.go:266] docker info: {ID:5FDH:SA5P:5GCT:NLAS:B73P:SGDQ:PBG5:UBVH:UZY3:RXGO:CI7S:WAIH Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:33 OomKillDisable:true NGoroutines:52 SystemTime:2024-05-20 14:02:01.254372546 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1058-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8215035904 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-21-244 Labels:[] ExperimentalBuild:false ServerVersion:26.1.3 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:e377cd56a71523140ca6ae87e30244719194a521 Expected:e377cd56a71523140ca6ae87e30244719194a521} RuncCommit:{ID:v1.1.12-0-g51d5e94 Expected:v1.1.12-0-g51d5e94} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.14.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.27.0]] Warnings:<nil>}}
I0520 14:02:01.268415 2333239 docker.go:295] overlay module found
I0520 14:02:01.270805 2333239 out.go:177] * Using the docker driver based on user configuration
I0520 14:02:01.272319 2333239 start.go:297] selected driver: docker
I0520 14:02:01.272343 2333239 start.go:901] validating driver "docker" against <nil>
I0520 14:02:01.272359 2333239 start.go:912] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0520 14:02:01.273045 2333239 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0520 14:02:01.330882 2333239 info.go:266] docker info: {ID:5FDH:SA5P:5GCT:NLAS:B73P:SGDQ:PBG5:UBVH:UZY3:RXGO:CI7S:WAIH Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:33 OomKillDisable:true NGoroutines:52 SystemTime:2024-05-20 14:02:01.320937546 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1058-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8215035904 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-21-244 Labels:[] ExperimentalBuild:false ServerVersion:26.1.3 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:e377cd56a71523140ca6ae87e30244719194a521 Expected:e377cd56a71523140ca6ae87e30244719194a521} RuncCommit:{ID:v1.1.12-0-g51d5e94 Expected:v1.1.12-0-g51d5e94} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.14.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.27.0]] Warnings:<nil>}}
I0520 14:02:01.331043 2333239 start_flags.go:310] no existing cluster config was found, will generate one from the flags
I0520 14:02:01.331296 2333239 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0520 14:02:01.333358 2333239 out.go:177] * Using Docker driver with root privileges
I0520 14:02:01.335233 2333239 cni.go:84] Creating CNI manager for ""
I0520 14:02:01.335263 2333239 cni.go:143] "docker" driver + "crio" runtime found, recommending kindnet
I0520 14:02:01.335276 2333239 start_flags.go:319] Found "CNI" CNI - setting NetworkPlugin=cni
I0520 14:02:01.335365 2333239 start.go:340] cluster config:
{Name:embed-certs-690365 KeepContext:false EmbedCerts:true MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1715707529-18887@sha256:734a2adad159415bd51b0392bc8976bd7e3e543e9165c2374d6e59bac37aed3a Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.1 ClusterName:embed-certs-690365 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local Contain
erRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.30.1 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuth
Sock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0520 14:02:01.337356 2333239 out.go:177] * Starting "embed-certs-690365" primary control-plane node in "embed-certs-690365" cluster
I0520 14:02:01.339310 2333239 cache.go:121] Beginning downloading kic base image for docker with crio
I0520 14:02:01.341061 2333239 out.go:177] * Pulling base image v0.0.44-1715707529-18887 ...
I0520 14:02:01.342634 2333239 preload.go:132] Checking if preload exists for k8s version v1.30.1 and runtime crio
I0520 14:02:01.342698 2333239 preload.go:147] Found local preload: /home/jenkins/minikube-integration/18932-2131433/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.1-cri-o-overlay-arm64.tar.lz4
I0520 14:02:01.342702 2333239 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1715707529-18887@sha256:734a2adad159415bd51b0392bc8976bd7e3e543e9165c2374d6e59bac37aed3a in local docker daemon
I0520 14:02:01.342711 2333239 cache.go:56] Caching tarball of preloaded images
I0520 14:02:01.342912 2333239 preload.go:173] Found /home/jenkins/minikube-integration/18932-2131433/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.1-cri-o-overlay-arm64.tar.lz4 in cache, skipping download
I0520 14:02:01.342930 2333239 cache.go:59] Finished verifying existence of preloaded tar for v1.30.1 on crio
I0520 14:02:01.343072 2333239 profile.go:143] Saving config to /home/jenkins/minikube-integration/18932-2131433/.minikube/profiles/embed-certs-690365/config.json ...
I0520 14:02:01.343103 2333239 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18932-2131433/.minikube/profiles/embed-certs-690365/config.json: {Name:mk625d1f809aa4805723d7058e76733bb817a0f5 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0520 14:02:01.358971 2333239 image.go:83] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1715707529-18887@sha256:734a2adad159415bd51b0392bc8976bd7e3e543e9165c2374d6e59bac37aed3a in local docker daemon, skipping pull
I0520 14:02:01.358996 2333239 cache.go:144] gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1715707529-18887@sha256:734a2adad159415bd51b0392bc8976bd7e3e543e9165c2374d6e59bac37aed3a exists in daemon, skipping load
I0520 14:02:01.359010 2333239 cache.go:194] Successfully downloaded all kic artifacts
I0520 14:02:01.359053 2333239 start.go:360] acquireMachinesLock for embed-certs-690365: {Name:mk64548308c9c181e50da21ab9f015569e31f580 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0520 14:02:01.359770 2333239 start.go:364] duration metric: took 680.339µs to acquireMachinesLock for "embed-certs-690365"
I0520 14:02:01.359808 2333239 start.go:93] Provisioning new machine with config: &{Name:embed-certs-690365 KeepContext:false EmbedCerts:true MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1715707529-18887@sha256:734a2adad159415bd51b0392bc8976bd7e3e543e9165c2374d6e59bac37aed3a Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.1 ClusterName:embed-certs-690365 Namespace:default APIServerHAVIP: APIServe
rName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.30.1 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false
CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.30.1 ContainerRuntime:crio ControlPlane:true Worker:true}
I0520 14:02:01.359891 2333239 start.go:125] createHost starting for "" (driver="docker")
I0520 14:02:04.020340 2324155 api_server.go:253] Checking apiserver healthz at https://192.168.76.2:8443/healthz ...
I0520 14:02:04.032540 2324155 api_server.go:279] https://192.168.76.2:8443/healthz returned 200:
ok
I0520 14:02:04.037782 2324155 out.go:177]
W0520 14:02:04.039777 2324155 out.go:239] X Exiting due to K8S_UNHEALTHY_CONTROL_PLANE: wait 6m0s for node: wait for healthy API server: controlPlane never updated to v1.20.0
W0520 14:02:04.039818 2324155 out.go:239] * Suggestion: Control Plane could not update, try minikube delete --all --purge
W0520 14:02:04.039837 2324155 out.go:239] * Related issue: https://github.com/kubernetes/minikube/issues/11417
W0520 14:02:04.039844 2324155 out.go:239] *
W0520 14:02:04.040713 2324155 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0520 14:02:04.043549 2324155 out.go:177]
==> CRI-O <==
May 20 13:59:38 old-k8s-version-196977 crio[622]: time="2024-05-20 13:59:38.157166087Z" level=info msg="Image fake.domain/registry.k8s.io/echoserver:1.4 not found" id=fe009177-7664-4580-a5b0-6a766d916a59 name=/runtime.v1alpha2.ImageService/ImageStatus
May 20 13:59:49 old-k8s-version-196977 crio[622]: time="2024-05-20 13:59:49.157040533Z" level=info msg="Checking image status: fake.domain/registry.k8s.io/echoserver:1.4" id=f3676f92-0428-4cf3-a076-526f238e8868 name=/runtime.v1alpha2.ImageService/ImageStatus
May 20 13:59:49 old-k8s-version-196977 crio[622]: time="2024-05-20 13:59:49.157274678Z" level=info msg="Image fake.domain/registry.k8s.io/echoserver:1.4 not found" id=f3676f92-0428-4cf3-a076-526f238e8868 name=/runtime.v1alpha2.ImageService/ImageStatus
May 20 14:00:03 old-k8s-version-196977 crio[622]: time="2024-05-20 14:00:03.157051693Z" level=info msg="Checking image status: fake.domain/registry.k8s.io/echoserver:1.4" id=85027a5f-52bc-40e6-bfbe-6191d5740245 name=/runtime.v1alpha2.ImageService/ImageStatus
May 20 14:00:03 old-k8s-version-196977 crio[622]: time="2024-05-20 14:00:03.157319519Z" level=info msg="Image fake.domain/registry.k8s.io/echoserver:1.4 not found" id=85027a5f-52bc-40e6-bfbe-6191d5740245 name=/runtime.v1alpha2.ImageService/ImageStatus
May 20 14:00:16 old-k8s-version-196977 crio[622]: time="2024-05-20 14:00:16.156961059Z" level=info msg="Checking image status: fake.domain/registry.k8s.io/echoserver:1.4" id=7509e4ea-b1ac-4fc4-b595-d73b3259b9ae name=/runtime.v1alpha2.ImageService/ImageStatus
May 20 14:00:16 old-k8s-version-196977 crio[622]: time="2024-05-20 14:00:16.157199142Z" level=info msg="Image fake.domain/registry.k8s.io/echoserver:1.4 not found" id=7509e4ea-b1ac-4fc4-b595-d73b3259b9ae name=/runtime.v1alpha2.ImageService/ImageStatus
May 20 14:00:28 old-k8s-version-196977 crio[622]: time="2024-05-20 14:00:28.157083522Z" level=info msg="Checking image status: fake.domain/registry.k8s.io/echoserver:1.4" id=ec5549a2-269b-4be6-aff7-6fd1b0fa73e5 name=/runtime.v1alpha2.ImageService/ImageStatus
May 20 14:00:28 old-k8s-version-196977 crio[622]: time="2024-05-20 14:00:28.157323944Z" level=info msg="Image fake.domain/registry.k8s.io/echoserver:1.4 not found" id=ec5549a2-269b-4be6-aff7-6fd1b0fa73e5 name=/runtime.v1alpha2.ImageService/ImageStatus
May 20 14:00:42 old-k8s-version-196977 crio[622]: time="2024-05-20 14:00:42.157152143Z" level=info msg="Checking image status: fake.domain/registry.k8s.io/echoserver:1.4" id=236baeeb-95a9-4bae-a81a-00720571daf6 name=/runtime.v1alpha2.ImageService/ImageStatus
May 20 14:00:42 old-k8s-version-196977 crio[622]: time="2024-05-20 14:00:42.157424687Z" level=info msg="Image fake.domain/registry.k8s.io/echoserver:1.4 not found" id=236baeeb-95a9-4bae-a81a-00720571daf6 name=/runtime.v1alpha2.ImageService/ImageStatus
May 20 14:00:54 old-k8s-version-196977 crio[622]: time="2024-05-20 14:00:54.156980030Z" level=info msg="Checking image status: fake.domain/registry.k8s.io/echoserver:1.4" id=cb8b9fe5-477f-476b-bc8d-c394db7bab66 name=/runtime.v1alpha2.ImageService/ImageStatus
May 20 14:00:54 old-k8s-version-196977 crio[622]: time="2024-05-20 14:00:54.157217367Z" level=info msg="Image fake.domain/registry.k8s.io/echoserver:1.4 not found" id=cb8b9fe5-477f-476b-bc8d-c394db7bab66 name=/runtime.v1alpha2.ImageService/ImageStatus
May 20 14:01:04 old-k8s-version-196977 crio[622]: time="2024-05-20 14:01:04.950291620Z" level=info msg="Checking image status: k8s.gcr.io/pause:3.2" id=53e20e4d-1aad-438f-b4f0-5b44904ec26e name=/runtime.v1alpha2.ImageService/ImageStatus
May 20 14:01:04 old-k8s-version-196977 crio[622]: time="2024-05-20 14:01:04.950544841Z" level=info msg="Image status: &ImageStatusResponse{Image:&Image{Id:2a060e2e7101d419352bf82c613158587400be743482d9a537ec4a9d1b4eb93c,RepoTags:[k8s.gcr.io/pause:3.2 registry.k8s.io/pause:3.2],RepoDigests:[k8s.gcr.io/pause@sha256:31d3efd12022ffeffb3146bc10ae8beb890c80ed2f07363515580add7ed47636 k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f registry.k8s.io/pause@sha256:31d3efd12022ffeffb3146bc10ae8beb890c80ed2f07363515580add7ed47636 registry.k8s.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f],Size_:489397,Uid:nil,Username:,Spec:nil,},Info:map[string]string{},}" id=53e20e4d-1aad-438f-b4f0-5b44904ec26e name=/runtime.v1alpha2.ImageService/ImageStatus
May 20 14:01:05 old-k8s-version-196977 crio[622]: time="2024-05-20 14:01:05.156848567Z" level=info msg="Checking image status: fake.domain/registry.k8s.io/echoserver:1.4" id=e96873b5-9b14-4706-9486-fdb318401756 name=/runtime.v1alpha2.ImageService/ImageStatus
May 20 14:01:05 old-k8s-version-196977 crio[622]: time="2024-05-20 14:01:05.157260956Z" level=info msg="Image fake.domain/registry.k8s.io/echoserver:1.4 not found" id=e96873b5-9b14-4706-9486-fdb318401756 name=/runtime.v1alpha2.ImageService/ImageStatus
May 20 14:01:20 old-k8s-version-196977 crio[622]: time="2024-05-20 14:01:20.157013605Z" level=info msg="Checking image status: fake.domain/registry.k8s.io/echoserver:1.4" id=6a5d92c9-9516-40ef-88be-1e4645379814 name=/runtime.v1alpha2.ImageService/ImageStatus
May 20 14:01:20 old-k8s-version-196977 crio[622]: time="2024-05-20 14:01:20.157270625Z" level=info msg="Image fake.domain/registry.k8s.io/echoserver:1.4 not found" id=6a5d92c9-9516-40ef-88be-1e4645379814 name=/runtime.v1alpha2.ImageService/ImageStatus
May 20 14:01:33 old-k8s-version-196977 crio[622]: time="2024-05-20 14:01:33.157024765Z" level=info msg="Checking image status: fake.domain/registry.k8s.io/echoserver:1.4" id=ae771e40-31a5-4dea-9585-01612e38d964 name=/runtime.v1alpha2.ImageService/ImageStatus
May 20 14:01:33 old-k8s-version-196977 crio[622]: time="2024-05-20 14:01:33.157256284Z" level=info msg="Image fake.domain/registry.k8s.io/echoserver:1.4 not found" id=ae771e40-31a5-4dea-9585-01612e38d964 name=/runtime.v1alpha2.ImageService/ImageStatus
May 20 14:01:46 old-k8s-version-196977 crio[622]: time="2024-05-20 14:01:46.156986154Z" level=info msg="Checking image status: fake.domain/registry.k8s.io/echoserver:1.4" id=b7c42b88-e948-43a6-84c5-89d16ba8964c name=/runtime.v1alpha2.ImageService/ImageStatus
May 20 14:01:46 old-k8s-version-196977 crio[622]: time="2024-05-20 14:01:46.157246120Z" level=info msg="Image fake.domain/registry.k8s.io/echoserver:1.4 not found" id=b7c42b88-e948-43a6-84c5-89d16ba8964c name=/runtime.v1alpha2.ImageService/ImageStatus
May 20 14:01:57 old-k8s-version-196977 crio[622]: time="2024-05-20 14:01:57.157224568Z" level=info msg="Checking image status: fake.domain/registry.k8s.io/echoserver:1.4" id=0f5ca7be-3c5d-4d5c-8c53-b52e65e6e0b4 name=/runtime.v1alpha2.ImageService/ImageStatus
May 20 14:01:57 old-k8s-version-196977 crio[622]: time="2024-05-20 14:01:57.157466524Z" level=info msg="Image fake.domain/registry.k8s.io/echoserver:1.4 not found" id=0f5ca7be-3c5d-4d5c-8c53-b52e65e6e0b4 name=/runtime.v1alpha2.ImageService/ImageStatus
==> container status <==
CONTAINER IMAGE CREATED STATE NAME ATTEMPT POD ID POD
755cecdafa77d a90209bb39e3d7b5fc9daf60c17044ea969aaca0333d672d8c7a34c7446e7ff7 2 minutes ago Exited dashboard-metrics-scraper 5 710025fdbd2a8 dashboard-metrics-scraper-8d5bb5db8-5689z
a5779cc8510e5 docker.io/kubernetesui/dashboard@sha256:2e500d29e9d5f4a086b908eb8dfe7ecac57d2ab09d65b24f588b1d449841ef93 5 minutes ago Running kubernetes-dashboard 0 7134569ea8e58 kubernetes-dashboard-cd95d586-79hrn
c6481d58189fa ba04bb24b95753201135cbc420b233c1b0b9fa2e1fd21d28319c348c33fbcde6 5 minutes ago Running storage-provisioner 0 f0f36079cdfb4 storage-provisioner
758b608b9e8e0 db91994f4ee8f894a1e8a6c1a76f615da8fc3c019300a3686291ce6fcbc57895 5 minutes ago Running coredns 0 82c97e1be4736 coredns-74ff55c5b-ptmbw
e8289b46f01a9 4740c1948d3fceb8d7dacc63033aa6299d80794ee4f4811539ec1081d9211f3d 5 minutes ago Running kindnet-cni 0 9713e1696e576 kindnet-j8tj2
2db445bda49f5 1611cd07b61d57dbbfebe6db242513fd51e1c02d20ba08af17a45837d86a8a8c 5 minutes ago Running busybox 0 5489a898e5a8f busybox
577e4eac4cee4 25a5233254979d0678a2db1d15b76b73dc380d81bc5eed93916ba5638b3cd894 5 minutes ago Running kube-proxy 0 887f72fe18ac3 kube-proxy-2sgl4
574ca79575df2 05b738aa1bc6355db8a2ee8639f3631b908286e43f584a3d2ee0c472de033c28 6 minutes ago Running etcd 0 94a842d1950db etcd-old-k8s-version-196977
6573124f1f00f 1df8a2b116bd16f7070fd383a6769c8d644b365575e8ffa3e492b84e4f05fc74 6 minutes ago Running kube-controller-manager 0 35f14310a1e9b kube-controller-manager-old-k8s-version-196977
21f02b40f812f 2c08bbbc02d3aa5dfbf4e79f15c0a61424049288917aa10364464ca1f7de7157 6 minutes ago Running kube-apiserver 0 33f6cebcbc13a kube-apiserver-old-k8s-version-196977
b2bf99df779ef e7605f88f17d6a4c3f083ef9c6f5f19b39f87e4d4406a05a8612b54a6ea57051 6 minutes ago Running kube-scheduler 0 35879ba6e5ea3 kube-scheduler-old-k8s-version-196977
==> coredns [758b608b9e8e08eed64aeb045062ae7d4a5a33e5295c6519a33c1a800cb38dd9] <==
.:53
[INFO] plugin/reload: Running configuration MD5 = b494d968e357ba1b925cee838fbd78ed
CoreDNS-1.7.0
linux/arm64, go1.14.4, f59c03d
[INFO] 127.0.0.1:38140 - 52403 "HINFO IN 3449110619632988581.4282706251078052320. udp 57 false 512" NXDOMAIN qr,rd,ra 57 0.030170182s
[INFO] SIGTERM: Shutting down servers then terminating
[INFO] plugin/health: Going into lameduck mode for 5s
.:53
[INFO] plugin/reload: Running configuration MD5 = b494d968e357ba1b925cee838fbd78ed
CoreDNS-1.7.0
linux/arm64, go1.14.4, f59c03d
[INFO] 127.0.0.1:46711 - 37538 "HINFO IN 4912076484811217565.8161074593680838594. udp 57 false 512" NXDOMAIN qr,rd,ra 57 0.032713115s
[INFO] plugin/ready: Still waiting on: "kubernetes"
[INFO] plugin/ready: Still waiting on: "kubernetes"
[INFO] plugin/ready: Still waiting on: "kubernetes"
I0520 13:56:51.351790 1 trace.go:116] Trace[2019727887]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125 (started: 2024-05-20 13:56:21.351157895 +0000 UTC m=+0.098230274) (total time: 30.000517195s):
Trace[2019727887]: [30.000517195s] [30.000517195s] END
E0520 13:56:51.351821 1 reflector.go:178] pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125: Failed to list *v1.Service: Get "https://10.96.0.1:443/api/v1/services?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout
I0520 13:56:51.351915 1 trace.go:116] Trace[939984059]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125 (started: 2024-05-20 13:56:21.351577431 +0000 UTC m=+0.098649958) (total time: 30.000327914s):
Trace[939984059]: [30.000327914s] [30.000327914s] END
E0520 13:56:51.351926 1 reflector.go:178] pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125: Failed to list *v1.Endpoints: Get "https://10.96.0.1:443/api/v1/endpoints?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout
I0520 13:56:51.352107 1 trace.go:116] Trace[911902081]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125 (started: 2024-05-20 13:56:21.351850517 +0000 UTC m=+0.098922896) (total time: 30.000243502s):
Trace[911902081]: [30.000243502s] [30.000243502s] END
E0520 13:56:51.352121 1 reflector.go:178] pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125: Failed to list *v1.Namespace: Get "https://10.96.0.1:443/api/v1/namespaces?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout
==> describe nodes <==
Name: old-k8s-version-196977
Roles: control-plane,master
Labels: beta.kubernetes.io/arch=arm64
beta.kubernetes.io/os=linux
kubernetes.io/arch=arm64
kubernetes.io/hostname=old-k8s-version-196977
kubernetes.io/os=linux
minikube.k8s.io/commit=0881f46f23ff5e176004d1ef4d2b1cc347d248bb
minikube.k8s.io/name=old-k8s-version-196977
minikube.k8s.io/primary=true
minikube.k8s.io/updated_at=2024_05_20T13_53_47_0700
minikube.k8s.io/version=v1.33.1
node-role.kubernetes.io/control-plane=
node-role.kubernetes.io/master=
Annotations: kubeadm.alpha.kubernetes.io/cri-socket: /var/run/crio/crio.sock
node.alpha.kubernetes.io/ttl: 0
volumes.kubernetes.io/controller-managed-attach-detach: true
CreationTimestamp: Mon, 20 May 2024 13:53:43 +0000
Taints: <none>
Unschedulable: false
Lease:
HolderIdentity: old-k8s-version-196977
AcquireTime: <unset>
RenewTime: Mon, 20 May 2024 14:02:01 +0000
Conditions:
Type Status LastHeartbeatTime LastTransitionTime Reason Message
---- ------ ----------------- ------------------ ------ -------
MemoryPressure False Mon, 20 May 2024 13:57:08 +0000 Mon, 20 May 2024 13:53:37 +0000 KubeletHasSufficientMemory kubelet has sufficient memory available
DiskPressure False Mon, 20 May 2024 13:57:08 +0000 Mon, 20 May 2024 13:53:37 +0000 KubeletHasNoDiskPressure kubelet has no disk pressure
PIDPressure False Mon, 20 May 2024 13:57:08 +0000 Mon, 20 May 2024 13:53:37 +0000 KubeletHasSufficientPID kubelet has sufficient PID available
Ready True Mon, 20 May 2024 13:57:08 +0000 Mon, 20 May 2024 13:54:45 +0000 KubeletReady kubelet is posting ready status
Addresses:
InternalIP: 192.168.76.2
Hostname: old-k8s-version-196977
Capacity:
cpu: 2
ephemeral-storage: 203034800Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
hugepages-32Mi: 0
hugepages-64Ki: 0
memory: 8022496Ki
pods: 110
Allocatable:
cpu: 2
ephemeral-storage: 203034800Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
hugepages-32Mi: 0
hugepages-64Ki: 0
memory: 8022496Ki
pods: 110
System Info:
Machine ID: d278a310310b4da1b9b229d6098ce55c
System UUID: 2c4ea2b0-2c42-4851-a8db-e2734b40d125
Boot ID: df9684e8-d429-41b3-8a9f-ef96b9c9133b
Kernel Version: 5.15.0-1058-aws
OS Image: Ubuntu 22.04.4 LTS
Operating System: linux
Architecture: arm64
Container Runtime Version: cri-o://1.24.6
Kubelet Version: v1.20.0
Kube-Proxy Version: v1.20.0
PodCIDR: 10.244.0.0/24
PodCIDRs: 10.244.0.0/24
Non-terminated Pods: (12 in total)
Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits AGE
--------- ---- ------------ ---------- --------------- ------------- ---
default busybox 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 6m43s
kube-system coredns-74ff55c5b-ptmbw 100m (5%!)(MISSING) 0 (0%!)(MISSING) 70Mi (0%!)(MISSING) 170Mi (2%!)(MISSING) 8m2s
kube-system etcd-old-k8s-version-196977 100m (5%!)(MISSING) 0 (0%!)(MISSING) 100Mi (1%!)(MISSING) 0 (0%!)(MISSING) 8m11s
kube-system kindnet-j8tj2 100m (5%!)(MISSING) 100m (5%!)(MISSING) 50Mi (0%!)(MISSING) 50Mi (0%!)(MISSING) 8m3s
kube-system kube-apiserver-old-k8s-version-196977 250m (12%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 8m11s
kube-system kube-controller-manager-old-k8s-version-196977 200m (10%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 8m11s
kube-system kube-proxy-2sgl4 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 8m2s
kube-system kube-scheduler-old-k8s-version-196977 100m (5%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 8m11s
kube-system metrics-server-9975d5f86-cxvzj 100m (5%!)(MISSING) 0 (0%!)(MISSING) 200Mi (2%!)(MISSING) 0 (0%!)(MISSING) 6m31s
kube-system storage-provisioner 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 8m1s
kubernetes-dashboard dashboard-metrics-scraper-8d5bb5db8-5689z 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 5m30s
kubernetes-dashboard kubernetes-dashboard-cd95d586-79hrn 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 5m30s
Allocated resources:
(Total limits may be over 100 percent, i.e., overcommitted.)
Resource Requests Limits
-------- -------- ------
cpu 950m (47%!)(MISSING) 100m (5%!)(MISSING)
memory 420Mi (5%!)(MISSING) 220Mi (2%!)(MISSING)
ephemeral-storage 100Mi (0%!)(MISSING) 0 (0%!)(MISSING)
hugepages-1Gi 0 (0%!)(MISSING) 0 (0%!)(MISSING)
hugepages-2Mi 0 (0%!)(MISSING) 0 (0%!)(MISSING)
hugepages-32Mi 0 (0%!)(MISSING) 0 (0%!)(MISSING)
hugepages-64Ki 0 (0%!)(MISSING) 0 (0%!)(MISSING)
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal Starting 8m31s kubelet Starting kubelet.
Normal NodeHasSufficientMemory 8m30s (x4 over 8m30s) kubelet Node old-k8s-version-196977 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 8m30s (x4 over 8m30s) kubelet Node old-k8s-version-196977 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 8m30s (x4 over 8m30s) kubelet Node old-k8s-version-196977 status is now: NodeHasSufficientPID
Normal Starting 8m11s kubelet Starting kubelet.
Normal NodeHasSufficientMemory 8m11s kubelet Node old-k8s-version-196977 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 8m11s kubelet Node old-k8s-version-196977 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 8m11s kubelet Node old-k8s-version-196977 status is now: NodeHasSufficientPID
Normal Starting 8m1s kube-proxy Starting kube-proxy.
Normal NodeReady 7m21s kubelet Node old-k8s-version-196977 status is now: NodeReady
Normal Starting 6m2s kubelet Starting kubelet.
Normal NodeHasSufficientMemory 6m1s (x8 over 6m1s) kubelet Node old-k8s-version-196977 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 6m1s (x8 over 6m1s) kubelet Node old-k8s-version-196977 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 6m1s (x8 over 6m1s) kubelet Node old-k8s-version-196977 status is now: NodeHasSufficientPID
Normal Starting 5m45s kube-proxy Starting kube-proxy.
==> dmesg <==
[ +0.000806] FS-Cache: N-cookie c=000001aa [p=000001a1 fl=2 nc=0 na=1]
[ +0.000980] FS-Cache: N-cookie d=00000000865130fc{9p.inode} n=0000000024c8dcdb
[ +0.001104] FS-Cache: N-key=[8] '99883b0000000000'
[ +0.003137] FS-Cache: Duplicate cookie detected
[ +0.000762] FS-Cache: O-cookie c=000001a4 [p=000001a1 fl=226 nc=0 na=1]
[ +0.000966] FS-Cache: O-cookie d=00000000865130fc{9p.inode} n=000000007d4b6b16
[ +0.001285] FS-Cache: O-key=[8] '99883b0000000000'
[ +0.000804] FS-Cache: N-cookie c=000001ab [p=000001a1 fl=2 nc=0 na=1]
[ +0.000990] FS-Cache: N-cookie d=00000000865130fc{9p.inode} n=000000002d6a31f9
[ +0.001050] FS-Cache: N-key=[8] '99883b0000000000'
[ +2.272487] FS-Cache: Duplicate cookie detected
[ +0.000769] FS-Cache: O-cookie c=000001a2 [p=000001a1 fl=226 nc=0 na=1]
[ +0.000999] FS-Cache: O-cookie d=00000000865130fc{9p.inode} n=0000000017488ba3
[ +0.001114] FS-Cache: O-key=[8] '98883b0000000000'
[ +0.000737] FS-Cache: N-cookie c=000001ad [p=000001a1 fl=2 nc=0 na=1]
[ +0.000938] FS-Cache: N-cookie d=00000000865130fc{9p.inode} n=0000000046618fe3
[ +0.001067] FS-Cache: N-key=[8] '98883b0000000000'
[ +0.340023] FS-Cache: Duplicate cookie detected
[ +0.000874] FS-Cache: O-cookie c=000001a7 [p=000001a1 fl=226 nc=0 na=1]
[ +0.001102] FS-Cache: O-cookie d=00000000865130fc{9p.inode} n=00000000041d3a7e
[ +0.001111] FS-Cache: O-key=[8] '9e883b0000000000'
[ +0.000774] FS-Cache: N-cookie c=000001ae [p=000001a1 fl=2 nc=0 na=1]
[ +0.001024] FS-Cache: N-cookie d=00000000865130fc{9p.inode} n=0000000024c8dcdb
[ +0.001079] FS-Cache: N-key=[8] '9e883b0000000000'
[May20 13:48] overlayfs: '/var/lib/containers/storage/overlay/l/Q2QJNMTVZL6GMULS36RA5ZJGSA' not a directory
==> etcd [574ca79575df26bfbb124b76c08ba1882d73ae20602034b6e0c9d2a4a58ddc9f] <==
2024-05-20 13:58:05.589568 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-05-20 13:58:15.589497 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-05-20 13:58:25.590382 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-05-20 13:58:35.589490 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-05-20 13:58:45.589480 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-05-20 13:58:55.589448 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-05-20 13:59:05.589468 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-05-20 13:59:15.589417 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-05-20 13:59:25.589406 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-05-20 13:59:35.589441 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-05-20 13:59:45.589442 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-05-20 13:59:55.589526 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-05-20 14:00:05.589588 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-05-20 14:00:15.589734 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-05-20 14:00:25.589481 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-05-20 14:00:35.589523 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-05-20 14:00:45.589454 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-05-20 14:00:55.589605 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-05-20 14:01:05.589477 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-05-20 14:01:15.589483 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-05-20 14:01:25.589514 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-05-20 14:01:35.589397 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-05-20 14:01:45.589412 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-05-20 14:01:55.589534 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-05-20 14:02:05.591460 I | etcdserver/api/etcdhttp: /health OK (status code 200)
==> kernel <==
14:02:06 up 1 day, 21:44, 0 users, load average: 0.91, 1.84, 2.34
Linux old-k8s-version-196977 5.15.0-1058-aws #64~20.04.1-Ubuntu SMP Tue Apr 9 11:11:55 UTC 2024 aarch64 aarch64 aarch64 GNU/Linux
PRETTY_NAME="Ubuntu 22.04.4 LTS"
==> kindnet [e8289b46f01a9d3e0e6b44ce3290e107e18c07f655ba4194c834341c4d468c83] <==
I0520 14:00:01.865515 1 main.go:227] handling current node
I0520 14:00:11.874368 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0520 14:00:11.874400 1 main.go:227] handling current node
I0520 14:00:21.883603 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0520 14:00:21.883632 1 main.go:227] handling current node
I0520 14:00:31.899841 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0520 14:00:31.899873 1 main.go:227] handling current node
I0520 14:00:41.907970 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0520 14:00:41.908007 1 main.go:227] handling current node
I0520 14:00:51.916393 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0520 14:00:51.916419 1 main.go:227] handling current node
I0520 14:01:01.929787 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0520 14:01:01.929818 1 main.go:227] handling current node
I0520 14:01:11.943974 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0520 14:01:11.944001 1 main.go:227] handling current node
I0520 14:01:21.951834 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0520 14:01:21.951869 1 main.go:227] handling current node
I0520 14:01:31.960250 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0520 14:01:31.960285 1 main.go:227] handling current node
I0520 14:01:41.977411 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0520 14:01:41.977640 1 main.go:227] handling current node
I0520 14:01:51.985870 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0520 14:01:51.985901 1 main.go:227] handling current node
I0520 14:02:01.997447 1 main.go:223] Handling node with IPs: map[192.168.76.2:{}]
I0520 14:02:01.997579 1 main.go:227] handling current node
==> kube-apiserver [21f02b40f812f73866c7240ca4f394dd16d29cf18f0bd90fe73f0f88278d7c3c] <==
I0520 13:58:41.645582 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0520 13:58:41.645591 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0520 13:59:13.890826 1 client.go:360] parsed scheme: "passthrough"
I0520 13:59:13.890965 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0520 13:59:13.891002 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
W0520 13:59:22.127818 1 handler_proxy.go:102] no RequestInfo found in the context
E0520 13:59:22.127899 1 controller.go:116] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
I0520 13:59:22.127907 1 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
I0520 13:59:50.892518 1 client.go:360] parsed scheme: "passthrough"
I0520 13:59:50.892577 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0520 13:59:50.892586 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0520 14:00:26.404695 1 client.go:360] parsed scheme: "passthrough"
I0520 14:00:26.404740 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0520 14:00:26.404750 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0520 14:01:01.435104 1 client.go:360] parsed scheme: "passthrough"
I0520 14:01:01.435151 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0520 14:01:01.435159 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
W0520 14:01:19.318700 1 handler_proxy.go:102] no RequestInfo found in the context
E0520 14:01:19.318778 1 controller.go:116] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
I0520 14:01:19.318786 1 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
I0520 14:01:39.124270 1 client.go:360] parsed scheme: "passthrough"
I0520 14:01:39.124309 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0520 14:01:39.124318 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
==> kube-controller-manager [6573124f1f00f0b93e75e9d9c4005f0198ca7f6b5324170c53a4e24d835271c4] <==
W0520 13:57:42.644416 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0520 13:58:08.592259 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0520 13:58:14.294936 1 request.go:655] Throttling request took 1.048479591s, request: GET:https://192.168.76.2:8443/apis/extensions/v1beta1?timeout=32s
W0520 13:58:15.146478 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0520 13:58:39.094476 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0520 13:58:46.799897 1 request.go:655] Throttling request took 1.048099925s, request: GET:https://192.168.76.2:8443/apis/storage.k8s.io/v1beta1?timeout=32s
W0520 13:58:47.651383 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0520 13:59:09.602315 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0520 13:59:19.301814 1 request.go:655] Throttling request took 1.048522707s, request: GET:https://192.168.76.2:8443/apis/apiextensions.k8s.io/v1?timeout=32s
W0520 13:59:20.153199 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0520 13:59:40.104346 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0520 13:59:51.803557 1 request.go:655] Throttling request took 1.047675192s, request: GET:https://192.168.76.2:8443/apis/apiextensions.k8s.io/v1?timeout=32s
W0520 13:59:52.655055 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0520 14:00:10.606196 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0520 14:00:24.305520 1 request.go:655] Throttling request took 1.048522052s, request: GET:https://192.168.76.2:8443/apis/apiextensions.k8s.io/v1?timeout=32s
W0520 14:00:25.158021 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0520 14:00:41.108226 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0520 14:00:56.808457 1 request.go:655] Throttling request took 1.0482498s, request: GET:https://192.168.76.2:8443/apis/apiextensions.k8s.io/v1beta1?timeout=32s
W0520 14:00:57.660652 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0520 14:01:11.609997 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0520 14:01:29.311149 1 request.go:655] Throttling request took 1.048344238s, request: GET:https://192.168.76.2:8443/apis/networking.k8s.io/v1beta1?timeout=32s
W0520 14:01:30.162637 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0520 14:01:42.112560 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0520 14:02:01.812998 1 request.go:655] Throttling request took 1.048160882s, request: GET:https://192.168.76.2:8443/apis/autoscaling/v1?timeout=32s
W0520 14:02:02.664629 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
==> kube-proxy [577e4eac4cee4596652e1e0a4aa1aab157007dd6015d77ef54ce41d332d17660] <==
I0520 13:54:05.539006 1 node.go:172] Successfully retrieved node IP: 192.168.76.2
I0520 13:54:05.541212 1 server_others.go:142] kube-proxy node IP is an IPv4 address (192.168.76.2), assume IPv4 operation
W0520 13:54:05.594464 1 server_others.go:578] Unknown proxy mode "", assuming iptables proxy
I0520 13:54:05.594552 1 server_others.go:185] Using iptables Proxier.
I0520 13:54:05.594954 1 server.go:650] Version: v1.20.0
I0520 13:54:05.595539 1 config.go:315] Starting service config controller
I0520 13:54:05.595573 1 shared_informer.go:240] Waiting for caches to sync for service config
I0520 13:54:05.595608 1 config.go:224] Starting endpoint slice config controller
I0520 13:54:05.595629 1 shared_informer.go:240] Waiting for caches to sync for endpoint slice config
I0520 13:54:05.695702 1 shared_informer.go:247] Caches are synced for endpoint slice config
I0520 13:54:05.695772 1 shared_informer.go:247] Caches are synced for service config
I0520 13:56:21.474350 1 node.go:172] Successfully retrieved node IP: 192.168.76.2
I0520 13:56:21.474680 1 server_others.go:142] kube-proxy node IP is an IPv4 address (192.168.76.2), assume IPv4 operation
W0520 13:56:21.496893 1 server_others.go:578] Unknown proxy mode "", assuming iptables proxy
I0520 13:56:21.497082 1 server_others.go:185] Using iptables Proxier.
I0520 13:56:21.497357 1 server.go:650] Version: v1.20.0
I0520 13:56:21.498389 1 config.go:315] Starting service config controller
I0520 13:56:21.498463 1 shared_informer.go:240] Waiting for caches to sync for service config
I0520 13:56:21.498516 1 config.go:224] Starting endpoint slice config controller
I0520 13:56:21.498561 1 shared_informer.go:240] Waiting for caches to sync for endpoint slice config
I0520 13:56:21.598586 1 shared_informer.go:247] Caches are synced for service config
I0520 13:56:21.598653 1 shared_informer.go:247] Caches are synced for endpoint slice config
==> kube-scheduler [b2bf99df779efc3459ff13a39979c379186fd56c60c69dc26b9297b16d4c1a3e] <==
E0520 13:53:43.839146 1 reflector.go:138] k8s.io/apiserver/pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
E0520 13:53:44.696262 1 reflector.go:138] k8s.io/apiserver/pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
E0520 13:53:44.745127 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
E0520 13:53:44.773873 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
E0520 13:53:44.789077 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
I0520 13:53:47.216768 1 shared_informer.go:247] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0520 13:56:12.933515 1 serving.go:331] Generated self-signed cert in-memory
W0520 13:56:18.193613 1 requestheader_controller.go:193] Unable to get configmap/extension-apiserver-authentication in kube-system. Usually fixed by 'kubectl create rolebinding -n kube-system ROLEBINDING_NAME --role=extension-apiserver-authentication-reader --serviceaccount=YOUR_NS:YOUR_SA'
W0520 13:56:18.193765 1 authentication.go:332] Error looking up in-cluster authentication configuration: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot get resource "configmaps" in API group "" in the namespace "kube-system"
W0520 13:56:18.193830 1 authentication.go:333] Continuing without authentication configuration. This may treat all requests as anonymous.
W0520 13:56:18.193860 1 authentication.go:334] To require authentication configuration lookup to succeed, set --authentication-tolerate-lookup-failure=false
I0520 13:56:18.370045 1 secure_serving.go:197] Serving securely on 127.0.0.1:10259
I0520 13:56:18.370281 1 configmap_cafile_content.go:202] Starting client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0520 13:56:18.370325 1 shared_informer.go:240] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0520 13:56:18.370366 1 tlsconfig.go:240] Starting DynamicServingCertificateController
E0520 13:56:18.396643 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
E0520 13:56:18.398631 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
E0520 13:56:18.398699 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
E0520 13:56:18.398768 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1beta1.PodDisruptionBudget: failed to list *v1beta1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
E0520 13:56:18.398835 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
E0520 13:56:18.398894 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
E0520 13:56:18.398956 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
E0520 13:56:18.399016 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
E0520 13:56:18.449625 1 reflector.go:138] k8s.io/apiserver/pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
I0520 13:56:19.877360 1 shared_informer.go:247] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
==> kubelet <==
May 20 14:00:28 old-k8s-version-196977 kubelet[735]: E0520 14:00:28.157555 735 pod_workers.go:191] Error syncing pod c8365eaa-709d-43e2-8d02-7bb97878bae7 ("metrics-server-9975d5f86-cxvzj_kube-system(c8365eaa-709d-43e2-8d02-7bb97878bae7)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
May 20 14:00:37 old-k8s-version-196977 kubelet[735]: I0520 14:00:37.156672 735 scope.go:95] [topologymanager] RemoveContainer - Container ID: 755cecdafa77de1c0686b24fdf588d3324011b041ecae03194d99a055b300793
May 20 14:00:37 old-k8s-version-196977 kubelet[735]: E0520 14:00:37.157011 735 pod_workers.go:191] Error syncing pod ab81093c-bffe-45a6-bb1f-d68defdc028d ("dashboard-metrics-scraper-8d5bb5db8-5689z_kubernetes-dashboard(ab81093c-bffe-45a6-bb1f-d68defdc028d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5689z_kubernetes-dashboard(ab81093c-bffe-45a6-bb1f-d68defdc028d)"
May 20 14:00:42 old-k8s-version-196977 kubelet[735]: E0520 14:00:42.157800 735 pod_workers.go:191] Error syncing pod c8365eaa-709d-43e2-8d02-7bb97878bae7 ("metrics-server-9975d5f86-cxvzj_kube-system(c8365eaa-709d-43e2-8d02-7bb97878bae7)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
May 20 14:00:52 old-k8s-version-196977 kubelet[735]: I0520 14:00:52.156591 735 scope.go:95] [topologymanager] RemoveContainer - Container ID: 755cecdafa77de1c0686b24fdf588d3324011b041ecae03194d99a055b300793
May 20 14:00:52 old-k8s-version-196977 kubelet[735]: E0520 14:00:52.156937 735 pod_workers.go:191] Error syncing pod ab81093c-bffe-45a6-bb1f-d68defdc028d ("dashboard-metrics-scraper-8d5bb5db8-5689z_kubernetes-dashboard(ab81093c-bffe-45a6-bb1f-d68defdc028d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5689z_kubernetes-dashboard(ab81093c-bffe-45a6-bb1f-d68defdc028d)"
May 20 14:00:54 old-k8s-version-196977 kubelet[735]: E0520 14:00:54.157689 735 pod_workers.go:191] Error syncing pod c8365eaa-709d-43e2-8d02-7bb97878bae7 ("metrics-server-9975d5f86-cxvzj_kube-system(c8365eaa-709d-43e2-8d02-7bb97878bae7)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
May 20 14:01:03 old-k8s-version-196977 kubelet[735]: I0520 14:01:03.156700 735 scope.go:95] [topologymanager] RemoveContainer - Container ID: 755cecdafa77de1c0686b24fdf588d3324011b041ecae03194d99a055b300793
May 20 14:01:03 old-k8s-version-196977 kubelet[735]: E0520 14:01:03.157044 735 pod_workers.go:191] Error syncing pod ab81093c-bffe-45a6-bb1f-d68defdc028d ("dashboard-metrics-scraper-8d5bb5db8-5689z_kubernetes-dashboard(ab81093c-bffe-45a6-bb1f-d68defdc028d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5689z_kubernetes-dashboard(ab81093c-bffe-45a6-bb1f-d68defdc028d)"
May 20 14:01:05 old-k8s-version-196977 kubelet[735]: E0520 14:01:05.089416 735 container_manager_linux.go:533] failed to find cgroups of kubelet - cpu and memory cgroup hierarchy not unified. cpu: /docker/37060f4867782612657eb50778f8f5effe655164d79c2ef9257ca077c3219353, memory: /docker/37060f4867782612657eb50778f8f5effe655164d79c2ef9257ca077c3219353/system.slice/kubelet.service
May 20 14:01:05 old-k8s-version-196977 kubelet[735]: E0520 14:01:05.157906 735 pod_workers.go:191] Error syncing pod c8365eaa-709d-43e2-8d02-7bb97878bae7 ("metrics-server-9975d5f86-cxvzj_kube-system(c8365eaa-709d-43e2-8d02-7bb97878bae7)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
May 20 14:01:14 old-k8s-version-196977 kubelet[735]: I0520 14:01:14.156679 735 scope.go:95] [topologymanager] RemoveContainer - Container ID: 755cecdafa77de1c0686b24fdf588d3324011b041ecae03194d99a055b300793
May 20 14:01:14 old-k8s-version-196977 kubelet[735]: E0520 14:01:14.157027 735 pod_workers.go:191] Error syncing pod ab81093c-bffe-45a6-bb1f-d68defdc028d ("dashboard-metrics-scraper-8d5bb5db8-5689z_kubernetes-dashboard(ab81093c-bffe-45a6-bb1f-d68defdc028d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5689z_kubernetes-dashboard(ab81093c-bffe-45a6-bb1f-d68defdc028d)"
May 20 14:01:20 old-k8s-version-196977 kubelet[735]: E0520 14:01:20.157731 735 pod_workers.go:191] Error syncing pod c8365eaa-709d-43e2-8d02-7bb97878bae7 ("metrics-server-9975d5f86-cxvzj_kube-system(c8365eaa-709d-43e2-8d02-7bb97878bae7)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
May 20 14:01:28 old-k8s-version-196977 kubelet[735]: I0520 14:01:28.156619 735 scope.go:95] [topologymanager] RemoveContainer - Container ID: 755cecdafa77de1c0686b24fdf588d3324011b041ecae03194d99a055b300793
May 20 14:01:28 old-k8s-version-196977 kubelet[735]: E0520 14:01:28.156964 735 pod_workers.go:191] Error syncing pod ab81093c-bffe-45a6-bb1f-d68defdc028d ("dashboard-metrics-scraper-8d5bb5db8-5689z_kubernetes-dashboard(ab81093c-bffe-45a6-bb1f-d68defdc028d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5689z_kubernetes-dashboard(ab81093c-bffe-45a6-bb1f-d68defdc028d)"
May 20 14:01:33 old-k8s-version-196977 kubelet[735]: E0520 14:01:33.157618 735 pod_workers.go:191] Error syncing pod c8365eaa-709d-43e2-8d02-7bb97878bae7 ("metrics-server-9975d5f86-cxvzj_kube-system(c8365eaa-709d-43e2-8d02-7bb97878bae7)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
May 20 14:01:40 old-k8s-version-196977 kubelet[735]: I0520 14:01:40.157406 735 scope.go:95] [topologymanager] RemoveContainer - Container ID: 755cecdafa77de1c0686b24fdf588d3324011b041ecae03194d99a055b300793
May 20 14:01:40 old-k8s-version-196977 kubelet[735]: E0520 14:01:40.157785 735 pod_workers.go:191] Error syncing pod ab81093c-bffe-45a6-bb1f-d68defdc028d ("dashboard-metrics-scraper-8d5bb5db8-5689z_kubernetes-dashboard(ab81093c-bffe-45a6-bb1f-d68defdc028d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5689z_kubernetes-dashboard(ab81093c-bffe-45a6-bb1f-d68defdc028d)"
May 20 14:01:46 old-k8s-version-196977 kubelet[735]: E0520 14:01:46.157493 735 pod_workers.go:191] Error syncing pod c8365eaa-709d-43e2-8d02-7bb97878bae7 ("metrics-server-9975d5f86-cxvzj_kube-system(c8365eaa-709d-43e2-8d02-7bb97878bae7)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
May 20 14:01:52 old-k8s-version-196977 kubelet[735]: I0520 14:01:52.156702 735 scope.go:95] [topologymanager] RemoveContainer - Container ID: 755cecdafa77de1c0686b24fdf588d3324011b041ecae03194d99a055b300793
May 20 14:01:52 old-k8s-version-196977 kubelet[735]: E0520 14:01:52.157520 735 pod_workers.go:191] Error syncing pod ab81093c-bffe-45a6-bb1f-d68defdc028d ("dashboard-metrics-scraper-8d5bb5db8-5689z_kubernetes-dashboard(ab81093c-bffe-45a6-bb1f-d68defdc028d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5689z_kubernetes-dashboard(ab81093c-bffe-45a6-bb1f-d68defdc028d)"
May 20 14:01:57 old-k8s-version-196977 kubelet[735]: E0520 14:01:57.158478 735 pod_workers.go:191] Error syncing pod c8365eaa-709d-43e2-8d02-7bb97878bae7 ("metrics-server-9975d5f86-cxvzj_kube-system(c8365eaa-709d-43e2-8d02-7bb97878bae7)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
May 20 14:02:03 old-k8s-version-196977 kubelet[735]: I0520 14:02:03.157351 735 scope.go:95] [topologymanager] RemoveContainer - Container ID: 755cecdafa77de1c0686b24fdf588d3324011b041ecae03194d99a055b300793
May 20 14:02:03 old-k8s-version-196977 kubelet[735]: E0520 14:02:03.158603 735 pod_workers.go:191] Error syncing pod ab81093c-bffe-45a6-bb1f-d68defdc028d ("dashboard-metrics-scraper-8d5bb5db8-5689z_kubernetes-dashboard(ab81093c-bffe-45a6-bb1f-d68defdc028d)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-5689z_kubernetes-dashboard(ab81093c-bffe-45a6-bb1f-d68defdc028d)"
==> kubernetes-dashboard [a5779cc8510e582479bdedeecea9ca5a0471306b7bf72588b0563dcb1a60a030] <==
2024/05/20 13:56:48 Using namespace: kubernetes-dashboard
2024/05/20 13:56:48 Using in-cluster config to connect to apiserver
2024/05/20 13:56:48 Using secret token for csrf signing
2024/05/20 13:56:48 Initializing csrf token from kubernetes-dashboard-csrf secret
2024/05/20 13:56:48 Empty token. Generating and storing in a secret kubernetes-dashboard-csrf
2024/05/20 13:56:48 Successful initial request to the apiserver, version: v1.20.0
2024/05/20 13:56:48 Generating JWE encryption key
2024/05/20 13:56:48 New synchronizer has been registered: kubernetes-dashboard-key-holder-kubernetes-dashboard. Starting
2024/05/20 13:56:48 Starting secret synchronizer for kubernetes-dashboard-key-holder in namespace kubernetes-dashboard
2024/05/20 13:56:49 Initializing JWE encryption key from synchronized object
2024/05/20 13:56:49 Creating in-cluster Sidecar client
2024/05/20 13:56:49 Serving insecurely on HTTP port: 9090
2024/05/20 13:56:49 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/05/20 13:57:19 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/05/20 13:57:49 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/05/20 13:58:19 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/05/20 13:58:49 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/05/20 13:59:19 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/05/20 13:59:49 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/05/20 14:00:19 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/05/20 14:00:49 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/05/20 14:01:19 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/05/20 14:01:49 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/05/20 13:56:48 Starting overwatch
==> storage-provisioner [c6481d58189faf4b67ee0efb1177763e086618f853c876070abc9fb1a4dc75cd] <==
I0520 13:54:50.719542 1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
I0520 13:54:50.747958 1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!
I0520 13:54:50.748019 1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...
I0520 13:54:50.793141 1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath
I0520 13:54:50.797803 1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_old-k8s-version-196977_fd19dc81-0b94-4768-b4cc-018724fc59e5!
I0520 13:54:50.798940 1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"e336d3a2-36df-4b00-a066-7b8f39c62025", APIVersion:"v1", ResourceVersion:"497", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' old-k8s-version-196977_fd19dc81-0b94-4768-b4cc-018724fc59e5 became leader
I0520 13:54:50.898032 1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_old-k8s-version-196977_fd19dc81-0b94-4768-b4cc-018724fc59e5!
I0520 13:56:22.569392 1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
I0520 13:56:22.638856 1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!
I0520 13:56:22.641311 1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...
I0520 13:56:40.294481 1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath
I0520 13:56:40.314177 1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_old-k8s-version-196977_59b9805d-5eb0-4838-a0e0-22a5b83c621c!
I0520 13:56:40.315462 1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"e336d3a2-36df-4b00-a066-7b8f39c62025", APIVersion:"v1", ResourceVersion:"740", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' old-k8s-version-196977_59b9805d-5eb0-4838-a0e0-22a5b83c621c became leader
I0520 13:56:40.431965 1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_old-k8s-version-196977_59b9805d-5eb0-4838-a0e0-22a5b83c621c!
-- /stdout --
helpers_test.go:254: (dbg) Run: out/minikube-linux-arm64 status --format={{.APIServer}} -p old-k8s-version-196977 -n old-k8s-version-196977
helpers_test.go:261: (dbg) Run: kubectl --context old-k8s-version-196977 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:272: non-running pods: metrics-server-9975d5f86-cxvzj
helpers_test.go:274: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/SecondStart]: describe non-running pods <======
helpers_test.go:277: (dbg) Run: kubectl --context old-k8s-version-196977 describe pod metrics-server-9975d5f86-cxvzj
helpers_test.go:277: (dbg) Non-zero exit: kubectl --context old-k8s-version-196977 describe pod metrics-server-9975d5f86-cxvzj: exit status 1 (241.980386ms)
** stderr **
Error from server (NotFound): pods "metrics-server-9975d5f86-cxvzj" not found
** /stderr **
helpers_test.go:279: kubectl --context old-k8s-version-196977 describe pod metrics-server-9975d5f86-cxvzj: exit status 1
--- FAIL: TestStartStop/group/old-k8s-version/serial/SecondStart (380.41s)