=== RUN TestStartStop/group/old-k8s-version/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run: out/minikube-linux-arm64 start -p old-k8s-version-425197 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --container-runtime=crio --kubernetes-version=v1.20.0
start_stop_delete_test.go:256: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p old-k8s-version-425197 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --container-runtime=crio --kubernetes-version=v1.20.0: exit status 102 (6m13.594914004s)
-- stdout --
* [old-k8s-version-425197] minikube v1.33.0 on Ubuntu 20.04 (arm64)
- MINIKUBE_LOCATION=18756
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/18756-1231546/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/18756-1231546/.minikube
- MINIKUBE_BIN=out/minikube-linux-arm64
- MINIKUBE_FORCE_SYSTEMD=
* Kubernetes 1.30.0 is now available. If you would like to upgrade, specify: --kubernetes-version=v1.30.0
* Using the docker driver based on existing profile
* Starting "old-k8s-version-425197" primary control-plane node in "old-k8s-version-425197" cluster
* Pulling base image v0.0.43-1713736339-18706 ...
* Restarting existing docker container for "old-k8s-version-425197" ...
* Preparing Kubernetes v1.20.0 on CRI-O 1.24.6 ...
* Verifying Kubernetes components...
- Using image registry.k8s.io/echoserver:1.4
- Using image docker.io/kubernetesui/dashboard:v2.7.0
- Using image gcr.io/k8s-minikube/storage-provisioner:v5
- Using image fake.domain/registry.k8s.io/echoserver:1.4
* Some dashboard features require the metrics-server addon. To enable all features please run:
minikube -p old-k8s-version-425197 addons enable metrics-server
* Enabled addons: storage-provisioner, dashboard, metrics-server, default-storageclass
-- /stdout --
** stderr **
I0429 12:29:30.062458 1423526 out.go:291] Setting OutFile to fd 1 ...
I0429 12:29:30.062692 1423526 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0429 12:29:30.062733 1423526 out.go:304] Setting ErrFile to fd 2...
I0429 12:29:30.062761 1423526 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0429 12:29:30.063072 1423526 root.go:338] Updating PATH: /home/jenkins/minikube-integration/18756-1231546/.minikube/bin
I0429 12:29:30.063520 1423526 out.go:298] Setting JSON to false
I0429 12:29:30.064594 1423526 start.go:129] hostinfo: {"hostname":"ip-172-31-31-251","uptime":29514,"bootTime":1714364256,"procs":184,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1058-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"982e3628-3742-4b3e-bb63-ac1b07660ec7"}
I0429 12:29:30.064760 1423526 start.go:139] virtualization:
I0429 12:29:30.068038 1423526 out.go:177] * [old-k8s-version-425197] minikube v1.33.0 on Ubuntu 20.04 (arm64)
I0429 12:29:30.070727 1423526 out.go:177] - MINIKUBE_LOCATION=18756
I0429 12:29:30.070805 1423526 notify.go:220] Checking for updates...
I0429 12:29:30.075664 1423526 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0429 12:29:30.078225 1423526 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/18756-1231546/kubeconfig
I0429 12:29:30.080162 1423526 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/18756-1231546/.minikube
I0429 12:29:30.082742 1423526 out.go:177] - MINIKUBE_BIN=out/minikube-linux-arm64
I0429 12:29:30.084773 1423526 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0429 12:29:30.087605 1423526 config.go:182] Loaded profile config "old-k8s-version-425197": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.20.0
I0429 12:29:30.090500 1423526 out.go:177] * Kubernetes 1.30.0 is now available. If you would like to upgrade, specify: --kubernetes-version=v1.30.0
I0429 12:29:30.092455 1423526 driver.go:392] Setting default libvirt URI to qemu:///system
I0429 12:29:30.118817 1423526 docker.go:122] docker version: linux-26.1.0:Docker Engine - Community
I0429 12:29:30.118950 1423526 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0429 12:29:30.204205 1423526 info.go:266] docker info: {ID:EOU5:DNGX:XN6V:L2FZ:UXRM:5TWK:EVUR:KC2F:GT7Z:Y4O4:GB77:5PD3 Containers:2 ContainersRunning:1 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:55 OomKillDisable:true NGoroutines:67 SystemTime:2024-04-29 12:29:30.192883962 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1058-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8215105536 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-31-251 Labels:[] ExperimentalBuild:false ServerVersion:26.1.0 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:e377cd56a71523140ca6ae87e30244719194a521 Expected:e377cd56a71523140ca6ae87e30244719194a521} RuncCommit:{ID:v1.1.12-0-g51d5e94 Expected:v1.1.12-0-g51d5e94} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.14.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.26.1]] Warnings:<nil>}}
I0429 12:29:30.204326 1423526 docker.go:295] overlay module found
I0429 12:29:30.206708 1423526 out.go:177] * Using the docker driver based on existing profile
I0429 12:29:30.208918 1423526 start.go:297] selected driver: docker
I0429 12:29:30.208940 1423526 start.go:901] validating driver "docker" against &{Name:old-k8s-version-425197 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.43-1713736339-18706@sha256:bccd96633fa59b612ea2e24c6961d2499fe576afbab2e6056a6801ffbd3b1a7e Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-425197 Namespace:default APIServerHAVIP: AP
IServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountStr
ing:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0429 12:29:30.209067 1423526 start.go:912] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0429 12:29:30.209716 1423526 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0429 12:29:30.280551 1423526 info.go:266] docker info: {ID:EOU5:DNGX:XN6V:L2FZ:UXRM:5TWK:EVUR:KC2F:GT7Z:Y4O4:GB77:5PD3 Containers:2 ContainersRunning:1 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:55 OomKillDisable:true NGoroutines:67 SystemTime:2024-04-29 12:29:30.269083528 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1058-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8215105536 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-31-251 Labels:[] ExperimentalBuild:false ServerVersion:26.1.0 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:e377cd56a71523140ca6ae87e30244719194a521 Expected:e377cd56a71523140ca6ae87e30244719194a521} RuncCommit:{ID:v1.1.12-0-g51d5e94 Expected:v1.1.12-0-g51d5e94} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.14.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.26.1]] Warnings:<nil>}}
I0429 12:29:30.280932 1423526 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0429 12:29:30.280984 1423526 cni.go:84] Creating CNI manager for ""
I0429 12:29:30.280997 1423526 cni.go:143] "docker" driver + "crio" runtime found, recommending kindnet
I0429 12:29:30.281037 1423526 start.go:340] cluster config:
{Name:old-k8s-version-425197 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.43-1713736339-18706@sha256:bccd96633fa59b612ea2e24c6961d2499fe576afbab2e6056a6801ffbd3b1a7e Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-425197 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local
ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP
: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0429 12:29:30.283550 1423526 out.go:177] * Starting "old-k8s-version-425197" primary control-plane node in "old-k8s-version-425197" cluster
I0429 12:29:30.285717 1423526 cache.go:121] Beginning downloading kic base image for docker with crio
I0429 12:29:30.288273 1423526 out.go:177] * Pulling base image v0.0.43-1713736339-18706 ...
I0429 12:29:30.290623 1423526 preload.go:132] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0429 12:29:30.290676 1423526 preload.go:147] Found local preload: /home/jenkins/minikube-integration/18756-1231546/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-arm64.tar.lz4
I0429 12:29:30.290686 1423526 cache.go:56] Caching tarball of preloaded images
I0429 12:29:30.290789 1423526 preload.go:173] Found /home/jenkins/minikube-integration/18756-1231546/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-arm64.tar.lz4 in cache, skipping download
I0429 12:29:30.290799 1423526 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on crio
I0429 12:29:30.290905 1423526 profile.go:143] Saving config to /home/jenkins/minikube-integration/18756-1231546/.minikube/profiles/old-k8s-version-425197/config.json ...
I0429 12:29:30.291129 1423526 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.43-1713736339-18706@sha256:bccd96633fa59b612ea2e24c6961d2499fe576afbab2e6056a6801ffbd3b1a7e in local docker daemon
I0429 12:29:30.306759 1423526 image.go:83] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.43-1713736339-18706@sha256:bccd96633fa59b612ea2e24c6961d2499fe576afbab2e6056a6801ffbd3b1a7e in local docker daemon, skipping pull
I0429 12:29:30.306787 1423526 cache.go:144] gcr.io/k8s-minikube/kicbase-builds:v0.0.43-1713736339-18706@sha256:bccd96633fa59b612ea2e24c6961d2499fe576afbab2e6056a6801ffbd3b1a7e exists in daemon, skipping load
I0429 12:29:30.306812 1423526 cache.go:194] Successfully downloaded all kic artifacts
I0429 12:29:30.306845 1423526 start.go:360] acquireMachinesLock for old-k8s-version-425197: {Name:mkea9c46670743e09dc8380ddda62d78a2dbc9b1 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0429 12:29:30.306921 1423526 start.go:364] duration metric: took 48.262µs to acquireMachinesLock for "old-k8s-version-425197"
I0429 12:29:30.306947 1423526 start.go:96] Skipping create...Using existing machine configuration
I0429 12:29:30.306965 1423526 fix.go:54] fixHost starting:
I0429 12:29:30.307237 1423526 cli_runner.go:164] Run: docker container inspect old-k8s-version-425197 --format={{.State.Status}}
I0429 12:29:30.324499 1423526 fix.go:112] recreateIfNeeded on old-k8s-version-425197: state=Stopped err=<nil>
W0429 12:29:30.324531 1423526 fix.go:138] unexpected machine state, will restart: <nil>
I0429 12:29:30.327276 1423526 out.go:177] * Restarting existing docker container for "old-k8s-version-425197" ...
I0429 12:29:30.329596 1423526 cli_runner.go:164] Run: docker start old-k8s-version-425197
I0429 12:29:30.709883 1423526 cli_runner.go:164] Run: docker container inspect old-k8s-version-425197 --format={{.State.Status}}
I0429 12:29:30.769474 1423526 kic.go:430] container "old-k8s-version-425197" state is running.
I0429 12:29:30.769834 1423526 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-425197
I0429 12:29:30.794524 1423526 profile.go:143] Saving config to /home/jenkins/minikube-integration/18756-1231546/.minikube/profiles/old-k8s-version-425197/config.json ...
I0429 12:29:30.794745 1423526 machine.go:94] provisionDockerMachine start ...
I0429 12:29:30.794803 1423526 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-425197
I0429 12:29:30.813270 1423526 main.go:141] libmachine: Using SSH client type: native
I0429 12:29:30.815504 1423526 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e1e90] 0x3e46f0 <nil> [] 0s} 127.0.0.1 34568 <nil> <nil>}
I0429 12:29:30.815543 1423526 main.go:141] libmachine: About to run SSH command:
hostname
I0429 12:29:30.823080 1423526 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: EOF
I0429 12:29:33.964317 1423526 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-425197
I0429 12:29:33.964343 1423526 ubuntu.go:169] provisioning hostname "old-k8s-version-425197"
I0429 12:29:33.964443 1423526 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-425197
I0429 12:29:33.985801 1423526 main.go:141] libmachine: Using SSH client type: native
I0429 12:29:33.986044 1423526 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e1e90] 0x3e46f0 <nil> [] 0s} 127.0.0.1 34568 <nil> <nil>}
I0429 12:29:33.986061 1423526 main.go:141] libmachine: About to run SSH command:
sudo hostname old-k8s-version-425197 && echo "old-k8s-version-425197" | sudo tee /etc/hostname
I0429 12:29:34.130647 1423526 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-425197
I0429 12:29:34.130815 1423526 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-425197
I0429 12:29:34.153519 1423526 main.go:141] libmachine: Using SSH client type: native
I0429 12:29:34.153772 1423526 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e1e90] 0x3e46f0 <nil> [] 0s} 127.0.0.1 34568 <nil> <nil>}
I0429 12:29:34.153790 1423526 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-425197' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-425197/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-425197' | sudo tee -a /etc/hosts;
fi
fi
I0429 12:29:34.289158 1423526 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0429 12:29:34.289187 1423526 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/18756-1231546/.minikube CaCertPath:/home/jenkins/minikube-integration/18756-1231546/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/18756-1231546/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/18756-1231546/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/18756-1231546/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/18756-1231546/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/18756-1231546/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/18756-1231546/.minikube}
I0429 12:29:34.289224 1423526 ubuntu.go:177] setting up certificates
I0429 12:29:34.289234 1423526 provision.go:84] configureAuth start
I0429 12:29:34.289311 1423526 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-425197
I0429 12:29:34.311521 1423526 provision.go:143] copyHostCerts
I0429 12:29:34.311591 1423526 exec_runner.go:144] found /home/jenkins/minikube-integration/18756-1231546/.minikube/ca.pem, removing ...
I0429 12:29:34.311604 1423526 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18756-1231546/.minikube/ca.pem
I0429 12:29:34.311681 1423526 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18756-1231546/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/18756-1231546/.minikube/ca.pem (1082 bytes)
I0429 12:29:34.311793 1423526 exec_runner.go:144] found /home/jenkins/minikube-integration/18756-1231546/.minikube/cert.pem, removing ...
I0429 12:29:34.311808 1423526 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18756-1231546/.minikube/cert.pem
I0429 12:29:34.311839 1423526 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18756-1231546/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/18756-1231546/.minikube/cert.pem (1123 bytes)
I0429 12:29:34.311904 1423526 exec_runner.go:144] found /home/jenkins/minikube-integration/18756-1231546/.minikube/key.pem, removing ...
I0429 12:29:34.311913 1423526 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18756-1231546/.minikube/key.pem
I0429 12:29:34.311942 1423526 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18756-1231546/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/18756-1231546/.minikube/key.pem (1675 bytes)
I0429 12:29:34.312004 1423526 provision.go:117] generating server cert: /home/jenkins/minikube-integration/18756-1231546/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/18756-1231546/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/18756-1231546/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-425197 san=[127.0.0.1 192.168.85.2 localhost minikube old-k8s-version-425197]
I0429 12:29:34.652065 1423526 provision.go:177] copyRemoteCerts
I0429 12:29:34.652140 1423526 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0429 12:29:34.652189 1423526 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-425197
I0429 12:29:34.669758 1423526 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34568 SSHKeyPath:/home/jenkins/minikube-integration/18756-1231546/.minikube/machines/old-k8s-version-425197/id_rsa Username:docker}
I0429 12:29:34.761563 1423526 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18756-1231546/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)
I0429 12:29:34.785950 1423526 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18756-1231546/.minikube/machines/server.pem --> /etc/docker/server.pem (1233 bytes)
I0429 12:29:34.808878 1423526 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18756-1231546/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
I0429 12:29:34.833114 1423526 provision.go:87] duration metric: took 543.861833ms to configureAuth
I0429 12:29:34.833135 1423526 ubuntu.go:193] setting minikube options for container-runtime
I0429 12:29:34.833337 1423526 config.go:182] Loaded profile config "old-k8s-version-425197": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.20.0
I0429 12:29:34.833441 1423526 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-425197
I0429 12:29:34.852431 1423526 main.go:141] libmachine: Using SSH client type: native
I0429 12:29:34.852697 1423526 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e1e90] 0x3e46f0 <nil> [] 0s} 127.0.0.1 34568 <nil> <nil>}
I0429 12:29:34.852715 1423526 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %s "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0429 12:29:35.267708 1423526 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0429 12:29:35.267732 1423526 machine.go:97] duration metric: took 4.472978118s to provisionDockerMachine
I0429 12:29:35.267744 1423526 start.go:293] postStartSetup for "old-k8s-version-425197" (driver="docker")
I0429 12:29:35.267756 1423526 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0429 12:29:35.267820 1423526 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0429 12:29:35.267877 1423526 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-425197
I0429 12:29:35.292576 1423526 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34568 SSHKeyPath:/home/jenkins/minikube-integration/18756-1231546/.minikube/machines/old-k8s-version-425197/id_rsa Username:docker}
I0429 12:29:35.398729 1423526 ssh_runner.go:195] Run: cat /etc/os-release
I0429 12:29:35.402513 1423526 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I0429 12:29:35.402548 1423526 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
I0429 12:29:35.402559 1423526 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
I0429 12:29:35.402566 1423526 info.go:137] Remote host: Ubuntu 22.04.4 LTS
I0429 12:29:35.402576 1423526 filesync.go:126] Scanning /home/jenkins/minikube-integration/18756-1231546/.minikube/addons for local assets ...
I0429 12:29:35.402629 1423526 filesync.go:126] Scanning /home/jenkins/minikube-integration/18756-1231546/.minikube/files for local assets ...
I0429 12:29:35.402705 1423526 filesync.go:149] local asset: /home/jenkins/minikube-integration/18756-1231546/.minikube/files/etc/ssl/certs/12369742.pem -> 12369742.pem in /etc/ssl/certs
I0429 12:29:35.402814 1423526 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0429 12:29:35.417886 1423526 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18756-1231546/.minikube/files/etc/ssl/certs/12369742.pem --> /etc/ssl/certs/12369742.pem (1708 bytes)
I0429 12:29:35.453973 1423526 start.go:296] duration metric: took 186.214435ms for postStartSetup
I0429 12:29:35.454121 1423526 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I0429 12:29:35.454212 1423526 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-425197
I0429 12:29:35.477351 1423526 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34568 SSHKeyPath:/home/jenkins/minikube-integration/18756-1231546/.minikube/machines/old-k8s-version-425197/id_rsa Username:docker}
I0429 12:29:35.567007 1423526 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
I0429 12:29:35.573723 1423526 fix.go:56] duration metric: took 5.266758261s for fixHost
I0429 12:29:35.573760 1423526 start.go:83] releasing machines lock for "old-k8s-version-425197", held for 5.266826126s
I0429 12:29:35.573862 1423526 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-425197
I0429 12:29:35.593358 1423526 ssh_runner.go:195] Run: cat /version.json
I0429 12:29:35.593421 1423526 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-425197
I0429 12:29:35.593427 1423526 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0429 12:29:35.593496 1423526 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-425197
I0429 12:29:35.627452 1423526 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34568 SSHKeyPath:/home/jenkins/minikube-integration/18756-1231546/.minikube/machines/old-k8s-version-425197/id_rsa Username:docker}
I0429 12:29:35.648488 1423526 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34568 SSHKeyPath:/home/jenkins/minikube-integration/18756-1231546/.minikube/machines/old-k8s-version-425197/id_rsa Username:docker}
I0429 12:29:35.740788 1423526 ssh_runner.go:195] Run: systemctl --version
I0429 12:29:35.857265 1423526 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0429 12:29:36.023791 1423526 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
I0429 12:29:36.028763 1423526 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0429 12:29:36.038847 1423526 cni.go:221] loopback cni configuration disabled: "/etc/cni/net.d/*loopback.conf*" found
I0429 12:29:36.038925 1423526 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0429 12:29:36.049502 1423526 cni.go:259] no active bridge cni configs found in "/etc/cni/net.d" - nothing to disable
I0429 12:29:36.049571 1423526 start.go:494] detecting cgroup driver to use...
I0429 12:29:36.049605 1423526 detect.go:196] detected "cgroupfs" cgroup driver on host os
I0429 12:29:36.049661 1423526 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0429 12:29:36.063979 1423526 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0429 12:29:36.077463 1423526 docker.go:217] disabling cri-docker service (if available) ...
I0429 12:29:36.077527 1423526 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0429 12:29:36.092614 1423526 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0429 12:29:36.105899 1423526 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0429 12:29:36.244475 1423526 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0429 12:29:36.368388 1423526 docker.go:233] disabling docker service ...
I0429 12:29:36.368509 1423526 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0429 12:29:36.385896 1423526 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0429 12:29:36.399631 1423526 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0429 12:29:36.508010 1423526 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0429 12:29:36.620581 1423526 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0429 12:29:36.634334 1423526 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0429 12:29:36.653945 1423526 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.2" pause image...
I0429 12:29:36.654065 1423526 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.2"|' /etc/crio/crio.conf.d/02-crio.conf"
I0429 12:29:36.664869 1423526 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0429 12:29:36.664991 1423526 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0429 12:29:36.675620 1423526 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0429 12:29:36.686496 1423526 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0429 12:29:36.696937 1423526 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0429 12:29:36.706600 1423526 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0429 12:29:36.715963 1423526 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0429 12:29:36.724850 1423526 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0429 12:29:36.836251 1423526 ssh_runner.go:195] Run: sudo systemctl restart crio
I0429 12:29:36.976203 1423526 start.go:541] Will wait 60s for socket path /var/run/crio/crio.sock
I0429 12:29:36.976361 1423526 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0429 12:29:36.983700 1423526 start.go:562] Will wait 60s for crictl version
I0429 12:29:36.983832 1423526 ssh_runner.go:195] Run: which crictl
I0429 12:29:36.990597 1423526 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0429 12:29:37.061074 1423526 start.go:578] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.24.6
RuntimeApiVersion: v1
I0429 12:29:37.061199 1423526 ssh_runner.go:195] Run: crio --version
I0429 12:29:37.123211 1423526 ssh_runner.go:195] Run: crio --version
I0429 12:29:37.174959 1423526 out.go:177] * Preparing Kubernetes v1.20.0 on CRI-O 1.24.6 ...
I0429 12:29:37.176968 1423526 cli_runner.go:164] Run: docker network inspect old-k8s-version-425197 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I0429 12:29:37.194411 1423526 ssh_runner.go:195] Run: grep 192.168.85.1 host.minikube.internal$ /etc/hosts
I0429 12:29:37.198454 1423526 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.85.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0429 12:29:37.209791 1423526 kubeadm.go:877] updating cluster {Name:old-k8s-version-425197 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.43-1713736339-18706@sha256:bccd96633fa59b612ea2e24c6961d2499fe576afbab2e6056a6801ffbd3b1a7e Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-425197 Namespace:default APIServerHAVIP: APIServerName:minik
ubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins
:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0429 12:29:37.209909 1423526 preload.go:132] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0429 12:29:37.209959 1423526 ssh_runner.go:195] Run: sudo crictl images --output json
I0429 12:29:37.264751 1423526 crio.go:514] all images are preloaded for cri-o runtime.
I0429 12:29:37.264778 1423526 crio.go:433] Images already preloaded, skipping extraction
I0429 12:29:37.264831 1423526 ssh_runner.go:195] Run: sudo crictl images --output json
I0429 12:29:37.314169 1423526 crio.go:514] all images are preloaded for cri-o runtime.
I0429 12:29:37.314205 1423526 cache_images.go:84] Images are preloaded, skipping loading
I0429 12:29:37.314238 1423526 kubeadm.go:928] updating node { 192.168.85.2 8443 v1.20.0 crio true true} ...
I0429 12:29:37.314384 1423526 kubeadm.go:940] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.20.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --cgroups-per-qos=false --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///var/run/crio/crio.sock --enforce-node-allocatable= --hostname-override=old-k8s-version-425197 --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.85.2
[Install]
config:
{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-425197 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0429 12:29:37.314505 1423526 ssh_runner.go:195] Run: crio config
I0429 12:29:37.412337 1423526 cni.go:84] Creating CNI manager for ""
I0429 12:29:37.412363 1423526 cni.go:143] "docker" driver + "crio" runtime found, recommending kindnet
I0429 12:29:37.412399 1423526 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0429 12:29:37.412427 1423526 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.85.2 APIServerPort:8443 KubernetesVersion:v1.20.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-425197 NodeName:old-k8s-version-425197 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.85.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.85.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPo
dPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
I0429 12:29:37.412620 1423526 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta2
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.85.2
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /var/run/crio/crio.sock
name: "old-k8s-version-425197"
kubeletExtraArgs:
node-ip: 192.168.85.2
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta2
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.85.2"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.20.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0429 12:29:37.412763 1423526 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.20.0
I0429 12:29:37.422676 1423526 binaries.go:44] Found k8s binaries, skipping transfer
I0429 12:29:37.422772 1423526 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0429 12:29:37.432375 1423526 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (480 bytes)
I0429 12:29:37.452696 1423526 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0429 12:29:37.473000 1423526 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2117 bytes)
I0429 12:29:37.494379 1423526 ssh_runner.go:195] Run: grep 192.168.85.2 control-plane.minikube.internal$ /etc/hosts
I0429 12:29:37.498637 1423526 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.85.2 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0429 12:29:37.510457 1423526 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0429 12:29:37.623347 1423526 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0429 12:29:37.639876 1423526 certs.go:68] Setting up /home/jenkins/minikube-integration/18756-1231546/.minikube/profiles/old-k8s-version-425197 for IP: 192.168.85.2
I0429 12:29:37.639898 1423526 certs.go:194] generating shared ca certs ...
I0429 12:29:37.639935 1423526 certs.go:226] acquiring lock for ca certs: {Name:mkcd7972b318778b7d6fba570abab6a01a410b21 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0429 12:29:37.640101 1423526 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/18756-1231546/.minikube/ca.key
I0429 12:29:37.640186 1423526 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/18756-1231546/.minikube/proxy-client-ca.key
I0429 12:29:37.640201 1423526 certs.go:256] generating profile certs ...
I0429 12:29:37.640337 1423526 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/18756-1231546/.minikube/profiles/old-k8s-version-425197/client.key
I0429 12:29:37.640433 1423526 certs.go:359] skipping valid signed profile cert regeneration for "minikube": /home/jenkins/minikube-integration/18756-1231546/.minikube/profiles/old-k8s-version-425197/apiserver.key.76e8b9fd
I0429 12:29:37.640500 1423526 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/18756-1231546/.minikube/profiles/old-k8s-version-425197/proxy-client.key
I0429 12:29:37.640639 1423526 certs.go:484] found cert: /home/jenkins/minikube-integration/18756-1231546/.minikube/certs/1236974.pem (1338 bytes)
W0429 12:29:37.640707 1423526 certs.go:480] ignoring /home/jenkins/minikube-integration/18756-1231546/.minikube/certs/1236974_empty.pem, impossibly tiny 0 bytes
I0429 12:29:37.640722 1423526 certs.go:484] found cert: /home/jenkins/minikube-integration/18756-1231546/.minikube/certs/ca-key.pem (1679 bytes)
I0429 12:29:37.640747 1423526 certs.go:484] found cert: /home/jenkins/minikube-integration/18756-1231546/.minikube/certs/ca.pem (1082 bytes)
I0429 12:29:37.640808 1423526 certs.go:484] found cert: /home/jenkins/minikube-integration/18756-1231546/.minikube/certs/cert.pem (1123 bytes)
I0429 12:29:37.640854 1423526 certs.go:484] found cert: /home/jenkins/minikube-integration/18756-1231546/.minikube/certs/key.pem (1675 bytes)
I0429 12:29:37.640943 1423526 certs.go:484] found cert: /home/jenkins/minikube-integration/18756-1231546/.minikube/files/etc/ssl/certs/12369742.pem (1708 bytes)
I0429 12:29:37.641710 1423526 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18756-1231546/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0429 12:29:37.729114 1423526 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18756-1231546/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
I0429 12:29:37.798965 1423526 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18756-1231546/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0429 12:29:37.839700 1423526 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18756-1231546/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I0429 12:29:37.875448 1423526 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18756-1231546/.minikube/profiles/old-k8s-version-425197/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
I0429 12:29:37.902966 1423526 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18756-1231546/.minikube/profiles/old-k8s-version-425197/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I0429 12:29:37.928545 1423526 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18756-1231546/.minikube/profiles/old-k8s-version-425197/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0429 12:29:37.954321 1423526 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18756-1231546/.minikube/profiles/old-k8s-version-425197/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I0429 12:29:37.980738 1423526 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18756-1231546/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0429 12:29:38.009902 1423526 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18756-1231546/.minikube/certs/1236974.pem --> /usr/share/ca-certificates/1236974.pem (1338 bytes)
I0429 12:29:38.039446 1423526 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18756-1231546/.minikube/files/etc/ssl/certs/12369742.pem --> /usr/share/ca-certificates/12369742.pem (1708 bytes)
I0429 12:29:38.068352 1423526 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0429 12:29:38.090392 1423526 ssh_runner.go:195] Run: openssl version
I0429 12:29:38.097198 1423526 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0429 12:29:38.107920 1423526 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0429 12:29:38.112106 1423526 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Apr 29 11:34 /usr/share/ca-certificates/minikubeCA.pem
I0429 12:29:38.112192 1423526 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0429 12:29:38.119788 1423526 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0429 12:29:38.130096 1423526 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/1236974.pem && ln -fs /usr/share/ca-certificates/1236974.pem /etc/ssl/certs/1236974.pem"
I0429 12:29:38.140550 1423526 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/1236974.pem
I0429 12:29:38.144755 1423526 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Apr 29 11:45 /usr/share/ca-certificates/1236974.pem
I0429 12:29:38.144847 1423526 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/1236974.pem
I0429 12:29:38.152782 1423526 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/1236974.pem /etc/ssl/certs/51391683.0"
I0429 12:29:38.162869 1423526 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/12369742.pem && ln -fs /usr/share/ca-certificates/12369742.pem /etc/ssl/certs/12369742.pem"
I0429 12:29:38.173437 1423526 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/12369742.pem
I0429 12:29:38.177934 1423526 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Apr 29 11:45 /usr/share/ca-certificates/12369742.pem
I0429 12:29:38.178030 1423526 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/12369742.pem
I0429 12:29:38.185799 1423526 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/12369742.pem /etc/ssl/certs/3ec20f2e.0"
I0429 12:29:38.195525 1423526 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0429 12:29:38.199418 1423526 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-etcd-client.crt -checkend 86400
I0429 12:29:38.206455 1423526 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-kubelet-client.crt -checkend 86400
I0429 12:29:38.213462 1423526 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/server.crt -checkend 86400
I0429 12:29:38.220318 1423526 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/healthcheck-client.crt -checkend 86400
I0429 12:29:38.227369 1423526 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/peer.crt -checkend 86400
I0429 12:29:38.234352 1423526 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/front-proxy-client.crt -checkend 86400
I0429 12:29:38.241307 1423526 kubeadm.go:391] StartCluster: {Name:old-k8s-version-425197 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.43-1713736339-18706@sha256:bccd96633fa59b612ea2e24c6961d2499fe576afbab2e6056a6801ffbd3b1a7e Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-425197 Namespace:default APIServerHAVIP: APIServerName:minikube
CA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/m
inikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0429 12:29:38.241462 1423526 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I0429 12:29:38.241558 1423526 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0429 12:29:38.286028 1423526 cri.go:89] found id: ""
I0429 12:29:38.286178 1423526 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
W0429 12:29:38.296535 1423526 kubeadm.go:404] apiserver tunnel failed: apiserver port not set
I0429 12:29:38.296609 1423526 kubeadm.go:407] found existing configuration files, will attempt cluster restart
I0429 12:29:38.296629 1423526 kubeadm.go:587] restartPrimaryControlPlane start ...
I0429 12:29:38.296734 1423526 ssh_runner.go:195] Run: sudo test -d /data/minikube
I0429 12:29:38.306485 1423526 kubeadm.go:129] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1
stdout:
stderr:
I0429 12:29:38.307040 1423526 kubeconfig.go:47] verify endpoint returned: get endpoint: "old-k8s-version-425197" does not appear in /home/jenkins/minikube-integration/18756-1231546/kubeconfig
I0429 12:29:38.307211 1423526 kubeconfig.go:62] /home/jenkins/minikube-integration/18756-1231546/kubeconfig needs updating (will repair): [kubeconfig missing "old-k8s-version-425197" cluster setting kubeconfig missing "old-k8s-version-425197" context setting]
I0429 12:29:38.307587 1423526 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18756-1231546/kubeconfig: {Name:mk3a783043373f26fbcf8c9fca1b15742ae22d84 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0429 12:29:38.309218 1423526 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new
I0429 12:29:38.319147 1423526 kubeadm.go:624] The running cluster does not require reconfiguration: 192.168.85.2
I0429 12:29:38.319227 1423526 kubeadm.go:591] duration metric: took 22.568588ms to restartPrimaryControlPlane
I0429 12:29:38.319249 1423526 kubeadm.go:393] duration metric: took 77.951261ms to StartCluster
I0429 12:29:38.319291 1423526 settings.go:142] acquiring lock: {Name:mk0ef22430695db96615335cd2f3ba564b8d0f0a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0429 12:29:38.319379 1423526 settings.go:150] Updating kubeconfig: /home/jenkins/minikube-integration/18756-1231546/kubeconfig
I0429 12:29:38.320223 1423526 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18756-1231546/kubeconfig: {Name:mk3a783043373f26fbcf8c9fca1b15742ae22d84 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0429 12:29:38.320507 1423526 start.go:234] Will wait 6m0s for node &{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}
I0429 12:29:38.325258 1423526 out.go:177] * Verifying Kubernetes components...
I0429 12:29:38.320962 1423526 addons.go:502] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:true default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:false volumesnapshots:false yakd:false]
I0429 12:29:38.321608 1423526 config.go:182] Loaded profile config "old-k8s-version-425197": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.20.0
I0429 12:29:38.327231 1423526 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0429 12:29:38.325574 1423526 addons.go:69] Setting storage-provisioner=true in profile "old-k8s-version-425197"
I0429 12:29:38.327561 1423526 addons.go:234] Setting addon storage-provisioner=true in "old-k8s-version-425197"
W0429 12:29:38.327590 1423526 addons.go:243] addon storage-provisioner should already be in state true
I0429 12:29:38.327651 1423526 host.go:66] Checking if "old-k8s-version-425197" exists ...
I0429 12:29:38.328187 1423526 cli_runner.go:164] Run: docker container inspect old-k8s-version-425197 --format={{.State.Status}}
I0429 12:29:38.325584 1423526 addons.go:69] Setting dashboard=true in profile "old-k8s-version-425197"
I0429 12:29:38.328498 1423526 addons.go:234] Setting addon dashboard=true in "old-k8s-version-425197"
W0429 12:29:38.328519 1423526 addons.go:243] addon dashboard should already be in state true
I0429 12:29:38.328567 1423526 host.go:66] Checking if "old-k8s-version-425197" exists ...
I0429 12:29:38.329207 1423526 cli_runner.go:164] Run: docker container inspect old-k8s-version-425197 --format={{.State.Status}}
I0429 12:29:38.325591 1423526 addons.go:69] Setting default-storageclass=true in profile "old-k8s-version-425197"
I0429 12:29:38.329697 1423526 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "old-k8s-version-425197"
I0429 12:29:38.329960 1423526 cli_runner.go:164] Run: docker container inspect old-k8s-version-425197 --format={{.State.Status}}
I0429 12:29:38.325599 1423526 addons.go:69] Setting metrics-server=true in profile "old-k8s-version-425197"
I0429 12:29:38.330211 1423526 addons.go:234] Setting addon metrics-server=true in "old-k8s-version-425197"
W0429 12:29:38.330220 1423526 addons.go:243] addon metrics-server should already be in state true
I0429 12:29:38.330243 1423526 host.go:66] Checking if "old-k8s-version-425197" exists ...
I0429 12:29:38.330634 1423526 cli_runner.go:164] Run: docker container inspect old-k8s-version-425197 --format={{.State.Status}}
I0429 12:29:38.375235 1423526 out.go:177] - Using image registry.k8s.io/echoserver:1.4
I0429 12:29:38.381104 1423526 out.go:177] - Using image docker.io/kubernetesui/dashboard:v2.7.0
I0429 12:29:38.386379 1423526 addons.go:426] installing /etc/kubernetes/addons/dashboard-ns.yaml
I0429 12:29:38.386405 1423526 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-ns.yaml (759 bytes)
I0429 12:29:38.386477 1423526 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-425197
I0429 12:29:38.410651 1423526 out.go:177] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
I0429 12:29:38.410297 1423526 addons.go:234] Setting addon default-storageclass=true in "old-k8s-version-425197"
W0429 12:29:38.412495 1423526 addons.go:243] addon default-storageclass should already be in state true
I0429 12:29:38.412532 1423526 addons.go:426] installing /etc/kubernetes/addons/storage-provisioner.yaml
I0429 12:29:38.412547 1423526 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I0429 12:29:38.412550 1423526 host.go:66] Checking if "old-k8s-version-425197" exists ...
I0429 12:29:38.412604 1423526 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-425197
I0429 12:29:38.413067 1423526 cli_runner.go:164] Run: docker container inspect old-k8s-version-425197 --format={{.State.Status}}
I0429 12:29:38.424565 1423526 out.go:177] - Using image fake.domain/registry.k8s.io/echoserver:1.4
I0429 12:29:38.428651 1423526 addons.go:426] installing /etc/kubernetes/addons/metrics-apiservice.yaml
I0429 12:29:38.428705 1423526 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)
I0429 12:29:38.428776 1423526 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-425197
I0429 12:29:38.456778 1423526 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34568 SSHKeyPath:/home/jenkins/minikube-integration/18756-1231546/.minikube/machines/old-k8s-version-425197/id_rsa Username:docker}
I0429 12:29:38.463165 1423526 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34568 SSHKeyPath:/home/jenkins/minikube-integration/18756-1231546/.minikube/machines/old-k8s-version-425197/id_rsa Username:docker}
I0429 12:29:38.488861 1423526 addons.go:426] installing /etc/kubernetes/addons/storageclass.yaml
I0429 12:29:38.488889 1423526 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I0429 12:29:38.488952 1423526 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-425197
I0429 12:29:38.489728 1423526 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34568 SSHKeyPath:/home/jenkins/minikube-integration/18756-1231546/.minikube/machines/old-k8s-version-425197/id_rsa Username:docker}
I0429 12:29:38.520773 1423526 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34568 SSHKeyPath:/home/jenkins/minikube-integration/18756-1231546/.minikube/machines/old-k8s-version-425197/id_rsa Username:docker}
I0429 12:29:38.630610 1423526 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0429 12:29:38.643823 1423526 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I0429 12:29:38.674214 1423526 node_ready.go:35] waiting up to 6m0s for node "old-k8s-version-425197" to be "Ready" ...
I0429 12:29:38.707173 1423526 addons.go:426] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
I0429 12:29:38.707236 1423526 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1825 bytes)
I0429 12:29:38.727884 1423526 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
I0429 12:29:38.761440 1423526 addons.go:426] installing /etc/kubernetes/addons/dashboard-clusterrole.yaml
I0429 12:29:38.761463 1423526 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-clusterrole.yaml (1001 bytes)
I0429 12:29:38.790352 1423526 addons.go:426] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
I0429 12:29:38.790375 1423526 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)
I0429 12:29:38.859363 1423526 addons.go:426] installing /etc/kubernetes/addons/metrics-server-service.yaml
I0429 12:29:38.859385 1423526 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)
I0429 12:29:38.863572 1423526 addons.go:426] installing /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml
I0429 12:29:38.863636 1423526 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml (1018 bytes)
I0429 12:29:38.916181 1423526 addons.go:426] installing /etc/kubernetes/addons/dashboard-configmap.yaml
I0429 12:29:38.916248 1423526 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-configmap.yaml (837 bytes)
I0429 12:29:38.923877 1423526 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0429 12:29:38.959498 1423526 addons.go:426] installing /etc/kubernetes/addons/dashboard-dp.yaml
I0429 12:29:38.959564 1423526 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-dp.yaml (4201 bytes)
W0429 12:29:39.004837 1423526 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0429 12:29:39.004955 1423526 retry.go:31] will retry after 319.756205ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0429 12:29:39.044402 1423526 addons.go:426] installing /etc/kubernetes/addons/dashboard-role.yaml
I0429 12:29:39.044469 1423526 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-role.yaml (1724 bytes)
W0429 12:29:39.094933 1423526 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0429 12:29:39.095008 1423526 retry.go:31] will retry after 283.800387ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0429 12:29:39.110908 1423526 addons.go:426] installing /etc/kubernetes/addons/dashboard-rolebinding.yaml
I0429 12:29:39.110986 1423526 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-rolebinding.yaml (1046 bytes)
W0429 12:29:39.118896 1423526 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0429 12:29:39.118977 1423526 retry.go:31] will retry after 274.747985ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0429 12:29:39.140125 1423526 addons.go:426] installing /etc/kubernetes/addons/dashboard-sa.yaml
I0429 12:29:39.140193 1423526 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-sa.yaml (837 bytes)
I0429 12:29:39.160352 1423526 addons.go:426] installing /etc/kubernetes/addons/dashboard-secret.yaml
I0429 12:29:39.160380 1423526 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-secret.yaml (1389 bytes)
I0429 12:29:39.186907 1423526 addons.go:426] installing /etc/kubernetes/addons/dashboard-svc.yaml
I0429 12:29:39.186994 1423526 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-svc.yaml (1294 bytes)
I0429 12:29:39.217354 1423526 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0429 12:29:39.312535 1423526 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0429 12:29:39.312571 1423526 retry.go:31] will retry after 265.440094ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0429 12:29:39.325860 1423526 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
I0429 12:29:39.379273 1423526 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
I0429 12:29:39.394685 1423526 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W0429 12:29:39.437157 1423526 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0429 12:29:39.437195 1423526 retry.go:31] will retry after 338.595367ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0429 12:29:39.512262 1423526 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0429 12:29:39.512302 1423526 retry.go:31] will retry after 437.575066ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0429 12:29:39.568269 1423526 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0429 12:29:39.568304 1423526 retry.go:31] will retry after 451.297571ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0429 12:29:39.578471 1423526 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0429 12:29:39.693126 1423526 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0429 12:29:39.693168 1423526 retry.go:31] will retry after 298.918696ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0429 12:29:39.776539 1423526 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W0429 12:29:39.870874 1423526 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0429 12:29:39.870915 1423526 retry.go:31] will retry after 541.7755ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0429 12:29:39.950281 1423526 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
I0429 12:29:39.992981 1423526 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
I0429 12:29:40.020553 1423526 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W0429 12:29:40.130252 1423526 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0429 12:29:40.130333 1423526 retry.go:31] will retry after 841.066499ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0429 12:29:40.308357 1423526 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0429 12:29:40.308398 1423526 retry.go:31] will retry after 680.408618ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0429 12:29:40.308504 1423526 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0429 12:29:40.308519 1423526 retry.go:31] will retry after 542.233805ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0429 12:29:40.412900 1423526 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W0429 12:29:40.479794 1423526 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0429 12:29:40.479826 1423526 retry.go:31] will retry after 912.439906ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0429 12:29:40.675531 1423526 node_ready.go:53] error getting node "old-k8s-version-425197": Get "https://192.168.85.2:8443/api/v1/nodes/old-k8s-version-425197": dial tcp 192.168.85.2:8443: connect: connection refused
I0429 12:29:40.851844 1423526 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0429 12:29:40.972427 1423526 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W0429 12:29:40.988055 1423526 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0429 12:29:40.988159 1423526 retry.go:31] will retry after 735.396676ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0429 12:29:40.989289 1423526 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0429 12:29:41.160258 1423526 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0429 12:29:41.160358 1423526 retry.go:31] will retry after 814.498657ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0429 12:29:41.182957 1423526 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0429 12:29:41.183042 1423526 retry.go:31] will retry after 466.844422ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0429 12:29:41.393451 1423526 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W0429 12:29:41.530554 1423526 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0429 12:29:41.530645 1423526 retry.go:31] will retry after 1.357697339s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0429 12:29:41.650964 1423526 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
I0429 12:29:41.723878 1423526 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W0429 12:29:41.786910 1423526 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0429 12:29:41.786984 1423526 retry.go:31] will retry after 1.32078294s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0429 12:29:41.884757 1423526 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0429 12:29:41.884835 1423526 retry.go:31] will retry after 886.437374ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0429 12:29:41.975156 1423526 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W0429 12:29:42.092616 1423526 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0429 12:29:42.092763 1423526 retry.go:31] will retry after 1.106535704s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0429 12:29:42.771623 1423526 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0429 12:29:42.889016 1423526 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W0429 12:29:42.956478 1423526 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0429 12:29:42.956573 1423526 retry.go:31] will retry after 1.882216868s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0429 12:29:43.022210 1423526 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0429 12:29:43.022292 1423526 retry.go:31] will retry after 1.541895075s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0429 12:29:43.108586 1423526 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
I0429 12:29:43.175241 1423526 node_ready.go:53] error getting node "old-k8s-version-425197": Get "https://192.168.85.2:8443/api/v1/nodes/old-k8s-version-425197": dial tcp 192.168.85.2:8443: connect: connection refused
I0429 12:29:43.199521 1423526 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W0429 12:29:43.274241 1423526 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0429 12:29:43.274341 1423526 retry.go:31] will retry after 2.715219101s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
W0429 12:29:43.345949 1423526 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0429 12:29:43.346025 1423526 retry.go:31] will retry after 1.820226638s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0429 12:29:44.565325 1423526 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W0429 12:29:44.689160 1423526 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0429 12:29:44.689240 1423526 retry.go:31] will retry after 1.798482465s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0429 12:29:44.839617 1423526 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W0429 12:29:44.956268 1423526 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0429 12:29:44.956361 1423526 retry.go:31] will retry after 2.071817613s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0429 12:29:45.167165 1423526 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
W0429 12:29:45.330247 1423526 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0429 12:29:45.330334 1423526 retry.go:31] will retry after 3.548115218s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0429 12:29:45.675129 1423526 node_ready.go:53] error getting node "old-k8s-version-425197": Get "https://192.168.85.2:8443/api/v1/nodes/old-k8s-version-425197": dial tcp 192.168.85.2:8443: connect: connection refused
I0429 12:29:45.990475 1423526 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
W0429 12:29:46.112209 1423526 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0429 12:29:46.112293 1423526 retry.go:31] will retry after 1.629993189s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0429 12:29:46.488122 1423526 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
W0429 12:29:46.563794 1423526 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0429 12:29:46.563828 1423526 retry.go:31] will retry after 3.366606992s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0429 12:29:47.028948 1423526 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
W0429 12:29:47.322030 1423526 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0429 12:29:47.322069 1423526 retry.go:31] will retry after 2.376504476s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
I0429 12:29:47.743369 1423526 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
I0429 12:29:48.878679 1423526 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
I0429 12:29:49.698860 1423526 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0429 12:29:49.931236 1423526 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
I0429 12:29:56.034033 1423526 node_ready.go:49] node "old-k8s-version-425197" has status "Ready":"True"
I0429 12:29:56.034058 1423526 node_ready.go:38] duration metric: took 17.359768121s for node "old-k8s-version-425197" to be "Ready" ...
I0429 12:29:56.034069 1423526 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0429 12:29:56.351914 1423526 pod_ready.go:78] waiting up to 6m0s for pod "coredns-74ff55c5b-hzh92" in "kube-system" namespace to be "Ready" ...
I0429 12:29:56.651744 1423526 pod_ready.go:92] pod "coredns-74ff55c5b-hzh92" in "kube-system" namespace has status "Ready":"True"
I0429 12:29:56.651822 1423526 pod_ready.go:81] duration metric: took 299.818944ms for pod "coredns-74ff55c5b-hzh92" in "kube-system" namespace to be "Ready" ...
I0429 12:29:56.651848 1423526 pod_ready.go:78] waiting up to 6m0s for pod "etcd-old-k8s-version-425197" in "kube-system" namespace to be "Ready" ...
I0429 12:29:57.490636 1423526 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: (9.747209181s)
I0429 12:29:57.492903 1423526 out.go:177] * Some dashboard features require the metrics-server addon. To enable all features please run:
minikube -p old-k8s-version-425197 addons enable metrics-server
I0429 12:29:57.490747 1423526 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: (8.612037224s)
I0429 12:29:57.490817 1423526 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (7.791883052s)
I0429 12:29:57.490861 1423526 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: (7.559602701s)
I0429 12:29:57.493344 1423526 addons.go:470] Verifying addon metrics-server=true in "old-k8s-version-425197"
I0429 12:29:57.506880 1423526 out.go:177] * Enabled addons: storage-provisioner, dashboard, metrics-server, default-storageclass
I0429 12:29:57.508901 1423526 addons.go:505] duration metric: took 19.187956652s for enable addons: enabled=[storage-provisioner dashboard metrics-server default-storageclass]
I0429 12:29:58.662821 1423526 pod_ready.go:102] pod "etcd-old-k8s-version-425197" in "kube-system" namespace has status "Ready":"False"
I0429 12:30:01.160333 1423526 pod_ready.go:102] pod "etcd-old-k8s-version-425197" in "kube-system" namespace has status "Ready":"False"
I0429 12:30:03.658875 1423526 pod_ready.go:102] pod "etcd-old-k8s-version-425197" in "kube-system" namespace has status "Ready":"False"
I0429 12:30:06.160600 1423526 pod_ready.go:102] pod "etcd-old-k8s-version-425197" in "kube-system" namespace has status "Ready":"False"
I0429 12:30:08.659260 1423526 pod_ready.go:102] pod "etcd-old-k8s-version-425197" in "kube-system" namespace has status "Ready":"False"
I0429 12:30:11.159044 1423526 pod_ready.go:102] pod "etcd-old-k8s-version-425197" in "kube-system" namespace has status "Ready":"False"
I0429 12:30:13.165523 1423526 pod_ready.go:102] pod "etcd-old-k8s-version-425197" in "kube-system" namespace has status "Ready":"False"
I0429 12:30:15.659578 1423526 pod_ready.go:102] pod "etcd-old-k8s-version-425197" in "kube-system" namespace has status "Ready":"False"
I0429 12:30:18.159534 1423526 pod_ready.go:102] pod "etcd-old-k8s-version-425197" in "kube-system" namespace has status "Ready":"False"
I0429 12:30:20.160852 1423526 pod_ready.go:102] pod "etcd-old-k8s-version-425197" in "kube-system" namespace has status "Ready":"False"
I0429 12:30:22.192441 1423526 pod_ready.go:102] pod "etcd-old-k8s-version-425197" in "kube-system" namespace has status "Ready":"False"
I0429 12:30:24.657368 1423526 pod_ready.go:102] pod "etcd-old-k8s-version-425197" in "kube-system" namespace has status "Ready":"False"
I0429 12:30:26.659286 1423526 pod_ready.go:102] pod "etcd-old-k8s-version-425197" in "kube-system" namespace has status "Ready":"False"
I0429 12:30:29.158032 1423526 pod_ready.go:102] pod "etcd-old-k8s-version-425197" in "kube-system" namespace has status "Ready":"False"
I0429 12:30:31.158150 1423526 pod_ready.go:102] pod "etcd-old-k8s-version-425197" in "kube-system" namespace has status "Ready":"False"
I0429 12:30:33.159696 1423526 pod_ready.go:102] pod "etcd-old-k8s-version-425197" in "kube-system" namespace has status "Ready":"False"
I0429 12:30:35.659044 1423526 pod_ready.go:102] pod "etcd-old-k8s-version-425197" in "kube-system" namespace has status "Ready":"False"
I0429 12:30:38.158319 1423526 pod_ready.go:102] pod "etcd-old-k8s-version-425197" in "kube-system" namespace has status "Ready":"False"
I0429 12:30:40.159205 1423526 pod_ready.go:102] pod "etcd-old-k8s-version-425197" in "kube-system" namespace has status "Ready":"False"
I0429 12:30:42.168787 1423526 pod_ready.go:102] pod "etcd-old-k8s-version-425197" in "kube-system" namespace has status "Ready":"False"
I0429 12:30:44.657757 1423526 pod_ready.go:102] pod "etcd-old-k8s-version-425197" in "kube-system" namespace has status "Ready":"False"
I0429 12:30:46.669613 1423526 pod_ready.go:102] pod "etcd-old-k8s-version-425197" in "kube-system" namespace has status "Ready":"False"
I0429 12:30:49.157900 1423526 pod_ready.go:102] pod "etcd-old-k8s-version-425197" in "kube-system" namespace has status "Ready":"False"
I0429 12:30:51.158663 1423526 pod_ready.go:102] pod "etcd-old-k8s-version-425197" in "kube-system" namespace has status "Ready":"False"
I0429 12:30:53.158704 1423526 pod_ready.go:102] pod "etcd-old-k8s-version-425197" in "kube-system" namespace has status "Ready":"False"
I0429 12:30:55.158763 1423526 pod_ready.go:102] pod "etcd-old-k8s-version-425197" in "kube-system" namespace has status "Ready":"False"
I0429 12:30:57.658025 1423526 pod_ready.go:102] pod "etcd-old-k8s-version-425197" in "kube-system" namespace has status "Ready":"False"
I0429 12:30:59.658548 1423526 pod_ready.go:102] pod "etcd-old-k8s-version-425197" in "kube-system" namespace has status "Ready":"False"
I0429 12:31:01.658697 1423526 pod_ready.go:102] pod "etcd-old-k8s-version-425197" in "kube-system" namespace has status "Ready":"False"
I0429 12:31:04.160012 1423526 pod_ready.go:102] pod "etcd-old-k8s-version-425197" in "kube-system" namespace has status "Ready":"False"
I0429 12:31:06.160634 1423526 pod_ready.go:102] pod "etcd-old-k8s-version-425197" in "kube-system" namespace has status "Ready":"False"
I0429 12:31:08.661388 1423526 pod_ready.go:102] pod "etcd-old-k8s-version-425197" in "kube-system" namespace has status "Ready":"False"
I0429 12:31:11.157936 1423526 pod_ready.go:102] pod "etcd-old-k8s-version-425197" in "kube-system" namespace has status "Ready":"False"
I0429 12:31:13.158470 1423526 pod_ready.go:102] pod "etcd-old-k8s-version-425197" in "kube-system" namespace has status "Ready":"False"
I0429 12:31:15.158596 1423526 pod_ready.go:102] pod "etcd-old-k8s-version-425197" in "kube-system" namespace has status "Ready":"False"
I0429 12:31:16.659039 1423526 pod_ready.go:92] pod "etcd-old-k8s-version-425197" in "kube-system" namespace has status "Ready":"True"
I0429 12:31:16.659108 1423526 pod_ready.go:81] duration metric: took 1m20.007238923s for pod "etcd-old-k8s-version-425197" in "kube-system" namespace to be "Ready" ...
I0429 12:31:16.659136 1423526 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-old-k8s-version-425197" in "kube-system" namespace to be "Ready" ...
I0429 12:31:16.675507 1423526 pod_ready.go:92] pod "kube-apiserver-old-k8s-version-425197" in "kube-system" namespace has status "Ready":"True"
I0429 12:31:16.675579 1423526 pod_ready.go:81] duration metric: took 16.423539ms for pod "kube-apiserver-old-k8s-version-425197" in "kube-system" namespace to be "Ready" ...
I0429 12:31:16.675605 1423526 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-old-k8s-version-425197" in "kube-system" namespace to be "Ready" ...
I0429 12:31:18.682438 1423526 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-425197" in "kube-system" namespace has status "Ready":"False"
I0429 12:31:20.685999 1423526 pod_ready.go:92] pod "kube-controller-manager-old-k8s-version-425197" in "kube-system" namespace has status "Ready":"True"
I0429 12:31:20.686025 1423526 pod_ready.go:81] duration metric: took 4.010401085s for pod "kube-controller-manager-old-k8s-version-425197" in "kube-system" namespace to be "Ready" ...
I0429 12:31:20.686037 1423526 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-5hlxl" in "kube-system" namespace to be "Ready" ...
I0429 12:31:20.691720 1423526 pod_ready.go:92] pod "kube-proxy-5hlxl" in "kube-system" namespace has status "Ready":"True"
I0429 12:31:20.691748 1423526 pod_ready.go:81] duration metric: took 5.702894ms for pod "kube-proxy-5hlxl" in "kube-system" namespace to be "Ready" ...
I0429 12:31:20.691758 1423526 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-old-k8s-version-425197" in "kube-system" namespace to be "Ready" ...
I0429 12:31:20.696293 1423526 pod_ready.go:92] pod "kube-scheduler-old-k8s-version-425197" in "kube-system" namespace has status "Ready":"True"
I0429 12:31:20.696316 1423526 pod_ready.go:81] duration metric: took 4.549956ms for pod "kube-scheduler-old-k8s-version-425197" in "kube-system" namespace to be "Ready" ...
I0429 12:31:20.696327 1423526 pod_ready.go:78] waiting up to 6m0s for pod "metrics-server-9975d5f86-jgp2v" in "kube-system" namespace to be "Ready" ...
I0429 12:31:22.702549 1423526 pod_ready.go:102] pod "metrics-server-9975d5f86-jgp2v" in "kube-system" namespace has status "Ready":"False"
I0429 12:31:25.210005 1423526 pod_ready.go:102] pod "metrics-server-9975d5f86-jgp2v" in "kube-system" namespace has status "Ready":"False"
I0429 12:31:27.702418 1423526 pod_ready.go:102] pod "metrics-server-9975d5f86-jgp2v" in "kube-system" namespace has status "Ready":"False"
I0429 12:31:29.702592 1423526 pod_ready.go:102] pod "metrics-server-9975d5f86-jgp2v" in "kube-system" namespace has status "Ready":"False"
I0429 12:31:32.203232 1423526 pod_ready.go:102] pod "metrics-server-9975d5f86-jgp2v" in "kube-system" namespace has status "Ready":"False"
I0429 12:31:34.704517 1423526 pod_ready.go:102] pod "metrics-server-9975d5f86-jgp2v" in "kube-system" namespace has status "Ready":"False"
I0429 12:31:37.202851 1423526 pod_ready.go:102] pod "metrics-server-9975d5f86-jgp2v" in "kube-system" namespace has status "Ready":"False"
I0429 12:31:39.702782 1423526 pod_ready.go:102] pod "metrics-server-9975d5f86-jgp2v" in "kube-system" namespace has status "Ready":"False"
I0429 12:31:41.709985 1423526 pod_ready.go:102] pod "metrics-server-9975d5f86-jgp2v" in "kube-system" namespace has status "Ready":"False"
I0429 12:31:44.203529 1423526 pod_ready.go:102] pod "metrics-server-9975d5f86-jgp2v" in "kube-system" namespace has status "Ready":"False"
I0429 12:31:46.708121 1423526 pod_ready.go:102] pod "metrics-server-9975d5f86-jgp2v" in "kube-system" namespace has status "Ready":"False"
I0429 12:31:49.202526 1423526 pod_ready.go:102] pod "metrics-server-9975d5f86-jgp2v" in "kube-system" namespace has status "Ready":"False"
I0429 12:31:51.202777 1423526 pod_ready.go:102] pod "metrics-server-9975d5f86-jgp2v" in "kube-system" namespace has status "Ready":"False"
I0429 12:31:53.203345 1423526 pod_ready.go:102] pod "metrics-server-9975d5f86-jgp2v" in "kube-system" namespace has status "Ready":"False"
I0429 12:31:55.203403 1423526 pod_ready.go:102] pod "metrics-server-9975d5f86-jgp2v" in "kube-system" namespace has status "Ready":"False"
I0429 12:31:57.702567 1423526 pod_ready.go:102] pod "metrics-server-9975d5f86-jgp2v" in "kube-system" namespace has status "Ready":"False"
I0429 12:31:59.702725 1423526 pod_ready.go:102] pod "metrics-server-9975d5f86-jgp2v" in "kube-system" namespace has status "Ready":"False"
I0429 12:32:01.703117 1423526 pod_ready.go:102] pod "metrics-server-9975d5f86-jgp2v" in "kube-system" namespace has status "Ready":"False"
I0429 12:32:04.202420 1423526 pod_ready.go:102] pod "metrics-server-9975d5f86-jgp2v" in "kube-system" namespace has status "Ready":"False"
I0429 12:32:06.202813 1423526 pod_ready.go:102] pod "metrics-server-9975d5f86-jgp2v" in "kube-system" namespace has status "Ready":"False"
I0429 12:32:08.702998 1423526 pod_ready.go:102] pod "metrics-server-9975d5f86-jgp2v" in "kube-system" namespace has status "Ready":"False"
I0429 12:32:11.202188 1423526 pod_ready.go:102] pod "metrics-server-9975d5f86-jgp2v" in "kube-system" namespace has status "Ready":"False"
I0429 12:32:13.202404 1423526 pod_ready.go:102] pod "metrics-server-9975d5f86-jgp2v" in "kube-system" namespace has status "Ready":"False"
I0429 12:32:15.202648 1423526 pod_ready.go:102] pod "metrics-server-9975d5f86-jgp2v" in "kube-system" namespace has status "Ready":"False"
I0429 12:32:17.203192 1423526 pod_ready.go:102] pod "metrics-server-9975d5f86-jgp2v" in "kube-system" namespace has status "Ready":"False"
I0429 12:32:19.205236 1423526 pod_ready.go:102] pod "metrics-server-9975d5f86-jgp2v" in "kube-system" namespace has status "Ready":"False"
I0429 12:32:21.702316 1423526 pod_ready.go:102] pod "metrics-server-9975d5f86-jgp2v" in "kube-system" namespace has status "Ready":"False"
I0429 12:32:24.201812 1423526 pod_ready.go:102] pod "metrics-server-9975d5f86-jgp2v" in "kube-system" namespace has status "Ready":"False"
I0429 12:32:26.202781 1423526 pod_ready.go:102] pod "metrics-server-9975d5f86-jgp2v" in "kube-system" namespace has status "Ready":"False"
I0429 12:32:28.702682 1423526 pod_ready.go:102] pod "metrics-server-9975d5f86-jgp2v" in "kube-system" namespace has status "Ready":"False"
I0429 12:32:31.202966 1423526 pod_ready.go:102] pod "metrics-server-9975d5f86-jgp2v" in "kube-system" namespace has status "Ready":"False"
I0429 12:32:33.702116 1423526 pod_ready.go:102] pod "metrics-server-9975d5f86-jgp2v" in "kube-system" namespace has status "Ready":"False"
I0429 12:32:35.703230 1423526 pod_ready.go:102] pod "metrics-server-9975d5f86-jgp2v" in "kube-system" namespace has status "Ready":"False"
I0429 12:32:38.202119 1423526 pod_ready.go:102] pod "metrics-server-9975d5f86-jgp2v" in "kube-system" namespace has status "Ready":"False"
I0429 12:32:40.203165 1423526 pod_ready.go:102] pod "metrics-server-9975d5f86-jgp2v" in "kube-system" namespace has status "Ready":"False"
I0429 12:32:42.204576 1423526 pod_ready.go:102] pod "metrics-server-9975d5f86-jgp2v" in "kube-system" namespace has status "Ready":"False"
I0429 12:32:44.703016 1423526 pod_ready.go:102] pod "metrics-server-9975d5f86-jgp2v" in "kube-system" namespace has status "Ready":"False"
I0429 12:32:47.201415 1423526 pod_ready.go:102] pod "metrics-server-9975d5f86-jgp2v" in "kube-system" namespace has status "Ready":"False"
I0429 12:32:49.209666 1423526 pod_ready.go:102] pod "metrics-server-9975d5f86-jgp2v" in "kube-system" namespace has status "Ready":"False"
I0429 12:32:51.701956 1423526 pod_ready.go:102] pod "metrics-server-9975d5f86-jgp2v" in "kube-system" namespace has status "Ready":"False"
I0429 12:32:53.702673 1423526 pod_ready.go:102] pod "metrics-server-9975d5f86-jgp2v" in "kube-system" namespace has status "Ready":"False"
I0429 12:32:56.202663 1423526 pod_ready.go:102] pod "metrics-server-9975d5f86-jgp2v" in "kube-system" namespace has status "Ready":"False"
I0429 12:32:58.702663 1423526 pod_ready.go:102] pod "metrics-server-9975d5f86-jgp2v" in "kube-system" namespace has status "Ready":"False"
I0429 12:33:00.703215 1423526 pod_ready.go:102] pod "metrics-server-9975d5f86-jgp2v" in "kube-system" namespace has status "Ready":"False"
I0429 12:33:02.703370 1423526 pod_ready.go:102] pod "metrics-server-9975d5f86-jgp2v" in "kube-system" namespace has status "Ready":"False"
I0429 12:33:05.203534 1423526 pod_ready.go:102] pod "metrics-server-9975d5f86-jgp2v" in "kube-system" namespace has status "Ready":"False"
I0429 12:33:07.703154 1423526 pod_ready.go:102] pod "metrics-server-9975d5f86-jgp2v" in "kube-system" namespace has status "Ready":"False"
I0429 12:33:10.203145 1423526 pod_ready.go:102] pod "metrics-server-9975d5f86-jgp2v" in "kube-system" namespace has status "Ready":"False"
I0429 12:33:12.702544 1423526 pod_ready.go:102] pod "metrics-server-9975d5f86-jgp2v" in "kube-system" namespace has status "Ready":"False"
I0429 12:33:14.708076 1423526 pod_ready.go:102] pod "metrics-server-9975d5f86-jgp2v" in "kube-system" namespace has status "Ready":"False"
I0429 12:33:17.203711 1423526 pod_ready.go:102] pod "metrics-server-9975d5f86-jgp2v" in "kube-system" namespace has status "Ready":"False"
I0429 12:33:19.702677 1423526 pod_ready.go:102] pod "metrics-server-9975d5f86-jgp2v" in "kube-system" namespace has status "Ready":"False"
I0429 12:33:21.702963 1423526 pod_ready.go:102] pod "metrics-server-9975d5f86-jgp2v" in "kube-system" namespace has status "Ready":"False"
I0429 12:33:24.202732 1423526 pod_ready.go:102] pod "metrics-server-9975d5f86-jgp2v" in "kube-system" namespace has status "Ready":"False"
I0429 12:33:26.208558 1423526 pod_ready.go:102] pod "metrics-server-9975d5f86-jgp2v" in "kube-system" namespace has status "Ready":"False"
I0429 12:33:28.702913 1423526 pod_ready.go:102] pod "metrics-server-9975d5f86-jgp2v" in "kube-system" namespace has status "Ready":"False"
I0429 12:33:31.202070 1423526 pod_ready.go:102] pod "metrics-server-9975d5f86-jgp2v" in "kube-system" namespace has status "Ready":"False"
I0429 12:33:33.202486 1423526 pod_ready.go:102] pod "metrics-server-9975d5f86-jgp2v" in "kube-system" namespace has status "Ready":"False"
I0429 12:33:35.701905 1423526 pod_ready.go:102] pod "metrics-server-9975d5f86-jgp2v" in "kube-system" namespace has status "Ready":"False"
I0429 12:33:37.703024 1423526 pod_ready.go:102] pod "metrics-server-9975d5f86-jgp2v" in "kube-system" namespace has status "Ready":"False"
I0429 12:33:40.202602 1423526 pod_ready.go:102] pod "metrics-server-9975d5f86-jgp2v" in "kube-system" namespace has status "Ready":"False"
I0429 12:33:42.207391 1423526 pod_ready.go:102] pod "metrics-server-9975d5f86-jgp2v" in "kube-system" namespace has status "Ready":"False"
I0429 12:33:44.702942 1423526 pod_ready.go:102] pod "metrics-server-9975d5f86-jgp2v" in "kube-system" namespace has status "Ready":"False"
I0429 12:33:47.202990 1423526 pod_ready.go:102] pod "metrics-server-9975d5f86-jgp2v" in "kube-system" namespace has status "Ready":"False"
I0429 12:33:49.203155 1423526 pod_ready.go:102] pod "metrics-server-9975d5f86-jgp2v" in "kube-system" namespace has status "Ready":"False"
I0429 12:33:51.702215 1423526 pod_ready.go:102] pod "metrics-server-9975d5f86-jgp2v" in "kube-system" namespace has status "Ready":"False"
I0429 12:33:53.702289 1423526 pod_ready.go:102] pod "metrics-server-9975d5f86-jgp2v" in "kube-system" namespace has status "Ready":"False"
I0429 12:33:56.203241 1423526 pod_ready.go:102] pod "metrics-server-9975d5f86-jgp2v" in "kube-system" namespace has status "Ready":"False"
I0429 12:33:58.702576 1423526 pod_ready.go:102] pod "metrics-server-9975d5f86-jgp2v" in "kube-system" namespace has status "Ready":"False"
I0429 12:34:01.202075 1423526 pod_ready.go:102] pod "metrics-server-9975d5f86-jgp2v" in "kube-system" namespace has status "Ready":"False"
I0429 12:34:03.203019 1423526 pod_ready.go:102] pod "metrics-server-9975d5f86-jgp2v" in "kube-system" namespace has status "Ready":"False"
I0429 12:34:05.203195 1423526 pod_ready.go:102] pod "metrics-server-9975d5f86-jgp2v" in "kube-system" namespace has status "Ready":"False"
I0429 12:34:07.702226 1423526 pod_ready.go:102] pod "metrics-server-9975d5f86-jgp2v" in "kube-system" namespace has status "Ready":"False"
I0429 12:34:09.703978 1423526 pod_ready.go:102] pod "metrics-server-9975d5f86-jgp2v" in "kube-system" namespace has status "Ready":"False"
I0429 12:34:12.203051 1423526 pod_ready.go:102] pod "metrics-server-9975d5f86-jgp2v" in "kube-system" namespace has status "Ready":"False"
I0429 12:34:14.203120 1423526 pod_ready.go:102] pod "metrics-server-9975d5f86-jgp2v" in "kube-system" namespace has status "Ready":"False"
I0429 12:34:16.702005 1423526 pod_ready.go:102] pod "metrics-server-9975d5f86-jgp2v" in "kube-system" namespace has status "Ready":"False"
I0429 12:34:18.702679 1423526 pod_ready.go:102] pod "metrics-server-9975d5f86-jgp2v" in "kube-system" namespace has status "Ready":"False"
I0429 12:34:20.702798 1423526 pod_ready.go:102] pod "metrics-server-9975d5f86-jgp2v" in "kube-system" namespace has status "Ready":"False"
I0429 12:34:23.203385 1423526 pod_ready.go:102] pod "metrics-server-9975d5f86-jgp2v" in "kube-system" namespace has status "Ready":"False"
I0429 12:34:25.703235 1423526 pod_ready.go:102] pod "metrics-server-9975d5f86-jgp2v" in "kube-system" namespace has status "Ready":"False"
I0429 12:34:28.207637 1423526 pod_ready.go:102] pod "metrics-server-9975d5f86-jgp2v" in "kube-system" namespace has status "Ready":"False"
I0429 12:34:30.702987 1423526 pod_ready.go:102] pod "metrics-server-9975d5f86-jgp2v" in "kube-system" namespace has status "Ready":"False"
I0429 12:34:33.202872 1423526 pod_ready.go:102] pod "metrics-server-9975d5f86-jgp2v" in "kube-system" namespace has status "Ready":"False"
I0429 12:34:35.702139 1423526 pod_ready.go:102] pod "metrics-server-9975d5f86-jgp2v" in "kube-system" namespace has status "Ready":"False"
I0429 12:34:37.703764 1423526 pod_ready.go:102] pod "metrics-server-9975d5f86-jgp2v" in "kube-system" namespace has status "Ready":"False"
I0429 12:34:40.206946 1423526 pod_ready.go:102] pod "metrics-server-9975d5f86-jgp2v" in "kube-system" namespace has status "Ready":"False"
I0429 12:34:42.701852 1423526 pod_ready.go:102] pod "metrics-server-9975d5f86-jgp2v" in "kube-system" namespace has status "Ready":"False"
I0429 12:34:44.702301 1423526 pod_ready.go:102] pod "metrics-server-9975d5f86-jgp2v" in "kube-system" namespace has status "Ready":"False"
I0429 12:34:46.702688 1423526 pod_ready.go:102] pod "metrics-server-9975d5f86-jgp2v" in "kube-system" namespace has status "Ready":"False"
I0429 12:34:49.203179 1423526 pod_ready.go:102] pod "metrics-server-9975d5f86-jgp2v" in "kube-system" namespace has status "Ready":"False"
I0429 12:34:51.702389 1423526 pod_ready.go:102] pod "metrics-server-9975d5f86-jgp2v" in "kube-system" namespace has status "Ready":"False"
I0429 12:34:53.702533 1423526 pod_ready.go:102] pod "metrics-server-9975d5f86-jgp2v" in "kube-system" namespace has status "Ready":"False"
I0429 12:34:56.202760 1423526 pod_ready.go:102] pod "metrics-server-9975d5f86-jgp2v" in "kube-system" namespace has status "Ready":"False"
I0429 12:34:58.702554 1423526 pod_ready.go:102] pod "metrics-server-9975d5f86-jgp2v" in "kube-system" namespace has status "Ready":"False"
I0429 12:35:00.702815 1423526 pod_ready.go:102] pod "metrics-server-9975d5f86-jgp2v" in "kube-system" namespace has status "Ready":"False"
I0429 12:35:03.202352 1423526 pod_ready.go:102] pod "metrics-server-9975d5f86-jgp2v" in "kube-system" namespace has status "Ready":"False"
I0429 12:35:05.701627 1423526 pod_ready.go:102] pod "metrics-server-9975d5f86-jgp2v" in "kube-system" namespace has status "Ready":"False"
I0429 12:35:07.703105 1423526 pod_ready.go:102] pod "metrics-server-9975d5f86-jgp2v" in "kube-system" namespace has status "Ready":"False"
I0429 12:35:10.203203 1423526 pod_ready.go:102] pod "metrics-server-9975d5f86-jgp2v" in "kube-system" namespace has status "Ready":"False"
I0429 12:35:12.203403 1423526 pod_ready.go:102] pod "metrics-server-9975d5f86-jgp2v" in "kube-system" namespace has status "Ready":"False"
I0429 12:35:14.702578 1423526 pod_ready.go:102] pod "metrics-server-9975d5f86-jgp2v" in "kube-system" namespace has status "Ready":"False"
I0429 12:35:16.703119 1423526 pod_ready.go:102] pod "metrics-server-9975d5f86-jgp2v" in "kube-system" namespace has status "Ready":"False"
I0429 12:35:18.753152 1423526 pod_ready.go:102] pod "metrics-server-9975d5f86-jgp2v" in "kube-system" namespace has status "Ready":"False"
I0429 12:35:20.702356 1423526 pod_ready.go:81] duration metric: took 4m0.006015034s for pod "metrics-server-9975d5f86-jgp2v" in "kube-system" namespace to be "Ready" ...
E0429 12:35:20.702382 1423526 pod_ready.go:66] WaitExtra: waitPodCondition: context deadline exceeded
I0429 12:35:20.702391 1423526 pod_ready.go:38] duration metric: took 5m24.668311478s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0429 12:35:20.702406 1423526 api_server.go:52] waiting for apiserver process to appear ...
I0429 12:35:20.702434 1423526 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I0429 12:35:20.702498 1423526 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0429 12:35:20.747258 1423526 cri.go:89] found id: "f70d0c48d399667aeefaece1ef554897ebeb68eb674e2b89d699347639d7798f"
I0429 12:35:20.747280 1423526 cri.go:89] found id: ""
I0429 12:35:20.747288 1423526 logs.go:276] 1 containers: [f70d0c48d399667aeefaece1ef554897ebeb68eb674e2b89d699347639d7798f]
I0429 12:35:20.747353 1423526 ssh_runner.go:195] Run: which crictl
I0429 12:35:20.750956 1423526 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I0429 12:35:20.751035 1423526 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0429 12:35:20.793925 1423526 cri.go:89] found id: "f87e16673fad4748fc3431ca613237d1244ca35397a18f8cc52a6f1a55706439"
I0429 12:35:20.793946 1423526 cri.go:89] found id: ""
I0429 12:35:20.793954 1423526 logs.go:276] 1 containers: [f87e16673fad4748fc3431ca613237d1244ca35397a18f8cc52a6f1a55706439]
I0429 12:35:20.794011 1423526 ssh_runner.go:195] Run: which crictl
I0429 12:35:20.797663 1423526 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I0429 12:35:20.797738 1423526 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0429 12:35:20.839736 1423526 cri.go:89] found id: "e7e73acd6e8014a42c001b36ed0f2d3c63e892feb1fc378fe2fdd2de335d53dc"
I0429 12:35:20.839759 1423526 cri.go:89] found id: ""
I0429 12:35:20.839768 1423526 logs.go:276] 1 containers: [e7e73acd6e8014a42c001b36ed0f2d3c63e892feb1fc378fe2fdd2de335d53dc]
I0429 12:35:20.839825 1423526 ssh_runner.go:195] Run: which crictl
I0429 12:35:20.843530 1423526 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I0429 12:35:20.843609 1423526 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0429 12:35:20.886809 1423526 cri.go:89] found id: "2d3031452f789fb6a9b7327ac93e3217d5bdc6b6383542150d20d2538540820b"
I0429 12:35:20.886833 1423526 cri.go:89] found id: ""
I0429 12:35:20.886842 1423526 logs.go:276] 1 containers: [2d3031452f789fb6a9b7327ac93e3217d5bdc6b6383542150d20d2538540820b]
I0429 12:35:20.886935 1423526 ssh_runner.go:195] Run: which crictl
I0429 12:35:20.890565 1423526 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I0429 12:35:20.890643 1423526 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0429 12:35:20.931053 1423526 cri.go:89] found id: "18f81edeecda84f01c57c2228b6bbacaea535fd1209a9525e4f4eb7e1ccec852"
I0429 12:35:20.931116 1423526 cri.go:89] found id: ""
I0429 12:35:20.931137 1423526 logs.go:276] 1 containers: [18f81edeecda84f01c57c2228b6bbacaea535fd1209a9525e4f4eb7e1ccec852]
I0429 12:35:20.931214 1423526 ssh_runner.go:195] Run: which crictl
I0429 12:35:20.934837 1423526 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I0429 12:35:20.934936 1423526 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0429 12:35:20.974385 1423526 cri.go:89] found id: "f54a7f3a396ba3db9133a1183e07c7fc6d06a8419cfc3ff1a57aa605a963a445"
I0429 12:35:20.974454 1423526 cri.go:89] found id: ""
I0429 12:35:20.974476 1423526 logs.go:276] 1 containers: [f54a7f3a396ba3db9133a1183e07c7fc6d06a8419cfc3ff1a57aa605a963a445]
I0429 12:35:20.974547 1423526 ssh_runner.go:195] Run: which crictl
I0429 12:35:20.978067 1423526 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I0429 12:35:20.978164 1423526 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0429 12:35:21.021482 1423526 cri.go:89] found id: "b187065048c48a70de847611a7bfa1e7d604a1f06e81f41522e2c4623edd5594"
I0429 12:35:21.021547 1423526 cri.go:89] found id: ""
I0429 12:35:21.021569 1423526 logs.go:276] 1 containers: [b187065048c48a70de847611a7bfa1e7d604a1f06e81f41522e2c4623edd5594]
I0429 12:35:21.021656 1423526 ssh_runner.go:195] Run: which crictl
I0429 12:35:21.025533 1423526 cri.go:54] listing CRI containers in root : {State:all Name:storage-provisioner Namespaces:[]}
I0429 12:35:21.025622 1423526 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
I0429 12:35:21.064592 1423526 cri.go:89] found id: "3ab604aa41320d5c9477a97ac38a8892497dd2dbef11c5750c4c98c0fcff96bd"
I0429 12:35:21.064618 1423526 cri.go:89] found id: "a8ebc8ecfe2f93123a8fd7e1b220084645143d83b644d4ac445a896b7a30c0cb"
I0429 12:35:21.064623 1423526 cri.go:89] found id: ""
I0429 12:35:21.064630 1423526 logs.go:276] 2 containers: [3ab604aa41320d5c9477a97ac38a8892497dd2dbef11c5750c4c98c0fcff96bd a8ebc8ecfe2f93123a8fd7e1b220084645143d83b644d4ac445a896b7a30c0cb]
I0429 12:35:21.064755 1423526 ssh_runner.go:195] Run: which crictl
I0429 12:35:21.068752 1423526 ssh_runner.go:195] Run: which crictl
I0429 12:35:21.072335 1423526 cri.go:54] listing CRI containers in root : {State:all Name:kubernetes-dashboard Namespaces:[]}
I0429 12:35:21.072428 1423526 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
I0429 12:35:21.118125 1423526 cri.go:89] found id: "8e449405f978982d5dbc2fab079a55aed290a3bb6c162ea759272192a3d96fa9"
I0429 12:35:21.118152 1423526 cri.go:89] found id: ""
I0429 12:35:21.118171 1423526 logs.go:276] 1 containers: [8e449405f978982d5dbc2fab079a55aed290a3bb6c162ea759272192a3d96fa9]
I0429 12:35:21.118229 1423526 ssh_runner.go:195] Run: which crictl
I0429 12:35:21.122208 1423526 logs.go:123] Gathering logs for kindnet [b187065048c48a70de847611a7bfa1e7d604a1f06e81f41522e2c4623edd5594] ...
I0429 12:35:21.122235 1423526 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 b187065048c48a70de847611a7bfa1e7d604a1f06e81f41522e2c4623edd5594"
I0429 12:35:21.170261 1423526 logs.go:123] Gathering logs for storage-provisioner [3ab604aa41320d5c9477a97ac38a8892497dd2dbef11c5750c4c98c0fcff96bd] ...
I0429 12:35:21.170290 1423526 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 3ab604aa41320d5c9477a97ac38a8892497dd2dbef11c5750c4c98c0fcff96bd"
I0429 12:35:21.217175 1423526 logs.go:123] Gathering logs for CRI-O ...
I0429 12:35:21.217204 1423526 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I0429 12:35:21.308085 1423526 logs.go:123] Gathering logs for kubelet ...
I0429 12:35:21.308164 1423526 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
W0429 12:35:21.361821 1423526 logs.go:138] Found kubelet problem: Apr 29 12:29:55 old-k8s-version-425197 kubelet[751]: E0429 12:29:55.852397 751 reflector.go:138] object-"kube-system"/"kube-proxy-token-fqfww": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kube-proxy-token-fqfww" is forbidden: User "system:node:old-k8s-version-425197" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-425197' and this object
W0429 12:35:21.362158 1423526 logs.go:138] Found kubelet problem: Apr 29 12:29:55 old-k8s-version-425197 kubelet[751]: E0429 12:29:55.852571 751 reflector.go:138] object-"default"/"default-token-vdxct": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "default-token-vdxct" is forbidden: User "system:node:old-k8s-version-425197" cannot list resource "secrets" in API group "" in the namespace "default": no relationship found between node 'old-k8s-version-425197' and this object
W0429 12:35:21.362385 1423526 logs.go:138] Found kubelet problem: Apr 29 12:29:55 old-k8s-version-425197 kubelet[751]: E0429 12:29:55.852623 751 reflector.go:138] object-"kube-system"/"storage-provisioner-token-984nr": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "storage-provisioner-token-984nr" is forbidden: User "system:node:old-k8s-version-425197" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-425197' and this object
W0429 12:35:21.362603 1423526 logs.go:138] Found kubelet problem: Apr 29 12:29:55 old-k8s-version-425197 kubelet[751]: E0429 12:29:55.852738 751 reflector.go:138] object-"kube-system"/"metrics-server-token-6n4sr": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "metrics-server-token-6n4sr" is forbidden: User "system:node:old-k8s-version-425197" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-425197' and this object
W0429 12:35:21.362806 1423526 logs.go:138] Found kubelet problem: Apr 29 12:29:55 old-k8s-version-425197 kubelet[751]: E0429 12:29:55.852797 751 reflector.go:138] object-"kube-system"/"kube-proxy": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-proxy" is forbidden: User "system:node:old-k8s-version-425197" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-425197' and this object
W0429 12:35:21.363015 1423526 logs.go:138] Found kubelet problem: Apr 29 12:29:55 old-k8s-version-425197 kubelet[751]: E0429 12:29:55.852860 751 reflector.go:138] object-"kube-system"/"coredns-token-qz96c": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "coredns-token-qz96c" is forbidden: User "system:node:old-k8s-version-425197" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-425197' and this object
W0429 12:35:21.363212 1423526 logs.go:138] Found kubelet problem: Apr 29 12:29:55 old-k8s-version-425197 kubelet[751]: E0429 12:29:55.852912 751 reflector.go:138] object-"kube-system"/"coredns": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "coredns" is forbidden: User "system:node:old-k8s-version-425197" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-425197' and this object
W0429 12:35:21.363420 1423526 logs.go:138] Found kubelet problem: Apr 29 12:29:55 old-k8s-version-425197 kubelet[751]: E0429 12:29:55.852954 751 reflector.go:138] object-"kube-system"/"kindnet-token-5j4j2": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kindnet-token-5j4j2" is forbidden: User "system:node:old-k8s-version-425197" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-425197' and this object
W0429 12:35:21.373645 1423526 logs.go:138] Found kubelet problem: Apr 29 12:29:57 old-k8s-version-425197 kubelet[751]: E0429 12:29:57.145076 751 pod_workers.go:191] Error syncing pod a940d36c-f69c-494d-a918-07d04aa421aa ("metrics-server-9975d5f86-jgp2v_kube-system(a940d36c-f69c-494d-a918-07d04aa421aa)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = pinging container registry fake.domain: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain: no such host"
W0429 12:35:21.373839 1423526 logs.go:138] Found kubelet problem: Apr 29 12:29:57 old-k8s-version-425197 kubelet[751]: E0429 12:29:57.288428 751 pod_workers.go:191] Error syncing pod a940d36c-f69c-494d-a918-07d04aa421aa ("metrics-server-9975d5f86-jgp2v_kube-system(a940d36c-f69c-494d-a918-07d04aa421aa)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0429 12:35:21.379762 1423526 logs.go:138] Found kubelet problem: Apr 29 12:30:12 old-k8s-version-425197 kubelet[751]: E0429 12:30:12.234703 751 pod_workers.go:191] Error syncing pod a940d36c-f69c-494d-a918-07d04aa421aa ("metrics-server-9975d5f86-jgp2v_kube-system(a940d36c-f69c-494d-a918-07d04aa421aa)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = pinging container registry fake.domain: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain: no such host"
W0429 12:35:21.381169 1423526 logs.go:138] Found kubelet problem: Apr 29 12:30:18 old-k8s-version-425197 kubelet[751]: E0429 12:30:18.390405 751 pod_workers.go:191] Error syncing pod 82bfd63e-9627-4725-9f84-902d955704d9 ("dashboard-metrics-scraper-8d5bb5db8-xlb6n_kubernetes-dashboard(82bfd63e-9627-4725-9f84-902d955704d9)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xlb6n_kubernetes-dashboard(82bfd63e-9627-4725-9f84-902d955704d9)"
W0429 12:35:21.381495 1423526 logs.go:138] Found kubelet problem: Apr 29 12:30:19 old-k8s-version-425197 kubelet[751]: E0429 12:30:19.392475 751 pod_workers.go:191] Error syncing pod 82bfd63e-9627-4725-9f84-902d955704d9 ("dashboard-metrics-scraper-8d5bb5db8-xlb6n_kubernetes-dashboard(82bfd63e-9627-4725-9f84-902d955704d9)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xlb6n_kubernetes-dashboard(82bfd63e-9627-4725-9f84-902d955704d9)"
W0429 12:35:21.381816 1423526 logs.go:138] Found kubelet problem: Apr 29 12:30:22 old-k8s-version-425197 kubelet[751]: E0429 12:30:22.334859 751 pod_workers.go:191] Error syncing pod 82bfd63e-9627-4725-9f84-902d955704d9 ("dashboard-metrics-scraper-8d5bb5db8-xlb6n_kubernetes-dashboard(82bfd63e-9627-4725-9f84-902d955704d9)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xlb6n_kubernetes-dashboard(82bfd63e-9627-4725-9f84-902d955704d9)"
W0429 12:35:21.381996 1423526 logs.go:138] Found kubelet problem: Apr 29 12:30:26 old-k8s-version-425197 kubelet[751]: E0429 12:30:26.212158 751 pod_workers.go:191] Error syncing pod a940d36c-f69c-494d-a918-07d04aa421aa ("metrics-server-9975d5f86-jgp2v_kube-system(a940d36c-f69c-494d-a918-07d04aa421aa)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0429 12:35:21.382700 1423526 logs.go:138] Found kubelet problem: Apr 29 12:30:36 old-k8s-version-425197 kubelet[751]: E0429 12:30:36.428062 751 pod_workers.go:191] Error syncing pod 82bfd63e-9627-4725-9f84-902d955704d9 ("dashboard-metrics-scraper-8d5bb5db8-xlb6n_kubernetes-dashboard(82bfd63e-9627-4725-9f84-902d955704d9)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xlb6n_kubernetes-dashboard(82bfd63e-9627-4725-9f84-902d955704d9)"
W0429 12:35:21.384732 1423526 logs.go:138] Found kubelet problem: Apr 29 12:30:38 old-k8s-version-425197 kubelet[751]: E0429 12:30:38.220590 751 pod_workers.go:191] Error syncing pod a940d36c-f69c-494d-a918-07d04aa421aa ("metrics-server-9975d5f86-jgp2v_kube-system(a940d36c-f69c-494d-a918-07d04aa421aa)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = pinging container registry fake.domain: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain: no such host"
W0429 12:35:21.385083 1423526 logs.go:138] Found kubelet problem: Apr 29 12:30:42 old-k8s-version-425197 kubelet[751]: E0429 12:30:42.334818 751 pod_workers.go:191] Error syncing pod 82bfd63e-9627-4725-9f84-902d955704d9 ("dashboard-metrics-scraper-8d5bb5db8-xlb6n_kubernetes-dashboard(82bfd63e-9627-4725-9f84-902d955704d9)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xlb6n_kubernetes-dashboard(82bfd63e-9627-4725-9f84-902d955704d9)"
W0429 12:35:21.385267 1423526 logs.go:138] Found kubelet problem: Apr 29 12:30:50 old-k8s-version-425197 kubelet[751]: E0429 12:30:50.212076 751 pod_workers.go:191] Error syncing pod a940d36c-f69c-494d-a918-07d04aa421aa ("metrics-server-9975d5f86-jgp2v_kube-system(a940d36c-f69c-494d-a918-07d04aa421aa)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0429 12:35:21.385850 1423526 logs.go:138] Found kubelet problem: Apr 29 12:30:56 old-k8s-version-425197 kubelet[751]: E0429 12:30:56.459489 751 pod_workers.go:191] Error syncing pod 82bfd63e-9627-4725-9f84-902d955704d9 ("dashboard-metrics-scraper-8d5bb5db8-xlb6n_kubernetes-dashboard(82bfd63e-9627-4725-9f84-902d955704d9)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xlb6n_kubernetes-dashboard(82bfd63e-9627-4725-9f84-902d955704d9)"
W0429 12:35:21.386172 1423526 logs.go:138] Found kubelet problem: Apr 29 12:31:02 old-k8s-version-425197 kubelet[751]: E0429 12:31:02.334286 751 pod_workers.go:191] Error syncing pod 82bfd63e-9627-4725-9f84-902d955704d9 ("dashboard-metrics-scraper-8d5bb5db8-xlb6n_kubernetes-dashboard(82bfd63e-9627-4725-9f84-902d955704d9)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xlb6n_kubernetes-dashboard(82bfd63e-9627-4725-9f84-902d955704d9)"
W0429 12:35:21.386354 1423526 logs.go:138] Found kubelet problem: Apr 29 12:31:04 old-k8s-version-425197 kubelet[751]: E0429 12:31:04.211782 751 pod_workers.go:191] Error syncing pod a940d36c-f69c-494d-a918-07d04aa421aa ("metrics-server-9975d5f86-jgp2v_kube-system(a940d36c-f69c-494d-a918-07d04aa421aa)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0429 12:35:21.386678 1423526 logs.go:138] Found kubelet problem: Apr 29 12:31:13 old-k8s-version-425197 kubelet[751]: E0429 12:31:13.212598 751 pod_workers.go:191] Error syncing pod 82bfd63e-9627-4725-9f84-902d955704d9 ("dashboard-metrics-scraper-8d5bb5db8-xlb6n_kubernetes-dashboard(82bfd63e-9627-4725-9f84-902d955704d9)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xlb6n_kubernetes-dashboard(82bfd63e-9627-4725-9f84-902d955704d9)"
W0429 12:35:21.386859 1423526 logs.go:138] Found kubelet problem: Apr 29 12:31:15 old-k8s-version-425197 kubelet[751]: E0429 12:31:15.211861 751 pod_workers.go:191] Error syncing pod a940d36c-f69c-494d-a918-07d04aa421aa ("metrics-server-9975d5f86-jgp2v_kube-system(a940d36c-f69c-494d-a918-07d04aa421aa)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0429 12:35:21.387180 1423526 logs.go:138] Found kubelet problem: Apr 29 12:31:24 old-k8s-version-425197 kubelet[751]: E0429 12:31:24.211151 751 pod_workers.go:191] Error syncing pod 82bfd63e-9627-4725-9f84-902d955704d9 ("dashboard-metrics-scraper-8d5bb5db8-xlb6n_kubernetes-dashboard(82bfd63e-9627-4725-9f84-902d955704d9)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xlb6n_kubernetes-dashboard(82bfd63e-9627-4725-9f84-902d955704d9)"
W0429 12:35:21.389200 1423526 logs.go:138] Found kubelet problem: Apr 29 12:31:27 old-k8s-version-425197 kubelet[751]: E0429 12:31:27.221253 751 pod_workers.go:191] Error syncing pod a940d36c-f69c-494d-a918-07d04aa421aa ("metrics-server-9975d5f86-jgp2v_kube-system(a940d36c-f69c-494d-a918-07d04aa421aa)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = pinging container registry fake.domain: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain: no such host"
W0429 12:35:21.389525 1423526 logs.go:138] Found kubelet problem: Apr 29 12:31:36 old-k8s-version-425197 kubelet[751]: E0429 12:31:36.211916 751 pod_workers.go:191] Error syncing pod 82bfd63e-9627-4725-9f84-902d955704d9 ("dashboard-metrics-scraper-8d5bb5db8-xlb6n_kubernetes-dashboard(82bfd63e-9627-4725-9f84-902d955704d9)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xlb6n_kubernetes-dashboard(82bfd63e-9627-4725-9f84-902d955704d9)"
W0429 12:35:21.389715 1423526 logs.go:138] Found kubelet problem: Apr 29 12:31:40 old-k8s-version-425197 kubelet[751]: E0429 12:31:40.211944 751 pod_workers.go:191] Error syncing pod a940d36c-f69c-494d-a918-07d04aa421aa ("metrics-server-9975d5f86-jgp2v_kube-system(a940d36c-f69c-494d-a918-07d04aa421aa)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0429 12:35:21.390300 1423526 logs.go:138] Found kubelet problem: Apr 29 12:31:48 old-k8s-version-425197 kubelet[751]: E0429 12:31:48.542770 751 pod_workers.go:191] Error syncing pod 82bfd63e-9627-4725-9f84-902d955704d9 ("dashboard-metrics-scraper-8d5bb5db8-xlb6n_kubernetes-dashboard(82bfd63e-9627-4725-9f84-902d955704d9)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xlb6n_kubernetes-dashboard(82bfd63e-9627-4725-9f84-902d955704d9)"
W0429 12:35:21.390623 1423526 logs.go:138] Found kubelet problem: Apr 29 12:31:52 old-k8s-version-425197 kubelet[751]: E0429 12:31:52.334115 751 pod_workers.go:191] Error syncing pod 82bfd63e-9627-4725-9f84-902d955704d9 ("dashboard-metrics-scraper-8d5bb5db8-xlb6n_kubernetes-dashboard(82bfd63e-9627-4725-9f84-902d955704d9)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xlb6n_kubernetes-dashboard(82bfd63e-9627-4725-9f84-902d955704d9)"
W0429 12:35:21.390842 1423526 logs.go:138] Found kubelet problem: Apr 29 12:31:53 old-k8s-version-425197 kubelet[751]: E0429 12:31:53.212065 751 pod_workers.go:191] Error syncing pod a940d36c-f69c-494d-a918-07d04aa421aa ("metrics-server-9975d5f86-jgp2v_kube-system(a940d36c-f69c-494d-a918-07d04aa421aa)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0429 12:35:21.391174 1423526 logs.go:138] Found kubelet problem: Apr 29 12:32:07 old-k8s-version-425197 kubelet[751]: E0429 12:32:07.212281 751 pod_workers.go:191] Error syncing pod 82bfd63e-9627-4725-9f84-902d955704d9 ("dashboard-metrics-scraper-8d5bb5db8-xlb6n_kubernetes-dashboard(82bfd63e-9627-4725-9f84-902d955704d9)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xlb6n_kubernetes-dashboard(82bfd63e-9627-4725-9f84-902d955704d9)"
W0429 12:35:21.391357 1423526 logs.go:138] Found kubelet problem: Apr 29 12:32:08 old-k8s-version-425197 kubelet[751]: E0429 12:32:08.212237 751 pod_workers.go:191] Error syncing pod a940d36c-f69c-494d-a918-07d04aa421aa ("metrics-server-9975d5f86-jgp2v_kube-system(a940d36c-f69c-494d-a918-07d04aa421aa)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0429 12:35:21.391690 1423526 logs.go:138] Found kubelet problem: Apr 29 12:32:21 old-k8s-version-425197 kubelet[751]: E0429 12:32:21.211175 751 pod_workers.go:191] Error syncing pod 82bfd63e-9627-4725-9f84-902d955704d9 ("dashboard-metrics-scraper-8d5bb5db8-xlb6n_kubernetes-dashboard(82bfd63e-9627-4725-9f84-902d955704d9)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xlb6n_kubernetes-dashboard(82bfd63e-9627-4725-9f84-902d955704d9)"
W0429 12:35:21.391872 1423526 logs.go:138] Found kubelet problem: Apr 29 12:32:23 old-k8s-version-425197 kubelet[751]: E0429 12:32:23.212280 751 pod_workers.go:191] Error syncing pod a940d36c-f69c-494d-a918-07d04aa421aa ("metrics-server-9975d5f86-jgp2v_kube-system(a940d36c-f69c-494d-a918-07d04aa421aa)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0429 12:35:21.392195 1423526 logs.go:138] Found kubelet problem: Apr 29 12:32:35 old-k8s-version-425197 kubelet[751]: E0429 12:32:35.211140 751 pod_workers.go:191] Error syncing pod 82bfd63e-9627-4725-9f84-902d955704d9 ("dashboard-metrics-scraper-8d5bb5db8-xlb6n_kubernetes-dashboard(82bfd63e-9627-4725-9f84-902d955704d9)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xlb6n_kubernetes-dashboard(82bfd63e-9627-4725-9f84-902d955704d9)"
W0429 12:35:21.392376 1423526 logs.go:138] Found kubelet problem: Apr 29 12:32:36 old-k8s-version-425197 kubelet[751]: E0429 12:32:36.212634 751 pod_workers.go:191] Error syncing pod a940d36c-f69c-494d-a918-07d04aa421aa ("metrics-server-9975d5f86-jgp2v_kube-system(a940d36c-f69c-494d-a918-07d04aa421aa)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0429 12:35:21.392709 1423526 logs.go:138] Found kubelet problem: Apr 29 12:32:47 old-k8s-version-425197 kubelet[751]: E0429 12:32:47.211198 751 pod_workers.go:191] Error syncing pod 82bfd63e-9627-4725-9f84-902d955704d9 ("dashboard-metrics-scraper-8d5bb5db8-xlb6n_kubernetes-dashboard(82bfd63e-9627-4725-9f84-902d955704d9)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xlb6n_kubernetes-dashboard(82bfd63e-9627-4725-9f84-902d955704d9)"
W0429 12:35:21.394727 1423526 logs.go:138] Found kubelet problem: Apr 29 12:32:49 old-k8s-version-425197 kubelet[751]: E0429 12:32:49.219994 751 pod_workers.go:191] Error syncing pod a940d36c-f69c-494d-a918-07d04aa421aa ("metrics-server-9975d5f86-jgp2v_kube-system(a940d36c-f69c-494d-a918-07d04aa421aa)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = pinging container registry fake.domain: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain: no such host"
W0429 12:35:21.395052 1423526 logs.go:138] Found kubelet problem: Apr 29 12:33:02 old-k8s-version-425197 kubelet[751]: E0429 12:33:02.211522 751 pod_workers.go:191] Error syncing pod 82bfd63e-9627-4725-9f84-902d955704d9 ("dashboard-metrics-scraper-8d5bb5db8-xlb6n_kubernetes-dashboard(82bfd63e-9627-4725-9f84-902d955704d9)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xlb6n_kubernetes-dashboard(82bfd63e-9627-4725-9f84-902d955704d9)"
W0429 12:35:21.395236 1423526 logs.go:138] Found kubelet problem: Apr 29 12:33:02 old-k8s-version-425197 kubelet[751]: E0429 12:33:02.212607 751 pod_workers.go:191] Error syncing pod a940d36c-f69c-494d-a918-07d04aa421aa ("metrics-server-9975d5f86-jgp2v_kube-system(a940d36c-f69c-494d-a918-07d04aa421aa)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0429 12:35:21.395417 1423526 logs.go:138] Found kubelet problem: Apr 29 12:33:13 old-k8s-version-425197 kubelet[751]: E0429 12:33:13.211645 751 pod_workers.go:191] Error syncing pod a940d36c-f69c-494d-a918-07d04aa421aa ("metrics-server-9975d5f86-jgp2v_kube-system(a940d36c-f69c-494d-a918-07d04aa421aa)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0429 12:35:21.395994 1423526 logs.go:138] Found kubelet problem: Apr 29 12:33:14 old-k8s-version-425197 kubelet[751]: E0429 12:33:14.663840 751 pod_workers.go:191] Error syncing pod 82bfd63e-9627-4725-9f84-902d955704d9 ("dashboard-metrics-scraper-8d5bb5db8-xlb6n_kubernetes-dashboard(82bfd63e-9627-4725-9f84-902d955704d9)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xlb6n_kubernetes-dashboard(82bfd63e-9627-4725-9f84-902d955704d9)"
W0429 12:35:21.396317 1423526 logs.go:138] Found kubelet problem: Apr 29 12:33:22 old-k8s-version-425197 kubelet[751]: E0429 12:33:22.334161 751 pod_workers.go:191] Error syncing pod 82bfd63e-9627-4725-9f84-902d955704d9 ("dashboard-metrics-scraper-8d5bb5db8-xlb6n_kubernetes-dashboard(82bfd63e-9627-4725-9f84-902d955704d9)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xlb6n_kubernetes-dashboard(82bfd63e-9627-4725-9f84-902d955704d9)"
W0429 12:35:21.396497 1423526 logs.go:138] Found kubelet problem: Apr 29 12:33:26 old-k8s-version-425197 kubelet[751]: E0429 12:33:26.211803 751 pod_workers.go:191] Error syncing pod a940d36c-f69c-494d-a918-07d04aa421aa ("metrics-server-9975d5f86-jgp2v_kube-system(a940d36c-f69c-494d-a918-07d04aa421aa)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0429 12:35:21.396827 1423526 logs.go:138] Found kubelet problem: Apr 29 12:33:36 old-k8s-version-425197 kubelet[751]: E0429 12:33:36.211577 751 pod_workers.go:191] Error syncing pod 82bfd63e-9627-4725-9f84-902d955704d9 ("dashboard-metrics-scraper-8d5bb5db8-xlb6n_kubernetes-dashboard(82bfd63e-9627-4725-9f84-902d955704d9)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xlb6n_kubernetes-dashboard(82bfd63e-9627-4725-9f84-902d955704d9)"
W0429 12:35:21.397012 1423526 logs.go:138] Found kubelet problem: Apr 29 12:33:39 old-k8s-version-425197 kubelet[751]: E0429 12:33:39.211633 751 pod_workers.go:191] Error syncing pod a940d36c-f69c-494d-a918-07d04aa421aa ("metrics-server-9975d5f86-jgp2v_kube-system(a940d36c-f69c-494d-a918-07d04aa421aa)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0429 12:35:21.397335 1423526 logs.go:138] Found kubelet problem: Apr 29 12:33:49 old-k8s-version-425197 kubelet[751]: E0429 12:33:49.211245 751 pod_workers.go:191] Error syncing pod 82bfd63e-9627-4725-9f84-902d955704d9 ("dashboard-metrics-scraper-8d5bb5db8-xlb6n_kubernetes-dashboard(82bfd63e-9627-4725-9f84-902d955704d9)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xlb6n_kubernetes-dashboard(82bfd63e-9627-4725-9f84-902d955704d9)"
W0429 12:35:21.397519 1423526 logs.go:138] Found kubelet problem: Apr 29 12:33:51 old-k8s-version-425197 kubelet[751]: E0429 12:33:51.211757 751 pod_workers.go:191] Error syncing pod a940d36c-f69c-494d-a918-07d04aa421aa ("metrics-server-9975d5f86-jgp2v_kube-system(a940d36c-f69c-494d-a918-07d04aa421aa)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0429 12:35:21.397843 1423526 logs.go:138] Found kubelet problem: Apr 29 12:34:01 old-k8s-version-425197 kubelet[751]: E0429 12:34:01.211169 751 pod_workers.go:191] Error syncing pod 82bfd63e-9627-4725-9f84-902d955704d9 ("dashboard-metrics-scraper-8d5bb5db8-xlb6n_kubernetes-dashboard(82bfd63e-9627-4725-9f84-902d955704d9)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xlb6n_kubernetes-dashboard(82bfd63e-9627-4725-9f84-902d955704d9)"
W0429 12:35:21.398026 1423526 logs.go:138] Found kubelet problem: Apr 29 12:34:03 old-k8s-version-425197 kubelet[751]: E0429 12:34:03.211740 751 pod_workers.go:191] Error syncing pod a940d36c-f69c-494d-a918-07d04aa421aa ("metrics-server-9975d5f86-jgp2v_kube-system(a940d36c-f69c-494d-a918-07d04aa421aa)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0429 12:35:21.398348 1423526 logs.go:138] Found kubelet problem: Apr 29 12:34:13 old-k8s-version-425197 kubelet[751]: E0429 12:34:13.211192 751 pod_workers.go:191] Error syncing pod 82bfd63e-9627-4725-9f84-902d955704d9 ("dashboard-metrics-scraper-8d5bb5db8-xlb6n_kubernetes-dashboard(82bfd63e-9627-4725-9f84-902d955704d9)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xlb6n_kubernetes-dashboard(82bfd63e-9627-4725-9f84-902d955704d9)"
W0429 12:35:21.398531 1423526 logs.go:138] Found kubelet problem: Apr 29 12:34:14 old-k8s-version-425197 kubelet[751]: E0429 12:34:14.211820 751 pod_workers.go:191] Error syncing pod a940d36c-f69c-494d-a918-07d04aa421aa ("metrics-server-9975d5f86-jgp2v_kube-system(a940d36c-f69c-494d-a918-07d04aa421aa)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0429 12:35:21.398856 1423526 logs.go:138] Found kubelet problem: Apr 29 12:34:27 old-k8s-version-425197 kubelet[751]: E0429 12:34:27.211244 751 pod_workers.go:191] Error syncing pod 82bfd63e-9627-4725-9f84-902d955704d9 ("dashboard-metrics-scraper-8d5bb5db8-xlb6n_kubernetes-dashboard(82bfd63e-9627-4725-9f84-902d955704d9)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xlb6n_kubernetes-dashboard(82bfd63e-9627-4725-9f84-902d955704d9)"
W0429 12:35:21.399041 1423526 logs.go:138] Found kubelet problem: Apr 29 12:34:27 old-k8s-version-425197 kubelet[751]: E0429 12:34:27.212498 751 pod_workers.go:191] Error syncing pod a940d36c-f69c-494d-a918-07d04aa421aa ("metrics-server-9975d5f86-jgp2v_kube-system(a940d36c-f69c-494d-a918-07d04aa421aa)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0429 12:35:21.399366 1423526 logs.go:138] Found kubelet problem: Apr 29 12:34:38 old-k8s-version-425197 kubelet[751]: E0429 12:34:38.211089 751 pod_workers.go:191] Error syncing pod 82bfd63e-9627-4725-9f84-902d955704d9 ("dashboard-metrics-scraper-8d5bb5db8-xlb6n_kubernetes-dashboard(82bfd63e-9627-4725-9f84-902d955704d9)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xlb6n_kubernetes-dashboard(82bfd63e-9627-4725-9f84-902d955704d9)"
W0429 12:35:21.399548 1423526 logs.go:138] Found kubelet problem: Apr 29 12:34:40 old-k8s-version-425197 kubelet[751]: E0429 12:34:40.211661 751 pod_workers.go:191] Error syncing pod a940d36c-f69c-494d-a918-07d04aa421aa ("metrics-server-9975d5f86-jgp2v_kube-system(a940d36c-f69c-494d-a918-07d04aa421aa)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0429 12:35:21.400111 1423526 logs.go:138] Found kubelet problem: Apr 29 12:34:52 old-k8s-version-425197 kubelet[751]: E0429 12:34:52.211238 751 pod_workers.go:191] Error syncing pod 82bfd63e-9627-4725-9f84-902d955704d9 ("dashboard-metrics-scraper-8d5bb5db8-xlb6n_kubernetes-dashboard(82bfd63e-9627-4725-9f84-902d955704d9)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xlb6n_kubernetes-dashboard(82bfd63e-9627-4725-9f84-902d955704d9)"
W0429 12:35:21.400292 1423526 logs.go:138] Found kubelet problem: Apr 29 12:34:55 old-k8s-version-425197 kubelet[751]: E0429 12:34:55.211712 751 pod_workers.go:191] Error syncing pod a940d36c-f69c-494d-a918-07d04aa421aa ("metrics-server-9975d5f86-jgp2v_kube-system(a940d36c-f69c-494d-a918-07d04aa421aa)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0429 12:35:21.400614 1423526 logs.go:138] Found kubelet problem: Apr 29 12:35:03 old-k8s-version-425197 kubelet[751]: E0429 12:35:03.211147 751 pod_workers.go:191] Error syncing pod 82bfd63e-9627-4725-9f84-902d955704d9 ("dashboard-metrics-scraper-8d5bb5db8-xlb6n_kubernetes-dashboard(82bfd63e-9627-4725-9f84-902d955704d9)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xlb6n_kubernetes-dashboard(82bfd63e-9627-4725-9f84-902d955704d9)"
W0429 12:35:21.400801 1423526 logs.go:138] Found kubelet problem: Apr 29 12:35:07 old-k8s-version-425197 kubelet[751]: E0429 12:35:07.211697 751 pod_workers.go:191] Error syncing pod a940d36c-f69c-494d-a918-07d04aa421aa ("metrics-server-9975d5f86-jgp2v_kube-system(a940d36c-f69c-494d-a918-07d04aa421aa)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0429 12:35:21.401122 1423526 logs.go:138] Found kubelet problem: Apr 29 12:35:14 old-k8s-version-425197 kubelet[751]: E0429 12:35:14.212381 751 pod_workers.go:191] Error syncing pod 82bfd63e-9627-4725-9f84-902d955704d9 ("dashboard-metrics-scraper-8d5bb5db8-xlb6n_kubernetes-dashboard(82bfd63e-9627-4725-9f84-902d955704d9)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xlb6n_kubernetes-dashboard(82bfd63e-9627-4725-9f84-902d955704d9)"
I0429 12:35:21.401133 1423526 logs.go:123] Gathering logs for coredns [e7e73acd6e8014a42c001b36ed0f2d3c63e892feb1fc378fe2fdd2de335d53dc] ...
I0429 12:35:21.401146 1423526 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 e7e73acd6e8014a42c001b36ed0f2d3c63e892feb1fc378fe2fdd2de335d53dc"
I0429 12:35:21.443044 1423526 logs.go:123] Gathering logs for kube-apiserver [f70d0c48d399667aeefaece1ef554897ebeb68eb674e2b89d699347639d7798f] ...
I0429 12:35:21.443073 1423526 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 f70d0c48d399667aeefaece1ef554897ebeb68eb674e2b89d699347639d7798f"
I0429 12:35:21.532041 1423526 logs.go:123] Gathering logs for etcd [f87e16673fad4748fc3431ca613237d1244ca35397a18f8cc52a6f1a55706439] ...
I0429 12:35:21.532080 1423526 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 f87e16673fad4748fc3431ca613237d1244ca35397a18f8cc52a6f1a55706439"
I0429 12:35:21.579347 1423526 logs.go:123] Gathering logs for kube-proxy [18f81edeecda84f01c57c2228b6bbacaea535fd1209a9525e4f4eb7e1ccec852] ...
I0429 12:35:21.579375 1423526 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 18f81edeecda84f01c57c2228b6bbacaea535fd1209a9525e4f4eb7e1ccec852"
I0429 12:35:21.623012 1423526 logs.go:123] Gathering logs for kube-controller-manager [f54a7f3a396ba3db9133a1183e07c7fc6d06a8419cfc3ff1a57aa605a963a445] ...
I0429 12:35:21.623039 1423526 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 f54a7f3a396ba3db9133a1183e07c7fc6d06a8419cfc3ff1a57aa605a963a445"
I0429 12:35:21.703667 1423526 logs.go:123] Gathering logs for kubernetes-dashboard [8e449405f978982d5dbc2fab079a55aed290a3bb6c162ea759272192a3d96fa9] ...
I0429 12:35:21.703701 1423526 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 8e449405f978982d5dbc2fab079a55aed290a3bb6c162ea759272192a3d96fa9"
I0429 12:35:21.746308 1423526 logs.go:123] Gathering logs for dmesg ...
I0429 12:35:21.746336 1423526 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0429 12:35:21.766264 1423526 logs.go:123] Gathering logs for describe nodes ...
I0429 12:35:21.766402 1423526 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0429 12:35:21.929075 1423526 logs.go:123] Gathering logs for container status ...
I0429 12:35:21.929103 1423526 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0429 12:35:21.978352 1423526 logs.go:123] Gathering logs for kube-scheduler [2d3031452f789fb6a9b7327ac93e3217d5bdc6b6383542150d20d2538540820b] ...
I0429 12:35:21.978381 1423526 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 2d3031452f789fb6a9b7327ac93e3217d5bdc6b6383542150d20d2538540820b"
I0429 12:35:22.027997 1423526 logs.go:123] Gathering logs for storage-provisioner [a8ebc8ecfe2f93123a8fd7e1b220084645143d83b644d4ac445a896b7a30c0cb] ...
I0429 12:35:22.028025 1423526 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 a8ebc8ecfe2f93123a8fd7e1b220084645143d83b644d4ac445a896b7a30c0cb"
I0429 12:35:22.070591 1423526 out.go:304] Setting ErrFile to fd 2...
I0429 12:35:22.070618 1423526 out.go:338] TERM=,COLORTERM=, which probably does not support color
W0429 12:35:22.070663 1423526 out.go:239] X Problems detected in kubelet:
X Problems detected in kubelet:
W0429 12:35:22.070676 1423526 out.go:239] Apr 29 12:34:52 old-k8s-version-425197 kubelet[751]: E0429 12:34:52.211238 751 pod_workers.go:191] Error syncing pod 82bfd63e-9627-4725-9f84-902d955704d9 ("dashboard-metrics-scraper-8d5bb5db8-xlb6n_kubernetes-dashboard(82bfd63e-9627-4725-9f84-902d955704d9)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xlb6n_kubernetes-dashboard(82bfd63e-9627-4725-9f84-902d955704d9)"
Apr 29 12:34:52 old-k8s-version-425197 kubelet[751]: E0429 12:34:52.211238 751 pod_workers.go:191] Error syncing pod 82bfd63e-9627-4725-9f84-902d955704d9 ("dashboard-metrics-scraper-8d5bb5db8-xlb6n_kubernetes-dashboard(82bfd63e-9627-4725-9f84-902d955704d9)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xlb6n_kubernetes-dashboard(82bfd63e-9627-4725-9f84-902d955704d9)"
W0429 12:35:22.070683 1423526 out.go:239] Apr 29 12:34:55 old-k8s-version-425197 kubelet[751]: E0429 12:34:55.211712 751 pod_workers.go:191] Error syncing pod a940d36c-f69c-494d-a918-07d04aa421aa ("metrics-server-9975d5f86-jgp2v_kube-system(a940d36c-f69c-494d-a918-07d04aa421aa)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Apr 29 12:34:55 old-k8s-version-425197 kubelet[751]: E0429 12:34:55.211712 751 pod_workers.go:191] Error syncing pod a940d36c-f69c-494d-a918-07d04aa421aa ("metrics-server-9975d5f86-jgp2v_kube-system(a940d36c-f69c-494d-a918-07d04aa421aa)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0429 12:35:22.070691 1423526 out.go:239] Apr 29 12:35:03 old-k8s-version-425197 kubelet[751]: E0429 12:35:03.211147 751 pod_workers.go:191] Error syncing pod 82bfd63e-9627-4725-9f84-902d955704d9 ("dashboard-metrics-scraper-8d5bb5db8-xlb6n_kubernetes-dashboard(82bfd63e-9627-4725-9f84-902d955704d9)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xlb6n_kubernetes-dashboard(82bfd63e-9627-4725-9f84-902d955704d9)"
Apr 29 12:35:03 old-k8s-version-425197 kubelet[751]: E0429 12:35:03.211147 751 pod_workers.go:191] Error syncing pod 82bfd63e-9627-4725-9f84-902d955704d9 ("dashboard-metrics-scraper-8d5bb5db8-xlb6n_kubernetes-dashboard(82bfd63e-9627-4725-9f84-902d955704d9)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xlb6n_kubernetes-dashboard(82bfd63e-9627-4725-9f84-902d955704d9)"
W0429 12:35:22.070716 1423526 out.go:239] Apr 29 12:35:07 old-k8s-version-425197 kubelet[751]: E0429 12:35:07.211697 751 pod_workers.go:191] Error syncing pod a940d36c-f69c-494d-a918-07d04aa421aa ("metrics-server-9975d5f86-jgp2v_kube-system(a940d36c-f69c-494d-a918-07d04aa421aa)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Apr 29 12:35:07 old-k8s-version-425197 kubelet[751]: E0429 12:35:07.211697 751 pod_workers.go:191] Error syncing pod a940d36c-f69c-494d-a918-07d04aa421aa ("metrics-server-9975d5f86-jgp2v_kube-system(a940d36c-f69c-494d-a918-07d04aa421aa)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0429 12:35:22.070725 1423526 out.go:239] Apr 29 12:35:14 old-k8s-version-425197 kubelet[751]: E0429 12:35:14.212381 751 pod_workers.go:191] Error syncing pod 82bfd63e-9627-4725-9f84-902d955704d9 ("dashboard-metrics-scraper-8d5bb5db8-xlb6n_kubernetes-dashboard(82bfd63e-9627-4725-9f84-902d955704d9)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xlb6n_kubernetes-dashboard(82bfd63e-9627-4725-9f84-902d955704d9)"
Apr 29 12:35:14 old-k8s-version-425197 kubelet[751]: E0429 12:35:14.212381 751 pod_workers.go:191] Error syncing pod 82bfd63e-9627-4725-9f84-902d955704d9 ("dashboard-metrics-scraper-8d5bb5db8-xlb6n_kubernetes-dashboard(82bfd63e-9627-4725-9f84-902d955704d9)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xlb6n_kubernetes-dashboard(82bfd63e-9627-4725-9f84-902d955704d9)"
I0429 12:35:22.070731 1423526 out.go:304] Setting ErrFile to fd 2...
I0429 12:35:22.070739 1423526 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0429 12:35:32.071134 1423526 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0429 12:35:32.083403 1423526 api_server.go:72] duration metric: took 5m53.762829916s to wait for apiserver process to appear ...
I0429 12:35:32.083426 1423526 api_server.go:88] waiting for apiserver healthz status ...
I0429 12:35:32.083462 1423526 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I0429 12:35:32.083517 1423526 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0429 12:35:32.128629 1423526 cri.go:89] found id: "f70d0c48d399667aeefaece1ef554897ebeb68eb674e2b89d699347639d7798f"
I0429 12:35:32.128649 1423526 cri.go:89] found id: ""
I0429 12:35:32.128656 1423526 logs.go:276] 1 containers: [f70d0c48d399667aeefaece1ef554897ebeb68eb674e2b89d699347639d7798f]
I0429 12:35:32.128738 1423526 ssh_runner.go:195] Run: which crictl
I0429 12:35:32.132416 1423526 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I0429 12:35:32.132489 1423526 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0429 12:35:32.173538 1423526 cri.go:89] found id: "f87e16673fad4748fc3431ca613237d1244ca35397a18f8cc52a6f1a55706439"
I0429 12:35:32.173558 1423526 cri.go:89] found id: ""
I0429 12:35:32.173567 1423526 logs.go:276] 1 containers: [f87e16673fad4748fc3431ca613237d1244ca35397a18f8cc52a6f1a55706439]
I0429 12:35:32.173623 1423526 ssh_runner.go:195] Run: which crictl
I0429 12:35:32.177288 1423526 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I0429 12:35:32.177361 1423526 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0429 12:35:32.220046 1423526 cri.go:89] found id: "e7e73acd6e8014a42c001b36ed0f2d3c63e892feb1fc378fe2fdd2de335d53dc"
I0429 12:35:32.220070 1423526 cri.go:89] found id: ""
I0429 12:35:32.220078 1423526 logs.go:276] 1 containers: [e7e73acd6e8014a42c001b36ed0f2d3c63e892feb1fc378fe2fdd2de335d53dc]
I0429 12:35:32.220135 1423526 ssh_runner.go:195] Run: which crictl
I0429 12:35:32.224358 1423526 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I0429 12:35:32.224428 1423526 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0429 12:35:32.274913 1423526 cri.go:89] found id: "2d3031452f789fb6a9b7327ac93e3217d5bdc6b6383542150d20d2538540820b"
I0429 12:35:32.274934 1423526 cri.go:89] found id: ""
I0429 12:35:32.274942 1423526 logs.go:276] 1 containers: [2d3031452f789fb6a9b7327ac93e3217d5bdc6b6383542150d20d2538540820b]
I0429 12:35:32.274999 1423526 ssh_runner.go:195] Run: which crictl
I0429 12:35:32.278544 1423526 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I0429 12:35:32.278624 1423526 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0429 12:35:32.318854 1423526 cri.go:89] found id: "18f81edeecda84f01c57c2228b6bbacaea535fd1209a9525e4f4eb7e1ccec852"
I0429 12:35:32.318878 1423526 cri.go:89] found id: ""
I0429 12:35:32.318886 1423526 logs.go:276] 1 containers: [18f81edeecda84f01c57c2228b6bbacaea535fd1209a9525e4f4eb7e1ccec852]
I0429 12:35:32.318961 1423526 ssh_runner.go:195] Run: which crictl
I0429 12:35:32.322884 1423526 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I0429 12:35:32.322980 1423526 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0429 12:35:32.364795 1423526 cri.go:89] found id: "f54a7f3a396ba3db9133a1183e07c7fc6d06a8419cfc3ff1a57aa605a963a445"
I0429 12:35:32.364815 1423526 cri.go:89] found id: ""
I0429 12:35:32.364823 1423526 logs.go:276] 1 containers: [f54a7f3a396ba3db9133a1183e07c7fc6d06a8419cfc3ff1a57aa605a963a445]
I0429 12:35:32.364884 1423526 ssh_runner.go:195] Run: which crictl
I0429 12:35:32.368723 1423526 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I0429 12:35:32.368793 1423526 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0429 12:35:32.408380 1423526 cri.go:89] found id: "b187065048c48a70de847611a7bfa1e7d604a1f06e81f41522e2c4623edd5594"
I0429 12:35:32.408408 1423526 cri.go:89] found id: ""
I0429 12:35:32.408416 1423526 logs.go:276] 1 containers: [b187065048c48a70de847611a7bfa1e7d604a1f06e81f41522e2c4623edd5594]
I0429 12:35:32.408470 1423526 ssh_runner.go:195] Run: which crictl
I0429 12:35:32.412015 1423526 cri.go:54] listing CRI containers in root : {State:all Name:kubernetes-dashboard Namespaces:[]}
I0429 12:35:32.412087 1423526 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
I0429 12:35:32.455685 1423526 cri.go:89] found id: "8e449405f978982d5dbc2fab079a55aed290a3bb6c162ea759272192a3d96fa9"
I0429 12:35:32.455751 1423526 cri.go:89] found id: ""
I0429 12:35:32.455782 1423526 logs.go:276] 1 containers: [8e449405f978982d5dbc2fab079a55aed290a3bb6c162ea759272192a3d96fa9]
I0429 12:35:32.455858 1423526 ssh_runner.go:195] Run: which crictl
I0429 12:35:32.459503 1423526 cri.go:54] listing CRI containers in root : {State:all Name:storage-provisioner Namespaces:[]}
I0429 12:35:32.459579 1423526 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
I0429 12:35:32.513099 1423526 cri.go:89] found id: "3ab604aa41320d5c9477a97ac38a8892497dd2dbef11c5750c4c98c0fcff96bd"
I0429 12:35:32.513120 1423526 cri.go:89] found id: "a8ebc8ecfe2f93123a8fd7e1b220084645143d83b644d4ac445a896b7a30c0cb"
I0429 12:35:32.513125 1423526 cri.go:89] found id: ""
I0429 12:35:32.513133 1423526 logs.go:276] 2 containers: [3ab604aa41320d5c9477a97ac38a8892497dd2dbef11c5750c4c98c0fcff96bd a8ebc8ecfe2f93123a8fd7e1b220084645143d83b644d4ac445a896b7a30c0cb]
I0429 12:35:32.513188 1423526 ssh_runner.go:195] Run: which crictl
I0429 12:35:32.516756 1423526 ssh_runner.go:195] Run: which crictl
I0429 12:35:32.521907 1423526 logs.go:123] Gathering logs for kube-apiserver [f70d0c48d399667aeefaece1ef554897ebeb68eb674e2b89d699347639d7798f] ...
I0429 12:35:32.521946 1423526 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 f70d0c48d399667aeefaece1ef554897ebeb68eb674e2b89d699347639d7798f"
I0429 12:35:32.601911 1423526 logs.go:123] Gathering logs for kube-proxy [18f81edeecda84f01c57c2228b6bbacaea535fd1209a9525e4f4eb7e1ccec852] ...
I0429 12:35:32.601947 1423526 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 18f81edeecda84f01c57c2228b6bbacaea535fd1209a9525e4f4eb7e1ccec852"
I0429 12:35:32.641448 1423526 logs.go:123] Gathering logs for kubernetes-dashboard [8e449405f978982d5dbc2fab079a55aed290a3bb6c162ea759272192a3d96fa9] ...
I0429 12:35:32.641478 1423526 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 8e449405f978982d5dbc2fab079a55aed290a3bb6c162ea759272192a3d96fa9"
I0429 12:35:32.687584 1423526 logs.go:123] Gathering logs for storage-provisioner [3ab604aa41320d5c9477a97ac38a8892497dd2dbef11c5750c4c98c0fcff96bd] ...
I0429 12:35:32.687612 1423526 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 3ab604aa41320d5c9477a97ac38a8892497dd2dbef11c5750c4c98c0fcff96bd"
I0429 12:35:32.736435 1423526 logs.go:123] Gathering logs for kube-scheduler [2d3031452f789fb6a9b7327ac93e3217d5bdc6b6383542150d20d2538540820b] ...
I0429 12:35:32.736462 1423526 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 2d3031452f789fb6a9b7327ac93e3217d5bdc6b6383542150d20d2538540820b"
I0429 12:35:32.780084 1423526 logs.go:123] Gathering logs for kubelet ...
I0429 12:35:32.780117 1423526 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
W0429 12:35:32.833917 1423526 logs.go:138] Found kubelet problem: Apr 29 12:29:55 old-k8s-version-425197 kubelet[751]: E0429 12:29:55.852397 751 reflector.go:138] object-"kube-system"/"kube-proxy-token-fqfww": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kube-proxy-token-fqfww" is forbidden: User "system:node:old-k8s-version-425197" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-425197' and this object
W0429 12:35:32.834240 1423526 logs.go:138] Found kubelet problem: Apr 29 12:29:55 old-k8s-version-425197 kubelet[751]: E0429 12:29:55.852571 751 reflector.go:138] object-"default"/"default-token-vdxct": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "default-token-vdxct" is forbidden: User "system:node:old-k8s-version-425197" cannot list resource "secrets" in API group "" in the namespace "default": no relationship found between node 'old-k8s-version-425197' and this object
W0429 12:35:32.834472 1423526 logs.go:138] Found kubelet problem: Apr 29 12:29:55 old-k8s-version-425197 kubelet[751]: E0429 12:29:55.852623 751 reflector.go:138] object-"kube-system"/"storage-provisioner-token-984nr": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "storage-provisioner-token-984nr" is forbidden: User "system:node:old-k8s-version-425197" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-425197' and this object
W0429 12:35:32.834708 1423526 logs.go:138] Found kubelet problem: Apr 29 12:29:55 old-k8s-version-425197 kubelet[751]: E0429 12:29:55.852738 751 reflector.go:138] object-"kube-system"/"metrics-server-token-6n4sr": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "metrics-server-token-6n4sr" is forbidden: User "system:node:old-k8s-version-425197" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-425197' and this object
W0429 12:35:32.834931 1423526 logs.go:138] Found kubelet problem: Apr 29 12:29:55 old-k8s-version-425197 kubelet[751]: E0429 12:29:55.852797 751 reflector.go:138] object-"kube-system"/"kube-proxy": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-proxy" is forbidden: User "system:node:old-k8s-version-425197" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-425197' and this object
W0429 12:35:32.835145 1423526 logs.go:138] Found kubelet problem: Apr 29 12:29:55 old-k8s-version-425197 kubelet[751]: E0429 12:29:55.852860 751 reflector.go:138] object-"kube-system"/"coredns-token-qz96c": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "coredns-token-qz96c" is forbidden: User "system:node:old-k8s-version-425197" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-425197' and this object
W0429 12:35:32.835347 1423526 logs.go:138] Found kubelet problem: Apr 29 12:29:55 old-k8s-version-425197 kubelet[751]: E0429 12:29:55.852912 751 reflector.go:138] object-"kube-system"/"coredns": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "coredns" is forbidden: User "system:node:old-k8s-version-425197" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-425197' and this object
W0429 12:35:32.835555 1423526 logs.go:138] Found kubelet problem: Apr 29 12:29:55 old-k8s-version-425197 kubelet[751]: E0429 12:29:55.852954 751 reflector.go:138] object-"kube-system"/"kindnet-token-5j4j2": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kindnet-token-5j4j2" is forbidden: User "system:node:old-k8s-version-425197" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-425197' and this object
W0429 12:35:32.846867 1423526 logs.go:138] Found kubelet problem: Apr 29 12:29:57 old-k8s-version-425197 kubelet[751]: E0429 12:29:57.145076 751 pod_workers.go:191] Error syncing pod a940d36c-f69c-494d-a918-07d04aa421aa ("metrics-server-9975d5f86-jgp2v_kube-system(a940d36c-f69c-494d-a918-07d04aa421aa)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = pinging container registry fake.domain: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain: no such host"
W0429 12:35:32.847120 1423526 logs.go:138] Found kubelet problem: Apr 29 12:29:57 old-k8s-version-425197 kubelet[751]: E0429 12:29:57.288428 751 pod_workers.go:191] Error syncing pod a940d36c-f69c-494d-a918-07d04aa421aa ("metrics-server-9975d5f86-jgp2v_kube-system(a940d36c-f69c-494d-a918-07d04aa421aa)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0429 12:35:32.853090 1423526 logs.go:138] Found kubelet problem: Apr 29 12:30:12 old-k8s-version-425197 kubelet[751]: E0429 12:30:12.234703 751 pod_workers.go:191] Error syncing pod a940d36c-f69c-494d-a918-07d04aa421aa ("metrics-server-9975d5f86-jgp2v_kube-system(a940d36c-f69c-494d-a918-07d04aa421aa)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = pinging container registry fake.domain: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain: no such host"
W0429 12:35:32.854476 1423526 logs.go:138] Found kubelet problem: Apr 29 12:30:18 old-k8s-version-425197 kubelet[751]: E0429 12:30:18.390405 751 pod_workers.go:191] Error syncing pod 82bfd63e-9627-4725-9f84-902d955704d9 ("dashboard-metrics-scraper-8d5bb5db8-xlb6n_kubernetes-dashboard(82bfd63e-9627-4725-9f84-902d955704d9)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xlb6n_kubernetes-dashboard(82bfd63e-9627-4725-9f84-902d955704d9)"
W0429 12:35:32.854803 1423526 logs.go:138] Found kubelet problem: Apr 29 12:30:19 old-k8s-version-425197 kubelet[751]: E0429 12:30:19.392475 751 pod_workers.go:191] Error syncing pod 82bfd63e-9627-4725-9f84-902d955704d9 ("dashboard-metrics-scraper-8d5bb5db8-xlb6n_kubernetes-dashboard(82bfd63e-9627-4725-9f84-902d955704d9)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xlb6n_kubernetes-dashboard(82bfd63e-9627-4725-9f84-902d955704d9)"
W0429 12:35:32.855127 1423526 logs.go:138] Found kubelet problem: Apr 29 12:30:22 old-k8s-version-425197 kubelet[751]: E0429 12:30:22.334859 751 pod_workers.go:191] Error syncing pod 82bfd63e-9627-4725-9f84-902d955704d9 ("dashboard-metrics-scraper-8d5bb5db8-xlb6n_kubernetes-dashboard(82bfd63e-9627-4725-9f84-902d955704d9)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xlb6n_kubernetes-dashboard(82bfd63e-9627-4725-9f84-902d955704d9)"
W0429 12:35:32.855311 1423526 logs.go:138] Found kubelet problem: Apr 29 12:30:26 old-k8s-version-425197 kubelet[751]: E0429 12:30:26.212158 751 pod_workers.go:191] Error syncing pod a940d36c-f69c-494d-a918-07d04aa421aa ("metrics-server-9975d5f86-jgp2v_kube-system(a940d36c-f69c-494d-a918-07d04aa421aa)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0429 12:35:32.856017 1423526 logs.go:138] Found kubelet problem: Apr 29 12:30:36 old-k8s-version-425197 kubelet[751]: E0429 12:30:36.428062 751 pod_workers.go:191] Error syncing pod 82bfd63e-9627-4725-9f84-902d955704d9 ("dashboard-metrics-scraper-8d5bb5db8-xlb6n_kubernetes-dashboard(82bfd63e-9627-4725-9f84-902d955704d9)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xlb6n_kubernetes-dashboard(82bfd63e-9627-4725-9f84-902d955704d9)"
W0429 12:35:32.858043 1423526 logs.go:138] Found kubelet problem: Apr 29 12:30:38 old-k8s-version-425197 kubelet[751]: E0429 12:30:38.220590 751 pod_workers.go:191] Error syncing pod a940d36c-f69c-494d-a918-07d04aa421aa ("metrics-server-9975d5f86-jgp2v_kube-system(a940d36c-f69c-494d-a918-07d04aa421aa)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = pinging container registry fake.domain: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain: no such host"
W0429 12:35:32.858368 1423526 logs.go:138] Found kubelet problem: Apr 29 12:30:42 old-k8s-version-425197 kubelet[751]: E0429 12:30:42.334818 751 pod_workers.go:191] Error syncing pod 82bfd63e-9627-4725-9f84-902d955704d9 ("dashboard-metrics-scraper-8d5bb5db8-xlb6n_kubernetes-dashboard(82bfd63e-9627-4725-9f84-902d955704d9)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xlb6n_kubernetes-dashboard(82bfd63e-9627-4725-9f84-902d955704d9)"
W0429 12:35:32.858548 1423526 logs.go:138] Found kubelet problem: Apr 29 12:30:50 old-k8s-version-425197 kubelet[751]: E0429 12:30:50.212076 751 pod_workers.go:191] Error syncing pod a940d36c-f69c-494d-a918-07d04aa421aa ("metrics-server-9975d5f86-jgp2v_kube-system(a940d36c-f69c-494d-a918-07d04aa421aa)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0429 12:35:32.859126 1423526 logs.go:138] Found kubelet problem: Apr 29 12:30:56 old-k8s-version-425197 kubelet[751]: E0429 12:30:56.459489 751 pod_workers.go:191] Error syncing pod 82bfd63e-9627-4725-9f84-902d955704d9 ("dashboard-metrics-scraper-8d5bb5db8-xlb6n_kubernetes-dashboard(82bfd63e-9627-4725-9f84-902d955704d9)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xlb6n_kubernetes-dashboard(82bfd63e-9627-4725-9f84-902d955704d9)"
W0429 12:35:32.859449 1423526 logs.go:138] Found kubelet problem: Apr 29 12:31:02 old-k8s-version-425197 kubelet[751]: E0429 12:31:02.334286 751 pod_workers.go:191] Error syncing pod 82bfd63e-9627-4725-9f84-902d955704d9 ("dashboard-metrics-scraper-8d5bb5db8-xlb6n_kubernetes-dashboard(82bfd63e-9627-4725-9f84-902d955704d9)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xlb6n_kubernetes-dashboard(82bfd63e-9627-4725-9f84-902d955704d9)"
W0429 12:35:32.859630 1423526 logs.go:138] Found kubelet problem: Apr 29 12:31:04 old-k8s-version-425197 kubelet[751]: E0429 12:31:04.211782 751 pod_workers.go:191] Error syncing pod a940d36c-f69c-494d-a918-07d04aa421aa ("metrics-server-9975d5f86-jgp2v_kube-system(a940d36c-f69c-494d-a918-07d04aa421aa)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0429 12:35:32.859953 1423526 logs.go:138] Found kubelet problem: Apr 29 12:31:13 old-k8s-version-425197 kubelet[751]: E0429 12:31:13.212598 751 pod_workers.go:191] Error syncing pod 82bfd63e-9627-4725-9f84-902d955704d9 ("dashboard-metrics-scraper-8d5bb5db8-xlb6n_kubernetes-dashboard(82bfd63e-9627-4725-9f84-902d955704d9)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xlb6n_kubernetes-dashboard(82bfd63e-9627-4725-9f84-902d955704d9)"
W0429 12:35:32.860134 1423526 logs.go:138] Found kubelet problem: Apr 29 12:31:15 old-k8s-version-425197 kubelet[751]: E0429 12:31:15.211861 751 pod_workers.go:191] Error syncing pod a940d36c-f69c-494d-a918-07d04aa421aa ("metrics-server-9975d5f86-jgp2v_kube-system(a940d36c-f69c-494d-a918-07d04aa421aa)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0429 12:35:32.860457 1423526 logs.go:138] Found kubelet problem: Apr 29 12:31:24 old-k8s-version-425197 kubelet[751]: E0429 12:31:24.211151 751 pod_workers.go:191] Error syncing pod 82bfd63e-9627-4725-9f84-902d955704d9 ("dashboard-metrics-scraper-8d5bb5db8-xlb6n_kubernetes-dashboard(82bfd63e-9627-4725-9f84-902d955704d9)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xlb6n_kubernetes-dashboard(82bfd63e-9627-4725-9f84-902d955704d9)"
W0429 12:35:32.862510 1423526 logs.go:138] Found kubelet problem: Apr 29 12:31:27 old-k8s-version-425197 kubelet[751]: E0429 12:31:27.221253 751 pod_workers.go:191] Error syncing pod a940d36c-f69c-494d-a918-07d04aa421aa ("metrics-server-9975d5f86-jgp2v_kube-system(a940d36c-f69c-494d-a918-07d04aa421aa)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = pinging container registry fake.domain: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain: no such host"
W0429 12:35:32.862837 1423526 logs.go:138] Found kubelet problem: Apr 29 12:31:36 old-k8s-version-425197 kubelet[751]: E0429 12:31:36.211916 751 pod_workers.go:191] Error syncing pod 82bfd63e-9627-4725-9f84-902d955704d9 ("dashboard-metrics-scraper-8d5bb5db8-xlb6n_kubernetes-dashboard(82bfd63e-9627-4725-9f84-902d955704d9)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xlb6n_kubernetes-dashboard(82bfd63e-9627-4725-9f84-902d955704d9)"
W0429 12:35:32.863018 1423526 logs.go:138] Found kubelet problem: Apr 29 12:31:40 old-k8s-version-425197 kubelet[751]: E0429 12:31:40.211944 751 pod_workers.go:191] Error syncing pod a940d36c-f69c-494d-a918-07d04aa421aa ("metrics-server-9975d5f86-jgp2v_kube-system(a940d36c-f69c-494d-a918-07d04aa421aa)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0429 12:35:32.863598 1423526 logs.go:138] Found kubelet problem: Apr 29 12:31:48 old-k8s-version-425197 kubelet[751]: E0429 12:31:48.542770 751 pod_workers.go:191] Error syncing pod 82bfd63e-9627-4725-9f84-902d955704d9 ("dashboard-metrics-scraper-8d5bb5db8-xlb6n_kubernetes-dashboard(82bfd63e-9627-4725-9f84-902d955704d9)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xlb6n_kubernetes-dashboard(82bfd63e-9627-4725-9f84-902d955704d9)"
W0429 12:35:32.863921 1423526 logs.go:138] Found kubelet problem: Apr 29 12:31:52 old-k8s-version-425197 kubelet[751]: E0429 12:31:52.334115 751 pod_workers.go:191] Error syncing pod 82bfd63e-9627-4725-9f84-902d955704d9 ("dashboard-metrics-scraper-8d5bb5db8-xlb6n_kubernetes-dashboard(82bfd63e-9627-4725-9f84-902d955704d9)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xlb6n_kubernetes-dashboard(82bfd63e-9627-4725-9f84-902d955704d9)"
W0429 12:35:32.864102 1423526 logs.go:138] Found kubelet problem: Apr 29 12:31:53 old-k8s-version-425197 kubelet[751]: E0429 12:31:53.212065 751 pod_workers.go:191] Error syncing pod a940d36c-f69c-494d-a918-07d04aa421aa ("metrics-server-9975d5f86-jgp2v_kube-system(a940d36c-f69c-494d-a918-07d04aa421aa)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0429 12:35:32.864429 1423526 logs.go:138] Found kubelet problem: Apr 29 12:32:07 old-k8s-version-425197 kubelet[751]: E0429 12:32:07.212281 751 pod_workers.go:191] Error syncing pod 82bfd63e-9627-4725-9f84-902d955704d9 ("dashboard-metrics-scraper-8d5bb5db8-xlb6n_kubernetes-dashboard(82bfd63e-9627-4725-9f84-902d955704d9)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xlb6n_kubernetes-dashboard(82bfd63e-9627-4725-9f84-902d955704d9)"
W0429 12:35:32.864613 1423526 logs.go:138] Found kubelet problem: Apr 29 12:32:08 old-k8s-version-425197 kubelet[751]: E0429 12:32:08.212237 751 pod_workers.go:191] Error syncing pod a940d36c-f69c-494d-a918-07d04aa421aa ("metrics-server-9975d5f86-jgp2v_kube-system(a940d36c-f69c-494d-a918-07d04aa421aa)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0429 12:35:32.864941 1423526 logs.go:138] Found kubelet problem: Apr 29 12:32:21 old-k8s-version-425197 kubelet[751]: E0429 12:32:21.211175 751 pod_workers.go:191] Error syncing pod 82bfd63e-9627-4725-9f84-902d955704d9 ("dashboard-metrics-scraper-8d5bb5db8-xlb6n_kubernetes-dashboard(82bfd63e-9627-4725-9f84-902d955704d9)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xlb6n_kubernetes-dashboard(82bfd63e-9627-4725-9f84-902d955704d9)"
W0429 12:35:32.865123 1423526 logs.go:138] Found kubelet problem: Apr 29 12:32:23 old-k8s-version-425197 kubelet[751]: E0429 12:32:23.212280 751 pod_workers.go:191] Error syncing pod a940d36c-f69c-494d-a918-07d04aa421aa ("metrics-server-9975d5f86-jgp2v_kube-system(a940d36c-f69c-494d-a918-07d04aa421aa)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0429 12:35:32.865446 1423526 logs.go:138] Found kubelet problem: Apr 29 12:32:35 old-k8s-version-425197 kubelet[751]: E0429 12:32:35.211140 751 pod_workers.go:191] Error syncing pod 82bfd63e-9627-4725-9f84-902d955704d9 ("dashboard-metrics-scraper-8d5bb5db8-xlb6n_kubernetes-dashboard(82bfd63e-9627-4725-9f84-902d955704d9)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xlb6n_kubernetes-dashboard(82bfd63e-9627-4725-9f84-902d955704d9)"
W0429 12:35:32.865627 1423526 logs.go:138] Found kubelet problem: Apr 29 12:32:36 old-k8s-version-425197 kubelet[751]: E0429 12:32:36.212634 751 pod_workers.go:191] Error syncing pod a940d36c-f69c-494d-a918-07d04aa421aa ("metrics-server-9975d5f86-jgp2v_kube-system(a940d36c-f69c-494d-a918-07d04aa421aa)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0429 12:35:32.865948 1423526 logs.go:138] Found kubelet problem: Apr 29 12:32:47 old-k8s-version-425197 kubelet[751]: E0429 12:32:47.211198 751 pod_workers.go:191] Error syncing pod 82bfd63e-9627-4725-9f84-902d955704d9 ("dashboard-metrics-scraper-8d5bb5db8-xlb6n_kubernetes-dashboard(82bfd63e-9627-4725-9f84-902d955704d9)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xlb6n_kubernetes-dashboard(82bfd63e-9627-4725-9f84-902d955704d9)"
W0429 12:35:32.867960 1423526 logs.go:138] Found kubelet problem: Apr 29 12:32:49 old-k8s-version-425197 kubelet[751]: E0429 12:32:49.219994 751 pod_workers.go:191] Error syncing pod a940d36c-f69c-494d-a918-07d04aa421aa ("metrics-server-9975d5f86-jgp2v_kube-system(a940d36c-f69c-494d-a918-07d04aa421aa)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = pinging container registry fake.domain: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain: no such host"
W0429 12:35:32.868282 1423526 logs.go:138] Found kubelet problem: Apr 29 12:33:02 old-k8s-version-425197 kubelet[751]: E0429 12:33:02.211522 751 pod_workers.go:191] Error syncing pod 82bfd63e-9627-4725-9f84-902d955704d9 ("dashboard-metrics-scraper-8d5bb5db8-xlb6n_kubernetes-dashboard(82bfd63e-9627-4725-9f84-902d955704d9)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xlb6n_kubernetes-dashboard(82bfd63e-9627-4725-9f84-902d955704d9)"
W0429 12:35:32.868462 1423526 logs.go:138] Found kubelet problem: Apr 29 12:33:02 old-k8s-version-425197 kubelet[751]: E0429 12:33:02.212607 751 pod_workers.go:191] Error syncing pod a940d36c-f69c-494d-a918-07d04aa421aa ("metrics-server-9975d5f86-jgp2v_kube-system(a940d36c-f69c-494d-a918-07d04aa421aa)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0429 12:35:32.868645 1423526 logs.go:138] Found kubelet problem: Apr 29 12:33:13 old-k8s-version-425197 kubelet[751]: E0429 12:33:13.211645 751 pod_workers.go:191] Error syncing pod a940d36c-f69c-494d-a918-07d04aa421aa ("metrics-server-9975d5f86-jgp2v_kube-system(a940d36c-f69c-494d-a918-07d04aa421aa)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0429 12:35:32.869237 1423526 logs.go:138] Found kubelet problem: Apr 29 12:33:14 old-k8s-version-425197 kubelet[751]: E0429 12:33:14.663840 751 pod_workers.go:191] Error syncing pod 82bfd63e-9627-4725-9f84-902d955704d9 ("dashboard-metrics-scraper-8d5bb5db8-xlb6n_kubernetes-dashboard(82bfd63e-9627-4725-9f84-902d955704d9)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xlb6n_kubernetes-dashboard(82bfd63e-9627-4725-9f84-902d955704d9)"
W0429 12:35:32.869562 1423526 logs.go:138] Found kubelet problem: Apr 29 12:33:22 old-k8s-version-425197 kubelet[751]: E0429 12:33:22.334161 751 pod_workers.go:191] Error syncing pod 82bfd63e-9627-4725-9f84-902d955704d9 ("dashboard-metrics-scraper-8d5bb5db8-xlb6n_kubernetes-dashboard(82bfd63e-9627-4725-9f84-902d955704d9)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xlb6n_kubernetes-dashboard(82bfd63e-9627-4725-9f84-902d955704d9)"
W0429 12:35:32.869745 1423526 logs.go:138] Found kubelet problem: Apr 29 12:33:26 old-k8s-version-425197 kubelet[751]: E0429 12:33:26.211803 751 pod_workers.go:191] Error syncing pod a940d36c-f69c-494d-a918-07d04aa421aa ("metrics-server-9975d5f86-jgp2v_kube-system(a940d36c-f69c-494d-a918-07d04aa421aa)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0429 12:35:32.870066 1423526 logs.go:138] Found kubelet problem: Apr 29 12:33:36 old-k8s-version-425197 kubelet[751]: E0429 12:33:36.211577 751 pod_workers.go:191] Error syncing pod 82bfd63e-9627-4725-9f84-902d955704d9 ("dashboard-metrics-scraper-8d5bb5db8-xlb6n_kubernetes-dashboard(82bfd63e-9627-4725-9f84-902d955704d9)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xlb6n_kubernetes-dashboard(82bfd63e-9627-4725-9f84-902d955704d9)"
W0429 12:35:32.870251 1423526 logs.go:138] Found kubelet problem: Apr 29 12:33:39 old-k8s-version-425197 kubelet[751]: E0429 12:33:39.211633 751 pod_workers.go:191] Error syncing pod a940d36c-f69c-494d-a918-07d04aa421aa ("metrics-server-9975d5f86-jgp2v_kube-system(a940d36c-f69c-494d-a918-07d04aa421aa)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0429 12:35:32.870576 1423526 logs.go:138] Found kubelet problem: Apr 29 12:33:49 old-k8s-version-425197 kubelet[751]: E0429 12:33:49.211245 751 pod_workers.go:191] Error syncing pod 82bfd63e-9627-4725-9f84-902d955704d9 ("dashboard-metrics-scraper-8d5bb5db8-xlb6n_kubernetes-dashboard(82bfd63e-9627-4725-9f84-902d955704d9)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xlb6n_kubernetes-dashboard(82bfd63e-9627-4725-9f84-902d955704d9)"
W0429 12:35:32.870756 1423526 logs.go:138] Found kubelet problem: Apr 29 12:33:51 old-k8s-version-425197 kubelet[751]: E0429 12:33:51.211757 751 pod_workers.go:191] Error syncing pod a940d36c-f69c-494d-a918-07d04aa421aa ("metrics-server-9975d5f86-jgp2v_kube-system(a940d36c-f69c-494d-a918-07d04aa421aa)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0429 12:35:32.871083 1423526 logs.go:138] Found kubelet problem: Apr 29 12:34:01 old-k8s-version-425197 kubelet[751]: E0429 12:34:01.211169 751 pod_workers.go:191] Error syncing pod 82bfd63e-9627-4725-9f84-902d955704d9 ("dashboard-metrics-scraper-8d5bb5db8-xlb6n_kubernetes-dashboard(82bfd63e-9627-4725-9f84-902d955704d9)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xlb6n_kubernetes-dashboard(82bfd63e-9627-4725-9f84-902d955704d9)"
W0429 12:35:32.871263 1423526 logs.go:138] Found kubelet problem: Apr 29 12:34:03 old-k8s-version-425197 kubelet[751]: E0429 12:34:03.211740 751 pod_workers.go:191] Error syncing pod a940d36c-f69c-494d-a918-07d04aa421aa ("metrics-server-9975d5f86-jgp2v_kube-system(a940d36c-f69c-494d-a918-07d04aa421aa)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0429 12:35:32.871584 1423526 logs.go:138] Found kubelet problem: Apr 29 12:34:13 old-k8s-version-425197 kubelet[751]: E0429 12:34:13.211192 751 pod_workers.go:191] Error syncing pod 82bfd63e-9627-4725-9f84-902d955704d9 ("dashboard-metrics-scraper-8d5bb5db8-xlb6n_kubernetes-dashboard(82bfd63e-9627-4725-9f84-902d955704d9)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xlb6n_kubernetes-dashboard(82bfd63e-9627-4725-9f84-902d955704d9)"
W0429 12:35:32.871764 1423526 logs.go:138] Found kubelet problem: Apr 29 12:34:14 old-k8s-version-425197 kubelet[751]: E0429 12:34:14.211820 751 pod_workers.go:191] Error syncing pod a940d36c-f69c-494d-a918-07d04aa421aa ("metrics-server-9975d5f86-jgp2v_kube-system(a940d36c-f69c-494d-a918-07d04aa421aa)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0429 12:35:32.872085 1423526 logs.go:138] Found kubelet problem: Apr 29 12:34:27 old-k8s-version-425197 kubelet[751]: E0429 12:34:27.211244 751 pod_workers.go:191] Error syncing pod 82bfd63e-9627-4725-9f84-902d955704d9 ("dashboard-metrics-scraper-8d5bb5db8-xlb6n_kubernetes-dashboard(82bfd63e-9627-4725-9f84-902d955704d9)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xlb6n_kubernetes-dashboard(82bfd63e-9627-4725-9f84-902d955704d9)"
W0429 12:35:32.872265 1423526 logs.go:138] Found kubelet problem: Apr 29 12:34:27 old-k8s-version-425197 kubelet[751]: E0429 12:34:27.212498 751 pod_workers.go:191] Error syncing pod a940d36c-f69c-494d-a918-07d04aa421aa ("metrics-server-9975d5f86-jgp2v_kube-system(a940d36c-f69c-494d-a918-07d04aa421aa)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0429 12:35:32.872590 1423526 logs.go:138] Found kubelet problem: Apr 29 12:34:38 old-k8s-version-425197 kubelet[751]: E0429 12:34:38.211089 751 pod_workers.go:191] Error syncing pod 82bfd63e-9627-4725-9f84-902d955704d9 ("dashboard-metrics-scraper-8d5bb5db8-xlb6n_kubernetes-dashboard(82bfd63e-9627-4725-9f84-902d955704d9)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xlb6n_kubernetes-dashboard(82bfd63e-9627-4725-9f84-902d955704d9)"
W0429 12:35:32.872777 1423526 logs.go:138] Found kubelet problem: Apr 29 12:34:40 old-k8s-version-425197 kubelet[751]: E0429 12:34:40.211661 751 pod_workers.go:191] Error syncing pod a940d36c-f69c-494d-a918-07d04aa421aa ("metrics-server-9975d5f86-jgp2v_kube-system(a940d36c-f69c-494d-a918-07d04aa421aa)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0429 12:35:32.873346 1423526 logs.go:138] Found kubelet problem: Apr 29 12:34:52 old-k8s-version-425197 kubelet[751]: E0429 12:34:52.211238 751 pod_workers.go:191] Error syncing pod 82bfd63e-9627-4725-9f84-902d955704d9 ("dashboard-metrics-scraper-8d5bb5db8-xlb6n_kubernetes-dashboard(82bfd63e-9627-4725-9f84-902d955704d9)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xlb6n_kubernetes-dashboard(82bfd63e-9627-4725-9f84-902d955704d9)"
W0429 12:35:32.873527 1423526 logs.go:138] Found kubelet problem: Apr 29 12:34:55 old-k8s-version-425197 kubelet[751]: E0429 12:34:55.211712 751 pod_workers.go:191] Error syncing pod a940d36c-f69c-494d-a918-07d04aa421aa ("metrics-server-9975d5f86-jgp2v_kube-system(a940d36c-f69c-494d-a918-07d04aa421aa)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0429 12:35:32.873849 1423526 logs.go:138] Found kubelet problem: Apr 29 12:35:03 old-k8s-version-425197 kubelet[751]: E0429 12:35:03.211147 751 pod_workers.go:191] Error syncing pod 82bfd63e-9627-4725-9f84-902d955704d9 ("dashboard-metrics-scraper-8d5bb5db8-xlb6n_kubernetes-dashboard(82bfd63e-9627-4725-9f84-902d955704d9)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xlb6n_kubernetes-dashboard(82bfd63e-9627-4725-9f84-902d955704d9)"
W0429 12:35:32.874030 1423526 logs.go:138] Found kubelet problem: Apr 29 12:35:07 old-k8s-version-425197 kubelet[751]: E0429 12:35:07.211697 751 pod_workers.go:191] Error syncing pod a940d36c-f69c-494d-a918-07d04aa421aa ("metrics-server-9975d5f86-jgp2v_kube-system(a940d36c-f69c-494d-a918-07d04aa421aa)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0429 12:35:32.874351 1423526 logs.go:138] Found kubelet problem: Apr 29 12:35:14 old-k8s-version-425197 kubelet[751]: E0429 12:35:14.212381 751 pod_workers.go:191] Error syncing pod 82bfd63e-9627-4725-9f84-902d955704d9 ("dashboard-metrics-scraper-8d5bb5db8-xlb6n_kubernetes-dashboard(82bfd63e-9627-4725-9f84-902d955704d9)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xlb6n_kubernetes-dashboard(82bfd63e-9627-4725-9f84-902d955704d9)"
W0429 12:35:32.874534 1423526 logs.go:138] Found kubelet problem: Apr 29 12:35:22 old-k8s-version-425197 kubelet[751]: E0429 12:35:22.212000 751 pod_workers.go:191] Error syncing pod a940d36c-f69c-494d-a918-07d04aa421aa ("metrics-server-9975d5f86-jgp2v_kube-system(a940d36c-f69c-494d-a918-07d04aa421aa)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0429 12:35:32.874857 1423526 logs.go:138] Found kubelet problem: Apr 29 12:35:27 old-k8s-version-425197 kubelet[751]: E0429 12:35:27.211183 751 pod_workers.go:191] Error syncing pod 82bfd63e-9627-4725-9f84-902d955704d9 ("dashboard-metrics-scraper-8d5bb5db8-xlb6n_kubernetes-dashboard(82bfd63e-9627-4725-9f84-902d955704d9)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xlb6n_kubernetes-dashboard(82bfd63e-9627-4725-9f84-902d955704d9)"
I0429 12:35:32.874869 1423526 logs.go:123] Gathering logs for describe nodes ...
I0429 12:35:32.874882 1423526 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0429 12:35:33.044639 1423526 logs.go:123] Gathering logs for etcd [f87e16673fad4748fc3431ca613237d1244ca35397a18f8cc52a6f1a55706439] ...
I0429 12:35:33.044940 1423526 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 f87e16673fad4748fc3431ca613237d1244ca35397a18f8cc52a6f1a55706439"
I0429 12:35:33.091438 1423526 logs.go:123] Gathering logs for coredns [e7e73acd6e8014a42c001b36ed0f2d3c63e892feb1fc378fe2fdd2de335d53dc] ...
I0429 12:35:33.091470 1423526 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 e7e73acd6e8014a42c001b36ed0f2d3c63e892feb1fc378fe2fdd2de335d53dc"
I0429 12:35:33.139453 1423526 logs.go:123] Gathering logs for kube-controller-manager [f54a7f3a396ba3db9133a1183e07c7fc6d06a8419cfc3ff1a57aa605a963a445] ...
I0429 12:35:33.139479 1423526 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 f54a7f3a396ba3db9133a1183e07c7fc6d06a8419cfc3ff1a57aa605a963a445"
I0429 12:35:33.232982 1423526 logs.go:123] Gathering logs for storage-provisioner [a8ebc8ecfe2f93123a8fd7e1b220084645143d83b644d4ac445a896b7a30c0cb] ...
I0429 12:35:33.233019 1423526 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 a8ebc8ecfe2f93123a8fd7e1b220084645143d83b644d4ac445a896b7a30c0cb"
I0429 12:35:33.280974 1423526 logs.go:123] Gathering logs for dmesg ...
I0429 12:35:33.281007 1423526 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0429 12:35:33.300285 1423526 logs.go:123] Gathering logs for kindnet [b187065048c48a70de847611a7bfa1e7d604a1f06e81f41522e2c4623edd5594] ...
I0429 12:35:33.300316 1423526 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 b187065048c48a70de847611a7bfa1e7d604a1f06e81f41522e2c4623edd5594"
I0429 12:35:33.358564 1423526 logs.go:123] Gathering logs for CRI-O ...
I0429 12:35:33.358595 1423526 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I0429 12:35:33.442820 1423526 logs.go:123] Gathering logs for container status ...
I0429 12:35:33.442856 1423526 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0429 12:35:33.500458 1423526 out.go:304] Setting ErrFile to fd 2...
I0429 12:35:33.500484 1423526 out.go:338] TERM=,COLORTERM=, which probably does not support color
W0429 12:35:33.500554 1423526 out.go:239] X Problems detected in kubelet:
X Problems detected in kubelet:
W0429 12:35:33.500569 1423526 out.go:239] Apr 29 12:35:03 old-k8s-version-425197 kubelet[751]: E0429 12:35:03.211147 751 pod_workers.go:191] Error syncing pod 82bfd63e-9627-4725-9f84-902d955704d9 ("dashboard-metrics-scraper-8d5bb5db8-xlb6n_kubernetes-dashboard(82bfd63e-9627-4725-9f84-902d955704d9)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xlb6n_kubernetes-dashboard(82bfd63e-9627-4725-9f84-902d955704d9)"
Apr 29 12:35:03 old-k8s-version-425197 kubelet[751]: E0429 12:35:03.211147 751 pod_workers.go:191] Error syncing pod 82bfd63e-9627-4725-9f84-902d955704d9 ("dashboard-metrics-scraper-8d5bb5db8-xlb6n_kubernetes-dashboard(82bfd63e-9627-4725-9f84-902d955704d9)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xlb6n_kubernetes-dashboard(82bfd63e-9627-4725-9f84-902d955704d9)"
W0429 12:35:33.500578 1423526 out.go:239] Apr 29 12:35:07 old-k8s-version-425197 kubelet[751]: E0429 12:35:07.211697 751 pod_workers.go:191] Error syncing pod a940d36c-f69c-494d-a918-07d04aa421aa ("metrics-server-9975d5f86-jgp2v_kube-system(a940d36c-f69c-494d-a918-07d04aa421aa)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Apr 29 12:35:07 old-k8s-version-425197 kubelet[751]: E0429 12:35:07.211697 751 pod_workers.go:191] Error syncing pod a940d36c-f69c-494d-a918-07d04aa421aa ("metrics-server-9975d5f86-jgp2v_kube-system(a940d36c-f69c-494d-a918-07d04aa421aa)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0429 12:35:33.500593 1423526 out.go:239] Apr 29 12:35:14 old-k8s-version-425197 kubelet[751]: E0429 12:35:14.212381 751 pod_workers.go:191] Error syncing pod 82bfd63e-9627-4725-9f84-902d955704d9 ("dashboard-metrics-scraper-8d5bb5db8-xlb6n_kubernetes-dashboard(82bfd63e-9627-4725-9f84-902d955704d9)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xlb6n_kubernetes-dashboard(82bfd63e-9627-4725-9f84-902d955704d9)"
Apr 29 12:35:14 old-k8s-version-425197 kubelet[751]: E0429 12:35:14.212381 751 pod_workers.go:191] Error syncing pod 82bfd63e-9627-4725-9f84-902d955704d9 ("dashboard-metrics-scraper-8d5bb5db8-xlb6n_kubernetes-dashboard(82bfd63e-9627-4725-9f84-902d955704d9)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xlb6n_kubernetes-dashboard(82bfd63e-9627-4725-9f84-902d955704d9)"
W0429 12:35:33.500724 1423526 out.go:239] Apr 29 12:35:22 old-k8s-version-425197 kubelet[751]: E0429 12:35:22.212000 751 pod_workers.go:191] Error syncing pod a940d36c-f69c-494d-a918-07d04aa421aa ("metrics-server-9975d5f86-jgp2v_kube-system(a940d36c-f69c-494d-a918-07d04aa421aa)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Apr 29 12:35:22 old-k8s-version-425197 kubelet[751]: E0429 12:35:22.212000 751 pod_workers.go:191] Error syncing pod a940d36c-f69c-494d-a918-07d04aa421aa ("metrics-server-9975d5f86-jgp2v_kube-system(a940d36c-f69c-494d-a918-07d04aa421aa)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
W0429 12:35:33.500755 1423526 out.go:239] Apr 29 12:35:27 old-k8s-version-425197 kubelet[751]: E0429 12:35:27.211183 751 pod_workers.go:191] Error syncing pod 82bfd63e-9627-4725-9f84-902d955704d9 ("dashboard-metrics-scraper-8d5bb5db8-xlb6n_kubernetes-dashboard(82bfd63e-9627-4725-9f84-902d955704d9)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xlb6n_kubernetes-dashboard(82bfd63e-9627-4725-9f84-902d955704d9)"
Apr 29 12:35:27 old-k8s-version-425197 kubelet[751]: E0429 12:35:27.211183 751 pod_workers.go:191] Error syncing pod 82bfd63e-9627-4725-9f84-902d955704d9 ("dashboard-metrics-scraper-8d5bb5db8-xlb6n_kubernetes-dashboard(82bfd63e-9627-4725-9f84-902d955704d9)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xlb6n_kubernetes-dashboard(82bfd63e-9627-4725-9f84-902d955704d9)"
I0429 12:35:33.500768 1423526 out.go:304] Setting ErrFile to fd 2...
I0429 12:35:33.500775 1423526 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0429 12:35:43.500976 1423526 api_server.go:253] Checking apiserver healthz at https://192.168.85.2:8443/healthz ...
I0429 12:35:43.509509 1423526 api_server.go:279] https://192.168.85.2:8443/healthz returned 200:
ok
I0429 12:35:43.513661 1423526 out.go:177]
W0429 12:35:43.515996 1423526 out.go:239] X Exiting due to K8S_UNHEALTHY_CONTROL_PLANE: wait 6m0s for node: wait for healthy API server: controlPlane never updated to v1.20.0
X Exiting due to K8S_UNHEALTHY_CONTROL_PLANE: wait 6m0s for node: wait for healthy API server: controlPlane never updated to v1.20.0
W0429 12:35:43.516194 1423526 out.go:239] * Suggestion: Control Plane could not update, try minikube delete --all --purge
* Suggestion: Control Plane could not update, try minikube delete --all --purge
W0429 12:35:43.516256 1423526 out.go:239] * Related issue: https://github.com/kubernetes/minikube/issues/11417
* Related issue: https://github.com/kubernetes/minikube/issues/11417
W0429 12:35:43.516290 1423526 out.go:239] *
*
W0429 12:35:43.517800 1423526 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0429 12:35:43.520235 1423526 out.go:177]
** /stderr **
start_stop_delete_test.go:259: failed to start minikube post-stop. args "out/minikube-linux-arm64 start -p old-k8s-version-425197 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --container-runtime=crio --kubernetes-version=v1.20.0": exit status 102
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:230: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/SecondStart]: docker inspect <======
helpers_test.go:231: (dbg) Run: docker inspect old-k8s-version-425197
helpers_test.go:235: (dbg) docker inspect old-k8s-version-425197:
-- stdout --
[
{
"Id": "9ec77e830d08baef23626f31b5ae4f87186a167e012dfa15a04ef645805d0496",
"Created": "2024-04-29T12:26:24.448193532Z",
"Path": "/usr/local/bin/entrypoint",
"Args": [
"/sbin/init"
],
"State": {
"Status": "running",
"Running": true,
"Paused": false,
"Restarting": false,
"OOMKilled": false,
"Dead": false,
"Pid": 1423716,
"ExitCode": 0,
"Error": "",
"StartedAt": "2024-04-29T12:29:30.697374372Z",
"FinishedAt": "2024-04-29T12:29:26.984017331Z"
},
"Image": "sha256:c9315e0f61546d7b9630cf89252fa7f614fc966830e816cca5333df5c944376f",
"ResolvConfPath": "/var/lib/docker/containers/9ec77e830d08baef23626f31b5ae4f87186a167e012dfa15a04ef645805d0496/resolv.conf",
"HostnamePath": "/var/lib/docker/containers/9ec77e830d08baef23626f31b5ae4f87186a167e012dfa15a04ef645805d0496/hostname",
"HostsPath": "/var/lib/docker/containers/9ec77e830d08baef23626f31b5ae4f87186a167e012dfa15a04ef645805d0496/hosts",
"LogPath": "/var/lib/docker/containers/9ec77e830d08baef23626f31b5ae4f87186a167e012dfa15a04ef645805d0496/9ec77e830d08baef23626f31b5ae4f87186a167e012dfa15a04ef645805d0496-json.log",
"Name": "/old-k8s-version-425197",
"RestartCount": 0,
"Driver": "overlay2",
"Platform": "linux",
"MountLabel": "",
"ProcessLabel": "",
"AppArmorProfile": "unconfined",
"ExecIDs": null,
"HostConfig": {
"Binds": [
"/lib/modules:/lib/modules:ro",
"old-k8s-version-425197:/var"
],
"ContainerIDFile": "",
"LogConfig": {
"Type": "json-file",
"Config": {}
},
"NetworkMode": "old-k8s-version-425197",
"PortBindings": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
]
},
"RestartPolicy": {
"Name": "no",
"MaximumRetryCount": 0
},
"AutoRemove": false,
"VolumeDriver": "",
"VolumesFrom": null,
"ConsoleSize": [
0,
0
],
"CapAdd": null,
"CapDrop": null,
"CgroupnsMode": "host",
"Dns": [],
"DnsOptions": [],
"DnsSearch": [],
"ExtraHosts": null,
"GroupAdd": null,
"IpcMode": "private",
"Cgroup": "",
"Links": null,
"OomScoreAdj": 0,
"PidMode": "",
"Privileged": true,
"PublishAllPorts": false,
"ReadonlyRootfs": false,
"SecurityOpt": [
"seccomp=unconfined",
"apparmor=unconfined",
"label=disable"
],
"Tmpfs": {
"/run": "",
"/tmp": ""
},
"UTSMode": "",
"UsernsMode": "",
"ShmSize": 67108864,
"Runtime": "runc",
"Isolation": "",
"CpuShares": 0,
"Memory": 2306867200,
"NanoCpus": 2000000000,
"CgroupParent": "",
"BlkioWeight": 0,
"BlkioWeightDevice": [],
"BlkioDeviceReadBps": [],
"BlkioDeviceWriteBps": [],
"BlkioDeviceReadIOps": [],
"BlkioDeviceWriteIOps": [],
"CpuPeriod": 0,
"CpuQuota": 0,
"CpuRealtimePeriod": 0,
"CpuRealtimeRuntime": 0,
"CpusetCpus": "",
"CpusetMems": "",
"Devices": [],
"DeviceCgroupRules": null,
"DeviceRequests": null,
"MemoryReservation": 0,
"MemorySwap": 4613734400,
"MemorySwappiness": null,
"OomKillDisable": false,
"PidsLimit": null,
"Ulimits": [],
"CpuCount": 0,
"CpuPercent": 0,
"IOMaximumIOps": 0,
"IOMaximumBandwidth": 0,
"MaskedPaths": null,
"ReadonlyPaths": null
},
"GraphDriver": {
"Data": {
"LowerDir": "/var/lib/docker/overlay2/ee73569bdac28ea7031b4edad4e5be5e0cf879ea69ad0c85522fcc8791e1dc9a-init/diff:/var/lib/docker/overlay2/99267fe96688a6fee0a92469b55a9da51d73214dc11fc371bf5149dbc069c731/diff",
"MergedDir": "/var/lib/docker/overlay2/ee73569bdac28ea7031b4edad4e5be5e0cf879ea69ad0c85522fcc8791e1dc9a/merged",
"UpperDir": "/var/lib/docker/overlay2/ee73569bdac28ea7031b4edad4e5be5e0cf879ea69ad0c85522fcc8791e1dc9a/diff",
"WorkDir": "/var/lib/docker/overlay2/ee73569bdac28ea7031b4edad4e5be5e0cf879ea69ad0c85522fcc8791e1dc9a/work"
},
"Name": "overlay2"
},
"Mounts": [
{
"Type": "bind",
"Source": "/lib/modules",
"Destination": "/lib/modules",
"Mode": "ro",
"RW": false,
"Propagation": "rprivate"
},
{
"Type": "volume",
"Name": "old-k8s-version-425197",
"Source": "/var/lib/docker/volumes/old-k8s-version-425197/_data",
"Destination": "/var",
"Driver": "local",
"Mode": "z",
"RW": true,
"Propagation": ""
}
],
"Config": {
"Hostname": "old-k8s-version-425197",
"Domainname": "",
"User": "",
"AttachStdin": false,
"AttachStdout": false,
"AttachStderr": false,
"ExposedPorts": {
"22/tcp": {},
"2376/tcp": {},
"32443/tcp": {},
"5000/tcp": {},
"8443/tcp": {}
},
"Tty": true,
"OpenStdin": false,
"StdinOnce": false,
"Env": [
"container=docker",
"PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
],
"Cmd": null,
"Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.43-1713736339-18706@sha256:bccd96633fa59b612ea2e24c6961d2499fe576afbab2e6056a6801ffbd3b1a7e",
"Volumes": null,
"WorkingDir": "/",
"Entrypoint": [
"/usr/local/bin/entrypoint",
"/sbin/init"
],
"OnBuild": null,
"Labels": {
"created_by.minikube.sigs.k8s.io": "true",
"mode.minikube.sigs.k8s.io": "old-k8s-version-425197",
"name.minikube.sigs.k8s.io": "old-k8s-version-425197",
"role.minikube.sigs.k8s.io": ""
},
"StopSignal": "SIGRTMIN+3"
},
"NetworkSettings": {
"Bridge": "",
"SandboxID": "f44b1fac4b9475ac1f84480bb62064d6fe1f3fde5659564d50a834fc42cbb766",
"SandboxKey": "/var/run/docker/netns/f44b1fac4b94",
"Ports": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "34568"
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "34567"
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "34564"
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "34566"
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "34565"
}
]
},
"HairpinMode": false,
"LinkLocalIPv6Address": "",
"LinkLocalIPv6PrefixLen": 0,
"SecondaryIPAddresses": null,
"SecondaryIPv6Addresses": null,
"EndpointID": "",
"Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"IPAddress": "",
"IPPrefixLen": 0,
"IPv6Gateway": "",
"MacAddress": "",
"Networks": {
"old-k8s-version-425197": {
"IPAMConfig": {
"IPv4Address": "192.168.85.2"
},
"Links": null,
"Aliases": null,
"MacAddress": "02:42:c0:a8:55:02",
"NetworkID": "e418dfcfe5850004b1f96ecc2546d5e471265b8fb16f3850524fc3d1f67e1a4f",
"EndpointID": "972df37417458f117ef22f3cda8218ab8d6762c44f3fc83e6246aeeadef4258a",
"Gateway": "192.168.85.1",
"IPAddress": "192.168.85.2",
"IPPrefixLen": 24,
"IPv6Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"DriverOpts": null,
"DNSNames": [
"old-k8s-version-425197",
"9ec77e830d08"
]
}
}
}
}
]
-- /stdout --
helpers_test.go:239: (dbg) Run: out/minikube-linux-arm64 status --format={{.Host}} -p old-k8s-version-425197 -n old-k8s-version-425197
helpers_test.go:244: <<< TestStartStop/group/old-k8s-version/serial/SecondStart FAILED: start of post-mortem logs <<<
helpers_test.go:245: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/SecondStart]: minikube logs <======
helpers_test.go:247: (dbg) Run: out/minikube-linux-arm64 -p old-k8s-version-425197 logs -n 25
helpers_test.go:247: (dbg) Done: out/minikube-linux-arm64 -p old-k8s-version-425197 logs -n 25: (2.61788016s)
helpers_test.go:252: TestStartStop/group/old-k8s-version/serial/SecondStart logs:
-- stdout --
==> Audit <==
|---------|--------------------------------------------------------|---------------------------|---------|---------|---------------------|---------------------|
| Command | Args | Profile | User | Version | Start Time | End Time |
|---------|--------------------------------------------------------|---------------------------|---------|---------|---------------------|---------------------|
| delete | -p kubernetes-upgrade-475015 | kubernetes-upgrade-475015 | jenkins | v1.33.0 | 29 Apr 24 12:25 UTC | 29 Apr 24 12:25 UTC |
| start | -p cert-expiration-059027 | cert-expiration-059027 | jenkins | v1.33.0 | 29 Apr 24 12:25 UTC | 29 Apr 24 12:25 UTC |
| | --memory=2048 | | | | | |
| | --cert-expiration=3m | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=crio | | | | | |
| delete | -p force-systemd-env-841567 | force-systemd-env-841567 | jenkins | v1.33.0 | 29 Apr 24 12:25 UTC | 29 Apr 24 12:25 UTC |
| start | -p cert-options-002271 | cert-options-002271 | jenkins | v1.33.0 | 29 Apr 24 12:25 UTC | 29 Apr 24 12:26 UTC |
| | --memory=2048 | | | | | |
| | --apiserver-ips=127.0.0.1 | | | | | |
| | --apiserver-ips=192.168.15.15 | | | | | |
| | --apiserver-names=localhost | | | | | |
| | --apiserver-names=www.google.com | | | | | |
| | --apiserver-port=8555 | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=crio | | | | | |
| ssh | cert-options-002271 ssh | cert-options-002271 | jenkins | v1.33.0 | 29 Apr 24 12:26 UTC | 29 Apr 24 12:26 UTC |
| | openssl x509 -text -noout -in | | | | | |
| | /var/lib/minikube/certs/apiserver.crt | | | | | |
| ssh | -p cert-options-002271 -- sudo | cert-options-002271 | jenkins | v1.33.0 | 29 Apr 24 12:26 UTC | 29 Apr 24 12:26 UTC |
| | cat /etc/kubernetes/admin.conf | | | | | |
| delete | -p cert-options-002271 | cert-options-002271 | jenkins | v1.33.0 | 29 Apr 24 12:26 UTC | 29 Apr 24 12:26 UTC |
| start | -p old-k8s-version-425197 | old-k8s-version-425197 | jenkins | v1.33.0 | 29 Apr 24 12:26 UTC | 29 Apr 24 12:29 UTC |
| | --memory=2200 | | | | | |
| | --alsologtostderr --wait=true | | | | | |
| | --kvm-network=default | | | | | |
| | --kvm-qemu-uri=qemu:///system | | | | | |
| | --disable-driver-mounts | | | | | |
| | --keep-context=false | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=crio | | | | | |
| | --kubernetes-version=v1.20.0 | | | | | |
| start | -p cert-expiration-059027 | cert-expiration-059027 | jenkins | v1.33.0 | 29 Apr 24 12:28 UTC | 29 Apr 24 12:29 UTC |
| | --memory=2048 | | | | | |
| | --cert-expiration=8760h | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=crio | | | | | |
| delete | -p cert-expiration-059027 | cert-expiration-059027 | jenkins | v1.33.0 | 29 Apr 24 12:29 UTC | 29 Apr 24 12:29 UTC |
| start | -p no-preload-880190 | no-preload-880190 | jenkins | v1.33.0 | 29 Apr 24 12:29 UTC | 29 Apr 24 12:30 UTC |
| | --memory=2200 | | | | | |
| | --alsologtostderr | | | | | |
| | --wait=true --preload=false | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=crio | | | | | |
| | --kubernetes-version=v1.30.0 | | | | | |
| addons | enable metrics-server -p old-k8s-version-425197 | old-k8s-version-425197 | jenkins | v1.33.0 | 29 Apr 24 12:29 UTC | 29 Apr 24 12:29 UTC |
| | --images=MetricsServer=registry.k8s.io/echoserver:1.4 | | | | | |
| | --registries=MetricsServer=fake.domain | | | | | |
| stop | -p old-k8s-version-425197 | old-k8s-version-425197 | jenkins | v1.33.0 | 29 Apr 24 12:29 UTC | 29 Apr 24 12:29 UTC |
| | --alsologtostderr -v=3 | | | | | |
| addons | enable dashboard -p old-k8s-version-425197 | old-k8s-version-425197 | jenkins | v1.33.0 | 29 Apr 24 12:29 UTC | 29 Apr 24 12:29 UTC |
| | --images=MetricsScraper=registry.k8s.io/echoserver:1.4 | | | | | |
| start | -p old-k8s-version-425197 | old-k8s-version-425197 | jenkins | v1.33.0 | 29 Apr 24 12:29 UTC | |
| | --memory=2200 | | | | | |
| | --alsologtostderr --wait=true | | | | | |
| | --kvm-network=default | | | | | |
| | --kvm-qemu-uri=qemu:///system | | | | | |
| | --disable-driver-mounts | | | | | |
| | --keep-context=false | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=crio | | | | | |
| | --kubernetes-version=v1.20.0 | | | | | |
| addons | enable metrics-server -p no-preload-880190 | no-preload-880190 | jenkins | v1.33.0 | 29 Apr 24 12:30 UTC | 29 Apr 24 12:30 UTC |
| | --images=MetricsServer=registry.k8s.io/echoserver:1.4 | | | | | |
| | --registries=MetricsServer=fake.domain | | | | | |
| stop | -p no-preload-880190 | no-preload-880190 | jenkins | v1.33.0 | 29 Apr 24 12:30 UTC | 29 Apr 24 12:30 UTC |
| | --alsologtostderr -v=3 | | | | | |
| addons | enable dashboard -p no-preload-880190 | no-preload-880190 | jenkins | v1.33.0 | 29 Apr 24 12:30 UTC | 29 Apr 24 12:30 UTC |
| | --images=MetricsScraper=registry.k8s.io/echoserver:1.4 | | | | | |
| start | -p no-preload-880190 | no-preload-880190 | jenkins | v1.33.0 | 29 Apr 24 12:30 UTC | 29 Apr 24 12:35 UTC |
| | --memory=2200 | | | | | |
| | --alsologtostderr | | | | | |
| | --wait=true --preload=false | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=crio | | | | | |
| | --kubernetes-version=v1.30.0 | | | | | |
| image | no-preload-880190 image list | no-preload-880190 | jenkins | v1.33.0 | 29 Apr 24 12:35 UTC | 29 Apr 24 12:35 UTC |
| | --format=json | | | | | |
| pause | -p no-preload-880190 | no-preload-880190 | jenkins | v1.33.0 | 29 Apr 24 12:35 UTC | 29 Apr 24 12:35 UTC |
| | --alsologtostderr -v=1 | | | | | |
| unpause | -p no-preload-880190 | no-preload-880190 | jenkins | v1.33.0 | 29 Apr 24 12:35 UTC | 29 Apr 24 12:35 UTC |
| | --alsologtostderr -v=1 | | | | | |
| delete | -p no-preload-880190 | no-preload-880190 | jenkins | v1.33.0 | 29 Apr 24 12:35 UTC | 29 Apr 24 12:35 UTC |
| delete | -p no-preload-880190 | no-preload-880190 | jenkins | v1.33.0 | 29 Apr 24 12:35 UTC | 29 Apr 24 12:35 UTC |
| start | -p embed-certs-635140 | embed-certs-635140 | jenkins | v1.33.0 | 29 Apr 24 12:35 UTC | |
| | --memory=2200 | | | | | |
| | --alsologtostderr --wait=true | | | | | |
| | --embed-certs --driver=docker | | | | | |
| | --container-runtime=crio | | | | | |
| | --kubernetes-version=v1.30.0 | | | | | |
|---------|--------------------------------------------------------|---------------------------|---------|---------|---------------------|---------------------|
==> Last Start <==
Log file created at: 2024/04/29 12:35:41
Running on machine: ip-172-31-31-251
Binary: Built with gc go1.22.1 for linux/arm64
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
I0429 12:35:41.072935 1432272 out.go:291] Setting OutFile to fd 1 ...
I0429 12:35:41.073101 1432272 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0429 12:35:41.073111 1432272 out.go:304] Setting ErrFile to fd 2...
I0429 12:35:41.073116 1432272 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0429 12:35:41.073657 1432272 root.go:338] Updating PATH: /home/jenkins/minikube-integration/18756-1231546/.minikube/bin
I0429 12:35:41.074252 1432272 out.go:298] Setting JSON to false
I0429 12:35:41.075353 1432272 start.go:129] hostinfo: {"hostname":"ip-172-31-31-251","uptime":29885,"bootTime":1714364256,"procs":204,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1058-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"982e3628-3742-4b3e-bb63-ac1b07660ec7"}
I0429 12:35:41.075487 1432272 start.go:139] virtualization:
I0429 12:35:41.078490 1432272 out.go:177] * [embed-certs-635140] minikube v1.33.0 on Ubuntu 20.04 (arm64)
I0429 12:35:41.080756 1432272 out.go:177] - MINIKUBE_LOCATION=18756
I0429 12:35:41.080871 1432272 notify.go:220] Checking for updates...
I0429 12:35:41.082916 1432272 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0429 12:35:41.085023 1432272 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/18756-1231546/kubeconfig
I0429 12:35:41.087251 1432272 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/18756-1231546/.minikube
I0429 12:35:41.089465 1432272 out.go:177] - MINIKUBE_BIN=out/minikube-linux-arm64
I0429 12:35:41.091150 1432272 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0429 12:35:41.093405 1432272 config.go:182] Loaded profile config "old-k8s-version-425197": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.20.0
I0429 12:35:41.093515 1432272 driver.go:392] Setting default libvirt URI to qemu:///system
I0429 12:35:41.114343 1432272 docker.go:122] docker version: linux-26.1.0:Docker Engine - Community
I0429 12:35:41.114464 1432272 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0429 12:35:41.185336 1432272 info.go:266] docker info: {ID:EOU5:DNGX:XN6V:L2FZ:UXRM:5TWK:EVUR:KC2F:GT7Z:Y4O4:GB77:5PD3 Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:33 OomKillDisable:true NGoroutines:52 SystemTime:2024-04-29 12:35:41.175793374 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1058-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8215105536 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-31-251 Labels:[] ExperimentalBuild:false ServerVersion:26.1.0 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:e377cd56a71523140ca6ae87e30244719194a521 Expected:e377cd56a71523140ca6ae87e30244719194a521} RuncCommit:{ID:v1.1.12-0-g51d5e94 Expected:v1.1.12-0-g51d5e94} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.14.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.26.1]] Warnings:<nil>}}
I0429 12:35:41.185456 1432272 docker.go:295] overlay module found
I0429 12:35:41.189501 1432272 out.go:177] * Using the docker driver based on user configuration
I0429 12:35:41.191526 1432272 start.go:297] selected driver: docker
I0429 12:35:41.191541 1432272 start.go:901] validating driver "docker" against <nil>
I0429 12:35:41.191555 1432272 start.go:912] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0429 12:35:41.192198 1432272 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0429 12:35:41.252148 1432272 info.go:266] docker info: {ID:EOU5:DNGX:XN6V:L2FZ:UXRM:5TWK:EVUR:KC2F:GT7Z:Y4O4:GB77:5PD3 Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:33 OomKillDisable:true NGoroutines:52 SystemTime:2024-04-29 12:35:41.241918516 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1058-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8215105536 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-31-251 Labels:[] ExperimentalBuild:false ServerVersion:26.1.0 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:e377cd56a71523140ca6ae87e30244719194a521 Expected:e377cd56a71523140ca6ae87e30244719194a521} RuncCommit:{ID:v1.1.12-0-g51d5e94 Expected:v1.1.12-0-g51d5e94} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.14.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.26.1]] Warnings:<nil>}}
I0429 12:35:41.252317 1432272 start_flags.go:310] no existing cluster config was found, will generate one from the flags
I0429 12:35:41.252560 1432272 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0429 12:35:41.254626 1432272 out.go:177] * Using Docker driver with root privileges
I0429 12:35:41.256281 1432272 cni.go:84] Creating CNI manager for ""
I0429 12:35:41.256305 1432272 cni.go:143] "docker" driver + "crio" runtime found, recommending kindnet
I0429 12:35:41.256316 1432272 start_flags.go:319] Found "CNI" CNI - setting NetworkPlugin=cni
I0429 12:35:41.256407 1432272 start.go:340] cluster config:
{Name:embed-certs-635140 KeepContext:false EmbedCerts:true MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.43-1713736339-18706@sha256:bccd96633fa59b612ea2e24c6961d2499fe576afbab2e6056a6801ffbd3b1a7e Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.0 ClusterName:embed-certs-635140 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local Contain
erRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.30.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuth
Sock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0429 12:35:41.258308 1432272 out.go:177] * Starting "embed-certs-635140" primary control-plane node in "embed-certs-635140" cluster
I0429 12:35:41.260269 1432272 cache.go:121] Beginning downloading kic base image for docker with crio
I0429 12:35:41.262240 1432272 out.go:177] * Pulling base image v0.0.43-1713736339-18706 ...
I0429 12:35:41.264066 1432272 preload.go:132] Checking if preload exists for k8s version v1.30.0 and runtime crio
I0429 12:35:41.264121 1432272 preload.go:147] Found local preload: /home/jenkins/minikube-integration/18756-1231546/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.0-cri-o-overlay-arm64.tar.lz4
I0429 12:35:41.264133 1432272 cache.go:56] Caching tarball of preloaded images
I0429 12:35:41.264163 1432272 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.43-1713736339-18706@sha256:bccd96633fa59b612ea2e24c6961d2499fe576afbab2e6056a6801ffbd3b1a7e in local docker daemon
I0429 12:35:41.264211 1432272 preload.go:173] Found /home/jenkins/minikube-integration/18756-1231546/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.0-cri-o-overlay-arm64.tar.lz4 in cache, skipping download
I0429 12:35:41.264222 1432272 cache.go:59] Finished verifying existence of preloaded tar for v1.30.0 on crio
I0429 12:35:41.264331 1432272 profile.go:143] Saving config to /home/jenkins/minikube-integration/18756-1231546/.minikube/profiles/embed-certs-635140/config.json ...
I0429 12:35:41.264347 1432272 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18756-1231546/.minikube/profiles/embed-certs-635140/config.json: {Name:mk4501ff0c6b04ac0cb9b119b874a2bab0f68fcb Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0429 12:35:41.281093 1432272 image.go:83] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.43-1713736339-18706@sha256:bccd96633fa59b612ea2e24c6961d2499fe576afbab2e6056a6801ffbd3b1a7e in local docker daemon, skipping pull
I0429 12:35:41.281117 1432272 cache.go:144] gcr.io/k8s-minikube/kicbase-builds:v0.0.43-1713736339-18706@sha256:bccd96633fa59b612ea2e24c6961d2499fe576afbab2e6056a6801ffbd3b1a7e exists in daemon, skipping load
I0429 12:35:41.281138 1432272 cache.go:194] Successfully downloaded all kic artifacts
I0429 12:35:41.281165 1432272 start.go:360] acquireMachinesLock for embed-certs-635140: {Name:mk793719d761fc16f39f9e28387e2f7e1e8ff535 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0429 12:35:41.281739 1432272 start.go:364] duration metric: took 548.288µs to acquireMachinesLock for "embed-certs-635140"
I0429 12:35:41.281775 1432272 start.go:93] Provisioning new machine with config: &{Name:embed-certs-635140 KeepContext:false EmbedCerts:true MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.43-1713736339-18706@sha256:bccd96633fa59b612ea2e24c6961d2499fe576afbab2e6056a6801ffbd3b1a7e Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.0 ClusterName:embed-certs-635140 Namespace:default APIServerHAVIP: APIServe
rName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.30.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false
CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.30.0 ContainerRuntime:crio ControlPlane:true Worker:true}
I0429 12:35:41.281870 1432272 start.go:125] createHost starting for "" (driver="docker")
I0429 12:35:43.500976 1423526 api_server.go:253] Checking apiserver healthz at https://192.168.85.2:8443/healthz ...
I0429 12:35:43.509509 1423526 api_server.go:279] https://192.168.85.2:8443/healthz returned 200:
ok
I0429 12:35:43.513661 1423526 out.go:177]
W0429 12:35:43.515996 1423526 out.go:239] X Exiting due to K8S_UNHEALTHY_CONTROL_PLANE: wait 6m0s for node: wait for healthy API server: controlPlane never updated to v1.20.0
W0429 12:35:43.516194 1423526 out.go:239] * Suggestion: Control Plane could not update, try minikube delete --all --purge
W0429 12:35:43.516256 1423526 out.go:239] * Related issue: https://github.com/kubernetes/minikube/issues/11417
W0429 12:35:43.516290 1423526 out.go:239] *
W0429 12:35:43.517800 1423526 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0429 12:35:43.520235 1423526 out.go:177]
==> CRI-O <==
Apr 29 12:33:26 old-k8s-version-425197 crio[639]: time="2024-04-29 12:33:26.211617657Z" level=info msg="Image fake.domain/registry.k8s.io/echoserver:1.4 not found" id=e3edc651-3a67-49a6-8def-948e086838a2 name=/runtime.v1alpha2.ImageService/ImageStatus
Apr 29 12:33:39 old-k8s-version-425197 crio[639]: time="2024-04-29 12:33:39.211185653Z" level=info msg="Checking image status: fake.domain/registry.k8s.io/echoserver:1.4" id=c176bf51-72f9-4a65-8fa5-8af05770587e name=/runtime.v1alpha2.ImageService/ImageStatus
Apr 29 12:33:39 old-k8s-version-425197 crio[639]: time="2024-04-29 12:33:39.211425529Z" level=info msg="Image fake.domain/registry.k8s.io/echoserver:1.4 not found" id=c176bf51-72f9-4a65-8fa5-8af05770587e name=/runtime.v1alpha2.ImageService/ImageStatus
Apr 29 12:33:51 old-k8s-version-425197 crio[639]: time="2024-04-29 12:33:51.211168072Z" level=info msg="Checking image status: fake.domain/registry.k8s.io/echoserver:1.4" id=e357d9fd-ad3f-4ff0-a735-0a5b4ef54129 name=/runtime.v1alpha2.ImageService/ImageStatus
Apr 29 12:33:51 old-k8s-version-425197 crio[639]: time="2024-04-29 12:33:51.211405633Z" level=info msg="Image fake.domain/registry.k8s.io/echoserver:1.4 not found" id=e357d9fd-ad3f-4ff0-a735-0a5b4ef54129 name=/runtime.v1alpha2.ImageService/ImageStatus
Apr 29 12:34:03 old-k8s-version-425197 crio[639]: time="2024-04-29 12:34:03.211273218Z" level=info msg="Checking image status: fake.domain/registry.k8s.io/echoserver:1.4" id=cdd1a439-4a8e-4c97-b528-db49c978b4c6 name=/runtime.v1alpha2.ImageService/ImageStatus
Apr 29 12:34:03 old-k8s-version-425197 crio[639]: time="2024-04-29 12:34:03.211513307Z" level=info msg="Image fake.domain/registry.k8s.io/echoserver:1.4 not found" id=cdd1a439-4a8e-4c97-b528-db49c978b4c6 name=/runtime.v1alpha2.ImageService/ImageStatus
Apr 29 12:34:14 old-k8s-version-425197 crio[639]: time="2024-04-29 12:34:14.211095828Z" level=info msg="Checking image status: fake.domain/registry.k8s.io/echoserver:1.4" id=78d8643e-ff14-448d-b623-8f2483178011 name=/runtime.v1alpha2.ImageService/ImageStatus
Apr 29 12:34:14 old-k8s-version-425197 crio[639]: time="2024-04-29 12:34:14.211338609Z" level=info msg="Image fake.domain/registry.k8s.io/echoserver:1.4 not found" id=78d8643e-ff14-448d-b623-8f2483178011 name=/runtime.v1alpha2.ImageService/ImageStatus
Apr 29 12:34:27 old-k8s-version-425197 crio[639]: time="2024-04-29 12:34:27.212035159Z" level=info msg="Checking image status: fake.domain/registry.k8s.io/echoserver:1.4" id=2ef950bf-75ba-4a40-a37f-07461395f0b3 name=/runtime.v1alpha2.ImageService/ImageStatus
Apr 29 12:34:27 old-k8s-version-425197 crio[639]: time="2024-04-29 12:34:27.212277447Z" level=info msg="Image fake.domain/registry.k8s.io/echoserver:1.4 not found" id=2ef950bf-75ba-4a40-a37f-07461395f0b3 name=/runtime.v1alpha2.ImageService/ImageStatus
Apr 29 12:34:40 old-k8s-version-425197 crio[639]: time="2024-04-29 12:34:40.211244813Z" level=info msg="Checking image status: fake.domain/registry.k8s.io/echoserver:1.4" id=39fa64af-e86d-4842-a103-a98489fc9ad2 name=/runtime.v1alpha2.ImageService/ImageStatus
Apr 29 12:34:40 old-k8s-version-425197 crio[639]: time="2024-04-29 12:34:40.211492287Z" level=info msg="Image fake.domain/registry.k8s.io/echoserver:1.4 not found" id=39fa64af-e86d-4842-a103-a98489fc9ad2 name=/runtime.v1alpha2.ImageService/ImageStatus
Apr 29 12:34:46 old-k8s-version-425197 crio[639]: time="2024-04-29 12:34:46.244286496Z" level=info msg="Checking image status: k8s.gcr.io/pause:3.2" id=11f86f62-d3b8-4631-981b-67a5712ea1f7 name=/runtime.v1alpha2.ImageService/ImageStatus
Apr 29 12:34:46 old-k8s-version-425197 crio[639]: time="2024-04-29 12:34:46.244541847Z" level=info msg="Image status: &ImageStatusResponse{Image:&Image{Id:2a060e2e7101d419352bf82c613158587400be743482d9a537ec4a9d1b4eb93c,RepoTags:[k8s.gcr.io/pause:3.2 registry.k8s.io/pause:3.2],RepoDigests:[k8s.gcr.io/pause@sha256:31d3efd12022ffeffb3146bc10ae8beb890c80ed2f07363515580add7ed47636 k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f registry.k8s.io/pause@sha256:31d3efd12022ffeffb3146bc10ae8beb890c80ed2f07363515580add7ed47636 registry.k8s.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f],Size_:489397,Uid:nil,Username:,Spec:nil,},Info:map[string]string{},}" id=11f86f62-d3b8-4631-981b-67a5712ea1f7 name=/runtime.v1alpha2.ImageService/ImageStatus
Apr 29 12:34:55 old-k8s-version-425197 crio[639]: time="2024-04-29 12:34:55.211260011Z" level=info msg="Checking image status: fake.domain/registry.k8s.io/echoserver:1.4" id=106f5c43-1e84-403e-9477-d02a77d55d90 name=/runtime.v1alpha2.ImageService/ImageStatus
Apr 29 12:34:55 old-k8s-version-425197 crio[639]: time="2024-04-29 12:34:55.211496408Z" level=info msg="Image fake.domain/registry.k8s.io/echoserver:1.4 not found" id=106f5c43-1e84-403e-9477-d02a77d55d90 name=/runtime.v1alpha2.ImageService/ImageStatus
Apr 29 12:35:07 old-k8s-version-425197 crio[639]: time="2024-04-29 12:35:07.211241414Z" level=info msg="Checking image status: fake.domain/registry.k8s.io/echoserver:1.4" id=e8ce47a8-a801-44c6-a797-643ffb7ec839 name=/runtime.v1alpha2.ImageService/ImageStatus
Apr 29 12:35:07 old-k8s-version-425197 crio[639]: time="2024-04-29 12:35:07.211475464Z" level=info msg="Image fake.domain/registry.k8s.io/echoserver:1.4 not found" id=e8ce47a8-a801-44c6-a797-643ffb7ec839 name=/runtime.v1alpha2.ImageService/ImageStatus
Apr 29 12:35:22 old-k8s-version-425197 crio[639]: time="2024-04-29 12:35:22.211452691Z" level=info msg="Checking image status: fake.domain/registry.k8s.io/echoserver:1.4" id=a9b4a140-b832-4264-8535-605ccdbb7458 name=/runtime.v1alpha2.ImageService/ImageStatus
Apr 29 12:35:22 old-k8s-version-425197 crio[639]: time="2024-04-29 12:35:22.211693920Z" level=info msg="Image fake.domain/registry.k8s.io/echoserver:1.4 not found" id=a9b4a140-b832-4264-8535-605ccdbb7458 name=/runtime.v1alpha2.ImageService/ImageStatus
Apr 29 12:35:37 old-k8s-version-425197 crio[639]: time="2024-04-29 12:35:37.211196647Z" level=info msg="Checking image status: fake.domain/registry.k8s.io/echoserver:1.4" id=5d038382-48e1-4240-8b46-0e4c6f163c96 name=/runtime.v1alpha2.ImageService/ImageStatus
Apr 29 12:35:37 old-k8s-version-425197 crio[639]: time="2024-04-29 12:35:37.211441569Z" level=info msg="Image fake.domain/registry.k8s.io/echoserver:1.4 not found" id=5d038382-48e1-4240-8b46-0e4c6f163c96 name=/runtime.v1alpha2.ImageService/ImageStatus
Apr 29 12:35:37 old-k8s-version-425197 crio[639]: time="2024-04-29 12:35:37.212647092Z" level=info msg="Pulling image: fake.domain/registry.k8s.io/echoserver:1.4" id=c9aa4dad-b99c-46f0-8b6d-8d41ba24f022 name=/runtime.v1alpha2.ImageService/PullImage
Apr 29 12:35:37 old-k8s-version-425197 crio[639]: time="2024-04-29 12:35:37.228142521Z" level=info msg="Trying to access \"fake.domain/registry.k8s.io/echoserver:1.4\""
==> container status <==
CONTAINER IMAGE CREATED STATE NAME ATTEMPT POD ID POD
cee29e4ac7387 a90209bb39e3d7b5fc9daf60c17044ea969aaca0333d672d8c7a34c7446e7ff7 2 minutes ago Exited dashboard-metrics-scraper 5 d38b5b146fb9d dashboard-metrics-scraper-8d5bb5db8-xlb6n
3ab604aa41320 ba04bb24b95753201135cbc420b233c1b0b9fa2e1fd21d28319c348c33fbcde6 5 minutes ago Running storage-provisioner 1 8b337480a7787 storage-provisioner
8e449405f9789 docker.io/kubernetesui/dashboard@sha256:2e500d29e9d5f4a086b908eb8dfe7ecac57d2ab09d65b24f588b1d449841ef93 5 minutes ago Running kubernetes-dashboard 0 5dc8c2e1af8a3 kubernetes-dashboard-cd95d586-jjpdf
18f81edeecda8 25a5233254979d0678a2db1d15b76b73dc380d81bc5eed93916ba5638b3cd894 5 minutes ago Running kube-proxy 0 6e3d520a7f018 kube-proxy-5hlxl
e7e73acd6e801 db91994f4ee8f894a1e8a6c1a76f615da8fc3c019300a3686291ce6fcbc57895 5 minutes ago Running coredns 0 ee91dff2888ee coredns-74ff55c5b-hzh92
b187065048c48 4740c1948d3fceb8d7dacc63033aa6299d80794ee4f4811539ec1081d9211f3d 5 minutes ago Running kindnet-cni 0 b4184ed33bfb8 kindnet-7lslc
a8ebc8ecfe2f9 ba04bb24b95753201135cbc420b233c1b0b9fa2e1fd21d28319c348c33fbcde6 5 minutes ago Exited storage-provisioner 0 8b337480a7787 storage-provisioner
4fd0a65f52ff1 1611cd07b61d57dbbfebe6db242513fd51e1c02d20ba08af17a45837d86a8a8c 5 minutes ago Running busybox 0 c29e9ca3f4778 busybox
f54a7f3a396ba 1df8a2b116bd16f7070fd383a6769c8d644b365575e8ffa3e492b84e4f05fc74 5 minutes ago Running kube-controller-manager 0 d64e525e538fb kube-controller-manager-old-k8s-version-425197
2d3031452f789 e7605f88f17d6a4c3f083ef9c6f5f19b39f87e4d4406a05a8612b54a6ea57051 5 minutes ago Running kube-scheduler 0 c8fe2fe4fda91 kube-scheduler-old-k8s-version-425197
f87e16673fad4 05b738aa1bc6355db8a2ee8639f3631b908286e43f584a3d2ee0c472de033c28 5 minutes ago Running etcd 0 e5dc54ba5a240 etcd-old-k8s-version-425197
f70d0c48d3996 2c08bbbc02d3aa5dfbf4e79f15c0a61424049288917aa10364464ca1f7de7157 5 minutes ago Running kube-apiserver 0 b4736b572dded kube-apiserver-old-k8s-version-425197
==> coredns [e7e73acd6e8014a42c001b36ed0f2d3c63e892feb1fc378fe2fdd2de335d53dc] <==
.:53
[INFO] plugin/reload: Running configuration MD5 = 093a0bf1423dd8c4eee62372bb216168
CoreDNS-1.7.0
linux/arm64, go1.14.4, f59c03d
[INFO] 127.0.0.1:51940 - 16008 "HINFO IN 1501846682157261104.1390484488655506091. udp 57 false 512" NXDOMAIN qr,rd,ra 57 0.031190276s
[INFO] SIGTERM: Shutting down servers then terminating
[INFO] plugin/health: Going into lameduck mode for 5s
.:53
[INFO] plugin/reload: Running configuration MD5 = 093a0bf1423dd8c4eee62372bb216168
CoreDNS-1.7.0
linux/arm64, go1.14.4, f59c03d
[INFO] 127.0.0.1:41529 - 41350 "HINFO IN 8450241710363776983.7337920661522141015. udp 57 false 512" NXDOMAIN qr,rd,ra 57 0.012867136s
[INFO] plugin/ready: Still waiting on: "kubernetes"
[INFO] plugin/ready: Still waiting on: "kubernetes"
[INFO] plugin/ready: Still waiting on: "kubernetes"
I0429 12:30:28.745277 1 trace.go:116] Trace[2019727887]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125 (started: 2024-04-29 12:29:58.744544356 +0000 UTC m=+0.026676743) (total time: 30.000620091s):
Trace[2019727887]: [30.000620091s] [30.000620091s] END
E0429 12:30:28.745306 1 reflector.go:178] pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125: Failed to list *v1.Namespace: Get "https://10.96.0.1:443/api/v1/namespaces?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout
I0429 12:30:28.745713 1 trace.go:116] Trace[939984059]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125 (started: 2024-04-29 12:29:58.745404306 +0000 UTC m=+0.027536684) (total time: 30.000282806s):
Trace[939984059]: [30.000282806s] [30.000282806s] END
E0429 12:30:28.745728 1 reflector.go:178] pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125: Failed to list *v1.Service: Get "https://10.96.0.1:443/api/v1/services?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout
I0429 12:30:28.745933 1 trace.go:116] Trace[911902081]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125 (started: 2024-04-29 12:29:58.745649662 +0000 UTC m=+0.027782041) (total time: 30.000260209s):
Trace[911902081]: [30.000260209s] [30.000260209s] END
E0429 12:30:28.745992 1 reflector.go:178] pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125: Failed to list *v1.Endpoints: Get "https://10.96.0.1:443/api/v1/endpoints?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout
==> describe nodes <==
Name: old-k8s-version-425197
Roles: control-plane,master
Labels: beta.kubernetes.io/arch=arm64
beta.kubernetes.io/os=linux
kubernetes.io/arch=arm64
kubernetes.io/hostname=old-k8s-version-425197
kubernetes.io/os=linux
minikube.k8s.io/commit=8dbdf0965c47dd73171cfc89e1a9c75505f7a22d
minikube.k8s.io/name=old-k8s-version-425197
minikube.k8s.io/primary=true
minikube.k8s.io/updated_at=2024_04_29T12_27_11_0700
minikube.k8s.io/version=v1.33.0
node-role.kubernetes.io/control-plane=
node-role.kubernetes.io/master=
Annotations: kubeadm.alpha.kubernetes.io/cri-socket: /var/run/crio/crio.sock
node.alpha.kubernetes.io/ttl: 0
volumes.kubernetes.io/controller-managed-attach-detach: true
CreationTimestamp: Mon, 29 Apr 2024 12:27:07 +0000
Taints: <none>
Unschedulable: false
Lease:
HolderIdentity: old-k8s-version-425197
AcquireTime: <unset>
RenewTime: Mon, 29 Apr 2024 12:35:38 +0000
Conditions:
Type Status LastHeartbeatTime LastTransitionTime Reason Message
---- ------ ----------------- ------------------ ------ -------
MemoryPressure False Mon, 29 Apr 2024 12:30:46 +0000 Mon, 29 Apr 2024 12:27:01 +0000 KubeletHasSufficientMemory kubelet has sufficient memory available
DiskPressure False Mon, 29 Apr 2024 12:30:46 +0000 Mon, 29 Apr 2024 12:27:01 +0000 KubeletHasNoDiskPressure kubelet has no disk pressure
PIDPressure False Mon, 29 Apr 2024 12:30:46 +0000 Mon, 29 Apr 2024 12:27:01 +0000 KubeletHasSufficientPID kubelet has sufficient PID available
Ready True Mon, 29 Apr 2024 12:30:46 +0000 Mon, 29 Apr 2024 12:28:09 +0000 KubeletReady kubelet is posting ready status
Addresses:
InternalIP: 192.168.85.2
Hostname: old-k8s-version-425197
Capacity:
cpu: 2
ephemeral-storage: 203034800Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
hugepages-32Mi: 0
hugepages-64Ki: 0
memory: 8022564Ki
pods: 110
Allocatable:
cpu: 2
ephemeral-storage: 203034800Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
hugepages-32Mi: 0
hugepages-64Ki: 0
memory: 8022564Ki
pods: 110
System Info:
Machine ID: 02ab2fd0610d4d41a8b1f9fa3f181fbb
System UUID: 6e562de7-3b34-4283-bcb8-f96f0e4b2c83
Boot ID: b8f2360a-0b19-4e04-aa8c-604719eae8f1
Kernel Version: 5.15.0-1058-aws
OS Image: Ubuntu 22.04.4 LTS
Operating System: linux
Architecture: arm64
Container Runtime Version: cri-o://1.24.6
Kubelet Version: v1.20.0
Kube-Proxy Version: v1.20.0
PodCIDR: 10.244.0.0/24
PodCIDRs: 10.244.0.0/24
Non-terminated Pods: (12 in total)
Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits AGE
--------- ---- ------------ ---------- --------------- ------------- ---
default busybox 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 6m42s
kube-system coredns-74ff55c5b-hzh92 100m (5%!)(MISSING) 0 (0%!)(MISSING) 70Mi (0%!)(MISSING) 170Mi (2%!)(MISSING) 8m19s
kube-system etcd-old-k8s-version-425197 100m (5%!)(MISSING) 0 (0%!)(MISSING) 100Mi (1%!)(MISSING) 0 (0%!)(MISSING) 8m26s
kube-system kindnet-7lslc 100m (5%!)(MISSING) 100m (5%!)(MISSING) 50Mi (0%!)(MISSING) 50Mi (0%!)(MISSING) 8m19s
kube-system kube-apiserver-old-k8s-version-425197 250m (12%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 8m26s
kube-system kube-controller-manager-old-k8s-version-425197 200m (10%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 8m26s
kube-system kube-proxy-5hlxl 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 8m19s
kube-system kube-scheduler-old-k8s-version-425197 100m (5%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 8m26s
kube-system metrics-server-9975d5f86-jgp2v 100m (5%!)(MISSING) 0 (0%!)(MISSING) 200Mi (2%!)(MISSING) 0 (0%!)(MISSING) 6m31s
kube-system storage-provisioner 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 8m18s
kubernetes-dashboard dashboard-metrics-scraper-8d5bb5db8-xlb6n 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 5m34s
kubernetes-dashboard kubernetes-dashboard-cd95d586-jjpdf 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 5m34s
Allocated resources:
(Total limits may be over 100 percent, i.e., overcommitted.)
Resource Requests Limits
-------- -------- ------
cpu 950m (47%!)(MISSING) 100m (5%!)(MISSING)
memory 420Mi (5%!)(MISSING) 220Mi (2%!)(MISSING)
ephemeral-storage 100Mi (0%!)(MISSING) 0 (0%!)(MISSING)
hugepages-1Gi 0 (0%!)(MISSING) 0 (0%!)(MISSING)
hugepages-2Mi 0 (0%!)(MISSING) 0 (0%!)(MISSING)
hugepages-32Mi 0 (0%!)(MISSING) 0 (0%!)(MISSING)
hugepages-64Ki 0 (0%!)(MISSING) 0 (0%!)(MISSING)
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal NodeHasSufficientMemory 8m46s (x5 over 8m46s) kubelet Node old-k8s-version-425197 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 8m46s (x5 over 8m46s) kubelet Node old-k8s-version-425197 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 8m46s (x4 over 8m46s) kubelet Node old-k8s-version-425197 status is now: NodeHasSufficientPID
Normal Starting 8m27s kubelet Starting kubelet.
Normal NodeHasSufficientMemory 8m27s kubelet Node old-k8s-version-425197 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 8m27s kubelet Node old-k8s-version-425197 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 8m27s kubelet Node old-k8s-version-425197 status is now: NodeHasSufficientPID
Normal Starting 8m18s kube-proxy Starting kube-proxy.
Normal NodeReady 7m36s kubelet Node old-k8s-version-425197 status is now: NodeReady
Normal Starting 5m59s kubelet Starting kubelet.
Normal NodeHasSufficientMemory 5m59s (x8 over 5m59s) kubelet Node old-k8s-version-425197 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 5m59s (x8 over 5m59s) kubelet Node old-k8s-version-425197 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 5m59s (x8 over 5m59s) kubelet Node old-k8s-version-425197 status is now: NodeHasSufficientPID
Normal Starting 5m45s kube-proxy Starting kube-proxy.
==> dmesg <==
[ +0.001000] FS-Cache: N-cookie d=00000000a8cdaa2f{9p.inode} n=00000000e2172674
[ +0.001140] FS-Cache: N-key=[8] 'e5405c0100000000'
[ +0.004916] FS-Cache: Duplicate cookie detected
[ +0.000791] FS-Cache: O-cookie c=0000004e [p=0000004b fl=226 nc=0 na=1]
[ +0.001003] FS-Cache: O-cookie d=00000000a8cdaa2f{9p.inode} n=00000000ec0b8a4d
[ +0.001195] FS-Cache: O-key=[8] 'e5405c0100000000'
[ +0.000745] FS-Cache: N-cookie c=00000055 [p=0000004b fl=2 nc=0 na=1]
[ +0.001015] FS-Cache: N-cookie d=00000000a8cdaa2f{9p.inode} n=00000000b703c03b
[ +0.001048] FS-Cache: N-key=[8] 'e5405c0100000000'
[ +2.246469] FS-Cache: Duplicate cookie detected
[ +0.000831] FS-Cache: O-cookie c=0000004c [p=0000004b fl=226 nc=0 na=1]
[ +0.001017] FS-Cache: O-cookie d=00000000a8cdaa2f{9p.inode} n=00000000bb4b91ea
[ +0.001149] FS-Cache: O-key=[8] 'e4405c0100000000'
[ +0.000878] FS-Cache: N-cookie c=00000057 [p=0000004b fl=2 nc=0 na=1]
[ +0.001015] FS-Cache: N-cookie d=00000000a8cdaa2f{9p.inode} n=000000008e2f8fe5
[ +0.001216] FS-Cache: N-key=[8] 'e4405c0100000000'
[ +0.409874] FS-Cache: Duplicate cookie detected
[ +0.000810] FS-Cache: O-cookie c=00000051 [p=0000004b fl=226 nc=0 na=1]
[ +0.000962] FS-Cache: O-cookie d=00000000a8cdaa2f{9p.inode} n=000000008545b5a7
[ +0.001083] FS-Cache: O-key=[8] 'ea405c0100000000'
[ +0.000751] FS-Cache: N-cookie c=00000058 [p=0000004b fl=2 nc=0 na=1]
[ +0.001137] FS-Cache: N-cookie d=00000000a8cdaa2f{9p.inode} n=00000000804f7cf5
[ +0.001117] FS-Cache: N-key=[8] 'ea405c0100000000'
[Apr29 12:22] overlayfs: '/var/lib/containers/storage/overlay/l/Q2QJNMTVZL6GMULS36RA5ZJGSA' not a directory
[ +0.139125] overlayfs: '/var/lib/containers/storage/overlay/l/Q2QJNMTVZL6GMULS36RA5ZJGSA' not a directory
==> etcd [f87e16673fad4748fc3431ca613237d1244ca35397a18f8cc52a6f1a55706439] <==
2024-04-29 12:31:39.223534 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-04-29 12:31:49.223507 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-04-29 12:31:59.223579 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-04-29 12:32:09.223449 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-04-29 12:32:19.223728 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-04-29 12:32:29.223635 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-04-29 12:32:39.223539 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-04-29 12:32:49.223522 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-04-29 12:32:59.223586 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-04-29 12:33:09.223550 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-04-29 12:33:19.223659 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-04-29 12:33:29.223543 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-04-29 12:33:39.223520 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-04-29 12:33:49.223564 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-04-29 12:33:59.223495 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-04-29 12:34:09.223740 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-04-29 12:34:19.223549 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-04-29 12:34:29.223564 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-04-29 12:34:39.223593 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-04-29 12:34:49.223537 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-04-29 12:34:59.223535 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-04-29 12:35:09.223562 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-04-29 12:35:19.223547 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-04-29 12:35:29.223502 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2024-04-29 12:35:39.223759 I | etcdserver/api/etcdhttp: /health OK (status code 200)
==> kernel <==
12:35:45 up 8:18, 0 users, load average: 1.09, 1.47, 1.91
Linux old-k8s-version-425197 5.15.0-1058-aws #64~20.04.1-Ubuntu SMP Tue Apr 9 11:11:55 UTC 2024 aarch64 aarch64 aarch64 GNU/Linux
PRETTY_NAME="Ubuntu 22.04.4 LTS"
==> kindnet [b187065048c48a70de847611a7bfa1e7d604a1f06e81f41522e2c4623edd5594] <==
I0429 12:33:39.300514 1 main.go:227] handling current node
I0429 12:33:49.318163 1 main.go:223] Handling node with IPs: map[192.168.85.2:{}]
I0429 12:33:49.318193 1 main.go:227] handling current node
I0429 12:33:59.327442 1 main.go:223] Handling node with IPs: map[192.168.85.2:{}]
I0429 12:33:59.327472 1 main.go:227] handling current node
I0429 12:34:09.343776 1 main.go:223] Handling node with IPs: map[192.168.85.2:{}]
I0429 12:34:09.343883 1 main.go:227] handling current node
I0429 12:34:19.360566 1 main.go:223] Handling node with IPs: map[192.168.85.2:{}]
I0429 12:34:19.360595 1 main.go:227] handling current node
I0429 12:34:29.368977 1 main.go:223] Handling node with IPs: map[192.168.85.2:{}]
I0429 12:34:29.369005 1 main.go:227] handling current node
I0429 12:34:39.384169 1 main.go:223] Handling node with IPs: map[192.168.85.2:{}]
I0429 12:34:39.384195 1 main.go:227] handling current node
I0429 12:34:49.401859 1 main.go:223] Handling node with IPs: map[192.168.85.2:{}]
I0429 12:34:49.401886 1 main.go:227] handling current node
I0429 12:34:59.412641 1 main.go:223] Handling node with IPs: map[192.168.85.2:{}]
I0429 12:34:59.412768 1 main.go:227] handling current node
I0429 12:35:09.425418 1 main.go:223] Handling node with IPs: map[192.168.85.2:{}]
I0429 12:35:09.425450 1 main.go:227] handling current node
I0429 12:35:19.432096 1 main.go:223] Handling node with IPs: map[192.168.85.2:{}]
I0429 12:35:19.432124 1 main.go:227] handling current node
I0429 12:35:29.444714 1 main.go:223] Handling node with IPs: map[192.168.85.2:{}]
I0429 12:35:29.444742 1 main.go:227] handling current node
I0429 12:35:39.448300 1 main.go:223] Handling node with IPs: map[192.168.85.2:{}]
I0429 12:35:39.448334 1 main.go:227] handling current node
==> kube-apiserver [f70d0c48d399667aeefaece1ef554897ebeb68eb674e2b89d699347639d7798f] <==
I0429 12:32:34.673584 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0429 12:32:34.673592 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
W0429 12:32:59.109694 1 handler_proxy.go:102] no RequestInfo found in the context
E0429 12:32:59.109769 1 controller.go:116] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
I0429 12:32:59.109777 1 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
I0429 12:33:11.953891 1 client.go:360] parsed scheme: "passthrough"
I0429 12:33:11.953935 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0429 12:33:11.953943 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0429 12:33:50.508423 1 client.go:360] parsed scheme: "passthrough"
I0429 12:33:50.508465 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0429 12:33:50.508473 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0429 12:34:25.509463 1 client.go:360] parsed scheme: "passthrough"
I0429 12:34:25.509519 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0429 12:34:25.509531 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
W0429 12:34:57.203936 1 handler_proxy.go:102] no RequestInfo found in the context
E0429 12:34:57.204002 1 controller.go:116] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
I0429 12:34:57.204010 1 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
I0429 12:35:01.731158 1 client.go:360] parsed scheme: "passthrough"
I0429 12:35:01.731278 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0429 12:35:01.731312 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0429 12:35:36.958347 1 client.go:360] parsed scheme: "passthrough"
I0429 12:35:36.958395 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0429 12:35:36.958404 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
==> kube-controller-manager [f54a7f3a396ba3db9133a1183e07c7fc6d06a8419cfc3ff1a57aa605a963a445] <==
W0429 12:31:19.856036 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0429 12:31:43.504517 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0429 12:31:51.506452 1 request.go:655] Throttling request took 1.048342084s, request: GET:https://192.168.85.2:8443/apis/extensions/v1beta1?timeout=32s
W0429 12:31:52.359039 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0429 12:32:14.009347 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0429 12:32:24.009573 1 request.go:655] Throttling request took 1.048384213s, request: GET:https://192.168.85.2:8443/apis/extensions/v1beta1?timeout=32s
W0429 12:32:24.860910 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0429 12:32:44.511111 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0429 12:32:56.511259 1 request.go:655] Throttling request took 1.04830499s, request: GET:https://192.168.85.2:8443/apis/autoscaling/v1?timeout=32s
W0429 12:32:57.362700 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0429 12:33:15.014636 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0429 12:33:29.013121 1 request.go:655] Throttling request took 1.048444456s, request: GET:https://192.168.85.2:8443/apis/autoscaling/v1?timeout=32s
W0429 12:33:29.864930 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0429 12:33:45.526382 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0429 12:34:01.515414 1 request.go:655] Throttling request took 1.048314575s, request: GET:https://192.168.85.2:8443/apis/extensions/v1beta1?timeout=32s
W0429 12:34:02.366801 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0429 12:34:16.028339 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0429 12:34:34.017207 1 request.go:655] Throttling request took 1.048381083s, request: GET:https://192.168.85.2:8443/apis/extensions/v1beta1?timeout=32s
W0429 12:34:34.868597 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0429 12:34:46.530290 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0429 12:35:06.519066 1 request.go:655] Throttling request took 1.048336649s, request: GET:https://192.168.85.2:8443/apis/coordination.k8s.io/v1beta1?timeout=32s
W0429 12:35:07.371615 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0429 12:35:17.032224 1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
I0429 12:35:39.022058 1 request.go:655] Throttling request took 1.048189423s, request: GET:https://192.168.85.2:8443/apis/extensions/v1beta1?timeout=32s
W0429 12:35:39.873491 1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
==> kube-proxy [18f81edeecda84f01c57c2228b6bbacaea535fd1209a9525e4f4eb7e1ccec852] <==
I0429 12:27:27.544645 1 node.go:172] Successfully retrieved node IP: 192.168.85.2
I0429 12:27:27.544945 1 server_others.go:142] kube-proxy node IP is an IPv4 address (192.168.85.2), assume IPv4 operation
W0429 12:27:27.573050 1 server_others.go:578] Unknown proxy mode "", assuming iptables proxy
I0429 12:27:27.573215 1 server_others.go:185] Using iptables Proxier.
I0429 12:27:27.573533 1 server.go:650] Version: v1.20.0
I0429 12:27:27.577527 1 config.go:315] Starting service config controller
I0429 12:27:27.577547 1 shared_informer.go:240] Waiting for caches to sync for service config
I0429 12:27:27.577817 1 config.go:224] Starting endpoint slice config controller
I0429 12:27:27.577831 1 shared_informer.go:240] Waiting for caches to sync for endpoint slice config
I0429 12:27:27.679476 1 shared_informer.go:247] Caches are synced for endpoint slice config
I0429 12:27:27.679715 1 shared_informer.go:247] Caches are synced for service config
I0429 12:29:59.992552 1 node.go:172] Successfully retrieved node IP: 192.168.85.2
I0429 12:29:59.992635 1 server_others.go:142] kube-proxy node IP is an IPv4 address (192.168.85.2), assume IPv4 operation
W0429 12:30:00.156265 1 server_others.go:578] Unknown proxy mode "", assuming iptables proxy
I0429 12:30:00.156536 1 server_others.go:185] Using iptables Proxier.
I0429 12:30:00.156905 1 server.go:650] Version: v1.20.0
I0429 12:30:00.158007 1 config.go:315] Starting service config controller
I0429 12:30:00.158145 1 shared_informer.go:240] Waiting for caches to sync for service config
I0429 12:30:00.158208 1 config.go:224] Starting endpoint slice config controller
I0429 12:30:00.158242 1 shared_informer.go:240] Waiting for caches to sync for endpoint slice config
I0429 12:30:00.361357 1 shared_informer.go:247] Caches are synced for endpoint slice config
I0429 12:30:00.361733 1 shared_informer.go:247] Caches are synced for service config
==> kube-scheduler [2d3031452f789fb6a9b7327ac93e3217d5bdc6b6383542150d20d2538540820b] <==
E0429 12:27:07.417420 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
E0429 12:27:07.417548 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1beta1.PodDisruptionBudget: failed to list *v1beta1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
E0429 12:27:07.417635 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
E0429 12:27:07.431480 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
E0429 12:27:07.431595 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
E0429 12:27:07.431701 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
E0429 12:27:07.431792 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
E0429 12:27:07.431893 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
E0429 12:27:07.433009 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
E0429 12:27:08.267619 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
E0429 12:27:08.332489 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
E0429 12:27:08.360306 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
E0429 12:27:08.396804 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
E0429 12:27:08.396904 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
I0429 12:27:09.004938 1 shared_informer.go:247] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0429 12:29:52.392630 1 serving.go:331] Generated self-signed cert in-memory
W0429 12:29:56.197858 1 requestheader_controller.go:193] Unable to get configmap/extension-apiserver-authentication in kube-system. Usually fixed by 'kubectl create rolebinding -n kube-system ROLEBINDING_NAME --role=extension-apiserver-authentication-reader --serviceaccount=YOUR_NS:YOUR_SA'
W0429 12:29:56.197911 1 authentication.go:332] Error looking up in-cluster authentication configuration: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot get resource "configmaps" in API group "" in the namespace "kube-system"
W0429 12:29:56.197927 1 authentication.go:333] Continuing without authentication configuration. This may treat all requests as anonymous.
W0429 12:29:56.197933 1 authentication.go:334] To require authentication configuration lookup to succeed, set --authentication-tolerate-lookup-failure=false
I0429 12:29:56.442614 1 configmap_cafile_content.go:202] Starting client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0429 12:29:56.442650 1 shared_informer.go:240] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0429 12:29:56.442812 1 secure_serving.go:197] Serving securely on 127.0.0.1:10259
I0429 12:29:56.451210 1 tlsconfig.go:240] Starting DynamicServingCertificateController
I0429 12:29:56.642837 1 shared_informer.go:247] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
==> kubelet <==
Apr 29 12:34:14 old-k8s-version-425197 kubelet[751]: E0429 12:34:14.211820 751 pod_workers.go:191] Error syncing pod a940d36c-f69c-494d-a918-07d04aa421aa ("metrics-server-9975d5f86-jgp2v_kube-system(a940d36c-f69c-494d-a918-07d04aa421aa)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Apr 29 12:34:27 old-k8s-version-425197 kubelet[751]: I0429 12:34:27.210936 751 scope.go:95] [topologymanager] RemoveContainer - Container ID: cee29e4ac7387e8c123612f3ca5f03d8916a985a35e561c6bdbd2376b5b3030a
Apr 29 12:34:27 old-k8s-version-425197 kubelet[751]: E0429 12:34:27.211244 751 pod_workers.go:191] Error syncing pod 82bfd63e-9627-4725-9f84-902d955704d9 ("dashboard-metrics-scraper-8d5bb5db8-xlb6n_kubernetes-dashboard(82bfd63e-9627-4725-9f84-902d955704d9)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xlb6n_kubernetes-dashboard(82bfd63e-9627-4725-9f84-902d955704d9)"
Apr 29 12:34:27 old-k8s-version-425197 kubelet[751]: E0429 12:34:27.212498 751 pod_workers.go:191] Error syncing pod a940d36c-f69c-494d-a918-07d04aa421aa ("metrics-server-9975d5f86-jgp2v_kube-system(a940d36c-f69c-494d-a918-07d04aa421aa)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Apr 29 12:34:38 old-k8s-version-425197 kubelet[751]: I0429 12:34:38.210759 751 scope.go:95] [topologymanager] RemoveContainer - Container ID: cee29e4ac7387e8c123612f3ca5f03d8916a985a35e561c6bdbd2376b5b3030a
Apr 29 12:34:38 old-k8s-version-425197 kubelet[751]: E0429 12:34:38.211089 751 pod_workers.go:191] Error syncing pod 82bfd63e-9627-4725-9f84-902d955704d9 ("dashboard-metrics-scraper-8d5bb5db8-xlb6n_kubernetes-dashboard(82bfd63e-9627-4725-9f84-902d955704d9)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xlb6n_kubernetes-dashboard(82bfd63e-9627-4725-9f84-902d955704d9)"
Apr 29 12:34:40 old-k8s-version-425197 kubelet[751]: E0429 12:34:40.211661 751 pod_workers.go:191] Error syncing pod a940d36c-f69c-494d-a918-07d04aa421aa ("metrics-server-9975d5f86-jgp2v_kube-system(a940d36c-f69c-494d-a918-07d04aa421aa)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Apr 29 12:34:46 old-k8s-version-425197 kubelet[751]: E0429 12:34:46.253196 751 container_manager_linux.go:533] failed to find cgroups of kubelet - cpu and memory cgroup hierarchy not unified. cpu: /docker/9ec77e830d08baef23626f31b5ae4f87186a167e012dfa15a04ef645805d0496, memory: /docker/9ec77e830d08baef23626f31b5ae4f87186a167e012dfa15a04ef645805d0496/system.slice/kubelet.service
Apr 29 12:34:52 old-k8s-version-425197 kubelet[751]: I0429 12:34:52.210864 751 scope.go:95] [topologymanager] RemoveContainer - Container ID: cee29e4ac7387e8c123612f3ca5f03d8916a985a35e561c6bdbd2376b5b3030a
Apr 29 12:34:52 old-k8s-version-425197 kubelet[751]: E0429 12:34:52.211238 751 pod_workers.go:191] Error syncing pod 82bfd63e-9627-4725-9f84-902d955704d9 ("dashboard-metrics-scraper-8d5bb5db8-xlb6n_kubernetes-dashboard(82bfd63e-9627-4725-9f84-902d955704d9)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xlb6n_kubernetes-dashboard(82bfd63e-9627-4725-9f84-902d955704d9)"
Apr 29 12:34:55 old-k8s-version-425197 kubelet[751]: E0429 12:34:55.211712 751 pod_workers.go:191] Error syncing pod a940d36c-f69c-494d-a918-07d04aa421aa ("metrics-server-9975d5f86-jgp2v_kube-system(a940d36c-f69c-494d-a918-07d04aa421aa)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Apr 29 12:35:03 old-k8s-version-425197 kubelet[751]: I0429 12:35:03.210825 751 scope.go:95] [topologymanager] RemoveContainer - Container ID: cee29e4ac7387e8c123612f3ca5f03d8916a985a35e561c6bdbd2376b5b3030a
Apr 29 12:35:03 old-k8s-version-425197 kubelet[751]: E0429 12:35:03.211147 751 pod_workers.go:191] Error syncing pod 82bfd63e-9627-4725-9f84-902d955704d9 ("dashboard-metrics-scraper-8d5bb5db8-xlb6n_kubernetes-dashboard(82bfd63e-9627-4725-9f84-902d955704d9)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xlb6n_kubernetes-dashboard(82bfd63e-9627-4725-9f84-902d955704d9)"
Apr 29 12:35:07 old-k8s-version-425197 kubelet[751]: E0429 12:35:07.211697 751 pod_workers.go:191] Error syncing pod a940d36c-f69c-494d-a918-07d04aa421aa ("metrics-server-9975d5f86-jgp2v_kube-system(a940d36c-f69c-494d-a918-07d04aa421aa)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Apr 29 12:35:14 old-k8s-version-425197 kubelet[751]: I0429 12:35:14.210876 751 scope.go:95] [topologymanager] RemoveContainer - Container ID: cee29e4ac7387e8c123612f3ca5f03d8916a985a35e561c6bdbd2376b5b3030a
Apr 29 12:35:14 old-k8s-version-425197 kubelet[751]: E0429 12:35:14.212381 751 pod_workers.go:191] Error syncing pod 82bfd63e-9627-4725-9f84-902d955704d9 ("dashboard-metrics-scraper-8d5bb5db8-xlb6n_kubernetes-dashboard(82bfd63e-9627-4725-9f84-902d955704d9)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xlb6n_kubernetes-dashboard(82bfd63e-9627-4725-9f84-902d955704d9)"
Apr 29 12:35:22 old-k8s-version-425197 kubelet[751]: E0429 12:35:22.212000 751 pod_workers.go:191] Error syncing pod a940d36c-f69c-494d-a918-07d04aa421aa ("metrics-server-9975d5f86-jgp2v_kube-system(a940d36c-f69c-494d-a918-07d04aa421aa)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
Apr 29 12:35:27 old-k8s-version-425197 kubelet[751]: I0429 12:35:27.210820 751 scope.go:95] [topologymanager] RemoveContainer - Container ID: cee29e4ac7387e8c123612f3ca5f03d8916a985a35e561c6bdbd2376b5b3030a
Apr 29 12:35:27 old-k8s-version-425197 kubelet[751]: E0429 12:35:27.211183 751 pod_workers.go:191] Error syncing pod 82bfd63e-9627-4725-9f84-902d955704d9 ("dashboard-metrics-scraper-8d5bb5db8-xlb6n_kubernetes-dashboard(82bfd63e-9627-4725-9f84-902d955704d9)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xlb6n_kubernetes-dashboard(82bfd63e-9627-4725-9f84-902d955704d9)"
Apr 29 12:35:37 old-k8s-version-425197 kubelet[751]: E0429 12:35:37.233956 751 remote_image.go:113] PullImage "fake.domain/registry.k8s.io/echoserver:1.4" from image service failed: rpc error: code = Unknown desc = pinging container registry fake.domain: Get "https://fake.domain/v2/": dial tcp: lookup fake.domain: no such host
Apr 29 12:35:37 old-k8s-version-425197 kubelet[751]: E0429 12:35:37.234005 751 kuberuntime_image.go:51] Pull image "fake.domain/registry.k8s.io/echoserver:1.4" failed: rpc error: code = Unknown desc = pinging container registry fake.domain: Get "https://fake.domain/v2/": dial tcp: lookup fake.domain: no such host
Apr 29 12:35:37 old-k8s-version-425197 kubelet[751]: E0429 12:35:37.234135 751 kuberuntime_manager.go:829] container &Container{Name:metrics-server,Image:fake.domain/registry.k8s.io/echoserver:1.4,Command:[],Args:[--cert-dir=/tmp --secure-port=4443 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --kubelet-use-node-status-port --metric-resolution=60s --kubelet-insecure-tls],WorkingDir:,Ports:[]ContainerPort{ContainerPort{Name:https,HostPort:0,ContainerPort:4443,Protocol:TCP,HostIP:,},},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{cpu: {{100 -3} {<nil>} 100m DecimalSI},memory: {{209715200 0} {<nil>} BinarySI},},},VolumeMounts:[]VolumeMount{VolumeMount{Name:tmp-dir,ReadOnly:false,MountPath:/tmp,SubPath:,MountPropagation:nil,SubPathExpr:,},VolumeMount{Name:metrics-server-token-6n4sr,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,},},LivenessProbe:&Probe{Handler:Handler{Exec
:nil,HTTPGet:&HTTPGetAction{Path:/livez,Port:{1 0 https},Host:,Scheme:HTTPS,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,},InitialDelaySeconds:0,TimeoutSeconds:1,PeriodSeconds:10,SuccessThreshold:1,FailureThreshold:3,},ReadinessProbe:&Probe{Handler:Handler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/readyz,Port:{1 0 https},Host:,Scheme:HTTPS,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,},InitialDelaySeconds:0,TimeoutSeconds:1,PeriodSeconds:10,SuccessThreshold:1,FailureThreshold:3,},Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:nil,Privileged:nil,SELinuxOptions:nil,RunAsUser:*1000,RunAsNonRoot:*true,ReadOnlyRootFilesystem:*true,AllowPrivilegeEscalation:nil,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,} start failed in pod metrics-server-9975d5f86-jgp2v_kube-system(a940d36
c-f69c-494d-a918-07d04aa421aa): ErrImagePull: rpc error: code = Unknown desc = pinging container registry fake.domain: Get "https://fake.domain/v2/": dial tcp: lookup fake.domain: no such host
Apr 29 12:35:37 old-k8s-version-425197 kubelet[751]: E0429 12:35:37.234163 751 pod_workers.go:191] Error syncing pod a940d36c-f69c-494d-a918-07d04aa421aa ("metrics-server-9975d5f86-jgp2v_kube-system(a940d36c-f69c-494d-a918-07d04aa421aa)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = pinging container registry fake.domain: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain: no such host"
Apr 29 12:35:41 old-k8s-version-425197 kubelet[751]: I0429 12:35:41.210824 751 scope.go:95] [topologymanager] RemoveContainer - Container ID: cee29e4ac7387e8c123612f3ca5f03d8916a985a35e561c6bdbd2376b5b3030a
Apr 29 12:35:41 old-k8s-version-425197 kubelet[751]: E0429 12:35:41.211171 751 pod_workers.go:191] Error syncing pod 82bfd63e-9627-4725-9f84-902d955704d9 ("dashboard-metrics-scraper-8d5bb5db8-xlb6n_kubernetes-dashboard(82bfd63e-9627-4725-9f84-902d955704d9)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-xlb6n_kubernetes-dashboard(82bfd63e-9627-4725-9f84-902d955704d9)"
==> kubernetes-dashboard [8e449405f978982d5dbc2fab079a55aed290a3bb6c162ea759272192a3d96fa9] <==
2024/04/29 12:30:22 Starting overwatch
2024/04/29 12:30:22 Using namespace: kubernetes-dashboard
2024/04/29 12:30:22 Using in-cluster config to connect to apiserver
2024/04/29 12:30:22 Using secret token for csrf signing
2024/04/29 12:30:22 Initializing csrf token from kubernetes-dashboard-csrf secret
2024/04/29 12:30:22 Empty token. Generating and storing in a secret kubernetes-dashboard-csrf
2024/04/29 12:30:22 Successful initial request to the apiserver, version: v1.20.0
2024/04/29 12:30:22 Generating JWE encryption key
2024/04/29 12:30:22 New synchronizer has been registered: kubernetes-dashboard-key-holder-kubernetes-dashboard. Starting
2024/04/29 12:30:22 Starting secret synchronizer for kubernetes-dashboard-key-holder in namespace kubernetes-dashboard
2024/04/29 12:30:23 Initializing JWE encryption key from synchronized object
2024/04/29 12:30:23 Creating in-cluster Sidecar client
2024/04/29 12:30:23 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/04/29 12:30:23 Serving insecurely on HTTP port: 9090
2024/04/29 12:30:53 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/04/29 12:31:23 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/04/29 12:31:54 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/04/29 12:32:24 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/04/29 12:32:54 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/04/29 12:33:24 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/04/29 12:33:54 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/04/29 12:34:24 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/04/29 12:34:54 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2024/04/29 12:35:24 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
==> storage-provisioner [3ab604aa41320d5c9477a97ac38a8892497dd2dbef11c5750c4c98c0fcff96bd] <==
I0429 12:30:28.505155 1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
I0429 12:30:28.524996 1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!
I0429 12:30:28.525057 1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...
I0429 12:30:45.969222 1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath
I0429 12:30:45.969384 1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_old-k8s-version-425197_77b23491-8dd7-4cb7-8dda-d621344baa5c!
I0429 12:30:45.970152 1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"255b8207-e6f9-461c-b07c-9060f36e5434", APIVersion:"v1", ResourceVersion:"808", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' old-k8s-version-425197_77b23491-8dd7-4cb7-8dda-d621344baa5c became leader
I0429 12:30:46.070141 1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_old-k8s-version-425197_77b23491-8dd7-4cb7-8dda-d621344baa5c!
==> storage-provisioner [a8ebc8ecfe2f93123a8fd7e1b220084645143d83b644d4ac445a896b7a30c0cb] <==
I0429 12:28:14.517185 1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
I0429 12:28:14.538669 1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!
I0429 12:28:14.538808 1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...
I0429 12:28:14.569918 1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath
I0429 12:28:14.571179 1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"255b8207-e6f9-461c-b07c-9060f36e5434", APIVersion:"v1", ResourceVersion:"489", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' old-k8s-version-425197_ab236131-b432-405f-a1bd-27a023a3a669 became leader
I0429 12:28:14.573257 1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_old-k8s-version-425197_ab236131-b432-405f-a1bd-27a023a3a669!
I0429 12:28:14.674404 1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_old-k8s-version-425197_ab236131-b432-405f-a1bd-27a023a3a669!
E0429 12:29:15.573136 1 leaderelection.go:361] Failed to update lock: Put "https://10.96.0.1:443/api/v1/namespaces/kube-system/endpoints/k8s.io-minikube-hostpath": http2: server sent GOAWAY and closed the connection; LastStreamID=143, ErrCode=NO_ERROR, debug=""
I0429 12:29:58.072978 1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
F0429 12:30:28.075671 1 main.go:39] error getting server version: Get "https://10.96.0.1:443/version?timeout=32s": dial tcp 10.96.0.1:443: i/o timeout
-- /stdout --
helpers_test.go:254: (dbg) Run: out/minikube-linux-arm64 status --format={{.APIServer}} -p old-k8s-version-425197 -n old-k8s-version-425197
helpers_test.go:261: (dbg) Run: kubectl --context old-k8s-version-425197 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:272: non-running pods: metrics-server-9975d5f86-jgp2v
helpers_test.go:274: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/SecondStart]: describe non-running pods <======
helpers_test.go:277: (dbg) Run: kubectl --context old-k8s-version-425197 describe pod metrics-server-9975d5f86-jgp2v
helpers_test.go:277: (dbg) Non-zero exit: kubectl --context old-k8s-version-425197 describe pod metrics-server-9975d5f86-jgp2v: exit status 1 (118.702078ms)
** stderr **
Error from server (NotFound): pods "metrics-server-9975d5f86-jgp2v" not found
** /stderr **
helpers_test.go:279: kubectl --context old-k8s-version-425197 describe pod metrics-server-9975d5f86-jgp2v: exit status 1
--- FAIL: TestStartStop/group/old-k8s-version/serial/SecondStart (377.37s)